Result | FAILURE |
Tests | 47 failed / 840 succeeded |
Started | |
Elapsed | 46m55s |
Revision | master |
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\sExternal\sStorage\s\[Driver\:\sebs\.csi\.aws\.com\]\s\[Testpattern\:\sDynamic\sPV\s\(default\sfs\)\(allowExpansion\)\]\svolume\-expand\sVerify\sif\soffline\sPVC\sexpansion\sworks$'
test/e2e/storage/testsuites/volume_expand.go:238 k8s.io/kubernetes/test/e2e/storage/testsuites.(*volumeExpandTestSuite).DefineTests.func4() test/e2e/storage/testsuites/volume_expand.go:238 +0xe5afrom junit_01.xml
[BeforeEach] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand test/e2e/storage/framework/testsuite.go:51 [BeforeEach] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand set up framework | framework.go:178 �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m02/02/23 02:39:10.92�[0m Feb 2 02:39:10.920: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP:�[0m Building a namespace api object, basename volume-expand �[38;5;243m02/02/23 02:39:10.921�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m02/02/23 02:39:11.009�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m02/02/23 02:39:11.064�[0m [BeforeEach] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand test/e2e/framework/metrics/init/init.go:31 [It] Verify if offline PVC expansion works test/e2e/storage/testsuites/volume_expand.go:172 Feb 2 02:39:11.120: INFO: Creating resource for dynamic PV Feb 2 02:39:11.120: INFO: Using claimSize:1Gi, test suite supported size:{ 1Gi}, driver(ebs.csi.aws.com) supported size:{ 1Gi} �[1mSTEP:�[0m creating a StorageClass volume-expand-5531-e2e-scc2g46 �[38;5;243m02/02/23 02:39:11.121�[0m �[1mSTEP:�[0m creating a claim �[38;5;243m02/02/23 02:39:11.151�[0m Feb 2 02:39:11.151: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil �[1mSTEP:�[0m Creating a pod with dynamically provisioned volume �[38;5;243m02/02/23 02:39:11.214�[0m Feb 2 02:39:11.246: INFO: Waiting up to 5m0s for pod "pod-21b9918f-f4ca-4246-9fad-4e93331a4c96" in namespace "volume-expand-5531" to be "running" Feb 2 02:39:11.275: INFO: Pod "pod-21b9918f-f4ca-4246-9fad-4e93331a4c96": Phase="Pending", Reason="", readiness=false. Elapsed: 28.389198ms Feb 2 02:39:13.304: INFO: Pod "pod-21b9918f-f4ca-4246-9fad-4e93331a4c96": Phase="Pending", Reason="", readiness=false. Elapsed: 2.057513078s Feb 2 02:39:15.304: INFO: Pod "pod-21b9918f-f4ca-4246-9fad-4e93331a4c96": Phase="Pending", Reason="", readiness=false. Elapsed: 4.057708824s Feb 2 02:39:17.303: INFO: Pod "pod-21b9918f-f4ca-4246-9fad-4e93331a4c96": Phase="Pending", Reason="", readiness=false. Elapsed: 6.057315763s Feb 2 02:39:19.304: INFO: Pod "pod-21b9918f-f4ca-4246-9fad-4e93331a4c96": Phase="Pending", Reason="", readiness=false. Elapsed: 8.058109908s Feb 2 02:39:21.303: INFO: Pod "pod-21b9918f-f4ca-4246-9fad-4e93331a4c96": Phase="Pending", Reason="", readiness=false. Elapsed: 10.05732045s Feb 2 02:39:23.304: INFO: Pod "pod-21b9918f-f4ca-4246-9fad-4e93331a4c96": Phase="Pending", Reason="", readiness=false. Elapsed: 12.057822178s Feb 2 02:39:25.305: INFO: Pod "pod-21b9918f-f4ca-4246-9fad-4e93331a4c96": Phase="Running", Reason="", readiness=true. Elapsed: 14.05846761s Feb 2 02:39:25.305: INFO: Pod "pod-21b9918f-f4ca-4246-9fad-4e93331a4c96" satisfied condition "running" �[1mSTEP:�[0m Deleting the previously created pod �[38;5;243m02/02/23 02:39:25.333�[0m Feb 2 02:39:25.333: INFO: Deleting pod "pod-21b9918f-f4ca-4246-9fad-4e93331a4c96" in namespace "volume-expand-5531" Feb 2 02:39:25.367: INFO: Wait up to 5m0s for pod "pod-21b9918f-f4ca-4246-9fad-4e93331a4c96" to be fully deleted �[1mSTEP:�[0m Expanding current pvc �[38;5;243m02/02/23 02:39:27.426�[0m Feb 2 02:39:27.426: INFO: currentPvcSize {{1073741824 0} {<nil>} 1Gi BinarySI}, newSize {{2147483648 0} {<nil>} BinarySI} �[1mSTEP:�[0m Waiting for cloudprovider resize to finish �[38;5;243m02/02/23 02:39:27.485�[0m �[1mSTEP:�[0m Checking for conditions on pvc �[38;5;243m02/02/23 02:39:31.547�[0m �[1mSTEP:�[0m Creating a new pod with same volume �[38;5;243m02/02/23 02:39:31.575�[0m Feb 2 02:39:31.605: INFO: Waiting up to 10m0s for pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f" in namespace "volume-expand-5531" to be "running" Feb 2 02:39:31.634: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 29.018978ms Feb 2 02:39:33.665: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 2.060188942s Feb 2 02:39:35.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 4.058229466s Feb 2 02:39:37.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 6.058133084s Feb 2 02:39:39.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 8.058305016s Feb 2 02:39:41.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 10.05900586s Feb 2 02:39:43.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 12.058708675s Feb 2 02:39:45.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 14.058614721s Feb 2 02:39:47.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 16.058420236s Feb 2 02:39:49.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 18.058517166s Feb 2 02:39:51.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 20.058290583s Feb 2 02:39:53.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 22.05821022s Feb 2 02:39:55.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 24.058649038s Feb 2 02:39:57.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 26.058450272s Feb 2 02:39:59.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 28.058144561s Feb 2 02:40:01.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 30.058676232s Feb 2 02:40:03.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 32.058516149s Feb 2 02:40:05.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 34.0578074s Feb 2 02:40:07.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 36.058382283s Feb 2 02:40:09.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 38.057894837s Feb 2 02:40:11.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 40.058486759s Feb 2 02:40:13.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 42.058141716s Feb 2 02:40:15.665: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 44.059386973s Feb 2 02:40:17.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 46.058484518s Feb 2 02:40:19.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 48.058736255s Feb 2 02:40:21.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 50.058382688s Feb 2 02:40:23.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 52.058367409s Feb 2 02:40:25.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 54.05872468s Feb 2 02:40:27.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 56.058450037s Feb 2 02:40:29.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 58.057950683s Feb 2 02:40:31.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.057730722s Feb 2 02:40:33.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.058470522s Feb 2 02:40:35.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.058161068s Feb 2 02:40:37.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.058108485s Feb 2 02:40:39.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.057622767s Feb 2 02:40:41.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.058278424s Feb 2 02:40:43.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.058540196s Feb 2 02:40:45.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.058418833s Feb 2 02:40:47.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.058355998s Feb 2 02:40:49.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.058197373s Feb 2 02:40:51.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.057792773s Feb 2 02:40:53.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.05802484s Feb 2 02:40:55.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.058380968s Feb 2 02:40:57.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.058480047s Feb 2 02:40:59.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.058452372s Feb 2 02:41:01.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.058509681s Feb 2 02:41:03.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.058416213s Feb 2 02:41:05.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.057816247s Feb 2 02:41:07.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.058758921s Feb 2 02:41:09.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.058763583s Feb 2 02:41:11.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.058275886s Feb 2 02:41:13.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.057437746s Feb 2 02:41:15.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.058391616s Feb 2 02:41:17.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.05853314s Feb 2 02:41:19.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.058345063s Feb 2 02:41:21.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.057723907s Feb 2 02:41:23.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.058351996s Feb 2 02:41:25.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.058240076s Feb 2 02:41:27.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.05812748s Feb 2 02:41:29.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.05819211s Feb 2 02:41:31.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.057554926s Feb 2 02:41:33.690: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.085249329s Feb 2 02:41:35.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.058218395s Feb 2 02:41:37.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.058547426s Feb 2 02:41:39.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.058104732s Feb 2 02:41:41.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.05823961s Feb 2 02:41:43.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.057541027s Feb 2 02:41:45.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.057341149s Feb 2 02:41:47.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.058521752s Feb 2 02:41:49.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.057361153s Feb 2 02:41:51.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.059058318s Feb 2 02:41:53.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.058559937s Feb 2 02:41:55.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.057615213s Feb 2 02:41:57.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.057886226s Feb 2 02:41:59.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.058245398s Feb 2 02:42:01.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.058570223s Feb 2 02:42:03.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.058285525s Feb 2 02:42:05.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.057671185s Feb 2 02:42:07.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.05814371s Feb 2 02:42:09.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.057488815s Feb 2 02:42:11.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.0580858s Feb 2 02:42:13.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.058029727s Feb 2 02:42:15.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.058050269s Feb 2 02:42:17.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.058491239s Feb 2 02:42:19.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.058017918s Feb 2 02:42:21.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.057546676s Feb 2 02:42:23.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.057909237s Feb 2 02:42:25.665: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.059643085s Feb 2 02:42:27.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.058476374s Feb 2 02:42:29.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.058423772s Feb 2 02:42:31.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.058312357s Feb 2 02:42:33.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.058426758s Feb 2 02:42:35.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.058234059s Feb 2 02:42:37.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.057799214s Feb 2 02:42:39.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.05831118s Feb 2 02:42:41.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.058264054s Feb 2 02:42:43.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.058463613s Feb 2 02:42:45.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.058030939s Feb 2 02:42:47.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.058505974s Feb 2 02:42:49.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.058318314s Feb 2 02:42:51.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.057552516s Feb 2 02:42:53.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.058186451s Feb 2 02:42:55.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.058194722s Feb 2 02:42:57.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.05794924s Feb 2 02:42:59.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.058453884s Feb 2 02:43:01.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.058534931s Feb 2 02:43:03.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.058363065s Feb 2 02:43:05.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.057599573s Feb 2 02:43:07.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.058527831s Feb 2 02:43:09.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.0585167s Feb 2 02:43:11.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.058221894s Feb 2 02:43:13.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.0590565s Feb 2 02:43:15.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.058329557s Feb 2 02:43:17.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.058396189s Feb 2 02:43:19.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.058195479s Feb 2 02:43:21.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.058317124s Feb 2 02:43:23.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.058569956s Feb 2 02:43:25.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.058323689s Feb 2 02:43:27.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.057992427s Feb 2 02:43:29.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.057506667s Feb 2 02:43:31.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.058533898s Feb 2 02:43:33.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.057409693s Feb 2 02:43:35.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.058556556s Feb 2 02:43:37.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.058352637s Feb 2 02:43:39.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.057871404s Feb 2 02:43:41.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.058419137s Feb 2 02:43:43.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.058248633s Feb 2 02:43:45.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.058443591s Feb 2 02:43:47.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.058374369s Feb 2 02:43:49.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.057668523s Feb 2 02:43:51.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.05835665s Feb 2 02:43:53.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.058248028s Feb 2 02:43:55.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.05812195s Feb 2 02:43:57.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.05775802s Feb 2 02:43:59.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.058435372s Feb 2 02:44:01.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.057487377s Feb 2 02:44:03.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.058402746s Feb 2 02:44:05.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.057754617s Feb 2 02:44:07.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.057894462s Feb 2 02:44:09.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.058132637s Feb 2 02:44:11.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.05823153s Feb 2 02:44:13.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.058368187s Feb 2 02:44:15.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.058490212s Feb 2 02:44:17.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.058480159s Feb 2 02:44:19.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.058475041s Feb 2 02:44:21.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.058005346s Feb 2 02:44:23.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.058293953s Feb 2 02:44:25.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.058260262s Feb 2 02:44:27.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.05817111s Feb 2 02:44:29.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.058136354s Feb 2 02:44:31.671: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.065538512s Feb 2 02:44:33.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m2.058363781s Feb 2 02:44:35.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m4.058071995s Feb 2 02:44:37.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m6.058170718s Feb 2 02:44:39.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m8.057460301s Feb 2 02:44:41.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m10.057994003s Feb 2 02:44:43.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m12.05828242s Feb 2 02:44:45.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m14.058306175s Feb 2 02:44:47.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m16.05848738s Feb 2 02:44:49.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m18.058058847s Feb 2 02:44:51.672: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m20.066658061s Feb 2 02:44:53.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m22.057886909s Feb 2 02:44:55.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m24.059144441s Feb 2 02:44:57.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m26.058299986s Feb 2 02:44:59.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m28.059296022s Feb 2 02:45:01.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m30.058061572s Feb 2 02:45:03.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m32.05751318s Feb 2 02:45:05.669: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m34.063684642s Feb 2 02:45:07.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m36.058310928s Feb 2 02:45:09.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m38.058331045s Feb 2 02:45:11.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m40.05821497s Feb 2 02:45:13.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m42.058080435s Feb 2 02:45:15.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m44.058341169s Feb 2 02:45:17.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m46.057791644s Feb 2 02:45:19.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m48.057991187s Feb 2 02:45:21.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m50.058002458s Feb 2 02:45:23.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m52.058472697s Feb 2 02:45:25.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m54.058264592s Feb 2 02:45:27.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m56.058392311s Feb 2 02:45:29.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m58.057858112s Feb 2 02:45:31.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m0.058253984s Feb 2 02:45:33.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m2.057966721s Feb 2 02:45:35.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m4.058253738s Feb 2 02:45:37.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m6.057517229s Feb 2 02:45:39.673: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m8.067470625s Feb 2 02:45:41.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m10.058100521s Feb 2 02:45:43.666: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m12.060446643s Feb 2 02:45:45.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m14.057745753s Feb 2 02:45:47.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m16.05802635s Feb 2 02:45:49.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m18.057382742s Feb 2 02:45:51.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m20.058183126s Feb 2 02:45:53.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m22.057343205s Feb 2 02:45:55.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m24.05806864s Feb 2 02:45:57.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m26.057805626s Feb 2 02:45:59.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m28.057414359s Feb 2 02:46:01.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m30.058377582s Feb 2 02:46:03.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m32.058277199s Feb 2 02:46:05.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m34.058585904s Feb 2 02:46:07.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m36.05818762s Feb 2 02:46:09.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m38.058286179s Feb 2 02:46:11.662: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m40.057268495s Feb 2 02:46:13.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m42.058077063s Feb 2 02:46:15.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m44.057971684s Feb 2 02:46:17.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m46.058273089s Feb 2 02:46:19.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m48.057995723s Feb 2 02:46:21.670: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m50.065265389s Feb 2 02:46:23.662: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m52.057202831s Feb 2 02:46:25.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m54.058524505s Feb 2 02:46:27.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m56.058285161s Feb 2 02:46:29.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m58.057721366s Feb 2 02:46:31.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m0.058369033s Feb 2 02:46:33.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m2.057901133s Feb 2 02:46:35.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m4.057796745s Feb 2 02:46:37.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m6.058443021s Feb 2 02:46:39.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m8.0575826s Feb 2 02:46:41.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m10.05757936s Feb 2 02:46:43.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m12.058549903s Feb 2 02:46:45.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m14.058424224s Feb 2 02:46:47.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m16.058605711s Feb 2 02:46:49.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m18.058663271s Feb 2 02:46:51.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m20.058571049s Feb 2 02:46:53.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m22.058114027s Feb 2 02:46:55.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m24.057532993s Feb 2 02:46:57.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m26.05849685s Feb 2 02:46:59.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m28.057919718s Feb 2 02:47:01.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m30.05767228s Feb 2 02:47:03.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m32.058446917s Feb 2 02:47:05.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m34.058001664s Feb 2 02:47:07.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m36.05853013s Feb 2 02:47:09.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m38.058531263s Feb 2 02:47:11.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m40.058100403s Feb 2 02:47:13.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m42.058066058s Feb 2 02:47:15.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m44.058005779s Feb 2 02:47:17.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m46.058249117s Feb 2 02:47:19.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m48.057695299s Feb 2 02:47:21.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m50.058098927s Feb 2 02:47:23.672: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m52.067006371s Feb 2 02:47:25.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m54.058683384s Feb 2 02:47:27.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m56.058254692s Feb 2 02:47:29.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m58.05764128s Feb 2 02:47:31.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m0.058281166s Feb 2 02:47:33.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m2.058561186s Feb 2 02:47:35.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m4.0580773s Feb 2 02:47:37.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m6.05785275s Feb 2 02:47:39.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m8.058403662s Feb 2 02:47:41.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m10.058224099s Feb 2 02:47:43.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m12.058446203s Feb 2 02:47:45.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m14.058758376s Feb 2 02:47:47.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m16.058398662s Feb 2 02:47:49.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m18.058215743s Feb 2 02:47:51.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m20.058178787s Feb 2 02:47:53.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m22.058532754s Feb 2 02:47:55.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m24.057650748s Feb 2 02:47:57.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m26.058041826s Feb 2 02:47:59.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m28.058630364s Feb 2 02:48:01.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m30.05834815s Feb 2 02:48:03.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m32.057979716s Feb 2 02:48:05.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m34.058202013s Feb 2 02:48:07.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m36.058462266s Feb 2 02:48:09.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m38.058048523s Feb 2 02:48:11.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m40.058414479s Feb 2 02:48:13.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m42.058586069s Feb 2 02:48:15.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m44.058337861s Feb 2 02:48:17.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m46.05809399s Feb 2 02:48:19.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m48.058509877s Feb 2 02:48:21.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m50.058588034s Feb 2 02:48:23.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m52.05856729s Feb 2 02:48:25.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m54.057823416s Feb 2 02:48:27.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m56.057944384s Feb 2 02:48:29.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m58.058082693s Feb 2 02:48:31.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m0.057570868s Feb 2 02:48:33.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m2.058685855s Feb 2 02:48:35.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m4.058482861s Feb 2 02:48:37.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m6.057688423s Feb 2 02:48:39.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m8.057621692s Feb 2 02:48:41.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m10.058590589s Feb 2 02:48:43.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m12.058272741s Feb 2 02:48:45.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m14.058216965s Feb 2 02:48:47.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m16.057748167s Feb 2 02:48:49.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m18.057467982s Feb 2 02:48:51.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m20.05822742s Feb 2 02:48:53.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m22.057933497s Feb 2 02:48:55.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m24.058040995s Feb 2 02:48:57.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m26.058541939s Feb 2 02:48:59.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m28.057561774s Feb 2 02:49:01.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m30.057596813s Feb 2 02:49:03.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m32.05844117s Feb 2 02:49:05.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m34.058931613s Feb 2 02:49:07.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m36.058312818s Feb 2 02:49:09.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m38.058341224s Feb 2 02:49:11.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m40.058386383s Feb 2 02:49:13.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m42.058284038s Feb 2 02:49:15.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m44.058053009s Feb 2 02:49:17.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m46.058675801s Feb 2 02:49:19.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m48.057483095s Feb 2 02:49:21.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m50.058113425s Feb 2 02:49:23.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m52.057667454s Feb 2 02:49:25.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m54.057924404s Feb 2 02:49:27.664: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m56.058313424s Feb 2 02:49:29.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m58.057576125s Feb 2 02:49:31.663: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 10m0.058181556s Feb 2 02:49:31.696: INFO: Pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f": Phase="Pending", Reason="", readiness=false. Elapsed: 10m0.09091929s Feb 2 02:49:31.696: INFO: Unexpected error: while recreating pod for resizing: <*errors.errorString | 0xc000c69300>: { s: "pod \"pod-059e4fe9-a68f-4452-baaa-69b48b71743f\" is not Running: timed out while waiting for pod volume-expand-5531/pod-059e4fe9-a68f-4452-baaa-69b48b71743f to be running", } Feb 2 02:49:31.696: FAIL: while recreating pod for resizing: pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f" is not Running: timed out while waiting for pod volume-expand-5531/pod-059e4fe9-a68f-4452-baaa-69b48b71743f to be running Full Stack Trace k8s.io/kubernetes/test/e2e/storage/testsuites.(*volumeExpandTestSuite).DefineTests.func4() test/e2e/storage/testsuites/volume_expand.go:238 +0xe5a Feb 2 02:49:31.696: INFO: Deleting pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f" in namespace "volume-expand-5531" Feb 2 02:49:31.733: INFO: Wait up to 5m0s for pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f" to be fully deleted Feb 2 02:49:33.791: INFO: Deleting pod "pod-21b9918f-f4ca-4246-9fad-4e93331a4c96" in namespace "volume-expand-5531" �[1mSTEP:�[0m Deleting pod �[38;5;243m02/02/23 02:49:33.818�[0m Feb 2 02:49:33.819: INFO: Deleting pod "pod-21b9918f-f4ca-4246-9fad-4e93331a4c96" in namespace "volume-expand-5531" �[1mSTEP:�[0m Deleting pod2 �[38;5;243m02/02/23 02:49:33.846�[0m Feb 2 02:49:33.846: INFO: Deleting pod "pod-059e4fe9-a68f-4452-baaa-69b48b71743f" in namespace "volume-expand-5531" �[1mSTEP:�[0m Deleting pvc �[38;5;243m02/02/23 02:49:33.874�[0m Feb 2 02:49:33.930: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.com2znsd" Feb 2 02:49:33.963: INFO: Waiting up to 5m0s for PersistentVolume pvc-eee0fe49-00ce-4617-9ffb-38ce397b5918 to get deleted Feb 2 02:49:33.991: INFO: PersistentVolume pvc-eee0fe49-00ce-4617-9ffb-38ce397b5918 found and phase=Released (27.837426ms) Feb 2 02:49:39.020: INFO: PersistentVolume pvc-eee0fe49-00ce-4617-9ffb-38ce397b5918 found and phase=Released (5.056684795s) Feb 2 02:49:44.053: INFO: PersistentVolume pvc-eee0fe49-00ce-4617-9ffb-38ce397b5918 found and phase=Released (10.08994732s) Feb 2 02:49:49.081: INFO: PersistentVolume pvc-eee0fe49-00ce-4617-9ffb-38ce397b5918 found and phase=Released (15.118494228s) Feb 2 02:49:54.110: INFO: PersistentVolume pvc-eee0fe49-00ce-4617-9ffb-38ce397b5918 found and phase=Released (20.147064463s) Feb 2 02:49:59.139: INFO: PersistentVolume pvc-eee0fe49-00ce-4617-9ffb-38ce397b5918 found and phase=Released (25.175883699s) Feb 2 02:50:04.168: INFO: PersistentVolume pvc-eee0fe49-00ce-4617-9ffb-38ce397b5918 found and phase=Released (30.204803225s) Feb 2 02:50:09.196: INFO: PersistentVolume pvc-eee0fe49-00ce-4617-9ffb-38ce397b5918 was removed �[1mSTEP:�[0m Deleting sc �[38;5;243m02/02/23 02:50:09.196�[0m [AfterEach] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand test/e2e/framework/node/init/init.go:32 Feb 2 02:50:09.228: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand dump namespaces | framework.go:196 �[1mSTEP:�[0m dump namespace information after failure �[38;5;243m02/02/23 02:50:09.258�[0m �[1mSTEP:�[0m Collecting events from namespace "volume-expand-5531". �[38;5;243m02/02/23 02:50:09.258�[0m �[1mSTEP:�[0m Found 27 events. �[38;5;243m02/02/23 02:50:09.287�[0m Feb 2 02:50:09.287: INFO: At 2023-02-02 02:39:11 +0000 UTC - event for ebs.csi.aws.com2znsd: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding Feb 2 02:50:09.287: INFO: At 2023-02-02 02:39:11 +0000 UTC - event for ebs.csi.aws.com2znsd: {ebs.csi.aws.com_i-01b885526491052d5_d47994d4-b7e1-4596-a8c0-cb83c8f567ef } Provisioning: External provisioner is provisioning volume for claim "volume-expand-5531/ebs.csi.aws.com2znsd" Feb 2 02:50:09.287: INFO: At 2023-02-02 02:39:11 +0000 UTC - event for ebs.csi.aws.com2znsd: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "ebs.csi.aws.com" or manually created by system administrator Feb 2 02:50:09.287: INFO: At 2023-02-02 02:39:14 +0000 UTC - event for ebs.csi.aws.com2znsd: {ebs.csi.aws.com_i-01b885526491052d5_d47994d4-b7e1-4596-a8c0-cb83c8f567ef } ProvisioningSucceeded: Successfully provisioned volume pvc-eee0fe49-00ce-4617-9ffb-38ce397b5918 Feb 2 02:50:09.287: INFO: At 2023-02-02 02:39:15 +0000 UTC - event for pod-21b9918f-f4ca-4246-9fad-4e93331a4c96: {default-scheduler } Scheduled: Successfully assigned volume-expand-5531/pod-21b9918f-f4ca-4246-9fad-4e93331a4c96 to i-0fe5d857b6eb4dfe3 Feb 2 02:50:09.287: INFO: At 2023-02-02 02:39:17 +0000 UTC - event for pod-21b9918f-f4ca-4246-9fad-4e93331a4c96: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-eee0fe49-00ce-4617-9ffb-38ce397b5918" Feb 2 02:50:09.287: INFO: At 2023-02-02 02:39:22 +0000 UTC - event for pod-21b9918f-f4ca-4246-9fad-4e93331a4c96: {kubelet i-0fe5d857b6eb4dfe3} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Feb 2 02:50:09.287: INFO: At 2023-02-02 02:39:22 +0000 UTC - event for pod-21b9918f-f4ca-4246-9fad-4e93331a4c96: {kubelet i-0fe5d857b6eb4dfe3} Created: Created container write-pod Feb 2 02:50:09.287: INFO: At 2023-02-02 02:39:22 +0000 UTC - event for pod-21b9918f-f4ca-4246-9fad-4e93331a4c96: {kubelet i-0fe5d857b6eb4dfe3} Started: Started container write-pod Feb 2 02:50:09.287: INFO: At 2023-02-02 02:39:25 +0000 UTC - event for pod-21b9918f-f4ca-4246-9fad-4e93331a4c96: {kubelet i-0fe5d857b6eb4dfe3} Killing: Stopping container write-pod Feb 2 02:50:09.287: INFO: At 2023-02-02 02:39:27 +0000 UTC - event for ebs.csi.aws.com2znsd: {volume_expand } ExternalExpanding: Ignoring the PVC: didn't find a plugin capable of expanding the volume; waiting for an external controller to process this PVC. Feb 2 02:50:09.287: INFO: At 2023-02-02 02:39:27 +0000 UTC - event for ebs.csi.aws.com2znsd: {external-resizer ebs.csi.aws.com } Resizing: External resizer is resizing volume pvc-eee0fe49-00ce-4617-9ffb-38ce397b5918 Feb 2 02:50:09.287: INFO: At 2023-02-02 02:39:30 +0000 UTC - event for ebs.csi.aws.com2znsd: {external-resizer ebs.csi.aws.com } FileSystemResizeRequired: Require file system resize of volume on node Feb 2 02:50:09.287: INFO: At 2023-02-02 02:39:31 +0000 UTC - event for pod-059e4fe9-a68f-4452-baaa-69b48b71743f: {default-scheduler } Scheduled: Successfully assigned volume-expand-5531/pod-059e4fe9-a68f-4452-baaa-69b48b71743f to i-0fe5d857b6eb4dfe3 Feb 2 02:50:09.287: INFO: At 2023-02-02 02:39:39 +0000 UTC - event for pod-059e4fe9-a68f-4452-baaa-69b48b71743f: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-eee0fe49-00ce-4617-9ffb-38ce397b5918" Feb 2 02:50:09.287: INFO: At 2023-02-02 02:39:41 +0000 UTC - event for ebs.csi.aws.com2znsd: {kubelet i-0fe5d857b6eb4dfe3} FileSystemResizeSuccessful: MountVolume.NodeExpandVolume succeeded for volume "pvc-eee0fe49-00ce-4617-9ffb-38ce397b5918" i-0fe5d857b6eb4dfe3 Feb 2 02:50:09.287: INFO: At 2023-02-02 02:39:41 +0000 UTC - event for pod-059e4fe9-a68f-4452-baaa-69b48b71743f: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "bd756ef9135d1122fab887be42c126d3a1f6530ca56ce7d5eefb03cc8f8124d9": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:50:09.287: INFO: At 2023-02-02 02:39:41 +0000 UTC - event for pod-059e4fe9-a68f-4452-baaa-69b48b71743f: {kubelet i-0fe5d857b6eb4dfe3} FileSystemResizeSuccessful: MountVolume.NodeExpandVolume succeeded for volume "pvc-eee0fe49-00ce-4617-9ffb-38ce397b5918" i-0fe5d857b6eb4dfe3 Feb 2 02:50:09.287: INFO: At 2023-02-02 02:39:57 +0000 UTC - event for pod-059e4fe9-a68f-4452-baaa-69b48b71743f: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "3783ffea5a3a59af5d06415c59b949d7de4c449d6d72abb6166db798e8f5798d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:50:09.287: INFO: At 2023-02-02 02:40:11 +0000 UTC - event for pod-059e4fe9-a68f-4452-baaa-69b48b71743f: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "876cc0c1a502010ae28791063f54f885e00a276da14690d8b7e8b291f58709a9": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:50:09.287: INFO: At 2023-02-02 02:40:23 +0000 UTC - event for pod-059e4fe9-a68f-4452-baaa-69b48b71743f: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "0b00fbe368979ff3600af66d1957599b4afbaf3a7305ca61530392af5de3fcf5": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:50:09.287: INFO: At 2023-02-02 02:40:36 +0000 UTC - event for pod-059e4fe9-a68f-4452-baaa-69b48b71743f: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "5676abcf86e0f6e13c5834bbe11acc9188d8391227fce1fd5c24e427c32be4af": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:50:09.287: INFO: At 2023-02-02 02:40:47 +0000 UTC - event for pod-059e4fe9-a68f-4452-baaa-69b48b71743f: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "fa4ba049e6c65f9f0a6301f9f5848ebb8bbda3252c2bc42b5d7034cc9b886d39": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:50:09.287: INFO: At 2023-02-02 02:41:00 +0000 UTC - event for pod-059e4fe9-a68f-4452-baaa-69b48b71743f: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "1167a72809f9f1ca734b95a4a8e4d5cbd2c5393c56254117c2bf63981eaf5894": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:50:09.287: INFO: At 2023-02-02 02:41:13 +0000 UTC - event for pod-059e4fe9-a68f-4452-baaa-69b48b71743f: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "1fa694ceb2bea5ceac3601a5b0b493c9fe34f97d7a0a4ef2369ba8122424d264": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:50:09.287: INFO: At 2023-02-02 02:41:27 +0000 UTC - event for pod-059e4fe9-a68f-4452-baaa-69b48b71743f: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "7117e19f25037567044ff09be3bafa783ff2670a2357d2de6178fe484785e61d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:50:09.287: INFO: At 2023-02-02 02:41:40 +0000 UTC - event for pod-059e4fe9-a68f-4452-baaa-69b48b71743f: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "10088d5cb7433fb348db71faa54bba0704c07cab60abae93dc9a2f908e999268": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:50:09.315: INFO: POD NODE PHASE GRACE CONDITIONS Feb 2 02:50:09.315: INFO: Feb 2 02:50:09.344: INFO: Logging node info for node i-01b885526491052d5 Feb 2 02:50:09.372: INFO: Node Info: &Node{ObjectMeta:{i-01b885526491052d5 dc5fa938-4b08-4e13-a650-8859f804b492 12027 0 2023-02-02 02:32:08 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east-1 failure-domain.beta.kubernetes.io/zone:us-east-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-01b885526491052d5 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:us-east-1a topology.kubernetes.io/region:us-east-1 topology.kubernetes.io/zone:us-east-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.61.65 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-01b885526491052d5"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-02-02 02:32:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-02-02 02:32:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {aws-cloud-controller-manager Update v1 2023-02-02 02:32:44 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-02-02 02:32:44 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-02-02 02:32:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-02-02 02:50:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///us-east-1a/i-01b885526491052d5,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3918811136 0} {<nil>} 3826964Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3813953536 0} {<nil>} 3724564Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-02 02:50:01 +0000 UTC,LastTransitionTime:2023-02-02 02:32:07 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-02 02:50:01 +0000 UTC,LastTransitionTime:2023-02-02 02:32:07 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-02 02:50:01 +0000 UTC,LastTransitionTime:2023-02-02 02:32:07 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-02 02:50:01 +0000 UTC,LastTransitionTime:2023-02-02 02:32:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.61.65,},NodeAddress{Type:ExternalIP,Address:54.205.170.33,},NodeAddress{Type:InternalDNS,Address:i-01b885526491052d5.ec2.internal,},NodeAddress{Type:Hostname,Address:i-01b885526491052d5.ec2.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-205-170-33.compute-1.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec26507379484fef3914c7eb427dc82e,SystemUUID:ec265073-7948-4fef-3914-c7eb427dc82e,BootID:9d8938d3-ec44-44d3-9a12-0dbd68248bf9,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.16,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:5ffb3f7cade4ae1d8c952251abb0c8bdfa8d4d9acb2c364e763328bd6f3d06aa registry.k8s.io/etcdadm/etcd-manager:v3.0.20230201],SizeBytes:243803152,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.1],SizeBytes:135178704,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.1],SizeBytes:124995897,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.1],SizeBytes:57661752,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-beta.2],SizeBytes:43857040,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-beta.2],SizeBytes:42821718,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-beta.2],SizeBytes:4965807,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Feb 2 02:50:09.373: INFO: Logging kubelet events for node i-01b885526491052d5 Feb 2 02:50:09.404: INFO: Logging pods the kubelet thinks is on node i-01b885526491052d5 Feb 2 02:50:09.465: INFO: aws-cloud-controller-manager-q9pdm started at 2023-02-02 02:32:40 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.465: INFO: Container aws-cloud-controller-manager ready: true, restart count 0 Feb 2 02:50:09.465: INFO: kops-controller-f4d7p started at 2023-02-02 02:32:40 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.465: INFO: Container kops-controller ready: true, restart count 0 Feb 2 02:50:09.465: INFO: ebs-csi-node-d97sr started at 2023-02-02 02:32:40 +0000 UTC (0+3 container statuses recorded) Feb 2 02:50:09.465: INFO: Container ebs-plugin ready: true, restart count 0 Feb 2 02:50:09.465: INFO: Container liveness-probe ready: true, restart count 0 Feb 2 02:50:09.465: INFO: Container node-driver-registrar ready: true, restart count 0 Feb 2 02:50:09.465: INFO: dns-controller-74d4646d88-tqtjs started at 2023-02-02 02:32:41 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.465: INFO: Container dns-controller ready: true, restart count 0 Feb 2 02:50:09.465: INFO: kube-scheduler-i-01b885526491052d5 started at 2023-02-02 02:31:38 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.465: INFO: Container kube-scheduler ready: true, restart count 0 Feb 2 02:50:09.465: INFO: kube-controller-manager-i-01b885526491052d5 started at 2023-02-02 02:31:38 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.465: INFO: Container kube-controller-manager ready: true, restart count 2 Feb 2 02:50:09.465: INFO: etcd-manager-events-i-01b885526491052d5 started at 2023-02-02 02:31:38 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.465: INFO: Container etcd-manager ready: true, restart count 0 Feb 2 02:50:09.465: INFO: etcd-manager-main-i-01b885526491052d5 started at 2023-02-02 02:31:38 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.465: INFO: Container etcd-manager ready: true, restart count 0 Feb 2 02:50:09.465: INFO: cilium-lzw4c started at 2023-02-02 02:32:40 +0000 UTC (1+1 container statuses recorded) Feb 2 02:50:09.465: INFO: Init container clean-cilium-state ready: true, restart count 0 Feb 2 02:50:09.465: INFO: Container cilium-agent ready: true, restart count 1 Feb 2 02:50:09.465: INFO: ebs-csi-controller-89bddb897-hx8fh started at 2023-02-02 02:32:41 +0000 UTC (0+5 container statuses recorded) Feb 2 02:50:09.465: INFO: Container csi-attacher ready: true, restart count 0 Feb 2 02:50:09.465: INFO: Container csi-provisioner ready: true, restart count 0 Feb 2 02:50:09.465: INFO: Container csi-resizer ready: true, restart count 0 Feb 2 02:50:09.465: INFO: Container ebs-plugin ready: true, restart count 0 Feb 2 02:50:09.465: INFO: Container liveness-probe ready: true, restart count 0 Feb 2 02:50:09.465: INFO: cilium-operator-6f8d6c4bf-68pf6 started at 2023-02-02 02:32:41 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.465: INFO: Container cilium-operator ready: true, restart count 1 Feb 2 02:50:09.465: INFO: kube-apiserver-i-01b885526491052d5 started at 2023-02-02 02:31:38 +0000 UTC (0+2 container statuses recorded) Feb 2 02:50:09.465: INFO: Container healthcheck ready: true, restart count 0 Feb 2 02:50:09.465: INFO: Container kube-apiserver ready: true, restart count 1 Feb 2 02:50:09.595: INFO: Latency metrics for node i-01b885526491052d5 Feb 2 02:50:09.595: INFO: Logging node info for node i-094933bbcaafb548f Feb 2 02:50:09.623: INFO: Node Info: &Node{ObjectMeta:{i-094933bbcaafb548f f8a3e392-0d95-41f4-b73c-92cf4fc28ad0 11318 0 2023-02-02 02:33:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east-1 failure-domain.beta.kubernetes.io/zone:us-east-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-094933bbcaafb548f kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-east-1a topology.hostpath.csi/node:i-094933bbcaafb548f topology.kubernetes.io/region:us-east-1 topology.kubernetes.io/zone:us-east-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.57.122 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-8448":"i-094933bbcaafb548f","ebs.csi.aws.com":"i-094933bbcaafb548f"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-02-02 02:38:04 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-02-02 02:49:37 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-02-02 02:49:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///us-east-1a/i-094933bbcaafb548f,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078206976 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973349376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-02 02:49:43 +0000 UTC,LastTransitionTime:2023-02-02 02:33:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-02 02:49:43 +0000 UTC,LastTransitionTime:2023-02-02 02:33:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-02 02:49:43 +0000 UTC,LastTransitionTime:2023-02-02 02:33:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-02 02:49:43 +0000 UTC,LastTransitionTime:2023-02-02 02:33:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.57.122,},NodeAddress{Type:ExternalIP,Address:34.229.175.171,},NodeAddress{Type:InternalDNS,Address:i-094933bbcaafb548f.ec2.internal,},NodeAddress{Type:Hostname,Address:i-094933bbcaafb548f.ec2.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-34-229-175-171.compute-1.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2268a1fc2523b710f39d6e8dcd11f8,SystemUUID:ec2268a1-fc25-23b7-10f3-9d6e8dcd11f8,BootID:a1887cfb-af12-4b59-88c8-e5de9f1d7ef9,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.16,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-8448^3a9ca785-a2a4-11ed-8d79-b6c07b6c44d4],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-8448^3a9ca785-a2a4-11ed-8d79-b6c07b6c44d4,DevicePath:,},},Config:nil,},} Feb 2 02:50:09.624: INFO: Logging kubelet events for node i-094933bbcaafb548f Feb 2 02:50:09.654: INFO: Logging pods the kubelet thinks is on node i-094933bbcaafb548f Feb 2 02:50:09.691: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-9vt7q started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.691: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:09.691: INFO: cilium-tc4dv started at 2023-02-02 02:33:34 +0000 UTC (1+1 container statuses recorded) Feb 2 02:50:09.691: INFO: Init container clean-cilium-state ready: true, restart count 0 Feb 2 02:50:09.691: INFO: Container cilium-agent ready: true, restart count 0 Feb 2 02:50:09.691: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-d85kv started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.691: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:09.691: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-dnh8t started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.691: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:09.691: INFO: rs-zdrtm started at 2023-02-02 02:49:51 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.691: INFO: Container donothing ready: false, restart count 0 Feb 2 02:50:09.691: INFO: netserver-0 started at 2023-02-02 02:49:33 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.691: INFO: Container webserver ready: true, restart count 0 Feb 2 02:50:09.691: INFO: inline-volume-tester-ttw96 started at 2023-02-02 02:49:36 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.691: INFO: Container csi-volume-tester ready: false, restart count 0 Feb 2 02:50:09.691: INFO: coredns-559769c974-qfr7h started at 2023-02-02 02:34:23 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.691: INFO: Container coredns ready: true, restart count 0 Feb 2 02:50:09.691: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-wpbbn started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.691: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:09.691: INFO: csi-hostpathplugin-0 started at 2023-02-02 02:39:16 +0000 UTC (0+7 container statuses recorded) Feb 2 02:50:09.691: INFO: Container csi-attacher ready: true, restart count 0 Feb 2 02:50:09.691: INFO: Container csi-provisioner ready: true, restart count 0 Feb 2 02:50:09.691: INFO: Container csi-resizer ready: true, restart count 0 Feb 2 02:50:09.691: INFO: Container csi-snapshotter ready: true, restart count 0 Feb 2 02:50:09.691: INFO: Container hostpath ready: true, restart count 0 Feb 2 02:50:09.691: INFO: Container liveness-probe ready: true, restart count 0 Feb 2 02:50:09.691: INFO: Container node-driver-registrar ready: true, restart count 0 Feb 2 02:50:09.691: INFO: ebs-csi-node-vgbm6 started at 2023-02-02 02:33:34 +0000 UTC (0+3 container statuses recorded) Feb 2 02:50:09.691: INFO: Container ebs-plugin ready: true, restart count 0 Feb 2 02:50:09.691: INFO: Container liveness-probe ready: true, restart count 0 Feb 2 02:50:09.691: INFO: Container node-driver-registrar ready: true, restart count 0 Feb 2 02:50:09.691: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-8jnbj started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.691: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:09.691: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-hvbsc started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.691: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:09.691: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-nwdp9 started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.691: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:09.691: INFO: csi-hostpathplugin-0 started at 2023-02-02 02:50:06 +0000 UTC (0+7 container statuses recorded) Feb 2 02:50:09.691: INFO: Container csi-attacher ready: false, restart count 0 Feb 2 02:50:09.691: INFO: Container csi-provisioner ready: false, restart count 0 Feb 2 02:50:09.691: INFO: Container csi-resizer ready: false, restart count 0 Feb 2 02:50:09.691: INFO: Container csi-snapshotter ready: false, restart count 0 Feb 2 02:50:09.691: INFO: Container hostpath ready: false, restart count 0 Feb 2 02:50:09.691: INFO: Container liveness-probe ready: false, restart count 0 Feb 2 02:50:09.691: INFO: Container node-driver-registrar ready: false, restart count 0 Feb 2 02:50:09.691: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-842cr started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.691: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:09.691: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-mn2cg started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.691: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:09.691: INFO: netserver-0 started at 2023-02-02 02:45:58 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.691: INFO: Container webserver ready: false, restart count 0 Feb 2 02:50:09.691: INFO: rs-d5xx6 started at 2023-02-02 02:49:52 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.691: INFO: Container donothing ready: false, restart count 0 Feb 2 02:50:09.691: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-4lnlh started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.691: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:09.919: INFO: Latency metrics for node i-094933bbcaafb548f Feb 2 02:50:09.919: INFO: Logging node info for node i-0edda5f045be0496e Feb 2 02:50:09.952: INFO: Node Info: &Node{ObjectMeta:{i-0edda5f045be0496e 4587fb05-429b-429c-8408-c6c4e9c69a39 11949 0 2023-02-02 02:33:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east-1 failure-domain.beta.kubernetes.io/zone:us-east-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0edda5f045be0496e kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-east-1a topology.hostpath.csi/node:i-0edda5f045be0496e topology.kubernetes.io/region:us-east-1 topology.kubernetes.io/zone:us-east-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.36.32 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0edda5f045be0496e"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-02-02 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-02-02 02:33:35 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-02-02 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-02-02 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-02-02 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-02-02 02:38:05 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-02-02 02:49:54 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-02-02 02:49:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///us-east-1a/i-0edda5f045be0496e,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078206976 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973349376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-02 02:49:54 +0000 UTC,LastTransitionTime:2023-02-02 02:33:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-02 02:49:54 +0000 UTC,LastTransitionTime:2023-02-02 02:33:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-02 02:49:54 +0000 UTC,LastTransitionTime:2023-02-02 02:33:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-02 02:49:54 +0000 UTC,LastTransitionTime:2023-02-02 02:33:46 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.36.32,},NodeAddress{Type:ExternalIP,Address:107.20.131.91,},NodeAddress{Type:InternalDNS,Address:i-0edda5f045be0496e.ec2.internal,},NodeAddress{Type:Hostname,Address:i-0edda5f045be0496e.ec2.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-107-20-131-91.compute-1.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2d6d99d20e1d252ee83a35d89804ad,SystemUUID:ec2d6d99-d20e-1d25-2ee8-3a35d89804ad,BootID:d1722e01-5561-4510-a9ae-eb13b4bd9a0f,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.16,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-00adc42c65bfab5b2],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-00adc42c65bfab5b2,DevicePath:,},},Config:nil,},} Feb 2 02:50:09.952: INFO: Logging kubelet events for node i-0edda5f045be0496e Feb 2 02:50:09.985: INFO: Logging pods the kubelet thinks is on node i-0edda5f045be0496e Feb 2 02:50:10.022: INFO: pod1 started at 2023-02-02 02:48:53 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.022: INFO: Container agnhost-container ready: true, restart count 0 Feb 2 02:50:10.022: INFO: master started at 2023-02-02 02:45:00 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.022: INFO: Container cntr ready: false, restart count 0 Feb 2 02:50:10.022: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-8hlcn started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.022: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:10.022: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-f67st started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.022: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:10.022: INFO: netserver-1 started at 2023-02-02 02:45:58 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.022: INFO: Container webserver ready: false, restart count 0 Feb 2 02:50:10.022: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-bc995 started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.022: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:10.022: INFO: cilium-q9c8c started at 2023-02-02 02:33:36 +0000 UTC (1+1 container statuses recorded) Feb 2 02:50:10.022: INFO: Init container clean-cilium-state ready: true, restart count 0 Feb 2 02:50:10.022: INFO: Container cilium-agent ready: true, restart count 0 Feb 2 02:50:10.022: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-jstkj started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.022: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: false, restart count 0 Feb 2 02:50:10.022: INFO: rs-glj89 started at 2023-02-02 02:49:55 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.022: INFO: Container donothing ready: false, restart count 0 Feb 2 02:50:10.022: INFO: ss2-2 started at 2023-02-02 02:38:37 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.023: INFO: Container webserver ready: true, restart count 0 Feb 2 02:50:10.023: INFO: inline-volume-tester-jcmtn started at 2023-02-02 02:38:54 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.023: INFO: Container csi-volume-tester ready: true, restart count 0 Feb 2 02:50:10.023: INFO: security-context-26d9d60c-8c31-4e0d-9488-ce019848329d started at 2023-02-02 02:49:26 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.023: INFO: Container test-container ready: false, restart count 0 Feb 2 02:50:10.023: INFO: execpodhrd2g started at 2023-02-02 02:49:38 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.023: INFO: Container agnhost-container ready: true, restart count 0 Feb 2 02:50:10.023: INFO: pfpod started at 2023-02-02 02:48:47 +0000 UTC (0+2 container statuses recorded) Feb 2 02:50:10.023: INFO: Container portforwardtester ready: false, restart count 0 Feb 2 02:50:10.023: INFO: Container readiness ready: false, restart count 0 Feb 2 02:50:10.023: INFO: rs-d42qg started at 2023-02-02 02:49:52 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.023: INFO: Container donothing ready: false, restart count 0 Feb 2 02:50:10.023: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-mkbdp started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.023: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:10.023: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-pn6d4 started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.023: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:10.023: INFO: netserver-1 started at 2023-02-02 02:49:33 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.023: INFO: Container webserver ready: true, restart count 0 Feb 2 02:50:10.023: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-l8l4k started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.023: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:10.023: INFO: csi-hostpathplugin-0 started at 2023-02-02 02:46:21 +0000 UTC (0+7 container statuses recorded) Feb 2 02:50:10.023: INFO: Container csi-attacher ready: false, restart count 0 Feb 2 02:50:10.023: INFO: Container csi-provisioner ready: false, restart count 0 Feb 2 02:50:10.023: INFO: Container csi-resizer ready: false, restart count 0 Feb 2 02:50:10.023: INFO: Container csi-snapshotter ready: false, restart count 0 Feb 2 02:50:10.023: INFO: Container hostpath ready: false, restart count 0 Feb 2 02:50:10.023: INFO: Container liveness-probe ready: false, restart count 0 Feb 2 02:50:10.023: INFO: Container node-driver-registrar ready: false, restart count 0 Feb 2 02:50:10.023: INFO: pod-secrets-2af698c1-7e7f-42cb-92b4-983c767e4fb3 started at 2023-02-02 02:49:44 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.023: INFO: Container secret-test ready: false, restart count 0 Feb 2 02:50:10.023: INFO: ebs-csi-node-kbmng started at 2023-02-02 02:33:36 +0000 UTC (0+3 container statuses recorded) Feb 2 02:50:10.023: INFO: Container ebs-plugin ready: true, restart count 0 Feb 2 02:50:10.023: INFO: Container liveness-probe ready: true, restart count 0 Feb 2 02:50:10.023: INFO: Container node-driver-registrar ready: true, restart count 0 Feb 2 02:50:10.023: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-hfvsn started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.023: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: false, restart count 0 Feb 2 02:50:10.023: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-2wdkr started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.023: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:10.023: INFO: rs-rk22n started at 2023-02-02 02:49:51 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.023: INFO: Container donothing ready: false, restart count 0 Feb 2 02:50:10.023: INFO: rs-k2vs7 started at 2023-02-02 02:49:52 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.023: INFO: Container donothing ready: false, restart count 0 Feb 2 02:50:10.023: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-9sqms started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.023: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:10.217: INFO: Latency metrics for node i-0edda5f045be0496e Feb 2 02:50:10.217: INFO: Logging node info for node i-0f7e2e4905cb6dadc Feb 2 02:50:10.246: INFO: Node Info: &Node{ObjectMeta:{i-0f7e2e4905cb6dadc 2adbbc9a-dd76-4b97-8d3e-a2bd14f0c57d 10413 0 2023-02-02 02:33:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east-1 failure-domain.beta.kubernetes.io/zone:us-east-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0f7e2e4905cb6dadc kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-east-1a topology.hostpath.csi/node:i-0f7e2e4905cb6dadc topology.kubernetes.io/region:us-east-1 topology.kubernetes.io/zone:us-east-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.40.134 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-3250":"i-0f7e2e4905cb6dadc","ebs.csi.aws.com":"i-0f7e2e4905cb6dadc"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-02-02 02:33:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {e2e.test Update v1 2023-02-02 02:38:05 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-02-02 02:49:03 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-02-02 02:49:11 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///us-east-1a/i-0f7e2e4905cb6dadc,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-02 02:49:11 +0000 UTC,LastTransitionTime:2023-02-02 02:33:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-02 02:49:11 +0000 UTC,LastTransitionTime:2023-02-02 02:33:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-02 02:49:11 +0000 UTC,LastTransitionTime:2023-02-02 02:33:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-02 02:49:11 +0000 UTC,LastTransitionTime:2023-02-02 02:33:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.40.134,},NodeAddress{Type:ExternalIP,Address:18.215.155.89,},NodeAddress{Type:InternalDNS,Address:i-0f7e2e4905cb6dadc.ec2.internal,},NodeAddress{Type:Hostname,Address:i-0f7e2e4905cb6dadc.ec2.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-215-155-89.compute-1.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2d895bde004236c844d2f199d4cb6e,SystemUUID:ec2d895b-de00-4236-c844-d2f199d4cb6e,BootID:e4805eb2-7c0d-48b7-a584-7f3b4b363884,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.16,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-3250^26b12128-a2a4-11ed-bb72-0efe19e96a51],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-3250^26b12128-a2a4-11ed-bb72-0efe19e96a51,DevicePath:,},},Config:nil,},} Feb 2 02:50:10.247: INFO: Logging kubelet events for node i-0f7e2e4905cb6dadc Feb 2 02:50:10.277: INFO: Logging pods the kubelet thinks is on node i-0f7e2e4905cb6dadc Feb 2 02:50:10.319: INFO: csi-hostpathplugin-0 started at 2023-02-02 02:46:42 +0000 UTC (0+7 container statuses recorded) Feb 2 02:50:10.319: INFO: Container csi-attacher ready: true, restart count 0 Feb 2 02:50:10.319: INFO: Container csi-provisioner ready: true, restart count 0 Feb 2 02:50:10.319: INFO: Container csi-resizer ready: true, restart count 0 Feb 2 02:50:10.319: INFO: Container csi-snapshotter ready: true, restart count 0 Feb 2 02:50:10.319: INFO: Container hostpath ready: true, restart count 0 Feb 2 02:50:10.319: INFO: Container liveness-probe ready: true, restart count 0 Feb 2 02:50:10.319: INFO: Container node-driver-registrar ready: true, restart count 0 Feb 2 02:50:10.319: INFO: ss2-0 started at 2023-02-02 02:49:44 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.319: INFO: Container webserver ready: false, restart count 0 Feb 2 02:50:10.319: INFO: pod-subpath-test-dynamicpv-4qbr started at 2023-02-02 02:49:02 +0000 UTC (1+1 container statuses recorded) Feb 2 02:50:10.319: INFO: Init container init-volume-dynamicpv-4qbr ready: false, restart count 0 Feb 2 02:50:10.319: INFO: Container test-container-subpath-dynamicpv-4qbr ready: false, restart count 0 Feb 2 02:50:10.319: INFO: netserver-2 started at 2023-02-02 02:45:58 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.319: INFO: Container webserver ready: false, restart count 0 Feb 2 02:50:10.319: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-h65xw started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.319: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:10.319: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-pwvqk started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.319: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:10.319: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-mphjv started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.319: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:10.319: INFO: pod-client started at 2023-02-02 02:49:11 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.319: INFO: Container pod-client ready: false, restart count 0 Feb 2 02:50:10.319: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-xzv2d started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.319: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:10.319: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-m7nw9 started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.319: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: false, restart count 0 Feb 2 02:50:10.319: INFO: coredns-autoscaler-7cb5c5b969-5nncn started at 2023-02-02 02:33:44 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.319: INFO: Container autoscaler ready: true, restart count 0 Feb 2 02:50:10.319: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-7wgzt started at 2023-02-02 02:38:06 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.319: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:10.319: INFO: rs-kn8tl started at 2023-02-02 02:49:52 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.319: INFO: Container donothing ready: false, restart count 0 Feb 2 02:50:10.319: INFO: ebs-csi-node-mkxjx started at 2023-02-02 02:33:34 +0000 UTC (0+3 container statuses recorded) Feb 2 02:50:10.319: INFO: Container ebs-plugin ready: true, restart count 0 Feb 2 02:50:10.319: INFO: Container liveness-probe ready: true, restart count 0 Feb 2 02:50:10.319: INFO: Container node-driver-registrar ready: true, restart count 0 Feb 2 02:50:10.319: INFO: netserver-2 started at 2023-02-02 02:49:33 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.319: INFO: Container webserver ready: true, restart count 0 Feb 2 02:50:10.319: INFO: rs-tq4jh started at 2023-02-02 02:49:51 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.319: INFO: Container donothing ready: false, restart count 0 Feb 2 02:50:10.319: INFO: cilium-k54gx started at 2023-02-02 02:33:34 +0000 UTC (1+1 container statuses recorded) Feb 2 02:50:10.319: INFO: Init container clean-cilium-state ready: true, restart count 0 Feb 2 02:50:10.319: INFO: Container cilium-agent ready: true, restart count 0 Feb 2 02:50:10.319: INFO: coredns-559769c974-s54lm started at 2023-02-02 02:33:44 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.319: INFO: Container coredns ready: true, restart count 0 Feb 2 02:50:10.319: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-rnf4c started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.319: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:10.319: INFO: rs-bb6k5 started at 2023-02-02 02:49:55 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.319: INFO: Container donothing ready: false, restart count 0 Feb 2 02:50:10.319: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-pgnjx started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.319: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:10.319: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-s6mxr started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.319: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:10.319: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-vtdsx started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.319: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:10.494: INFO: Latency metrics for node i-0f7e2e4905cb6dadc Feb 2 02:50:10.494: INFO: Logging node info for node i-0fe5d857b6eb4dfe3 Feb 2 02:50:10.522: INFO: Node Info: &Node{ObjectMeta:{i-0fe5d857b6eb4dfe3 9d0f7cfc-7470-4601-b0c7-c2b476a9fab7 11273 0 2023-02-02 02:33:43 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east-1 failure-domain.beta.kubernetes.io/zone:us-east-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0fe5d857b6eb4dfe3 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-east-1a topology.hostpath.csi/node:i-0fe5d857b6eb4dfe3 topology.kubernetes.io/region:us-east-1 topology.kubernetes.io/zone:us-east-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.53.228 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0fe5d857b6eb4dfe3"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-02-02 02:33:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-02-02 02:33:43 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-02-02 02:33:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-02-02 02:33:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-02-02 02:33:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-02-02 02:38:05 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-02-02 02:49:42 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-02-02 02:49:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///us-east-1a/i-0fe5d857b6eb4dfe3,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078206976 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973349376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-02 02:49:42 +0000 UTC,LastTransitionTime:2023-02-02 02:33:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-02 02:49:42 +0000 UTC,LastTransitionTime:2023-02-02 02:33:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-02 02:49:42 +0000 UTC,LastTransitionTime:2023-02-02 02:33:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-02 02:49:42 +0000 UTC,LastTransitionTime:2023-02-02 02:33:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.53.228,},NodeAddress{Type:ExternalIP,Address:18.212.239.71,},NodeAddress{Type:InternalDNS,Address:i-0fe5d857b6eb4dfe3.ec2.internal,},NodeAddress{Type:Hostname,Address:i-0fe5d857b6eb4dfe3.ec2.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-212-239-71.compute-1.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23a338ffd343d89814911cd0d0d8ea,SystemUUID:ec23a338-ffd3-43d8-9814-911cd0d0d8ea,BootID:588a11ea-21bc-44af-808b-852f5f90dd84,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.16,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-021fcced421837e53 kubernetes.io/csi/ebs.csi.aws.com^vol-06c549b1251626bdf],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-06c549b1251626bdf,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-021fcced421837e53,DevicePath:,},},Config:nil,},} Feb 2 02:50:10.522: INFO: Logging kubelet events for node i-0fe5d857b6eb4dfe3 Feb 2 02:50:10.553: INFO: Logging pods the kubelet thinks is on node i-0fe5d857b6eb4dfe3 Feb 2 02:50:10.590: INFO: host-test-container-pod started at 2023-02-02 02:49:55 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.590: INFO: Container agnhost-container ready: true, restart count 0 Feb 2 02:50:10.590: INFO: rs-pwffb started at 2023-02-02 02:49:52 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.590: INFO: Container donothing ready: false, restart count 0 Feb 2 02:50:10.590: INFO: rs-ncbsn started at 2023-02-02 02:49:55 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.590: INFO: Container donothing ready: false, restart count 0 Feb 2 02:50:10.590: INFO: test-container-pod started at 2023-02-02 02:49:55 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.590: INFO: Container webserver ready: false, restart count 0 Feb 2 02:50:10.590: INFO: netserver-3 started at 2023-02-02 02:49:33 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.590: INFO: Container webserver ready: true, restart count 0 Feb 2 02:50:10.590: INFO: pod-configmaps-f596c9e4-0702-4bac-bb8d-e766ca7cefb2 started at 2023-02-02 02:49:46 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.590: INFO: Container agnhost-container ready: false, restart count 0 Feb 2 02:50:10.590: INFO: netserver-3 started at 2023-02-02 02:45:58 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.590: INFO: Container webserver ready: true, restart count 0 Feb 2 02:50:10.590: INFO: csi-mockplugin-0 started at 2023-02-02 02:46:24 +0000 UTC (0+3 container statuses recorded) Feb 2 02:50:10.590: INFO: Container csi-provisioner ready: false, restart count 0 Feb 2 02:50:10.590: INFO: Container driver-registrar ready: false, restart count 0 Feb 2 02:50:10.590: INFO: Container mock ready: false, restart count 0 Feb 2 02:50:10.591: INFO: rs-vl4zj started at 2023-02-02 02:49:51 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.591: INFO: Container donothing ready: false, restart count 0 Feb 2 02:50:10.591: INFO: cilium-gffsv started at 2023-02-02 02:33:43 +0000 UTC (1+1 container statuses recorded) Feb 2 02:50:10.591: INFO: Init container clean-cilium-state ready: true, restart count 0 Feb 2 02:50:10.591: INFO: Container cilium-agent ready: true, restart count 0 Feb 2 02:50:10.591: INFO: inline-volume-tester-vzj57 started at 2023-02-02 02:38:29 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.591: INFO: Container csi-volume-tester ready: false, restart count 0 Feb 2 02:50:10.591: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-sb6sx started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.591: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:10.591: INFO: ss2-1 started at 2023-02-02 02:41:26 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.591: INFO: Container webserver ready: true, restart count 0 Feb 2 02:50:10.591: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-n4rbc started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.591: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:10.591: INFO: rs-42smn started at 2023-02-02 02:49:52 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.591: INFO: Container donothing ready: false, restart count 0 Feb 2 02:50:10.591: INFO: pod2 started at 2023-02-02 02:49:56 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.591: INFO: Container agnhost-container ready: false, restart count 0 Feb 2 02:50:10.591: INFO: csi-mockplugin-attacher-0 started at 2023-02-02 02:46:24 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.591: INFO: Container csi-attacher ready: false, restart count 0 Feb 2 02:50:10.591: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-dz5bh started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.591: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:10.591: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-dss8d started at 2023-02-02 02:38:06 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.591: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:10.591: INFO: inline-volume-tester2-wpgg7 started at 2023-02-02 02:39:34 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.591: INFO: Container csi-volume-tester ready: false, restart count 0 Feb 2 02:50:10.591: INFO: ebs-csi-node-qqz2d started at 2023-02-02 02:33:43 +0000 UTC (0+3 container statuses recorded) Feb 2 02:50:10.591: INFO: Container ebs-plugin ready: true, restart count 0 Feb 2 02:50:10.591: INFO: Container liveness-probe ready: true, restart count 0 Feb 2 02:50:10.591: INFO: Container node-driver-registrar ready: true, restart count 0 Feb 2 02:50:10.591: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-snv7k started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.591: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:10.591: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-7j88c started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.591: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:10.591: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-2psrz started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.591: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:10.591: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-7xd6t started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.591: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:10.591: INFO: pod-projected-configmaps-c7fde8d3-2d87-44f0-a97d-2cae453e883c started at 2023-02-02 02:49:47 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.591: INFO: Container projected-configmap-volume-test ready: false, restart count 0 Feb 2 02:50:10.591: INFO: pod-subpath-test-configmap-sr27 started at 2023-02-02 02:49:44 +0000 UTC (1+2 container statuses recorded) Feb 2 02:50:10.591: INFO: Init container init-volume-configmap-sr27 ready: false, restart count 0 Feb 2 02:50:10.591: INFO: Container test-container-subpath-configmap-sr27 ready: false, restart count 0 Feb 2 02:50:10.591: INFO: Container test-container-volume-configmap-sr27 ready: false, restart count 0 Feb 2 02:50:10.591: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-j9kxn started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.591: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:10.591: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-965cw started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.591: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:10.745: INFO: Latency metrics for node i-0fe5d857b6eb4dfe3 [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand tear down framework | framework.go:193 �[1mSTEP:�[0m Destroying namespace "volume-expand-5531" for this suite. �[38;5;243m02/02/23 02:50:10.745�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\sExternal\sStorage\s\[Driver\:\sebs\.csi\.aws\.com\]\s\[Testpattern\:\sDynamic\sPV\s\(default\sfs\)\]\ssubPath\sshould\ssupport\snon\-existent\spath$'
test/e2e/framework/pod/output/output.go:237 k8s.io/kubernetes/test/e2e/framework/pod/output.TestContainerOutputMatcher(0xc003bb0d80?, {0x75c4bbe?, 0x0?}, 0xc003bb0d80, 0x1, {0xc003a1dee8, 0x1, 0x1}, 0x22?) test/e2e/framework/pod/output/output.go:237 +0x176 k8s.io/kubernetes/test/e2e/framework/pod/output.TestContainerOutput(...) test/e2e/framework/pod/output/output.go:214 k8s.io/kubernetes/test/e2e/storage/testsuites.testReadFile(0xc0016933b0, {0xc003bb7080, 0x28}, 0xc003bb0d80, 0x1) test/e2e/storage/testsuites/subpath.go:691 +0x15c k8s.io/kubernetes/test/e2e/storage/testsuites.(*subPathTestSuite).DefineTests.func3() test/e2e/storage/testsuites/subpath.go:202 +0xb0from junit_01.xml
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath test/e2e/storage/framework/testsuite.go:51 [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath set up framework | framework.go:178 �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m02/02/23 02:38:26.933�[0m Feb 2 02:38:26.933: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP:�[0m Building a namespace api object, basename provisioning �[38;5;243m02/02/23 02:38:26.934�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m02/02/23 02:38:27.029�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m02/02/23 02:38:27.089�[0m [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath test/e2e/framework/metrics/init/init.go:31 [It] should support non-existent path test/e2e/storage/testsuites/subpath.go:194 Feb 2 02:38:27.149: INFO: Creating resource for dynamic PV Feb 2 02:38:27.149: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} �[1mSTEP:�[0m creating a StorageClass provisioning-8979-e2e-sc7c7k6 �[38;5;243m02/02/23 02:38:27.149�[0m �[1mSTEP:�[0m creating a claim �[38;5;243m02/02/23 02:38:27.186�[0m Feb 2 02:38:27.186: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil �[1mSTEP:�[0m Creating pod pod-subpath-test-dynamicpv-xqkk �[38;5;243m02/02/23 02:38:27.249�[0m �[1mSTEP:�[0m Creating a pod to test subpath �[38;5;243m02/02/23 02:38:27.249�[0m Feb 2 02:38:27.284: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-xqkk" in namespace "provisioning-8979" to be "Succeeded or Failed" Feb 2 02:38:27.315: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 30.931984ms Feb 2 02:38:29.346: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 2.062446553s Feb 2 02:38:31.348: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 4.064206041s Feb 2 02:38:33.348: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 6.064223197s Feb 2 02:38:35.346: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 8.062020316s Feb 2 02:38:37.346: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 10.061901651s Feb 2 02:38:39.346: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 12.062301643s Feb 2 02:38:41.346: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 14.062199568s Feb 2 02:38:43.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 16.060046179s Feb 2 02:38:45.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 18.060971466s Feb 2 02:38:47.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 20.061075169s Feb 2 02:38:49.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 22.060640696s Feb 2 02:38:51.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 24.060102315s Feb 2 02:38:53.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 26.060050783s Feb 2 02:38:55.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 28.06079658s Feb 2 02:38:57.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 30.060340469s Feb 2 02:38:59.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 32.060463194s Feb 2 02:39:01.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 34.060399652s Feb 2 02:39:03.347: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 36.062948776s Feb 2 02:39:05.349: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 38.064985194s Feb 2 02:39:07.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 40.060817708s Feb 2 02:39:09.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 42.060922316s Feb 2 02:39:11.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 44.060464736s Feb 2 02:39:13.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 46.060194495s Feb 2 02:39:15.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 48.060874605s Feb 2 02:39:17.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 50.06038315s Feb 2 02:39:19.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 52.06035613s Feb 2 02:39:21.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 54.060460934s Feb 2 02:39:23.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 56.061103183s Feb 2 02:39:25.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 58.061480461s Feb 2 02:39:27.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.060238344s Feb 2 02:39:29.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.061038381s Feb 2 02:39:31.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.060279524s Feb 2 02:39:33.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.060371593s Feb 2 02:39:35.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.060252495s Feb 2 02:39:37.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.060575577s Feb 2 02:39:39.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.060781953s Feb 2 02:39:41.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.060589947s Feb 2 02:39:43.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.060204733s Feb 2 02:39:45.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.060798471s Feb 2 02:39:47.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.060274593s Feb 2 02:39:49.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.060775627s Feb 2 02:39:51.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.06048459s Feb 2 02:39:53.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.060520466s Feb 2 02:39:55.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.060867945s Feb 2 02:39:57.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.060508884s Feb 2 02:39:59.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.060678878s Feb 2 02:40:01.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.06105748s Feb 2 02:40:03.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.061025064s Feb 2 02:40:05.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.060664766s Feb 2 02:40:07.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.060783589s Feb 2 02:40:09.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.060698936s Feb 2 02:40:11.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.060107994s Feb 2 02:40:13.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.06029349s Feb 2 02:40:15.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.060364067s Feb 2 02:40:17.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.060347008s Feb 2 02:40:19.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.061212891s Feb 2 02:40:21.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.060580162s Feb 2 02:40:23.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.060286138s Feb 2 02:40:25.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.060482245s Feb 2 02:40:27.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.060141277s Feb 2 02:40:29.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.060594397s Feb 2 02:40:31.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.060427227s Feb 2 02:40:33.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.060374632s Feb 2 02:40:35.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.060513861s Feb 2 02:40:37.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.060389433s Feb 2 02:40:39.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.060904964s Feb 2 02:40:41.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.061103214s Feb 2 02:40:43.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.060600032s Feb 2 02:40:45.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.061210523s Feb 2 02:40:47.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.061267175s Feb 2 02:40:49.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.060994856s Feb 2 02:40:51.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.060261767s Feb 2 02:40:53.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.061160905s Feb 2 02:40:55.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.060501258s Feb 2 02:40:57.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.061107884s Feb 2 02:40:59.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.060857887s Feb 2 02:41:01.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.061150688s Feb 2 02:41:03.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.060602786s Feb 2 02:41:05.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.060659579s Feb 2 02:41:07.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.060696082s Feb 2 02:41:09.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.060968978s Feb 2 02:41:11.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.060734089s Feb 2 02:41:13.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.060960065s Feb 2 02:41:15.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.060703391s Feb 2 02:41:17.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.060291994s Feb 2 02:41:19.348: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.064485607s Feb 2 02:41:21.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.061089822s Feb 2 02:41:23.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.060843699s Feb 2 02:41:25.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.060217451s Feb 2 02:41:27.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.060492064s Feb 2 02:41:29.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.060345837s Feb 2 02:41:31.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.060520635s Feb 2 02:41:33.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.061037025s Feb 2 02:41:35.348: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.06406523s Feb 2 02:41:37.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.060334072s Feb 2 02:41:39.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.060988224s Feb 2 02:41:41.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.060374639s Feb 2 02:41:43.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.060705684s Feb 2 02:41:45.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.060583127s Feb 2 02:41:47.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.06032655s Feb 2 02:41:49.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.060894463s Feb 2 02:41:51.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.060848297s Feb 2 02:41:53.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.061129794s Feb 2 02:41:55.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.060407915s Feb 2 02:41:57.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.060596691s Feb 2 02:41:59.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.06119326s Feb 2 02:42:01.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.060687565s Feb 2 02:42:03.349: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.06529718s Feb 2 02:42:05.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.061243904s Feb 2 02:42:07.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.06092129s Feb 2 02:42:09.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.060833658s Feb 2 02:42:11.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.060338449s Feb 2 02:42:13.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.061289621s Feb 2 02:42:15.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.060629694s Feb 2 02:42:17.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.060135655s Feb 2 02:42:19.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.060791489s Feb 2 02:42:21.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.06039476s Feb 2 02:42:23.347: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.062991256s Feb 2 02:42:25.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.060504806s Feb 2 02:42:27.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.06104174s Feb 2 02:42:29.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.060816596s Feb 2 02:42:31.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.060345496s Feb 2 02:42:33.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.060593665s Feb 2 02:42:35.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.060164776s Feb 2 02:42:37.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.061133315s Feb 2 02:42:39.347: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.062741453s Feb 2 02:42:41.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.060472995s Feb 2 02:42:43.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.060676633s Feb 2 02:42:45.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.060362366s Feb 2 02:42:47.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.060581511s Feb 2 02:42:49.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.060462185s Feb 2 02:42:51.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.060103462s Feb 2 02:42:53.346: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.062254956s Feb 2 02:42:55.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.060946889s Feb 2 02:42:57.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.060614447s Feb 2 02:42:59.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.060953822s Feb 2 02:43:01.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.060507037s Feb 2 02:43:03.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.060488659s Feb 2 02:43:05.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.061396699s Feb 2 02:43:07.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.060459674s Feb 2 02:43:09.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.061327745s Feb 2 02:43:11.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.060789742s Feb 2 02:43:13.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.060549839s Feb 2 02:43:15.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.060675566s Feb 2 02:43:17.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.060632711s Feb 2 02:43:19.345: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.060728417s Feb 2 02:43:21.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.060421931s Feb 2 02:43:23.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.060365881s Feb 2 02:43:25.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.060344003s Feb 2 02:43:27.344: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.060627643s Feb 2 02:43:27.373: INFO: Pod "pod-subpath-test-dynamicpv-xqkk": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.089599694s Feb 2 02:43:27.433: INFO: Failed to get logs from node "i-0fe5d857b6eb4dfe3" pod "pod-subpath-test-dynamicpv-xqkk" container "test-init-subpath-dynamicpv-xqkk": the server rejected our request for an unknown reason (get pods pod-subpath-test-dynamicpv-xqkk) Feb 2 02:43:27.463: INFO: Failed to get logs from node "i-0fe5d857b6eb4dfe3" pod "pod-subpath-test-dynamicpv-xqkk" container "test-container-subpath-dynamicpv-xqkk": the server rejected our request for an unknown reason (get pods pod-subpath-test-dynamicpv-xqkk) Feb 2 02:43:27.493: INFO: Failed to get logs from node "i-0fe5d857b6eb4dfe3" pod "pod-subpath-test-dynamicpv-xqkk" container "test-container-volume-dynamicpv-xqkk": the server rejected our request for an unknown reason (get pods pod-subpath-test-dynamicpv-xqkk) �[1mSTEP:�[0m delete the pod �[38;5;243m02/02/23 02:43:27.493�[0m Feb 2 02:43:27.527: INFO: Waiting for pod pod-subpath-test-dynamicpv-xqkk to disappear Feb 2 02:43:27.555: INFO: Pod pod-subpath-test-dynamicpv-xqkk still exists Feb 2 02:43:29.556: INFO: Waiting for pod pod-subpath-test-dynamicpv-xqkk to disappear Feb 2 02:43:29.585: INFO: Pod pod-subpath-test-dynamicpv-xqkk no longer exists Feb 2 02:43:29.585: INFO: Unexpected error: <*errors.errorString | 0xc000b37a50>: { s: "expected pod \"pod-subpath-test-dynamicpv-xqkk\" success: timed out while waiting for pod provisioning-8979/pod-subpath-test-dynamicpv-xqkk to be Succeeded or Failed", } Feb 2 02:43:29.585: FAIL: expected pod "pod-subpath-test-dynamicpv-xqkk" success: timed out while waiting for pod provisioning-8979/pod-subpath-test-dynamicpv-xqkk to be Succeeded or Failed Full Stack Trace k8s.io/kubernetes/test/e2e/framework/pod/output.TestContainerOutputMatcher(0xc003bb0d80?, {0x75c4bbe?, 0x0?}, 0xc003bb0d80, 0x1, {0xc003a1dee8, 0x1, 0x1}, 0x22?) test/e2e/framework/pod/output/output.go:237 +0x176 k8s.io/kubernetes/test/e2e/framework/pod/output.TestContainerOutput(...) test/e2e/framework/pod/output/output.go:214 k8s.io/kubernetes/test/e2e/storage/testsuites.testReadFile(0xc0016933b0, {0xc003bb7080, 0x28}, 0xc003bb0d80, 0x1) test/e2e/storage/testsuites/subpath.go:691 +0x15c k8s.io/kubernetes/test/e2e/storage/testsuites.(*subPathTestSuite).DefineTests.func3() test/e2e/storage/testsuites/subpath.go:202 +0xb0 �[1mSTEP:�[0m Deleting pod �[38;5;243m02/02/23 02:43:29.585�[0m Feb 2 02:43:29.585: INFO: Deleting pod "pod-subpath-test-dynamicpv-xqkk" in namespace "provisioning-8979" �[1mSTEP:�[0m Deleting pvc �[38;5;243m02/02/23 02:43:29.614�[0m Feb 2 02:43:29.672: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.com49lrs" Feb 2 02:43:29.702: INFO: Waiting up to 5m0s for PersistentVolume pvc-a38a1512-c041-4e78-a31d-245f452ed461 to get deleted Feb 2 02:43:29.730: INFO: PersistentVolume pvc-a38a1512-c041-4e78-a31d-245f452ed461 found and phase=Released (28.632979ms) Feb 2 02:43:34.760: INFO: PersistentVolume pvc-a38a1512-c041-4e78-a31d-245f452ed461 found and phase=Released (5.058453919s) Feb 2 02:43:39.791: INFO: PersistentVolume pvc-a38a1512-c041-4e78-a31d-245f452ed461 found and phase=Released (10.088788453s) Feb 2 02:43:44.820: INFO: PersistentVolume pvc-a38a1512-c041-4e78-a31d-245f452ed461 found and phase=Released (15.118108905s) Feb 2 02:43:49.850: INFO: PersistentVolume pvc-a38a1512-c041-4e78-a31d-245f452ed461 was removed �[1mSTEP:�[0m Deleting sc �[38;5;243m02/02/23 02:43:49.85�[0m [AfterEach] [Testpattern: Dynamic PV (default fs)] subPath test/e2e/framework/node/init/init.go:32 Feb 2 02:43:49.881: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath dump namespaces | framework.go:196 �[1mSTEP:�[0m dump namespace information after failure �[38;5;243m02/02/23 02:43:49.911�[0m �[1mSTEP:�[0m Collecting events from namespace "provisioning-8979". �[38;5;243m02/02/23 02:43:49.911�[0m �[1mSTEP:�[0m Found 16 events. �[38;5;243m02/02/23 02:43:49.94�[0m Feb 2 02:43:49.941: INFO: At 2023-02-02 02:38:27 +0000 UTC - event for ebs.csi.aws.com49lrs: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding Feb 2 02:43:49.941: INFO: At 2023-02-02 02:38:27 +0000 UTC - event for ebs.csi.aws.com49lrs: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "ebs.csi.aws.com" or manually created by system administrator Feb 2 02:43:49.941: INFO: At 2023-02-02 02:38:27 +0000 UTC - event for ebs.csi.aws.com49lrs: {ebs.csi.aws.com_i-01b885526491052d5_d47994d4-b7e1-4596-a8c0-cb83c8f567ef } Provisioning: External provisioner is provisioning volume for claim "provisioning-8979/ebs.csi.aws.com49lrs" Feb 2 02:43:49.941: INFO: At 2023-02-02 02:38:30 +0000 UTC - event for ebs.csi.aws.com49lrs: {ebs.csi.aws.com_i-01b885526491052d5_d47994d4-b7e1-4596-a8c0-cb83c8f567ef } ProvisioningSucceeded: Successfully provisioned volume pvc-a38a1512-c041-4e78-a31d-245f452ed461 Feb 2 02:43:49.941: INFO: At 2023-02-02 02:38:31 +0000 UTC - event for pod-subpath-test-dynamicpv-xqkk: {default-scheduler } Scheduled: Successfully assigned provisioning-8979/pod-subpath-test-dynamicpv-xqkk to i-0fe5d857b6eb4dfe3 Feb 2 02:43:49.941: INFO: At 2023-02-02 02:38:33 +0000 UTC - event for pod-subpath-test-dynamicpv-xqkk: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-a38a1512-c041-4e78-a31d-245f452ed461" Feb 2 02:43:49.941: INFO: At 2023-02-02 02:38:40 +0000 UTC - event for pod-subpath-test-dynamicpv-xqkk: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "147d881be41c772c218fbc2b40f18c88be07915e705b835bd8c561bee28a2741": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:43:49.941: INFO: At 2023-02-02 02:38:53 +0000 UTC - event for pod-subpath-test-dynamicpv-xqkk: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "6470c2b77f586bd4a90099831585608c081223c364bb9f038467346899774284": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:43:49.941: INFO: At 2023-02-02 02:39:08 +0000 UTC - event for pod-subpath-test-dynamicpv-xqkk: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "5bc7302790d7d5c5e08026083633fbce7a86f017931208bd3c24d1c046c58acd": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:43:49.941: INFO: At 2023-02-02 02:39:22 +0000 UTC - event for pod-subpath-test-dynamicpv-xqkk: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "8d95fc74ae88ff5d4f443a4f4b79b8ec1e22539900a2eab31acbfce4c9daf8dc": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:43:49.941: INFO: At 2023-02-02 02:39:37 +0000 UTC - event for pod-subpath-test-dynamicpv-xqkk: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "9a4a07e994d6857996973deba65847b57925f40cab4a64227327a21f6f392236": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:43:49.941: INFO: At 2023-02-02 02:39:48 +0000 UTC - event for pod-subpath-test-dynamicpv-xqkk: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "77b787e13081936957352ee3152ec8f506fc2dae335edd887fdf1197aec5b50a": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:43:49.941: INFO: At 2023-02-02 02:40:01 +0000 UTC - event for pod-subpath-test-dynamicpv-xqkk: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "1f7a560d0ac75dd1648665773349184fe92d0da9eb508578c5e6e364a1c70866": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:43:49.941: INFO: At 2023-02-02 02:40:12 +0000 UTC - event for pod-subpath-test-dynamicpv-xqkk: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "12b6b409e67a25527a95306a991df9a3e80aeda6c5ac0505c618732ff1c981cd": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:43:49.941: INFO: At 2023-02-02 02:40:24 +0000 UTC - event for pod-subpath-test-dynamicpv-xqkk: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "72d8c48d662279e5a4b44ffb31d2dc9cd8177f2dca520ef3216509e9c0f5673d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:43:49.941: INFO: At 2023-02-02 02:40:37 +0000 UTC - event for pod-subpath-test-dynamicpv-xqkk: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "cc72e686ed9cd0ba241c5b1f731cc0d76881b8f12eb06c375bd190a7ae841283": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:43:49.969: INFO: POD NODE PHASE GRACE CONDITIONS Feb 2 02:43:49.969: INFO: Feb 2 02:43:49.999: INFO: Logging node info for node i-01b885526491052d5 Feb 2 02:43:50.028: INFO: Node Info: &Node{ObjectMeta:{i-01b885526491052d5 dc5fa938-4b08-4e13-a650-8859f804b492 7089 0 2023-02-02 02:32:08 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east-1 failure-domain.beta.kubernetes.io/zone:us-east-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-01b885526491052d5 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:us-east-1a topology.kubernetes.io/region:us-east-1 topology.kubernetes.io/zone:us-east-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.61.65 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-01b885526491052d5"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-02-02 02:32:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-02-02 02:32:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {aws-cloud-controller-manager Update v1 2023-02-02 02:32:44 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-02-02 02:32:44 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-02-02 02:32:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-02-02 02:39:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///us-east-1a/i-01b885526491052d5,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3918811136 0} {<nil>} 3826964Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3813953536 0} {<nil>} 3724564Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-02 02:39:47 +0000 UTC,LastTransitionTime:2023-02-02 02:32:07 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-02 02:39:47 +0000 UTC,LastTransitionTime:2023-02-02 02:32:07 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-02 02:39:47 +0000 UTC,LastTransitionTime:2023-02-02 02:32:07 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-02 02:39:47 +0000 UTC,LastTransitionTime:2023-02-02 02:32:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.61.65,},NodeAddress{Type:ExternalIP,Address:54.205.170.33,},NodeAddress{Type:InternalDNS,Address:i-01b885526491052d5.ec2.internal,},NodeAddress{Type:Hostname,Address:i-01b885526491052d5.ec2.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-205-170-33.compute-1.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec26507379484fef3914c7eb427dc82e,SystemUUID:ec265073-7948-4fef-3914-c7eb427dc82e,BootID:9d8938d3-ec44-44d3-9a12-0dbd68248bf9,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.16,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:5ffb3f7cade4ae1d8c952251abb0c8bdfa8d4d9acb2c364e763328bd6f3d06aa registry.k8s.io/etcdadm/etcd-manager:v3.0.20230201],SizeBytes:243803152,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.1],SizeBytes:135178704,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.1],SizeBytes:124995897,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.1],SizeBytes:57661752,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-beta.2],SizeBytes:43857040,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-beta.2],SizeBytes:42821718,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-beta.2],SizeBytes:4965807,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Feb 2 02:43:50.028: INFO: Logging kubelet events for node i-01b885526491052d5 Feb 2 02:43:50.059: INFO: Logging pods the kubelet thinks is on node i-01b885526491052d5 Feb 2 02:43:50.124: INFO: kube-apiserver-i-01b885526491052d5 started at 2023-02-02 02:31:38 +0000 UTC (0+2 container statuses recorded) Feb 2 02:43:50.124: INFO: Container healthcheck ready: true, restart count 0 Feb 2 02:43:50.124: INFO: Container kube-apiserver ready: true, restart count 1 Feb 2 02:43:50.124: INFO: kube-controller-manager-i-01b885526491052d5 started at 2023-02-02 02:31:38 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.124: INFO: Container kube-controller-manager ready: true, restart count 2 Feb 2 02:43:50.124: INFO: etcd-manager-events-i-01b885526491052d5 started at 2023-02-02 02:31:38 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.124: INFO: Container etcd-manager ready: true, restart count 0 Feb 2 02:43:50.124: INFO: etcd-manager-main-i-01b885526491052d5 started at 2023-02-02 02:31:38 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.124: INFO: Container etcd-manager ready: true, restart count 0 Feb 2 02:43:50.124: INFO: cilium-lzw4c started at 2023-02-02 02:32:40 +0000 UTC (1+1 container statuses recorded) Feb 2 02:43:50.124: INFO: Init container clean-cilium-state ready: true, restart count 0 Feb 2 02:43:50.124: INFO: Container cilium-agent ready: true, restart count 1 Feb 2 02:43:50.124: INFO: ebs-csi-controller-89bddb897-hx8fh started at 2023-02-02 02:32:41 +0000 UTC (0+5 container statuses recorded) Feb 2 02:43:50.124: INFO: Container csi-attacher ready: true, restart count 0 Feb 2 02:43:50.124: INFO: Container csi-provisioner ready: true, restart count 0 Feb 2 02:43:50.124: INFO: Container csi-resizer ready: true, restart count 0 Feb 2 02:43:50.124: INFO: Container ebs-plugin ready: true, restart count 0 Feb 2 02:43:50.124: INFO: Container liveness-probe ready: true, restart count 0 Feb 2 02:43:50.124: INFO: cilium-operator-6f8d6c4bf-68pf6 started at 2023-02-02 02:32:41 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.124: INFO: Container cilium-operator ready: true, restart count 1 Feb 2 02:43:50.124: INFO: kube-scheduler-i-01b885526491052d5 started at 2023-02-02 02:31:38 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.124: INFO: Container kube-scheduler ready: true, restart count 0 Feb 2 02:43:50.124: INFO: aws-cloud-controller-manager-q9pdm started at 2023-02-02 02:32:40 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.124: INFO: Container aws-cloud-controller-manager ready: true, restart count 0 Feb 2 02:43:50.124: INFO: kops-controller-f4d7p started at 2023-02-02 02:32:40 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.124: INFO: Container kops-controller ready: true, restart count 0 Feb 2 02:43:50.124: INFO: ebs-csi-node-d97sr started at 2023-02-02 02:32:40 +0000 UTC (0+3 container statuses recorded) Feb 2 02:43:50.124: INFO: Container ebs-plugin ready: true, restart count 0 Feb 2 02:43:50.124: INFO: Container liveness-probe ready: true, restart count 0 Feb 2 02:43:50.124: INFO: Container node-driver-registrar ready: true, restart count 0 Feb 2 02:43:50.124: INFO: dns-controller-74d4646d88-tqtjs started at 2023-02-02 02:32:41 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.124: INFO: Container dns-controller ready: true, restart count 0 Feb 2 02:43:50.255: INFO: Latency metrics for node i-01b885526491052d5 Feb 2 02:43:50.255: INFO: Logging node info for node i-094933bbcaafb548f Feb 2 02:43:50.285: INFO: Node Info: &Node{ObjectMeta:{i-094933bbcaafb548f f8a3e392-0d95-41f4-b73c-92cf4fc28ad0 8340 0 2023-02-02 02:33:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east-1 failure-domain.beta.kubernetes.io/zone:us-east-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-094933bbcaafb548f kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-east-1a topology.hostpath.csi/node:i-094933bbcaafb548f topology.kubernetes.io/region:us-east-1 topology.kubernetes.io/zone:us-east-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.57.122 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-094933bbcaafb548f"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-02-02 02:38:04 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-02-02 02:43:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///us-east-1a/i-094933bbcaafb548f,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078206976 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973349376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-02 02:43:46 +0000 UTC,LastTransitionTime:2023-02-02 02:33:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-02 02:43:46 +0000 UTC,LastTransitionTime:2023-02-02 02:33:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-02 02:43:46 +0000 UTC,LastTransitionTime:2023-02-02 02:33:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-02 02:43:46 +0000 UTC,LastTransitionTime:2023-02-02 02:33:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.57.122,},NodeAddress{Type:ExternalIP,Address:34.229.175.171,},NodeAddress{Type:InternalDNS,Address:i-094933bbcaafb548f.ec2.internal,},NodeAddress{Type:Hostname,Address:i-094933bbcaafb548f.ec2.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-34-229-175-171.compute-1.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2268a1fc2523b710f39d6e8dcd11f8,SystemUUID:ec2268a1-fc25-23b7-10f3-9d6e8dcd11f8,BootID:a1887cfb-af12-4b59-88c8-e5de9f1d7ef9,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.16,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Feb 2 02:43:50.285: INFO: Logging kubelet events for node i-094933bbcaafb548f Feb 2 02:43:50.317: INFO: Logging pods the kubelet thinks is on node i-094933bbcaafb548f Feb 2 02:43:50.352: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-wpbbn started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.352: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:43:50.352: INFO: csi-hostpathplugin-0 started at 2023-02-02 02:39:16 +0000 UTC (0+7 container statuses recorded) Feb 2 02:43:50.352: INFO: Container csi-attacher ready: false, restart count 0 Feb 2 02:43:50.352: INFO: Container csi-provisioner ready: false, restart count 0 Feb 2 02:43:50.352: INFO: Container csi-resizer ready: false, restart count 0 Feb 2 02:43:50.352: INFO: Container csi-snapshotter ready: false, restart count 0 Feb 2 02:43:50.352: INFO: Container hostpath ready: false, restart count 0 Feb 2 02:43:50.352: INFO: Container liveness-probe ready: false, restart count 0 Feb 2 02:43:50.352: INFO: Container node-driver-registrar ready: false, restart count 0 Feb 2 02:43:50.352: INFO: coredns-559769c974-qfr7h started at 2023-02-02 02:34:23 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.352: INFO: Container coredns ready: true, restart count 0 Feb 2 02:43:50.352: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-8jnbj started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.352: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:43:50.352: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-hvbsc started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.352: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:43:50.352: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-nwdp9 started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.352: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:43:50.352: INFO: ebs-csi-node-vgbm6 started at 2023-02-02 02:33:34 +0000 UTC (0+3 container statuses recorded) Feb 2 02:43:50.352: INFO: Container ebs-plugin ready: true, restart count 0 Feb 2 02:43:50.352: INFO: Container liveness-probe ready: true, restart count 0 Feb 2 02:43:50.352: INFO: Container node-driver-registrar ready: true, restart count 0 Feb 2 02:43:50.352: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-mn2cg started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.352: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:43:50.352: INFO: rs-wv4bz started at 2023-02-02 02:39:20 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.352: INFO: Container donothing ready: true, restart count 0 Feb 2 02:43:50.352: INFO: rs-kfs5v started at 2023-02-02 02:39:20 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.352: INFO: Container donothing ready: false, restart count 0 Feb 2 02:43:50.352: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-842cr started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.352: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:43:50.352: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-4lnlh started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.352: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:43:50.352: INFO: service-headless-pq9xf started at 2023-02-02 02:38:58 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.352: INFO: Container service-headless ready: false, restart count 0 Feb 2 02:43:50.352: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-9vt7q started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.352: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:43:50.352: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-d85kv started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.352: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:43:50.352: INFO: cilium-tc4dv started at 2023-02-02 02:33:34 +0000 UTC (1+1 container statuses recorded) Feb 2 02:43:50.352: INFO: Init container clean-cilium-state ready: true, restart count 0 Feb 2 02:43:50.352: INFO: Container cilium-agent ready: true, restart count 0 Feb 2 02:43:50.352: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-dnh8t started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.352: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:43:50.498: INFO: Latency metrics for node i-094933bbcaafb548f Feb 2 02:43:50.498: INFO: Logging node info for node i-0edda5f045be0496e Feb 2 02:43:50.527: INFO: Node Info: &Node{ObjectMeta:{i-0edda5f045be0496e 4587fb05-429b-429c-8408-c6c4e9c69a39 7737 0 2023-02-02 02:33:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east-1 failure-domain.beta.kubernetes.io/zone:us-east-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0edda5f045be0496e kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-east-1a topology.hostpath.csi/node:i-0edda5f045be0496e topology.kubernetes.io/region:us-east-1 topology.kubernetes.io/zone:us-east-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.36.32 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0edda5f045be0496e"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-02-02 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-02-02 02:33:35 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-02-02 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-02-02 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-02-02 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-02-02 02:38:05 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-02-02 02:41:03 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-02-02 02:41:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///us-east-1a/i-0edda5f045be0496e,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078206976 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973349376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-02 02:41:44 +0000 UTC,LastTransitionTime:2023-02-02 02:33:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-02 02:41:44 +0000 UTC,LastTransitionTime:2023-02-02 02:33:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-02 02:41:44 +0000 UTC,LastTransitionTime:2023-02-02 02:33:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-02 02:41:44 +0000 UTC,LastTransitionTime:2023-02-02 02:33:46 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.36.32,},NodeAddress{Type:ExternalIP,Address:107.20.131.91,},NodeAddress{Type:InternalDNS,Address:i-0edda5f045be0496e.ec2.internal,},NodeAddress{Type:Hostname,Address:i-0edda5f045be0496e.ec2.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-107-20-131-91.compute-1.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2d6d99d20e1d252ee83a35d89804ad,SystemUUID:ec2d6d99-d20e-1d25-2ee8-3a35d89804ad,BootID:d1722e01-5561-4510-a9ae-eb13b4bd9a0f,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.16,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-00adc42c65bfab5b2 kubernetes.io/csi/ebs.csi.aws.com^vol-04c22c580a5e76d0d],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-04c22c580a5e76d0d,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-00adc42c65bfab5b2,DevicePath:,},},Config:nil,},} Feb 2 02:43:50.528: INFO: Logging kubelet events for node i-0edda5f045be0496e Feb 2 02:43:50.559: INFO: Logging pods the kubelet thinks is on node i-0edda5f045be0496e Feb 2 02:43:50.595: INFO: service-headless-cw8vt started at 2023-02-02 02:38:58 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.595: INFO: Container service-headless ready: true, restart count 0 Feb 2 02:43:50.595: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-bc995 started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.595: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: false, restart count 0 Feb 2 02:43:50.595: INFO: cilium-q9c8c started at 2023-02-02 02:33:36 +0000 UTC (1+1 container statuses recorded) Feb 2 02:43:50.595: INFO: Init container clean-cilium-state ready: true, restart count 0 Feb 2 02:43:50.595: INFO: Container cilium-agent ready: true, restart count 0 Feb 2 02:43:50.595: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-jstkj started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.595: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: false, restart count 0 Feb 2 02:43:50.595: INFO: ss2-2 started at 2023-02-02 02:38:37 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.595: INFO: Container webserver ready: true, restart count 0 Feb 2 02:43:50.595: INFO: inline-volume-tester-jcmtn started at 2023-02-02 02:38:54 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.595: INFO: Container csi-volume-tester ready: true, restart count 0 Feb 2 02:43:50.595: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-pn6d4 started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.595: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:43:50.595: INFO: pod-update-e0566f22-7dbc-4426-86f8-1537068ff7f2 started at 2023-02-02 02:41:34 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.595: INFO: Container pause ready: false, restart count 0 Feb 2 02:43:50.595: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-mkbdp started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.595: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:43:50.595: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-hfvsn started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.595: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: false, restart count 0 Feb 2 02:43:50.595: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-l8l4k started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.595: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:43:50.595: INFO: rs-x9jhx started at 2023-02-02 02:39:20 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.595: INFO: Container donothing ready: true, restart count 0 Feb 2 02:43:50.595: INFO: ebs-csi-node-kbmng started at 2023-02-02 02:33:36 +0000 UTC (0+3 container statuses recorded) Feb 2 02:43:50.595: INFO: Container ebs-plugin ready: true, restart count 0 Feb 2 02:43:50.595: INFO: Container liveness-probe ready: true, restart count 0 Feb 2 02:43:50.595: INFO: Container node-driver-registrar ready: true, restart count 0 Feb 2 02:43:50.595: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-2wdkr started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.595: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:43:50.595: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-9sqms started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.595: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:43:50.595: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-8hlcn started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.595: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: false, restart count 0 Feb 2 02:43:50.595: INFO: pod-2 started at 2023-02-02 02:39:01 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.595: INFO: Container donothing ready: true, restart count 0 Feb 2 02:43:50.595: INFO: rs-pdw5z started at 2023-02-02 02:39:20 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.595: INFO: Container donothing ready: false, restart count 0 Feb 2 02:43:50.595: INFO: rs-khhlp started at 2023-02-02 02:39:20 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.595: INFO: Container donothing ready: true, restart count 0 Feb 2 02:43:50.595: INFO: pvc-volume-tester-reader-ptvl4 started at 2023-02-02 02:39:22 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.595: INFO: Container volume-tester ready: false, restart count 0 Feb 2 02:43:50.595: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-f67st started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.595: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:43:50.777: INFO: Latency metrics for node i-0edda5f045be0496e Feb 2 02:43:50.777: INFO: Logging node info for node i-0f7e2e4905cb6dadc Feb 2 02:43:50.806: INFO: Node Info: &Node{ObjectMeta:{i-0f7e2e4905cb6dadc 2adbbc9a-dd76-4b97-8d3e-a2bd14f0c57d 7056 0 2023-02-02 02:33:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east-1 failure-domain.beta.kubernetes.io/zone:us-east-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0f7e2e4905cb6dadc kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-east-1a topology.hostpath.csi/node:i-0f7e2e4905cb6dadc topology.kubernetes.io/region:us-east-1 topology.kubernetes.io/zone:us-east-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.40.134 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-9485":"i-0f7e2e4905cb6dadc","csi-mock-csi-mock-volumes-7484":"i-0f7e2e4905cb6dadc","ebs.csi.aws.com":"i-0f7e2e4905cb6dadc"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-02-02 02:33:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {e2e.test Update v1 2023-02-02 02:38:05 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-02-02 02:39:19 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-02-02 02:39:40 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///us-east-1a/i-0f7e2e4905cb6dadc,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-02 02:39:40 +0000 UTC,LastTransitionTime:2023-02-02 02:33:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-02 02:39:40 +0000 UTC,LastTransitionTime:2023-02-02 02:33:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-02 02:39:40 +0000 UTC,LastTransitionTime:2023-02-02 02:33:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-02 02:39:40 +0000 UTC,LastTransitionTime:2023-02-02 02:33:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.40.134,},NodeAddress{Type:ExternalIP,Address:18.215.155.89,},NodeAddress{Type:InternalDNS,Address:i-0f7e2e4905cb6dadc.ec2.internal,},NodeAddress{Type:Hostname,Address:i-0f7e2e4905cb6dadc.ec2.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-215-155-89.compute-1.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2d895bde004236c844d2f199d4cb6e,SystemUUID:ec2d895b-de00-4236-c844-d2f199d4cb6e,BootID:e4805eb2-7c0d-48b7-a584-7f3b4b363884,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.16,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-9485^c9ca611a-a2a2-11ed-bb7d-42e4b9bcaf4b kubernetes.io/csi/csi-mock-csi-mock-volumes-7484^ba866ccb-a2a2-11ed-b75e-522fe2d860c4],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-9485^c9ca611a-a2a2-11ed-bb7d-42e4b9bcaf4b,DevicePath:,},},Config:nil,},} Feb 2 02:43:50.807: INFO: Logging kubelet events for node i-0f7e2e4905cb6dadc Feb 2 02:43:50.837: INFO: Logging pods the kubelet thinks is on node i-0f7e2e4905cb6dadc Feb 2 02:43:50.875: INFO: hostpath-symlink-prep-provisioning-5183 started at 2023-02-02 02:39:17 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.875: INFO: Container init-volume-provisioning-5183 ready: false, restart count 0 Feb 2 02:43:50.875: INFO: hostexec-i-0f7e2e4905cb6dadc-86drv started at 2023-02-02 02:41:39 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.875: INFO: Container agnhost-container ready: true, restart count 0 Feb 2 02:43:50.875: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-pgnjx started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.875: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:43:50.875: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-s6mxr started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.875: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:43:50.875: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-vtdsx started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.875: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:43:50.875: INFO: csi-mockplugin-0 started at 2023-02-02 02:38:41 +0000 UTC (0+3 container statuses recorded) Feb 2 02:43:50.875: INFO: Container csi-provisioner ready: true, restart count 0 Feb 2 02:43:50.875: INFO: Container driver-registrar ready: true, restart count 0 Feb 2 02:43:50.875: INFO: Container mock ready: true, restart count 0 Feb 2 02:43:50.875: INFO: ss2-0 started at 2023-02-02 02:38:35 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.875: INFO: Container webserver ready: true, restart count 0 Feb 2 02:43:50.875: INFO: rs-vs5f2 started at 2023-02-02 02:39:20 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.875: INFO: Container donothing ready: false, restart count 0 Feb 2 02:43:50.875: INFO: pod-subpath-test-preprovisionedpv-f979 started at 2023-02-02 02:41:56 +0000 UTC (1+1 container statuses recorded) Feb 2 02:43:50.875: INFO: Init container init-volume-preprovisionedpv-f979 ready: false, restart count 0 Feb 2 02:43:50.875: INFO: Container test-container-subpath-preprovisionedpv-f979 ready: false, restart count 0 Feb 2 02:43:50.875: INFO: local-injector started at 2023-02-02 02:43:40 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.875: INFO: Container local-injector ready: false, restart count 0 Feb 2 02:43:50.875: INFO: csi-mockplugin-attacher-0 started at 2023-02-02 02:38:41 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.875: INFO: Container csi-attacher ready: false, restart count 0 Feb 2 02:43:50.875: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-h65xw started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.875: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:43:50.875: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-pwvqk started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.875: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:43:50.875: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-mphjv started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.875: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: false, restart count 0 Feb 2 02:43:50.875: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-xzv2d started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.875: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:43:50.875: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-m7nw9 started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.875: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: false, restart count 0 Feb 2 02:43:50.875: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-7wgzt started at 2023-02-02 02:38:06 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.875: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: false, restart count 0 Feb 2 02:43:50.875: INFO: hostexec-i-0f7e2e4905cb6dadc-prvb7 started at 2023-02-02 02:43:34 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.875: INFO: Container agnhost-container ready: true, restart count 0 Feb 2 02:43:50.875: INFO: coredns-autoscaler-7cb5c5b969-5nncn started at 2023-02-02 02:33:44 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.875: INFO: Container autoscaler ready: true, restart count 0 Feb 2 02:43:50.875: INFO: csi-hostpathplugin-0 started at 2023-02-02 02:38:44 +0000 UTC (0+7 container statuses recorded) Feb 2 02:43:50.875: INFO: Container csi-attacher ready: true, restart count 0 Feb 2 02:43:50.875: INFO: Container csi-provisioner ready: true, restart count 0 Feb 2 02:43:50.875: INFO: Container csi-resizer ready: true, restart count 0 Feb 2 02:43:50.875: INFO: Container csi-snapshotter ready: true, restart count 0 Feb 2 02:43:50.875: INFO: Container hostpath ready: true, restart count 0 Feb 2 02:43:50.875: INFO: Container liveness-probe ready: true, restart count 0 Feb 2 02:43:50.875: INFO: Container node-driver-registrar ready: true, restart count 0 Feb 2 02:43:50.875: INFO: pod-subpath-test-dynamicpv-bxxf started at 2023-02-02 02:39:19 +0000 UTC (1+1 container statuses recorded) Feb 2 02:43:50.875: INFO: Init container init-volume-dynamicpv-bxxf ready: false, restart count 0 Feb 2 02:43:50.875: INFO: Container test-container-subpath-dynamicpv-bxxf ready: false, restart count 0 Feb 2 02:43:50.875: INFO: ebs-csi-node-mkxjx started at 2023-02-02 02:33:34 +0000 UTC (0+3 container statuses recorded) Feb 2 02:43:50.875: INFO: Container ebs-plugin ready: true, restart count 0 Feb 2 02:43:50.875: INFO: Container liveness-probe ready: true, restart count 0 Feb 2 02:43:50.875: INFO: Container node-driver-registrar ready: true, restart count 0 Feb 2 02:43:50.875: INFO: coredns-559769c974-s54lm started at 2023-02-02 02:33:44 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.875: INFO: Container coredns ready: true, restart count 0 Feb 2 02:43:50.875: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-rnf4c started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.875: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:43:50.875: INFO: pvc-volume-tester-c8vzx started at 2023-02-02 02:38:53 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.875: INFO: Container volume-tester ready: false, restart count 0 Feb 2 02:43:50.875: INFO: rs-rvbxc started at 2023-02-02 02:39:20 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:50.875: INFO: Container donothing ready: false, restart count 0 Feb 2 02:43:50.875: INFO: cilium-k54gx started at 2023-02-02 02:33:34 +0000 UTC (1+1 container statuses recorded) Feb 2 02:43:50.875: INFO: Init container clean-cilium-state ready: true, restart count 0 Feb 2 02:43:50.875: INFO: Container cilium-agent ready: true, restart count 0 Feb 2 02:43:51.046: INFO: Latency metrics for node i-0f7e2e4905cb6dadc Feb 2 02:43:51.046: INFO: Logging node info for node i-0fe5d857b6eb4dfe3 Feb 2 02:43:51.076: INFO: Node Info: &Node{ObjectMeta:{i-0fe5d857b6eb4dfe3 9d0f7cfc-7470-4601-b0c7-c2b476a9fab7 8318 0 2023-02-02 02:33:43 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east-1 failure-domain.beta.kubernetes.io/zone:us-east-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0fe5d857b6eb4dfe3 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-east-1a topology.hostpath.csi/node:i-0fe5d857b6eb4dfe3 topology.kubernetes.io/region:us-east-1 topology.kubernetes.io/zone:us-east-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.53.228 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0fe5d857b6eb4dfe3"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-02-02 02:33:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-02-02 02:33:43 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-02-02 02:33:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-02-02 02:33:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-02-02 02:33:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-02-02 02:38:05 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-02-02 02:43:42 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-02-02 02:43:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///us-east-1a/i-0fe5d857b6eb4dfe3,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078206976 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973349376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-02 02:43:44 +0000 UTC,LastTransitionTime:2023-02-02 02:33:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-02 02:43:44 +0000 UTC,LastTransitionTime:2023-02-02 02:33:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-02 02:43:44 +0000 UTC,LastTransitionTime:2023-02-02 02:33:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-02 02:43:44 +0000 UTC,LastTransitionTime:2023-02-02 02:33:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.53.228,},NodeAddress{Type:ExternalIP,Address:18.212.239.71,},NodeAddress{Type:InternalDNS,Address:i-0fe5d857b6eb4dfe3.ec2.internal,},NodeAddress{Type:Hostname,Address:i-0fe5d857b6eb4dfe3.ec2.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-212-239-71.compute-1.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23a338ffd343d89814911cd0d0d8ea,SystemUUID:ec23a338-ffd3-43d8-9814-911cd0d0d8ea,BootID:588a11ea-21bc-44af-808b-852f5f90dd84,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.16,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-021fcced421837e53 kubernetes.io/csi/ebs.csi.aws.com^vol-06c549b1251626bdf kubernetes.io/csi/ebs.csi.aws.com^vol-08de06f77783ea680 kubernetes.io/csi/ebs.csi.aws.com^vol-099bf0e1f55ee83c6 kubernetes.io/csi/ebs.csi.aws.com^vol-0c4a2d0a3ad476e6b],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-021fcced421837e53,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-099bf0e1f55ee83c6,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-06c549b1251626bdf,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-08de06f77783ea680,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0c4a2d0a3ad476e6b,DevicePath:,},},Config:nil,},} Feb 2 02:43:51.076: INFO: Logging kubelet events for node i-0fe5d857b6eb4dfe3 Feb 2 02:43:51.107: INFO: Logging pods the kubelet thinks is on node i-0fe5d857b6eb4dfe3 Feb 2 02:43:51.145: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-sb6sx started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:51.145: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:43:51.145: INFO: ss2-1 started at 2023-02-02 02:41:26 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:51.145: INFO: Container webserver ready: false, restart count 0 Feb 2 02:43:51.145: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-n4rbc started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:51.145: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:43:51.145: INFO: pod-1 started at 2023-02-02 02:39:01 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:51.145: INFO: Container donothing ready: false, restart count 0 Feb 2 02:43:51.145: INFO: httpd started at 2023-02-02 02:39:06 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:51.145: INFO: Container httpd ready: false, restart count 0 Feb 2 02:43:51.145: INFO: pod-subpath-test-dynamicpv-6xtb started at 2023-02-02 02:43:40 +0000 UTC (2+1 container statuses recorded) Feb 2 02:43:51.145: INFO: Init container init-volume-dynamicpv-6xtb ready: false, restart count 0 Feb 2 02:43:51.145: INFO: Init container test-init-volume-dynamicpv-6xtb ready: false, restart count 0 Feb 2 02:43:51.145: INFO: Container test-container-subpath-dynamicpv-6xtb ready: false, restart count 0 Feb 2 02:43:51.145: INFO: pod-a45c6964-0be7-4212-ba75-32a87b45e7f3 started at 2023-02-02 02:42:10 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:51.145: INFO: Container write-pod ready: false, restart count 0 Feb 2 02:43:51.145: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-dz5bh started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:51.145: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:43:51.145: INFO: pod-subpath-test-dynamicpv-2tnq started at 2023-02-02 02:39:33 +0000 UTC (2+1 container statuses recorded) Feb 2 02:43:51.145: INFO: Init container init-volume-dynamicpv-2tnq ready: false, restart count 0 Feb 2 02:43:51.145: INFO: Init container test-init-volume-dynamicpv-2tnq ready: false, restart count 0 Feb 2 02:43:51.145: INFO: Container test-container-subpath-dynamicpv-2tnq ready: false, restart count 0 Feb 2 02:43:51.145: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-dss8d started at 2023-02-02 02:38:06 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:51.145: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:43:51.145: INFO: inline-volume-tester2-wpgg7 started at 2023-02-02 02:39:34 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:51.145: INFO: Container csi-volume-tester ready: false, restart count 0 Feb 2 02:43:51.145: INFO: ebs-csi-node-qqz2d started at 2023-02-02 02:33:43 +0000 UTC (0+3 container statuses recorded) Feb 2 02:43:51.145: INFO: Container ebs-plugin ready: true, restart count 0 Feb 2 02:43:51.145: INFO: Container liveness-probe ready: true, restart count 0 Feb 2 02:43:51.145: INFO: Container node-driver-registrar ready: true, restart count 0 Feb 2 02:43:51.145: INFO: rs-pc45g started at 2023-02-02 02:39:21 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:51.145: INFO: Container donothing ready: true, restart count 0 Feb 2 02:43:51.145: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-snv7k started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:51.145: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:43:51.145: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-7j88c started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:51.145: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:43:51.145: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-2psrz started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:51.145: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:43:51.145: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-7xd6t started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:51.145: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:43:51.145: INFO: hostexec-i-0fe5d857b6eb4dfe3-lx74v started at 2023-02-02 02:42:01 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:51.145: INFO: Container agnhost-container ready: true, restart count 0 Feb 2 02:43:51.145: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-j9kxn started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:51.145: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:43:51.145: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-965cw started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:51.145: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:43:51.145: INFO: rs-hhq9v started at 2023-02-02 02:39:20 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:51.145: INFO: Container donothing ready: false, restart count 0 Feb 2 02:43:51.145: INFO: pod-projected-secrets-918e5772-55b0-4269-825b-3ee86000400e started at 2023-02-02 02:41:19 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:51.145: INFO: Container projected-secret-volume-test ready: false, restart count 0 Feb 2 02:43:51.145: INFO: pod-059e4fe9-a68f-4452-baaa-69b48b71743f started at 2023-02-02 02:39:31 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:51.145: INFO: Container write-pod ready: false, restart count 0 Feb 2 02:43:51.145: INFO: rs-qxhxb started at 2023-02-02 02:39:20 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:51.145: INFO: Container donothing ready: false, restart count 0 Feb 2 02:43:51.145: INFO: pod-projected-secrets-6f0d7385-d977-4fbe-a186-ff66930802df started at 2023-02-02 02:39:22 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:51.145: INFO: Container projected-secret-volume-test ready: false, restart count 0 Feb 2 02:43:51.145: INFO: service-headless-rgvn4 started at 2023-02-02 02:38:58 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:51.145: INFO: Container service-headless ready: false, restart count 0 Feb 2 02:43:51.145: INFO: pod-projected-secrets-1b41cf48-d8fd-4fe7-91ba-525ecc657f65 started at 2023-02-02 02:39:11 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:51.145: INFO: Container projected-secret-volume-test ready: false, restart count 0 Feb 2 02:43:51.145: INFO: pod-always-succeed545112d7-d6bd-40a2-ba1a-654186f0078d started at 2023-02-02 02:43:44 +0000 UTC (1+1 container statuses recorded) Feb 2 02:43:51.145: INFO: Init container foo ready: false, restart count 0 Feb 2 02:43:51.145: INFO: Container bar ready: false, restart count 0 Feb 2 02:43:51.145: INFO: cilium-gffsv started at 2023-02-02 02:33:43 +0000 UTC (1+1 container statuses recorded) Feb 2 02:43:51.145: INFO: Init container clean-cilium-state ready: true, restart count 0 Feb 2 02:43:51.145: INFO: Container cilium-agent ready: true, restart count 0 Feb 2 02:43:51.145: INFO: inline-volume-tester-vzj57 started at 2023-02-02 02:38:29 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:51.145: INFO: Container csi-volume-tester ready: false, restart count 0 Feb 2 02:43:51.145: INFO: pod-0 started at 2023-02-02 02:39:01 +0000 UTC (0+1 container statuses recorded) Feb 2 02:43:51.145: INFO: Container donothing ready: true, restart count 0 Feb 2 02:43:51.322: INFO: Latency metrics for node i-0fe5d857b6eb4dfe3 [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath tear down framework | framework.go:193 �[1mSTEP:�[0m Destroying namespace "provisioning-8979" for this suite. �[38;5;243m02/02/23 02:43:51.322�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\sExternal\sStorage\s\[Driver\:\sebs\.csi\.aws\.com\]\s\[Testpattern\:\sDynamic\sPV\s\(default\sfs\)\]\ssubPath\sshould\ssupport\sreadOnly\sdirectory\sspecified\sin\sthe\svolumeMount$'
test/e2e/framework/pod/output/output.go:237 k8s.io/kubernetes/test/e2e/framework/pod/output.TestContainerOutputMatcher(0xc002d58480?, {0x75c4bbe?, 0x0?}, 0xc002d58480, 0x0, {0xc0008bfec0, 0x1, 0x1}, 0x34?) test/e2e/framework/pod/output/output.go:237 +0x176 k8s.io/kubernetes/test/e2e/framework/pod/output.TestContainerOutput(...) test/e2e/framework/pod/output/output.go:214 k8s.io/kubernetes/test/e2e/storage/testsuites.testReadFile(0xc0016a53b0, {0xc003592408, 0x16}, 0xc002d58480, 0x0) test/e2e/storage/testsuites/subpath.go:691 +0x15c k8s.io/kubernetes/test/e2e/storage/testsuites.(*subPathTestSuite).DefineTests.func16() test/e2e/storage/testsuites/subpath.go:377 +0x1dafrom junit_01.xml
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath test/e2e/storage/framework/testsuite.go:51 [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath set up framework | framework.go:178 �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m02/02/23 02:39:26.304�[0m Feb 2 02:39:26.304: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP:�[0m Building a namespace api object, basename provisioning �[38;5;243m02/02/23 02:39:26.305�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m02/02/23 02:39:26.395�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m02/02/23 02:39:26.451�[0m [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath test/e2e/framework/metrics/init/init.go:31 [It] should support readOnly directory specified in the volumeMount test/e2e/storage/testsuites/subpath.go:365 Feb 2 02:39:26.507: INFO: Creating resource for dynamic PV Feb 2 02:39:26.507: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} �[1mSTEP:�[0m creating a StorageClass provisioning-9832-e2e-sckqqhk �[38;5;243m02/02/23 02:39:26.508�[0m �[1mSTEP:�[0m creating a claim �[38;5;243m02/02/23 02:39:26.539�[0m Feb 2 02:39:26.539: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil �[1mSTEP:�[0m Creating pod pod-subpath-test-dynamicpv-2tnq �[38;5;243m02/02/23 02:39:26.602�[0m �[1mSTEP:�[0m Creating a pod to test subpath �[38;5;243m02/02/23 02:39:26.602�[0m Feb 2 02:39:26.636: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-2tnq" in namespace "provisioning-9832" to be "Succeeded or Failed" Feb 2 02:39:26.664: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 28.102527ms Feb 2 02:39:28.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 2.057387732s Feb 2 02:39:30.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 4.057796553s Feb 2 02:39:32.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 6.057365112s Feb 2 02:39:34.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 8.057451284s Feb 2 02:39:36.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 10.056940251s Feb 2 02:39:38.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 12.056867551s Feb 2 02:39:40.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 14.057455947s Feb 2 02:39:42.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 16.057571717s Feb 2 02:39:44.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 18.057400334s Feb 2 02:39:46.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 20.05752181s Feb 2 02:39:48.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 22.057312284s Feb 2 02:39:50.695: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 24.059010794s Feb 2 02:39:52.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 26.057062354s Feb 2 02:39:54.692: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 28.056604232s Feb 2 02:39:56.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 30.056994712s Feb 2 02:39:58.692: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 32.056797594s Feb 2 02:40:00.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 34.056979161s Feb 2 02:40:02.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 36.056920244s Feb 2 02:40:04.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 38.057190657s Feb 2 02:40:06.695: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 40.059074965s Feb 2 02:40:08.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 42.057229754s Feb 2 02:40:10.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 44.056845822s Feb 2 02:40:12.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 46.057377386s Feb 2 02:40:14.692: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 48.056624749s Feb 2 02:40:16.692: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 50.056598752s Feb 2 02:40:18.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 52.057053724s Feb 2 02:40:20.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 54.056916636s Feb 2 02:40:22.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 56.057059853s Feb 2 02:40:24.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 58.057396544s Feb 2 02:40:26.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.057350635s Feb 2 02:40:28.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.057536948s Feb 2 02:40:30.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.057026226s Feb 2 02:40:32.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.057550789s Feb 2 02:40:34.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.057066785s Feb 2 02:40:36.692: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.056565867s Feb 2 02:40:38.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.057561738s Feb 2 02:40:40.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.056857751s Feb 2 02:40:42.692: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.056591618s Feb 2 02:40:44.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.056903051s Feb 2 02:40:46.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.056934s Feb 2 02:40:48.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.057363877s Feb 2 02:40:50.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.057041252s Feb 2 02:40:52.695: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.058994057s Feb 2 02:40:54.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.057210861s Feb 2 02:40:56.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.057492291s Feb 2 02:40:58.692: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.056807662s Feb 2 02:41:00.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.057321661s Feb 2 02:41:02.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.057525523s Feb 2 02:41:04.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.057388161s Feb 2 02:41:06.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.057090571s Feb 2 02:41:08.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.057208662s Feb 2 02:41:10.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.057089598s Feb 2 02:41:12.692: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.056797029s Feb 2 02:41:14.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.057293887s Feb 2 02:41:16.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.056983785s Feb 2 02:41:18.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.057112054s Feb 2 02:41:20.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.05688165s Feb 2 02:41:22.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.056835322s Feb 2 02:41:24.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.056884605s Feb 2 02:41:26.692: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.0567253s Feb 2 02:41:28.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.056961222s Feb 2 02:41:30.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.056964109s Feb 2 02:41:32.694: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.058167925s Feb 2 02:41:34.692: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.056677368s Feb 2 02:41:36.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.057753648s Feb 2 02:41:38.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.057319644s Feb 2 02:41:40.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.05721893s Feb 2 02:41:42.692: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.056717578s Feb 2 02:41:44.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.057566016s Feb 2 02:41:46.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.056949787s Feb 2 02:41:48.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.057083704s Feb 2 02:41:50.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.057259901s Feb 2 02:41:52.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.057447385s Feb 2 02:41:54.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.057453997s Feb 2 02:41:56.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.056948014s Feb 2 02:41:58.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.057376606s Feb 2 02:42:00.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.057424447s Feb 2 02:42:02.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.057370853s Feb 2 02:42:04.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.057555153s Feb 2 02:42:06.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.056875589s Feb 2 02:42:08.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.057179028s Feb 2 02:42:10.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.056945075s Feb 2 02:42:12.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.056913206s Feb 2 02:42:14.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.057409756s Feb 2 02:42:16.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.057623323s Feb 2 02:42:18.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.057196744s Feb 2 02:42:20.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.057082288s Feb 2 02:42:22.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.05706123s Feb 2 02:42:24.692: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.056641914s Feb 2 02:42:26.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.057216916s Feb 2 02:42:28.692: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.056790804s Feb 2 02:42:30.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.056834758s Feb 2 02:42:32.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.057731292s Feb 2 02:42:34.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.056981344s Feb 2 02:42:36.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.056976302s Feb 2 02:42:38.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.057443649s Feb 2 02:42:40.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.057554158s Feb 2 02:42:42.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.056970938s Feb 2 02:42:44.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.057472936s Feb 2 02:42:46.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.056963786s Feb 2 02:42:48.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.057223895s Feb 2 02:42:50.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.057083233s Feb 2 02:42:52.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.057168869s Feb 2 02:42:54.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.05742436s Feb 2 02:42:56.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.056946682s Feb 2 02:42:58.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.057075668s Feb 2 02:43:00.692: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.056612472s Feb 2 02:43:02.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.057140414s Feb 2 02:43:04.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.057195273s Feb 2 02:43:06.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.057066311s Feb 2 02:43:08.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.057625801s Feb 2 02:43:10.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.057360402s Feb 2 02:43:12.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.057054621s Feb 2 02:43:14.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.057581598s Feb 2 02:43:16.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.057151191s Feb 2 02:43:18.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.05686133s Feb 2 02:43:20.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.057328021s Feb 2 02:43:22.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.057463857s Feb 2 02:43:24.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.05755715s Feb 2 02:43:26.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.057169407s Feb 2 02:43:28.692: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.056817365s Feb 2 02:43:30.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.056860435s Feb 2 02:43:32.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.057058913s Feb 2 02:43:34.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.057453408s Feb 2 02:43:36.692: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.056638595s Feb 2 02:43:38.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.056931182s Feb 2 02:43:40.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.057279512s Feb 2 02:43:42.692: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.056652477s Feb 2 02:43:44.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.057427548s Feb 2 02:43:46.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.057081838s Feb 2 02:43:48.692: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.056788503s Feb 2 02:43:50.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.057026338s Feb 2 02:43:52.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.057527794s Feb 2 02:43:54.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.057429241s Feb 2 02:43:56.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.056844814s Feb 2 02:43:58.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.056980214s Feb 2 02:44:00.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.057224365s Feb 2 02:44:02.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.056942194s Feb 2 02:44:04.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.05737126s Feb 2 02:44:06.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.056955179s Feb 2 02:44:08.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.057408412s Feb 2 02:44:10.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.056947145s Feb 2 02:44:12.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.057602764s Feb 2 02:44:14.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.056955327s Feb 2 02:44:16.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.057607354s Feb 2 02:44:18.692: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.056686128s Feb 2 02:44:20.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.057100401s Feb 2 02:44:22.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.056926201s Feb 2 02:44:24.694: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.057854108s Feb 2 02:44:26.693: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.057071813s Feb 2 02:44:26.721: INFO: Pod "pod-subpath-test-dynamicpv-2tnq": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.085024778s Feb 2 02:44:26.779: INFO: Failed to get logs from node "i-0fe5d857b6eb4dfe3" pod "pod-subpath-test-dynamicpv-2tnq" container "init-volume-dynamicpv-2tnq": the server rejected our request for an unknown reason (get pods pod-subpath-test-dynamicpv-2tnq) Feb 2 02:44:26.808: INFO: Failed to get logs from node "i-0fe5d857b6eb4dfe3" pod "pod-subpath-test-dynamicpv-2tnq" container "test-init-volume-dynamicpv-2tnq": the server rejected our request for an unknown reason (get pods pod-subpath-test-dynamicpv-2tnq) Feb 2 02:44:26.838: INFO: Failed to get logs from node "i-0fe5d857b6eb4dfe3" pod "pod-subpath-test-dynamicpv-2tnq" container "test-container-subpath-dynamicpv-2tnq": the server rejected our request for an unknown reason (get pods pod-subpath-test-dynamicpv-2tnq) �[1mSTEP:�[0m delete the pod �[38;5;243m02/02/23 02:44:26.838�[0m Feb 2 02:44:26.872: INFO: Waiting for pod pod-subpath-test-dynamicpv-2tnq to disappear Feb 2 02:44:26.900: INFO: Pod pod-subpath-test-dynamicpv-2tnq still exists Feb 2 02:44:28.901: INFO: Waiting for pod pod-subpath-test-dynamicpv-2tnq to disappear Feb 2 02:44:28.933: INFO: Pod pod-subpath-test-dynamicpv-2tnq no longer exists Feb 2 02:44:28.933: INFO: Unexpected error: <*errors.errorString | 0xc001166fd0>: { s: "expected pod \"pod-subpath-test-dynamicpv-2tnq\" success: timed out while waiting for pod provisioning-9832/pod-subpath-test-dynamicpv-2tnq to be Succeeded or Failed", } Feb 2 02:44:28.933: FAIL: expected pod "pod-subpath-test-dynamicpv-2tnq" success: timed out while waiting for pod provisioning-9832/pod-subpath-test-dynamicpv-2tnq to be Succeeded or Failed Full Stack Trace k8s.io/kubernetes/test/e2e/framework/pod/output.TestContainerOutputMatcher(0xc002d58480?, {0x75c4bbe?, 0x0?}, 0xc002d58480, 0x0, {0xc0008bfec0, 0x1, 0x1}, 0x34?) test/e2e/framework/pod/output/output.go:237 +0x176 k8s.io/kubernetes/test/e2e/framework/pod/output.TestContainerOutput(...) test/e2e/framework/pod/output/output.go:214 k8s.io/kubernetes/test/e2e/storage/testsuites.testReadFile(0xc0016a53b0, {0xc003592408, 0x16}, 0xc002d58480, 0x0) test/e2e/storage/testsuites/subpath.go:691 +0x15c k8s.io/kubernetes/test/e2e/storage/testsuites.(*subPathTestSuite).DefineTests.func16() test/e2e/storage/testsuites/subpath.go:377 +0x1da �[1mSTEP:�[0m Deleting pod �[38;5;243m02/02/23 02:44:28.933�[0m Feb 2 02:44:28.933: INFO: Deleting pod "pod-subpath-test-dynamicpv-2tnq" in namespace "provisioning-9832" �[1mSTEP:�[0m Deleting pvc �[38;5;243m02/02/23 02:44:28.961�[0m Feb 2 02:44:29.017: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.comk7qnz" Feb 2 02:44:29.049: INFO: Waiting up to 5m0s for PersistentVolume pvc-23c7b0d5-cf4a-4183-ab4c-1298f1763b26 to get deleted Feb 2 02:44:29.077: INFO: PersistentVolume pvc-23c7b0d5-cf4a-4183-ab4c-1298f1763b26 found and phase=Released (27.908115ms) Feb 2 02:44:34.106: INFO: PersistentVolume pvc-23c7b0d5-cf4a-4183-ab4c-1298f1763b26 found and phase=Released (5.056581778s) Feb 2 02:44:39.135: INFO: PersistentVolume pvc-23c7b0d5-cf4a-4183-ab4c-1298f1763b26 found and phase=Released (10.085723227s) Feb 2 02:44:44.164: INFO: PersistentVolume pvc-23c7b0d5-cf4a-4183-ab4c-1298f1763b26 found and phase=Released (15.114858785s) Feb 2 02:44:49.193: INFO: PersistentVolume pvc-23c7b0d5-cf4a-4183-ab4c-1298f1763b26 was removed �[1mSTEP:�[0m Deleting sc �[38;5;243m02/02/23 02:44:49.193�[0m [AfterEach] [Testpattern: Dynamic PV (default fs)] subPath test/e2e/framework/node/init/init.go:32 Feb 2 02:44:49.223: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath dump namespaces | framework.go:196 �[1mSTEP:�[0m dump namespace information after failure �[38;5;243m02/02/23 02:44:49.253�[0m �[1mSTEP:�[0m Collecting events from namespace "provisioning-9832". �[38;5;243m02/02/23 02:44:49.253�[0m �[1mSTEP:�[0m Found 16 events. �[38;5;243m02/02/23 02:44:49.282�[0m Feb 2 02:44:49.282: INFO: At 2023-02-02 02:39:26 +0000 UTC - event for ebs.csi.aws.comk7qnz: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding Feb 2 02:44:49.282: INFO: At 2023-02-02 02:39:26 +0000 UTC - event for ebs.csi.aws.comk7qnz: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "ebs.csi.aws.com" or manually created by system administrator Feb 2 02:44:49.282: INFO: At 2023-02-02 02:39:26 +0000 UTC - event for ebs.csi.aws.comk7qnz: {ebs.csi.aws.com_i-01b885526491052d5_d47994d4-b7e1-4596-a8c0-cb83c8f567ef } Provisioning: External provisioner is provisioning volume for claim "provisioning-9832/ebs.csi.aws.comk7qnz" Feb 2 02:44:49.282: INFO: At 2023-02-02 02:39:32 +0000 UTC - event for ebs.csi.aws.comk7qnz: {ebs.csi.aws.com_i-01b885526491052d5_d47994d4-b7e1-4596-a8c0-cb83c8f567ef } ProvisioningSucceeded: Successfully provisioned volume pvc-23c7b0d5-cf4a-4183-ab4c-1298f1763b26 Feb 2 02:44:49.282: INFO: At 2023-02-02 02:39:33 +0000 UTC - event for pod-subpath-test-dynamicpv-2tnq: {default-scheduler } Scheduled: Successfully assigned provisioning-9832/pod-subpath-test-dynamicpv-2tnq to i-0fe5d857b6eb4dfe3 Feb 2 02:44:49.282: INFO: At 2023-02-02 02:39:36 +0000 UTC - event for pod-subpath-test-dynamicpv-2tnq: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-23c7b0d5-cf4a-4183-ab4c-1298f1763b26" Feb 2 02:44:49.282: INFO: At 2023-02-02 02:39:41 +0000 UTC - event for pod-subpath-test-dynamicpv-2tnq: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "8b3128530915188e642105a7cba3e5f24e5cc06673591e427c1f88bc349ed1df": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:44:49.282: INFO: At 2023-02-02 02:39:57 +0000 UTC - event for pod-subpath-test-dynamicpv-2tnq: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "08504a7a052e155e03f6f7f02fa2d0a468fcd337c2897a0cca657a6df716dfdd": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:44:49.282: INFO: At 2023-02-02 02:40:11 +0000 UTC - event for pod-subpath-test-dynamicpv-2tnq: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "fd845177c86031caf9d6f41a0613b55936883645dbe4eaa89b1af26724726e70": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:44:49.282: INFO: At 2023-02-02 02:40:26 +0000 UTC - event for pod-subpath-test-dynamicpv-2tnq: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "60f96d17fa870d7eed48388ed7ca87f3bdcb680feff1d7d6cb6edfbab1f4f53f": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:44:49.282: INFO: At 2023-02-02 02:40:39 +0000 UTC - event for pod-subpath-test-dynamicpv-2tnq: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "0576e2d0abd1d50b22f99a09d62419430ec11bcae43cf87f8cde2f4ee1c700f4": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:44:49.282: INFO: At 2023-02-02 02:40:53 +0000 UTC - event for pod-subpath-test-dynamicpv-2tnq: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "07fe4686acc0b99e796c1da852b5a23a7777d4efde983ea01c01381194622271": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:44:49.282: INFO: At 2023-02-02 02:41:04 +0000 UTC - event for pod-subpath-test-dynamicpv-2tnq: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "70930b92a1e4b44f503f853838943d95cd6097fcc36ef0ac3047a6491ebb6b31": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:44:49.282: INFO: At 2023-02-02 02:41:18 +0000 UTC - event for pod-subpath-test-dynamicpv-2tnq: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "5f497866451fa135d49639a55c6d6b7d7b2146d44441f1c4891095e6dbe54f5b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:44:49.282: INFO: At 2023-02-02 02:41:31 +0000 UTC - event for pod-subpath-test-dynamicpv-2tnq: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "f9d59afeecf4dadcb9f3915e794189e9f388556a0d6dd233a481ee992559125a": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:44:49.282: INFO: At 2023-02-02 02:41:43 +0000 UTC - event for pod-subpath-test-dynamicpv-2tnq: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "95f33ef640d80947c3956bc005592b15afbffdee3ba5d9904589b0c44c7c81fb": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:44:49.310: INFO: POD NODE PHASE GRACE CONDITIONS Feb 2 02:44:49.310: INFO: Feb 2 02:44:49.339: INFO: Logging node info for node i-01b885526491052d5 Feb 2 02:44:49.367: INFO: Node Info: &Node{ObjectMeta:{i-01b885526491052d5 dc5fa938-4b08-4e13-a650-8859f804b492 7089 0 2023-02-02 02:32:08 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east-1 failure-domain.beta.kubernetes.io/zone:us-east-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-01b885526491052d5 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:us-east-1a topology.kubernetes.io/region:us-east-1 topology.kubernetes.io/zone:us-east-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.61.65 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-01b885526491052d5"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-02-02 02:32:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-02-02 02:32:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {aws-cloud-controller-manager Update v1 2023-02-02 02:32:44 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-02-02 02:32:44 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-02-02 02:32:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-02-02 02:39:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///us-east-1a/i-01b885526491052d5,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3918811136 0} {<nil>} 3826964Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3813953536 0} {<nil>} 3724564Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-02 02:39:47 +0000 UTC,LastTransitionTime:2023-02-02 02:32:07 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-02 02:39:47 +0000 UTC,LastTransitionTime:2023-02-02 02:32:07 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-02 02:39:47 +0000 UTC,LastTransitionTime:2023-02-02 02:32:07 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-02 02:39:47 +0000 UTC,LastTransitionTime:2023-02-02 02:32:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.61.65,},NodeAddress{Type:ExternalIP,Address:54.205.170.33,},NodeAddress{Type:InternalDNS,Address:i-01b885526491052d5.ec2.internal,},NodeAddress{Type:Hostname,Address:i-01b885526491052d5.ec2.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-205-170-33.compute-1.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec26507379484fef3914c7eb427dc82e,SystemUUID:ec265073-7948-4fef-3914-c7eb427dc82e,BootID:9d8938d3-ec44-44d3-9a12-0dbd68248bf9,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.16,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:5ffb3f7cade4ae1d8c952251abb0c8bdfa8d4d9acb2c364e763328bd6f3d06aa registry.k8s.io/etcdadm/etcd-manager:v3.0.20230201],SizeBytes:243803152,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.1],SizeBytes:135178704,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.1],SizeBytes:124995897,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.1],SizeBytes:57661752,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-beta.2],SizeBytes:43857040,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-beta.2],SizeBytes:42821718,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-beta.2],SizeBytes:4965807,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Feb 2 02:44:49.368: INFO: Logging kubelet events for node i-01b885526491052d5 Feb 2 02:44:49.403: INFO: Logging pods the kubelet thinks is on node i-01b885526491052d5 Feb 2 02:44:49.465: INFO: etcd-manager-main-i-01b885526491052d5 started at 2023-02-02 02:31:38 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:49.465: INFO: Container etcd-manager ready: true, restart count 0 Feb 2 02:44:49.465: INFO: cilium-lzw4c started at 2023-02-02 02:32:40 +0000 UTC (1+1 container statuses recorded) Feb 2 02:44:49.465: INFO: Init container clean-cilium-state ready: true, restart count 0 Feb 2 02:44:49.465: INFO: Container cilium-agent ready: true, restart count 1 Feb 2 02:44:49.465: INFO: ebs-csi-controller-89bddb897-hx8fh started at 2023-02-02 02:32:41 +0000 UTC (0+5 container statuses recorded) Feb 2 02:44:49.465: INFO: Container csi-attacher ready: true, restart count 0 Feb 2 02:44:49.465: INFO: Container csi-provisioner ready: true, restart count 0 Feb 2 02:44:49.465: INFO: Container csi-resizer ready: true, restart count 0 Feb 2 02:44:49.465: INFO: Container ebs-plugin ready: true, restart count 0 Feb 2 02:44:49.465: INFO: Container liveness-probe ready: true, restart count 0 Feb 2 02:44:49.465: INFO: cilium-operator-6f8d6c4bf-68pf6 started at 2023-02-02 02:32:41 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:49.465: INFO: Container cilium-operator ready: true, restart count 1 Feb 2 02:44:49.465: INFO: kube-apiserver-i-01b885526491052d5 started at 2023-02-02 02:31:38 +0000 UTC (0+2 container statuses recorded) Feb 2 02:44:49.465: INFO: Container healthcheck ready: true, restart count 0 Feb 2 02:44:49.465: INFO: Container kube-apiserver ready: true, restart count 1 Feb 2 02:44:49.465: INFO: kube-controller-manager-i-01b885526491052d5 started at 2023-02-02 02:31:38 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:49.465: INFO: Container kube-controller-manager ready: true, restart count 2 Feb 2 02:44:49.465: INFO: etcd-manager-events-i-01b885526491052d5 started at 2023-02-02 02:31:38 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:49.465: INFO: Container etcd-manager ready: true, restart count 0 Feb 2 02:44:49.465: INFO: ebs-csi-node-d97sr started at 2023-02-02 02:32:40 +0000 UTC (0+3 container statuses recorded) Feb 2 02:44:49.465: INFO: Container ebs-plugin ready: true, restart count 0 Feb 2 02:44:49.465: INFO: Container liveness-probe ready: true, restart count 0 Feb 2 02:44:49.465: INFO: Container node-driver-registrar ready: true, restart count 0 Feb 2 02:44:49.465: INFO: dns-controller-74d4646d88-tqtjs started at 2023-02-02 02:32:41 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:49.465: INFO: Container dns-controller ready: true, restart count 0 Feb 2 02:44:49.465: INFO: kube-scheduler-i-01b885526491052d5 started at 2023-02-02 02:31:38 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:49.465: INFO: Container kube-scheduler ready: true, restart count 0 Feb 2 02:44:49.465: INFO: aws-cloud-controller-manager-q9pdm started at 2023-02-02 02:32:40 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:49.465: INFO: Container aws-cloud-controller-manager ready: true, restart count 0 Feb 2 02:44:49.465: INFO: kops-controller-f4d7p started at 2023-02-02 02:32:40 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:49.465: INFO: Container kops-controller ready: true, restart count 0 Feb 2 02:44:49.597: INFO: Latency metrics for node i-01b885526491052d5 Feb 2 02:44:49.597: INFO: Logging node info for node i-094933bbcaafb548f Feb 2 02:44:49.625: INFO: Node Info: &Node{ObjectMeta:{i-094933bbcaafb548f f8a3e392-0d95-41f4-b73c-92cf4fc28ad0 8340 0 2023-02-02 02:33:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east-1 failure-domain.beta.kubernetes.io/zone:us-east-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-094933bbcaafb548f kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-east-1a topology.hostpath.csi/node:i-094933bbcaafb548f topology.kubernetes.io/region:us-east-1 topology.kubernetes.io/zone:us-east-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.57.122 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-094933bbcaafb548f"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-02-02 02:38:04 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-02-02 02:43:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///us-east-1a/i-094933bbcaafb548f,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078206976 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973349376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-02 02:43:46 +0000 UTC,LastTransitionTime:2023-02-02 02:33:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-02 02:43:46 +0000 UTC,LastTransitionTime:2023-02-02 02:33:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-02 02:43:46 +0000 UTC,LastTransitionTime:2023-02-02 02:33:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-02 02:43:46 +0000 UTC,LastTransitionTime:2023-02-02 02:33:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.57.122,},NodeAddress{Type:ExternalIP,Address:34.229.175.171,},NodeAddress{Type:InternalDNS,Address:i-094933bbcaafb548f.ec2.internal,},NodeAddress{Type:Hostname,Address:i-094933bbcaafb548f.ec2.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-34-229-175-171.compute-1.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2268a1fc2523b710f39d6e8dcd11f8,SystemUUID:ec2268a1-fc25-23b7-10f3-9d6e8dcd11f8,BootID:a1887cfb-af12-4b59-88c8-e5de9f1d7ef9,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.16,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Feb 2 02:44:49.626: INFO: Logging kubelet events for node i-094933bbcaafb548f Feb 2 02:44:49.656: INFO: Logging pods the kubelet thinks is on node i-094933bbcaafb548f Feb 2 02:44:49.691: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-4lnlh started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:49.691: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:44:49.691: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-9vt7q started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:49.691: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:44:49.691: INFO: service-headless-pq9xf started at 2023-02-02 02:38:58 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:49.691: INFO: Container service-headless ready: false, restart count 0 Feb 2 02:44:49.691: INFO: cilium-tc4dv started at 2023-02-02 02:33:34 +0000 UTC (1+1 container statuses recorded) Feb 2 02:44:49.691: INFO: Init container clean-cilium-state ready: true, restart count 0 Feb 2 02:44:49.691: INFO: Container cilium-agent ready: true, restart count 0 Feb 2 02:44:49.691: INFO: netserver-0 started at 2023-02-02 02:43:51 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:49.691: INFO: Container webserver ready: false, restart count 0 Feb 2 02:44:49.691: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-d85kv started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:49.691: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:44:49.691: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-dnh8t started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:49.691: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:44:49.691: INFO: coredns-559769c974-qfr7h started at 2023-02-02 02:34:23 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:49.691: INFO: Container coredns ready: true, restart count 0 Feb 2 02:44:49.691: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-wpbbn started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:49.691: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:44:49.691: INFO: csi-hostpathplugin-0 started at 2023-02-02 02:39:16 +0000 UTC (0+7 container statuses recorded) Feb 2 02:44:49.691: INFO: Container csi-attacher ready: false, restart count 0 Feb 2 02:44:49.691: INFO: Container csi-provisioner ready: false, restart count 0 Feb 2 02:44:49.691: INFO: Container csi-resizer ready: false, restart count 0 Feb 2 02:44:49.691: INFO: Container csi-snapshotter ready: false, restart count 0 Feb 2 02:44:49.691: INFO: Container hostpath ready: false, restart count 0 Feb 2 02:44:49.691: INFO: Container liveness-probe ready: false, restart count 0 Feb 2 02:44:49.691: INFO: Container node-driver-registrar ready: false, restart count 0 Feb 2 02:44:49.691: INFO: ebs-csi-node-vgbm6 started at 2023-02-02 02:33:34 +0000 UTC (0+3 container statuses recorded) Feb 2 02:44:49.691: INFO: Container ebs-plugin ready: true, restart count 0 Feb 2 02:44:49.691: INFO: Container liveness-probe ready: true, restart count 0 Feb 2 02:44:49.691: INFO: Container node-driver-registrar ready: true, restart count 0 Feb 2 02:44:49.691: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-8jnbj started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:49.691: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:44:49.691: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-hvbsc started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:49.691: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:44:49.691: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-nwdp9 started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:49.691: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:44:49.691: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-842cr started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:49.691: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:44:49.691: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-mn2cg started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:49.691: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:44:49.691: INFO: rs-wv4bz started at 2023-02-02 02:39:20 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:49.691: INFO: Container donothing ready: true, restart count 0 Feb 2 02:44:49.691: INFO: rs-kfs5v started at 2023-02-02 02:39:20 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:49.691: INFO: Container donothing ready: false, restart count 0 Feb 2 02:44:49.838: INFO: Latency metrics for node i-094933bbcaafb548f Feb 2 02:44:49.839: INFO: Logging node info for node i-0edda5f045be0496e Feb 2 02:44:49.867: INFO: Node Info: &Node{ObjectMeta:{i-0edda5f045be0496e 4587fb05-429b-429c-8408-c6c4e9c69a39 7737 0 2023-02-02 02:33:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east-1 failure-domain.beta.kubernetes.io/zone:us-east-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0edda5f045be0496e kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-east-1a topology.hostpath.csi/node:i-0edda5f045be0496e topology.kubernetes.io/region:us-east-1 topology.kubernetes.io/zone:us-east-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.36.32 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0edda5f045be0496e"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-02-02 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-02-02 02:33:35 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-02-02 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-02-02 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-02-02 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-02-02 02:38:05 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-02-02 02:41:03 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-02-02 02:41:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///us-east-1a/i-0edda5f045be0496e,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078206976 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973349376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-02 02:41:44 +0000 UTC,LastTransitionTime:2023-02-02 02:33:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-02 02:41:44 +0000 UTC,LastTransitionTime:2023-02-02 02:33:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-02 02:41:44 +0000 UTC,LastTransitionTime:2023-02-02 02:33:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-02 02:41:44 +0000 UTC,LastTransitionTime:2023-02-02 02:33:46 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.36.32,},NodeAddress{Type:ExternalIP,Address:107.20.131.91,},NodeAddress{Type:InternalDNS,Address:i-0edda5f045be0496e.ec2.internal,},NodeAddress{Type:Hostname,Address:i-0edda5f045be0496e.ec2.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-107-20-131-91.compute-1.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2d6d99d20e1d252ee83a35d89804ad,SystemUUID:ec2d6d99-d20e-1d25-2ee8-3a35d89804ad,BootID:d1722e01-5561-4510-a9ae-eb13b4bd9a0f,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.16,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-00adc42c65bfab5b2 kubernetes.io/csi/ebs.csi.aws.com^vol-04c22c580a5e76d0d],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-04c22c580a5e76d0d,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-00adc42c65bfab5b2,DevicePath:,},},Config:nil,},} Feb 2 02:44:49.867: INFO: Logging kubelet events for node i-0edda5f045be0496e Feb 2 02:44:49.898: INFO: Logging pods the kubelet thinks is on node i-0edda5f045be0496e Feb 2 02:44:49.934: INFO: inline-volume-tester-jcmtn started at 2023-02-02 02:38:54 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:49.934: INFO: Container csi-volume-tester ready: true, restart count 0 Feb 2 02:44:49.934: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-jstkj started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:49.934: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: false, restart count 0 Feb 2 02:44:49.934: INFO: ss2-2 started at 2023-02-02 02:38:37 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:49.934: INFO: Container webserver ready: true, restart count 0 Feb 2 02:44:49.934: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-mkbdp started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:49.934: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:44:49.934: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-pn6d4 started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:49.934: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:44:49.934: INFO: netserver-1 started at 2023-02-02 02:43:51 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:49.934: INFO: Container webserver ready: false, restart count 0 Feb 2 02:44:49.934: INFO: pod-update-e0566f22-7dbc-4426-86f8-1537068ff7f2 started at 2023-02-02 02:41:34 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:49.934: INFO: Container pause ready: false, restart count 0 Feb 2 02:44:49.934: INFO: ebs-csi-node-kbmng started at 2023-02-02 02:33:36 +0000 UTC (0+3 container statuses recorded) Feb 2 02:44:49.934: INFO: Container ebs-plugin ready: true, restart count 0 Feb 2 02:44:49.934: INFO: Container liveness-probe ready: true, restart count 0 Feb 2 02:44:49.934: INFO: Container node-driver-registrar ready: true, restart count 0 Feb 2 02:44:49.934: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-hfvsn started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:49.934: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: false, restart count 0 Feb 2 02:44:49.934: INFO: busybox-979a1d02-d05a-4585-bba7-7f48a1be5c80 started at 2023-02-02 02:44:19 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:49.934: INFO: Container busybox ready: false, restart count 0 Feb 2 02:44:49.934: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-l8l4k started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:49.934: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:44:49.934: INFO: rs-x9jhx started at 2023-02-02 02:39:20 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:49.934: INFO: Container donothing ready: true, restart count 0 Feb 2 02:44:49.934: INFO: pod-projected-configmaps-73c4ca18-4b12-4052-b5d6-417ba8f49fa3 started at 2023-02-02 02:44:38 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:49.934: INFO: Container agnhost-container ready: false, restart count 0 Feb 2 02:44:49.934: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-2wdkr started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:49.934: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:44:49.934: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-9sqms started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:49.934: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:44:49.934: INFO: rs-khhlp started at 2023-02-02 02:39:20 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:49.934: INFO: Container donothing ready: true, restart count 0 Feb 2 02:44:49.934: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-8hlcn started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:49.934: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: false, restart count 0 Feb 2 02:44:49.934: INFO: metadata-volume-c4778e9b-5719-4089-889c-9511ef27ee9d started at 2023-02-02 02:44:26 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:49.934: INFO: Container client-container ready: false, restart count 0 Feb 2 02:44:49.934: INFO: pod-2 started at 2023-02-02 02:39:01 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:49.934: INFO: Container donothing ready: true, restart count 0 Feb 2 02:44:49.934: INFO: rs-pdw5z started at 2023-02-02 02:39:20 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:49.934: INFO: Container donothing ready: false, restart count 0 Feb 2 02:44:49.934: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-f67st started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:49.934: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:44:49.934: INFO: pvc-volume-tester-reader-ptvl4 started at 2023-02-02 02:39:22 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:49.934: INFO: Container volume-tester ready: false, restart count 0 Feb 2 02:44:49.934: INFO: cilium-q9c8c started at 2023-02-02 02:33:36 +0000 UTC (1+1 container statuses recorded) Feb 2 02:44:49.934: INFO: Init container clean-cilium-state ready: true, restart count 0 Feb 2 02:44:49.934: INFO: Container cilium-agent ready: true, restart count 0 Feb 2 02:44:49.934: INFO: service-headless-cw8vt started at 2023-02-02 02:38:58 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:49.934: INFO: Container service-headless ready: true, restart count 0 Feb 2 02:44:49.934: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-bc995 started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:49.934: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: false, restart count 0 Feb 2 02:44:50.092: INFO: Latency metrics for node i-0edda5f045be0496e Feb 2 02:44:50.092: INFO: Logging node info for node i-0f7e2e4905cb6dadc Feb 2 02:44:50.120: INFO: Node Info: &Node{ObjectMeta:{i-0f7e2e4905cb6dadc 2adbbc9a-dd76-4b97-8d3e-a2bd14f0c57d 8645 0 2023-02-02 02:33:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east-1 failure-domain.beta.kubernetes.io/zone:us-east-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0f7e2e4905cb6dadc kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-east-1a topology.hostpath.csi/node:i-0f7e2e4905cb6dadc topology.kubernetes.io/region:us-east-1 topology.kubernetes.io/zone:us-east-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.40.134 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-7484":"i-0f7e2e4905cb6dadc","ebs.csi.aws.com":"i-0f7e2e4905cb6dadc"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-02-02 02:33:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {e2e.test Update v1 2023-02-02 02:38:05 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-02-02 02:44:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///us-east-1a/i-0f7e2e4905cb6dadc,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-02 02:44:26 +0000 UTC,LastTransitionTime:2023-02-02 02:33:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-02 02:44:26 +0000 UTC,LastTransitionTime:2023-02-02 02:33:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-02 02:44:26 +0000 UTC,LastTransitionTime:2023-02-02 02:33:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-02 02:44:26 +0000 UTC,LastTransitionTime:2023-02-02 02:33:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.40.134,},NodeAddress{Type:ExternalIP,Address:18.215.155.89,},NodeAddress{Type:InternalDNS,Address:i-0f7e2e4905cb6dadc.ec2.internal,},NodeAddress{Type:Hostname,Address:i-0f7e2e4905cb6dadc.ec2.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-215-155-89.compute-1.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2d895bde004236c844d2f199d4cb6e,SystemUUID:ec2d895b-de00-4236-c844-d2f199d4cb6e,BootID:e4805eb2-7c0d-48b7-a584-7f3b4b363884,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.16,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-7484^ba866ccb-a2a2-11ed-b75e-522fe2d860c4],VolumesAttached:[]AttachedVolume{},Config:nil,},} Feb 2 02:44:50.121: INFO: Logging kubelet events for node i-0f7e2e4905cb6dadc Feb 2 02:44:50.151: INFO: Logging pods the kubelet thinks is on node i-0f7e2e4905cb6dadc Feb 2 02:44:50.188: INFO: csi-mockplugin-0 started at 2023-02-02 02:38:41 +0000 UTC (0+3 container statuses recorded) Feb 2 02:44:50.188: INFO: Container csi-provisioner ready: true, restart count 0 Feb 2 02:44:50.188: INFO: Container driver-registrar ready: true, restart count 0 Feb 2 02:44:50.188: INFO: Container mock ready: true, restart count 0 Feb 2 02:44:50.188: INFO: hostexec-i-0f7e2e4905cb6dadc-86drv started at 2023-02-02 02:41:39 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:50.188: INFO: Container agnhost-container ready: true, restart count 0 Feb 2 02:44:50.188: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-pgnjx started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:50.188: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:44:50.188: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-s6mxr started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:50.188: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:44:50.188: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-vtdsx started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:50.188: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:44:50.188: INFO: ss2-0 started at 2023-02-02 02:38:35 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:50.188: INFO: Container webserver ready: true, restart count 0 Feb 2 02:44:50.188: INFO: netserver-2 started at 2023-02-02 02:43:51 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:50.188: INFO: Container webserver ready: false, restart count 0 Feb 2 02:44:50.188: INFO: csi-mockplugin-attacher-0 started at 2023-02-02 02:38:41 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:50.188: INFO: Container csi-attacher ready: false, restart count 0 Feb 2 02:44:50.188: INFO: rs-vs5f2 started at 2023-02-02 02:39:20 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:50.188: INFO: Container donothing ready: false, restart count 0 Feb 2 02:44:50.188: INFO: pod-subpath-test-preprovisionedpv-f979 started at 2023-02-02 02:41:56 +0000 UTC (1+1 container statuses recorded) Feb 2 02:44:50.188: INFO: Init container init-volume-preprovisionedpv-f979 ready: true, restart count 0 Feb 2 02:44:50.188: INFO: Container test-container-subpath-preprovisionedpv-f979 ready: true, restart count 0 Feb 2 02:44:50.188: INFO: local-injector started at 2023-02-02 02:43:40 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:50.188: INFO: Container local-injector ready: false, restart count 0 Feb 2 02:44:50.188: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-h65xw started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:50.188: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:44:50.188: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-pwvqk started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:50.188: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:44:50.188: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-mphjv started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:50.188: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: false, restart count 0 Feb 2 02:44:50.188: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-xzv2d started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:50.188: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:44:50.188: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-m7nw9 started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:50.188: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: false, restart count 0 Feb 2 02:44:50.188: INFO: coredns-autoscaler-7cb5c5b969-5nncn started at 2023-02-02 02:33:44 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:50.188: INFO: Container autoscaler ready: true, restart count 0 Feb 2 02:44:50.188: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-7wgzt started at 2023-02-02 02:38:06 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:50.188: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: false, restart count 0 Feb 2 02:44:50.188: INFO: hostexec-i-0f7e2e4905cb6dadc-prvb7 started at 2023-02-02 02:43:34 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:50.188: INFO: Container agnhost-container ready: true, restart count 0 Feb 2 02:44:50.188: INFO: ebs-csi-node-mkxjx started at 2023-02-02 02:33:34 +0000 UTC (0+3 container statuses recorded) Feb 2 02:44:50.188: INFO: Container ebs-plugin ready: true, restart count 0 Feb 2 02:44:50.188: INFO: Container liveness-probe ready: true, restart count 0 Feb 2 02:44:50.188: INFO: Container node-driver-registrar ready: true, restart count 0 Feb 2 02:44:50.188: INFO: cilium-k54gx started at 2023-02-02 02:33:34 +0000 UTC (1+1 container statuses recorded) Feb 2 02:44:50.188: INFO: Init container clean-cilium-state ready: true, restart count 0 Feb 2 02:44:50.188: INFO: Container cilium-agent ready: true, restart count 0 Feb 2 02:44:50.188: INFO: coredns-559769c974-s54lm started at 2023-02-02 02:33:44 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:50.188: INFO: Container coredns ready: true, restart count 0 Feb 2 02:44:50.188: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-rnf4c started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:50.188: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:44:50.188: INFO: pvc-volume-tester-c8vzx started at 2023-02-02 02:38:53 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:50.188: INFO: Container volume-tester ready: false, restart count 0 Feb 2 02:44:50.188: INFO: rs-rvbxc started at 2023-02-02 02:39:20 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:50.188: INFO: Container donothing ready: false, restart count 0 Feb 2 02:44:50.333: INFO: Latency metrics for node i-0f7e2e4905cb6dadc Feb 2 02:44:50.333: INFO: Logging node info for node i-0fe5d857b6eb4dfe3 Feb 2 02:44:50.361: INFO: Node Info: &Node{ObjectMeta:{i-0fe5d857b6eb4dfe3 9d0f7cfc-7470-4601-b0c7-c2b476a9fab7 8678 0 2023-02-02 02:33:43 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east-1 failure-domain.beta.kubernetes.io/zone:us-east-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0fe5d857b6eb4dfe3 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-east-1a topology.hostpath.csi/node:i-0fe5d857b6eb4dfe3 topology.kubernetes.io/region:us-east-1 topology.kubernetes.io/zone:us-east-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.53.228 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0fe5d857b6eb4dfe3"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-02-02 02:33:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-02-02 02:33:43 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-02-02 02:33:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-02-02 02:33:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-02-02 02:33:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-02-02 02:38:05 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-02-02 02:44:35 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-02-02 02:44:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///us-east-1a/i-0fe5d857b6eb4dfe3,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078206976 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973349376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-02 02:44:35 +0000 UTC,LastTransitionTime:2023-02-02 02:33:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-02 02:44:35 +0000 UTC,LastTransitionTime:2023-02-02 02:33:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-02 02:44:35 +0000 UTC,LastTransitionTime:2023-02-02 02:33:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-02 02:44:35 +0000 UTC,LastTransitionTime:2023-02-02 02:33:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.53.228,},NodeAddress{Type:ExternalIP,Address:18.212.239.71,},NodeAddress{Type:InternalDNS,Address:i-0fe5d857b6eb4dfe3.ec2.internal,},NodeAddress{Type:Hostname,Address:i-0fe5d857b6eb4dfe3.ec2.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-212-239-71.compute-1.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23a338ffd343d89814911cd0d0d8ea,SystemUUID:ec23a338-ffd3-43d8-9814-911cd0d0d8ea,BootID:588a11ea-21bc-44af-808b-852f5f90dd84,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.16,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-021fcced421837e53 kubernetes.io/csi/ebs.csi.aws.com^vol-06c549b1251626bdf kubernetes.io/csi/ebs.csi.aws.com^vol-08de06f77783ea680 kubernetes.io/csi/ebs.csi.aws.com^vol-099bf0e1f55ee83c6],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-021fcced421837e53,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-099bf0e1f55ee83c6,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-06c549b1251626bdf,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-08de06f77783ea680,DevicePath:,},},Config:nil,},} Feb 2 02:44:50.362: INFO: Logging kubelet events for node i-0fe5d857b6eb4dfe3 Feb 2 02:44:50.392: INFO: Logging pods the kubelet thinks is on node i-0fe5d857b6eb4dfe3 Feb 2 02:44:50.428: INFO: inline-volume-tester2-wpgg7 started at 2023-02-02 02:39:34 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:50.428: INFO: Container csi-volume-tester ready: false, restart count 0 Feb 2 02:44:50.428: INFO: ebs-csi-node-qqz2d started at 2023-02-02 02:33:43 +0000 UTC (0+3 container statuses recorded) Feb 2 02:44:50.428: INFO: Container ebs-plugin ready: true, restart count 0 Feb 2 02:44:50.428: INFO: Container liveness-probe ready: true, restart count 0 Feb 2 02:44:50.428: INFO: Container node-driver-registrar ready: true, restart count 0 Feb 2 02:44:50.428: INFO: rs-pc45g started at 2023-02-02 02:39:21 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:50.428: INFO: Container donothing ready: true, restart count 0 Feb 2 02:44:50.428: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-snv7k started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:50.428: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:44:50.428: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-dz5bh started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:50.428: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:44:50.429: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-dss8d started at 2023-02-02 02:38:06 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:50.429: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:44:50.429: INFO: netserver-3 started at 2023-02-02 02:43:51 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:50.429: INFO: Container webserver ready: false, restart count 0 Feb 2 02:44:50.429: INFO: hostexec-i-0fe5d857b6eb4dfe3-lx74v started at 2023-02-02 02:42:01 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:50.429: INFO: Container agnhost-container ready: true, restart count 0 Feb 2 02:44:50.429: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-j9kxn started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:50.429: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:44:50.429: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-965cw started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:50.429: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:44:50.429: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-7j88c started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:50.429: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:44:50.429: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-2psrz started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:50.429: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:44:50.429: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-7xd6t started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:50.429: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:44:50.429: INFO: rs-hhq9v started at 2023-02-02 02:39:20 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:50.429: INFO: Container donothing ready: false, restart count 0 Feb 2 02:44:50.429: INFO: pod-projected-secrets-918e5772-55b0-4269-825b-3ee86000400e started at 2023-02-02 02:41:19 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:50.429: INFO: Container projected-secret-volume-test ready: false, restart count 0 Feb 2 02:44:50.429: INFO: rs-qxhxb started at 2023-02-02 02:39:20 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:50.429: INFO: Container donothing ready: false, restart count 0 Feb 2 02:44:50.429: INFO: pod-059e4fe9-a68f-4452-baaa-69b48b71743f started at 2023-02-02 02:39:31 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:50.429: INFO: Container write-pod ready: false, restart count 0 Feb 2 02:44:50.429: INFO: service-headless-rgvn4 started at 2023-02-02 02:38:58 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:50.429: INFO: Container service-headless ready: false, restart count 0 Feb 2 02:44:50.429: INFO: cilium-gffsv started at 2023-02-02 02:33:43 +0000 UTC (1+1 container statuses recorded) Feb 2 02:44:50.429: INFO: Init container clean-cilium-state ready: true, restart count 0 Feb 2 02:44:50.429: INFO: Container cilium-agent ready: true, restart count 0 Feb 2 02:44:50.429: INFO: inline-volume-tester-vzj57 started at 2023-02-02 02:38:29 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:50.429: INFO: Container csi-volume-tester ready: false, restart count 0 Feb 2 02:44:50.429: INFO: pod-0 started at 2023-02-02 02:39:01 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:50.429: INFO: Container donothing ready: true, restart count 0 Feb 2 02:44:50.429: INFO: pod-always-succeed545112d7-d6bd-40a2-ba1a-654186f0078d started at 2023-02-02 02:43:44 +0000 UTC (1+1 container statuses recorded) Feb 2 02:44:50.429: INFO: Init container foo ready: false, restart count 0 Feb 2 02:44:50.429: INFO: Container bar ready: false, restart count 0 Feb 2 02:44:50.429: INFO: pfpod started at 2023-02-02 02:44:09 +0000 UTC (0+2 container statuses recorded) Feb 2 02:44:50.429: INFO: Container portforwardtester ready: false, restart count 0 Feb 2 02:44:50.429: INFO: Container readiness ready: false, restart count 0 Feb 2 02:44:50.429: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-n4rbc started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:50.429: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:44:50.429: INFO: pod-1 started at 2023-02-02 02:39:01 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:50.429: INFO: Container donothing ready: false, restart count 0 Feb 2 02:44:50.429: INFO: downwardapi-volume-f822f893-f68e-4550-8d56-75d959db5fcd started at 2023-02-02 02:44:15 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:50.429: INFO: Container client-container ready: false, restart count 0 Feb 2 02:44:50.429: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-sb6sx started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:50.429: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:44:50.429: INFO: ss2-1 started at 2023-02-02 02:41:26 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:50.429: INFO: Container webserver ready: false, restart count 0 Feb 2 02:44:50.429: INFO: pod-subpath-test-dynamicpv-6xtb started at 2023-02-02 02:43:40 +0000 UTC (2+1 container statuses recorded) Feb 2 02:44:50.429: INFO: Init container init-volume-dynamicpv-6xtb ready: false, restart count 0 Feb 2 02:44:50.429: INFO: Init container test-init-volume-dynamicpv-6xtb ready: false, restart count 0 Feb 2 02:44:50.429: INFO: Container test-container-subpath-dynamicpv-6xtb ready: false, restart count 0 Feb 2 02:44:50.429: INFO: pod-a45c6964-0be7-4212-ba75-32a87b45e7f3 started at 2023-02-02 02:42:10 +0000 UTC (0+1 container statuses recorded) Feb 2 02:44:50.429: INFO: Container write-pod ready: false, restart count 0 Feb 2 02:44:50.589: INFO: Latency metrics for node i-0fe5d857b6eb4dfe3 [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath tear down framework | framework.go:193 �[1mSTEP:�[0m Destroying namespace "provisioning-9832" for this suite. �[38;5;243m02/02/23 02:44:50.589�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\sExternal\sStorage\s\[Driver\:\sebs\.csi\.aws\.com\]\s\[Testpattern\:\sDynamic\sPV\s\(default\sfs\)\]\ssubPath\sshould\ssupport\sreadOnly\sfile\sspecified\sin\sthe\svolumeMount\s\[LinuxOnly\]$'
test/e2e/framework/pod/output/output.go:237 k8s.io/kubernetes/test/e2e/framework/pod/output.TestContainerOutputMatcher(0xc00057c480?, {0x75c4bbe?, 0x0?}, 0xc00057c480, 0x0, {0xc0036ddec0, 0x1, 0x1}, 0x29?) test/e2e/framework/pod/output/output.go:237 +0x176 k8s.io/kubernetes/test/e2e/framework/pod/output.TestContainerOutput(...) test/e2e/framework/pod/output/output.go:214 k8s.io/kubernetes/test/e2e/storage/testsuites.testReadFile(0xc0017e73b0, {0x75d498a, 0xc}, 0xc00057c480, 0x0) test/e2e/storage/testsuites/subpath.go:691 +0x15c k8s.io/kubernetes/test/e2e/storage/testsuites.(*subPathTestSuite).DefineTests.func17() test/e2e/storage/testsuites/subpath.go:392 +0x1e5from junit_01.xml
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath test/e2e/storage/framework/testsuite.go:51 [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath set up framework | framework.go:178 �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m02/02/23 02:43:36.254�[0m Feb 2 02:43:36.255: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP:�[0m Building a namespace api object, basename provisioning �[38;5;243m02/02/23 02:43:36.256�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m02/02/23 02:43:36.345�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m02/02/23 02:43:36.401�[0m [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath test/e2e/framework/metrics/init/init.go:31 [It] should support readOnly file specified in the volumeMount [LinuxOnly] test/e2e/storage/testsuites/subpath.go:380 Feb 2 02:43:36.458: INFO: Creating resource for dynamic PV Feb 2 02:43:36.458: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} �[1mSTEP:�[0m creating a StorageClass provisioning-195-e2e-sc6gwhz �[38;5;243m02/02/23 02:43:36.458�[0m �[1mSTEP:�[0m creating a claim �[38;5;243m02/02/23 02:43:36.493�[0m Feb 2 02:43:36.493: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil �[1mSTEP:�[0m Creating pod pod-subpath-test-dynamicpv-6xtb �[38;5;243m02/02/23 02:43:36.552�[0m �[1mSTEP:�[0m Creating a pod to test subpath �[38;5;243m02/02/23 02:43:36.552�[0m Feb 2 02:43:36.587: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-6xtb" in namespace "provisioning-195" to be "Succeeded or Failed" Feb 2 02:43:36.620: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 33.451757ms Feb 2 02:43:38.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 2.063300002s Feb 2 02:43:40.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 4.063267504s Feb 2 02:43:42.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 6.063502552s Feb 2 02:43:44.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 8.063439417s Feb 2 02:43:46.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 10.063693564s Feb 2 02:43:48.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 12.063873875s Feb 2 02:43:50.649: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 14.062741809s Feb 2 02:43:52.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 16.063744392s Feb 2 02:43:54.649: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 18.062640922s Feb 2 02:43:56.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 20.063256186s Feb 2 02:43:58.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 22.063649236s Feb 2 02:44:00.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 24.063637538s Feb 2 02:44:02.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 26.063159681s Feb 2 02:44:04.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 28.063585306s Feb 2 02:44:06.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 30.06300367s Feb 2 02:44:08.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 32.062947885s Feb 2 02:44:10.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 34.063410999s Feb 2 02:44:12.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 36.063840956s Feb 2 02:44:14.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 38.063669898s Feb 2 02:44:16.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 40.063602806s Feb 2 02:44:18.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 42.063605815s Feb 2 02:44:20.649: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 44.062604142s Feb 2 02:44:22.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 46.063573141s Feb 2 02:44:24.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 48.063512662s Feb 2 02:44:26.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 50.063148757s Feb 2 02:44:28.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 52.063396063s Feb 2 02:44:30.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 54.063359693s Feb 2 02:44:32.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 56.063303943s Feb 2 02:44:34.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 58.063533457s Feb 2 02:44:36.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.062883477s Feb 2 02:44:38.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.063468254s Feb 2 02:44:40.649: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.062609068s Feb 2 02:44:42.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.063465842s Feb 2 02:44:44.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.063511903s Feb 2 02:44:46.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.063002122s Feb 2 02:44:48.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.063429075s Feb 2 02:44:50.649: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.062594944s Feb 2 02:44:52.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.06372117s Feb 2 02:44:54.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.063406641s Feb 2 02:44:56.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.063276945s Feb 2 02:44:58.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.063164138s Feb 2 02:45:00.653: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.065890472s Feb 2 02:45:02.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.063474305s Feb 2 02:45:04.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.063527348s Feb 2 02:45:06.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.06387514s Feb 2 02:45:08.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.063498348s Feb 2 02:45:10.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.063677457s Feb 2 02:45:12.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.06380009s Feb 2 02:45:14.651: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.064040385s Feb 2 02:45:16.649: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.062627896s Feb 2 02:45:18.649: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.062842992s Feb 2 02:45:20.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.063594623s Feb 2 02:45:22.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.063792293s Feb 2 02:45:24.651: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.063902672s Feb 2 02:45:26.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.062911804s Feb 2 02:45:28.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.063682655s Feb 2 02:45:30.652: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.065117949s Feb 2 02:45:32.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.06347119s Feb 2 02:45:34.651: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.063919443s Feb 2 02:45:36.649: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.062743983s Feb 2 02:45:38.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.06365978s Feb 2 02:45:40.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.063483912s Feb 2 02:45:42.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.063672688s Feb 2 02:45:44.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.063778038s Feb 2 02:45:46.649: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.062798506s Feb 2 02:45:48.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.063137152s Feb 2 02:45:50.649: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.062720896s Feb 2 02:45:52.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.063375819s Feb 2 02:45:54.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.063463769s Feb 2 02:45:56.651: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.064043814s Feb 2 02:45:58.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.06331001s Feb 2 02:46:00.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.063724811s Feb 2 02:46:02.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.063868304s Feb 2 02:46:04.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.062894367s Feb 2 02:46:06.651: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.064411715s Feb 2 02:46:08.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.063528352s Feb 2 02:46:10.665: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.077939144s Feb 2 02:46:12.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.063410307s Feb 2 02:46:14.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.06349549s Feb 2 02:46:16.651: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.064313177s Feb 2 02:46:18.651: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.064749255s Feb 2 02:46:20.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.062996403s Feb 2 02:46:22.649: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.062729099s Feb 2 02:46:24.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.062946973s Feb 2 02:46:26.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.063700709s Feb 2 02:46:28.649: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.062868378s Feb 2 02:46:30.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.06314328s Feb 2 02:46:32.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.063645629s Feb 2 02:46:34.649: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.062653752s Feb 2 02:46:36.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.063306144s Feb 2 02:46:38.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.063670087s Feb 2 02:46:40.649: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.062457588s Feb 2 02:46:42.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.063526073s Feb 2 02:46:44.651: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.064051628s Feb 2 02:46:46.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.063874676s Feb 2 02:46:48.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.063582199s Feb 2 02:46:50.649: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.062855963s Feb 2 02:46:52.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.063797692s Feb 2 02:46:54.649: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.062871147s Feb 2 02:46:56.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.063719336s Feb 2 02:46:58.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.06292441s Feb 2 02:47:00.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.063364958s Feb 2 02:47:02.655: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.068519414s Feb 2 02:47:04.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.063657215s Feb 2 02:47:06.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.06290733s Feb 2 02:47:08.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.063268558s Feb 2 02:47:10.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.063606394s Feb 2 02:47:12.661: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.074193492s Feb 2 02:47:14.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.063123507s Feb 2 02:47:16.651: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.064145971s Feb 2 02:47:18.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.063614887s Feb 2 02:47:20.649: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.062781226s Feb 2 02:47:22.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.063658457s Feb 2 02:47:24.649: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.06272035s Feb 2 02:47:26.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.063677901s Feb 2 02:47:28.653: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.06644911s Feb 2 02:47:30.649: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.062805251s Feb 2 02:47:32.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.062992339s Feb 2 02:47:34.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.06331262s Feb 2 02:47:36.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.063815569s Feb 2 02:47:38.649: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.062642139s Feb 2 02:47:40.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.06338705s Feb 2 02:47:42.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.063713475s Feb 2 02:47:44.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.063652554s Feb 2 02:47:46.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.063579032s Feb 2 02:47:48.649: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.062617402s Feb 2 02:47:50.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.063413307s Feb 2 02:47:52.653: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.066196587s Feb 2 02:47:54.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.063800783s Feb 2 02:47:56.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.063386189s Feb 2 02:47:58.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.063842659s Feb 2 02:48:00.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.063296657s Feb 2 02:48:02.651: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.064321992s Feb 2 02:48:04.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.063860212s Feb 2 02:48:06.651: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.064028599s Feb 2 02:48:08.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.063400383s Feb 2 02:48:10.649: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.062745492s Feb 2 02:48:12.654: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.067251583s Feb 2 02:48:14.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.06358535s Feb 2 02:48:16.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.063120219s Feb 2 02:48:18.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.063087139s Feb 2 02:48:20.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.063516726s Feb 2 02:48:22.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.063084214s Feb 2 02:48:24.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.06373324s Feb 2 02:48:26.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.06380351s Feb 2 02:48:28.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.063577204s Feb 2 02:48:30.649: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.062840023s Feb 2 02:48:32.649: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.062851407s Feb 2 02:48:34.651: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.063890264s Feb 2 02:48:36.650: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.063706623s Feb 2 02:48:36.679: INFO: Pod "pod-subpath-test-dynamicpv-6xtb": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.09246294s Feb 2 02:48:36.740: INFO: Failed to get logs from node "i-0fe5d857b6eb4dfe3" pod "pod-subpath-test-dynamicpv-6xtb" container "init-volume-dynamicpv-6xtb": the server rejected our request for an unknown reason (get pods pod-subpath-test-dynamicpv-6xtb) Feb 2 02:48:36.770: INFO: Failed to get logs from node "i-0fe5d857b6eb4dfe3" pod "pod-subpath-test-dynamicpv-6xtb" container "test-init-volume-dynamicpv-6xtb": the server rejected our request for an unknown reason (get pods pod-subpath-test-dynamicpv-6xtb) Feb 2 02:48:36.800: INFO: Failed to get logs from node "i-0fe5d857b6eb4dfe3" pod "pod-subpath-test-dynamicpv-6xtb" container "test-container-subpath-dynamicpv-6xtb": the server rejected our request for an unknown reason (get pods pod-subpath-test-dynamicpv-6xtb) �[1mSTEP:�[0m delete the pod �[38;5;243m02/02/23 02:48:36.8�[0m Feb 2 02:48:36.832: INFO: Waiting for pod pod-subpath-test-dynamicpv-6xtb to disappear Feb 2 02:48:36.861: INFO: Pod pod-subpath-test-dynamicpv-6xtb still exists Feb 2 02:48:38.861: INFO: Waiting for pod pod-subpath-test-dynamicpv-6xtb to disappear Feb 2 02:48:38.890: INFO: Pod pod-subpath-test-dynamicpv-6xtb no longer exists Feb 2 02:48:38.890: INFO: Unexpected error: <*errors.errorString | 0xc00136d520>: { s: "expected pod \"pod-subpath-test-dynamicpv-6xtb\" success: timed out while waiting for pod provisioning-195/pod-subpath-test-dynamicpv-6xtb to be Succeeded or Failed", } Feb 2 02:48:38.890: FAIL: expected pod "pod-subpath-test-dynamicpv-6xtb" success: timed out while waiting for pod provisioning-195/pod-subpath-test-dynamicpv-6xtb to be Succeeded or Failed Full Stack Trace k8s.io/kubernetes/test/e2e/framework/pod/output.TestContainerOutputMatcher(0xc00057c480?, {0x75c4bbe?, 0x0?}, 0xc00057c480, 0x0, {0xc0036ddec0, 0x1, 0x1}, 0x29?) test/e2e/framework/pod/output/output.go:237 +0x176 k8s.io/kubernetes/test/e2e/framework/pod/output.TestContainerOutput(...) test/e2e/framework/pod/output/output.go:214 k8s.io/kubernetes/test/e2e/storage/testsuites.testReadFile(0xc0017e73b0, {0x75d498a, 0xc}, 0xc00057c480, 0x0) test/e2e/storage/testsuites/subpath.go:691 +0x15c k8s.io/kubernetes/test/e2e/storage/testsuites.(*subPathTestSuite).DefineTests.func17() test/e2e/storage/testsuites/subpath.go:392 +0x1e5 �[1mSTEP:�[0m Deleting pod �[38;5;243m02/02/23 02:48:38.89�[0m Feb 2 02:48:38.891: INFO: Deleting pod "pod-subpath-test-dynamicpv-6xtb" in namespace "provisioning-195" �[1mSTEP:�[0m Deleting pvc �[38;5;243m02/02/23 02:48:38.919�[0m Feb 2 02:48:38.977: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.comhpkrv" Feb 2 02:48:39.008: INFO: Waiting up to 5m0s for PersistentVolume pvc-0fca04c9-17a7-4ae2-bbcc-7ed0bd8c9142 to get deleted Feb 2 02:48:39.036: INFO: PersistentVolume pvc-0fca04c9-17a7-4ae2-bbcc-7ed0bd8c9142 found and phase=Released (28.774943ms) Feb 2 02:48:44.066: INFO: PersistentVolume pvc-0fca04c9-17a7-4ae2-bbcc-7ed0bd8c9142 found and phase=Released (5.058822618s) Feb 2 02:48:49.096: INFO: PersistentVolume pvc-0fca04c9-17a7-4ae2-bbcc-7ed0bd8c9142 found and phase=Released (10.088918717s) Feb 2 02:48:54.126: INFO: PersistentVolume pvc-0fca04c9-17a7-4ae2-bbcc-7ed0bd8c9142 found and phase=Released (15.118692596s) Feb 2 02:48:59.155: INFO: PersistentVolume pvc-0fca04c9-17a7-4ae2-bbcc-7ed0bd8c9142 was removed �[1mSTEP:�[0m Deleting sc �[38;5;243m02/02/23 02:48:59.155�[0m [AfterEach] [Testpattern: Dynamic PV (default fs)] subPath test/e2e/framework/node/init/init.go:32 Feb 2 02:48:59.186: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath dump namespaces | framework.go:196 �[1mSTEP:�[0m dump namespace information after failure �[38;5;243m02/02/23 02:48:59.217�[0m �[1mSTEP:�[0m Collecting events from namespace "provisioning-195". �[38;5;243m02/02/23 02:48:59.217�[0m �[1mSTEP:�[0m Found 16 events. �[38;5;243m02/02/23 02:48:59.247�[0m Feb 2 02:48:59.247: INFO: At 2023-02-02 02:43:36 +0000 UTC - event for ebs.csi.aws.comhpkrv: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding Feb 2 02:48:59.247: INFO: At 2023-02-02 02:43:36 +0000 UTC - event for ebs.csi.aws.comhpkrv: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "ebs.csi.aws.com" or manually created by system administrator Feb 2 02:48:59.247: INFO: At 2023-02-02 02:43:36 +0000 UTC - event for ebs.csi.aws.comhpkrv: {ebs.csi.aws.com_i-01b885526491052d5_d47994d4-b7e1-4596-a8c0-cb83c8f567ef } Provisioning: External provisioner is provisioning volume for claim "provisioning-195/ebs.csi.aws.comhpkrv" Feb 2 02:48:59.247: INFO: At 2023-02-02 02:43:39 +0000 UTC - event for ebs.csi.aws.comhpkrv: {ebs.csi.aws.com_i-01b885526491052d5_d47994d4-b7e1-4596-a8c0-cb83c8f567ef } ProvisioningSucceeded: Successfully provisioned volume pvc-0fca04c9-17a7-4ae2-bbcc-7ed0bd8c9142 Feb 2 02:48:59.247: INFO: At 2023-02-02 02:43:40 +0000 UTC - event for pod-subpath-test-dynamicpv-6xtb: {default-scheduler } Scheduled: Successfully assigned provisioning-195/pod-subpath-test-dynamicpv-6xtb to i-0fe5d857b6eb4dfe3 Feb 2 02:48:59.247: INFO: At 2023-02-02 02:43:42 +0000 UTC - event for pod-subpath-test-dynamicpv-6xtb: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-0fca04c9-17a7-4ae2-bbcc-7ed0bd8c9142" Feb 2 02:48:59.247: INFO: At 2023-02-02 02:43:44 +0000 UTC - event for pod-subpath-test-dynamicpv-6xtb: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a8bafd68929d6f679c734564ec031d81e00adc353e67f62ac2da68e656ed254e": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:48:59.247: INFO: At 2023-02-02 02:44:00 +0000 UTC - event for pod-subpath-test-dynamicpv-6xtb: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "fb46c517615b468b275e9a8fac2ca32d262f4b4bd9a7cf939dc30b5b9540b277": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:48:59.247: INFO: At 2023-02-02 02:44:12 +0000 UTC - event for pod-subpath-test-dynamicpv-6xtb: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "cc90fd60e1504b3788b20a24ee89e6afe60913179b8f2e1ae30fc94761a6c48c": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:48:59.247: INFO: At 2023-02-02 02:44:26 +0000 UTC - event for pod-subpath-test-dynamicpv-6xtb: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "52dcda730220800d2277583d9aa4b96ad9ba6322ddc64611cccee1c8be277713": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:48:59.247: INFO: At 2023-02-02 02:44:38 +0000 UTC - event for pod-subpath-test-dynamicpv-6xtb: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "814aa6ff3e2b486c34fc90d141260cb1cd96f183409e638af31e23b6e2e5f220": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:48:59.247: INFO: At 2023-02-02 02:44:52 +0000 UTC - event for pod-subpath-test-dynamicpv-6xtb: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "5da407532dc146cd7a06f485847e8bbb8634b387618c4dd3e165f5a6282dbb6d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:48:59.247: INFO: At 2023-02-02 02:45:07 +0000 UTC - event for pod-subpath-test-dynamicpv-6xtb: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "6dee3ad3b297b59f877087be8e9d61e340594b6529186cd45a932209a97f6639": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:48:59.247: INFO: At 2023-02-02 02:45:19 +0000 UTC - event for pod-subpath-test-dynamicpv-6xtb: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "60f3bb6be0df882c34c988f98938fc6735845bbec15391858256e4ec77a6b161": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:48:59.247: INFO: At 2023-02-02 02:45:34 +0000 UTC - event for pod-subpath-test-dynamicpv-6xtb: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b1e2bb1b2f51de21264cfdf87a84baf969035eacf87b5a9a8a30f14bb232abf8": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:48:59.247: INFO: At 2023-02-02 02:45:45 +0000 UTC - event for pod-subpath-test-dynamicpv-6xtb: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d1432fb661aca58bf446e5db84c973b9763702d058467dbfe42ac33f128a5b47": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:48:59.276: INFO: POD NODE PHASE GRACE CONDITIONS Feb 2 02:48:59.276: INFO: Feb 2 02:48:59.306: INFO: Logging node info for node i-01b885526491052d5 Feb 2 02:48:59.335: INFO: Node Info: &Node{ObjectMeta:{i-01b885526491052d5 dc5fa938-4b08-4e13-a650-8859f804b492 8783 0 2023-02-02 02:32:08 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east-1 failure-domain.beta.kubernetes.io/zone:us-east-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-01b885526491052d5 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:us-east-1a topology.kubernetes.io/region:us-east-1 topology.kubernetes.io/zone:us-east-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.61.65 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-01b885526491052d5"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-02-02 02:32:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-02-02 02:32:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {aws-cloud-controller-manager Update v1 2023-02-02 02:32:44 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-02-02 02:32:44 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-02-02 02:32:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-02-02 02:44:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///us-east-1a/i-01b885526491052d5,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3918811136 0} {<nil>} 3826964Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3813953536 0} {<nil>} 3724564Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-02 02:44:53 +0000 UTC,LastTransitionTime:2023-02-02 02:32:07 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-02 02:44:53 +0000 UTC,LastTransitionTime:2023-02-02 02:32:07 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-02 02:44:53 +0000 UTC,LastTransitionTime:2023-02-02 02:32:07 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-02 02:44:53 +0000 UTC,LastTransitionTime:2023-02-02 02:32:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.61.65,},NodeAddress{Type:ExternalIP,Address:54.205.170.33,},NodeAddress{Type:InternalDNS,Address:i-01b885526491052d5.ec2.internal,},NodeAddress{Type:Hostname,Address:i-01b885526491052d5.ec2.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-205-170-33.compute-1.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec26507379484fef3914c7eb427dc82e,SystemUUID:ec265073-7948-4fef-3914-c7eb427dc82e,BootID:9d8938d3-ec44-44d3-9a12-0dbd68248bf9,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.16,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:5ffb3f7cade4ae1d8c952251abb0c8bdfa8d4d9acb2c364e763328bd6f3d06aa registry.k8s.io/etcdadm/etcd-manager:v3.0.20230201],SizeBytes:243803152,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.1],SizeBytes:135178704,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.1],SizeBytes:124995897,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.1],SizeBytes:57661752,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-beta.2],SizeBytes:43857040,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-beta.2],SizeBytes:42821718,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-beta.2],SizeBytes:4965807,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Feb 2 02:48:59.335: INFO: Logging kubelet events for node i-01b885526491052d5 Feb 2 02:48:59.367: INFO: Logging pods the kubelet thinks is on node i-01b885526491052d5 Feb 2 02:48:59.402: INFO: cilium-operator-6f8d6c4bf-68pf6 started at 2023-02-02 02:32:41 +0000 UTC (0+1 container statuses recorded) Feb 2 02:48:59.402: INFO: Container cilium-operator ready: true, restart count 1 Feb 2 02:48:59.402: INFO: kube-apiserver-i-01b885526491052d5 started at 2023-02-02 02:31:38 +0000 UTC (0+2 container statuses recorded) Feb 2 02:48:59.402: INFO: Container healthcheck ready: true, restart count 0 Feb 2 02:48:59.402: INFO: Container kube-apiserver ready: true, restart count 1 Feb 2 02:48:59.402: INFO: kube-controller-manager-i-01b885526491052d5 started at 2023-02-02 02:31:38 +0000 UTC (0+1 container statuses recorded) Feb 2 02:48:59.402: INFO: Container kube-controller-manager ready: true, restart count 2 Feb 2 02:48:59.402: INFO: etcd-manager-events-i-01b885526491052d5 started at 2023-02-02 02:31:38 +0000 UTC (0+1 container statuses recorded) Feb 2 02:48:59.402: INFO: Container etcd-manager ready: true, restart count 0 Feb 2 02:48:59.402: INFO: etcd-manager-main-i-01b885526491052d5 started at 2023-02-02 02:31:38 +0000 UTC (0+1 container statuses recorded) Feb 2 02:48:59.402: INFO: Container etcd-manager ready: true, restart count 0 Feb 2 02:48:59.402: INFO: cilium-lzw4c started at 2023-02-02 02:32:40 +0000 UTC (1+1 container statuses recorded) Feb 2 02:48:59.402: INFO: Init container clean-cilium-state ready: true, restart count 0 Feb 2 02:48:59.402: INFO: Container cilium-agent ready: true, restart count 1 Feb 2 02:48:59.402: INFO: ebs-csi-controller-89bddb897-hx8fh started at 2023-02-02 02:32:41 +0000 UTC (0+5 container statuses recorded) Feb 2 02:48:59.402: INFO: Container csi-attacher ready: true, restart count 0 Feb 2 02:48:59.402: INFO: Container csi-provisioner ready: true, restart count 0 Feb 2 02:48:59.402: INFO: Container csi-resizer ready: true, restart count 0 Feb 2 02:48:59.402: INFO: Container ebs-plugin ready: true, restart count 0 Feb 2 02:48:59.402: INFO: Container liveness-probe ready: true, restart count 0 Feb 2 02:48:59.402: INFO: kube-scheduler-i-01b885526491052d5 started at 2023-02-02 02:31:38 +0000 UTC (0+1 container statuses recorded) Feb 2 02:48:59.402: INFO: Container kube-scheduler ready: true, restart count 0 Feb 2 02:48:59.402: INFO: aws-cloud-controller-manager-q9pdm started at 2023-02-02 02:32:40 +0000 UTC (0+1 container statuses recorded) Feb 2 02:48:59.402: INFO: Container aws-cloud-controller-manager ready: true, restart count 0 Feb 2 02:48:59.402: INFO: kops-controller-f4d7p started at 2023-02-02 02:32:40 +0000 UTC (0+1 container statuses recorded) Feb 2 02:48:59.402: INFO: Container kops-controller ready: true, restart count 0 Feb 2 02:48:59.402: INFO: ebs-csi-node-d97sr started at 2023-02-02 02:32:40 +0000 UTC (0+3 container statuses recorded) Feb 2 02:48:59.402: INFO: Container ebs-plugin ready: true, restart count 0 Feb 2 02:48:59.402: INFO: Container liveness-probe ready: true, restart count 0 Feb 2 02:48:59.402: INFO: Container node-driver-registrar ready: true, restart count 0 Feb 2 02:48:59.402: INFO: dns-controller-74d4646d88-tqtjs started at 2023-02-02 02:32:41 +0000 UTC (0+1 container statuses recorded) Feb 2 02:48:59.402: INFO: Container dns-controller ready: true, restart count 0 Feb 2 02:48:59.532: INFO: Latency metrics for node i-01b885526491052d5 Feb 2 02:48:59.532: INFO: Logging node info for node i-094933bbcaafb548f Feb 2 02:48:59.561: INFO: Node Info: &Node{ObjectMeta:{i-094933bbcaafb548f f8a3e392-0d95-41f4-b73c-92cf4fc28ad0 10276 0 2023-02-02 02:33:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east-1 failure-domain.beta.kubernetes.io/zone:us-east-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-094933bbcaafb548f kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-east-1a topology.hostpath.csi/node:i-094933bbcaafb548f topology.kubernetes.io/region:us-east-1 topology.kubernetes.io/zone:us-east-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.57.122 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-094933bbcaafb548f"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-02-02 02:38:04 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-02-02 02:48:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///us-east-1a/i-094933bbcaafb548f,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078206976 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973349376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-02 02:48:52 +0000 UTC,LastTransitionTime:2023-02-02 02:33:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-02 02:48:52 +0000 UTC,LastTransitionTime:2023-02-02 02:33:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-02 02:48:52 +0000 UTC,LastTransitionTime:2023-02-02 02:33:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-02 02:48:52 +0000 UTC,LastTransitionTime:2023-02-02 02:33:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.57.122,},NodeAddress{Type:ExternalIP,Address:34.229.175.171,},NodeAddress{Type:InternalDNS,Address:i-094933bbcaafb548f.ec2.internal,},NodeAddress{Type:Hostname,Address:i-094933bbcaafb548f.ec2.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-34-229-175-171.compute-1.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2268a1fc2523b710f39d6e8dcd11f8,SystemUUID:ec2268a1-fc25-23b7-10f3-9d6e8dcd11f8,BootID:a1887cfb-af12-4b59-88c8-e5de9f1d7ef9,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.16,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Feb 2 02:48:59.562: INFO: Logging kubelet events for node i-094933bbcaafb548f Feb 2 02:48:59.593: INFO: Logging pods the kubelet thinks is on node i-094933bbcaafb548f Feb 2 02:48:59.628: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-842cr started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:48:59.628: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:48:59.628: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-mn2cg started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:48:59.628: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:48:59.628: INFO: rs-wv4bz started at 2023-02-02 02:39:20 +0000 UTC (0+1 container statuses recorded) Feb 2 02:48:59.628: INFO: Container donothing ready: true, restart count 0 Feb 2 02:48:59.628: INFO: rs-kfs5v started at 2023-02-02 02:39:20 +0000 UTC (0+1 container statuses recorded) Feb 2 02:48:59.628: INFO: Container donothing ready: false, restart count 0 Feb 2 02:48:59.628: INFO: netserver-0 started at 2023-02-02 02:45:58 +0000 UTC (0+1 container statuses recorded) Feb 2 02:48:59.628: INFO: Container webserver ready: false, restart count 0 Feb 2 02:48:59.628: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-4lnlh started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:48:59.628: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:48:59.628: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-9vt7q started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:48:59.628: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:48:59.628: INFO: cilium-tc4dv started at 2023-02-02 02:33:34 +0000 UTC (1+1 container statuses recorded) Feb 2 02:48:59.628: INFO: Init container clean-cilium-state ready: true, restart count 0 Feb 2 02:48:59.628: INFO: Container cilium-agent ready: true, restart count 0 Feb 2 02:48:59.628: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-d85kv started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:48:59.628: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:48:59.628: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-dnh8t started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:48:59.628: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:48:59.628: INFO: coredns-559769c974-qfr7h started at 2023-02-02 02:34:23 +0000 UTC (0+1 container statuses recorded) Feb 2 02:48:59.628: INFO: Container coredns ready: true, restart count 0 Feb 2 02:48:59.628: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-wpbbn started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:48:59.628: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:48:59.628: INFO: csi-hostpathplugin-0 started at 2023-02-02 02:39:16 +0000 UTC (0+7 container statuses recorded) Feb 2 02:48:59.628: INFO: Container csi-attacher ready: false, restart count 0 Feb 2 02:48:59.628: INFO: Container csi-provisioner ready: false, restart count 0 Feb 2 02:48:59.628: INFO: Container csi-resizer ready: false, restart count 0 Feb 2 02:48:59.628: INFO: Container csi-snapshotter ready: false, restart count 0 Feb 2 02:48:59.628: INFO: Container hostpath ready: false, restart count 0 Feb 2 02:48:59.628: INFO: Container liveness-probe ready: false, restart count 0 Feb 2 02:48:59.628: INFO: Container node-driver-registrar ready: false, restart count 0 Feb 2 02:48:59.628: INFO: ebs-csi-node-vgbm6 started at 2023-02-02 02:33:34 +0000 UTC (0+3 container statuses recorded) Feb 2 02:48:59.628: INFO: Container ebs-plugin ready: true, restart count 0 Feb 2 02:48:59.628: INFO: Container liveness-probe ready: true, restart count 0 Feb 2 02:48:59.628: INFO: Container node-driver-registrar ready: true, restart count 0 Feb 2 02:48:59.628: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-8jnbj started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:48:59.628: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:48:59.628: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-hvbsc started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:48:59.628: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:48:59.628: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-nwdp9 started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:48:59.628: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:48:59.775: INFO: Latency metrics for node i-094933bbcaafb548f Feb 2 02:48:59.775: INFO: Logging node info for node i-0edda5f045be0496e Feb 2 02:48:59.804: INFO: Node Info: &Node{ObjectMeta:{i-0edda5f045be0496e 4587fb05-429b-429c-8408-c6c4e9c69a39 9899 0 2023-02-02 02:33:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east-1 failure-domain.beta.kubernetes.io/zone:us-east-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0edda5f045be0496e kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-east-1a topology.hostpath.csi/node:i-0edda5f045be0496e topology.kubernetes.io/region:us-east-1 topology.kubernetes.io/zone:us-east-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.36.32 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0edda5f045be0496e"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-02-02 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-02-02 02:33:35 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-02-02 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-02-02 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-02-02 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-02-02 02:38:05 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-02-02 02:47:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-02-02 02:47:24 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///us-east-1a/i-0edda5f045be0496e,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078206976 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973349376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-02 02:47:21 +0000 UTC,LastTransitionTime:2023-02-02 02:33:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-02 02:47:21 +0000 UTC,LastTransitionTime:2023-02-02 02:33:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-02 02:47:21 +0000 UTC,LastTransitionTime:2023-02-02 02:33:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-02 02:47:21 +0000 UTC,LastTransitionTime:2023-02-02 02:33:46 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.36.32,},NodeAddress{Type:ExternalIP,Address:107.20.131.91,},NodeAddress{Type:InternalDNS,Address:i-0edda5f045be0496e.ec2.internal,},NodeAddress{Type:Hostname,Address:i-0edda5f045be0496e.ec2.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-107-20-131-91.compute-1.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2d6d99d20e1d252ee83a35d89804ad,SystemUUID:ec2d6d99-d20e-1d25-2ee8-3a35d89804ad,BootID:d1722e01-5561-4510-a9ae-eb13b4bd9a0f,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.16,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-00adc42c65bfab5b2 kubernetes.io/csi/ebs.csi.aws.com^vol-017618c08fd4915e5 kubernetes.io/csi/ebs.csi.aws.com^vol-04c22c580a5e76d0d],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-017618c08fd4915e5,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-04c22c580a5e76d0d,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-00adc42c65bfab5b2,DevicePath:,},},Config:nil,},} Feb 2 02:48:59.805: INFO: Logging kubelet events for node i-0edda5f045be0496e Feb 2 02:48:59.836: INFO: Logging pods the kubelet thinks is on node i-0edda5f045be0496e Feb 2 02:48:59.874: INFO: ebs-csi-node-kbmng started at 2023-02-02 02:33:36 +0000 UTC (0+3 container statuses recorded) Feb 2 02:48:59.874: INFO: Container ebs-plugin ready: true, restart count 0 Feb 2 02:48:59.874: INFO: Container liveness-probe ready: true, restart count 0 Feb 2 02:48:59.874: INFO: Container node-driver-registrar ready: true, restart count 0 Feb 2 02:48:59.874: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-hfvsn started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:48:59.874: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: false, restart count 0 Feb 2 02:48:59.874: INFO: busybox-979a1d02-d05a-4585-bba7-7f48a1be5c80 started at 2023-02-02 02:44:19 +0000 UTC (0+1 container statuses recorded) Feb 2 02:48:59.874: INFO: Container busybox ready: false, restart count 0 Feb 2 02:48:59.874: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-l8l4k started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:48:59.874: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:48:59.875: INFO: csi-hostpathplugin-0 started at 2023-02-02 02:46:21 +0000 UTC (0+7 container statuses recorded) Feb 2 02:48:59.875: INFO: Container csi-attacher ready: false, restart count 0 Feb 2 02:48:59.875: INFO: Container csi-provisioner ready: false, restart count 0 Feb 2 02:48:59.875: INFO: Container csi-resizer ready: false, restart count 0 Feb 2 02:48:59.875: INFO: Container csi-snapshotter ready: false, restart count 0 Feb 2 02:48:59.875: INFO: Container hostpath ready: false, restart count 0 Feb 2 02:48:59.875: INFO: Container liveness-probe ready: false, restart count 0 Feb 2 02:48:59.875: INFO: Container node-driver-registrar ready: false, restart count 0 Feb 2 02:48:59.875: INFO: rs-x9jhx started at 2023-02-02 02:39:20 +0000 UTC (0+1 container statuses recorded) Feb 2 02:48:59.875: INFO: Container donothing ready: true, restart count 0 Feb 2 02:48:59.875: INFO: pod-projected-configmaps-73c4ca18-4b12-4052-b5d6-417ba8f49fa3 started at 2023-02-02 02:44:38 +0000 UTC (0+1 container statuses recorded) Feb 2 02:48:59.875: INFO: Container agnhost-container ready: false, restart count 0 Feb 2 02:48:59.875: INFO: pod-subpath-test-dynamicpv-ppz6 started at 2023-02-02 02:47:19 +0000 UTC (1+1 container statuses recorded) Feb 2 02:48:59.875: INFO: Init container init-volume-dynamicpv-ppz6 ready: false, restart count 0 Feb 2 02:48:59.875: INFO: Container test-container-subpath-dynamicpv-ppz6 ready: false, restart count 0 Feb 2 02:48:59.875: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-2wdkr started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:48:59.875: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:48:59.875: INFO: test-pod-a627d490-f3f7-40a6-9bb2-57e07c32697f started at 2023-02-02 02:45:13 +0000 UTC (0+1 container statuses recorded) Feb 2 02:48:59.875: INFO: Container agnhost-container ready: false, restart count 0 Feb 2 02:48:59.875: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-9sqms started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:48:59.875: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:48:59.875: INFO: rs-khhlp started at 2023-02-02 02:39:20 +0000 UTC (0+1 container statuses recorded) Feb 2 02:48:59.875: INFO: Container donothing ready: true, restart count 0 Feb 2 02:48:59.875: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-8hlcn started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:48:59.875: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: false, restart count 0 Feb 2 02:48:59.875: INFO: pod1 started at 2023-02-02 02:48:53 +0000 UTC (0+1 container statuses recorded) Feb 2 02:48:59.875: INFO: Container agnhost-container ready: false, restart count 0 Feb 2 02:48:59.875: INFO: pod-2 started at 2023-02-02 02:39:01 +0000 UTC (0+1 container statuses recorded) Feb 2 02:48:59.875: INFO: Container donothing ready: true, restart count 0 Feb 2 02:48:59.875: INFO: rs-pdw5z started at 2023-02-02 02:39:20 +0000 UTC (0+1 container statuses recorded) Feb 2 02:48:59.875: INFO: Container donothing ready: false, restart count 0 Feb 2 02:48:59.875: INFO: master started at 2023-02-02 02:45:00 +0000 UTC (0+1 container statuses recorded) Feb 2 02:48:59.875: INFO: Container cntr ready: false, restart count 0 Feb 2 02:48:59.875: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-f67st started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:48:59.875: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:48:59.875: INFO: pvc-volume-tester-reader-ptvl4 started at 2023-02-02 02:39:22 +0000 UTC (0+1 container statuses recorded) Feb 2 02:48:59.875: INFO: Container volume-tester ready: false, restart count 0 Feb 2 02:48:59.875: INFO: pod-size-memory-volume-ad2110cc-0a0e-48a7-afef-382e2fbae4b0 started at 2023-02-02 02:44:57 +0000 UTC (0+1 container statuses recorded) Feb 2 02:48:59.875: INFO: Container busybox-main-container ready: false, restart count 0 Feb 2 02:48:59.875: INFO: cilium-q9c8c started at 2023-02-02 02:33:36 +0000 UTC (1+1 container statuses recorded) Feb 2 02:48:59.875: INFO: Init container clean-cilium-state ready: true, restart count 0 Feb 2 02:48:59.875: INFO: Container cilium-agent ready: true, restart count 0 Feb 2 02:48:59.875: INFO: sample-apiserver-deployment-55bd96fd47-kjdct started at 2023-02-02 02:45:08 +0000 UTC (0+2 container statuses recorded) Feb 2 02:48:59.875: INFO: Container etcd ready: false, restart count 0 Feb 2 02:48:59.875: INFO: Container sample-apiserver ready: false, restart count 0 Feb 2 02:48:59.875: INFO: netserver-1 started at 2023-02-02 02:45:58 +0000 UTC (0+1 container statuses recorded) Feb 2 02:48:59.875: INFO: Container webserver ready: false, restart count 0 Feb 2 02:48:59.875: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-bc995 started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:48:59.875: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:48:59.875: INFO: inline-volume-tester-jcmtn started at 2023-02-02 02:38:54 +0000 UTC (0+1 container statuses recorded) Feb 2 02:48:59.875: INFO: Container csi-volume-tester ready: true, restart count 0 Feb 2 02:48:59.875: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-jstkj started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:48:59.875: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: false, restart count 0 Feb 2 02:48:59.875: INFO: ss2-2 started at 2023-02-02 02:38:37 +0000 UTC (0+1 container statuses recorded) Feb 2 02:48:59.875: INFO: Container webserver ready: true, restart count 0 Feb 2 02:48:59.875: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-mkbdp started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:48:59.875: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:48:59.875: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-pn6d4 started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:48:59.875: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:48:59.875: INFO: pfpod started at 2023-02-02 02:48:47 +0000 UTC (0+2 container statuses recorded) Feb 2 02:48:59.875: INFO: Container portforwardtester ready: false, restart count 0 Feb 2 02:48:59.875: INFO: Container readiness ready: false, restart count 0 Feb 2 02:49:00.026: INFO: Latency metrics for node i-0edda5f045be0496e Feb 2 02:49:00.026: INFO: Logging node info for node i-0f7e2e4905cb6dadc Feb 2 02:49:00.055: INFO: Node Info: &Node{ObjectMeta:{i-0f7e2e4905cb6dadc 2adbbc9a-dd76-4b97-8d3e-a2bd14f0c57d 9182 0 2023-02-02 02:33:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east-1 failure-domain.beta.kubernetes.io/zone:us-east-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0f7e2e4905cb6dadc kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-east-1a topology.hostpath.csi/node:i-0f7e2e4905cb6dadc topology.kubernetes.io/region:us-east-1 topology.kubernetes.io/zone:us-east-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.40.134 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0f7e2e4905cb6dadc"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-02-02 02:33:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {e2e.test Update v1 2023-02-02 02:38:05 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-02-02 02:45:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///us-east-1a/i-0f7e2e4905cb6dadc,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-02 02:45:37 +0000 UTC,LastTransitionTime:2023-02-02 02:33:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-02 02:45:37 +0000 UTC,LastTransitionTime:2023-02-02 02:33:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-02 02:45:37 +0000 UTC,LastTransitionTime:2023-02-02 02:33:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-02 02:45:37 +0000 UTC,LastTransitionTime:2023-02-02 02:33:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.40.134,},NodeAddress{Type:ExternalIP,Address:18.215.155.89,},NodeAddress{Type:InternalDNS,Address:i-0f7e2e4905cb6dadc.ec2.internal,},NodeAddress{Type:Hostname,Address:i-0f7e2e4905cb6dadc.ec2.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-215-155-89.compute-1.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2d895bde004236c844d2f199d4cb6e,SystemUUID:ec2d895b-de00-4236-c844-d2f199d4cb6e,BootID:e4805eb2-7c0d-48b7-a584-7f3b4b363884,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.16,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Feb 2 02:49:00.055: INFO: Logging kubelet events for node i-0f7e2e4905cb6dadc Feb 2 02:49:00.087: INFO: Logging pods the kubelet thinks is on node i-0f7e2e4905cb6dadc Feb 2 02:49:00.123: INFO: coredns-autoscaler-7cb5c5b969-5nncn started at 2023-02-02 02:33:44 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:00.123: INFO: Container autoscaler ready: true, restart count 0 Feb 2 02:49:00.123: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-7wgzt started at 2023-02-02 02:38:06 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:00.123: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: false, restart count 0 Feb 2 02:49:00.123: INFO: ebs-csi-node-mkxjx started at 2023-02-02 02:33:34 +0000 UTC (0+3 container statuses recorded) Feb 2 02:49:00.123: INFO: Container ebs-plugin ready: true, restart count 0 Feb 2 02:49:00.123: INFO: Container liveness-probe ready: true, restart count 0 Feb 2 02:49:00.123: INFO: Container node-driver-registrar ready: true, restart count 0 Feb 2 02:49:00.123: INFO: rs-rvbxc started at 2023-02-02 02:39:20 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:00.123: INFO: Container donothing ready: false, restart count 0 Feb 2 02:49:00.123: INFO: cilium-k54gx started at 2023-02-02 02:33:34 +0000 UTC (1+1 container statuses recorded) Feb 2 02:49:00.123: INFO: Init container clean-cilium-state ready: true, restart count 0 Feb 2 02:49:00.123: INFO: Container cilium-agent ready: true, restart count 0 Feb 2 02:49:00.123: INFO: coredns-559769c974-s54lm started at 2023-02-02 02:33:44 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:00.123: INFO: Container coredns ready: true, restart count 0 Feb 2 02:49:00.123: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-rnf4c started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:00.123: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:49:00.123: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-pgnjx started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:00.123: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:49:00.123: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-s6mxr started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:00.123: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:49:00.123: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-vtdsx started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:00.123: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:49:00.123: INFO: ss2-0 started at 2023-02-02 02:38:35 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:00.123: INFO: Container webserver ready: true, restart count 0 Feb 2 02:49:00.123: INFO: csi-hostpathplugin-0 started at 2023-02-02 02:46:42 +0000 UTC (0+7 container statuses recorded) Feb 2 02:49:00.123: INFO: Container csi-attacher ready: false, restart count 0 Feb 2 02:49:00.123: INFO: Container csi-provisioner ready: false, restart count 0 Feb 2 02:49:00.123: INFO: Container csi-resizer ready: false, restart count 0 Feb 2 02:49:00.123: INFO: Container csi-snapshotter ready: false, restart count 0 Feb 2 02:49:00.123: INFO: Container hostpath ready: false, restart count 0 Feb 2 02:49:00.123: INFO: Container liveness-probe ready: false, restart count 0 Feb 2 02:49:00.123: INFO: Container node-driver-registrar ready: false, restart count 0 Feb 2 02:49:00.123: INFO: rs-vs5f2 started at 2023-02-02 02:39:20 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:00.123: INFO: Container donothing ready: false, restart count 0 Feb 2 02:49:00.123: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-mphjv started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:00.123: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:49:00.123: INFO: netserver-2 started at 2023-02-02 02:45:58 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:00.123: INFO: Container webserver ready: false, restart count 0 Feb 2 02:49:00.123: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-h65xw started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:00.123: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:49:00.123: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-pwvqk started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:00.123: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:49:00.123: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-m7nw9 started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:00.123: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: false, restart count 0 Feb 2 02:49:00.123: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-xzv2d started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:00.123: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:49:00.295: INFO: Latency metrics for node i-0f7e2e4905cb6dadc Feb 2 02:49:00.296: INFO: Logging node info for node i-0fe5d857b6eb4dfe3 Feb 2 02:49:00.324: INFO: Node Info: &Node{ObjectMeta:{i-0fe5d857b6eb4dfe3 9d0f7cfc-7470-4601-b0c7-c2b476a9fab7 10183 0 2023-02-02 02:33:43 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east-1 failure-domain.beta.kubernetes.io/zone:us-east-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0fe5d857b6eb4dfe3 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-east-1a topology.hostpath.csi/node:i-0fe5d857b6eb4dfe3 topology.kubernetes.io/region:us-east-1 topology.kubernetes.io/zone:us-east-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.53.228 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0fe5d857b6eb4dfe3"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-02-02 02:33:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-02-02 02:33:43 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-02-02 02:33:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-02-02 02:33:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-02-02 02:33:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-02-02 02:38:05 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-02-02 02:48:41 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-02-02 02:48:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///us-east-1a/i-0fe5d857b6eb4dfe3,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078206976 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973349376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-02 02:48:41 +0000 UTC,LastTransitionTime:2023-02-02 02:33:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-02 02:48:41 +0000 UTC,LastTransitionTime:2023-02-02 02:33:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-02 02:48:41 +0000 UTC,LastTransitionTime:2023-02-02 02:33:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-02 02:48:41 +0000 UTC,LastTransitionTime:2023-02-02 02:33:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.53.228,},NodeAddress{Type:ExternalIP,Address:18.212.239.71,},NodeAddress{Type:InternalDNS,Address:i-0fe5d857b6eb4dfe3.ec2.internal,},NodeAddress{Type:Hostname,Address:i-0fe5d857b6eb4dfe3.ec2.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-212-239-71.compute-1.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23a338ffd343d89814911cd0d0d8ea,SystemUUID:ec23a338-ffd3-43d8-9814-911cd0d0d8ea,BootID:588a11ea-21bc-44af-808b-852f5f90dd84,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.16,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-021fcced421837e53 kubernetes.io/csi/ebs.csi.aws.com^vol-06c549b1251626bdf kubernetes.io/csi/ebs.csi.aws.com^vol-099bf0e1f55ee83c6],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-099bf0e1f55ee83c6,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-06c549b1251626bdf,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-021fcced421837e53,DevicePath:,},},Config:nil,},} Feb 2 02:49:00.325: INFO: Logging kubelet events for node i-0fe5d857b6eb4dfe3 Feb 2 02:49:00.356: INFO: Logging pods the kubelet thinks is on node i-0fe5d857b6eb4dfe3 Feb 2 02:49:00.393: INFO: netserver-3 started at 2023-02-02 02:45:58 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:00.393: INFO: Container webserver ready: false, restart count 0 Feb 2 02:49:00.393: INFO: csi-mockplugin-0 started at 2023-02-02 02:46:24 +0000 UTC (0+3 container statuses recorded) Feb 2 02:49:00.393: INFO: Container csi-provisioner ready: false, restart count 0 Feb 2 02:49:00.393: INFO: Container driver-registrar ready: false, restart count 0 Feb 2 02:49:00.393: INFO: Container mock ready: false, restart count 0 Feb 2 02:49:00.393: INFO: pod-0 started at 2023-02-02 02:39:01 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:00.393: INFO: Container donothing ready: true, restart count 0 Feb 2 02:49:00.393: INFO: pfpod started at 2023-02-02 02:44:09 +0000 UTC (0+2 container statuses recorded) Feb 2 02:49:00.393: INFO: Container portforwardtester ready: false, restart count 0 Feb 2 02:49:00.393: INFO: Container readiness ready: false, restart count 0 Feb 2 02:49:00.393: INFO: cilium-gffsv started at 2023-02-02 02:33:43 +0000 UTC (1+1 container statuses recorded) Feb 2 02:49:00.393: INFO: Init container clean-cilium-state ready: true, restart count 0 Feb 2 02:49:00.393: INFO: Container cilium-agent ready: true, restart count 0 Feb 2 02:49:00.393: INFO: inline-volume-tester-vzj57 started at 2023-02-02 02:38:29 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:00.393: INFO: Container csi-volume-tester ready: false, restart count 0 Feb 2 02:49:00.393: INFO: downwardapi-volume-f822f893-f68e-4550-8d56-75d959db5fcd started at 2023-02-02 02:44:15 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:00.393: INFO: Container client-container ready: false, restart count 0 Feb 2 02:49:00.393: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-sb6sx started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:00.393: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:49:00.393: INFO: ss2-1 started at 2023-02-02 02:41:26 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:00.393: INFO: Container webserver ready: false, restart count 0 Feb 2 02:49:00.393: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-n4rbc started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:00.393: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:49:00.393: INFO: pod-1 started at 2023-02-02 02:39:01 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:00.393: INFO: Container donothing ready: false, restart count 0 Feb 2 02:49:00.393: INFO: csi-mockplugin-attacher-0 started at 2023-02-02 02:46:24 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:00.393: INFO: Container csi-attacher ready: false, restart count 0 Feb 2 02:49:00.393: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-snv7k started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:00.393: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:49:00.393: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-dz5bh started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:00.393: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:49:00.393: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-dss8d started at 2023-02-02 02:38:06 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:00.393: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:49:00.393: INFO: inline-volume-tester2-wpgg7 started at 2023-02-02 02:39:34 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:00.393: INFO: Container csi-volume-tester ready: false, restart count 0 Feb 2 02:49:00.393: INFO: ebs-csi-node-qqz2d started at 2023-02-02 02:33:43 +0000 UTC (0+3 container statuses recorded) Feb 2 02:49:00.393: INFO: Container ebs-plugin ready: true, restart count 0 Feb 2 02:49:00.393: INFO: Container liveness-probe ready: true, restart count 0 Feb 2 02:49:00.393: INFO: Container node-driver-registrar ready: true, restart count 0 Feb 2 02:49:00.393: INFO: rs-pc45g started at 2023-02-02 02:39:21 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:00.393: INFO: Container donothing ready: true, restart count 0 Feb 2 02:49:00.393: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-965cw started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:00.393: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:49:00.393: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-7j88c started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:00.393: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:49:00.393: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-2psrz started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:00.393: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:49:00.393: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-7xd6t started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:00.393: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:49:00.393: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-j9kxn started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:00.393: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:49:00.393: INFO: rs-hhq9v started at 2023-02-02 02:39:20 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:00.393: INFO: Container donothing ready: false, restart count 0 Feb 2 02:49:00.393: INFO: rs-qxhxb started at 2023-02-02 02:39:20 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:00.393: INFO: Container donothing ready: false, restart count 0 Feb 2 02:49:00.393: INFO: pod-059e4fe9-a68f-4452-baaa-69b48b71743f started at 2023-02-02 02:39:31 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:00.393: INFO: Container write-pod ready: false, restart count 0 Feb 2 02:49:00.570: INFO: Latency metrics for node i-0fe5d857b6eb4dfe3 [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath tear down framework | framework.go:193 �[1mSTEP:�[0m Destroying namespace "provisioning-195" for this suite. �[38;5;243m02/02/23 02:49:00.57�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\sExternal\sStorage\s\[Driver\:\sebs\.csi\.aws\.com\]\s\[Testpattern\:\sGeneric\sEphemeral\-volume\s\(block\svolmode\)\s\(late\-binding\)\]\sephemeral\sshould\screate\sread\/write\sinline\sephemeral\svolume$'
test/e2e/storage/testsuites/ephemeral.go:413 k8s.io/kubernetes/test/e2e/storage/testsuites.EphemeralTest.TestEphemeral({{0x8022ee8, 0xc000cd9d40}, 0xc0018ebc80, {0xc004a38f50, 0xe}, {0x0, 0x0}, 0xc001ed43c0, {{0x0, 0x0}, ...}, ...}, ...) test/e2e/storage/testsuites/ephemeral.go:413 +0x63d k8s.io/kubernetes/test/e2e/storage/testsuites.(*ephemeralTestSuite).DefineTests.func4({0x7f1ff4c2f540, 0xc00499c2c0}) test/e2e/storage/testsuites/ephemeral.go:214 +0x1b4from junit_01.xml
[BeforeEach] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral test/e2e/storage/framework/testsuite.go:51 [BeforeEach] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral set up framework | framework.go:178 �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m02/02/23 02:38:21.572�[0m Feb 2 02:38:21.572: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP:�[0m Building a namespace api object, basename ephemeral �[38;5;243m02/02/23 02:38:21.574�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m02/02/23 02:38:21.664�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m02/02/23 02:38:21.721�[0m [BeforeEach] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral test/e2e/framework/metrics/init/init.go:31 [It] should create read/write inline ephemeral volume test/e2e/storage/testsuites/ephemeral.go:197 Feb 2 02:38:21.840: INFO: Pod inline-volume-x4bv8 has the following logs: Feb 2 02:38:21.870: INFO: Deleting pod "inline-volume-x4bv8" in namespace "ephemeral-2214" Feb 2 02:38:21.900: INFO: Wait up to 5m0s for pod "inline-volume-x4bv8" to be fully deleted Feb 2 02:38:23.959: INFO: Creating resource for dynamic PV Feb 2 02:38:23.959: INFO: Using claimSize:1Gi, test suite supported size:{ }, driver(ebs.csi.aws.com) supported size:{ } �[1mSTEP:�[0m creating a StorageClass ephemeral-2214-e2e-sc24lht �[38;5;243m02/02/23 02:38:23.959�[0m �[1mSTEP:�[0m checking the requested inline volume exists in the pod running on node {Name: Selector:map[] Affinity:nil} �[38;5;243m02/02/23 02:38:23.991�[0m Feb 2 02:38:24.028: INFO: Waiting up to 15m0s for pod "inline-volume-tester-vzj57" in namespace "ephemeral-2214" to be "running" Feb 2 02:38:24.057: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 29.393758ms Feb 2 02:38:26.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 2.059715826s Feb 2 02:38:28.087: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 4.059041003s Feb 2 02:38:30.087: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 6.058745066s Feb 2 02:38:32.087: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 8.059203165s Feb 2 02:38:34.087: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 10.059692885s Feb 2 02:38:36.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 12.05972276s Feb 2 02:38:38.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 14.061604837s Feb 2 02:38:40.087: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 16.059337966s Feb 2 02:38:42.087: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 18.05953078s Feb 2 02:38:44.087: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 20.059079942s Feb 2 02:38:46.086: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 22.05858753s Feb 2 02:38:48.086: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 24.058653501s Feb 2 02:38:50.087: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 26.059239335s Feb 2 02:38:52.087: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 28.059054695s Feb 2 02:38:54.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 30.060503741s Feb 2 02:38:56.087: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 32.059325697s Feb 2 02:38:58.087: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 34.059410015s Feb 2 02:39:00.097: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 36.069324073s Feb 2 02:39:02.087: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 38.0590915s Feb 2 02:39:04.087: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 40.059505838s Feb 2 02:39:06.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 42.060023094s Feb 2 02:39:08.087: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 44.059624163s Feb 2 02:39:10.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 46.05974232s Feb 2 02:39:12.087: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 48.059636688s Feb 2 02:39:14.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 50.059902571s Feb 2 02:39:16.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 52.061652826s Feb 2 02:39:18.087: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 54.05899039s Feb 2 02:39:20.087: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 56.059504427s Feb 2 02:39:22.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 58.060648301s Feb 2 02:39:24.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.059975699s Feb 2 02:39:26.087: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.059635448s Feb 2 02:39:28.087: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.059647239s Feb 2 02:39:30.087: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.058910019s Feb 2 02:39:32.087: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.058799573s Feb 2 02:39:34.087: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.058991547s Feb 2 02:39:36.087: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.05875464s Feb 2 02:39:38.087: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.059317684s Feb 2 02:39:40.087: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.058770363s Feb 2 02:39:42.087: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.058703789s Feb 2 02:39:44.087: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.059175091s Feb 2 02:39:46.087: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.059171565s Feb 2 02:39:48.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.059750048s Feb 2 02:39:50.087: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.058874535s Feb 2 02:39:52.087: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.059022796s Feb 2 02:39:54.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.059883116s Feb 2 02:39:56.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.05985528s Feb 2 02:39:58.087: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.059569618s Feb 2 02:40:00.087: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.059162292s Feb 2 02:40:02.087: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.059052808s Feb 2 02:40:04.087: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.059236587s Feb 2 02:40:06.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.059852845s Feb 2 02:40:08.087: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.059643964s Feb 2 02:40:10.087: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.058843596s Feb 2 02:40:12.087: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.058963408s Feb 2 02:40:14.087: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.05938273s Feb 2 02:40:16.090: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.061873525s Feb 2 02:40:18.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.060767742s Feb 2 02:40:20.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.06109193s Feb 2 02:40:22.090: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.062665378s Feb 2 02:40:24.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.060579137s Feb 2 02:40:26.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.060611394s Feb 2 02:40:28.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.060936838s Feb 2 02:40:30.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.061324534s Feb 2 02:40:32.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.06140201s Feb 2 02:40:34.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.06135696s Feb 2 02:40:36.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.060784679s Feb 2 02:40:38.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.061359752s Feb 2 02:40:40.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.061486369s Feb 2 02:40:42.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.061546042s Feb 2 02:40:44.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.060546036s Feb 2 02:40:46.090: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.061708656s Feb 2 02:40:48.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.060905758s Feb 2 02:40:50.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.06152995s Feb 2 02:40:52.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.060859259s Feb 2 02:40:54.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.061336154s Feb 2 02:40:56.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.061261116s Feb 2 02:40:58.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.061539841s Feb 2 02:41:00.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.0613738s Feb 2 02:41:02.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.061505779s Feb 2 02:41:04.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.0616788s Feb 2 02:41:06.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.061245369s Feb 2 02:41:08.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.061667972s Feb 2 02:41:10.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.060347921s Feb 2 02:41:12.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.060873273s Feb 2 02:41:14.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.061090721s Feb 2 02:41:16.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.061551615s Feb 2 02:41:18.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.060521581s Feb 2 02:41:20.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.061033661s Feb 2 02:41:22.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.061231313s Feb 2 02:41:24.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.06127509s Feb 2 02:41:26.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.061522569s Feb 2 02:41:28.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.061004363s Feb 2 02:41:30.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.061170829s Feb 2 02:41:32.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.060631793s Feb 2 02:41:34.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.060534463s Feb 2 02:41:36.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.060808661s Feb 2 02:41:38.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.060737045s Feb 2 02:41:40.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.06057112s Feb 2 02:41:42.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.060628966s Feb 2 02:41:44.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.060503013s Feb 2 02:41:46.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.060757789s Feb 2 02:41:48.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.06123545s Feb 2 02:41:50.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.060698827s Feb 2 02:41:52.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.061437872s Feb 2 02:41:54.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.061137405s Feb 2 02:41:56.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.060653963s Feb 2 02:41:58.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.060750215s Feb 2 02:42:00.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.060573642s Feb 2 02:42:02.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.061038628s Feb 2 02:42:04.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.061200512s Feb 2 02:42:06.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.060488211s Feb 2 02:42:08.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.060552334s Feb 2 02:42:10.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.060992548s Feb 2 02:42:12.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.061152966s Feb 2 02:42:14.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.06149573s Feb 2 02:42:16.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.060271636s Feb 2 02:42:18.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.060998058s Feb 2 02:42:20.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.060391681s Feb 2 02:42:22.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.060718417s Feb 2 02:42:24.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.060700771s Feb 2 02:42:26.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.060774807s Feb 2 02:42:28.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.060949136s Feb 2 02:42:30.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.060698838s Feb 2 02:42:32.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.060600734s Feb 2 02:42:34.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.060955019s Feb 2 02:42:36.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.060723701s Feb 2 02:42:38.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.060876963s Feb 2 02:42:40.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.06054555s Feb 2 02:42:42.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.060472736s Feb 2 02:42:44.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.060117788s Feb 2 02:42:46.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.060737707s Feb 2 02:42:48.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.060961495s Feb 2 02:42:50.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.060351649s Feb 2 02:42:52.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.060686807s Feb 2 02:42:54.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.060432668s Feb 2 02:42:56.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.060637423s Feb 2 02:42:58.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.060913201s Feb 2 02:43:00.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.060692881s Feb 2 02:43:02.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.060746646s Feb 2 02:43:04.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.060815742s Feb 2 02:43:06.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.061028507s Feb 2 02:43:08.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.060576171s Feb 2 02:43:10.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.060832395s Feb 2 02:43:12.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.061019857s Feb 2 02:43:14.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.061103037s Feb 2 02:43:16.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.060917761s Feb 2 02:43:18.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.060940694s Feb 2 02:43:20.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.060408575s Feb 2 02:43:22.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.060285137s Feb 2 02:43:24.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.06055678s Feb 2 02:43:26.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 5m2.060765493s Feb 2 02:43:28.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 5m4.060276555s Feb 2 02:43:30.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 5m6.060832344s Feb 2 02:43:32.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 5m8.060527438s Feb 2 02:43:34.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 5m10.060320764s Feb 2 02:43:36.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 5m12.060323657s Feb 2 02:43:38.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 5m14.060748847s Feb 2 02:43:40.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 5m16.061148448s Feb 2 02:43:42.090: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 5m18.062328522s Feb 2 02:43:44.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 5m20.061025348s Feb 2 02:43:46.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 5m22.060735009s Feb 2 02:43:48.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 5m24.060915995s Feb 2 02:43:50.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 5m26.061078862s Feb 2 02:43:52.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 5m28.060876966s Feb 2 02:43:54.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 5m30.060547617s Feb 2 02:43:56.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 5m32.061282935s Feb 2 02:43:58.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 5m34.061164647s Feb 2 02:44:00.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 5m36.061001184s Feb 2 02:44:02.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 5m38.060743261s Feb 2 02:44:04.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 5m40.060735871s Feb 2 02:44:06.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 5m42.060397619s Feb 2 02:44:08.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 5m44.061156241s Feb 2 02:44:10.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 5m46.060978879s Feb 2 02:44:12.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 5m48.061138804s Feb 2 02:44:14.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 5m50.061069726s Feb 2 02:44:16.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 5m52.060896599s Feb 2 02:44:18.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 5m54.060733749s Feb 2 02:44:20.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 5m56.060603227s Feb 2 02:44:22.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 5m58.060472601s Feb 2 02:44:24.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 6m0.06061216s Feb 2 02:44:26.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 6m2.060325269s Feb 2 02:44:28.093: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 6m4.065240993s Feb 2 02:44:30.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 6m6.061496708s Feb 2 02:44:32.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 6m8.061249727s Feb 2 02:44:34.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 6m10.060947512s Feb 2 02:44:36.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 6m12.061387779s Feb 2 02:44:38.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 6m14.061567703s Feb 2 02:44:40.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 6m16.060798617s Feb 2 02:44:42.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 6m18.060524412s Feb 2 02:44:44.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 6m20.060735631s Feb 2 02:44:46.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 6m22.060225642s Feb 2 02:44:48.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 6m24.061340491s Feb 2 02:44:50.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 6m26.060598533s Feb 2 02:44:52.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 6m28.060847131s Feb 2 02:44:54.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 6m30.060226858s Feb 2 02:44:56.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 6m32.060655442s Feb 2 02:44:58.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 6m34.060256265s Feb 2 02:45:00.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 6m36.061230768s Feb 2 02:45:02.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 6m38.061060541s Feb 2 02:45:04.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 6m40.061479076s Feb 2 02:45:06.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 6m42.06101326s Feb 2 02:45:08.093: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 6m44.065467947s Feb 2 02:45:10.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 6m46.06085758s Feb 2 02:45:12.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 6m48.061306079s Feb 2 02:45:14.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 6m50.06043397s Feb 2 02:45:16.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 6m52.060781684s Feb 2 02:45:18.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 6m54.060863414s Feb 2 02:45:20.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 6m56.060732628s Feb 2 02:45:22.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 6m58.060683665s Feb 2 02:45:24.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 7m0.060732337s Feb 2 02:45:26.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 7m2.060890502s Feb 2 02:45:28.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 7m4.060921232s Feb 2 02:45:30.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 7m6.06081684s Feb 2 02:45:32.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 7m8.06078485s Feb 2 02:45:34.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 7m10.060683802s Feb 2 02:45:36.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 7m12.060824551s Feb 2 02:45:38.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 7m14.06095332s Feb 2 02:45:40.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 7m16.060883129s Feb 2 02:45:42.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 7m18.060755378s Feb 2 02:45:44.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 7m20.060652861s Feb 2 02:45:46.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 7m22.060914253s Feb 2 02:45:48.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 7m24.061228285s Feb 2 02:45:50.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 7m26.060760184s Feb 2 02:45:52.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 7m28.060527864s Feb 2 02:45:54.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 7m30.060617153s Feb 2 02:45:56.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 7m32.060658485s Feb 2 02:45:58.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 7m34.060801517s Feb 2 02:46:00.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 7m36.060962815s Feb 2 02:46:02.100: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 7m38.072402875s Feb 2 02:46:04.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 7m40.061133695s Feb 2 02:46:06.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 7m42.060876273s Feb 2 02:46:08.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 7m44.060966331s Feb 2 02:46:10.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 7m46.060595563s Feb 2 02:46:12.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 7m48.060632638s Feb 2 02:46:14.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 7m50.0609376s Feb 2 02:46:16.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 7m52.060879729s Feb 2 02:46:18.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 7m54.060854325s Feb 2 02:46:20.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 7m56.060512665s Feb 2 02:46:22.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 7m58.060378522s Feb 2 02:46:24.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 8m0.060874118s Feb 2 02:46:26.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 8m2.061129056s Feb 2 02:46:28.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 8m4.060555991s Feb 2 02:46:30.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 8m6.060401258s Feb 2 02:46:32.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 8m8.061345069s Feb 2 02:46:34.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 8m10.060177394s Feb 2 02:46:36.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 8m12.060456304s Feb 2 02:46:38.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 8m14.060425505s Feb 2 02:46:40.090: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 8m16.061978015s Feb 2 02:46:42.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 8m18.060939018s Feb 2 02:46:44.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 8m20.061153763s Feb 2 02:46:46.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 8m22.060888978s Feb 2 02:46:48.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 8m24.060779306s Feb 2 02:46:50.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 8m26.060802222s Feb 2 02:46:52.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 8m28.061258805s Feb 2 02:46:54.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 8m30.061608104s Feb 2 02:46:56.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 8m32.061346934s Feb 2 02:46:58.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 8m34.060855842s Feb 2 02:47:00.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 8m36.060995413s Feb 2 02:47:02.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 8m38.061545022s Feb 2 02:47:04.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 8m40.060833678s Feb 2 02:47:06.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 8m42.060671871s Feb 2 02:47:08.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 8m44.061425806s Feb 2 02:47:10.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 8m46.060809644s Feb 2 02:47:12.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 8m48.06145955s Feb 2 02:47:14.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 8m50.061093352s Feb 2 02:47:16.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 8m52.060611351s Feb 2 02:47:18.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 8m54.061036559s Feb 2 02:47:20.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 8m56.060563093s Feb 2 02:47:22.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 8m58.060519991s Feb 2 02:47:24.091: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 9m0.063301062s Feb 2 02:47:26.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 9m2.06126533s Feb 2 02:47:28.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 9m4.060514814s Feb 2 02:47:30.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 9m6.060481559s Feb 2 02:47:32.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 9m8.060857972s Feb 2 02:47:34.111: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 9m10.083194387s Feb 2 02:47:36.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 9m12.060955779s Feb 2 02:47:38.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 9m14.060569319s Feb 2 02:47:40.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 9m16.060564103s Feb 2 02:47:42.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 9m18.061574151s Feb 2 02:47:44.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 9m20.061554903s Feb 2 02:47:46.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 9m22.060634626s Feb 2 02:47:48.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 9m24.061330252s Feb 2 02:47:50.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 9m26.060992948s Feb 2 02:47:52.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 9m28.061197003s Feb 2 02:47:54.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 9m30.061444135s Feb 2 02:47:56.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 9m32.061219828s Feb 2 02:47:58.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 9m34.060287486s Feb 2 02:48:00.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 9m36.060975296s Feb 2 02:48:02.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 9m38.061456736s Feb 2 02:48:04.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 9m40.060842198s Feb 2 02:48:06.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 9m42.060511778s Feb 2 02:48:08.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 9m44.061589246s Feb 2 02:48:10.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 9m46.061093995s Feb 2 02:48:12.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 9m48.061393085s Feb 2 02:48:14.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 9m50.061496804s Feb 2 02:48:16.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 9m52.060582134s Feb 2 02:48:18.090: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 9m54.061795312s Feb 2 02:48:20.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 9m56.061408814s Feb 2 02:48:22.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 9m58.060846906s Feb 2 02:48:24.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 10m0.061511897s Feb 2 02:48:26.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 10m2.061425039s Feb 2 02:48:28.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 10m4.060707246s Feb 2 02:48:30.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 10m6.061097349s Feb 2 02:48:32.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 10m8.061014439s Feb 2 02:48:34.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 10m10.06067759s Feb 2 02:48:36.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 10m12.060419446s Feb 2 02:48:38.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 10m14.060657294s Feb 2 02:48:40.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 10m16.060989003s Feb 2 02:48:42.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 10m18.060731514s Feb 2 02:48:44.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 10m20.060650665s Feb 2 02:48:46.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 10m22.061098513s Feb 2 02:48:48.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 10m24.06127001s Feb 2 02:48:50.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 10m26.060900308s Feb 2 02:48:52.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 10m28.061159347s Feb 2 02:48:54.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 10m30.060399728s Feb 2 02:48:56.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 10m32.06113723s Feb 2 02:48:58.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 10m34.06070364s Feb 2 02:49:00.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 10m36.060480986s Feb 2 02:49:02.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 10m38.061172116s Feb 2 02:49:04.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 10m40.060911234s Feb 2 02:49:06.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 10m42.061590503s Feb 2 02:49:08.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 10m44.060620479s Feb 2 02:49:10.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 10m46.060608626s Feb 2 02:49:12.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 10m48.060750559s Feb 2 02:49:14.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 10m50.061459401s Feb 2 02:49:16.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 10m52.061178276s Feb 2 02:49:18.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 10m54.061400454s Feb 2 02:49:20.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 10m56.060775144s Feb 2 02:49:22.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 10m58.061139642s Feb 2 02:49:24.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 11m0.06147532s Feb 2 02:49:26.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 11m2.060730386s Feb 2 02:49:28.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 11m4.060855185s Feb 2 02:49:30.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 11m6.060870688s Feb 2 02:49:32.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 11m8.060305342s Feb 2 02:49:34.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 11m10.06051169s Feb 2 02:49:36.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 11m12.060517917s Feb 2 02:49:38.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 11m14.060778948s Feb 2 02:49:40.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 11m16.061199642s Feb 2 02:49:42.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 11m18.060551362s Feb 2 02:49:44.098: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 11m20.070506397s Feb 2 02:49:46.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 11m22.061099411s Feb 2 02:49:48.090: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 11m24.062231158s Feb 2 02:49:50.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 11m26.061207911s Feb 2 02:49:52.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 11m28.061323209s Feb 2 02:49:54.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 11m30.06078967s Feb 2 02:49:56.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 11m32.061626116s Feb 2 02:49:58.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 11m34.060574387s Feb 2 02:50:00.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 11m36.060658124s Feb 2 02:50:02.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 11m38.060339605s Feb 2 02:50:04.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 11m40.061494249s Feb 2 02:50:06.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 11m42.061063183s Feb 2 02:50:08.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 11m44.061540222s Feb 2 02:50:10.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 11m46.061424925s Feb 2 02:50:12.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 11m48.060487712s Feb 2 02:50:14.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 11m50.060333256s Feb 2 02:50:16.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 11m52.06099711s Feb 2 02:50:18.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 11m54.061419146s Feb 2 02:50:20.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 11m56.060662282s Feb 2 02:50:22.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 11m58.061429162s Feb 2 02:50:24.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 12m0.060580997s Feb 2 02:50:26.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 12m2.061210812s Feb 2 02:50:28.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 12m4.061155285s Feb 2 02:50:30.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 12m6.060412318s Feb 2 02:50:32.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 12m8.061245166s Feb 2 02:50:34.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 12m10.06040463s Feb 2 02:50:36.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 12m12.06073859s Feb 2 02:50:38.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 12m14.06087615s Feb 2 02:50:40.090: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 12m16.061958232s Feb 2 02:50:42.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 12m18.061515671s Feb 2 02:50:44.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 12m20.061525914s Feb 2 02:50:46.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 12m22.061347004s Feb 2 02:50:48.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 12m24.06043656s Feb 2 02:50:50.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 12m26.060929904s Feb 2 02:50:52.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 12m28.061157508s Feb 2 02:50:54.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 12m30.061214344s Feb 2 02:50:56.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 12m32.06041355s Feb 2 02:50:58.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 12m34.061435535s Feb 2 02:51:00.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 12m36.060690158s Feb 2 02:51:02.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 12m38.060457046s Feb 2 02:51:04.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 12m40.060540294s Feb 2 02:51:06.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 12m42.061169187s Feb 2 02:51:08.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 12m44.061316145s Feb 2 02:51:10.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 12m46.060943873s Feb 2 02:51:12.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 12m48.060503121s Feb 2 02:51:14.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 12m50.060567607s Feb 2 02:51:16.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 12m52.061247533s Feb 2 02:51:18.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 12m54.060384611s Feb 2 02:51:20.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 12m56.060566289s Feb 2 02:51:22.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 12m58.060330005s Feb 2 02:51:24.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 13m0.061672412s Feb 2 02:51:26.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 13m2.061296415s Feb 2 02:51:28.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 13m4.060374876s Feb 2 02:51:30.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 13m6.060865179s Feb 2 02:51:32.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 13m8.060451956s Feb 2 02:51:34.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 13m10.060286415s Feb 2 02:51:36.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 13m12.060846158s Feb 2 02:51:38.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 13m14.060471933s Feb 2 02:51:40.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 13m16.061026949s Feb 2 02:51:42.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 13m18.061122537s Feb 2 02:51:44.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 13m20.060439593s Feb 2 02:51:46.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 13m22.060320113s Feb 2 02:51:48.090: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 13m24.061779986s Feb 2 02:51:50.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 13m26.061285721s Feb 2 02:51:52.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 13m28.060761617s Feb 2 02:51:54.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 13m30.060933952s Feb 2 02:51:56.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 13m32.060982405s Feb 2 02:51:58.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 13m34.061599423s Feb 2 02:52:00.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 13m36.060477106s Feb 2 02:52:02.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 13m38.06076207s Feb 2 02:52:04.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 13m40.060960949s Feb 2 02:52:06.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 13m42.060968103s Feb 2 02:52:08.090: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 13m44.061756456s Feb 2 02:52:10.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 13m46.061559881s Feb 2 02:52:12.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 13m48.06080965s Feb 2 02:52:14.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 13m50.060740427s Feb 2 02:52:16.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 13m52.061060299s Feb 2 02:52:18.090: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 13m54.061735181s Feb 2 02:52:20.090: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 13m56.061821175s Feb 2 02:52:22.088: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 13m58.060688667s Feb 2 02:52:24.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 14m0.061239488s Feb 2 02:52:26.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 14m2.061034232s Feb 2 02:52:28.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 14m4.061563486s Feb 2 02:52:30.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 14m6.061170857s Feb 2 02:52:32.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 14m8.060843426s Feb 2 02:52:34.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 14m10.061621674s Feb 2 02:52:36.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 14m12.061563357s Feb 2 02:52:38.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 14m14.060788248s Feb 2 02:52:40.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 14m16.06085172s Feb 2 02:52:42.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 14m18.060797312s Feb 2 02:52:44.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 14m20.061508339s Feb 2 02:52:46.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 14m22.061472455s Feb 2 02:52:48.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 14m24.060763292s Feb 2 02:52:50.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 14m26.061062221s Feb 2 02:52:52.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 14m28.061542573s Feb 2 02:52:54.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 14m30.061133108s Feb 2 02:52:56.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 14m32.060715571s Feb 2 02:52:58.090: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 14m34.061801565s Feb 2 02:53:00.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 14m36.061368876s Feb 2 02:53:02.090: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 14m38.061716196s Feb 2 02:53:04.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 14m40.060781385s Feb 2 02:53:06.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 14m42.06160537s Feb 2 02:53:08.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 14m44.060728992s Feb 2 02:53:10.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 14m46.061010459s Feb 2 02:53:12.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 14m48.060746384s Feb 2 02:53:14.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 14m50.060784115s Feb 2 02:53:16.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 14m52.061534756s Feb 2 02:53:18.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 14m54.061186752s Feb 2 02:53:20.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 14m56.061087568s Feb 2 02:53:22.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 14m58.061669532s Feb 2 02:53:24.089: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 15m0.060734298s Feb 2 02:53:24.119: INFO: Pod "inline-volume-tester-vzj57": Phase="Pending", Reason="", readiness=false. Elapsed: 15m0.091618522s Feb 2 02:53:24.121: INFO: Unexpected error: waiting for pod with inline volume: <*pod.timeoutError | 0xc001ce3170>: { msg: "timed out while waiting for pod ephemeral-2214/inline-volume-tester-vzj57 to be running", observedObjects: [ <*v1.Pod | 0xc000bcc900>{ TypeMeta: {Kind: "", APIVersion: ""}, ObjectMeta: { Name: "inline-volume-tester-vzj57", GenerateName: "inline-volume-tester-", Namespace: "ephemeral-2214", SelfLink: "", UID: "82e7259c-610b-4355-9aa9-76632d1a2d7c", ResourceVersion: "5471", Generation: 0, CreationTimestamp: { Time: { wall: 0, ext: 63810902304, loc: { name: "Local", zone: [ {name: "UTC", offset: 0, isDST: false}, ], tx: [ { when: -9223372036854775808, index: 0, isstd: false, isutc: false, }, ], extend: "UTC0", cacheStart: 9223372036854775807, cacheEnd: 9223372036854775807, cacheZone: {name: "UTC", offset: 0, isDST: false}, }, }, }, DeletionTimestamp: nil, DeletionGracePeriodSeconds: nil, Labels: { "app": "inline-volume-tester", }, Annotations: nil, OwnerReferences: nil, Finalizers: nil, ManagedFields: [ { Manager: "e2e.test", Operation: "Update", APIVersion: "v1", Time: { Time: { wall: 0, ext: 63810902304, loc: { name: "Local", zone: [...], tx: [...], extend: "UTC0", cacheStart: 9223372036854775807, cacheEnd: 9223372036854775807, cacheZone: {name: ..., offset: ..., isDST: ...}, }, }, }, FieldsType: "FieldsV1", FieldsV1: { Raw: "{\"f:metadata\":{\"f:generateName\":{},\"f:labels\":{\".\":{},\"f:app\":{}}},\"f:spec\":{\"f:containers\":{\"k:{\\\"name\\\":\\\"csi-volume-tester\\\"}\":{\".\":{},\"f:command\":{},\"f:image\":{},\"f:imagePullPolicy\":{},\"f:name\":{},\"f:resources\":{},\"f:terminationMessagePath\":{},\"f:terminationMessagePolicy\":{},\"f:volumeDevices\":{\".\":{},\"k:{\\\"devicePath\\\":\\\"/mnt/test-0\\\"}\":{\".\":{},\"f:devicePath\":{},\"f:name\":{}}}}},\"f:dnsPolicy\":{},\"f:enableServiceLinks\":{},\"f:restartPolicy\":{},\"f:schedulerName\":{},\"f:securityContext\":{},\"f:terminationGracePeriodSeconds\":{},\"f:volumes\":{\".\":{},\"k:{\\\"name\\\":\\\"my-volume-0\\\"}\":{\".\":{},\"f:ephemeral\":{\".\":{},\"f:volumeClaimTemplate\":{\".\":{},\"f:metadata\":{\".\":{},\"f:creationTimestamp\":{}},\"f:spec\":{\".\":{},\"f:accessModes\":{},\"f:resources\":{\".\":{},\"f:requests\":{\".\":{},\"f:storage\":{}}},\"f:storageClassName\":{},\"f:volumeMode\":{}}}},\"f:name\":{}}}}}", }, Subresource: "", }, { Manager: "kube-scheduler", Operation: "Update", APIVersion: "v1", Time: { Time: { wall: 0, ext: 63810902304, loc: { name: "Local", zone: [...], tx: [...], extend: "UTC0", cacheStart: 9223372036854775807, cacheEnd: 9223372036854775807, cacheZone: {name: ..., offset: ..., isDST: ...}, }, }, }, FieldsType: "FieldsV1", FieldsV1: { Raw: "{\"f:status\":{\"f:conditions\":{\".\":{},\"k:{\\\"type\\\":\\\"PodScheduled\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:message\":{},\"f:reason\":{},\"f:status\":{},\"f:type\":{}}}}}", }, Subresource: "status", }, { Manager: "kubelet", Operation: "Update", APIVersion: "v1", Time: { Time: { wall: 0, ext: 63810902309, loc: { name: "Local", zone: [...], tx: [...], extend: "UTC0", cacheStart: 9223372036854775807, cacheEnd: 9223372036854775807, cacheZone: {name: ..., offset: ..., isDST: ...}, }, }, }, FieldsType: "FieldsV1", FieldsV1: { Raw: "{\"f:status\":{\"f:conditions\":{\"k:{\\\"type\\\":\\\"ContainersReady\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:message\":{},\"f:reason\":{},\"f:status\":{},\"f:type\":{}},\"k:{\\\"type\\\":\\\"Initialized\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:status\":{},\"f:type\":{}},\"k:{\\\"type\\\":\\\"Ready\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:message\":{},\"f:reason\":{},\"f:status\":{},\"f:type\":{}}},\"f:containerStatuses\":{},\"f:hostIP\":{},\"f:startTime\":{}}}", }, Subresource: "status", }, ], }, Spec: { Volumes: [ { Name: "my-volume-0", VolumeSource: { HostPath: nil, EmptyDir: nil, GCEPersistentDisk: nil, AWSElasticBlockStore: nil, GitRepo: nil, Secret: nil, NFS: nil, ISCSI: nil, Glusterfs: nil,... Gomega truncated this representation as it exceeds 'format.MaxLength'. Consider having the object provide a custom 'GomegaStringer' representation or adjust the parameters in Gomega's 'format' package. Learn more here: https://onsi.github.io/gomega/#adjusting-output Feb 2 02:53:24.121: FAIL: waiting for pod with inline volume: timed out while waiting for pod ephemeral-2214/inline-volume-tester-vzj57 to be running Full Stack Trace k8s.io/kubernetes/test/e2e/storage/testsuites.EphemeralTest.TestEphemeral({{0x8022ee8, 0xc000cd9d40}, 0xc0018ebc80, {0xc004a38f50, 0xe}, {0x0, 0x0}, 0xc001ed43c0, {{0x0, 0x0}, ...}, ...}, ...) test/e2e/storage/testsuites/ephemeral.go:413 +0x63d k8s.io/kubernetes/test/e2e/storage/testsuites.(*ephemeralTestSuite).DefineTests.func4({0x7f1ff4c2f540, 0xc00499c2c0}) test/e2e/storage/testsuites/ephemeral.go:214 +0x1b4 Feb 2 02:53:24.154: INFO: Error getting logs for pod inline-volume-tester-vzj57: the server rejected our request for an unknown reason (get pods inline-volume-tester-vzj57) Feb 2 02:53:24.215: INFO: Deleting pod "inline-volume-tester-vzj57" in namespace "ephemeral-2214" Feb 2 02:53:24.250: INFO: Wait up to 5m0s for pod "inline-volume-tester-vzj57" to be fully deleted Feb 2 02:53:26.312: INFO: Wait up to 5m0s for pod PV pvc-a80915b0-987c-4735-a86c-e488d8a49a3d to be fully deleted Feb 2 02:53:26.312: INFO: Waiting up to 5m0s for PersistentVolume pvc-a80915b0-987c-4735-a86c-e488d8a49a3d to get deleted Feb 2 02:53:26.343: INFO: PersistentVolume pvc-a80915b0-987c-4735-a86c-e488d8a49a3d found and phase=Released (30.743048ms) Feb 2 02:53:31.375: INFO: PersistentVolume pvc-a80915b0-987c-4735-a86c-e488d8a49a3d found and phase=Released (5.062657758s) Feb 2 02:53:36.406: INFO: PersistentVolume pvc-a80915b0-987c-4735-a86c-e488d8a49a3d found and phase=Released (10.094093349s) Feb 2 02:53:41.437: INFO: PersistentVolume pvc-a80915b0-987c-4735-a86c-e488d8a49a3d was removed �[1mSTEP:�[0m Deleting sc �[38;5;243m02/02/23 02:53:41.437�[0m [AfterEach] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral test/e2e/framework/node/init/init.go:32 Feb 2 02:53:41.471: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral dump namespaces | framework.go:196 �[1mSTEP:�[0m dump namespace information after failure �[38;5;243m02/02/23 02:53:41.503�[0m �[1mSTEP:�[0m Collecting events from namespace "ephemeral-2214". �[38;5;243m02/02/23 02:53:41.503�[0m �[1mSTEP:�[0m Found 21 events. �[38;5;243m02/02/23 02:53:41.534�[0m Feb 2 02:53:41.534: INFO: At 2023-02-02 02:38:21 +0000 UTC - event for inline-volume-x4bv8: {default-scheduler } FailedScheduling: 0/5 nodes are available: waiting for ephemeral volume controller to create the persistentvolumeclaim "inline-volume-x4bv8-my-volume". preemption: 0/5 nodes are available: 5 No preemption victims found for incoming pod.. Feb 2 02:53:41.534: INFO: At 2023-02-02 02:38:21 +0000 UTC - event for inline-volume-x4bv8-my-volume: {persistentvolume-controller } ProvisioningFailed: storageclass.storage.k8s.io "no-such-storage-class" not found Feb 2 02:53:41.534: INFO: At 2023-02-02 02:38:24 +0000 UTC - event for inline-volume-tester-vzj57: {default-scheduler } FailedScheduling: 0/5 nodes are available: waiting for ephemeral volume controller to create the persistentvolumeclaim "inline-volume-tester-vzj57-my-volume-0". preemption: 0/5 nodes are available: 5 No preemption victims found for incoming pod.. Feb 2 02:53:41.534: INFO: At 2023-02-02 02:38:24 +0000 UTC - event for inline-volume-tester-vzj57-my-volume-0: {persistentvolume-controller } WaitForPodScheduled: waiting for pod inline-volume-tester-vzj57 to be scheduled Feb 2 02:53:41.534: INFO: At 2023-02-02 02:38:25 +0000 UTC - event for inline-volume-tester-vzj57-my-volume-0: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "ebs.csi.aws.com" or manually created by system administrator Feb 2 02:53:41.534: INFO: At 2023-02-02 02:38:25 +0000 UTC - event for inline-volume-tester-vzj57-my-volume-0: {ebs.csi.aws.com_i-01b885526491052d5_d47994d4-b7e1-4596-a8c0-cb83c8f567ef } Provisioning: External provisioner is provisioning volume for claim "ephemeral-2214/inline-volume-tester-vzj57-my-volume-0" Feb 2 02:53:41.534: INFO: At 2023-02-02 02:38:28 +0000 UTC - event for inline-volume-tester-vzj57-my-volume-0: {ebs.csi.aws.com_i-01b885526491052d5_d47994d4-b7e1-4596-a8c0-cb83c8f567ef } ProvisioningSucceeded: Successfully provisioned volume pvc-a80915b0-987c-4735-a86c-e488d8a49a3d Feb 2 02:53:41.534: INFO: At 2023-02-02 02:38:29 +0000 UTC - event for inline-volume-tester-vzj57: {default-scheduler } Scheduled: Successfully assigned ephemeral-2214/inline-volume-tester-vzj57 to i-0fe5d857b6eb4dfe3 Feb 2 02:53:41.534: INFO: At 2023-02-02 02:38:31 +0000 UTC - event for inline-volume-tester-vzj57: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-a80915b0-987c-4735-a86c-e488d8a49a3d" Feb 2 02:53:41.534: INFO: At 2023-02-02 02:38:39 +0000 UTC - event for inline-volume-tester-vzj57: {kubelet i-0fe5d857b6eb4dfe3} SuccessfulMountVolume: MapVolume.MapPodDevice succeeded for volume "pvc-a80915b0-987c-4735-a86c-e488d8a49a3d" globalMapPath "/var/lib/kubelet/plugins/kubernetes.io/csi/volumeDevices/pvc-a80915b0-987c-4735-a86c-e488d8a49a3d/dev" Feb 2 02:53:41.534: INFO: At 2023-02-02 02:38:39 +0000 UTC - event for inline-volume-tester-vzj57: {kubelet i-0fe5d857b6eb4dfe3} SuccessfulMountVolume: MapVolume.MapPodDevice succeeded for volume "pvc-a80915b0-987c-4735-a86c-e488d8a49a3d" volumeMapPath "/var/lib/kubelet/pods/82e7259c-610b-4355-9aa9-76632d1a2d7c/volumeDevices/kubernetes.io~csi" Feb 2 02:53:41.534: INFO: At 2023-02-02 02:38:39 +0000 UTC - event for inline-volume-tester-vzj57: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "af73d5b4636e9f6d6d3fb27f9861f59ee83ffa08b24a8c139ccf4ccc7aae28a7": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:53:41.534: INFO: At 2023-02-02 02:38:55 +0000 UTC - event for inline-volume-tester-vzj57: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "304e9433814b1721699c1bf5f973a1fa89ab75794cfc910c240dfa8254080aa6": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:53:41.534: INFO: At 2023-02-02 02:39:06 +0000 UTC - event for inline-volume-tester-vzj57: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "230638535f7b0c67c4ae83cb310b7223a7ab59972efb7b5d418276d56d03f161": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:53:41.534: INFO: At 2023-02-02 02:39:18 +0000 UTC - event for inline-volume-tester-vzj57: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "c2158a7925bbaa4fe92ef0533ae988fe7f8f5088ef1a135213bb286ea0de2af1": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:53:41.534: INFO: At 2023-02-02 02:39:33 +0000 UTC - event for inline-volume-tester-vzj57: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "dfb2d06ae70e57fc18e8a2e083d03817b7e11391eab39490bcfa7eb723cc1626": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:53:41.534: INFO: At 2023-02-02 02:39:45 +0000 UTC - event for inline-volume-tester-vzj57: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "cd30c0df9bd86eea7b19ba89b4eff9a9f726b7dc083a672a733427f737012fb8": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:53:41.534: INFO: At 2023-02-02 02:39:59 +0000 UTC - event for inline-volume-tester-vzj57: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "10aad741566b957671f9d0ed17b2363477c203c6b98bb683ccc44fa1192d9247": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:53:41.534: INFO: At 2023-02-02 02:40:11 +0000 UTC - event for inline-volume-tester-vzj57: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e26b0731939b6da59d890831660602e3ba29b72b00e40955bd5580f180f5dfbd": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:53:41.534: INFO: At 2023-02-02 02:40:27 +0000 UTC - event for inline-volume-tester-vzj57: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "699c31e383d14f0f106badb2d353d9e81a86e9d22d0c1189060ccc386a56f5da": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:53:41.534: INFO: At 2023-02-02 02:40:39 +0000 UTC - event for inline-volume-tester-vzj57: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "40684701066c5394f3d9f33143529c4092d46c3bd4688dae60bd9f9e3002aa1d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:53:41.565: INFO: POD NODE PHASE GRACE CONDITIONS Feb 2 02:53:41.565: INFO: Feb 2 02:53:41.597: INFO: Logging node info for node i-01b885526491052d5 Feb 2 02:53:41.628: INFO: Node Info: &Node{ObjectMeta:{i-01b885526491052d5 dc5fa938-4b08-4e13-a650-8859f804b492 12027 0 2023-02-02 02:32:08 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east-1 failure-domain.beta.kubernetes.io/zone:us-east-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-01b885526491052d5 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:us-east-1a topology.kubernetes.io/region:us-east-1 topology.kubernetes.io/zone:us-east-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.61.65 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-01b885526491052d5"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-02-02 02:32:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-02-02 02:32:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {aws-cloud-controller-manager Update v1 2023-02-02 02:32:44 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-02-02 02:32:44 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-02-02 02:32:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-02-02 02:50:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///us-east-1a/i-01b885526491052d5,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3918811136 0} {<nil>} 3826964Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3813953536 0} {<nil>} 3724564Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-02 02:50:01 +0000 UTC,LastTransitionTime:2023-02-02 02:32:07 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-02 02:50:01 +0000 UTC,LastTransitionTime:2023-02-02 02:32:07 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-02 02:50:01 +0000 UTC,LastTransitionTime:2023-02-02 02:32:07 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-02 02:50:01 +0000 UTC,LastTransitionTime:2023-02-02 02:32:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.61.65,},NodeAddress{Type:ExternalIP,Address:54.205.170.33,},NodeAddress{Type:InternalDNS,Address:i-01b885526491052d5.ec2.internal,},NodeAddress{Type:Hostname,Address:i-01b885526491052d5.ec2.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-205-170-33.compute-1.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec26507379484fef3914c7eb427dc82e,SystemUUID:ec265073-7948-4fef-3914-c7eb427dc82e,BootID:9d8938d3-ec44-44d3-9a12-0dbd68248bf9,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.16,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:5ffb3f7cade4ae1d8c952251abb0c8bdfa8d4d9acb2c364e763328bd6f3d06aa registry.k8s.io/etcdadm/etcd-manager:v3.0.20230201],SizeBytes:243803152,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.1],SizeBytes:135178704,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.1],SizeBytes:124995897,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.1],SizeBytes:57661752,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-beta.2],SizeBytes:43857040,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-beta.2],SizeBytes:42821718,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-beta.2],SizeBytes:4965807,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Feb 2 02:53:41.628: INFO: Logging kubelet events for node i-01b885526491052d5 Feb 2 02:53:41.661: INFO: Logging pods the kubelet thinks is on node i-01b885526491052d5 Feb 2 02:53:41.726: INFO: ebs-csi-controller-89bddb897-hx8fh started at 2023-02-02 02:32:41 +0000 UTC (0+5 container statuses recorded) Feb 2 02:53:41.726: INFO: Container csi-attacher ready: true, restart count 0 Feb 2 02:53:41.726: INFO: Container csi-provisioner ready: true, restart count 0 Feb 2 02:53:41.726: INFO: Container csi-resizer ready: true, restart count 0 Feb 2 02:53:41.726: INFO: Container ebs-plugin ready: true, restart count 0 Feb 2 02:53:41.726: INFO: Container liveness-probe ready: true, restart count 0 Feb 2 02:53:41.726: INFO: cilium-operator-6f8d6c4bf-68pf6 started at 2023-02-02 02:32:41 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:41.726: INFO: Container cilium-operator ready: true, restart count 1 Feb 2 02:53:41.726: INFO: kube-apiserver-i-01b885526491052d5 started at 2023-02-02 02:31:38 +0000 UTC (0+2 container statuses recorded) Feb 2 02:53:41.726: INFO: Container healthcheck ready: true, restart count 0 Feb 2 02:53:41.726: INFO: Container kube-apiserver ready: true, restart count 1 Feb 2 02:53:41.726: INFO: kube-controller-manager-i-01b885526491052d5 started at 2023-02-02 02:31:38 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:41.726: INFO: Container kube-controller-manager ready: true, restart count 2 Feb 2 02:53:41.726: INFO: etcd-manager-events-i-01b885526491052d5 started at 2023-02-02 02:31:38 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:41.726: INFO: Container etcd-manager ready: true, restart count 0 Feb 2 02:53:41.726: INFO: etcd-manager-main-i-01b885526491052d5 started at 2023-02-02 02:31:38 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:41.726: INFO: Container etcd-manager ready: true, restart count 0 Feb 2 02:53:41.726: INFO: cilium-lzw4c started at 2023-02-02 02:32:40 +0000 UTC (1+1 container statuses recorded) Feb 2 02:53:41.726: INFO: Init container clean-cilium-state ready: true, restart count 0 Feb 2 02:53:41.726: INFO: Container cilium-agent ready: true, restart count 1 Feb 2 02:53:41.726: INFO: kube-scheduler-i-01b885526491052d5 started at 2023-02-02 02:31:38 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:41.726: INFO: Container kube-scheduler ready: true, restart count 0 Feb 2 02:53:41.726: INFO: aws-cloud-controller-manager-q9pdm started at 2023-02-02 02:32:40 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:41.726: INFO: Container aws-cloud-controller-manager ready: true, restart count 0 Feb 2 02:53:41.726: INFO: kops-controller-f4d7p started at 2023-02-02 02:32:40 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:41.726: INFO: Container kops-controller ready: true, restart count 0 Feb 2 02:53:41.726: INFO: ebs-csi-node-d97sr started at 2023-02-02 02:32:40 +0000 UTC (0+3 container statuses recorded) Feb 2 02:53:41.726: INFO: Container ebs-plugin ready: true, restart count 0 Feb 2 02:53:41.726: INFO: Container liveness-probe ready: true, restart count 0 Feb 2 02:53:41.726: INFO: Container node-driver-registrar ready: true, restart count 0 Feb 2 02:53:41.726: INFO: dns-controller-74d4646d88-tqtjs started at 2023-02-02 02:32:41 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:41.726: INFO: Container dns-controller ready: true, restart count 0 Feb 2 02:53:41.903: INFO: Latency metrics for node i-01b885526491052d5 Feb 2 02:53:41.903: INFO: Logging node info for node i-094933bbcaafb548f Feb 2 02:53:41.935: INFO: Node Info: &Node{ObjectMeta:{i-094933bbcaafb548f f8a3e392-0d95-41f4-b73c-92cf4fc28ad0 11318 0 2023-02-02 02:33:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east-1 failure-domain.beta.kubernetes.io/zone:us-east-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-094933bbcaafb548f kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-east-1a topology.hostpath.csi/node:i-094933bbcaafb548f topology.kubernetes.io/region:us-east-1 topology.kubernetes.io/zone:us-east-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.57.122 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-8448":"i-094933bbcaafb548f","ebs.csi.aws.com":"i-094933bbcaafb548f"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-02-02 02:38:04 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-02-02 02:49:37 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-02-02 02:49:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///us-east-1a/i-094933bbcaafb548f,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078206976 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973349376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-02 02:49:43 +0000 UTC,LastTransitionTime:2023-02-02 02:33:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-02 02:49:43 +0000 UTC,LastTransitionTime:2023-02-02 02:33:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-02 02:49:43 +0000 UTC,LastTransitionTime:2023-02-02 02:33:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-02 02:49:43 +0000 UTC,LastTransitionTime:2023-02-02 02:33:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.57.122,},NodeAddress{Type:ExternalIP,Address:34.229.175.171,},NodeAddress{Type:InternalDNS,Address:i-094933bbcaafb548f.ec2.internal,},NodeAddress{Type:Hostname,Address:i-094933bbcaafb548f.ec2.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-34-229-175-171.compute-1.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2268a1fc2523b710f39d6e8dcd11f8,SystemUUID:ec2268a1-fc25-23b7-10f3-9d6e8dcd11f8,BootID:a1887cfb-af12-4b59-88c8-e5de9f1d7ef9,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.16,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-8448^3a9ca785-a2a4-11ed-8d79-b6c07b6c44d4],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-8448^3a9ca785-a2a4-11ed-8d79-b6c07b6c44d4,DevicePath:,},},Config:nil,},} Feb 2 02:53:41.935: INFO: Logging kubelet events for node i-094933bbcaafb548f Feb 2 02:53:41.968: INFO: Logging pods the kubelet thinks is on node i-094933bbcaafb548f Feb 2 02:53:42.006: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-842cr started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.006: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:53:42.006: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-mn2cg started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.006: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:53:42.006: INFO: rs-d5xx6 started at 2023-02-02 02:49:52 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.006: INFO: Container donothing ready: false, restart count 0 Feb 2 02:53:42.006: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-4lnlh started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.006: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:53:42.006: INFO: hostexec-i-094933bbcaafb548f-5cbgf started at 2023-02-02 02:50:10 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.006: INFO: Container agnhost-container ready: true, restart count 0 Feb 2 02:53:42.006: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-9vt7q started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.006: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:53:42.006: INFO: pod-8e8f631a-33a8-400c-a36c-a77fc9f16d42 started at 2023-02-02 02:50:13 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.006: INFO: Container write-pod ready: false, restart count 0 Feb 2 02:53:42.006: INFO: cilium-tc4dv started at 2023-02-02 02:33:34 +0000 UTC (1+1 container statuses recorded) Feb 2 02:53:42.006: INFO: Init container clean-cilium-state ready: true, restart count 0 Feb 2 02:53:42.006: INFO: Container cilium-agent ready: true, restart count 0 Feb 2 02:53:42.006: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-d85kv started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.006: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:53:42.006: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-dnh8t started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.007: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:53:42.007: INFO: rs-zdrtm started at 2023-02-02 02:49:51 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.007: INFO: Container donothing ready: false, restart count 0 Feb 2 02:53:42.007: INFO: inline-volume-tester-ttw96 started at 2023-02-02 02:49:36 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.007: INFO: Container csi-volume-tester ready: false, restart count 0 Feb 2 02:53:42.007: INFO: coredns-559769c974-qfr7h started at 2023-02-02 02:34:23 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.007: INFO: Container coredns ready: true, restart count 0 Feb 2 02:53:42.007: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-wpbbn started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.007: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:53:42.007: INFO: csi-hostpathplugin-0 started at 2023-02-02 02:39:16 +0000 UTC (0+7 container statuses recorded) Feb 2 02:53:42.007: INFO: Container csi-attacher ready: true, restart count 0 Feb 2 02:53:42.007: INFO: Container csi-provisioner ready: true, restart count 0 Feb 2 02:53:42.007: INFO: Container csi-resizer ready: true, restart count 0 Feb 2 02:53:42.007: INFO: Container csi-snapshotter ready: true, restart count 0 Feb 2 02:53:42.007: INFO: Container hostpath ready: true, restart count 0 Feb 2 02:53:42.007: INFO: Container liveness-probe ready: true, restart count 0 Feb 2 02:53:42.007: INFO: Container node-driver-registrar ready: true, restart count 0 Feb 2 02:53:42.007: INFO: ebs-csi-node-vgbm6 started at 2023-02-02 02:33:34 +0000 UTC (0+3 container statuses recorded) Feb 2 02:53:42.007: INFO: Container ebs-plugin ready: true, restart count 0 Feb 2 02:53:42.007: INFO: Container liveness-probe ready: true, restart count 0 Feb 2 02:53:42.007: INFO: Container node-driver-registrar ready: true, restart count 0 Feb 2 02:53:42.007: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-8jnbj started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.007: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:53:42.007: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-hvbsc started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.007: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:53:42.007: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-nwdp9 started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.007: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:53:42.007: INFO: csi-hostpathplugin-0 started at 2023-02-02 02:50:06 +0000 UTC (0+7 container statuses recorded) Feb 2 02:53:42.007: INFO: Container csi-attacher ready: false, restart count 0 Feb 2 02:53:42.007: INFO: Container csi-provisioner ready: false, restart count 0 Feb 2 02:53:42.007: INFO: Container csi-resizer ready: false, restart count 0 Feb 2 02:53:42.007: INFO: Container csi-snapshotter ready: false, restart count 0 Feb 2 02:53:42.007: INFO: Container hostpath ready: false, restart count 0 Feb 2 02:53:42.007: INFO: Container liveness-probe ready: false, restart count 0 Feb 2 02:53:42.007: INFO: Container node-driver-registrar ready: false, restart count 0 Feb 2 02:53:42.189: INFO: Latency metrics for node i-094933bbcaafb548f Feb 2 02:53:42.189: INFO: Logging node info for node i-0edda5f045be0496e Feb 2 02:53:42.220: INFO: Node Info: &Node{ObjectMeta:{i-0edda5f045be0496e 4587fb05-429b-429c-8408-c6c4e9c69a39 13419 0 2023-02-02 02:33:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east-1 failure-domain.beta.kubernetes.io/zone:us-east-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0edda5f045be0496e kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-east-1a topology.hostpath.csi/node:i-0edda5f045be0496e topology.kubernetes.io/region:us-east-1 topology.kubernetes.io/zone:us-east-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.36.32 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0edda5f045be0496e"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-02-02 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-02-02 02:33:35 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-02-02 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-02-02 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-02-02 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-02-02 02:38:05 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-02-02 02:52:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///us-east-1a/i-0edda5f045be0496e,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078206976 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973349376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-02 02:52:38 +0000 UTC,LastTransitionTime:2023-02-02 02:33:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-02 02:52:38 +0000 UTC,LastTransitionTime:2023-02-02 02:33:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-02 02:52:38 +0000 UTC,LastTransitionTime:2023-02-02 02:33:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-02 02:52:38 +0000 UTC,LastTransitionTime:2023-02-02 02:33:46 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.36.32,},NodeAddress{Type:ExternalIP,Address:107.20.131.91,},NodeAddress{Type:InternalDNS,Address:i-0edda5f045be0496e.ec2.internal,},NodeAddress{Type:Hostname,Address:i-0edda5f045be0496e.ec2.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-107-20-131-91.compute-1.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2d6d99d20e1d252ee83a35d89804ad,SystemUUID:ec2d6d99-d20e-1d25-2ee8-3a35d89804ad,BootID:d1722e01-5561-4510-a9ae-eb13b4bd9a0f,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.16,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Feb 2 02:53:42.221: INFO: Logging kubelet events for node i-0edda5f045be0496e Feb 2 02:53:42.254: INFO: Logging pods the kubelet thinks is on node i-0edda5f045be0496e Feb 2 02:53:42.295: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-2wdkr started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.295: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:53:42.295: INFO: hostexec-i-0edda5f045be0496e-rfdgl started at 2023-02-02 02:51:02 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.295: INFO: Container agnhost-container ready: true, restart count 0 Feb 2 02:53:42.295: INFO: rs-rk22n started at 2023-02-02 02:49:51 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.295: INFO: Container donothing ready: false, restart count 0 Feb 2 02:53:42.295: INFO: rs-k2vs7 started at 2023-02-02 02:49:52 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.295: INFO: Container donothing ready: false, restart count 0 Feb 2 02:53:42.295: INFO: privileged-pod started at 2023-02-02 02:50:11 +0000 UTC (0+2 container statuses recorded) Feb 2 02:53:42.295: INFO: Container not-privileged-container ready: false, restart count 0 Feb 2 02:53:42.295: INFO: Container privileged-container ready: false, restart count 0 Feb 2 02:53:42.295: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-9sqms started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.295: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:53:42.295: INFO: pod-ready started at 2023-02-02 02:53:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.295: INFO: Container pod-readiness-gate ready: false, restart count 0 Feb 2 02:53:42.295: INFO: pod-9074a42a-1cc9-466f-8fa8-bced410c2c8f started at 2023-02-02 02:51:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.295: INFO: Container write-pod ready: false, restart count 0 Feb 2 02:53:42.295: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-8hlcn started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.295: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:53:42.295: INFO: pod1 started at 2023-02-02 02:48:53 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.295: INFO: Container agnhost-container ready: true, restart count 0 Feb 2 02:53:42.295: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-f67st started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.295: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:53:42.295: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-bc995 started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.295: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:53:42.295: INFO: cilium-q9c8c started at 2023-02-02 02:33:36 +0000 UTC (1+1 container statuses recorded) Feb 2 02:53:42.295: INFO: Init container clean-cilium-state ready: true, restart count 0 Feb 2 02:53:42.295: INFO: Container cilium-agent ready: true, restart count 0 Feb 2 02:53:42.295: INFO: csi-mockplugin-attacher-0 started at 2023-02-02 02:51:43 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.295: INFO: Container csi-attacher ready: false, restart count 0 Feb 2 02:53:42.295: INFO: rs-glj89 started at 2023-02-02 02:49:55 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.295: INFO: Container donothing ready: false, restart count 0 Feb 2 02:53:42.295: INFO: pod-projected-configmaps-02f3e32a-f624-4925-95ba-753d29824b49 started at 2023-02-02 02:52:23 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.295: INFO: Container agnhost-container ready: false, restart count 0 Feb 2 02:53:42.295: INFO: security-context-26d9d60c-8c31-4e0d-9488-ce019848329d started at 2023-02-02 02:49:26 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.295: INFO: Container test-container ready: false, restart count 0 Feb 2 02:53:42.295: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-jstkj started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.295: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: false, restart count 0 Feb 2 02:53:42.295: INFO: pfpod started at 2023-02-02 02:48:47 +0000 UTC (0+2 container statuses recorded) Feb 2 02:53:42.295: INFO: Container portforwardtester ready: false, restart count 0 Feb 2 02:53:42.295: INFO: Container readiness ready: false, restart count 0 Feb 2 02:53:42.295: INFO: rs-d42qg started at 2023-02-02 02:49:52 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.295: INFO: Container donothing ready: true, restart count 0 Feb 2 02:53:42.295: INFO: csi-mockplugin-0 started at 2023-02-02 02:51:43 +0000 UTC (0+3 container statuses recorded) Feb 2 02:53:42.295: INFO: Container csi-provisioner ready: false, restart count 0 Feb 2 02:53:42.295: INFO: Container driver-registrar ready: false, restart count 0 Feb 2 02:53:42.295: INFO: Container mock ready: false, restart count 0 Feb 2 02:53:42.295: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-mkbdp started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.295: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:53:42.295: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-pn6d4 started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.295: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:53:42.295: INFO: execpodhrd2g started at 2023-02-02 02:49:38 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.295: INFO: Container agnhost-container ready: true, restart count 0 Feb 2 02:53:42.295: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-l8l4k started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.295: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:53:42.295: INFO: csi-hostpathplugin-0 started at 2023-02-02 02:46:21 +0000 UTC (0+7 container statuses recorded) Feb 2 02:53:42.295: INFO: Container csi-attacher ready: false, restart count 0 Feb 2 02:53:42.295: INFO: Container csi-provisioner ready: false, restart count 0 Feb 2 02:53:42.295: INFO: Container csi-resizer ready: false, restart count 0 Feb 2 02:53:42.295: INFO: Container csi-snapshotter ready: false, restart count 0 Feb 2 02:53:42.295: INFO: Container hostpath ready: false, restart count 0 Feb 2 02:53:42.295: INFO: Container liveness-probe ready: false, restart count 0 Feb 2 02:53:42.295: INFO: Container node-driver-registrar ready: false, restart count 0 Feb 2 02:53:42.295: INFO: pod-secrets-2af698c1-7e7f-42cb-92b4-983c767e4fb3 started at 2023-02-02 02:49:44 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.295: INFO: Container secret-test ready: false, restart count 0 Feb 2 02:53:42.295: INFO: ebs-csi-node-kbmng started at 2023-02-02 02:33:36 +0000 UTC (0+3 container statuses recorded) Feb 2 02:53:42.295: INFO: Container ebs-plugin ready: true, restart count 0 Feb 2 02:53:42.295: INFO: Container liveness-probe ready: true, restart count 0 Feb 2 02:53:42.295: INFO: Container node-driver-registrar ready: true, restart count 0 Feb 2 02:53:42.295: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-hfvsn started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.295: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:53:42.463: INFO: Latency metrics for node i-0edda5f045be0496e Feb 2 02:53:42.463: INFO: Logging node info for node i-0f7e2e4905cb6dadc Feb 2 02:53:42.494: INFO: Node Info: &Node{ObjectMeta:{i-0f7e2e4905cb6dadc 2adbbc9a-dd76-4b97-8d3e-a2bd14f0c57d 10413 0 2023-02-02 02:33:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east-1 failure-domain.beta.kubernetes.io/zone:us-east-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0f7e2e4905cb6dadc kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-east-1a topology.hostpath.csi/node:i-0f7e2e4905cb6dadc topology.kubernetes.io/region:us-east-1 topology.kubernetes.io/zone:us-east-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.40.134 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-3250":"i-0f7e2e4905cb6dadc","ebs.csi.aws.com":"i-0f7e2e4905cb6dadc"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-02-02 02:33:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {e2e.test Update v1 2023-02-02 02:38:05 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-02-02 02:49:03 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-02-02 02:49:11 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///us-east-1a/i-0f7e2e4905cb6dadc,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-02 02:49:11 +0000 UTC,LastTransitionTime:2023-02-02 02:33:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-02 02:49:11 +0000 UTC,LastTransitionTime:2023-02-02 02:33:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-02 02:49:11 +0000 UTC,LastTransitionTime:2023-02-02 02:33:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-02 02:49:11 +0000 UTC,LastTransitionTime:2023-02-02 02:33:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.40.134,},NodeAddress{Type:ExternalIP,Address:18.215.155.89,},NodeAddress{Type:InternalDNS,Address:i-0f7e2e4905cb6dadc.ec2.internal,},NodeAddress{Type:Hostname,Address:i-0f7e2e4905cb6dadc.ec2.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-215-155-89.compute-1.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2d895bde004236c844d2f199d4cb6e,SystemUUID:ec2d895b-de00-4236-c844-d2f199d4cb6e,BootID:e4805eb2-7c0d-48b7-a584-7f3b4b363884,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.16,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-3250^26b12128-a2a4-11ed-bb72-0efe19e96a51],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-3250^26b12128-a2a4-11ed-bb72-0efe19e96a51,DevicePath:,},},Config:nil,},} Feb 2 02:53:42.495: INFO: Logging kubelet events for node i-0f7e2e4905cb6dadc Feb 2 02:53:42.528: INFO: Logging pods the kubelet thinks is on node i-0f7e2e4905cb6dadc Feb 2 02:53:42.565: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-7wgzt started at 2023-02-02 02:38:06 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.565: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:53:42.565: INFO: rs-kn8tl started at 2023-02-02 02:49:52 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.565: INFO: Container donothing ready: false, restart count 0 Feb 2 02:53:42.565: INFO: coredns-autoscaler-7cb5c5b969-5nncn started at 2023-02-02 02:33:44 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.565: INFO: Container autoscaler ready: true, restart count 0 Feb 2 02:53:42.565: INFO: rs-tq4jh started at 2023-02-02 02:49:51 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.565: INFO: Container donothing ready: false, restart count 0 Feb 2 02:53:42.565: INFO: ebs-csi-node-mkxjx started at 2023-02-02 02:33:34 +0000 UTC (0+3 container statuses recorded) Feb 2 02:53:42.565: INFO: Container ebs-plugin ready: true, restart count 0 Feb 2 02:53:42.565: INFO: Container liveness-probe ready: true, restart count 0 Feb 2 02:53:42.565: INFO: Container node-driver-registrar ready: true, restart count 0 Feb 2 02:53:42.565: INFO: coredns-559769c974-s54lm started at 2023-02-02 02:33:44 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.565: INFO: Container coredns ready: true, restart count 0 Feb 2 02:53:42.565: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-rnf4c started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.565: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:53:42.565: INFO: cilium-k54gx started at 2023-02-02 02:33:34 +0000 UTC (1+1 container statuses recorded) Feb 2 02:53:42.565: INFO: Init container clean-cilium-state ready: true, restart count 0 Feb 2 02:53:42.565: INFO: Container cilium-agent ready: true, restart count 0 Feb 2 02:53:42.565: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-pgnjx started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.565: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:53:42.565: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-s6mxr started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.565: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:53:42.565: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-vtdsx started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.565: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:53:42.565: INFO: rs-bb6k5 started at 2023-02-02 02:49:55 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.565: INFO: Container donothing ready: false, restart count 0 Feb 2 02:53:42.565: INFO: pod-subpath-test-dynamicpv-4qbr started at 2023-02-02 02:49:02 +0000 UTC (1+1 container statuses recorded) Feb 2 02:53:42.565: INFO: Init container init-volume-dynamicpv-4qbr ready: false, restart count 0 Feb 2 02:53:42.565: INFO: Container test-container-subpath-dynamicpv-4qbr ready: false, restart count 0 Feb 2 02:53:42.565: INFO: csi-hostpathplugin-0 started at 2023-02-02 02:46:42 +0000 UTC (0+7 container statuses recorded) Feb 2 02:53:42.565: INFO: Container csi-attacher ready: true, restart count 0 Feb 2 02:53:42.565: INFO: Container csi-provisioner ready: true, restart count 0 Feb 2 02:53:42.565: INFO: Container csi-resizer ready: true, restart count 0 Feb 2 02:53:42.565: INFO: Container csi-snapshotter ready: true, restart count 0 Feb 2 02:53:42.565: INFO: Container hostpath ready: true, restart count 0 Feb 2 02:53:42.565: INFO: Container liveness-probe ready: true, restart count 0 Feb 2 02:53:42.565: INFO: Container node-driver-registrar ready: true, restart count 0 Feb 2 02:53:42.565: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-h65xw started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.565: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:53:42.565: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-pwvqk started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.565: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:53:42.565: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-mphjv started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.565: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:53:42.565: INFO: pod-client started at 2023-02-02 02:49:11 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.565: INFO: Container pod-client ready: false, restart count 0 Feb 2 02:53:42.565: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-xzv2d started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.565: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:53:42.565: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-m7nw9 started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.565: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: false, restart count 0 Feb 2 02:53:42.742: INFO: Latency metrics for node i-0f7e2e4905cb6dadc Feb 2 02:53:42.742: INFO: Logging node info for node i-0fe5d857b6eb4dfe3 Feb 2 02:53:42.773: INFO: Node Info: &Node{ObjectMeta:{i-0fe5d857b6eb4dfe3 9d0f7cfc-7470-4601-b0c7-c2b476a9fab7 13618 0 2023-02-02 02:33:43 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east-1 failure-domain.beta.kubernetes.io/zone:us-east-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0fe5d857b6eb4dfe3 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-east-1a topology.hostpath.csi/node:i-0fe5d857b6eb4dfe3 topology.kubernetes.io/region:us-east-1 topology.kubernetes.io/zone:us-east-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.53.228 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0fe5d857b6eb4dfe3"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-02-02 02:33:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-02-02 02:33:43 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-02-02 02:33:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-02-02 02:33:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-02-02 02:33:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-02-02 02:38:05 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-02-02 02:53:26 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-02-02 02:53:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///us-east-1a/i-0fe5d857b6eb4dfe3,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078206976 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973349376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-02 02:53:26 +0000 UTC,LastTransitionTime:2023-02-02 02:33:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-02 02:53:26 +0000 UTC,LastTransitionTime:2023-02-02 02:33:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-02 02:53:26 +0000 UTC,LastTransitionTime:2023-02-02 02:33:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-02 02:53:26 +0000 UTC,LastTransitionTime:2023-02-02 02:33:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.53.228,},NodeAddress{Type:ExternalIP,Address:18.212.239.71,},NodeAddress{Type:InternalDNS,Address:i-0fe5d857b6eb4dfe3.ec2.internal,},NodeAddress{Type:Hostname,Address:i-0fe5d857b6eb4dfe3.ec2.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-212-239-71.compute-1.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23a338ffd343d89814911cd0d0d8ea,SystemUUID:ec23a338-ffd3-43d8-9814-911cd0d0d8ea,BootID:588a11ea-21bc-44af-808b-852f5f90dd84,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.16,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-060f9a1af1005c0f9],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-060f9a1af1005c0f9,DevicePath:,},},Config:nil,},} Feb 2 02:53:42.773: INFO: Logging kubelet events for node i-0fe5d857b6eb4dfe3 Feb 2 02:53:42.806: INFO: Logging pods the kubelet thinks is on node i-0fe5d857b6eb4dfe3 Feb 2 02:53:42.845: INFO: pod-configmaps-f596c9e4-0702-4bac-bb8d-e766ca7cefb2 started at 2023-02-02 02:49:46 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.845: INFO: Container agnhost-container ready: false, restart count 0 Feb 2 02:53:42.845: INFO: rs-vl4zj started at 2023-02-02 02:49:51 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.845: INFO: Container donothing ready: true, restart count 0 Feb 2 02:53:42.845: INFO: test-pod started at 2023-02-02 02:50:21 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.845: INFO: Container webserver ready: false, restart count 0 Feb 2 02:53:42.845: INFO: ss-0 started at 2023-02-02 02:51:06 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.845: INFO: Container webserver ready: false, restart count 0 Feb 2 02:53:42.845: INFO: cilium-gffsv started at 2023-02-02 02:33:43 +0000 UTC (1+1 container statuses recorded) Feb 2 02:53:42.845: INFO: Init container clean-cilium-state ready: true, restart count 0 Feb 2 02:53:42.845: INFO: Container cilium-agent ready: true, restart count 0 Feb 2 02:53:42.845: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-sb6sx started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.845: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:53:42.845: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-n4rbc started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.845: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:53:42.845: INFO: rs-42smn started at 2023-02-02 02:49:52 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.845: INFO: Container donothing ready: false, restart count 0 Feb 2 02:53:42.845: INFO: pod2 started at 2023-02-02 02:49:56 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.845: INFO: Container agnhost-container ready: false, restart count 0 Feb 2 02:53:42.845: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-snv7k started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.845: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:53:42.845: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-dz5bh started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.845: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:53:42.845: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-dss8d started at 2023-02-02 02:38:06 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.845: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:53:42.845: INFO: ebs-csi-node-qqz2d started at 2023-02-02 02:33:43 +0000 UTC (0+3 container statuses recorded) Feb 2 02:53:42.845: INFO: Container ebs-plugin ready: true, restart count 0 Feb 2 02:53:42.845: INFO: Container liveness-probe ready: true, restart count 0 Feb 2 02:53:42.845: INFO: Container node-driver-registrar ready: true, restart count 0 Feb 2 02:53:42.845: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-965cw started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.845: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:53:42.845: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-7j88c started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.845: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:53:42.845: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-2psrz started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.845: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:53:42.845: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-7xd6t started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.845: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:53:42.845: INFO: pod-projected-configmaps-c7fde8d3-2d87-44f0-a97d-2cae453e883c started at 2023-02-02 02:49:47 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.845: INFO: Container projected-configmap-volume-test ready: false, restart count 0 Feb 2 02:53:42.845: INFO: pod-secrets-1de64bc4-346c-4af0-b4b8-3969dfc74207 started at 2023-02-02 02:51:49 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.845: INFO: Container secret-volume-test ready: false, restart count 0 Feb 2 02:53:42.845: INFO: pod-subpath-test-configmap-sr27 started at 2023-02-02 02:49:44 +0000 UTC (1+2 container statuses recorded) Feb 2 02:53:42.845: INFO: Init container init-volume-configmap-sr27 ready: false, restart count 0 Feb 2 02:53:42.845: INFO: Container test-container-subpath-configmap-sr27 ready: false, restart count 0 Feb 2 02:53:42.845: INFO: Container test-container-volume-configmap-sr27 ready: false, restart count 0 Feb 2 02:53:42.845: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-j9kxn started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.845: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:53:42.845: INFO: rs-pwffb started at 2023-02-02 02:49:52 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.845: INFO: Container donothing ready: true, restart count 0 Feb 2 02:53:42.845: INFO: rs-ncbsn started at 2023-02-02 02:49:55 +0000 UTC (0+1 container statuses recorded) Feb 2 02:53:42.845: INFO: Container donothing ready: false, restart count 0 Feb 2 02:53:42.982: INFO: Latency metrics for node i-0fe5d857b6eb4dfe3 [DeferCleanup (Each)] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral tear down framework | framework.go:193 �[1mSTEP:�[0m Destroying namespace "ephemeral-2214" for this suite. �[38;5;243m02/02/23 02:53:42.982�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sAggregator\sShould\sbe\sable\sto\ssupport\sthe\s1\.17\sSample\sAPI\sServer\susing\sthe\scurrent\sAggregator\s\[Conformance\]$'
test/e2e/apimachinery/aggregator.go:333 k8s.io/kubernetes/test/e2e/apimachinery.TestSampleAPIServer(0xc000a845a0, 0xc000f17d40, {0xc0032c7800, 0x37}) test/e2e/apimachinery/aggregator.go:333 +0x2c05 k8s.io/kubernetes/test/e2e/apimachinery.glob..func1.3() test/e2e/apimachinery/aggregator.go:102 +0x125from junit_01.xml
[BeforeEach] [sig-api-machinery] Aggregator set up framework | framework.go:178 �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m02/02/23 02:45:07.321�[0m Feb 2 02:45:07.322: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP:�[0m Building a namespace api object, basename aggregator �[38;5;243m02/02/23 02:45:07.323�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m02/02/23 02:45:07.418�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m02/02/23 02:45:07.478�[0m [BeforeEach] [sig-api-machinery] Aggregator test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-api-machinery] Aggregator test/e2e/apimachinery/aggregator.go:78 Feb 2 02:45:07.539: INFO: >>> kubeConfig: /root/.kube/config [It] Should be able to support the 1.17 Sample API Server using the current Aggregator [Conformance] test/e2e/apimachinery/aggregator.go:100 �[1mSTEP:�[0m Registering the sample API server. �[38;5;243m02/02/23 02:45:07.54�[0m Feb 2 02:45:08.332: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:45:10.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:45:12.367: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:45:14.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:45:16.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:45:18.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:45:20.366: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:45:22.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:45:24.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:45:26.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:45:28.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:45:30.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:45:32.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:45:34.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:45:36.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:45:38.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:45:40.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:45:42.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:45:44.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:45:46.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:45:48.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:45:50.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:45:52.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:45:54.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:45:56.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:45:58.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:46:00.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:46:02.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:46:04.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:46:06.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:46:08.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:46:10.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:46:12.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:46:14.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:46:16.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:46:18.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:46:20.363: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:46:22.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:46:24.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:46:26.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:46:28.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:46:30.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:46:32.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:46:34.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:46:36.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:46:38.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:46:40.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:46:42.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:46:44.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:46:46.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:46:48.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:46:50.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:46:52.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:46:54.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:46:56.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:46:58.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:47:00.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:47:02.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:47:04.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:47:06.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:47:08.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:47:10.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:47:12.372: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:47:14.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:47:16.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:47:18.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:47:20.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:47:22.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:47:24.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:47:26.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:47:28.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:47:30.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:47:32.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:47:34.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:47:36.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:47:38.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:47:40.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:47:42.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:47:44.366: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:47:46.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:47:48.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:47:50.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:47:52.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:47:54.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:47:56.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:47:58.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:48:00.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:48:02.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:48:04.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:48:06.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:48:08.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:48:10.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:48:12.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:48:14.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:48:16.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:48:18.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:48:20.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:48:22.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:48:24.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:48:26.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:48:28.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:48:30.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:48:32.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:48:34.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:48:36.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:48:38.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:48:40.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:48:42.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:48:44.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:48:46.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:48:48.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:48:50.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:48:52.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:48:54.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:48:56.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:48:58.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:49:00.363: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:49:02.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:49:04.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:49:06.367: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:49:08.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:49:10.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:49:12.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:49:14.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:49:16.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:49:18.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:49:20.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:49:22.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:49:24.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:49:26.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:49:28.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:49:30.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:49:32.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:49:34.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:49:36.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:49:38.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:49:40.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:49:42.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:49:44.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:49:46.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:49:48.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:49:50.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:49:52.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:49:54.365: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:49:56.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:49:58.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:50:00.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:50:02.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:50:04.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:50:06.366: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:50:08.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:50:08.396: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Feb 2 02:50:08.396: INFO: Unexpected error: deploying extension apiserver in namespace aggregator-6516: <*errors.errorString | 0xc0010862b0>: { s: "error waiting for deployment \"sample-apiserver-deployment\" status to match expectation: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:\"Available\", Status:\"False\", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:\"MinimumReplicasUnavailable\", Message:\"Deployment does not have minimum availability.\"}, v1.DeploymentCondition{Type:\"Progressing\", Status:\"True\", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:\"ReplicaSetUpdated\", Message:\"ReplicaSet \\\"sample-apiserver-deployment-55bd96fd47\\\" is progressing.\"}}, CollisionCount:(*int32)(nil)}", } Feb 2 02:50:08.396: FAIL: deploying extension apiserver in namespace aggregator-6516: error waiting for deployment "sample-apiserver-deployment" status to match expectation: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.February, 2, 2, 45, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Full Stack Trace k8s.io/kubernetes/test/e2e/apimachinery.TestSampleAPIServer(0xc000a845a0, 0xc000f17d40, {0xc0032c7800, 0x37}) test/e2e/apimachinery/aggregator.go:333 +0x2c05 k8s.io/kubernetes/test/e2e/apimachinery.glob..func1.3() test/e2e/apimachinery/aggregator.go:102 +0x125 [AfterEach] [sig-api-machinery] Aggregator test/e2e/apimachinery/aggregator.go:68 [AfterEach] [sig-api-machinery] Aggregator test/e2e/framework/node/init/init.go:32 Feb 2 02:50:08.697: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-api-machinery] Aggregator test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-api-machinery] Aggregator dump namespaces | framework.go:196 �[1mSTEP:�[0m dump namespace information after failure �[38;5;243m02/02/23 02:50:08.73�[0m �[1mSTEP:�[0m Collecting events from namespace "aggregator-6516". �[38;5;243m02/02/23 02:50:08.73�[0m �[1mSTEP:�[0m Found 13 events. �[38;5;243m02/02/23 02:50:08.761�[0m Feb 2 02:50:08.761: INFO: At 2023-02-02 02:45:08 +0000 UTC - event for sample-apiserver-deployment: {deployment-controller } ScalingReplicaSet: Scaled up replica set sample-apiserver-deployment-55bd96fd47 to 1 Feb 2 02:50:08.761: INFO: At 2023-02-02 02:45:08 +0000 UTC - event for sample-apiserver-deployment-55bd96fd47: {replicaset-controller } SuccessfulCreate: Created pod: sample-apiserver-deployment-55bd96fd47-kjdct Feb 2 02:50:08.761: INFO: At 2023-02-02 02:45:08 +0000 UTC - event for sample-apiserver-deployment-55bd96fd47-kjdct: {kubelet i-0edda5f045be0496e} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "12fc5e3e30d42e9a96aa826017730e168bad3163238bd82a35f4b75650590ddd": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:50:08.761: INFO: At 2023-02-02 02:45:08 +0000 UTC - event for sample-apiserver-deployment-55bd96fd47-kjdct: {default-scheduler } Scheduled: Successfully assigned aggregator-6516/sample-apiserver-deployment-55bd96fd47-kjdct to i-0edda5f045be0496e Feb 2 02:50:08.761: INFO: At 2023-02-02 02:45:19 +0000 UTC - event for sample-apiserver-deployment-55bd96fd47-kjdct: {kubelet i-0edda5f045be0496e} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "fd656642ce1a53947413dfc515dcc482eb646303efb1481e7698943f1c2a13ce": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:50:08.761: INFO: At 2023-02-02 02:45:32 +0000 UTC - event for sample-apiserver-deployment-55bd96fd47-kjdct: {kubelet i-0edda5f045be0496e} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "3f6cd5a6cc29d0437b25fb1927a2d4c25dd678b0335e7151641084670abda24e": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:50:08.761: INFO: At 2023-02-02 02:45:44 +0000 UTC - event for sample-apiserver-deployment-55bd96fd47-kjdct: {kubelet i-0edda5f045be0496e} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e8ec930faf1b1d930964fa3a7cf9aac25460125b776f0f4e4b58f812162a1e78": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:50:08.761: INFO: At 2023-02-02 02:45:59 +0000 UTC - event for sample-apiserver-deployment-55bd96fd47-kjdct: {kubelet i-0edda5f045be0496e} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "6b452a038a2fccb0c7e9c3588ccd969794f95d009338b8f715c825015205d3ad": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:50:08.761: INFO: At 2023-02-02 02:46:10 +0000 UTC - event for sample-apiserver-deployment-55bd96fd47-kjdct: {kubelet i-0edda5f045be0496e} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "3842ed2d5e95e7bac1f78a2ed58e080cd616241176e262dfa31b3b0d9d1dae97": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:50:08.761: INFO: At 2023-02-02 02:46:24 +0000 UTC - event for sample-apiserver-deployment-55bd96fd47-kjdct: {kubelet i-0edda5f045be0496e} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "cbf3ebd0060611e0fb35c48adf63482a566493802da42a7c28e8395289b0dceb": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:50:08.761: INFO: At 2023-02-02 02:46:36 +0000 UTC - event for sample-apiserver-deployment-55bd96fd47-kjdct: {kubelet i-0edda5f045be0496e} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "db282a577b1523395c47460e749758d1e82a95c8f34f1feff155ce5ff35b1c9f": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:50:08.761: INFO: At 2023-02-02 02:46:49 +0000 UTC - event for sample-apiserver-deployment-55bd96fd47-kjdct: {kubelet i-0edda5f045be0496e} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ac85c1fc24a8492a1c2720d7f78cad9658beac259646d5f5ec271c2ab3a97f76": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:50:08.761: INFO: At 2023-02-02 02:47:00 +0000 UTC - event for sample-apiserver-deployment-55bd96fd47-kjdct: {kubelet i-0edda5f045be0496e} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "547c7aef61db88d4a34f006d805db23b87176bbec34c3975ccda2fafb0e7c5cf": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:50:08.792: INFO: POD NODE PHASE GRACE CONDITIONS Feb 2 02:50:08.792: INFO: Feb 2 02:50:08.824: INFO: Logging node info for node i-01b885526491052d5 Feb 2 02:50:08.856: INFO: Node Info: &Node{ObjectMeta:{i-01b885526491052d5 dc5fa938-4b08-4e13-a650-8859f804b492 12027 0 2023-02-02 02:32:08 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east-1 failure-domain.beta.kubernetes.io/zone:us-east-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-01b885526491052d5 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:us-east-1a topology.kubernetes.io/region:us-east-1 topology.kubernetes.io/zone:us-east-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.61.65 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-01b885526491052d5"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-02-02 02:32:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-02-02 02:32:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {aws-cloud-controller-manager Update v1 2023-02-02 02:32:44 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-02-02 02:32:44 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-02-02 02:32:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-02-02 02:50:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///us-east-1a/i-01b885526491052d5,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3918811136 0} {<nil>} 3826964Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3813953536 0} {<nil>} 3724564Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-02 02:50:01 +0000 UTC,LastTransitionTime:2023-02-02 02:32:07 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-02 02:50:01 +0000 UTC,LastTransitionTime:2023-02-02 02:32:07 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-02 02:50:01 +0000 UTC,LastTransitionTime:2023-02-02 02:32:07 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-02 02:50:01 +0000 UTC,LastTransitionTime:2023-02-02 02:32:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.61.65,},NodeAddress{Type:ExternalIP,Address:54.205.170.33,},NodeAddress{Type:InternalDNS,Address:i-01b885526491052d5.ec2.internal,},NodeAddress{Type:Hostname,Address:i-01b885526491052d5.ec2.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-205-170-33.compute-1.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec26507379484fef3914c7eb427dc82e,SystemUUID:ec265073-7948-4fef-3914-c7eb427dc82e,BootID:9d8938d3-ec44-44d3-9a12-0dbd68248bf9,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.16,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:5ffb3f7cade4ae1d8c952251abb0c8bdfa8d4d9acb2c364e763328bd6f3d06aa registry.k8s.io/etcdadm/etcd-manager:v3.0.20230201],SizeBytes:243803152,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.1],SizeBytes:135178704,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.1],SizeBytes:124995897,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.1],SizeBytes:57661752,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-beta.2],SizeBytes:43857040,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-beta.2],SizeBytes:42821718,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-beta.2],SizeBytes:4965807,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Feb 2 02:50:08.856: INFO: Logging kubelet events for node i-01b885526491052d5 Feb 2 02:50:08.890: INFO: Logging pods the kubelet thinks is on node i-01b885526491052d5 Feb 2 02:50:08.956: INFO: cilium-operator-6f8d6c4bf-68pf6 started at 2023-02-02 02:32:41 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:08.956: INFO: Container cilium-operator ready: true, restart count 1 Feb 2 02:50:08.956: INFO: kube-apiserver-i-01b885526491052d5 started at 2023-02-02 02:31:38 +0000 UTC (0+2 container statuses recorded) Feb 2 02:50:08.956: INFO: Container healthcheck ready: true, restart count 0 Feb 2 02:50:08.956: INFO: Container kube-apiserver ready: true, restart count 1 Feb 2 02:50:08.956: INFO: kube-controller-manager-i-01b885526491052d5 started at 2023-02-02 02:31:38 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:08.956: INFO: Container kube-controller-manager ready: true, restart count 2 Feb 2 02:50:08.956: INFO: etcd-manager-events-i-01b885526491052d5 started at 2023-02-02 02:31:38 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:08.956: INFO: Container etcd-manager ready: true, restart count 0 Feb 2 02:50:08.956: INFO: etcd-manager-main-i-01b885526491052d5 started at 2023-02-02 02:31:38 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:08.956: INFO: Container etcd-manager ready: true, restart count 0 Feb 2 02:50:08.956: INFO: cilium-lzw4c started at 2023-02-02 02:32:40 +0000 UTC (1+1 container statuses recorded) Feb 2 02:50:08.956: INFO: Init container clean-cilium-state ready: true, restart count 0 Feb 2 02:50:08.956: INFO: Container cilium-agent ready: true, restart count 1 Feb 2 02:50:08.956: INFO: ebs-csi-controller-89bddb897-hx8fh started at 2023-02-02 02:32:41 +0000 UTC (0+5 container statuses recorded) Feb 2 02:50:08.956: INFO: Container csi-attacher ready: true, restart count 0 Feb 2 02:50:08.956: INFO: Container csi-provisioner ready: true, restart count 0 Feb 2 02:50:08.956: INFO: Container csi-resizer ready: true, restart count 0 Feb 2 02:50:08.956: INFO: Container ebs-plugin ready: true, restart count 0 Feb 2 02:50:08.956: INFO: Container liveness-probe ready: true, restart count 0 Feb 2 02:50:08.956: INFO: kube-scheduler-i-01b885526491052d5 started at 2023-02-02 02:31:38 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:08.956: INFO: Container kube-scheduler ready: true, restart count 0 Feb 2 02:50:08.956: INFO: aws-cloud-controller-manager-q9pdm started at 2023-02-02 02:32:40 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:08.956: INFO: Container aws-cloud-controller-manager ready: true, restart count 0 Feb 2 02:50:08.956: INFO: kops-controller-f4d7p started at 2023-02-02 02:32:40 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:08.956: INFO: Container kops-controller ready: true, restart count 0 Feb 2 02:50:08.956: INFO: ebs-csi-node-d97sr started at 2023-02-02 02:32:40 +0000 UTC (0+3 container statuses recorded) Feb 2 02:50:08.956: INFO: Container ebs-plugin ready: true, restart count 0 Feb 2 02:50:08.956: INFO: Container liveness-probe ready: true, restart count 0 Feb 2 02:50:08.956: INFO: Container node-driver-registrar ready: true, restart count 0 Feb 2 02:50:08.956: INFO: dns-controller-74d4646d88-tqtjs started at 2023-02-02 02:32:41 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:08.956: INFO: Container dns-controller ready: true, restart count 0 Feb 2 02:50:09.093: INFO: Latency metrics for node i-01b885526491052d5 Feb 2 02:50:09.093: INFO: Logging node info for node i-094933bbcaafb548f Feb 2 02:50:09.124: INFO: Node Info: &Node{ObjectMeta:{i-094933bbcaafb548f f8a3e392-0d95-41f4-b73c-92cf4fc28ad0 11318 0 2023-02-02 02:33:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east-1 failure-domain.beta.kubernetes.io/zone:us-east-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-094933bbcaafb548f kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-east-1a topology.hostpath.csi/node:i-094933bbcaafb548f topology.kubernetes.io/region:us-east-1 topology.kubernetes.io/zone:us-east-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.57.122 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-8448":"i-094933bbcaafb548f","ebs.csi.aws.com":"i-094933bbcaafb548f"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-02-02 02:38:04 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-02-02 02:49:37 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-02-02 02:49:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///us-east-1a/i-094933bbcaafb548f,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078206976 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973349376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-02 02:49:43 +0000 UTC,LastTransitionTime:2023-02-02 02:33:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-02 02:49:43 +0000 UTC,LastTransitionTime:2023-02-02 02:33:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-02 02:49:43 +0000 UTC,LastTransitionTime:2023-02-02 02:33:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-02 02:49:43 +0000 UTC,LastTransitionTime:2023-02-02 02:33:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.57.122,},NodeAddress{Type:ExternalIP,Address:34.229.175.171,},NodeAddress{Type:InternalDNS,Address:i-094933bbcaafb548f.ec2.internal,},NodeAddress{Type:Hostname,Address:i-094933bbcaafb548f.ec2.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-34-229-175-171.compute-1.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2268a1fc2523b710f39d6e8dcd11f8,SystemUUID:ec2268a1-fc25-23b7-10f3-9d6e8dcd11f8,BootID:a1887cfb-af12-4b59-88c8-e5de9f1d7ef9,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.16,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-8448^3a9ca785-a2a4-11ed-8d79-b6c07b6c44d4],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-8448^3a9ca785-a2a4-11ed-8d79-b6c07b6c44d4,DevicePath:,},},Config:nil,},} Feb 2 02:50:09.124: INFO: Logging kubelet events for node i-094933bbcaafb548f Feb 2 02:50:09.158: INFO: Logging pods the kubelet thinks is on node i-094933bbcaafb548f Feb 2 02:50:09.196: INFO: ebs-csi-node-vgbm6 started at 2023-02-02 02:33:34 +0000 UTC (0+3 container statuses recorded) Feb 2 02:50:09.196: INFO: Container ebs-plugin ready: true, restart count 0 Feb 2 02:50:09.196: INFO: Container liveness-probe ready: true, restart count 0 Feb 2 02:50:09.196: INFO: Container node-driver-registrar ready: true, restart count 0 Feb 2 02:50:09.196: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-8jnbj started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.196: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:09.196: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-hvbsc started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.196: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:09.196: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-nwdp9 started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.196: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:09.196: INFO: csi-hostpathplugin-0 started at 2023-02-02 02:50:06 +0000 UTC (0+7 container statuses recorded) Feb 2 02:50:09.196: INFO: Container csi-attacher ready: false, restart count 0 Feb 2 02:50:09.196: INFO: Container csi-provisioner ready: false, restart count 0 Feb 2 02:50:09.196: INFO: Container csi-resizer ready: false, restart count 0 Feb 2 02:50:09.196: INFO: Container csi-snapshotter ready: false, restart count 0 Feb 2 02:50:09.196: INFO: Container hostpath ready: false, restart count 0 Feb 2 02:50:09.196: INFO: Container liveness-probe ready: false, restart count 0 Feb 2 02:50:09.196: INFO: Container node-driver-registrar ready: false, restart count 0 Feb 2 02:50:09.196: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-842cr started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.196: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:09.196: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-mn2cg started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.196: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:09.196: INFO: netserver-0 started at 2023-02-02 02:45:58 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.196: INFO: Container webserver ready: false, restart count 0 Feb 2 02:50:09.196: INFO: rs-d5xx6 started at 2023-02-02 02:49:52 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.196: INFO: Container donothing ready: false, restart count 0 Feb 2 02:50:09.196: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-4lnlh started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.196: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:09.196: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-9vt7q started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.196: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:09.196: INFO: cilium-tc4dv started at 2023-02-02 02:33:34 +0000 UTC (1+1 container statuses recorded) Feb 2 02:50:09.196: INFO: Init container clean-cilium-state ready: true, restart count 0 Feb 2 02:50:09.196: INFO: Container cilium-agent ready: true, restart count 0 Feb 2 02:50:09.196: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-d85kv started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.196: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:09.196: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-dnh8t started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.196: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:09.196: INFO: rs-zdrtm started at 2023-02-02 02:49:51 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.196: INFO: Container donothing ready: false, restart count 0 Feb 2 02:50:09.196: INFO: netserver-0 started at 2023-02-02 02:49:33 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.196: INFO: Container webserver ready: true, restart count 0 Feb 2 02:50:09.196: INFO: inline-volume-tester-ttw96 started at 2023-02-02 02:49:36 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.196: INFO: Container csi-volume-tester ready: false, restart count 0 Feb 2 02:50:09.196: INFO: coredns-559769c974-qfr7h started at 2023-02-02 02:34:23 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.196: INFO: Container coredns ready: true, restart count 0 Feb 2 02:50:09.196: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-wpbbn started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.196: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:09.196: INFO: csi-hostpathplugin-0 started at 2023-02-02 02:39:16 +0000 UTC (0+7 container statuses recorded) Feb 2 02:50:09.196: INFO: Container csi-attacher ready: true, restart count 0 Feb 2 02:50:09.196: INFO: Container csi-provisioner ready: true, restart count 0 Feb 2 02:50:09.196: INFO: Container csi-resizer ready: true, restart count 0 Feb 2 02:50:09.196: INFO: Container csi-snapshotter ready: true, restart count 0 Feb 2 02:50:09.196: INFO: Container hostpath ready: true, restart count 0 Feb 2 02:50:09.196: INFO: Container liveness-probe ready: true, restart count 0 Feb 2 02:50:09.196: INFO: Container node-driver-registrar ready: true, restart count 0 Feb 2 02:50:09.404: INFO: Latency metrics for node i-094933bbcaafb548f Feb 2 02:50:09.404: INFO: Logging node info for node i-0edda5f045be0496e Feb 2 02:50:09.435: INFO: Node Info: &Node{ObjectMeta:{i-0edda5f045be0496e 4587fb05-429b-429c-8408-c6c4e9c69a39 11949 0 2023-02-02 02:33:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east-1 failure-domain.beta.kubernetes.io/zone:us-east-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0edda5f045be0496e kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-east-1a topology.hostpath.csi/node:i-0edda5f045be0496e topology.kubernetes.io/region:us-east-1 topology.kubernetes.io/zone:us-east-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.36.32 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0edda5f045be0496e"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-02-02 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-02-02 02:33:35 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-02-02 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-02-02 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-02-02 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-02-02 02:38:05 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-02-02 02:49:54 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-02-02 02:49:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///us-east-1a/i-0edda5f045be0496e,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078206976 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973349376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-02 02:49:54 +0000 UTC,LastTransitionTime:2023-02-02 02:33:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-02 02:49:54 +0000 UTC,LastTransitionTime:2023-02-02 02:33:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-02 02:49:54 +0000 UTC,LastTransitionTime:2023-02-02 02:33:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-02 02:49:54 +0000 UTC,LastTransitionTime:2023-02-02 02:33:46 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.36.32,},NodeAddress{Type:ExternalIP,Address:107.20.131.91,},NodeAddress{Type:InternalDNS,Address:i-0edda5f045be0496e.ec2.internal,},NodeAddress{Type:Hostname,Address:i-0edda5f045be0496e.ec2.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-107-20-131-91.compute-1.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2d6d99d20e1d252ee83a35d89804ad,SystemUUID:ec2d6d99-d20e-1d25-2ee8-3a35d89804ad,BootID:d1722e01-5561-4510-a9ae-eb13b4bd9a0f,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.16,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-00adc42c65bfab5b2],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-00adc42c65bfab5b2,DevicePath:,},},Config:nil,},} Feb 2 02:50:09.436: INFO: Logging kubelet events for node i-0edda5f045be0496e Feb 2 02:50:09.472: INFO: Logging pods the kubelet thinks is on node i-0edda5f045be0496e Feb 2 02:50:09.511: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-mkbdp started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.511: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:09.511: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-pn6d4 started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.511: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:09.511: INFO: execpodhrd2g started at 2023-02-02 02:49:38 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.511: INFO: Container agnhost-container ready: true, restart count 0 Feb 2 02:50:09.511: INFO: pfpod started at 2023-02-02 02:48:47 +0000 UTC (0+2 container statuses recorded) Feb 2 02:50:09.511: INFO: Container portforwardtester ready: false, restart count 0 Feb 2 02:50:09.511: INFO: Container readiness ready: false, restart count 0 Feb 2 02:50:09.511: INFO: rs-d42qg started at 2023-02-02 02:49:52 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.511: INFO: Container donothing ready: false, restart count 0 Feb 2 02:50:09.511: INFO: ebs-csi-node-kbmng started at 2023-02-02 02:33:36 +0000 UTC (0+3 container statuses recorded) Feb 2 02:50:09.511: INFO: Container ebs-plugin ready: true, restart count 0 Feb 2 02:50:09.511: INFO: Container liveness-probe ready: true, restart count 0 Feb 2 02:50:09.511: INFO: Container node-driver-registrar ready: true, restart count 0 Feb 2 02:50:09.511: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-hfvsn started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.511: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: false, restart count 0 Feb 2 02:50:09.511: INFO: netserver-1 started at 2023-02-02 02:49:33 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.511: INFO: Container webserver ready: true, restart count 0 Feb 2 02:50:09.511: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-l8l4k started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.511: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:09.511: INFO: csi-hostpathplugin-0 started at 2023-02-02 02:46:21 +0000 UTC (0+7 container statuses recorded) Feb 2 02:50:09.511: INFO: Container csi-attacher ready: false, restart count 0 Feb 2 02:50:09.511: INFO: Container csi-provisioner ready: false, restart count 0 Feb 2 02:50:09.511: INFO: Container csi-resizer ready: false, restart count 0 Feb 2 02:50:09.511: INFO: Container csi-snapshotter ready: false, restart count 0 Feb 2 02:50:09.511: INFO: Container hostpath ready: false, restart count 0 Feb 2 02:50:09.511: INFO: Container liveness-probe ready: false, restart count 0 Feb 2 02:50:09.511: INFO: Container node-driver-registrar ready: false, restart count 0 Feb 2 02:50:09.511: INFO: pod-secrets-2af698c1-7e7f-42cb-92b4-983c767e4fb3 started at 2023-02-02 02:49:44 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.511: INFO: Container secret-test ready: false, restart count 0 Feb 2 02:50:09.511: INFO: rs-rk22n started at 2023-02-02 02:49:51 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.511: INFO: Container donothing ready: false, restart count 0 Feb 2 02:50:09.511: INFO: rs-k2vs7 started at 2023-02-02 02:49:52 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.511: INFO: Container donothing ready: false, restart count 0 Feb 2 02:50:09.511: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-2wdkr started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.511: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:09.511: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-9sqms started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.511: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:09.511: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-8hlcn started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.511: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:09.511: INFO: pod1 started at 2023-02-02 02:48:53 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.511: INFO: Container agnhost-container ready: true, restart count 0 Feb 2 02:50:09.511: INFO: master started at 2023-02-02 02:45:00 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.511: INFO: Container cntr ready: false, restart count 0 Feb 2 02:50:09.511: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-f67st started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.511: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:09.511: INFO: cilium-q9c8c started at 2023-02-02 02:33:36 +0000 UTC (1+1 container statuses recorded) Feb 2 02:50:09.511: INFO: Init container clean-cilium-state ready: true, restart count 0 Feb 2 02:50:09.511: INFO: Container cilium-agent ready: true, restart count 0 Feb 2 02:50:09.511: INFO: netserver-1 started at 2023-02-02 02:45:58 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.511: INFO: Container webserver ready: false, restart count 0 Feb 2 02:50:09.511: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-bc995 started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.511: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:09.511: INFO: inline-volume-tester-jcmtn started at 2023-02-02 02:38:54 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.511: INFO: Container csi-volume-tester ready: true, restart count 0 Feb 2 02:50:09.511: INFO: security-context-26d9d60c-8c31-4e0d-9488-ce019848329d started at 2023-02-02 02:49:26 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.511: INFO: Container test-container ready: false, restart count 0 Feb 2 02:50:09.511: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-jstkj started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.511: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: false, restart count 0 Feb 2 02:50:09.511: INFO: rs-glj89 started at 2023-02-02 02:49:55 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.511: INFO: Container donothing ready: false, restart count 0 Feb 2 02:50:09.511: INFO: ss2-2 started at 2023-02-02 02:38:37 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.511: INFO: Container webserver ready: true, restart count 0 Feb 2 02:50:09.673: INFO: Latency metrics for node i-0edda5f045be0496e Feb 2 02:50:09.673: INFO: Logging node info for node i-0f7e2e4905cb6dadc Feb 2 02:50:09.704: INFO: Node Info: &Node{ObjectMeta:{i-0f7e2e4905cb6dadc 2adbbc9a-dd76-4b97-8d3e-a2bd14f0c57d 10413 0 2023-02-02 02:33:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east-1 failure-domain.beta.kubernetes.io/zone:us-east-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0f7e2e4905cb6dadc kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-east-1a topology.hostpath.csi/node:i-0f7e2e4905cb6dadc topology.kubernetes.io/region:us-east-1 topology.kubernetes.io/zone:us-east-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.40.134 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-3250":"i-0f7e2e4905cb6dadc","ebs.csi.aws.com":"i-0f7e2e4905cb6dadc"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-02-02 02:33:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {e2e.test Update v1 2023-02-02 02:38:05 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-02-02 02:49:03 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-02-02 02:49:11 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///us-east-1a/i-0f7e2e4905cb6dadc,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-02 02:49:11 +0000 UTC,LastTransitionTime:2023-02-02 02:33:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-02 02:49:11 +0000 UTC,LastTransitionTime:2023-02-02 02:33:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-02 02:49:11 +0000 UTC,LastTransitionTime:2023-02-02 02:33:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-02 02:49:11 +0000 UTC,LastTransitionTime:2023-02-02 02:33:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.40.134,},NodeAddress{Type:ExternalIP,Address:18.215.155.89,},NodeAddress{Type:InternalDNS,Address:i-0f7e2e4905cb6dadc.ec2.internal,},NodeAddress{Type:Hostname,Address:i-0f7e2e4905cb6dadc.ec2.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-215-155-89.compute-1.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2d895bde004236c844d2f199d4cb6e,SystemUUID:ec2d895b-de00-4236-c844-d2f199d4cb6e,BootID:e4805eb2-7c0d-48b7-a584-7f3b4b363884,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.16,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-3250^26b12128-a2a4-11ed-bb72-0efe19e96a51],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-3250^26b12128-a2a4-11ed-bb72-0efe19e96a51,DevicePath:,},},Config:nil,},} Feb 2 02:50:09.704: INFO: Logging kubelet events for node i-0f7e2e4905cb6dadc Feb 2 02:50:09.737: INFO: Logging pods the kubelet thinks is on node i-0f7e2e4905cb6dadc Feb 2 02:50:09.776: INFO: pod-client started at 2023-02-02 02:49:11 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.776: INFO: Container pod-client ready: false, restart count 0 Feb 2 02:50:09.776: INFO: netserver-2 started at 2023-02-02 02:45:58 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.776: INFO: Container webserver ready: false, restart count 0 Feb 2 02:50:09.776: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-h65xw started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.776: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:09.776: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-pwvqk started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.776: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:09.776: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-mphjv started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.776: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:09.776: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-xzv2d started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.776: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:09.776: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-m7nw9 started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.776: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: false, restart count 0 Feb 2 02:50:09.776: INFO: coredns-autoscaler-7cb5c5b969-5nncn started at 2023-02-02 02:33:44 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.776: INFO: Container autoscaler ready: true, restart count 0 Feb 2 02:50:09.776: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-7wgzt started at 2023-02-02 02:38:06 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.776: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:09.776: INFO: rs-kn8tl started at 2023-02-02 02:49:52 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.776: INFO: Container donothing ready: false, restart count 0 Feb 2 02:50:09.776: INFO: ebs-csi-node-mkxjx started at 2023-02-02 02:33:34 +0000 UTC (0+3 container statuses recorded) Feb 2 02:50:09.776: INFO: Container ebs-plugin ready: true, restart count 0 Feb 2 02:50:09.776: INFO: Container liveness-probe ready: true, restart count 0 Feb 2 02:50:09.776: INFO: Container node-driver-registrar ready: true, restart count 0 Feb 2 02:50:09.776: INFO: netserver-2 started at 2023-02-02 02:49:33 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.776: INFO: Container webserver ready: true, restart count 0 Feb 2 02:50:09.776: INFO: rs-tq4jh started at 2023-02-02 02:49:51 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.776: INFO: Container donothing ready: false, restart count 0 Feb 2 02:50:09.776: INFO: cilium-k54gx started at 2023-02-02 02:33:34 +0000 UTC (1+1 container statuses recorded) Feb 2 02:50:09.776: INFO: Init container clean-cilium-state ready: true, restart count 0 Feb 2 02:50:09.776: INFO: Container cilium-agent ready: true, restart count 0 Feb 2 02:50:09.776: INFO: coredns-559769c974-s54lm started at 2023-02-02 02:33:44 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.776: INFO: Container coredns ready: true, restart count 0 Feb 2 02:50:09.776: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-rnf4c started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.776: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:09.776: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-pgnjx started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.776: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:09.776: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-s6mxr started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.776: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:09.776: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-vtdsx started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.776: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:09.776: INFO: rs-bb6k5 started at 2023-02-02 02:49:55 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.776: INFO: Container donothing ready: false, restart count 0 Feb 2 02:50:09.776: INFO: csi-hostpathplugin-0 started at 2023-02-02 02:46:42 +0000 UTC (0+7 container statuses recorded) Feb 2 02:50:09.776: INFO: Container csi-attacher ready: true, restart count 0 Feb 2 02:50:09.776: INFO: Container csi-provisioner ready: true, restart count 0 Feb 2 02:50:09.776: INFO: Container csi-resizer ready: true, restart count 0 Feb 2 02:50:09.776: INFO: Container csi-snapshotter ready: true, restart count 0 Feb 2 02:50:09.776: INFO: Container hostpath ready: true, restart count 0 Feb 2 02:50:09.776: INFO: Container liveness-probe ready: true, restart count 0 Feb 2 02:50:09.776: INFO: Container node-driver-registrar ready: true, restart count 0 Feb 2 02:50:09.776: INFO: ss2-0 started at 2023-02-02 02:49:44 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:09.776: INFO: Container webserver ready: false, restart count 0 Feb 2 02:50:09.776: INFO: pod-subpath-test-dynamicpv-4qbr started at 2023-02-02 02:49:02 +0000 UTC (1+1 container statuses recorded) Feb 2 02:50:09.776: INFO: Init container init-volume-dynamicpv-4qbr ready: false, restart count 0 Feb 2 02:50:09.776: INFO: Container test-container-subpath-dynamicpv-4qbr ready: false, restart count 0 Feb 2 02:50:09.957: INFO: Latency metrics for node i-0f7e2e4905cb6dadc Feb 2 02:50:09.957: INFO: Logging node info for node i-0fe5d857b6eb4dfe3 Feb 2 02:50:09.988: INFO: Node Info: &Node{ObjectMeta:{i-0fe5d857b6eb4dfe3 9d0f7cfc-7470-4601-b0c7-c2b476a9fab7 11273 0 2023-02-02 02:33:43 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east-1 failure-domain.beta.kubernetes.io/zone:us-east-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0fe5d857b6eb4dfe3 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-east-1a topology.hostpath.csi/node:i-0fe5d857b6eb4dfe3 topology.kubernetes.io/region:us-east-1 topology.kubernetes.io/zone:us-east-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.53.228 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0fe5d857b6eb4dfe3"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-02-02 02:33:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-02-02 02:33:43 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-02-02 02:33:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-02-02 02:33:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-02-02 02:33:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-02-02 02:38:05 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-02-02 02:49:42 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-02-02 02:49:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///us-east-1a/i-0fe5d857b6eb4dfe3,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078206976 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973349376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-02 02:49:42 +0000 UTC,LastTransitionTime:2023-02-02 02:33:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-02 02:49:42 +0000 UTC,LastTransitionTime:2023-02-02 02:33:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-02 02:49:42 +0000 UTC,LastTransitionTime:2023-02-02 02:33:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-02 02:49:42 +0000 UTC,LastTransitionTime:2023-02-02 02:33:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.53.228,},NodeAddress{Type:ExternalIP,Address:18.212.239.71,},NodeAddress{Type:InternalDNS,Address:i-0fe5d857b6eb4dfe3.ec2.internal,},NodeAddress{Type:Hostname,Address:i-0fe5d857b6eb4dfe3.ec2.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-212-239-71.compute-1.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23a338ffd343d89814911cd0d0d8ea,SystemUUID:ec23a338-ffd3-43d8-9814-911cd0d0d8ea,BootID:588a11ea-21bc-44af-808b-852f5f90dd84,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.16,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-021fcced421837e53 kubernetes.io/csi/ebs.csi.aws.com^vol-06c549b1251626bdf],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-06c549b1251626bdf,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-021fcced421837e53,DevicePath:,},},Config:nil,},} Feb 2 02:50:09.988: INFO: Logging kubelet events for node i-0fe5d857b6eb4dfe3 Feb 2 02:50:10.022: INFO: Logging pods the kubelet thinks is on node i-0fe5d857b6eb4dfe3 Feb 2 02:50:10.062: INFO: rs-ncbsn started at 2023-02-02 02:49:55 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.062: INFO: Container donothing ready: false, restart count 0 Feb 2 02:50:10.062: INFO: test-container-pod started at 2023-02-02 02:49:55 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.062: INFO: Container webserver ready: false, restart count 0 Feb 2 02:50:10.062: INFO: host-test-container-pod started at 2023-02-02 02:49:55 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.062: INFO: Container agnhost-container ready: true, restart count 0 Feb 2 02:50:10.062: INFO: rs-pwffb started at 2023-02-02 02:49:52 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.062: INFO: Container donothing ready: false, restart count 0 Feb 2 02:50:10.062: INFO: pod-configmaps-f596c9e4-0702-4bac-bb8d-e766ca7cefb2 started at 2023-02-02 02:49:46 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.062: INFO: Container agnhost-container ready: false, restart count 0 Feb 2 02:50:10.062: INFO: netserver-3 started at 2023-02-02 02:49:33 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.062: INFO: Container webserver ready: true, restart count 0 Feb 2 02:50:10.062: INFO: csi-mockplugin-0 started at 2023-02-02 02:46:24 +0000 UTC (0+3 container statuses recorded) Feb 2 02:50:10.062: INFO: Container csi-provisioner ready: false, restart count 0 Feb 2 02:50:10.062: INFO: Container driver-registrar ready: false, restart count 0 Feb 2 02:50:10.062: INFO: Container mock ready: false, restart count 0 Feb 2 02:50:10.062: INFO: rs-vl4zj started at 2023-02-02 02:49:51 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.062: INFO: Container donothing ready: false, restart count 0 Feb 2 02:50:10.062: INFO: netserver-3 started at 2023-02-02 02:45:58 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.062: INFO: Container webserver ready: true, restart count 0 Feb 2 02:50:10.062: INFO: inline-volume-tester-vzj57 started at 2023-02-02 02:38:29 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.062: INFO: Container csi-volume-tester ready: false, restart count 0 Feb 2 02:50:10.062: INFO: cilium-gffsv started at 2023-02-02 02:33:43 +0000 UTC (1+1 container statuses recorded) Feb 2 02:50:10.062: INFO: Init container clean-cilium-state ready: true, restart count 0 Feb 2 02:50:10.062: INFO: Container cilium-agent ready: true, restart count 0 Feb 2 02:50:10.062: INFO: rs-42smn started at 2023-02-02 02:49:52 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.062: INFO: Container donothing ready: false, restart count 0 Feb 2 02:50:10.062: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-sb6sx started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.062: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:10.062: INFO: ss2-1 started at 2023-02-02 02:41:26 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.062: INFO: Container webserver ready: true, restart count 0 Feb 2 02:50:10.062: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-n4rbc started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.062: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:10.062: INFO: csi-mockplugin-attacher-0 started at 2023-02-02 02:46:24 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.062: INFO: Container csi-attacher ready: false, restart count 0 Feb 2 02:50:10.062: INFO: pod2 started at 2023-02-02 02:49:56 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.062: INFO: Container agnhost-container ready: false, restart count 0 Feb 2 02:50:10.062: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-snv7k started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.062: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:10.062: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-dz5bh started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.062: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:10.062: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-dss8d started at 2023-02-02 02:38:06 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.062: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:10.062: INFO: inline-volume-tester2-wpgg7 started at 2023-02-02 02:39:34 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.062: INFO: Container csi-volume-tester ready: false, restart count 0 Feb 2 02:50:10.062: INFO: ebs-csi-node-qqz2d started at 2023-02-02 02:33:43 +0000 UTC (0+3 container statuses recorded) Feb 2 02:50:10.062: INFO: Container ebs-plugin ready: true, restart count 0 Feb 2 02:50:10.062: INFO: Container liveness-probe ready: true, restart count 0 Feb 2 02:50:10.062: INFO: Container node-driver-registrar ready: true, restart count 0 Feb 2 02:50:10.062: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-j9kxn started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.062: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:10.062: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-965cw started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.062: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:10.062: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-7j88c started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.062: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:10.062: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-2psrz started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.062: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:10.062: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-7xd6t started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.062: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:50:10.062: INFO: pod-projected-configmaps-c7fde8d3-2d87-44f0-a97d-2cae453e883c started at 2023-02-02 02:49:47 +0000 UTC (0+1 container statuses recorded) Feb 2 02:50:10.062: INFO: Container projected-configmap-volume-test ready: false, restart count 0 Feb 2 02:50:10.062: INFO: pod-subpath-test-configmap-sr27 started at 2023-02-02 02:49:44 +0000 UTC (1+2 container statuses recorded) Feb 2 02:50:10.062: INFO: Init container init-volume-configmap-sr27 ready: false, restart count 0 Feb 2 02:50:10.062: INFO: Container test-container-subpath-configmap-sr27 ready: false, restart count 0 Feb 2 02:50:10.062: INFO: Container test-container-volume-configmap-sr27 ready: false, restart count 0 Feb 2 02:50:10.254: INFO: Latency metrics for node i-0fe5d857b6eb4dfe3 [DeferCleanup (Each)] [sig-api-machinery] Aggregator tear down framework | framework.go:193 �[1mSTEP:�[0m Destroying namespace "aggregator-6516" for this suite. �[38;5;243m02/02/23 02:50:10.254�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-apps\]\sDisruptionController\sevictions\:\senough\spods\,\sabsolute\s\=\>\sshould\sallow\san\seviction$'
test/e2e/apps/disruption.go:580 k8s.io/kubernetes/test/e2e/apps.waitForPodsOrDie({0x8022ee8?, 0xc0039f8340}, {0xc00477f6a0, 0xe}, 0x3) test/e2e/apps/disruption.go:580 +0x167 k8s.io/kubernetes/test/e2e/apps.glob..func6.7() test/e2e/apps/disruption.go:326 +0x49f
[BeforeEach] [sig-apps] DisruptionController set up framework | framework.go:178 �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m02/02/23 02:39:01.02�[0m Feb 2 02:39:01.020: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP:�[0m Building a namespace api object, basename disruption �[38;5;243m02/02/23 02:39:01.021�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m02/02/23 02:39:01.114�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m02/02/23 02:39:01.172�[0m [BeforeEach] [sig-apps] DisruptionController test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-apps] DisruptionController test/e2e/apps/disruption.go:72 [It] evictions: enough pods, absolute => should allow an eviction test/e2e/apps/disruption.go:290 �[1mSTEP:�[0m Waiting for the pdb to be processed �[38;5;243m02/02/23 02:39:01.36�[0m �[1mSTEP:�[0m locating a running pod �[38;5;243m02/02/23 02:39:01.39�[0m �[1mSTEP:�[0m Waiting for all pods to be running �[38;5;243m02/02/23 02:39:29.451�[0m Feb 2 02:39:29.481: INFO: running pods: 1 < 3 Feb 2 02:39:31.512: INFO: running pods: 1 < 3 Feb 2 02:39:33.512: INFO: running pods: 1 < 3 Feb 2 02:39:35.512: INFO: running pods: 1 < 3 Feb 2 02:39:37.512: INFO: running pods: 1 < 3 Feb 2 02:39:39.512: INFO: running pods: 1 < 3 Feb 2 02:39:41.512: INFO: running pods: 1 < 3 Feb 2 02:39:43.512: INFO: running pods: 1 < 3 Feb 2 02:39:45.512: INFO: running pods: 1 < 3 Feb 2 02:39:47.512: INFO: running pods: 1 < 3 Feb 2 02:39:49.512: INFO: running pods: 1 < 3 Feb 2 02:39:51.512: INFO: running pods: 1 < 3 Feb 2 02:39:53.512: INFO: running pods: 1 < 3 Feb 2 02:39:55.512: INFO: running pods: 1 < 3 Feb 2 02:39:57.512: INFO: running pods: 1 < 3 Feb 2 02:39:59.513: INFO: running pods: 1 < 3 Feb 2 02:40:01.512: INFO: running pods: 1 < 3 Feb 2 02:40:03.513: INFO: running pods: 1 < 3 Feb 2 02:40:05.512: INFO: running pods: 1 < 3 Feb 2 02:40:07.512: INFO: running pods: 1 < 3 Feb 2 02:40:09.513: INFO: running pods: 1 < 3 Feb 2 02:40:11.512: INFO: running pods: 1 < 3 Feb 2 02:40:13.512: INFO: running pods: 1 < 3 Feb 2 02:40:15.512: INFO: running pods: 1 < 3 Feb 2 02:40:17.512: INFO: running pods: 1 < 3 Feb 2 02:40:19.512: INFO: running pods: 1 < 3 Feb 2 02:40:21.512: INFO: running pods: 1 < 3 Feb 2 02:40:23.512: INFO: running pods: 1 < 3 Feb 2 02:40:25.512: INFO: running pods: 1 < 3 Feb 2 02:40:27.512: INFO: running pods: 1 < 3 Feb 2 02:40:29.512: INFO: running pods: 1 < 3 Feb 2 02:40:31.512: INFO: running pods: 1 < 3 Feb 2 02:40:33.513: INFO: running pods: 1 < 3 Feb 2 02:40:35.512: INFO: running pods: 1 < 3 Feb 2 02:40:37.512: INFO: running pods: 1 < 3 Feb 2 02:40:39.512: INFO: running pods: 1 < 3 Feb 2 02:40:41.513: INFO: running pods: 1 < 3 Feb 2 02:40:43.512: INFO: running pods: 1 < 3 Feb 2 02:40:45.512: INFO: running pods: 1 < 3 Feb 2 02:40:47.512: INFO: running pods: 1 < 3 Feb 2 02:40:49.512: INFO: running pods: 1 < 3 Feb 2 02:40:51.513: INFO: running pods: 1 < 3 Feb 2 02:40:53.511: INFO: running pods: 1 < 3 Feb 2 02:40:55.512: INFO: running pods: 1 < 3 Feb 2 02:40:57.511: INFO: running pods: 1 < 3 Feb 2 02:40:59.512: INFO: running pods: 1 < 3 Feb 2 02:41:01.513: INFO: running pods: 1 < 3 Feb 2 02:41:03.513: INFO: running pods: 1 < 3 Feb 2 02:41:05.512: INFO: running pods: 2 < 3 Feb 2 02:41:07.512: INFO: running pods: 2 < 3 Feb 2 02:41:09.512: INFO: running pods: 2 < 3 Feb 2 02:41:11.512: INFO: running pods: 2 < 3 Feb 2 02:41:13.513: INFO: running pods: 2 < 3 Feb 2 02:41:15.512: INFO: running pods: 2 < 3 Feb 2 02:41:17.512: INFO: running pods: 2 < 3 Feb 2 02:41:19.512: INFO: running pods: 2 < 3 Feb 2 02:41:21.512: INFO: running pods: 2 < 3 Feb 2 02:41:23.512: INFO: running pods: 2 < 3 Feb 2 02:41:25.512: INFO: running pods: 2 < 3 Feb 2 02:41:27.512: INFO: running pods: 2 < 3 Feb 2 02:41:29.513: INFO: running pods: 2 < 3 Feb 2 02:41:31.513: INFO: running pods: 2 < 3 Feb 2 02:41:33.511: INFO: running pods: 2 < 3 Feb 2 02:41:35.512: INFO: running pods: 2 < 3 Feb 2 02:41:37.511: INFO: running pods: 2 < 3 Feb 2 02:41:39.512: INFO: running pods: 2 < 3 Feb 2 02:41:41.512: INFO: running pods: 2 < 3 Feb 2 02:41:43.513: INFO: running pods: 2 < 3 Feb 2 02:41:45.512: INFO: running pods: 2 < 3 Feb 2 02:41:47.513: INFO: running pods: 2 < 3 Feb 2 02:41:49.512: INFO: running pods: 2 < 3 Feb 2 02:41:51.512: INFO: running pods: 2 < 3 Feb 2 02:41:53.512: INFO: running pods: 2 < 3 Feb 2 02:41:55.512: INFO: running pods: 2 < 3 Feb 2 02:41:57.512: INFO: running pods: 2 < 3 Feb 2 02:41:59.512: INFO: running pods: 2 < 3 Feb 2 02:42:01.512: INFO: running pods: 2 < 3 Feb 2 02:42:03.512: INFO: running pods: 2 < 3 Feb 2 02:42:05.512: INFO: running pods: 2 < 3 Feb 2 02:42:07.512: INFO: running pods: 2 < 3 Feb 2 02:42:09.513: INFO: running pods: 2 < 3 Feb 2 02:42:11.512: INFO: running pods: 2 < 3 Feb 2 02:42:13.512: INFO: running pods: 2 < 3 Feb 2 02:42:15.513: INFO: running pods: 2 < 3 Feb 2 02:42:17.512: INFO: running pods: 2 < 3 Feb 2 02:42:19.512: INFO: running pods: 2 < 3 Feb 2 02:42:21.512: INFO: running pods: 2 < 3 Feb 2 02:42:23.512: INFO: running pods: 2 < 3 Feb 2 02:42:25.512: INFO: running pods: 2 < 3 Feb 2 02:42:27.512: INFO: running pods: 2 < 3 Feb 2 02:42:29.512: INFO: running pods: 2 < 3 Feb 2 02:42:31.513: INFO: running pods: 2 < 3 Feb 2 02:42:33.512: INFO: running pods: 2 < 3 Feb 2 02:42:35.511: INFO: running pods: 2 < 3 Feb 2 02:42:37.512: INFO: running pods: 2 < 3 Feb 2 02:42:39.513: INFO: running pods: 2 < 3 Feb 2 02:42:41.511: INFO: running pods: 2 < 3 Feb 2 02:42:43.512: INFO: running pods: 2 < 3 Feb 2 02:42:45.512: INFO: running pods: 2 < 3 Feb 2 02:42:47.512: INFO: running pods: 2 < 3 Feb 2 02:42:49.512: INFO: running pods: 2 < 3 Feb 2 02:42:51.513: INFO: running pods: 2 < 3 Feb 2 02:42:53.512: INFO: running pods: 2 < 3 Feb 2 02:42:55.512: INFO: running pods: 2 < 3 Feb 2 02:42:57.511: INFO: running pods: 2 < 3 Feb 2 02:42:59.512: INFO: running pods: 2 < 3 Feb 2 02:43:01.512: INFO: running pods: 2 < 3 Feb 2 02:43:03.512: INFO: running pods: 2 < 3 Feb 2 02:43:05.513: INFO: running pods: 2 < 3 Feb 2 02:43:07.512: INFO: running pods: 2 < 3 Feb 2 02:43:09.512: INFO: running pods: 2 < 3 Feb 2 02:43:11.512: INFO: running pods: 2 < 3 Feb 2 02:43:13.512: INFO: running pods: 2 < 3 Feb 2 02:43:15.512: INFO: running pods: 2 < 3 Feb 2 02:43:17.512: INFO: running pods: 2 < 3 Feb 2 02:43:19.512: INFO: running pods: 2 < 3 Feb 2 02:43:21.512: INFO: running pods: 2 < 3 Feb 2 02:43:23.517: INFO: running pods: 2 < 3 Feb 2 02:43:25.514: INFO: running pods: 2 < 3 Feb 2 02:43:27.511: INFO: running pods: 2 < 3 Feb 2 02:43:29.512: INFO: running pods: 2 < 3 Feb 2 02:43:31.512: INFO: running pods: 2 < 3 Feb 2 02:43:33.511: INFO: running pods: 2 < 3 Feb 2 02:43:35.513: INFO: running pods: 2 < 3 Feb 2 02:43:37.512: INFO: running pods: 2 < 3 Feb 2 02:43:39.513: INFO: running pods: 2 < 3 Feb 2 02:43:41.512: INFO: running pods: 2 < 3 Feb 2 02:43:43.512: INFO: running pods: 2 < 3 Feb 2 02:43:45.512: INFO: running pods: 2 < 3 Feb 2 02:43:47.512: INFO: running pods: 2 < 3 Feb 2 02:43:49.512: INFO: running pods: 2 < 3 Feb 2 02:43:51.512: INFO: running pods: 2 < 3 Feb 2 02:43:53.512: INFO: running pods: 2 < 3 Feb 2 02:43:55.512: INFO: running pods: 2 < 3 Feb 2 02:43:57.512: INFO: running pods: 2 < 3 Feb 2 02:43:59.512: INFO: running pods: 2 < 3 Feb 2 02:44:01.512: INFO: running pods: 2 < 3 Feb 2 02:44:03.512: INFO: running pods: 2 < 3 Feb 2 02:44:05.512: INFO: running pods: 2 < 3 Feb 2 02:44:07.511: INFO: running pods: 2 < 3 Feb 2 02:44:09.513: INFO: running pods: 2 < 3 Feb 2 02:44:11.511: INFO: running pods: 2 < 3 Feb 2 02:44:13.512: INFO: running pods: 2 < 3 Feb 2 02:44:15.513: INFO: running pods: 2 < 3 Feb 2 02:44:17.512: INFO: running pods: 2 < 3 Feb 2 02:44:19.513: INFO: running pods: 2 < 3 Feb 2 02:44:21.512: INFO: running pods: 2 < 3 Feb 2 02:44:23.512: INFO: running pods: 2 < 3 Feb 2 02:44:25.512: INFO: running pods: 2 < 3 Feb 2 02:44:27.513: INFO: running pods: 2 < 3 Feb 2 02:44:29.512: INFO: running pods: 2 < 3 Feb 2 02:44:31.528: INFO: running pods: 2 < 3 Feb 2 02:44:33.513: INFO: running pods: 2 < 3 Feb 2 02:44:35.512: INFO: running pods: 2 < 3 Feb 2 02:44:37.513: INFO: running pods: 2 < 3 Feb 2 02:44:39.512: INFO: running pods: 2 < 3 Feb 2 02:44:41.513: INFO: running pods: 2 < 3 Feb 2 02:44:43.513: INFO: running pods: 2 < 3 Feb 2 02:44:45.513: INFO: running pods: 2 < 3 Feb 2 02:44:47.512: INFO: running pods: 2 < 3 Feb 2 02:44:49.512: INFO: running pods: 2 < 3 Feb 2 02:44:51.513: INFO: running pods: 2 < 3 Feb 2 02:44:53.512: INFO: running pods: 2 < 3 Feb 2 02:44:55.512: INFO: running pods: 2 < 3 Feb 2 02:44:57.511: INFO: running pods: 2 < 3 Feb 2 02:44:59.513: INFO: running pods: 2 < 3 Feb 2 02:45:01.512: INFO: running pods: 2 < 3 Feb 2 02:45:03.512: INFO: running pods: 2 < 3 Feb 2 02:45:05.513: INFO: running pods: 2 < 3 Feb 2 02:45:07.511: INFO: running pods: 2 < 3 Feb 2 02:45:09.513: INFO: running pods: 2 < 3 Feb 2 02:45:11.513: INFO: running pods: 2 < 3 Feb 2 02:45:13.512: INFO: running pods: 2 < 3 Feb 2 02:45:15.513: INFO: running pods: 2 < 3 Feb 2 02:45:17.512: INFO: running pods: 2 < 3 Feb 2 02:45:19.511: INFO: running pods: 2 < 3 Feb 2 02:45:21.512: INFO: running pods: 2 < 3 Feb 2 02:45:23.512: INFO: running pods: 2 < 3 Feb 2 02:45:25.513: INFO: running pods: 2 < 3 Feb 2 02:45:27.513: INFO: running pods: 2 < 3 Feb 2 02:45:29.512: INFO: running pods: 2 < 3 Feb 2 02:45:31.512: INFO: running pods: 2 < 3 Feb 2 02:45:33.513: INFO: running pods: 2 < 3 Feb 2 02:45:35.512: INFO: running pods: 2 < 3 Feb 2 02:45:37.513: INFO: running pods: 2 < 3 Feb 2 02:45:39.512: INFO: running pods: 2 < 3 Feb 2 02:45:41.512: INFO: running pods: 2 < 3 Feb 2 02:45:43.513: INFO: running pods: 2 < 3 Feb 2 02:45:45.512: INFO: running pods: 2 < 3 Feb 2 02:45:47.512: INFO: running pods: 2 < 3 Feb 2 02:45:49.512: INFO: running pods: 2 < 3 Feb 2 02:45:51.513: INFO: running pods: 2 < 3 Feb 2 02:45:53.512: INFO: running pods: 2 < 3 Feb 2 02:45:55.512: INFO: running pods: 2 < 3 Feb 2 02:45:57.512: INFO: running pods: 2 < 3 Feb 2 02:45:59.512: INFO: running pods: 2 < 3 Feb 2 02:46:01.513: INFO: running pods: 2 < 3 Feb 2 02:46:03.512: INFO: running pods: 2 < 3 Feb 2 02:46:05.513: INFO: running pods: 2 < 3 Feb 2 02:46:07.512: INFO: running pods: 2 < 3 Feb 2 02:46:09.511: INFO: running pods: 2 < 3 Feb 2 02:46:11.512: INFO: running pods: 2 < 3 Feb 2 02:46:13.512: INFO: running pods: 2 < 3 Feb 2 02:46:15.516: INFO: running pods: 2 < 3 Feb 2 02:46:17.512: INFO: running pods: 2 < 3 Feb 2 02:46:19.511: INFO: running pods: 2 < 3 Feb 2 02:46:21.512: INFO: running pods: 2 < 3 Feb 2 02:46:23.512: INFO: running pods: 2 < 3 Feb 2 02:46:25.512: INFO: running pods: 2 < 3 Feb 2 02:46:27.511: INFO: running pods: 2 < 3 Feb 2 02:46:29.512: INFO: running pods: 2 < 3 Feb 2 02:46:31.513: INFO: running pods: 2 < 3 Feb 2 02:46:33.513: INFO: running pods: 2 < 3 Feb 2 02:46:35.512: INFO: running pods: 2 < 3 Feb 2 02:46:37.512: INFO: running pods: 2 < 3 Feb 2 02:46:39.512: INFO: running pods: 2 < 3 Feb 2 02:46:41.513: INFO: running pods: 2 < 3 Feb 2 02:46:43.513: INFO: running pods: 2 < 3 Feb 2 02:46:45.512: INFO: running pods: 2 < 3 Feb 2 02:46:47.512: INFO: running pods: 2 < 3 Feb 2 02:46:49.512: INFO: running pods: 2 < 3 Feb 2 02:46:51.512: INFO: running pods: 2 < 3 Feb 2 02:46:53.512: INFO: running pods: 2 < 3 Feb 2 02:46:55.512: INFO: running pods: 2 < 3 Feb 2 02:46:57.512: INFO: running pods: 2 < 3 Feb 2 02:46:59.513: INFO: running pods: 2 < 3 Feb 2 02:47:01.512: INFO: running pods: 2 < 3 Feb 2 02:47:03.512: INFO: running pods: 2 < 3 Feb 2 02:47:05.513: INFO: running pods: 2 < 3 Feb 2 02:47:07.512: INFO: running pods: 2 < 3 Feb 2 02:47:09.513: INFO: running pods: 2 < 3 Feb 2 02:47:11.512: INFO: running pods: 2 < 3 Feb 2 02:47:13.513: INFO: running pods: 2 < 3 Feb 2 02:47:15.513: INFO: running pods: 2 < 3 Feb 2 02:47:17.512: INFO: running pods: 2 < 3 Feb 2 02:47:19.512: INFO: running pods: 2 < 3 Feb 2 02:47:21.512: INFO: running pods: 2 < 3 Feb 2 02:47:23.512: INFO: running pods: 2 < 3 Feb 2 02:47:25.512: INFO: running pods: 2 < 3 Feb 2 02:47:27.513: INFO: running pods: 2 < 3 Feb 2 02:47:29.512: INFO: running pods: 2 < 3 Feb 2 02:47:31.511: INFO: running pods: 2 < 3 Feb 2 02:47:33.512: INFO: running pods: 2 < 3 Feb 2 02:47:35.513: INFO: running pods: 2 < 3 Feb 2 02:47:37.513: INFO: running pods: 2 < 3 Feb 2 02:47:39.513: INFO: running pods: 2 < 3 Feb 2 02:47:41.513: INFO: running pods: 2 < 3 Feb 2 02:47:43.512: INFO: running pods: 2 < 3 Feb 2 02:47:45.513: INFO: running pods: 2 < 3 Feb 2 02:47:47.513: INFO: running pods: 2 < 3 Feb 2 02:47:49.512: INFO: running pods: 2 < 3 Feb 2 02:47:51.512: INFO: running pods: 2 < 3 Feb 2 02:47:53.513: INFO: running pods: 2 < 3 Feb 2 02:47:55.512: INFO: running pods: 2 < 3 Feb 2 02:47:57.512: INFO: running pods: 2 < 3 Feb 2 02:47:59.512: INFO: running pods: 2 < 3 Feb 2 02:48:01.513: INFO: running pods: 2 < 3 Feb 2 02:48:03.512: INFO: running pods: 2 < 3 Feb 2 02:48:05.512: INFO: running pods: 2 < 3 Feb 2 02:48:07.512: INFO: running pods: 2 < 3 Feb 2 02:48:09.512: INFO: running pods: 2 < 3 Feb 2 02:48:11.512: INFO: running pods: 2 < 3 Feb 2 02:48:13.512: INFO: running pods: 2 < 3 Feb 2 02:48:15.512: INFO: running pods: 2 < 3 Feb 2 02:48:17.512: INFO: running pods: 2 < 3 Feb 2 02:48:19.512: INFO: running pods: 2 < 3 Feb 2 02:48:21.512: INFO: running pods: 2 < 3 Feb 2 02:48:23.512: INFO: running pods: 2 < 3 Feb 2 02:48:25.512: INFO: running pods: 2 < 3 Feb 2 02:48:27.512: INFO: running pods: 2 < 3 Feb 2 02:48:29.512: INFO: running pods: 2 < 3 Feb 2 02:48:31.513: INFO: running pods: 2 < 3 Feb 2 02:48:33.512: INFO: running pods: 2 < 3 Feb 2 02:48:35.512: INFO: running pods: 2 < 3 Feb 2 02:48:37.511: INFO: running pods: 2 < 3 Feb 2 02:48:39.512: INFO: running pods: 2 < 3 Feb 2 02:48:41.512: INFO: running pods: 2 < 3 Feb 2 02:48:43.513: INFO: running pods: 2 < 3 Feb 2 02:48:45.513: INFO: running pods: 2 < 3 Feb 2 02:48:47.512: INFO: running pods: 2 < 3 Feb 2 02:48:49.512: INFO: running pods: 2 < 3 Feb 2 02:48:51.511: INFO: running pods: 2 < 3 Feb 2 02:48:53.512: INFO: running pods: 2 < 3 Feb 2 02:48:55.512: INFO: running pods: 2 < 3 Feb 2 02:48:57.512: INFO: running pods: 2 < 3 Feb 2 02:48:59.512: INFO: running pods: 2 < 3 Feb 2 02:49:01.512: INFO: running pods: 2 < 3 Feb 2 02:49:03.512: INFO: running pods: 2 < 3 Feb 2 02:49:05.513: INFO: running pods: 2 < 3 Feb 2 02:49:07.516: INFO: running pods: 2 < 3 Feb 2 02:49:09.513: INFO: running pods: 2 < 3 Feb 2 02:49:11.512: INFO: running pods: 2 < 3 Feb 2 02:49:13.512: INFO: running pods: 2 < 3 Feb 2 02:49:15.512: INFO: running pods: 2 < 3 Feb 2 02:49:17.513: INFO: running pods: 2 < 3 Feb 2 02:49:19.513: INFO: running pods: 2 < 3 Feb 2 02:49:21.512: INFO: running pods: 2 < 3 Feb 2 02:49:23.512: INFO: running pods: 2 < 3 Feb 2 02:49:25.512: INFO: running pods: 2 < 3 Feb 2 02:49:27.512: INFO: running pods: 2 < 3 Feb 2 02:49:29.512: INFO: running pods: 2 < 3 Feb 2 02:49:29.541: INFO: running pods: 2 < 3 Feb 2 02:49:29.541: INFO: Unexpected error: Waiting for pods in namespace "disruption-181" to be ready: <*errors.errorString | 0xc000215d90>: { s: "timed out waiting for the condition", } Feb 2 02:49:29.541: FAIL: Waiting for pods in namespace "disruption-181" to be ready: timed out waiting for the condition Full Stack Trace k8s.io/kubernetes/test/e2e/apps.waitForPodsOrDie({0x8022ee8?, 0xc0039f8340}, {0xc00477f6a0, 0xe}, 0x3) test/e2e/apps/disruption.go:580 +0x167 k8s.io/kubernetes/test/e2e/apps.glob..func6.7() test/e2e/apps/disruption.go:326 +0x49f [AfterEach] [sig-apps] DisruptionController test/e2e/framework/node/init/init.go:32 Feb 2 02:49:29.542: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-apps] DisruptionController test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-apps] DisruptionController dump namespaces | framework.go:196 �[1mSTEP:�[0m dump namespace information after failure �[38;5;243m02/02/23 02:49:29.573�[0m �[1mSTEP:�[0m Collecting events from namespace "disruption-181". �[38;5;243m02/02/23 02:49:29.573�[0m �[1mSTEP:�[0m Found 30 events. �[38;5;243m02/02/23 02:49:29.603�[0m Feb 2 02:49:29.603: INFO: At 2023-02-02 02:39:01 +0000 UTC - event for pod-0: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ad6cf194c8f5d510bf5cb8fbbbf16840b6ca4d4a3f72c2babbd6cf6f1d5a0b2b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:49:29.603: INFO: At 2023-02-02 02:39:01 +0000 UTC - event for pod-0: {default-scheduler } Scheduled: Successfully assigned disruption-181/pod-0 to i-0fe5d857b6eb4dfe3 Feb 2 02:49:29.603: INFO: At 2023-02-02 02:39:01 +0000 UTC - event for pod-1: {default-scheduler } Scheduled: Successfully assigned disruption-181/pod-1 to i-0fe5d857b6eb4dfe3 Feb 2 02:49:29.603: INFO: At 2023-02-02 02:39:01 +0000 UTC - event for pod-1: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "2eaf8f594fe61c92188fe16af338fa1354b9f4b49682ff8a1b8f118a1655bccb": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:49:29.603: INFO: At 2023-02-02 02:39:01 +0000 UTC - event for pod-2: {default-scheduler } Scheduled: Successfully assigned disruption-181/pod-2 to i-0edda5f045be0496e Feb 2 02:49:29.603: INFO: At 2023-02-02 02:39:02 +0000 UTC - event for pod-2: {kubelet i-0edda5f045be0496e} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b7a8ea1ac6a9d205f46ef5cdcdff9b2921923a45f680eca313e3162e6807e8ba": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:49:29.603: INFO: At 2023-02-02 02:39:12 +0000 UTC - event for pod-1: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "08663db6d2224819d0285031e153de84f453124eecdda7c11a5e11473445bdc1": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:49:29.603: INFO: At 2023-02-02 02:39:14 +0000 UTC - event for pod-2: {kubelet i-0edda5f045be0496e} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "280bdd57962c78a62e62f246889d252051ded1af94c3f355f96cfcb393d82b0e": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:49:29.603: INFO: At 2023-02-02 02:39:15 +0000 UTC - event for pod-0: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "f663ea5a432bd8da53b7c363ba7cd8671fa7fa3f6c5c6d02bae5313480c67cd4": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:49:29.603: INFO: At 2023-02-02 02:39:25 +0000 UTC - event for pod-1: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "6d1565b38a4c56e8f85c101ea57e6d6729af7e0a768c46e3cc94b7200dd2e6e1": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:49:29.603: INFO: At 2023-02-02 02:39:27 +0000 UTC - event for pod-0: {kubelet i-0fe5d857b6eb4dfe3} Started: Started container donothing Feb 2 02:49:29.603: INFO: At 2023-02-02 02:39:27 +0000 UTC - event for pod-0: {kubelet i-0fe5d857b6eb4dfe3} Created: Created container donothing Feb 2 02:49:29.603: INFO: At 2023-02-02 02:39:27 +0000 UTC - event for pod-0: {kubelet i-0fe5d857b6eb4dfe3} Pulled: Container image "registry.k8s.io/pause:3.9" already present on machine Feb 2 02:49:29.603: INFO: At 2023-02-02 02:39:29 +0000 UTC - event for pod-2: {kubelet i-0edda5f045be0496e} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "580b4a45fee7e17bd72bc01469d1dedefa853896634269194ffc2fc67a83073e": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:49:29.603: INFO: At 2023-02-02 02:39:38 +0000 UTC - event for pod-1: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d708e39eefc164a3c8fad899a7d04a44fa415bc331dc85c7d3a232bbc2c59ced": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:49:29.603: INFO: At 2023-02-02 02:39:43 +0000 UTC - event for pod-2: {kubelet i-0edda5f045be0496e} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "f3c4b44e956bf8303db710d73c9ce166d719127a11fea3f935d67671ba2c783e": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:49:29.603: INFO: At 2023-02-02 02:39:50 +0000 UTC - event for pod-1: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "efb738fb935764b660e039d69c2da4273ac1d7db8aa03ec84ff1271bfab8a0fe": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:49:29.603: INFO: At 2023-02-02 02:39:59 +0000 UTC - event for pod-2: {kubelet i-0edda5f045be0496e} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ef7bcca5747636957e5cbca0b55f6b201f52cf0b4c315aed03babc31c6b2f270": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:49:29.603: INFO: At 2023-02-02 02:40:02 +0000 UTC - event for pod-1: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "9ef04e5a17b57c84a5d9b7950432bde49afe022a3a93c4d039b658d013703200": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:49:29.603: INFO: At 2023-02-02 02:40:10 +0000 UTC - event for pod-2: {kubelet i-0edda5f045be0496e} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "6e0517e706c419a745030be2db94c6eb6ee33aa4d5daa81ed32ac39489c0c33b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:49:29.603: INFO: At 2023-02-02 02:40:17 +0000 UTC - event for pod-1: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "7d47d17232c78f6faade8631cd220e304c90520d3e4375e21b22ce3cb37824ac": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:49:29.603: INFO: At 2023-02-02 02:40:21 +0000 UTC - event for pod-2: {kubelet i-0edda5f045be0496e} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "9812f24431bb852014ebb47eaacd8b68cde00e5bd6e7ef0dbcf8683f19638b51": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:49:29.603: INFO: At 2023-02-02 02:40:29 +0000 UTC - event for pod-1: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "0821afd431520bf0a90be389227d7bfb21791806f516360f9219820f273aff9a": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:49:29.603: INFO: At 2023-02-02 02:40:34 +0000 UTC - event for pod-2: {kubelet i-0edda5f045be0496e} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ae7cd6bd37edf6b01322e90ebb3face7a7983ff08c7edf2741814b73f300a7ce": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:49:29.603: INFO: At 2023-02-02 02:40:42 +0000 UTC - event for pod-1: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d26586d7a1b582eca9871281014a040eb29ada4b8c3039b3c505834f3aa43c30": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:49:29.603: INFO: At 2023-02-02 02:40:48 +0000 UTC - event for pod-2: {kubelet i-0edda5f045be0496e} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "3f791b7554a6880feb74fee9d9caf190d45f7a8bc7db66a1c2b1b34ce2cb9261": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:49:29.603: INFO: At 2023-02-02 02:40:57 +0000 UTC - event for pod-1: {kubelet i-0fe5d857b6eb4dfe3} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "7afd53ada4ccc8523343cdd88d7bd2ad134b99fb90424527f9f5de87e0950bf8": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Feb 2 02:49:29.603: INFO: At 2023-02-02 02:41:04 +0000 UTC - event for pod-2: {kubelet i-0edda5f045be0496e} Pulled: Container image "registry.k8s.io/pause:3.9" already present on machine Feb 2 02:49:29.603: INFO: At 2023-02-02 02:41:04 +0000 UTC - event for pod-2: {kubelet i-0edda5f045be0496e} Created: Created container donothing Feb 2 02:49:29.603: INFO: At 2023-02-02 02:41:04 +0000 UTC - event for pod-2: {kubelet i-0edda5f045be0496e} Started: Started container donothing Feb 2 02:49:29.633: INFO: POD NODE PHASE GRACE CONDITIONS Feb 2 02:49:29.633: INFO: pod-0 i-0fe5d857b6eb4dfe3 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-02-02 02:39:01 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-02-02 02:39:27 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-02-02 02:39:27 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-02-02 02:39:01 +0000 UTC }] Feb 2 02:49:29.633: INFO: pod-1 i-0fe5d857b6eb4dfe3 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-02-02 02:39:01 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-02-02 02:39:01 +0000 UTC ContainersNotReady containers with unready status: [donothing]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-02-02 02:39:01 +0000 UTC ContainersNotReady containers with unready status: [donothing]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-02-02 02:39:01 +0000 UTC }] Feb 2 02:49:29.633: INFO: pod-2 i-0edda5f045be0496e Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-02-02 02:39:01 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-02-02 02:41:04 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-02-02 02:41:04 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-02-02 02:39:01 +0000 UTC }] Feb 2 02:49:29.633: INFO: Feb 2 02:49:29.696: INFO: Unable to fetch disruption-181/pod-1/donothing logs: the server rejected our request for an unknown reason (get pods pod-1) Feb 2 02:49:29.759: INFO: Logging node info for node i-01b885526491052d5 Feb 2 02:49:29.789: INFO: Node Info: &Node{ObjectMeta:{i-01b885526491052d5 dc5fa938-4b08-4e13-a650-8859f804b492 8783 0 2023-02-02 02:32:08 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east-1 failure-domain.beta.kubernetes.io/zone:us-east-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-01b885526491052d5 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:us-east-1a topology.kubernetes.io/region:us-east-1 topology.kubernetes.io/zone:us-east-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.61.65 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-01b885526491052d5"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-02-02 02:32:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-02-02 02:32:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {aws-cloud-controller-manager Update v1 2023-02-02 02:32:44 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-02-02 02:32:44 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-02-02 02:32:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-02-02 02:44:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///us-east-1a/i-01b885526491052d5,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3918811136 0} {<nil>} 3826964Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3813953536 0} {<nil>} 3724564Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-02 02:44:53 +0000 UTC,LastTransitionTime:2023-02-02 02:32:07 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-02 02:44:53 +0000 UTC,LastTransitionTime:2023-02-02 02:32:07 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-02 02:44:53 +0000 UTC,LastTransitionTime:2023-02-02 02:32:07 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-02 02:44:53 +0000 UTC,LastTransitionTime:2023-02-02 02:32:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.61.65,},NodeAddress{Type:ExternalIP,Address:54.205.170.33,},NodeAddress{Type:InternalDNS,Address:i-01b885526491052d5.ec2.internal,},NodeAddress{Type:Hostname,Address:i-01b885526491052d5.ec2.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-205-170-33.compute-1.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec26507379484fef3914c7eb427dc82e,SystemUUID:ec265073-7948-4fef-3914-c7eb427dc82e,BootID:9d8938d3-ec44-44d3-9a12-0dbd68248bf9,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.16,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:5ffb3f7cade4ae1d8c952251abb0c8bdfa8d4d9acb2c364e763328bd6f3d06aa registry.k8s.io/etcdadm/etcd-manager:v3.0.20230201],SizeBytes:243803152,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.1],SizeBytes:135178704,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.1],SizeBytes:124995897,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.1],SizeBytes:57661752,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-beta.2],SizeBytes:43857040,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-beta.2],SizeBytes:42821718,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-beta.2],SizeBytes:4965807,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Feb 2 02:49:29.789: INFO: Logging kubelet events for node i-01b885526491052d5 Feb 2 02:49:29.821: INFO: Logging pods the kubelet thinks is on node i-01b885526491052d5 Feb 2 02:49:29.892: INFO: kube-apiserver-i-01b885526491052d5 started at 2023-02-02 02:31:38 +0000 UTC (0+2 container statuses recorded) Feb 2 02:49:29.892: INFO: Container healthcheck ready: true, restart count 0 Feb 2 02:49:29.892: INFO: Container kube-apiserver ready: true, restart count 1 Feb 2 02:49:29.892: INFO: kube-controller-manager-i-01b885526491052d5 started at 2023-02-02 02:31:38 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:29.892: INFO: Container kube-controller-manager ready: true, restart count 2 Feb 2 02:49:29.892: INFO: etcd-manager-events-i-01b885526491052d5 started at 2023-02-02 02:31:38 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:29.892: INFO: Container etcd-manager ready: true, restart count 0 Feb 2 02:49:29.892: INFO: etcd-manager-main-i-01b885526491052d5 started at 2023-02-02 02:31:38 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:29.892: INFO: Container etcd-manager ready: true, restart count 0 Feb 2 02:49:29.892: INFO: cilium-lzw4c started at 2023-02-02 02:32:40 +0000 UTC (1+1 container statuses recorded) Feb 2 02:49:29.892: INFO: Init container clean-cilium-state ready: true, restart count 0 Feb 2 02:49:29.892: INFO: Container cilium-agent ready: true, restart count 1 Feb 2 02:49:29.892: INFO: ebs-csi-controller-89bddb897-hx8fh started at 2023-02-02 02:32:41 +0000 UTC (0+5 container statuses recorded) Feb 2 02:49:29.892: INFO: Container csi-attacher ready: true, restart count 0 Feb 2 02:49:29.892: INFO: Container csi-provisioner ready: true, restart count 0 Feb 2 02:49:29.892: INFO: Container csi-resizer ready: true, restart count 0 Feb 2 02:49:29.892: INFO: Container ebs-plugin ready: true, restart count 0 Feb 2 02:49:29.892: INFO: Container liveness-probe ready: true, restart count 0 Feb 2 02:49:29.892: INFO: cilium-operator-6f8d6c4bf-68pf6 started at 2023-02-02 02:32:41 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:29.892: INFO: Container cilium-operator ready: true, restart count 1 Feb 2 02:49:29.892: INFO: kube-scheduler-i-01b885526491052d5 started at 2023-02-02 02:31:38 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:29.892: INFO: Container kube-scheduler ready: true, restart count 0 Feb 2 02:49:29.892: INFO: aws-cloud-controller-manager-q9pdm started at 2023-02-02 02:32:40 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:29.892: INFO: Container aws-cloud-controller-manager ready: true, restart count 0 Feb 2 02:49:29.892: INFO: kops-controller-f4d7p started at 2023-02-02 02:32:40 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:29.892: INFO: Container kops-controller ready: true, restart count 0 Feb 2 02:49:29.892: INFO: ebs-csi-node-d97sr started at 2023-02-02 02:32:40 +0000 UTC (0+3 container statuses recorded) Feb 2 02:49:29.892: INFO: Container ebs-plugin ready: true, restart count 0 Feb 2 02:49:29.892: INFO: Container liveness-probe ready: true, restart count 0 Feb 2 02:49:29.892: INFO: Container node-driver-registrar ready: true, restart count 0 Feb 2 02:49:29.892: INFO: dns-controller-74d4646d88-tqtjs started at 2023-02-02 02:32:41 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:29.892: INFO: Container dns-controller ready: true, restart count 0 Feb 2 02:49:30.028: INFO: Latency metrics for node i-01b885526491052d5 Feb 2 02:49:30.028: INFO: Logging node info for node i-094933bbcaafb548f Feb 2 02:49:30.058: INFO: Node Info: &Node{ObjectMeta:{i-094933bbcaafb548f f8a3e392-0d95-41f4-b73c-92cf4fc28ad0 10276 0 2023-02-02 02:33:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east-1 failure-domain.beta.kubernetes.io/zone:us-east-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-094933bbcaafb548f kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-east-1a topology.hostpath.csi/node:i-094933bbcaafb548f topology.kubernetes.io/region:us-east-1 topology.kubernetes.io/zone:us-east-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.57.122 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-094933bbcaafb548f"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-02-02 02:38:04 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-02-02 02:48:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///us-east-1a/i-094933bbcaafb548f,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078206976 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973349376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-02 02:48:52 +0000 UTC,LastTransitionTime:2023-02-02 02:33:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-02 02:48:52 +0000 UTC,LastTransitionTime:2023-02-02 02:33:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-02 02:48:52 +0000 UTC,LastTransitionTime:2023-02-02 02:33:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-02 02:48:52 +0000 UTC,LastTransitionTime:2023-02-02 02:33:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.57.122,},NodeAddress{Type:ExternalIP,Address:34.229.175.171,},NodeAddress{Type:InternalDNS,Address:i-094933bbcaafb548f.ec2.internal,},NodeAddress{Type:Hostname,Address:i-094933bbcaafb548f.ec2.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-34-229-175-171.compute-1.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2268a1fc2523b710f39d6e8dcd11f8,SystemUUID:ec2268a1-fc25-23b7-10f3-9d6e8dcd11f8,BootID:a1887cfb-af12-4b59-88c8-e5de9f1d7ef9,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.16,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Feb 2 02:49:30.058: INFO: Logging kubelet events for node i-094933bbcaafb548f Feb 2 02:49:30.090: INFO: Logging pods the kubelet thinks is on node i-094933bbcaafb548f Feb 2 02:49:30.126: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-4lnlh started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:30.126: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:49:30.126: INFO: netserver-0 started at 2023-02-02 02:45:58 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:30.126: INFO: Container webserver ready: false, restart count 0 Feb 2 02:49:30.126: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-9vt7q started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:30.126: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:49:30.126: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-d85kv started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:30.126: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:49:30.126: INFO: cilium-tc4dv started at 2023-02-02 02:33:34 +0000 UTC (1+1 container statuses recorded) Feb 2 02:49:30.126: INFO: Init container clean-cilium-state ready: true, restart count 0 Feb 2 02:49:30.126: INFO: Container cilium-agent ready: true, restart count 0 Feb 2 02:49:30.126: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-dnh8t started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:30.126: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:49:30.126: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-wpbbn started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:30.126: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:49:30.126: INFO: csi-hostpathplugin-0 started at 2023-02-02 02:39:16 +0000 UTC (0+7 container statuses recorded) Feb 2 02:49:30.126: INFO: Container csi-attacher ready: false, restart count 0 Feb 2 02:49:30.126: INFO: Container csi-provisioner ready: false, restart count 0 Feb 2 02:49:30.126: INFO: Container csi-resizer ready: false, restart count 0 Feb 2 02:49:30.126: INFO: Container csi-snapshotter ready: false, restart count 0 Feb 2 02:49:30.126: INFO: Container hostpath ready: false, restart count 0 Feb 2 02:49:30.126: INFO: Container liveness-probe ready: false, restart count 0 Feb 2 02:49:30.126: INFO: Container node-driver-registrar ready: false, restart count 0 Feb 2 02:49:30.126: INFO: coredns-559769c974-qfr7h started at 2023-02-02 02:34:23 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:30.126: INFO: Container coredns ready: true, restart count 0 Feb 2 02:49:30.126: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-8jnbj started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:30.126: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:49:30.126: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-hvbsc started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:30.126: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:49:30.126: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-nwdp9 started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:30.126: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:49:30.126: INFO: ebs-csi-node-vgbm6 started at 2023-02-02 02:33:34 +0000 UTC (0+3 container statuses recorded) Feb 2 02:49:30.126: INFO: Container ebs-plugin ready: true, restart count 0 Feb 2 02:49:30.126: INFO: Container liveness-probe ready: true, restart count 0 Feb 2 02:49:30.126: INFO: Container node-driver-registrar ready: true, restart count 0 Feb 2 02:49:30.126: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-mn2cg started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:30.126: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:49:30.126: INFO: rs-wv4bz started at 2023-02-02 02:39:20 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:30.126: INFO: Container donothing ready: true, restart count 0 Feb 2 02:49:30.126: INFO: rs-kfs5v started at 2023-02-02 02:39:20 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:30.126: INFO: Container donothing ready: false, restart count 0 Feb 2 02:49:30.126: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-842cr started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:30.126: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:49:30.306: INFO: Latency metrics for node i-094933bbcaafb548f Feb 2 02:49:30.306: INFO: Logging node info for node i-0edda5f045be0496e Feb 2 02:49:30.338: INFO: Node Info: &Node{ObjectMeta:{i-0edda5f045be0496e 4587fb05-429b-429c-8408-c6c4e9c69a39 9899 0 2023-02-02 02:33:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east-1 failure-domain.beta.kubernetes.io/zone:us-east-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0edda5f045be0496e kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-east-1a topology.hostpath.csi/node:i-0edda5f045be0496e topology.kubernetes.io/region:us-east-1 topology.kubernetes.io/zone:us-east-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.36.32 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0edda5f045be0496e"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-02-02 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-02-02 02:33:35 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-02-02 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-02-02 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-02-02 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-02-02 02:38:05 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-02-02 02:47:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-02-02 02:47:24 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///us-east-1a/i-0edda5f045be0496e,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078206976 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973349376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-02 02:47:21 +0000 UTC,LastTransitionTime:2023-02-02 02:33:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-02 02:47:21 +0000 UTC,LastTransitionTime:2023-02-02 02:33:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-02 02:47:21 +0000 UTC,LastTransitionTime:2023-02-02 02:33:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-02 02:47:21 +0000 UTC,LastTransitionTime:2023-02-02 02:33:46 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.36.32,},NodeAddress{Type:ExternalIP,Address:107.20.131.91,},NodeAddress{Type:InternalDNS,Address:i-0edda5f045be0496e.ec2.internal,},NodeAddress{Type:Hostname,Address:i-0edda5f045be0496e.ec2.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-107-20-131-91.compute-1.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2d6d99d20e1d252ee83a35d89804ad,SystemUUID:ec2d6d99-d20e-1d25-2ee8-3a35d89804ad,BootID:d1722e01-5561-4510-a9ae-eb13b4bd9a0f,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.16,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-00adc42c65bfab5b2 kubernetes.io/csi/ebs.csi.aws.com^vol-017618c08fd4915e5 kubernetes.io/csi/ebs.csi.aws.com^vol-04c22c580a5e76d0d],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-017618c08fd4915e5,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-04c22c580a5e76d0d,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-00adc42c65bfab5b2,DevicePath:,},},Config:nil,},} Feb 2 02:49:30.338: INFO: Logging kubelet events for node i-0edda5f045be0496e Feb 2 02:49:30.370: INFO: Logging pods the kubelet thinks is on node i-0edda5f045be0496e Feb 2 02:49:30.412: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-mkbdp started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:30.412: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:49:30.412: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-pn6d4 started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:30.412: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:49:30.412: INFO: pfpod started at 2023-02-02 02:48:47 +0000 UTC (0+2 container statuses recorded) Feb 2 02:49:30.412: INFO: Container portforwardtester ready: false, restart count 0 Feb 2 02:49:30.412: INFO: Container readiness ready: false, restart count 0 Feb 2 02:49:30.412: INFO: ebs-csi-node-kbmng started at 2023-02-02 02:33:36 +0000 UTC (0+3 container statuses recorded) Feb 2 02:49:30.412: INFO: Container ebs-plugin ready: true, restart count 0 Feb 2 02:49:30.412: INFO: Container liveness-probe ready: true, restart count 0 Feb 2 02:49:30.412: INFO: Container node-driver-registrar ready: true, restart count 0 Feb 2 02:49:30.412: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-hfvsn started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:30.412: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: false, restart count 0 Feb 2 02:49:30.412: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-l8l4k started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:30.412: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:49:30.412: INFO: csi-hostpathplugin-0 started at 2023-02-02 02:46:21 +0000 UTC (0+7 container statuses recorded) Feb 2 02:49:30.412: INFO: Container csi-attacher ready: false, restart count 0 Feb 2 02:49:30.412: INFO: Container csi-provisioner ready: false, restart count 0 Feb 2 02:49:30.412: INFO: Container csi-resizer ready: false, restart count 0 Feb 2 02:49:30.412: INFO: Container csi-snapshotter ready: false, restart count 0 Feb 2 02:49:30.412: INFO: Container hostpath ready: false, restart count 0 Feb 2 02:49:30.412: INFO: Container liveness-probe ready: false, restart count 0 Feb 2 02:49:30.412: INFO: Container node-driver-registrar ready: false, restart count 0 Feb 2 02:49:30.412: INFO: rs-x9jhx started at 2023-02-02 02:39:20 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:30.412: INFO: Container donothing ready: true, restart count 0 Feb 2 02:49:30.412: INFO: pod-subpath-test-inlinevolume-rj5s started at 2023-02-02 02:49:00 +0000 UTC (1+2 container statuses recorded) Feb 2 02:49:30.412: INFO: Init container test-init-subpath-inlinevolume-rj5s ready: false, restart count 0 Feb 2 02:49:30.412: INFO: Container test-container-subpath-inlinevolume-rj5s ready: false, restart count 0 Feb 2 02:49:30.412: INFO: Container test-container-volume-inlinevolume-rj5s ready: false, restart count 0 Feb 2 02:49:30.412: INFO: pod-projected-configmaps-73c4ca18-4b12-4052-b5d6-417ba8f49fa3 started at 2023-02-02 02:44:38 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:30.412: INFO: Container agnhost-container ready: false, restart count 0 Feb 2 02:49:30.412: INFO: pod-subpath-test-dynamicpv-ppz6 started at 2023-02-02 02:47:19 +0000 UTC (1+1 container statuses recorded) Feb 2 02:49:30.412: INFO: Init container init-volume-dynamicpv-ppz6 ready: false, restart count 0 Feb 2 02:49:30.412: INFO: Container test-container-subpath-dynamicpv-ppz6 ready: false, restart count 0 Feb 2 02:49:30.412: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-2wdkr started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:30.412: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:49:30.412: INFO: test-pod-a627d490-f3f7-40a6-9bb2-57e07c32697f started at 2023-02-02 02:45:13 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:30.412: INFO: Container agnhost-container ready: false, restart count 0 Feb 2 02:49:30.412: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-9sqms started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:30.412: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:49:30.412: INFO: rs-khhlp started at 2023-02-02 02:39:20 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:30.412: INFO: Container donothing ready: true, restart count 0 Feb 2 02:49:30.412: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-8hlcn started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:30.412: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: false, restart count 0 Feb 2 02:49:30.412: INFO: pod1 started at 2023-02-02 02:48:53 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:30.412: INFO: Container agnhost-container ready: false, restart count 0 Feb 2 02:49:30.412: INFO: pod-2 started at 2023-02-02 02:39:01 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:30.412: INFO: Container donothing ready: true, restart count 0 Feb 2 02:49:30.412: INFO: rs-pdw5z started at 2023-02-02 02:39:20 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:30.412: INFO: Container donothing ready: false, restart count 0 Feb 2 02:49:30.412: INFO: master started at 2023-02-02 02:45:00 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:30.412: INFO: Container cntr ready: false, restart count 0 Feb 2 02:49:30.412: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-f67st started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:30.412: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:49:30.412: INFO: pvc-volume-tester-reader-ptvl4 started at 2023-02-02 02:39:22 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:30.412: INFO: Container volume-tester ready: false, restart count 0 Feb 2 02:49:30.412: INFO: pod-size-memory-volume-ad2110cc-0a0e-48a7-afef-382e2fbae4b0 started at 2023-02-02 02:44:57 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:30.412: INFO: Container busybox-main-container ready: false, restart count 0 Feb 2 02:49:30.412: INFO: cilium-q9c8c started at 2023-02-02 02:33:36 +0000 UTC (1+1 container statuses recorded) Feb 2 02:49:30.412: INFO: Init container clean-cilium-state ready: true, restart count 0 Feb 2 02:49:30.412: INFO: Container cilium-agent ready: true, restart count 0 Feb 2 02:49:30.412: INFO: sample-apiserver-deployment-55bd96fd47-kjdct started at 2023-02-02 02:45:08 +0000 UTC (0+2 container statuses recorded) Feb 2 02:49:30.412: INFO: Container etcd ready: false, restart count 0 Feb 2 02:49:30.412: INFO: Container sample-apiserver ready: false, restart count 0 Feb 2 02:49:30.412: INFO: netserver-1 started at 2023-02-02 02:45:58 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:30.412: INFO: Container webserver ready: false, restart count 0 Feb 2 02:49:30.412: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-bc995 started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:30.412: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:49:30.412: INFO: inline-volume-tester-jcmtn started at 2023-02-02 02:38:54 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:30.412: INFO: Container csi-volume-tester ready: true, restart count 0 Feb 2 02:49:30.412: INFO: security-context-26d9d60c-8c31-4e0d-9488-ce019848329d started at 2023-02-02 02:49:26 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:30.412: INFO: Container test-container ready: false, restart count 0 Feb 2 02:49:30.412: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-jstkj started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:30.412: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: false, restart count 0 Feb 2 02:49:30.412: INFO: ss2-2 started at 2023-02-02 02:38:37 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:30.412: INFO: Container webserver ready: true, restart count 0 Feb 2 02:49:30.558: INFO: Latency metrics for node i-0edda5f045be0496e Feb 2 02:49:30.558: INFO: Logging node info for node i-0f7e2e4905cb6dadc Feb 2 02:49:30.589: INFO: Node Info: &Node{ObjectMeta:{i-0f7e2e4905cb6dadc 2adbbc9a-dd76-4b97-8d3e-a2bd14f0c57d 10413 0 2023-02-02 02:33:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east-1 failure-domain.beta.kubernetes.io/zone:us-east-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0f7e2e4905cb6dadc kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-east-1a topology.hostpath.csi/node:i-0f7e2e4905cb6dadc topology.kubernetes.io/region:us-east-1 topology.kubernetes.io/zone:us-east-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.40.134 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-3250":"i-0f7e2e4905cb6dadc","ebs.csi.aws.com":"i-0f7e2e4905cb6dadc"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-02-02 02:33:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-02-02 02:33:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {e2e.test Update v1 2023-02-02 02:38:05 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-02-02 02:49:03 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-02-02 02:49:11 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///us-east-1a/i-0f7e2e4905cb6dadc,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-02 02:49:11 +0000 UTC,LastTransitionTime:2023-02-02 02:33:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-02 02:49:11 +0000 UTC,LastTransitionTime:2023-02-02 02:33:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-02 02:49:11 +0000 UTC,LastTransitionTime:2023-02-02 02:33:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-02 02:49:11 +0000 UTC,LastTransitionTime:2023-02-02 02:33:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.40.134,},NodeAddress{Type:ExternalIP,Address:18.215.155.89,},NodeAddress{Type:InternalDNS,Address:i-0f7e2e4905cb6dadc.ec2.internal,},NodeAddress{Type:Hostname,Address:i-0f7e2e4905cb6dadc.ec2.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-215-155-89.compute-1.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2d895bde004236c844d2f199d4cb6e,SystemUUID:ec2d895b-de00-4236-c844-d2f199d4cb6e,BootID:e4805eb2-7c0d-48b7-a584-7f3b4b363884,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.16,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-3250^26b12128-a2a4-11ed-bb72-0efe19e96a51],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-3250^26b12128-a2a4-11ed-bb72-0efe19e96a51,DevicePath:,},},Config:nil,},} Feb 2 02:49:30.589: INFO: Logging kubelet events for node i-0f7e2e4905cb6dadc Feb 2 02:49:30.621: INFO: Logging pods the kubelet thinks is on node i-0f7e2e4905cb6dadc Feb 2 02:49:30.658: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-h65xw started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:30.658: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:49:30.658: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-pwvqk started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:30.658: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:49:30.658: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-mphjv started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:30.658: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:49:30.658: INFO: pod-client started at 2023-02-02 02:49:11 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:30.658: INFO: Container pod-client ready: false, restart count 0 Feb 2 02:49:30.658: INFO: netserver-2 started at 2023-02-02 02:45:58 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:30.658: INFO: Container webserver ready: false, restart count 0 Feb 2 02:49:30.658: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-xzv2d started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:30.658: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:49:30.658: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-m7nw9 started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:30.658: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: false, restart count 0 Feb 2 02:49:30.658: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-7wgzt started at 2023-02-02 02:38:06 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:30.658: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: false, restart count 0 Feb 2 02:49:30.658: INFO: coredns-autoscaler-7cb5c5b969-5nncn started at 2023-02-02 02:33:44 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:30.658: INFO: Container autoscaler ready: true, restart count 0 Feb 2 02:49:30.658: INFO: ebs-csi-node-mkxjx started at 2023-02-02 02:33:34 +0000 UTC (0+3 container statuses recorded) Feb 2 02:49:30.658: INFO: Container ebs-plugin ready: true, restart count 0 Feb 2 02:49:30.658: INFO: Container liveness-probe ready: true, restart count 0 Feb 2 02:49:30.658: INFO: Container node-driver-registrar ready: true, restart count 0 Feb 2 02:49:30.658: INFO: coredns-559769c974-s54lm started at 2023-02-02 02:33:44 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:30.658: INFO: Container coredns ready: true, restart count 0 Feb 2 02:49:30.658: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-rnf4c started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:30.658: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:49:30.658: INFO: rs-rvbxc started at 2023-02-02 02:39:20 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:30.658: INFO: Container donothing ready: false, restart count 0 Feb 2 02:49:30.658: INFO: cilium-k54gx started at 2023-02-02 02:33:34 +0000 UTC (1+1 container statuses recorded) Feb 2 02:49:30.658: INFO: Init container clean-cilium-state ready: true, restart count 0 Feb 2 02:49:30.658: INFO: Container cilium-agent ready: true, restart count 0 Feb 2 02:49:30.658: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-pgnjx started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:30.658: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:49:30.658: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-s6mxr started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:30.658: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:49:30.658: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-vtdsx started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:30.658: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:49:30.658: INFO: ss2-0 started at 2023-02-02 02:38:35 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:30.658: INFO: Container webserver ready: true, restart count 0 Feb 2 02:49:30.658: INFO: rs-vs5f2 started at 2023-02-02 02:39:20 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:30.658: INFO: Container donothing ready: false, restart count 0 Feb 2 02:49:30.658: INFO: pod-subpath-test-dynamicpv-4qbr started at 2023-02-02 02:49:02 +0000 UTC (1+1 container statuses recorded) Feb 2 02:49:30.658: INFO: Init container init-volume-dynamicpv-4qbr ready: false, restart count 0 Feb 2 02:49:30.658: INFO: Container test-container-subpath-dynamicpv-4qbr ready: false, restart count 0 Feb 2 02:49:30.658: INFO: csi-hostpathplugin-0 started at 2023-02-02 02:46:42 +0000 UTC (0+7 container statuses recorded) Feb 2 02:49:30.658: INFO: Container csi-attacher ready: true, restart count 0 Feb 2 02:49:30.658: INFO: Container csi-provisioner ready: true, restart count 0 Feb 2 02:49:30.658: INFO: Container csi-resizer ready: true, restart count 0 Feb 2 02:49:30.658: INFO: Container csi-snapshotter ready: true, restart count 0 Feb 2 02:49:30.658: INFO: Container hostpath ready: true, restart count 0 Feb 2 02:49:30.658: INFO: Container liveness-probe ready: true, restart count 0 Feb 2 02:49:30.658: INFO: Container node-driver-registrar ready: true, restart count 0 Feb 2 02:49:30.918: INFO: Latency metrics for node i-0f7e2e4905cb6dadc Feb 2 02:49:30.918: INFO: Logging node info for node i-0fe5d857b6eb4dfe3 Feb 2 02:49:30.948: INFO: Node Info: &Node{ObjectMeta:{i-0fe5d857b6eb4dfe3 9d0f7cfc-7470-4601-b0c7-c2b476a9fab7 10183 0 2023-02-02 02:33:43 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east-1 failure-domain.beta.kubernetes.io/zone:us-east-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0fe5d857b6eb4dfe3 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-east-1a topology.hostpath.csi/node:i-0fe5d857b6eb4dfe3 topology.kubernetes.io/region:us-east-1 topology.kubernetes.io/zone:us-east-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.53.228 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0fe5d857b6eb4dfe3"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-02-02 02:33:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-02-02 02:33:43 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-02-02 02:33:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-02-02 02:33:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-02-02 02:33:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-02-02 02:38:05 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-02-02 02:48:41 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-02-02 02:48:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///us-east-1a/i-0fe5d857b6eb4dfe3,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078206976 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973349376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-02 02:48:41 +0000 UTC,LastTransitionTime:2023-02-02 02:33:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-02 02:48:41 +0000 UTC,LastTransitionTime:2023-02-02 02:33:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-02 02:48:41 +0000 UTC,LastTransitionTime:2023-02-02 02:33:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-02 02:48:41 +0000 UTC,LastTransitionTime:2023-02-02 02:33:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.53.228,},NodeAddress{Type:ExternalIP,Address:18.212.239.71,},NodeAddress{Type:InternalDNS,Address:i-0fe5d857b6eb4dfe3.ec2.internal,},NodeAddress{Type:Hostname,Address:i-0fe5d857b6eb4dfe3.ec2.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-212-239-71.compute-1.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23a338ffd343d89814911cd0d0d8ea,SystemUUID:ec23a338-ffd3-43d8-9814-911cd0d0d8ea,BootID:588a11ea-21bc-44af-808b-852f5f90dd84,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.16,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-021fcced421837e53 kubernetes.io/csi/ebs.csi.aws.com^vol-06c549b1251626bdf kubernetes.io/csi/ebs.csi.aws.com^vol-099bf0e1f55ee83c6],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-099bf0e1f55ee83c6,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-06c549b1251626bdf,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-021fcced421837e53,DevicePath:,},},Config:nil,},} Feb 2 02:49:30.948: INFO: Logging kubelet events for node i-0fe5d857b6eb4dfe3 Feb 2 02:49:30.980: INFO: Logging pods the kubelet thinks is on node i-0fe5d857b6eb4dfe3 Feb 2 02:49:31.016: INFO: cilium-gffsv started at 2023-02-02 02:33:43 +0000 UTC (1+1 container statuses recorded) Feb 2 02:49:31.016: INFO: Init container clean-cilium-state ready: true, restart count 0 Feb 2 02:49:31.016: INFO: Container cilium-agent ready: true, restart count 0 Feb 2 02:49:31.016: INFO: inline-volume-tester-vzj57 started at 2023-02-02 02:38:29 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:31.016: INFO: Container csi-volume-tester ready: false, restart count 0 Feb 2 02:49:31.016: INFO: pod-0 started at 2023-02-02 02:39:01 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:31.016: INFO: Container donothing ready: true, restart count 0 Feb 2 02:49:31.016: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-n4rbc started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:31.016: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:49:31.016: INFO: pod-1 started at 2023-02-02 02:39:01 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:31.016: INFO: Container donothing ready: false, restart count 0 Feb 2 02:49:31.016: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-sb6sx started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:31.016: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:49:31.016: INFO: ss2-1 started at 2023-02-02 02:41:26 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:31.016: INFO: Container webserver ready: false, restart count 0 Feb 2 02:49:31.016: INFO: csi-mockplugin-attacher-0 started at 2023-02-02 02:46:24 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:31.016: INFO: Container csi-attacher ready: false, restart count 0 Feb 2 02:49:31.016: INFO: ebs-csi-node-qqz2d started at 2023-02-02 02:33:43 +0000 UTC (0+3 container statuses recorded) Feb 2 02:49:31.016: INFO: Container ebs-plugin ready: true, restart count 0 Feb 2 02:49:31.016: INFO: Container liveness-probe ready: true, restart count 0 Feb 2 02:49:31.016: INFO: Container node-driver-registrar ready: true, restart count 0 Feb 2 02:49:31.016: INFO: rs-pc45g started at 2023-02-02 02:39:21 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:31.016: INFO: Container donothing ready: true, restart count 0 Feb 2 02:49:31.016: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-snv7k started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:31.016: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:49:31.016: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-dz5bh started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:31.016: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:49:31.016: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-dss8d started at 2023-02-02 02:38:06 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:31.016: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:49:31.016: INFO: inline-volume-tester2-wpgg7 started at 2023-02-02 02:39:34 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:31.016: INFO: Container csi-volume-tester ready: false, restart count 0 Feb 2 02:49:31.016: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-j9kxn started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:31.016: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:49:31.016: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-965cw started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:31.016: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:49:31.016: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-7j88c started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:31.016: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:49:31.016: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-2psrz started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:31.016: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:49:31.016: INFO: cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad-7xd6t started at 2023-02-02 02:38:05 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:31.016: INFO: Container cleanup40-097bcbf8-afb9-4c9c-a3fd-b6cefd56ebad ready: true, restart count 0 Feb 2 02:49:31.016: INFO: rs-hhq9v started at 2023-02-02 02:39:20 +0000 UTC (0+1 container statuses recorded) Feb 2 02:49:31.016: INFO: Container donothing ready: false, restart count 0 Fe