e2e-kops-grid-cilium-eni-u2004-k26 #1610158934625095680 Results

Test Failures

Kubernetes e2e suite [It] External Storage [Driver: ebs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents 10m37s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\sExternal\sStorage\s\[Driver\:\sebs\.csi\.aws\.com\]\s\[Testpattern\:\sDynamic\sPV\s\(default\sfs\)\]\sfsgroupchangepolicy\s\(Always\)\[LinuxOnly\]\,\spod\screated\swith\san\sinitial\sfsgroup\,\snew\spod\sfsgroup\sapplied\sto\svolume\scontents$'

test/e2e/storage/testsuites/fsgroupchangepolicy.go:258
k8s.io/kubernetes/test/e2e/storage/testsuites.createPodAndVerifyContentGid(0xc001702f00, 0xc004f35e10, 0x0, {0xc005c8c858, 0x4}, {0xc005c8c85c, 0x4})
	test/e2e/storage/testsuites/fsgroupchangepolicy.go:258 +0x151
k8s.io/kubernetes/test/e2e/storage/testsuites.(*fsGroupChangePolicyTestSuite).DefineTests.func3()
	test/e2e/storage/testsuites/fsgroupchangepolicy.go:247 +0x556
				[BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/03/23 06:42:59.627�[0m
Jan  3 06:42:59.627: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename fsgroupchangepolicy �[38;5;243m01/03/23 06:42:59.629�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/03/23 06:43:00.324�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/03/23 06:43:00.786�[0m
[BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  test/e2e/framework/metrics/init/init.go:31
[It] (Always)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents
  test/e2e/storage/testsuites/fsgroupchangepolicy.go:210
Jan  3 06:43:01.248: INFO: Creating resource for dynamic PV
Jan  3 06:43:01.248: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} 
�[1mSTEP:�[0m creating a StorageClass fsgroupchangepolicy-2239-e2e-sc5bhz5 �[38;5;243m01/03/23 06:43:01.249�[0m
�[1mSTEP:�[0m creating a claim �[38;5;243m01/03/23 06:43:01.483�[0m
Jan  3 06:43:01.484: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
�[1mSTEP:�[0m Creating Pod in namespace fsgroupchangepolicy-2239 with fsgroup 1000 �[38;5;243m01/03/23 06:43:01.952�[0m
Jan  3 06:43:02.186: INFO: Waiting up to 5m0s for pod "pod-d1f9b429-7157-46da-88b6-a01fe6c4b9fc" in namespace "fsgroupchangepolicy-2239" to be "running"
Jan  3 06:43:02.418: INFO: Pod "pod-d1f9b429-7157-46da-88b6-a01fe6c4b9fc": Phase="Pending", Reason="", readiness=false. Elapsed: 231.745897ms
Jan  3 06:43:04.649: INFO: Pod "pod-d1f9b429-7157-46da-88b6-a01fe6c4b9fc": Phase="Pending", Reason="", readiness=false. Elapsed: 2.463555854s
Jan  3 06:43:06.650: INFO: Pod "pod-d1f9b429-7157-46da-88b6-a01fe6c4b9fc": Phase="Pending", Reason="", readiness=false. Elapsed: 4.463725302s
Jan  3 06:43:08.650: INFO: Pod "pod-d1f9b429-7157-46da-88b6-a01fe6c4b9fc": Phase="Pending", Reason="", readiness=false. Elapsed: 6.463750002s
Jan  3 06:43:10.650: INFO: Pod "pod-d1f9b429-7157-46da-88b6-a01fe6c4b9fc": Phase="Pending", Reason="", readiness=false. Elapsed: 8.464700981s
Jan  3 06:43:12.650: INFO: Pod "pod-d1f9b429-7157-46da-88b6-a01fe6c4b9fc": Phase="Running", Reason="", readiness=true. Elapsed: 10.464073417s
Jan  3 06:43:12.650: INFO: Pod "pod-d1f9b429-7157-46da-88b6-a01fe6c4b9fc" satisfied condition "running"
Jan  3 06:43:12.882: INFO: Pod fsgroupchangepolicy-2239/pod-d1f9b429-7157-46da-88b6-a01fe6c4b9fc started successfully
�[1mSTEP:�[0m Creating a sub-directory and file, and verifying their ownership is 1000 �[38;5;243m01/03/23 06:43:12.882�[0m
Jan  3 06:43:12.882: INFO: ExecWithOptions {Command:[/bin/sh -c touch /mnt/volume1/file1] Namespace:fsgroupchangepolicy-2239 PodName:pod-d1f9b429-7157-46da-88b6-a01fe6c4b9fc ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false}
Jan  3 06:43:12.882: INFO: >>> kubeConfig: /root/.kube/config
Jan  3 06:43:12.884: INFO: ExecWithOptions: Clientset creation
Jan  3 06:43:12.884: INFO: ExecWithOptions: execute(POST https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io/api/v1/namespaces/fsgroupchangepolicy-2239/pods/pod-d1f9b429-7157-46da-88b6-a01fe6c4b9fc/exec?command=%2Fbin%2Fsh&command=-c&command=touch+%2Fmnt%2Fvolume1%2Ffile1&container=write-pod&container=write-pod&stderr=true&stdout=true)
Jan  3 06:43:14.397: INFO: ExecWithOptions {Command:[/bin/sh -c ls -l /mnt/volume1/file1] Namespace:fsgroupchangepolicy-2239 PodName:pod-d1f9b429-7157-46da-88b6-a01fe6c4b9fc ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false}
Jan  3 06:43:14.397: INFO: >>> kubeConfig: /root/.kube/config
Jan  3 06:43:14.399: INFO: ExecWithOptions: Clientset creation
Jan  3 06:43:14.399: INFO: ExecWithOptions: execute(POST https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io/api/v1/namespaces/fsgroupchangepolicy-2239/pods/pod-d1f9b429-7157-46da-88b6-a01fe6c4b9fc/exec?command=%2Fbin%2Fsh&command=-c&command=ls+-l+%2Fmnt%2Fvolume1%2Ffile1&container=write-pod&container=write-pod&stderr=true&stdout=true)
Jan  3 06:43:15.908: INFO: pod fsgroupchangepolicy-2239/pod-d1f9b429-7157-46da-88b6-a01fe6c4b9fc exec for cmd ls -l /mnt/volume1/file1, stdout: -rw-r--r--    1 root     1000             0 Jan  3 06:43 /mnt/volume1/file1, stderr: 
Jan  3 06:43:15.908: INFO: stdout split: [-rw-r--r-- 1 root 1000 0 Jan 3 06:43 /mnt/volume1/file1], expected gid: 1000
Jan  3 06:43:15.908: INFO: ExecWithOptions {Command:[/bin/sh -c mkdir /mnt/volume1/subdir] Namespace:fsgroupchangepolicy-2239 PodName:pod-d1f9b429-7157-46da-88b6-a01fe6c4b9fc ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false}
Jan  3 06:43:15.908: INFO: >>> kubeConfig: /root/.kube/config
Jan  3 06:43:15.910: INFO: ExecWithOptions: Clientset creation
Jan  3 06:43:15.911: INFO: ExecWithOptions: execute(POST https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io/api/v1/namespaces/fsgroupchangepolicy-2239/pods/pod-d1f9b429-7157-46da-88b6-a01fe6c4b9fc/exec?command=%2Fbin%2Fsh&command=-c&command=mkdir+%2Fmnt%2Fvolume1%2Fsubdir&container=write-pod&container=write-pod&stderr=true&stdout=true)
Jan  3 06:43:17.394: INFO: ExecWithOptions {Command:[/bin/sh -c touch /mnt/volume1/subdir/file2] Namespace:fsgroupchangepolicy-2239 PodName:pod-d1f9b429-7157-46da-88b6-a01fe6c4b9fc ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false}
Jan  3 06:43:17.394: INFO: >>> kubeConfig: /root/.kube/config
Jan  3 06:43:17.396: INFO: ExecWithOptions: Clientset creation
Jan  3 06:43:17.396: INFO: ExecWithOptions: execute(POST https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io/api/v1/namespaces/fsgroupchangepolicy-2239/pods/pod-d1f9b429-7157-46da-88b6-a01fe6c4b9fc/exec?command=%2Fbin%2Fsh&command=-c&command=touch+%2Fmnt%2Fvolume1%2Fsubdir%2Ffile2&container=write-pod&container=write-pod&stderr=true&stdout=true)
Jan  3 06:43:18.907: INFO: ExecWithOptions {Command:[/bin/sh -c ls -l /mnt/volume1/subdir/file2] Namespace:fsgroupchangepolicy-2239 PodName:pod-d1f9b429-7157-46da-88b6-a01fe6c4b9fc ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false}
Jan  3 06:43:18.907: INFO: >>> kubeConfig: /root/.kube/config
Jan  3 06:43:18.908: INFO: ExecWithOptions: Clientset creation
Jan  3 06:43:18.909: INFO: ExecWithOptions: execute(POST https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io/api/v1/namespaces/fsgroupchangepolicy-2239/pods/pod-d1f9b429-7157-46da-88b6-a01fe6c4b9fc/exec?command=%2Fbin%2Fsh&command=-c&command=ls+-l+%2Fmnt%2Fvolume1%2Fsubdir%2Ffile2&container=write-pod&container=write-pod&stderr=true&stdout=true)
Jan  3 06:43:20.383: INFO: pod fsgroupchangepolicy-2239/pod-d1f9b429-7157-46da-88b6-a01fe6c4b9fc exec for cmd ls -l /mnt/volume1/subdir/file2, stdout: -rw-r--r--    1 root     1000             0 Jan  3 06:43 /mnt/volume1/subdir/file2, stderr: 
Jan  3 06:43:20.383: INFO: stdout split: [-rw-r--r-- 1 root 1000 0 Jan 3 06:43 /mnt/volume1/subdir/file2], expected gid: 1000
�[1mSTEP:�[0m Deleting Pod fsgroupchangepolicy-2239/pod-d1f9b429-7157-46da-88b6-a01fe6c4b9fc �[38;5;243m01/03/23 06:43:20.383�[0m
Jan  3 06:43:20.384: INFO: Deleting pod "pod-d1f9b429-7157-46da-88b6-a01fe6c4b9fc" in namespace "fsgroupchangepolicy-2239"
Jan  3 06:43:20.619: INFO: Wait up to 5m0s for pod "pod-d1f9b429-7157-46da-88b6-a01fe6c4b9fc" to be fully deleted
�[1mSTEP:�[0m Creating Pod in namespace fsgroupchangepolicy-2239 with fsgroup 2000 �[38;5;243m01/03/23 06:43:23.084�[0m
Jan  3 06:43:23.319: INFO: Waiting up to 5m0s for pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe" in namespace "fsgroupchangepolicy-2239" to be "running"
Jan  3 06:43:23.550: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 231.583596ms
Jan  3 06:43:25.783: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 2.464148653s
Jan  3 06:43:27.783: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 4.464159078s
Jan  3 06:43:29.783: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 6.464285063s
Jan  3 06:43:31.786: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 8.467696431s
Jan  3 06:43:33.796: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 10.477534127s
Jan  3 06:43:35.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 12.463710678s
Jan  3 06:43:37.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 14.463636342s
Jan  3 06:43:39.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 16.463538106s
Jan  3 06:43:41.783: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 18.464410185s
Jan  3 06:43:43.786: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 20.467030881s
Jan  3 06:43:45.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 22.463437611s
Jan  3 06:43:47.783: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 24.464022393s
Jan  3 06:43:49.781: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 26.462578414s
Jan  3 06:43:51.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 28.46331593s
Jan  3 06:43:53.786: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 30.467273466s
Jan  3 06:43:55.783: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 32.464220947s
Jan  3 06:43:57.783: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 34.464767437s
Jan  3 06:43:59.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 36.463591756s
Jan  3 06:44:01.783: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 38.464207203s
Jan  3 06:44:03.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 40.463707266s
Jan  3 06:44:05.783: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 42.464274341s
Jan  3 06:44:07.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 44.463166779s
Jan  3 06:44:09.783: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 46.464628008s
Jan  3 06:44:11.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 48.46287821s
Jan  3 06:44:13.788: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 50.468855042s
Jan  3 06:44:15.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 52.463565719s
Jan  3 06:44:17.783: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 54.464175784s
Jan  3 06:44:19.783: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 56.464276348s
Jan  3 06:44:21.784: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 58.46572729s
Jan  3 06:44:23.783: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.464089869s
Jan  3 06:44:25.783: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.463996504s
Jan  3 06:44:27.784: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.465119059s
Jan  3 06:44:29.783: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.464278471s
Jan  3 06:44:31.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.463779256s
Jan  3 06:44:33.783: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.464537218s
Jan  3 06:44:35.783: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.464417967s
Jan  3 06:44:37.783: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.464247417s
Jan  3 06:44:39.783: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.463951027s
Jan  3 06:44:41.786: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.467597912s
Jan  3 06:44:43.783: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.464348662s
Jan  3 06:44:45.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.463539952s
Jan  3 06:44:47.783: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.464100246s
Jan  3 06:44:49.783: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.463826631s
Jan  3 06:44:51.783: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.464395487s
Jan  3 06:44:53.784: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.464904237s
Jan  3 06:44:55.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.463430142s
Jan  3 06:44:57.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.463516182s
Jan  3 06:44:59.784: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.465438776s
Jan  3 06:45:01.783: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.464474519s
Jan  3 06:45:03.783: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.464037566s
Jan  3 06:45:05.784: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.465244762s
Jan  3 06:45:07.783: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.464058658s
Jan  3 06:45:09.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.46330954s
Jan  3 06:45:11.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.462935147s
Jan  3 06:45:13.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.463032052s
Jan  3 06:45:15.788: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.469035506s
Jan  3 06:45:17.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.462936724s
Jan  3 06:45:19.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.463736789s
Jan  3 06:45:21.783: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.463874341s
Jan  3 06:45:23.781: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.46272299s
Jan  3 06:45:25.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.463382709s
Jan  3 06:45:27.784: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.465499343s
Jan  3 06:45:29.789: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.470687685s
Jan  3 06:45:31.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.463594314s
Jan  3 06:45:33.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.462928833s
Jan  3 06:45:35.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.463751977s
Jan  3 06:45:37.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.463265187s
Jan  3 06:45:39.783: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.464264721s
Jan  3 06:45:41.781: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.462747834s
Jan  3 06:45:43.783: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.463917404s
Jan  3 06:45:45.783: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.463867874s
Jan  3 06:45:47.781: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.462589897s
Jan  3 06:45:49.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.46380909s
Jan  3 06:45:51.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.463821158s
Jan  3 06:45:53.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.463066671s
Jan  3 06:45:55.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.463782561s
Jan  3 06:45:57.781: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.462726947s
Jan  3 06:45:59.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.463086377s
Jan  3 06:46:01.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.463677236s
Jan  3 06:46:03.781: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.462594195s
Jan  3 06:46:05.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.46353129s
Jan  3 06:46:07.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.462851707s
Jan  3 06:46:09.787: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.468295961s
Jan  3 06:46:11.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.462995338s
Jan  3 06:46:13.787: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.468629161s
Jan  3 06:46:15.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.463811144s
Jan  3 06:46:17.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.463668848s
Jan  3 06:46:19.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.463767194s
Jan  3 06:46:21.783: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.464033036s
Jan  3 06:46:23.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.463143361s
Jan  3 06:46:25.783: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.464097505s
Jan  3 06:46:27.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.463531205s
Jan  3 06:46:29.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.463022675s
Jan  3 06:46:31.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.463604245s
Jan  3 06:46:33.783: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.463941302s
Jan  3 06:46:35.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.4634369s
Jan  3 06:46:37.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.463537988s
Jan  3 06:46:39.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.463715373s
Jan  3 06:46:41.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.46311749s
Jan  3 06:46:43.783: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.463847328s
Jan  3 06:46:45.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.463535426s
Jan  3 06:46:47.783: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.463826118s
Jan  3 06:46:49.783: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.463986931s
Jan  3 06:46:51.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.463427562s
Jan  3 06:46:53.784: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.465311398s
Jan  3 06:46:55.788: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.46890657s
Jan  3 06:46:57.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.463173277s
Jan  3 06:46:59.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.462973989s
Jan  3 06:47:01.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.463352142s
Jan  3 06:47:03.781: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.462770406s
Jan  3 06:47:05.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.463023927s
Jan  3 06:47:07.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.463616414s
Jan  3 06:47:09.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.463220363s
Jan  3 06:47:11.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.463347355s
Jan  3 06:47:13.783: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.464641626s
Jan  3 06:47:15.783: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.464322325s
Jan  3 06:47:17.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.462984002s
Jan  3 06:47:19.784: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.464905099s
Jan  3 06:47:21.785: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.466504957s
Jan  3 06:47:23.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.462869982s
Jan  3 06:47:25.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.462837167s
Jan  3 06:47:27.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.463670001s
Jan  3 06:47:29.783: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.463847481s
Jan  3 06:47:31.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.463547457s
Jan  3 06:47:33.781: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.462765719s
Jan  3 06:47:35.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.46374674s
Jan  3 06:47:37.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.463705269s
Jan  3 06:47:39.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.462841933s
Jan  3 06:47:41.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.463496661s
Jan  3 06:47:43.781: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.462715438s
Jan  3 06:47:45.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.463785036s
Jan  3 06:47:47.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.463566011s
Jan  3 06:47:49.783: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.464305438s
Jan  3 06:47:51.783: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.464790526s
Jan  3 06:47:53.783: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.464542513s
Jan  3 06:47:55.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.463607714s
Jan  3 06:47:57.784: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.464852489s
Jan  3 06:47:59.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.463485155s
Jan  3 06:48:01.783: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.464688689s
Jan  3 06:48:03.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.463512468s
Jan  3 06:48:05.781: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.462637531s
Jan  3 06:48:07.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.463384658s
Jan  3 06:48:09.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.463651258s
Jan  3 06:48:11.783: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.463922738s
Jan  3 06:48:13.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.463577547s
Jan  3 06:48:15.783: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.463914274s
Jan  3 06:48:17.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.463705405s
Jan  3 06:48:19.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.463742755s
Jan  3 06:48:21.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.46335638s
Jan  3 06:48:23.782: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.463081547s
Jan  3 06:48:24.012: INFO: Pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.69362671s
Jan  3 06:48:24.012: INFO: Unexpected error: 
    <*errors.errorString | 0xc005308230>: {
        s: "pod \"pod-9d10df65-59e8-4966-a058-376431a1bbfe\" is not Running: timed out while waiting for pod fsgroupchangepolicy-2239/pod-9d10df65-59e8-4966-a058-376431a1bbfe to be running",
    }
Jan  3 06:48:24.013: FAIL: pod "pod-9d10df65-59e8-4966-a058-376431a1bbfe" is not Running: timed out while waiting for pod fsgroupchangepolicy-2239/pod-9d10df65-59e8-4966-a058-376431a1bbfe to be running

Full Stack Trace
k8s.io/kubernetes/test/e2e/storage/testsuites.createPodAndVerifyContentGid(0xc001702f00, 0xc004f35e10, 0x0, {0xc005c8c858, 0x4}, {0xc005c8c85c, 0x4})
	test/e2e/storage/testsuites/fsgroupchangepolicy.go:258 +0x151
k8s.io/kubernetes/test/e2e/storage/testsuites.(*fsGroupChangePolicyTestSuite).DefineTests.func3()
	test/e2e/storage/testsuites/fsgroupchangepolicy.go:247 +0x556
�[1mSTEP:�[0m Deleting pvc �[38;5;243m01/03/23 06:48:24.013�[0m
Jan  3 06:48:24.474: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.com884th"
Jan  3 06:48:24.707: INFO: Waiting up to 5m0s for PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf to get deleted
Jan  3 06:48:24.938: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (230.925829ms)
Jan  3 06:48:30.170: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (5.462986805s)
Jan  3 06:48:35.401: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (10.693975011s)
Jan  3 06:48:40.633: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (15.925964668s)
Jan  3 06:48:45.864: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (21.157354303s)
Jan  3 06:48:51.096: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (26.389517309s)
Jan  3 06:48:56.328: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (31.621441533s)
Jan  3 06:49:01.564: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (36.85726125s)
Jan  3 06:49:06.795: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (42.088283187s)
Jan  3 06:49:12.026: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (47.319344541s)
Jan  3 06:49:17.258: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (52.551149256s)
Jan  3 06:49:22.489: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (57.782775354s)
Jan  3 06:49:27.722: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (1m3.014866376s)
Jan  3 06:49:32.953: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (1m8.24623612s)
Jan  3 06:49:38.184: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (1m13.477083614s)
Jan  3 06:49:43.415: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (1m18.708218135s)
Jan  3 06:49:48.646: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (1m23.939570663s)
Jan  3 06:49:53.877: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (1m29.170778608s)
Jan  3 06:49:59.109: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (1m34.402286643s)
Jan  3 06:50:04.341: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (1m39.633882667s)
Jan  3 06:50:09.572: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (1m44.865611359s)
Jan  3 06:50:14.804: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (1m50.096794684s)
Jan  3 06:50:20.035: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (1m55.328292255s)
Jan  3 06:50:25.266: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (2m0.559705057s)
Jan  3 06:50:30.498: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (2m5.790856182s)
Jan  3 06:50:35.729: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (2m11.022347211s)
Jan  3 06:50:40.961: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (2m16.254244328s)
Jan  3 06:50:46.192: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (2m21.485439762s)
Jan  3 06:50:51.424: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (2m26.716807162s)
Jan  3 06:50:56.655: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (2m31.948309727s)
Jan  3 06:51:01.886: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (2m37.179196754s)
Jan  3 06:51:07.118: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (2m42.411510594s)
Jan  3 06:51:12.350: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (2m47.643620326s)
Jan  3 06:51:17.582: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (2m52.875381136s)
Jan  3 06:51:22.814: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (2m58.107169809s)
Jan  3 06:51:28.045: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (3m3.337990411s)
Jan  3 06:51:33.277: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (3m8.569803009s)
Jan  3 06:51:38.508: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (3m13.801322158s)
Jan  3 06:51:43.742: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (3m19.035345996s)
Jan  3 06:51:48.974: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (3m24.266866187s)
Jan  3 06:51:54.205: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (3m29.498339686s)
Jan  3 06:51:59.440: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (3m34.733128279s)
Jan  3 06:52:04.676: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (3m39.96944091s)
Jan  3 06:52:09.908: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (3m45.200904772s)
Jan  3 06:52:15.139: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (3m50.431856271s)
Jan  3 06:52:20.370: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (3m55.662990106s)
Jan  3 06:52:25.601: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (4m0.89443792s)
Jan  3 06:52:30.832: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (4m6.125057331s)
Jan  3 06:52:36.064: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (4m11.357479018s)
Jan  3 06:52:41.296: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (4m16.589132203s)
Jan  3 06:52:46.527: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (4m21.820276722s)
Jan  3 06:52:51.759: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (4m27.052329154s)
Jan  3 06:52:56.992: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (4m32.285655268s)
Jan  3 06:53:02.224: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (4m37.517033589s)
Jan  3 06:53:07.455: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (4m42.748028278s)
Jan  3 06:53:12.686: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (4m47.979172626s)
Jan  3 06:53:17.917: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (4m53.210676559s)
Jan  3 06:53:23.149: INFO: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf found and phase=Bound (4m58.442577471s)
�[1mSTEP:�[0m Deleting sc �[38;5;243m01/03/23 06:53:28.149�[0m
Jan  3 06:53:28.388: INFO: Unexpected error: while cleanup resource: 
    <errors.aggregate | len:1, cap:1>: [
        <errors.aggregate | len:1, cap:1>[
            <*fmt.wrapError | 0xc00517c400>{
                msg: "persistent Volume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf not deleted by dynamic provisioner: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf still exists within 5m0s",
                err: <*errors.errorString | 0xc0011db050>{
                    s: "PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf still exists within 5m0s",
                },
            },
        ],
    ]
Jan  3 06:53:28.388: FAIL: while cleanup resource: persistent Volume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf not deleted by dynamic provisioner: PersistentVolume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf still exists within 5m0s

Full Stack Trace
k8s.io/kubernetes/test/e2e/storage/testsuites.(*fsGroupChangePolicyTestSuite).DefineTests.func2()
	test/e2e/storage/testsuites/fsgroupchangepolicy.go:128 +0x14e
panic({0x70eb680, 0xc0004992d0})
	/usr/local/go/src/runtime/panic.go:884 +0x212
k8s.io/kubernetes/test/e2e/framework.Fail({0xc0056e0000, 0xae}, {0xc002583c30?, 0xc0056e0000?, 0xc002583c58?})
	test/e2e/framework/log.go:61 +0x145
k8s.io/kubernetes/test/e2e/framework.ExpectNoErrorWithOffset(0x1, {0x7fa4200, 0xc005308230}, {0x0?, 0x2?, 0x0?})
	test/e2e/framework/expect.go:76 +0x267
k8s.io/kubernetes/test/e2e/framework.ExpectNoError(...)
	test/e2e/framework/expect.go:43
k8s.io/kubernetes/test/e2e/storage/testsuites.createPodAndVerifyContentGid(0xc001702f00, 0xc004f35e10, 0x0, {0xc005c8c858, 0x4}, {0xc005c8c85c, 0x4})
	test/e2e/storage/testsuites/fsgroupchangepolicy.go:258 +0x151
k8s.io/kubernetes/test/e2e/storage/testsuites.(*fsGroupChangePolicyTestSuite).DefineTests.func3()
	test/e2e/storage/testsuites/fsgroupchangepolicy.go:247 +0x556
[AfterEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  test/e2e/framework/node/init/init.go:32
Jan  3 06:53:28.388: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/03/23 06:53:28.62�[0m
�[1mSTEP:�[0m Collecting events from namespace "fsgroupchangepolicy-2239". �[38;5;243m01/03/23 06:53:28.62�[0m
�[1mSTEP:�[0m Found 24 events. �[38;5;243m01/03/23 06:53:28.852�[0m
Jan  3 06:53:28.852: INFO: At 2023-01-03 06:43:01 +0000 UTC - event for ebs.csi.aws.com884th: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding
Jan  3 06:53:28.852: INFO: At 2023-01-03 06:43:02 +0000 UTC - event for ebs.csi.aws.com884th: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "ebs.csi.aws.com" or manually created by system administrator
Jan  3 06:53:28.852: INFO: At 2023-01-03 06:43:02 +0000 UTC - event for ebs.csi.aws.com884th: {ebs.csi.aws.com_ebs-csi-controller-89b649c94-4zgt2_1779730c-5257-4aff-9d90-5eac067bcce9 } Provisioning: External provisioner is provisioning volume for claim "fsgroupchangepolicy-2239/ebs.csi.aws.com884th"
Jan  3 06:53:28.852: INFO: At 2023-01-03 06:43:05 +0000 UTC - event for ebs.csi.aws.com884th: {ebs.csi.aws.com_ebs-csi-controller-89b649c94-4zgt2_1779730c-5257-4aff-9d90-5eac067bcce9 } ProvisioningSucceeded: Successfully provisioned volume pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf
Jan  3 06:53:28.852: INFO: At 2023-01-03 06:43:06 +0000 UTC - event for pod-d1f9b429-7157-46da-88b6-a01fe6c4b9fc: {default-scheduler } Scheduled: Successfully assigned fsgroupchangepolicy-2239/pod-d1f9b429-7157-46da-88b6-a01fe6c4b9fc to i-0887927f295dab249
Jan  3 06:53:28.852: INFO: At 2023-01-03 06:43:08 +0000 UTC - event for pod-d1f9b429-7157-46da-88b6-a01fe6c4b9fc: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-cab7d570-e3a8-4802-9e06-04516e4e40cf" 
Jan  3 06:53:28.852: INFO: At 2023-01-03 06:43:12 +0000 UTC - event for pod-d1f9b429-7157-46da-88b6-a01fe6c4b9fc: {kubelet i-0887927f295dab249} Started: Started container write-pod
Jan  3 06:53:28.852: INFO: At 2023-01-03 06:43:12 +0000 UTC - event for pod-d1f9b429-7157-46da-88b6-a01fe6c4b9fc: {kubelet i-0887927f295dab249} Created: Created container write-pod
Jan  3 06:53:28.852: INFO: At 2023-01-03 06:43:12 +0000 UTC - event for pod-d1f9b429-7157-46da-88b6-a01fe6c4b9fc: {kubelet i-0887927f295dab249} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine
Jan  3 06:53:28.852: INFO: At 2023-01-03 06:43:20 +0000 UTC - event for pod-d1f9b429-7157-46da-88b6-a01fe6c4b9fc: {kubelet i-0887927f295dab249} Killing: Stopping container write-pod
Jan  3 06:53:28.852: INFO: At 2023-01-03 06:43:23 +0000 UTC - event for pod-9d10df65-59e8-4966-a058-376431a1bbfe: {default-scheduler } Scheduled: Successfully assigned fsgroupchangepolicy-2239/pod-9d10df65-59e8-4966-a058-376431a1bbfe to i-0887927f295dab249
Jan  3 06:53:28.852: INFO: At 2023-01-03 06:43:32 +0000 UTC - event for pod-9d10df65-59e8-4966-a058-376431a1bbfe: {kubelet i-0887927f295dab249} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "7223173e0a839d3c610650f2d3ec2b393035378f4f56eedf37d9b97b7d0fb0c4": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:53:28.852: INFO: At 2023-01-03 06:43:45 +0000 UTC - event for pod-9d10df65-59e8-4966-a058-376431a1bbfe: {kubelet i-0887927f295dab249} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ff1429c133b9a602258c3f7559618f95367e46f53bf8060659fbed3f49488058": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:53:28.852: INFO: At 2023-01-03 06:44:00 +0000 UTC - event for pod-9d10df65-59e8-4966-a058-376431a1bbfe: {kubelet i-0887927f295dab249} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "c266e6aba78cc73106a6b74716b2c72042ed03f5a81d6e2f166f64b35234a0cc": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:53:28.852: INFO: At 2023-01-03 06:44:14 +0000 UTC - event for pod-9d10df65-59e8-4966-a058-376431a1bbfe: {kubelet i-0887927f295dab249} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "6175d04f4693d382910fbd903f0958a407a579dc865bbee2db59136816b7fe82": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:53:28.852: INFO: At 2023-01-03 06:44:26 +0000 UTC - event for pod-9d10df65-59e8-4966-a058-376431a1bbfe: {kubelet i-0887927f295dab249} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a1704bb20c356ca410cf17c8099455a61ffed064cabf688ca14c7c363f4b6f16": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:53:28.852: INFO: At 2023-01-03 06:44:40 +0000 UTC - event for pod-9d10df65-59e8-4966-a058-376431a1bbfe: {kubelet i-0887927f295dab249} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "7e3fc998ebb31e5e837f29d77abf2305c4bae4f0c0d9b4dac168e9e9b9ffb77d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:53:28.852: INFO: At 2023-01-03 06:44:55 +0000 UTC - event for pod-9d10df65-59e8-4966-a058-376431a1bbfe: {kubelet i-0887927f295dab249} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "1e447fbed525a8ca3a8e024c5a95e95a595e762811c3c59a2116a68dc6071cf6": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:53:28.852: INFO: At 2023-01-03 06:45:09 +0000 UTC - event for pod-9d10df65-59e8-4966-a058-376431a1bbfe: {kubelet i-0887927f295dab249} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "c0d36747896c5674313a5d6ad901675cdb0dde84f4a6cee1baf4a4913d298bc1": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:53:28.852: INFO: At 2023-01-03 06:45:21 +0000 UTC - event for pod-9d10df65-59e8-4966-a058-376431a1bbfe: {kubelet i-0887927f295dab249} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "c5605cacda137d32801a242db4f219dc8f907769de8095ac5a676c124255ae28": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:53:28.852: INFO: At 2023-01-03 06:45:33 +0000 UTC - event for pod-9d10df65-59e8-4966-a058-376431a1bbfe: {kubelet i-0887927f295dab249} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "50f957e9c0f272751d3eb0a7ef0c9017ef873428b682a63b7ed81541382b6aba": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:53:28.852: INFO: At 2023-01-03 06:48:40 +0000 UTC - event for pod-9d10df65-59e8-4966-a058-376431a1bbfe: {kubelet i-0887927f295dab249} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine
Jan  3 06:53:28.852: INFO: At 2023-01-03 06:48:40 +0000 UTC - event for pod-9d10df65-59e8-4966-a058-376431a1bbfe: {kubelet i-0887927f295dab249} Created: Created container write-pod
Jan  3 06:53:28.852: INFO: At 2023-01-03 06:48:40 +0000 UTC - event for pod-9d10df65-59e8-4966-a058-376431a1bbfe: {kubelet i-0887927f295dab249} Started: Started container write-pod
Jan  3 06:53:29.083: INFO: POD                                       NODE                 PHASE    GRACE  CONDITIONS
Jan  3 06:53:29.083: INFO: pod-9d10df65-59e8-4966-a058-376431a1bbfe  i-0887927f295dab249  Running         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-03 06:43:23 +0000 UTC  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-01-03 06:48:40 +0000 UTC  } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-01-03 06:48:40 +0000 UTC  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-03 06:43:23 +0000 UTC  }]
Jan  3 06:53:29.083: INFO: 
Jan  3 06:53:29.550: INFO: 
Logging node info for node i-0116ec5cfa0915363
Jan  3 06:53:29.781: INFO: Node Info: &Node{ObjectMeta:{i-0116ec5cfa0915363    845a5e73-b93d-4679-a025-6403fe91469b 35934 0 2023-01-03 06:24:27 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0116ec5cfa0915363 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:ap-south-1a topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.51.97 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0116ec5cfa0915363"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-03 06:24:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-03 06:24:54 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:25:11 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-03 06:25:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-03 06:25:13 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-03 06:52:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0116ec5cfa0915363,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892301824 0} {<nil>} 3801076Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787444224 0} {<nil>} 3698676Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-03 06:52:32 +0000 UTC,LastTransitionTime:2023-01-03 06:24:21 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-03 06:52:32 +0000 UTC,LastTransitionTime:2023-01-03 06:24:21 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-03 06:52:32 +0000 UTC,LastTransitionTime:2023-01-03 06:24:21 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-03 06:52:32 +0000 UTC,LastTransitionTime:2023-01-03 06:25:11 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.51.97,},NodeAddress{Type:ExternalIP,Address:35.154.4.55,},NodeAddress{Type:InternalDNS,Address:i-0116ec5cfa0915363.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0116ec5cfa0915363.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-154-4-55.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec291a4b21ade93e02dbfdea9af30b8c,SystemUUID:ec291a4b-21ad-e93e-02db-fdea9af30b8c,BootID:3cd177e4-da3b-4287-b5dc-70d163e7dd13,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.0],SizeBytes:135162323,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.0],SizeBytes:124991801,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.0],SizeBytes:57657656,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43446388,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42805548,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4967304,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan  3 06:53:29.781: INFO: 
Logging kubelet events for node i-0116ec5cfa0915363
Jan  3 06:53:30.015: INFO: 
Logging pods the kubelet thinks is on node i-0116ec5cfa0915363
Jan  3 06:53:30.254: INFO: etcd-manager-events-i-0116ec5cfa0915363 started at 2023-01-03 06:23:51 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:30.254: INFO: 	Container etcd-manager ready: true, restart count 0
Jan  3 06:53:30.254: INFO: kube-apiserver-i-0116ec5cfa0915363 started at 2023-01-03 06:23:51 +0000 UTC (0+2 container statuses recorded)
Jan  3 06:53:30.254: INFO: 	Container healthcheck ready: true, restart count 0
Jan  3 06:53:30.254: INFO: 	Container kube-apiserver ready: true, restart count 1
Jan  3 06:53:30.254: INFO: kube-controller-manager-i-0116ec5cfa0915363 started at 2023-01-03 06:23:51 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:30.254: INFO: 	Container kube-controller-manager ready: true, restart count 2
Jan  3 06:53:30.254: INFO: kube-scheduler-i-0116ec5cfa0915363 started at 2023-01-03 06:23:51 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:30.254: INFO: 	Container kube-scheduler ready: true, restart count 0
Jan  3 06:53:30.254: INFO: kops-controller-9t2zt started at 2023-01-03 06:24:59 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:30.254: INFO: 	Container kops-controller ready: true, restart count 0
Jan  3 06:53:30.254: INFO: cilium-npb6w started at 2023-01-03 06:24:59 +0000 UTC (1+1 container statuses recorded)
Jan  3 06:53:30.254: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  3 06:53:30.254: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  3 06:53:30.254: INFO: aws-cloud-controller-manager-mvsjr started at 2023-01-03 06:24:59 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:30.254: INFO: 	Container aws-cloud-controller-manager ready: true, restart count 0
Jan  3 06:53:30.254: INFO: ebs-csi-node-pg7l9 started at 2023-01-03 06:24:59 +0000 UTC (0+3 container statuses recorded)
Jan  3 06:53:30.254: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  3 06:53:30.254: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:53:30.254: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:53:30.254: INFO: dns-controller-69987775c6-rgd5s started at 2023-01-03 06:25:00 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:30.254: INFO: 	Container dns-controller ready: true, restart count 0
Jan  3 06:53:30.254: INFO: etcd-manager-main-i-0116ec5cfa0915363 started at 2023-01-03 06:23:51 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:30.254: INFO: 	Container etcd-manager ready: true, restart count 0
Jan  3 06:53:30.254: INFO: cilium-operator-5dd44dc49f-nzbgs started at 2023-01-03 06:25:00 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:30.254: INFO: 	Container cilium-operator ready: true, restart count 0
Jan  3 06:53:30.254: INFO: ebs-csi-controller-89b649c94-4zgt2 started at 2023-01-03 06:25:00 +0000 UTC (0+5 container statuses recorded)
Jan  3 06:53:30.254: INFO: 	Container csi-attacher ready: true, restart count 0
Jan  3 06:53:30.254: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  3 06:53:30.254: INFO: 	Container csi-resizer ready: true, restart count 0
Jan  3 06:53:30.254: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  3 06:53:30.254: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:53:31.009: INFO: 
Latency metrics for node i-0116ec5cfa0915363
Jan  3 06:53:31.009: INFO: 
Logging node info for node i-06675ed9fdf15131e
Jan  3 06:53:31.240: INFO: Node Info: &Node{ObjectMeta:{i-06675ed9fdf15131e    6a365a73-a0a0-47e1-83ac-1dd53dc6cb56 37303 0 2023-01-03 06:26:03 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kubernetes.io/arch:amd64 kubernetes.io/hostname:i-06675ed9fdf15131e kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-06675ed9fdf15131e topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.34.128 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-7351":"i-06675ed9fdf15131e","ebs.csi.aws.com":"i-06675ed9fdf15131e"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-03 06:26:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-03 06:26:03 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-03 06:26:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-03 06:26:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:26:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:52:35 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-03 06:53:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-06675ed9fdf15131e,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-03 06:52:34 +0000 UTC,LastTransitionTime:2023-01-03 06:26:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-03 06:52:34 +0000 UTC,LastTransitionTime:2023-01-03 06:26:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-03 06:52:34 +0000 UTC,LastTransitionTime:2023-01-03 06:26:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-03 06:52:34 +0000 UTC,LastTransitionTime:2023-01-03 06:26:18 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.34.128,},NodeAddress{Type:ExternalIP,Address:13.233.53.249,},NodeAddress{Type:InternalDNS,Address:i-06675ed9fdf15131e.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-06675ed9fdf15131e.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-233-53-249.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec278d28e0e8aa5f9f5a88afed4c7357,SystemUUID:ec278d28-e0e8-aa5f-9f5a-88afed4c7357,BootID:60717d56-76f8-4838-8bb7-4a4ce6867c70,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-7351^1b3035d4-8b33-11ed-9d87-42bca2bad564],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-7351^1b3035d4-8b33-11ed-9d87-42bca2bad564,DevicePath:,},},Config:nil,},}
Jan  3 06:53:31.241: INFO: 
Logging kubelet events for node i-06675ed9fdf15131e
Jan  3 06:53:31.474: INFO: 
Logging pods the kubelet thinks is on node i-06675ed9fdf15131e
Jan  3 06:53:31.947: INFO: csi-mockplugin-0 started at 2023-01-03 06:51:49 +0000 UTC (0+3 container statuses recorded)
Jan  3 06:53:31.947: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  3 06:53:31.947: INFO: 	Container driver-registrar ready: true, restart count 0
Jan  3 06:53:31.947: INFO: 	Container mock ready: true, restart count 0
Jan  3 06:53:31.947: INFO: csi-mockplugin-attacher-0 started at 2023-01-03 06:51:50 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:31.947: INFO: 	Container csi-attacher ready: true, restart count 0
Jan  3 06:53:31.947: INFO: simpletest.rc-qrnzz started at 2023-01-03 06:52:56 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:31.947: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:31.947: INFO: simpletest.rc-kpgd9 started at 2023-01-03 06:52:56 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:31.947: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:31.947: INFO: hostexec-i-06675ed9fdf15131e-chd9q started at 2023-01-03 06:52:57 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:31.947: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  3 06:53:31.947: INFO: cilium-88fm4 started at 2023-01-03 06:26:04 +0000 UTC (1+1 container statuses recorded)
Jan  3 06:53:31.947: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  3 06:53:31.947: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  3 06:53:31.947: INFO: simpletest.rc-kb5zv started at 2023-01-03 06:52:53 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:31.947: INFO: 	Container nginx ready: true, restart count 0
Jan  3 06:53:31.947: INFO: simpletest.rc-24wzs started at 2023-01-03 06:52:54 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:31.947: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:31.947: INFO: simpletest.rc-bqb4x started at 2023-01-03 06:52:53 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:31.947: INFO: 	Container nginx ready: true, restart count 0
Jan  3 06:53:31.947: INFO: simpletest.rc-8prx4 started at 2023-01-03 06:52:54 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:31.947: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:31.947: INFO: simpletest.rc-54h77 started at 2023-01-03 06:52:55 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:31.947: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:31.947: INFO: simpletest.rc-59cv2 started at 2023-01-03 06:52:56 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:31.947: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:31.947: INFO: simpletest.rc-86m2c started at 2023-01-03 06:52:56 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:31.947: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:31.947: INFO: pod-subpath-test-preprovisionedpv-5hc4 started at 2023-01-03 06:53:30 +0000 UTC (0+2 container statuses recorded)
Jan  3 06:53:31.947: INFO: 	Container test-container-subpath-preprovisionedpv-5hc4 ready: false, restart count 0
Jan  3 06:53:31.947: INFO: 	Container test-container-volume-preprovisionedpv-5hc4 ready: false, restart count 0
Jan  3 06:53:31.947: INFO: coredns-autoscaler-7cb5c5b969-tg22d started at 2023-01-03 06:26:18 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:31.947: INFO: 	Container autoscaler ready: true, restart count 0
Jan  3 06:53:31.947: INFO: simpletest.rc-8dgch started at 2023-01-03 06:52:53 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:31.947: INFO: 	Container nginx ready: true, restart count 0
Jan  3 06:53:31.947: INFO: pvc-volume-tester-rpthj started at 2023-01-03 06:51:54 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:31.947: INFO: 	Container volume-tester ready: true, restart count 0
Jan  3 06:53:31.947: INFO: simpletest.rc-6q4xx started at 2023-01-03 06:52:53 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:31.947: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:31.947: INFO: simpletest.rc-pvcvv started at 2023-01-03 06:52:55 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:31.947: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:31.947: INFO: simpletest.rc-t75t7 started at 2023-01-03 06:52:53 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:31.947: INFO: 	Container nginx ready: true, restart count 0
Jan  3 06:53:31.947: INFO: simpletest.rc-v4c88 started at 2023-01-03 06:52:53 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:31.947: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:31.947: INFO: simpletest.rc-dd6m2 started at 2023-01-03 06:52:55 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:31.947: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:31.947: INFO: ebs-csi-node-q24xb started at 2023-01-03 06:26:04 +0000 UTC (0+3 container statuses recorded)
Jan  3 06:53:31.947: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  3 06:53:31.947: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:53:31.947: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:53:31.947: INFO: simpletest.rc-kk7rx started at 2023-01-03 06:52:53 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:31.947: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:31.947: INFO: simpletest.rc-cg9fj started at 2023-01-03 06:52:54 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:31.947: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:31.947: INFO: simpletest.rc-shr24 started at 2023-01-03 06:52:55 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:31.947: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:31.947: INFO: netserver-0 started at 2023-01-03 06:53:11 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:31.947: INFO: 	Container webserver ready: false, restart count 0
Jan  3 06:53:31.947: INFO: coredns-559769c974-xh6r4 started at 2023-01-03 06:26:18 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:31.947: INFO: 	Container coredns ready: true, restart count 0
Jan  3 06:53:31.947: INFO: netserver-0 started at 2023-01-03 06:52:34 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:31.947: INFO: 	Container webserver ready: true, restart count 0
Jan  3 06:53:31.947: INFO: simpletest.rc-n6hn2 started at 2023-01-03 06:52:53 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:31.947: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:31.947: INFO: simpletest.rc-ggcqr started at 2023-01-03 06:52:54 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:31.947: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:31.947: INFO: simpletest.rc-s872p started at 2023-01-03 06:52:56 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:31.947: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:31.947: INFO: simpletest.rc-zlqvv started at 2023-01-03 06:52:53 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:31.947: INFO: 	Container nginx ready: true, restart count 0
Jan  3 06:53:31.947: INFO: simpletest.rc-qj6d7 started at 2023-01-03 06:52:53 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:31.947: INFO: 	Container nginx ready: true, restart count 0
Jan  3 06:53:31.947: INFO: simpletest.rc-jk5fv started at 2023-01-03 06:52:54 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:31.947: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:31.947: INFO: simpletest.rc-rngmg started at 2023-01-03 06:52:55 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:31.947: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:32.751: INFO: 
Latency metrics for node i-06675ed9fdf15131e
Jan  3 06:53:32.751: INFO: 
Logging node info for node i-0887927f295dab249
Jan  3 06:53:32.983: INFO: Node Info: &Node{ObjectMeta:{i-0887927f295dab249    8c537f9f-6ce2-4eae-a273-3e5dec0f5a97 37420 0 2023-01-03 06:26:08 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0887927f295dab249 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-0887927f295dab249 topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.43.47 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0887927f295dab249"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:53:06 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-03 06:53:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0887927f295dab249,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-03 06:53:13 +0000 UTC,LastTransitionTime:2023-01-03 06:26:08 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-03 06:53:13 +0000 UTC,LastTransitionTime:2023-01-03 06:26:08 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-03 06:53:13 +0000 UTC,LastTransitionTime:2023-01-03 06:26:08 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-03 06:53:13 +0000 UTC,LastTransitionTime:2023-01-03 06:26:24 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.43.47,},NodeAddress{Type:ExternalIP,Address:65.0.96.201,},NodeAddress{Type:InternalDNS,Address:i-0887927f295dab249.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0887927f295dab249.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-65-0-96-201.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2d5f1c251f05fc398417508c564588,SystemUUID:ec2d5f1c-251f-05fc-3984-17508c564588,BootID:80a76b6c-5e81-478d-a15c-92ab635eebdb,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0747fe00dd5d5923d kubernetes.io/csi/ebs.csi.aws.com^vol-095c197bc6d09f134],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-095c197bc6d09f134,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0747fe00dd5d5923d,DevicePath:,},},Config:nil,},}
Jan  3 06:53:32.983: INFO: 
Logging kubelet events for node i-0887927f295dab249
Jan  3 06:53:33.216: INFO: 
Logging pods the kubelet thinks is on node i-0887927f295dab249
Jan  3 06:53:33.457: INFO: bin-false767209ab-3023-43dd-ad12-f8ba3d4639eb started at 2023-01-03 06:53:16 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:33.457: INFO: 	Container bin-false767209ab-3023-43dd-ad12-f8ba3d4639eb ready: false, restart count 0
Jan  3 06:53:33.457: INFO: simpletest.rc-4nl7j started at 2023-01-03 06:52:53 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:33.457: INFO: 	Container nginx ready: true, restart count 0
Jan  3 06:53:33.457: INFO: simpletest.rc-9snhv started at 2023-01-03 06:52:54 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:33.457: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:33.457: INFO: simpletest.rc-t2gs6 started at 2023-01-03 06:52:56 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:33.457: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:33.457: INFO: httpd started at 2023-01-03 06:52:58 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:33.457: INFO: 	Container httpd ready: false, restart count 0
Jan  3 06:53:33.457: INFO: pod-9d10df65-59e8-4966-a058-376431a1bbfe started at 2023-01-03 06:43:23 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:33.457: INFO: 	Container write-pod ready: true, restart count 0
Jan  3 06:53:33.457: INFO: funny-ip-54v2p started at 2023-01-03 06:52:45 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:33.457: INFO: 	Container funny-ip ready: true, restart count 0
Jan  3 06:53:33.457: INFO: simpletest.rc-hf7kn started at 2023-01-03 06:52:53 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:33.457: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:33.457: INFO: simpletest.rc-x2rgt started at 2023-01-03 06:52:53 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:33.457: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:33.457: INFO: simpletest.rc-rbwmc started at 2023-01-03 06:52:54 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:33.457: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:33.457: INFO: pod-1 started at 2023-01-03 06:52:41 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:33.457: INFO: 	Container donothing ready: true, restart count 0
Jan  3 06:53:33.457: INFO: simpletest.rc-56vqj started at 2023-01-03 06:52:55 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:33.457: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:33.457: INFO: simpletest.rc-xjj2k started at 2023-01-03 06:52:55 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:33.457: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:33.457: INFO: simpletest.rc-w5jnn started at 2023-01-03 06:52:55 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:33.457: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:33.457: INFO: simpletest.rc-7chgz started at 2023-01-03 06:52:55 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:33.457: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:33.457: INFO: test-container-pod started at 2023-01-03 06:53:09 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:33.457: INFO: 	Container webserver ready: false, restart count 0
Jan  3 06:53:33.457: INFO: simpletest.rc-vtwth started at 2023-01-03 06:52:53 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:33.457: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:33.457: INFO: simpletest.rc-5n944 started at 2023-01-03 06:52:56 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:33.457: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:33.457: INFO: netserver-1 started at 2023-01-03 06:53:11 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:33.457: INFO: 	Container webserver ready: false, restart count 0
Jan  3 06:53:33.457: INFO: ebs-csi-node-22htr started at 2023-01-03 06:26:09 +0000 UTC (0+3 container statuses recorded)
Jan  3 06:53:33.457: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  3 06:53:33.457: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:53:33.457: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:53:33.457: INFO: simpletest.rc-8m544 started at 2023-01-03 06:52:53 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:33.457: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:33.457: INFO: simpletest.rc-rqtcr started at 2023-01-03 06:52:53 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:33.457: INFO: 	Container nginx ready: true, restart count 0
Jan  3 06:53:33.457: INFO: liveness-3a3c9a51-a4c7-44c1-8901-5e866b399768 started at 2023-01-03 06:51:36 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:33.457: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  3 06:53:33.457: INFO: simpletest.rc-54b85 started at 2023-01-03 06:52:54 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:33.457: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:33.457: INFO: simpletest.rc-z27nr started at 2023-01-03 06:52:56 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:33.457: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:33.457: INFO: simpletest.rc-hpwng started at 2023-01-03 06:52:56 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:33.457: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:33.457: INFO: simpletest.rc-pj2zs started at 2023-01-03 06:52:53 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:33.457: INFO: 	Container nginx ready: true, restart count 0
Jan  3 06:53:33.457: INFO: simpletest.rc-zb49l started at 2023-01-03 06:52:53 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:33.457: INFO: 	Container nginx ready: true, restart count 0
Jan  3 06:53:33.457: INFO: simpletest.rc-jj9cx started at 2023-01-03 06:52:53 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:33.457: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:33.457: INFO: simpletest.rc-hn4hb started at 2023-01-03 06:52:54 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:33.457: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:33.457: INFO: pod-configmaps-9eb13546-35b6-4cfc-a5ab-462699d627d1 started at 2023-01-03 06:52:58 +0000 UTC (0+2 container statuses recorded)
Jan  3 06:53:33.457: INFO: 	Container agnhost-container ready: false, restart count 0
Jan  3 06:53:33.457: INFO: 	Container configmap-volume-binary-test ready: false, restart count 0
Jan  3 06:53:33.457: INFO: cilium-s9l8s started at 2023-01-03 06:26:09 +0000 UTC (1+1 container statuses recorded)
Jan  3 06:53:33.457: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  3 06:53:33.457: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  3 06:53:33.457: INFO: ss-0 started at 2023-01-03 06:53:04 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:33.457: INFO: 	Container webserver ready: false, restart count 0
Jan  3 06:53:33.457: INFO: pod-projected-secrets-38d48380-4b20-4c9b-be8a-dea82f01f63f started at 2023-01-03 06:53:22 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:33.457: INFO: 	Container projected-secret-volume-test ready: false, restart count 0
Jan  3 06:53:33.457: INFO: simpletest.rc-zx46s started at 2023-01-03 06:52:54 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:33.457: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:33.457: INFO: pod-2 started at 2023-01-03 06:52:41 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:33.457: INFO: 	Container donothing ready: true, restart count 0
Jan  3 06:53:33.457: INFO: netserver-1 started at 2023-01-03 06:52:34 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:33.457: INFO: 	Container webserver ready: true, restart count 0
Jan  3 06:53:33.457: INFO: simpletest.rc-j98jg started at 2023-01-03 06:52:53 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:33.457: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:33.457: INFO: simpletest.rc-gxhvr started at 2023-01-03 06:52:56 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:33.457: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:33.457: INFO: labelsupdate81f79f9e-c79c-4add-af18-ce32c636b4fa started at 2023-01-03 06:53:22 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:33.457: INFO: 	Container client-container ready: false, restart count 0
Jan  3 06:53:33.457: INFO: simpletest.rc-wmnbr started at 2023-01-03 06:52:53 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:33.457: INFO: 	Container nginx ready: true, restart count 0
Jan  3 06:53:34.336: INFO: 
Latency metrics for node i-0887927f295dab249
Jan  3 06:53:34.336: INFO: 
Logging node info for node i-0c4c153cc3021d728
Jan  3 06:53:34.567: INFO: Node Info: &Node{ObjectMeta:{i-0c4c153cc3021d728    0fc330cf-9a4f-4650-8df2-bbc4962562bf 37661 0 2023-01-03 06:26:07 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0c4c153cc3021d728 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-0c4c153cc3021d728 topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.34.232 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0c4c153cc3021d728"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-03 06:26:07 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-03 06:26:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-03 06:26:07 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:26:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-03 06:26:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-01-03 06:53:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0c4c153cc3021d728,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-03 06:53:30 +0000 UTC,LastTransitionTime:2023-01-03 06:26:07 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-03 06:53:30 +0000 UTC,LastTransitionTime:2023-01-03 06:26:07 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-03 06:53:30 +0000 UTC,LastTransitionTime:2023-01-03 06:26:07 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-03 06:53:30 +0000 UTC,LastTransitionTime:2023-01-03 06:26:23 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.34.232,},NodeAddress{Type:ExternalIP,Address:13.232.119.101,},NodeAddress{Type:InternalDNS,Address:i-0c4c153cc3021d728.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0c4c153cc3021d728.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-232-119-101.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec20ee6ab34ca9da624dd2e5f8c44780,SystemUUID:ec20ee6a-b34c-a9da-624d-d2e5f8c44780,BootID:960d66c3-58ec-4ea0-a76c-db5eb00e743c,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan  3 06:53:34.568: INFO: 
Logging kubelet events for node i-0c4c153cc3021d728
Jan  3 06:53:34.801: INFO: 
Logging pods the kubelet thinks is on node i-0c4c153cc3021d728
Jan  3 06:53:35.046: INFO: simpletest.rc-56nsg started at 2023-01-03 06:52:53 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:35.046: INFO: 	Container nginx ready: true, restart count 0
Jan  3 06:53:35.046: INFO: simpletest.rc-82wg8 started at 2023-01-03 06:52:53 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:35.046: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:35.046: INFO: simpletest.rc-p9blv started at 2023-01-03 06:52:55 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:35.046: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:35.046: INFO: simpletest.rc-fcsbp started at 2023-01-03 06:52:56 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:35.046: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:35.046: INFO: netserver-2 started at 2023-01-03 06:53:12 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:35.046: INFO: 	Container webserver ready: false, restart count 0
Jan  3 06:53:35.046: INFO: hostexec-i-0c4c153cc3021d728-q9qpr started at 2023-01-03 06:53:07 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:35.046: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  3 06:53:35.046: INFO: my-hostname-basic-8a8967ef-5e6f-43f6-972b-5474b81f9416-9zz7w started at 2023-01-03 06:53:31 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:35.046: INFO: 	Container my-hostname-basic-8a8967ef-5e6f-43f6-972b-5474b81f9416 ready: false, restart count 0
Jan  3 06:53:35.046: INFO: simpletest.rc-l6rnw started at 2023-01-03 06:52:53 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:35.046: INFO: 	Container nginx ready: true, restart count 0
Jan  3 06:53:35.046: INFO: simpletest.rc-q9ltb started at 2023-01-03 06:52:53 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:35.046: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:35.046: INFO: simpletest.rc-s4md9 started at 2023-01-03 06:52:53 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:35.046: INFO: 	Container nginx ready: true, restart count 0
Jan  3 06:53:35.046: INFO: simpletest.rc-gnv2b started at 2023-01-03 06:52:54 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:35.046: INFO: 	Container nginx ready: true, restart count 0
Jan  3 06:53:35.046: INFO: simpletest.rc-xpvkp started at 2023-01-03 06:52:56 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:35.046: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:35.046: INFO: ebs-csi-node-5sgcl started at 2023-01-03 06:26:08 +0000 UTC (0+3 container statuses recorded)
Jan  3 06:53:35.046: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  3 06:53:35.046: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:53:35.046: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:53:35.046: INFO: simpletest.rc-z5fqh started at 2023-01-03 06:52:53 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:35.046: INFO: 	Container nginx ready: true, restart count 0
Jan  3 06:53:35.046: INFO: simpletest.rc-dw228 started at 2023-01-03 06:52:53 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:35.046: INFO: 	Container nginx ready: true, restart count 0
Jan  3 06:53:35.046: INFO: simpletest.rc-sz6f5 started at 2023-01-03 06:52:54 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:35.046: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:35.046: INFO: hostexec-i-0c4c153cc3021d728-sb94h started at 2023-01-03 06:52:59 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:35.046: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  3 06:53:35.046: INFO: local-injector started at 2023-01-03 06:53:32 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:35.046: INFO: 	Container local-injector ready: false, restart count 0
Jan  3 06:53:35.046: INFO: simpletest.rc-p75df started at 2023-01-03 06:52:53 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:35.046: INFO: 	Container nginx ready: true, restart count 0
Jan  3 06:53:35.046: INFO: simpletest.rc-22f9m started at 2023-01-03 06:52:54 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:35.046: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:35.046: INFO: simpletest.rc-h2lfr started at 2023-01-03 06:52:55 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:35.046: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:35.046: INFO: explicit-nonroot-uid started at 2023-01-03 06:53:17 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:35.046: INFO: 	Container explicit-nonroot-uid ready: false, restart count 0
Jan  3 06:53:35.046: INFO: netserver-2 started at 2023-01-03 06:52:34 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:35.046: INFO: 	Container webserver ready: true, restart count 0
Jan  3 06:53:35.046: INFO: simpletest.rc-2h4f7 started at 2023-01-03 06:52:54 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:35.046: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:35.046: INFO: simpletest.rc-h9kh7 started at 2023-01-03 06:52:55 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:35.046: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:35.046: INFO: pod-projected-configmaps-0eb1fd38-b050-41bc-91f7-ebde22755825 started at 2023-01-03 06:51:56 +0000 UTC (0+3 container statuses recorded)
Jan  3 06:53:35.046: INFO: 	Container createcm-volume-test ready: true, restart count 0
Jan  3 06:53:35.046: INFO: 	Container delcm-volume-test ready: true, restart count 0
Jan  3 06:53:35.046: INFO: 	Container updcm-volume-test ready: true, restart count 0
Jan  3 06:53:35.046: INFO: simpletest.rc-zzhvc started at 2023-01-03 06:52:56 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:35.046: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:35.046: INFO: simpletest.rc-qw94t started at 2023-01-03 06:52:56 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:35.046: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:35.046: INFO: cilium-87m98 started at 2023-01-03 06:26:08 +0000 UTC (1+1 container statuses recorded)
Jan  3 06:53:35.046: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  3 06:53:35.046: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  3 06:53:35.046: INFO: simpletest.rc-2s2m4 started at 2023-01-03 06:52:53 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:35.046: INFO: 	Container nginx ready: true, restart count 0
Jan  3 06:53:35.046: INFO: simpletest.rc-4l8nm started at 2023-01-03 06:52:53 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:35.046: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:35.046: INFO: simpletest.rc-dsvm2 started at 2023-01-03 06:52:55 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:35.046: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:35.046: INFO: simpletest.rc-vjzbs started at 2023-01-03 06:52:56 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:35.046: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:35.046: INFO: test-recreate-deployment-795566c5cb-stkm7 started at 2023-01-03 06:53:15 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:35.046: INFO: 	Container agnhost ready: false, restart count 0
Jan  3 06:53:35.046: INFO: pod-subpath-test-preprovisionedpv-hgpz started at 2023-01-03 06:53:30 +0000 UTC (1+2 container statuses recorded)
Jan  3 06:53:35.046: INFO: 	Init container test-init-subpath-preprovisionedpv-hgpz ready: false, restart count 0
Jan  3 06:53:35.046: INFO: 	Container test-container-subpath-preprovisionedpv-hgpz ready: false, restart count 0
Jan  3 06:53:35.046: INFO: 	Container test-container-volume-preprovisionedpv-hgpz ready: false, restart count 0
Jan  3 06:53:35.046: INFO: simpletest.rc-627th started at 2023-01-03 06:52:53 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:35.046: INFO: 	Container nginx ready: true, restart count 0
Jan  3 06:53:35.046: INFO: simpletest.rc-w8nqf started at 2023-01-03 06:52:54 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:35.046: INFO: 	Container nginx ready: true, restart count 0
Jan  3 06:53:35.046: INFO: simpletest.rc-bxd8s started at 2023-01-03 06:52:55 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:35.046: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:35.046: INFO: downwardapi-volume-d521703b-57c0-49d3-8b19-439e73425e2c started at 2023-01-03 06:53:13 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:35.046: INFO: 	Container client-container ready: false, restart count 0
Jan  3 06:53:35.866: INFO: 
Latency metrics for node i-0c4c153cc3021d728
Jan  3 06:53:35.866: INFO: 
Logging node info for node i-0f6d4ea509bfe3fbe
Jan  3 06:53:36.097: INFO: Node Info: &Node{ObjectMeta:{i-0f6d4ea509bfe3fbe    d3d92523-9fe9-40c0-96cf-7de8a708f9e5 35683 0 2023-01-03 06:26:08 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0f6d4ea509bfe3fbe kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-0f6d4ea509bfe3fbe topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.56.168 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0f6d4ea509bfe3fbe"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-01-03 06:52:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0f6d4ea509bfe3fbe,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-03 06:52:09 +0000 UTC,LastTransitionTime:2023-01-03 06:26:08 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-03 06:52:09 +0000 UTC,LastTransitionTime:2023-01-03 06:26:08 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-03 06:52:09 +0000 UTC,LastTransitionTime:2023-01-03 06:26:08 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-03 06:52:09 +0000 UTC,LastTransitionTime:2023-01-03 06:26:23 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.56.168,},NodeAddress{Type:ExternalIP,Address:15.206.145.14,},NodeAddress{Type:InternalDNS,Address:i-0f6d4ea509bfe3fbe.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0f6d4ea509bfe3fbe.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-206-145-14.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2eebc156cceaa5905e74ada30878dd,SystemUUID:ec2eebc1-56cc-eaa5-905e-74ada30878dd,BootID:d561d40a-625b-4fa0-ad51-87e12466f6e1,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan  3 06:53:36.098: INFO: 
Logging kubelet events for node i-0f6d4ea509bfe3fbe
Jan  3 06:53:36.331: INFO: 
Logging pods the kubelet thinks is on node i-0f6d4ea509bfe3fbe
Jan  3 06:53:36.570: INFO: execpoddttrn started at 2023-01-03 06:52:48 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:36.570: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  3 06:53:36.570: INFO: simpletest.rc-wtnr5 started at 2023-01-03 06:52:53 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:36.570: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:36.570: INFO: simpletest.rc-vnrbp started at 2023-01-03 06:52:54 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:36.570: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:36.570: INFO: simpletest.rc-flc2p started at 2023-01-03 06:52:56 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:36.570: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:36.570: INFO: simpletest.rc-zsdgr started at 2023-01-03 06:52:56 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:36.570: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:36.570: INFO: simpletest.rc-vr7bx started at 2023-01-03 06:52:53 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:36.570: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:36.570: INFO: simpletest.rc-qbfpg started at 2023-01-03 06:52:53 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:36.570: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:36.570: INFO: simpletest.rc-fjq6c started at 2023-01-03 06:52:55 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:36.570: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:36.570: INFO: simpletest.rc-b646n started at 2023-01-03 06:52:53 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:36.570: INFO: 	Container nginx ready: true, restart count 0
Jan  3 06:53:36.570: INFO: simpletest.rc-nt267 started at 2023-01-03 06:52:54 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:36.570: INFO: 	Container nginx ready: true, restart count 0
Jan  3 06:53:36.570: INFO: simpletest.rc-7mhvx started at 2023-01-03 06:52:55 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:36.570: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:36.570: INFO: simpletest.rc-2zplr started at 2023-01-03 06:52:56 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:36.570: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:36.570: INFO: simpletest.rc-lscnv started at 2023-01-03 06:52:53 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:36.570: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:36.570: INFO: inline-volume-lwc5l started at 2023-01-03 06:52:07 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:36.570: INFO: 	Container volume-tester ready: false, restart count 0
Jan  3 06:53:36.570: INFO: pod-0 started at 2023-01-03 06:52:40 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:36.570: INFO: 	Container donothing ready: true, restart count 0
Jan  3 06:53:36.570: INFO: simpletest.rc-vx7xw started at 2023-01-03 06:52:53 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:36.570: INFO: 	Container nginx ready: true, restart count 0
Jan  3 06:53:36.570: INFO: busybox-1bb6bafe-acde-45a9-afbb-daaeec008096 started at 2023-01-03 06:52:49 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:36.570: INFO: 	Container busybox ready: true, restart count 0
Jan  3 06:53:36.570: INFO: simpletest.rc-2q9tb started at 2023-01-03 06:52:53 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:36.570: INFO: 	Container nginx ready: true, restart count 0
Jan  3 06:53:36.570: INFO: simpletest.rc-wz2rb started at 2023-01-03 06:52:54 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:36.570: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:36.570: INFO: simpletest.rc-bllvp started at 2023-01-03 06:52:53 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:36.570: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:36.570: INFO: ebs-csi-node-78dfk started at 2023-01-03 06:26:09 +0000 UTC (0+3 container statuses recorded)
Jan  3 06:53:36.570: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  3 06:53:36.570: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:53:36.570: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:53:36.570: INFO: cilium-cd88p started at 2023-01-03 06:26:09 +0000 UTC (1+1 container statuses recorded)
Jan  3 06:53:36.570: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  3 06:53:36.570: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  3 06:53:36.570: INFO: netserver-3 started at 2023-01-03 06:52:34 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:36.570: INFO: 	Container webserver ready: true, restart count 0
Jan  3 06:53:36.570: INFO: simpletest.rc-lgsxm started at 2023-01-03 06:52:53 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:36.570: INFO: 	Container nginx ready: true, restart count 0
Jan  3 06:53:36.570: INFO: simpletest.rc-jdpbq started at 2023-01-03 06:52:54 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:36.570: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:36.570: INFO: simpletest.rc-4mlzv started at 2023-01-03 06:52:54 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:36.570: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:36.570: INFO: simpletest.rc-bxbcv started at 2023-01-03 06:52:55 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:36.570: INFO: 	Container nginx ready: true, restart count 0
Jan  3 06:53:36.570: INFO: simpletest.rc-z5z7t started at 2023-01-03 06:52:55 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:36.570: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:36.570: INFO: simpletest.rc-2b2jv started at 2023-01-03 06:52:56 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:36.570: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:36.570: INFO: netserver-3 started at 2023-01-03 06:53:12 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:36.570: INFO: 	Container webserver ready: false, restart count 0
Jan  3 06:53:36.570: INFO: coredns-559769c974-ls78k started at 2023-01-03 06:26:47 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:36.570: INFO: 	Container coredns ready: true, restart count 0
Jan  3 06:53:36.570: INFO: httpd started at 2023-01-03 06:52:38 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:36.570: INFO: 	Container httpd ready: true, restart count 0
Jan  3 06:53:36.570: INFO: simpletest.rc-t7gbh started at 2023-01-03 06:52:53 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:36.570: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:36.570: INFO: simpletest.rc-pkplm started at 2023-01-03 06:52:55 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:53:36.570: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:53:37.370: INFO: 
Latency metrics for node i-0f6d4ea509bfe3fbe
[DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "fsgroupchangepolicy-2239" for this suite. �[38;5;243m01/03/23 06:53:37.37�[0m

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-auth] ServiceAccounts should mount projected service account token [Conformance] 5m12s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-auth\]\sServiceAccounts\sshould\smount\sprojected\sservice\saccount\stoken\s\[Conformance\]$'

test/e2e/framework/pod/output/output.go:237
k8s.io/kubernetes/test/e2e/framework/pod/output.TestContainerOutputMatcher(0x761c035?, {0x7616b36?, 0xc004ffbf48?}, 0xc001f3d680, 0x0, {0xc00135bf28, 0x1, 0x1}, 0x2?)
	test/e2e/framework/pod/output/output.go:237 +0x176
k8s.io/kubernetes/test/e2e/framework/pod/output.TestContainerOutputRegexp(...)
	test/e2e/framework/pod/output/output.go:221
k8s.io/kubernetes/test/e2e/auth.glob..func5.4()
	test/e2e/auth/service_accounts.go:320 +0x41a
				[BeforeEach] [sig-auth] ServiceAccounts
  set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/03/23 06:42:37.382�[0m
Jan  3 06:42:37.382: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename svcaccounts �[38;5;243m01/03/23 06:42:37.383�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/03/23 06:42:38.087�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/03/23 06:42:38.554�[0m
[BeforeEach] [sig-auth] ServiceAccounts
  test/e2e/framework/metrics/init/init.go:31
[It] should mount projected service account token [Conformance]
  test/e2e/auth/service_accounts.go:275
�[1mSTEP:�[0m Creating a pod to test service account token:  �[38;5;243m01/03/23 06:42:39.021�[0m
Jan  3 06:42:39.259: INFO: Waiting up to 5m0s for pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d" in namespace "svcaccounts-6425" to be "Succeeded or Failed"
Jan  3 06:42:39.493: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 234.763343ms
Jan  3 06:42:41.730: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 2.471052034s
Jan  3 06:42:43.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 4.469735934s
Jan  3 06:42:45.729: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 6.47018761s
Jan  3 06:42:47.729: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 8.470093341s
Jan  3 06:42:49.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 10.469794277s
Jan  3 06:42:51.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 12.469346639s
Jan  3 06:42:53.729: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 14.470073806s
Jan  3 06:42:55.734: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 16.475728998s
Jan  3 06:42:57.729: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 18.469835452s
Jan  3 06:42:59.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 20.469386878s
Jan  3 06:43:01.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 22.469084905s
Jan  3 06:43:03.729: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 24.470599552s
Jan  3 06:43:05.730: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 26.470907039s
Jan  3 06:43:07.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 28.46955872s
Jan  3 06:43:09.731: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 30.472232484s
Jan  3 06:43:11.731: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 32.472202246s
Jan  3 06:43:13.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 34.469280651s
Jan  3 06:43:15.729: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 36.46992272s
Jan  3 06:43:17.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 38.469180174s
Jan  3 06:43:19.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 40.46927752s
Jan  3 06:43:21.729: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 42.469883299s
Jan  3 06:43:23.729: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 44.469999653s
Jan  3 06:43:25.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 46.469623819s
Jan  3 06:43:27.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 48.469300332s
Jan  3 06:43:29.731: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 50.472320761s
Jan  3 06:43:31.731: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 52.472693562s
Jan  3 06:43:33.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 54.469538255s
Jan  3 06:43:35.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 56.469740289s
Jan  3 06:43:37.733: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 58.47387791s
Jan  3 06:43:39.729: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.470342656s
Jan  3 06:43:41.729: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.469844995s
Jan  3 06:43:43.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.469284096s
Jan  3 06:43:45.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.469598058s
Jan  3 06:43:47.730: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.471418194s
Jan  3 06:43:49.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.469155673s
Jan  3 06:43:51.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.469325259s
Jan  3 06:43:53.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.46888632s
Jan  3 06:43:55.727: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.468602336s
Jan  3 06:43:57.730: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.471341052s
Jan  3 06:43:59.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.46889255s
Jan  3 06:44:01.730: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.471668584s
Jan  3 06:44:03.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.469667188s
Jan  3 06:44:05.730: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.471782842s
Jan  3 06:44:07.727: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.468457924s
Jan  3 06:44:09.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.469729176s
Jan  3 06:44:11.731: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.47254504s
Jan  3 06:44:13.729: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.470225478s
Jan  3 06:44:15.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.469590911s
Jan  3 06:44:17.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.469281659s
Jan  3 06:44:19.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.469637794s
Jan  3 06:44:21.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.469246978s
Jan  3 06:44:23.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.469270376s
Jan  3 06:44:25.729: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.469850034s
Jan  3 06:44:27.729: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.47023724s
Jan  3 06:44:29.734: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.475495967s
Jan  3 06:44:31.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.469807148s
Jan  3 06:44:33.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.469398037s
Jan  3 06:44:35.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.469076973s
Jan  3 06:44:37.730: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.470818116s
Jan  3 06:44:39.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.46930554s
Jan  3 06:44:41.729: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.469937242s
Jan  3 06:44:43.739: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.480675508s
Jan  3 06:44:45.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.469683901s
Jan  3 06:44:47.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.469448499s
Jan  3 06:44:49.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.469579603s
Jan  3 06:44:51.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.469702173s
Jan  3 06:44:53.731: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.472382951s
Jan  3 06:44:55.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.469486616s
Jan  3 06:44:57.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.468844754s
Jan  3 06:44:59.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.469257433s
Jan  3 06:45:01.729: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.469879388s
Jan  3 06:45:03.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.469241867s
Jan  3 06:45:05.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.469034158s
Jan  3 06:45:07.727: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.468476979s
Jan  3 06:45:09.727: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.468798256s
Jan  3 06:45:11.727: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.468541998s
Jan  3 06:45:13.730: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.470985522s
Jan  3 06:45:15.727: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.468792764s
Jan  3 06:45:17.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.469186271s
Jan  3 06:45:19.730: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.470829167s
Jan  3 06:45:21.731: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.471970727s
Jan  3 06:45:23.727: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.468488631s
Jan  3 06:45:25.727: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.468664818s
Jan  3 06:45:27.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.469112062s
Jan  3 06:45:29.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.469032925s
Jan  3 06:45:31.729: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.470157682s
Jan  3 06:45:33.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.469335763s
Jan  3 06:45:35.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.46945203s
Jan  3 06:45:37.727: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.468655191s
Jan  3 06:45:39.727: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.468762888s
Jan  3 06:45:41.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.46893763s
Jan  3 06:45:43.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.469287568s
Jan  3 06:45:45.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.468873191s
Jan  3 06:45:47.727: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.468657484s
Jan  3 06:45:49.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.469253767s
Jan  3 06:45:51.727: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.468744162s
Jan  3 06:45:53.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.468840683s
Jan  3 06:45:55.727: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.468746472s
Jan  3 06:45:57.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.469285067s
Jan  3 06:45:59.727: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.46874833s
Jan  3 06:46:01.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.469678781s
Jan  3 06:46:03.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.46916312s
Jan  3 06:46:05.727: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.468693103s
Jan  3 06:46:07.727: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.468688725s
Jan  3 06:46:09.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.469478758s
Jan  3 06:46:11.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.469402804s
Jan  3 06:46:13.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.468938763s
Jan  3 06:46:15.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.469267759s
Jan  3 06:46:17.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.468851982s
Jan  3 06:46:19.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.46962195s
Jan  3 06:46:21.727: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.46867407s
Jan  3 06:46:23.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.46920176s
Jan  3 06:46:25.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.469289199s
Jan  3 06:46:27.727: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.468606891s
Jan  3 06:46:29.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.469014374s
Jan  3 06:46:31.736: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.477014829s
Jan  3 06:46:33.727: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.468770548s
Jan  3 06:46:35.729: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.469983565s
Jan  3 06:46:37.727: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.468782227s
Jan  3 06:46:39.727: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.468642337s
Jan  3 06:46:41.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.469037444s
Jan  3 06:46:43.731: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.471864681s
Jan  3 06:46:45.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.468934962s
Jan  3 06:46:47.727: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.468718894s
Jan  3 06:46:49.732: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.473043604s
Jan  3 06:46:51.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.469235642s
Jan  3 06:46:53.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.469009041s
Jan  3 06:46:55.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.469044498s
Jan  3 06:46:57.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.469149755s
Jan  3 06:46:59.729: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.470062284s
Jan  3 06:47:01.729: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.469891216s
Jan  3 06:47:03.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.468828751s
Jan  3 06:47:05.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.469472185s
Jan  3 06:47:07.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.469069014s
Jan  3 06:47:09.729: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.470725578s
Jan  3 06:47:11.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.469068138s
Jan  3 06:47:13.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.469329921s
Jan  3 06:47:15.732: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.473330977s
Jan  3 06:47:17.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.46894301s
Jan  3 06:47:19.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.468999976s
Jan  3 06:47:21.731: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.472110002s
Jan  3 06:47:23.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.469556952s
Jan  3 06:47:25.731: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.472252151s
Jan  3 06:47:27.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.468935726s
Jan  3 06:47:29.727: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.468362212s
Jan  3 06:47:31.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.469045018s
Jan  3 06:47:33.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.469597798s
Jan  3 06:47:35.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.46891735s
Jan  3 06:47:37.728: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.469348465s
Jan  3 06:47:39.729: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.46982289s
Jan  3 06:47:39.962: INFO: Pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.703544615s
Jan  3 06:47:40.431: INFO: Failed to get logs from node "i-0887927f295dab249" pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d" container "agnhost-container": the server rejected our request for an unknown reason (get pods test-pod-8f8b0f25-9283-406c-a37f-7b953461815d)
�[1mSTEP:�[0m delete the pod �[38;5;243m01/03/23 06:47:40.431�[0m
Jan  3 06:47:40.670: INFO: Waiting for pod test-pod-8f8b0f25-9283-406c-a37f-7b953461815d to disappear
Jan  3 06:47:40.904: INFO: Pod test-pod-8f8b0f25-9283-406c-a37f-7b953461815d no longer exists
Jan  3 06:47:40.904: INFO: Unexpected error: 
    <*errors.errorString | 0xc000f7a610>: {
        s: "expected pod \"test-pod-8f8b0f25-9283-406c-a37f-7b953461815d\" success: timed out while waiting for pod svcaccounts-6425/test-pod-8f8b0f25-9283-406c-a37f-7b953461815d to be Succeeded or Failed",
    }
Jan  3 06:47:40.904: FAIL: expected pod "test-pod-8f8b0f25-9283-406c-a37f-7b953461815d" success: timed out while waiting for pod svcaccounts-6425/test-pod-8f8b0f25-9283-406c-a37f-7b953461815d to be Succeeded or Failed

Full Stack Trace
k8s.io/kubernetes/test/e2e/framework/pod/output.TestContainerOutputMatcher(0x761c035?, {0x7616b36?, 0xc004ffbf48?}, 0xc001f3d680, 0x0, {0xc00135bf28, 0x1, 0x1}, 0x2?)
	test/e2e/framework/pod/output/output.go:237 +0x176
k8s.io/kubernetes/test/e2e/framework/pod/output.TestContainerOutputRegexp(...)
	test/e2e/framework/pod/output/output.go:221
k8s.io/kubernetes/test/e2e/auth.glob..func5.4()
	test/e2e/auth/service_accounts.go:320 +0x41a
[AfterEach] [sig-auth] ServiceAccounts
  test/e2e/framework/node/init/init.go:32
Jan  3 06:47:40.905: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-auth] ServiceAccounts
  test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-auth] ServiceAccounts
  dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/03/23 06:47:41.14�[0m
�[1mSTEP:�[0m Collecting events from namespace "svcaccounts-6425". �[38;5;243m01/03/23 06:47:41.14�[0m
�[1mSTEP:�[0m Found 11 events. �[38;5;243m01/03/23 06:47:41.374�[0m
Jan  3 06:47:41.374: INFO: At 2023-01-03 06:42:39 +0000 UTC - event for test-pod-8f8b0f25-9283-406c-a37f-7b953461815d: {default-scheduler } Scheduled: Successfully assigned svcaccounts-6425/test-pod-8f8b0f25-9283-406c-a37f-7b953461815d to i-0887927f295dab249
Jan  3 06:47:41.374: INFO: At 2023-01-03 06:42:40 +0000 UTC - event for test-pod-8f8b0f25-9283-406c-a37f-7b953461815d: {kubelet i-0887927f295dab249} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "f182ae1f4a9e013e7818adfb6304aa48c726c1b5795eb405584a25df699e6534": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:47:41.374: INFO: At 2023-01-03 06:42:54 +0000 UTC - event for test-pod-8f8b0f25-9283-406c-a37f-7b953461815d: {kubelet i-0887927f295dab249} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "4bf676148b5adee8e9f392de30abe450f7feea7632696f3b8ef489ac9e0804f3": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:47:41.374: INFO: At 2023-01-03 06:43:07 +0000 UTC - event for test-pod-8f8b0f25-9283-406c-a37f-7b953461815d: {kubelet i-0887927f295dab249} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d0d968496b598e86c57b9b897e0d5b8b1453f36535e68462c260e3dff6b9d981": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:47:41.374: INFO: At 2023-01-03 06:43:20 +0000 UTC - event for test-pod-8f8b0f25-9283-406c-a37f-7b953461815d: {kubelet i-0887927f295dab249} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "db5ee3677657c14c7b9aa5c906cb6897aad9bdedde121ad9c0ccc54bd33b7748": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:47:41.374: INFO: At 2023-01-03 06:43:32 +0000 UTC - event for test-pod-8f8b0f25-9283-406c-a37f-7b953461815d: {kubelet i-0887927f295dab249} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "41959af15bae66b09f4846e32e8b19d761c1eaf757d759e228b516a9a9f5fe60": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:47:41.374: INFO: At 2023-01-03 06:43:43 +0000 UTC - event for test-pod-8f8b0f25-9283-406c-a37f-7b953461815d: {kubelet i-0887927f295dab249} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "8b751e5d56f934fca7432d8f979884069dd3d4e767a8fe36218f7ae3a5c7f623": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:47:41.374: INFO: At 2023-01-03 06:43:56 +0000 UTC - event for test-pod-8f8b0f25-9283-406c-a37f-7b953461815d: {kubelet i-0887927f295dab249} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "0e93c4f258f84e4b0b5b1bf12ef4ed129e6b3da7a61bc512ad5bce914da5f6e9": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:47:41.374: INFO: At 2023-01-03 06:44:09 +0000 UTC - event for test-pod-8f8b0f25-9283-406c-a37f-7b953461815d: {kubelet i-0887927f295dab249} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "765f4a40f9f4e9ec842b6c951764851711ef44d46a80ccbd9234c17229154973": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:47:41.374: INFO: At 2023-01-03 06:44:23 +0000 UTC - event for test-pod-8f8b0f25-9283-406c-a37f-7b953461815d: {kubelet i-0887927f295dab249} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "8e6b82c4a260aac4daddc01016e8fc9cf2f9771a48e09e6d64bae6b796238b82": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:47:41.374: INFO: At 2023-01-03 06:44:38 +0000 UTC - event for test-pod-8f8b0f25-9283-406c-a37f-7b953461815d: {kubelet i-0887927f295dab249} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "85a9806e061fe3a74f400c2e98b3b1753aecb2b72ce12d3a1a2978bfdc6805c1": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:47:41.607: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Jan  3 06:47:41.607: INFO: 
Jan  3 06:47:41.842: INFO: 
Logging node info for node i-0116ec5cfa0915363
Jan  3 06:47:42.076: INFO: Node Info: &Node{ObjectMeta:{i-0116ec5cfa0915363    845a5e73-b93d-4679-a025-6403fe91469b 30693 0 2023-01-03 06:24:27 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0116ec5cfa0915363 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:ap-south-1a topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.51.97 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0116ec5cfa0915363"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-03 06:24:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-03 06:24:54 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:25:11 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-03 06:25:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-03 06:25:13 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-03 06:47:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0116ec5cfa0915363,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892301824 0} {<nil>} 3801076Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787444224 0} {<nil>} 3698676Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-03 06:47:26 +0000 UTC,LastTransitionTime:2023-01-03 06:24:21 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-03 06:47:26 +0000 UTC,LastTransitionTime:2023-01-03 06:24:21 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-03 06:47:26 +0000 UTC,LastTransitionTime:2023-01-03 06:24:21 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-03 06:47:26 +0000 UTC,LastTransitionTime:2023-01-03 06:25:11 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.51.97,},NodeAddress{Type:ExternalIP,Address:35.154.4.55,},NodeAddress{Type:InternalDNS,Address:i-0116ec5cfa0915363.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0116ec5cfa0915363.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-154-4-55.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec291a4b21ade93e02dbfdea9af30b8c,SystemUUID:ec291a4b-21ad-e93e-02db-fdea9af30b8c,BootID:3cd177e4-da3b-4287-b5dc-70d163e7dd13,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.0],SizeBytes:135162323,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.0],SizeBytes:124991801,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.0],SizeBytes:57657656,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43446388,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42805548,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4967304,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan  3 06:47:42.076: INFO: 
Logging kubelet events for node i-0116ec5cfa0915363
Jan  3 06:47:42.312: INFO: 
Logging pods the kubelet thinks is on node i-0116ec5cfa0915363
Jan  3 06:47:42.553: INFO: cilium-npb6w started at 2023-01-03 06:24:59 +0000 UTC (1+1 container statuses recorded)
Jan  3 06:47:42.553: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  3 06:47:42.553: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  3 06:47:42.553: INFO: aws-cloud-controller-manager-mvsjr started at 2023-01-03 06:24:59 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:42.553: INFO: 	Container aws-cloud-controller-manager ready: true, restart count 0
Jan  3 06:47:42.553: INFO: ebs-csi-node-pg7l9 started at 2023-01-03 06:24:59 +0000 UTC (0+3 container statuses recorded)
Jan  3 06:47:42.553: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  3 06:47:42.553: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:47:42.553: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:47:42.553: INFO: etcd-manager-events-i-0116ec5cfa0915363 started at 2023-01-03 06:23:51 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:42.553: INFO: 	Container etcd-manager ready: true, restart count 0
Jan  3 06:47:42.553: INFO: kube-apiserver-i-0116ec5cfa0915363 started at 2023-01-03 06:23:51 +0000 UTC (0+2 container statuses recorded)
Jan  3 06:47:42.553: INFO: 	Container healthcheck ready: true, restart count 0
Jan  3 06:47:42.553: INFO: 	Container kube-apiserver ready: true, restart count 1
Jan  3 06:47:42.553: INFO: kube-controller-manager-i-0116ec5cfa0915363 started at 2023-01-03 06:23:51 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:42.553: INFO: 	Container kube-controller-manager ready: true, restart count 2
Jan  3 06:47:42.553: INFO: kube-scheduler-i-0116ec5cfa0915363 started at 2023-01-03 06:23:51 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:42.553: INFO: 	Container kube-scheduler ready: true, restart count 0
Jan  3 06:47:42.553: INFO: kops-controller-9t2zt started at 2023-01-03 06:24:59 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:42.553: INFO: 	Container kops-controller ready: true, restart count 0
Jan  3 06:47:42.553: INFO: dns-controller-69987775c6-rgd5s started at 2023-01-03 06:25:00 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:42.553: INFO: 	Container dns-controller ready: true, restart count 0
Jan  3 06:47:42.553: INFO: etcd-manager-main-i-0116ec5cfa0915363 started at 2023-01-03 06:23:51 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:42.553: INFO: 	Container etcd-manager ready: true, restart count 0
Jan  3 06:47:42.553: INFO: cilium-operator-5dd44dc49f-nzbgs started at 2023-01-03 06:25:00 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:42.553: INFO: 	Container cilium-operator ready: true, restart count 0
Jan  3 06:47:42.553: INFO: ebs-csi-controller-89b649c94-4zgt2 started at 2023-01-03 06:25:00 +0000 UTC (0+5 container statuses recorded)
Jan  3 06:47:42.553: INFO: 	Container csi-attacher ready: true, restart count 0
Jan  3 06:47:42.553: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  3 06:47:42.553: INFO: 	Container csi-resizer ready: true, restart count 0
Jan  3 06:47:42.553: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  3 06:47:42.553: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:47:43.335: INFO: 
Latency metrics for node i-0116ec5cfa0915363
Jan  3 06:47:43.335: INFO: 
Logging node info for node i-06675ed9fdf15131e
Jan  3 06:47:43.569: INFO: Node Info: &Node{ObjectMeta:{i-06675ed9fdf15131e    6a365a73-a0a0-47e1-83ac-1dd53dc6cb56 29432 0 2023-01-03 06:26:03 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-06675ed9fdf15131e kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-06675ed9fdf15131e topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.34.128 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-7802":"i-06675ed9fdf15131e","csi-mock-csi-mock-volumes-5893":"i-06675ed9fdf15131e","ebs.csi.aws.com":"i-06675ed9fdf15131e"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-03 06:26:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-03 06:26:03 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-03 06:26:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-03 06:26:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:26:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {e2e.test Update v1 2023-01-03 06:40:01 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:40:12 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-03 06:45:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-06675ed9fdf15131e,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-03 06:45:25 +0000 UTC,LastTransitionTime:2023-01-03 06:26:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-03 06:45:25 +0000 UTC,LastTransitionTime:2023-01-03 06:26:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-03 06:45:25 +0000 UTC,LastTransitionTime:2023-01-03 06:26:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-03 06:45:25 +0000 UTC,LastTransitionTime:2023-01-03 06:26:18 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.34.128,},NodeAddress{Type:ExternalIP,Address:13.233.53.249,},NodeAddress{Type:InternalDNS,Address:i-06675ed9fdf15131e.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-06675ed9fdf15131e.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-233-53-249.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec278d28e0e8aa5f9f5a88afed4c7357,SystemUUID:ec278d28-e0e8-aa5f-9f5a-88afed4c7357,BootID:60717d56-76f8-4838-8bb7-4a4ce6867c70,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-7802^78eb4252-8b31-11ed-a7cd-e699b846bc6a],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-7802^78eb4252-8b31-11ed-a7cd-e699b846bc6a,DevicePath:,},},Config:nil,},}
Jan  3 06:47:43.570: INFO: 
Logging kubelet events for node i-06675ed9fdf15131e
Jan  3 06:47:43.807: INFO: 
Logging pods the kubelet thinks is on node i-06675ed9fdf15131e
Jan  3 06:47:44.053: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-pn6rb started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:44.053: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:44.053: INFO: coredns-autoscaler-7cb5c5b969-tg22d started at 2023-01-03 06:26:18 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:44.053: INFO: 	Container autoscaler ready: true, restart count 0
Jan  3 06:47:44.053: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-bhflv started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:44.053: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:44.053: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-qbds6 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:44.054: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:44.054: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-5qt2b started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:44.054: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:44.054: INFO: csi-hostpathplugin-0 started at 2023-01-03 06:42:46 +0000 UTC (0+7 container statuses recorded)
Jan  3 06:47:44.054: INFO: 	Container csi-attacher ready: false, restart count 0
Jan  3 06:47:44.054: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan  3 06:47:44.054: INFO: 	Container csi-resizer ready: false, restart count 0
Jan  3 06:47:44.054: INFO: 	Container csi-snapshotter ready: false, restart count 0
Jan  3 06:47:44.054: INFO: 	Container hostpath ready: false, restart count 0
Jan  3 06:47:44.054: INFO: 	Container liveness-probe ready: false, restart count 0
Jan  3 06:47:44.054: INFO: 	Container node-driver-registrar ready: false, restart count 0
Jan  3 06:47:44.054: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-kn247 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:44.054: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:44.054: INFO: csi-hostpathplugin-0 started at 2023-01-03 06:43:56 +0000 UTC (0+7 container statuses recorded)
Jan  3 06:47:44.054: INFO: 	Container csi-attacher ready: false, restart count 0
Jan  3 06:47:44.054: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan  3 06:47:44.054: INFO: 	Container csi-resizer ready: false, restart count 0
Jan  3 06:47:44.054: INFO: 	Container csi-snapshotter ready: false, restart count 0
Jan  3 06:47:44.054: INFO: 	Container hostpath ready: false, restart count 0
Jan  3 06:47:44.054: INFO: 	Container liveness-probe ready: false, restart count 0
Jan  3 06:47:44.054: INFO: 	Container node-driver-registrar ready: false, restart count 0
Jan  3 06:47:44.054: INFO: ebs-csi-node-q24xb started at 2023-01-03 06:26:04 +0000 UTC (0+3 container statuses recorded)
Jan  3 06:47:44.054: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  3 06:47:44.054: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:47:44.054: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:47:44.054: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-vkxkf started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:44.054: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:44.054: INFO: csi-mockplugin-0 started at 2023-01-03 06:42:50 +0000 UTC (0+3 container statuses recorded)
Jan  3 06:47:44.054: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  3 06:47:44.054: INFO: 	Container driver-registrar ready: true, restart count 0
Jan  3 06:47:44.054: INFO: 	Container mock ready: true, restart count 0
Jan  3 06:47:44.054: INFO: csi-mockplugin-resizer-0 started at 2023-01-03 06:42:51 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:44.054: INFO: 	Container csi-resizer ready: false, restart count 0
Jan  3 06:47:44.054: INFO: coredns-559769c974-xh6r4 started at 2023-01-03 06:26:18 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:44.054: INFO: 	Container coredns ready: true, restart count 0
Jan  3 06:47:44.054: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-gcftr started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:44.054: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:44.054: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-knmjr started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:44.054: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: false, restart count 0
Jan  3 06:47:44.054: INFO: pvc-volume-tester-tnqg4 started at 2023-01-03 06:43:36 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:44.054: INFO: 	Container volume-tester ready: false, restart count 0
Jan  3 06:47:44.054: INFO: inline-volume-tester-578zd started at 2023-01-03 06:43:56 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:44.054: INFO: 	Container csi-volume-tester ready: false, restart count 0
Jan  3 06:47:44.054: INFO: csi-hostpathplugin-0 started at 2023-01-03 06:39:40 +0000 UTC (0+7 container statuses recorded)
Jan  3 06:47:44.054: INFO: 	Container csi-attacher ready: true, restart count 0
Jan  3 06:47:44.054: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  3 06:47:44.054: INFO: 	Container csi-resizer ready: true, restart count 0
Jan  3 06:47:44.054: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan  3 06:47:44.054: INFO: 	Container hostpath ready: true, restart count 0
Jan  3 06:47:44.054: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:47:44.054: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:47:44.054: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-vmn8b started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:44.054: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:44.054: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-gzk6r started at 2023-01-03 06:40:04 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:44.054: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: false, restart count 0
Jan  3 06:47:44.054: INFO: inline-volume-tester-7frp2 started at 2023-01-03 06:42:47 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:44.054: INFO: 	Container csi-volume-tester ready: false, restart count 0
Jan  3 06:47:44.054: INFO: cilium-88fm4 started at 2023-01-03 06:26:04 +0000 UTC (1+1 container statuses recorded)
Jan  3 06:47:44.054: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  3 06:47:44.054: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  3 06:47:44.054: INFO: hostpath-client started at 2023-01-03 06:40:11 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:44.054: INFO: 	Container hostpath-client ready: false, restart count 0
Jan  3 06:47:44.879: INFO: 
Latency metrics for node i-06675ed9fdf15131e
Jan  3 06:47:44.879: INFO: 
Logging node info for node i-0887927f295dab249
Jan  3 06:47:45.113: INFO: Node Info: &Node{ObjectMeta:{i-0887927f295dab249    8c537f9f-6ce2-4eae-a273-3e5dec0f5a97 30854 0 2023-01-03 06:26:08 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0887927f295dab249 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-0887927f295dab249 topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.43.47 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-7494":"i-0887927f295dab249","ebs.csi.aws.com":"i-0887927f295dab249"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-03 06:40:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-03 06:45:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-01-03 06:47:39 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0887927f295dab249,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-03 06:45:13 +0000 UTC,LastTransitionTime:2023-01-03 06:26:08 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-03 06:45:13 +0000 UTC,LastTransitionTime:2023-01-03 06:26:08 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-03 06:45:13 +0000 UTC,LastTransitionTime:2023-01-03 06:26:08 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-03 06:45:13 +0000 UTC,LastTransitionTime:2023-01-03 06:26:24 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.43.47,},NodeAddress{Type:ExternalIP,Address:65.0.96.201,},NodeAddress{Type:InternalDNS,Address:i-0887927f295dab249.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0887927f295dab249.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-65-0-96-201.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2d5f1c251f05fc398417508c564588,SystemUUID:ec2d5f1c-251f-05fc-3984-17508c564588,BootID:80a76b6c-5e81-478d-a15c-92ab635eebdb,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-7494^2a9b5c2b-8b32-11ed-9a17-02cea9609c51 kubernetes.io/csi/csi-hostpath-ephemeral-7494^2a9f4d2c-8b32-11ed-9a17-02cea9609c51 kubernetes.io/csi/ebs.csi.aws.com^vol-0747fe00dd5d5923d],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-7494^2a9b5c2b-8b32-11ed-9a17-02cea9609c51,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-7494^2a9f4d2c-8b32-11ed-9a17-02cea9609c51,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0747fe00dd5d5923d,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0e0e80dfc2d2b174b,DevicePath:,},},Config:nil,},}
Jan  3 06:47:45.113: INFO: 
Logging kubelet events for node i-0887927f295dab249
Jan  3 06:47:45.349: INFO: 
Logging pods the kubelet thinks is on node i-0887927f295dab249
Jan  3 06:47:45.597: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-m9n4g started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:45.597: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:45.597: INFO: dns-test-71df1669-ca24-4488-bdc2-c2149686db55 started at 2023-01-03 06:46:44 +0000 UTC (0+3 container statuses recorded)
Jan  3 06:47:45.597: INFO: 	Container jessie-querier ready: false, restart count 0
Jan  3 06:47:45.597: INFO: 	Container querier ready: false, restart count 0
Jan  3 06:47:45.597: INFO: 	Container webserver ready: false, restart count 0
Jan  3 06:47:45.597: INFO: startup-33131899-1a42-412a-9a76-c7ee101e12d3 started at 2023-01-03 06:44:39 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:45.597: INFO: 	Container busybox ready: false, restart count 0
Jan  3 06:47:45.597: INFO: cilium-s9l8s started at 2023-01-03 06:26:09 +0000 UTC (1+1 container statuses recorded)
Jan  3 06:47:45.597: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  3 06:47:45.597: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  3 06:47:45.597: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-dbt7p started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:45.597: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:45.597: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-87btk started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:45.597: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:45.597: INFO: csi-hostpathplugin-0 started at 2023-01-03 06:43:44 +0000 UTC (0+7 container statuses recorded)
Jan  3 06:47:45.597: INFO: 	Container csi-attacher ready: true, restart count 0
Jan  3 06:47:45.597: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  3 06:47:45.597: INFO: 	Container csi-resizer ready: true, restart count 0
Jan  3 06:47:45.597: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan  3 06:47:45.597: INFO: 	Container hostpath ready: true, restart count 0
Jan  3 06:47:45.597: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:47:45.597: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:47:45.597: INFO: test-deployment-swhng-54bc444df-8rmgv started at 2023-01-03 06:44:38 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:45.597: INFO: 	Container httpd ready: true, restart count 0
Jan  3 06:47:45.597: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-47hz9 started at 2023-01-03 06:40:04 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:45.597: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:45.597: INFO: pod-projected-configmaps-158e5277-3e7e-4278-a0c2-3078bcbd01de started at 2023-01-03 06:47:24 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:45.597: INFO: 	Container agnhost-container ready: false, restart count 0
Jan  3 06:47:45.597: INFO: pvc-tester-7bfxw started at 2023-01-03 06:47:37 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:45.597: INFO: 	Container write-pod ready: false, restart count 0
Jan  3 06:47:45.597: INFO: pod-9d10df65-59e8-4966-a058-376431a1bbfe started at 2023-01-03 06:43:23 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:45.597: INFO: 	Container write-pod ready: false, restart count 0
Jan  3 06:47:45.597: INFO: pod-adoption-release started at 2023-01-03 06:46:06 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:45.597: INFO: 	Container pod-adoption-release ready: false, restart count 0
Jan  3 06:47:45.597: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-5tzj6 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:45.597: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:45.597: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-qs9vk started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:45.597: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:45.597: INFO: pod-terminate-status-0-1 started at 2023-01-03 06:47:44 +0000 UTC (1+1 container statuses recorded)
Jan  3 06:47:45.597: INFO: 	Init container fail ready: false, restart count 0
Jan  3 06:47:45.597: INFO: 	Container blocked ready: false, restart count 0
Jan  3 06:47:45.597: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-5sjfb started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:45.597: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:45.597: INFO: ss2-0 started at 2023-01-03 06:45:36 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:45.597: INFO: 	Container webserver ready: false, restart count 0
Jan  3 06:47:45.597: INFO: inline-volume-tester-qwfhg started at 2023-01-03 06:45:10 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:45.597: INFO: 	Container csi-volume-tester ready: false, restart count 0
Jan  3 06:47:45.597: INFO: pod-configmaps-6ac65fd0-2362-460b-b401-dc12549b2575 started at 2023-01-03 06:45:42 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:45.597: INFO: 	Container agnhost-container ready: false, restart count 0
Jan  3 06:47:45.597: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-nzbt8 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:45.597: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:45.597: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-kmgz2 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:45.597: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:45.597: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-z8hhz started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:45.597: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:45.597: INFO: ebs-csi-node-22htr started at 2023-01-03 06:26:09 +0000 UTC (0+3 container statuses recorded)
Jan  3 06:47:45.597: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  3 06:47:45.597: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:47:45.597: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:47:46.707: INFO: 
Latency metrics for node i-0887927f295dab249
Jan  3 06:47:46.707: INFO: 
Logging node info for node i-0c4c153cc3021d728
Jan  3 06:47:46.941: INFO: Node Info: &Node{ObjectMeta:{i-0c4c153cc3021d728    0fc330cf-9a4f-4650-8df2-bbc4962562bf 30921 0 2023-01-03 06:26:07 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a io.kubernetes.storage.mock/node:some-mock-node kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0c4c153cc3021d728 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-0c4c153cc3021d728 topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.34.232 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-volume-expand-9886":"i-0c4c153cc3021d728","ebs.csi.aws.com":"i-0c4c153cc3021d728"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-03 06:26:07 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-03 06:26:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-03 06:26:07 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:26:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-03 06:26:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-03 06:40:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:47:40 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-03 06:47:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0c4c153cc3021d728,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-03 06:47:43 +0000 UTC,LastTransitionTime:2023-01-03 06:26:07 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-03 06:47:43 +0000 UTC,LastTransitionTime:2023-01-03 06:26:07 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-03 06:47:43 +0000 UTC,LastTransitionTime:2023-01-03 06:26:07 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-03 06:47:43 +0000 UTC,LastTransitionTime:2023-01-03 06:26:23 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.34.232,},NodeAddress{Type:ExternalIP,Address:13.232.119.101,},NodeAddress{Type:InternalDNS,Address:i-0c4c153cc3021d728.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0c4c153cc3021d728.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-232-119-101.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec20ee6ab34ca9da624dd2e5f8c44780,SystemUUID:ec20ee6a-b34c-a9da-624d-d2e5f8c44780,BootID:960d66c3-58ec-4ea0-a76c-db5eb00e743c,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-volume-expand-9886^4e0f5548-8b32-11ed-8e7f-066d9af4aed6 kubernetes.io/csi/ebs.csi.aws.com^vol-04fbf6323899d3409 kubernetes.io/csi/ebs.csi.aws.com^vol-06acee6733ca9dadc],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-06acee6733ca9dadc,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-volume-expand-9886^4e0f5548-8b32-11ed-8e7f-066d9af4aed6,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-04fbf6323899d3409,DevicePath:,},},Config:nil,},}
Jan  3 06:47:46.942: INFO: 
Logging kubelet events for node i-0c4c153cc3021d728
Jan  3 06:47:47.177: INFO: 
Logging pods the kubelet thinks is on node i-0c4c153cc3021d728
Jan  3 06:47:47.422: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-w8kkx started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:47.422: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:47.422: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-s8mtc started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:47.422: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:47.422: INFO: pod-terminate-status-1-1 started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:47.422: INFO: fail-once-non-local-82rmn started at 2023-01-03 06:44:35 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:47.422: INFO: 	Container c ready: false, restart count 0
Jan  3 06:47:47.422: INFO: fail-once-non-local-jk86f started at 2023-01-03 06:45:06 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:47.422: INFO: 	Container c ready: false, restart count 0
Jan  3 06:47:47.422: INFO: hostexec-i-0c4c153cc3021d728-s292j started at 2023-01-03 06:45:18 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:47.422: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  3 06:47:47.422: INFO: pod-subpath-test-preprovisionedpv-vsdz started at 2023-01-03 06:45:30 +0000 UTC (2+1 container statuses recorded)
Jan  3 06:47:47.422: INFO: 	Init container init-volume-preprovisionedpv-vsdz ready: false, restart count 0
Jan  3 06:47:47.422: INFO: 	Init container test-init-volume-preprovisionedpv-vsdz ready: false, restart count 0
Jan  3 06:47:47.422: INFO: 	Container test-container-subpath-preprovisionedpv-vsdz ready: false, restart count 0
Jan  3 06:47:47.422: INFO: ebs-csi-node-5sgcl started at 2023-01-03 06:26:08 +0000 UTC (0+3 container statuses recorded)
Jan  3 06:47:47.422: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  3 06:47:47.422: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:47:47.422: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:47:47.422: INFO: inline-volume-tester-7m9fg started at 2023-01-03 06:47:37 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:47.422: INFO: 	Container csi-volume-tester ready: false, restart count 0
Jan  3 06:47:47.422: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-4sx4g started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:47.422: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:47.422: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-98hxx started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:47.422: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:47.422: INFO: csi-hostpathplugin-0 started at 2023-01-03 06:45:29 +0000 UTC (0+7 container statuses recorded)
Jan  3 06:47:47.422: INFO: 	Container csi-attacher ready: true, restart count 0
Jan  3 06:47:47.422: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  3 06:47:47.422: INFO: 	Container csi-resizer ready: true, restart count 0
Jan  3 06:47:47.422: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan  3 06:47:47.422: INFO: 	Container hostpath ready: true, restart count 0
Jan  3 06:47:47.422: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:47:47.422: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:47:47.422: INFO: pod-20c75720-f672-49af-b552-0eceef5b318c started at 2023-01-03 06:46:11 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:47.422: INFO: 	Container write-pod ready: false, restart count 0
Jan  3 06:47:47.422: INFO: pod-subpath-test-inlinevolume-z5hb started at 2023-01-03 06:46:53 +0000 UTC (2+2 container statuses recorded)
Jan  3 06:47:47.422: INFO: 	Init container init-volume-inlinevolume-z5hb ready: false, restart count 0
Jan  3 06:47:47.422: INFO: 	Init container test-init-subpath-inlinevolume-z5hb ready: false, restart count 0
Jan  3 06:47:47.422: INFO: 	Container test-container-subpath-inlinevolume-z5hb ready: false, restart count 0
Jan  3 06:47:47.422: INFO: 	Container test-container-volume-inlinevolume-z5hb ready: false, restart count 0
Jan  3 06:47:47.422: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-ljkk6 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:47.422: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:47.422: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-tfhlj started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:47.422: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:47.422: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-44v74 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:47.422: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:47.422: INFO: pod-aabe41ab-4497-45a4-95cb-20ac95d22556 started at 2023-01-03 06:47:41 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:47.422: INFO: 	Container write-pod ready: false, restart count 0
Jan  3 06:47:47.422: INFO: cilium-87m98 started at 2023-01-03 06:26:08 +0000 UTC (1+1 container statuses recorded)
Jan  3 06:47:47.422: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  3 06:47:47.422: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  3 06:47:47.422: INFO: fail-once-non-local-ms76g started at 2023-01-03 06:45:23 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:47.422: INFO: 	Container c ready: false, restart count 0
Jan  3 06:47:47.422: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-fh8hc started at 2023-01-03 06:40:04 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:47.422: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:47.422: INFO: fail-once-non-local-27nz9 started at 2023-01-03 06:45:02 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:47.422: INFO: 	Container c ready: false, restart count 0
Jan  3 06:47:47.422: INFO: fail-once-non-local-wdcck started at 2023-01-03 06:44:35 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:47.422: INFO: 	Container c ready: false, restart count 0
Jan  3 06:47:47.422: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-55wkd started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:47.422: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:47.422: INFO: pod-terminate-status-2-1 started at 2023-01-03 06:47:44 +0000 UTC (1+1 container statuses recorded)
Jan  3 06:47:47.422: INFO: 	Init container fail ready: false, restart count 0
Jan  3 06:47:47.422: INFO: 	Container blocked ready: false, restart count 0
Jan  3 06:47:47.422: INFO: hostexec-i-0c4c153cc3021d728-cfppg started at 2023-01-03 06:47:35 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:47.422: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  3 06:47:47.422: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-l9w98 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:47.422: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:48.229: INFO: 
Latency metrics for node i-0c4c153cc3021d728
Jan  3 06:47:48.229: INFO: 
Logging node info for node i-0f6d4ea509bfe3fbe
Jan  3 06:47:48.463: INFO: Node Info: &Node{ObjectMeta:{i-0f6d4ea509bfe3fbe    d3d92523-9fe9-40c0-96cf-7de8a708f9e5 29995 0 2023-01-03 06:26:08 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0f6d4ea509bfe3fbe kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-0f6d4ea509bfe3fbe topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.56.168 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-1691":"i-0f6d4ea509bfe3fbe","ebs.csi.aws.com":"i-0f6d4ea509bfe3fbe"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-03 06:40:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:41:48 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-03 06:47:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0f6d4ea509bfe3fbe,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-03 06:47:03 +0000 UTC,LastTransitionTime:2023-01-03 06:26:08 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-03 06:47:03 +0000 UTC,LastTransitionTime:2023-01-03 06:26:08 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-03 06:47:03 +0000 UTC,LastTransitionTime:2023-01-03 06:26:08 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-03 06:47:03 +0000 UTC,LastTransitionTime:2023-01-03 06:26:23 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.56.168,},NodeAddress{Type:ExternalIP,Address:15.206.145.14,},NodeAddress{Type:InternalDNS,Address:i-0f6d4ea509bfe3fbe.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0f6d4ea509bfe3fbe.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-206-145-14.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2eebc156cceaa5905e74ada30878dd,SystemUUID:ec2eebc1-56cc-eaa5-905e-74ada30878dd,BootID:d561d40a-625b-4fa0-ad51-87e12466f6e1,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-1691^b1a35b91-8b31-11ed-a7c5-62d1175edcc5],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-1691^b1a35b91-8b31-11ed-a7c5-62d1175edcc5,DevicePath:,},},Config:nil,},}
Jan  3 06:47:48.463: INFO: 
Logging kubelet events for node i-0f6d4ea509bfe3fbe
Jan  3 06:47:48.699: INFO: 
Logging pods the kubelet thinks is on node i-0f6d4ea509bfe3fbe
Jan  3 06:47:48.938: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-7s22g started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:48.938: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:48.938: INFO: csi-hostpathplugin-0 started at 2023-01-03 06:41:05 +0000 UTC (0+7 container statuses recorded)
Jan  3 06:47:48.938: INFO: 	Container csi-attacher ready: true, restart count 0
Jan  3 06:47:48.938: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  3 06:47:48.938: INFO: 	Container csi-resizer ready: true, restart count 0
Jan  3 06:47:48.938: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan  3 06:47:48.938: INFO: 	Container hostpath ready: true, restart count 0
Jan  3 06:47:48.938: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:47:48.938: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:47:48.938: INFO: ebs-csi-node-78dfk started at 2023-01-03 06:26:09 +0000 UTC (0+3 container statuses recorded)
Jan  3 06:47:48.938: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  3 06:47:48.938: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:47:48.938: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:47:48.938: INFO: cilium-cd88p started at 2023-01-03 06:26:09 +0000 UTC (1+1 container statuses recorded)
Jan  3 06:47:48.938: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  3 06:47:48.938: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  3 06:47:48.938: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-txkql started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:48.938: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:48.938: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-7cwlm started at 2023-01-03 06:40:04 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:48.938: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:48.938: INFO: coredns-559769c974-ls78k started at 2023-01-03 06:26:47 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:48.938: INFO: 	Container coredns ready: true, restart count 0
Jan  3 06:47:48.938: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-vgzx4 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:48.938: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:48.938: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-64hvj started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:48.938: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:48.938: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-mqf8m started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:48.938: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:48.938: INFO: inline-volume-tester-9wfs9 started at 2023-01-03 06:41:47 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:48.938: INFO: 	Container csi-volume-tester ready: false, restart count 0
Jan  3 06:47:48.938: INFO: pod-33511478-1f92-45f0-a4ad-dfec83a925bb started at 2023-01-03 06:44:42 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:48.938: INFO: 	Container write-pod ready: false, restart count 0
Jan  3 06:47:48.938: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-mdkxh started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:48.938: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:48.938: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-26j4z started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:48.938: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:48.938: INFO: hostexec-i-0f6d4ea509bfe3fbe-x62kt started at 2023-01-03 06:44:36 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:48.938: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  3 06:47:48.938: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-bv5tk started at 2023-01-03 06:40:04 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:48.938: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:48.938: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-9hzqt started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:48.938: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:49.781: INFO: 
Latency metrics for node i-0f6d4ea509bfe3fbe
[DeferCleanup (Each)] [sig-auth] ServiceAccounts
  tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "svcaccounts-6425" for this suite. �[38;5;243m01/03/23 06:47:49.781�[0m

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-network] Services should have session affinity work for NodePort service [LinuxOnly] [Conformance] 6m6s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-network\]\sServices\sshould\shave\ssession\saffinity\swork\sfor\sNodePort\sservice\s\[LinuxOnly\]\s\[Conformance\]$'

test/e2e/network/service.go:3912
k8s.io/kubernetes/test/e2e/network.execAffinityTestForNonLBServiceWithOptionalTransition(0x75ecd08?, {0x801e128, 0xc000598820}, 0xc005046f00, 0x0)
	test/e2e/network/service.go:3912 +0x1d0
k8s.io/kubernetes/test/e2e/network.execAffinityTestForNonLBService(...)
	test/e2e/network/service.go:3897
k8s.io/kubernetes/test/e2e/network.glob..func26.28()
	test/e2e/network/service.go:2231 +0x8d
				[BeforeEach] [sig-network] Services
  set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/03/23 06:41:26.955�[0m
Jan  3 06:41:26.955: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename services �[38;5;243m01/03/23 06:41:26.956�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/03/23 06:41:27.655�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/03/23 06:41:28.118�[0m
[BeforeEach] [sig-network] Services
  test/e2e/framework/metrics/init/init.go:31
[BeforeEach] [sig-network] Services
  test/e2e/network/service.go:766
[It] should have session affinity work for NodePort service [LinuxOnly] [Conformance]
  test/e2e/network/service.go:2228
�[1mSTEP:�[0m creating service in namespace services-3405 �[38;5;243m01/03/23 06:41:28.582�[0m
�[1mSTEP:�[0m creating service affinity-nodeport in namespace services-3405 �[38;5;243m01/03/23 06:41:28.582�[0m
�[1mSTEP:�[0m creating replication controller affinity-nodeport in namespace services-3405 �[38;5;243m01/03/23 06:41:28.826�[0m
I0103 06:41:29.061055    6587 runners.go:193] Created replication controller with name: affinity-nodeport, namespace: services-3405, replica count: 3
I0103 06:41:32.312358    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 1 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:41:35.312921    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 1 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:41:38.313664    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 1 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:41:41.314676    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 1 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:41:44.315208    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 1 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:41:47.315831    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 1 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:41:50.316618    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 1 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:41:53.316899    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 1 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:41:56.317566    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 1 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:41:59.318492    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 1 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:42:02.319440    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 1 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:42:05.320436    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 1 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:42:08.321622    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 1 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:42:11.322522    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 1 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:42:14.323735    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 1 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:42:17.324541    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 1 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:42:20.325670    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 1 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:42:23.326286    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:42:26.327417    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:42:29.328116    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:42:32.329313    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:42:35.329856    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:42:38.330814    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:42:41.331564    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:42:44.332751    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:42:47.333158    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:42:50.334165    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:42:53.335135    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:42:56.335827    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:42:59.336759    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:43:02.337883    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:43:05.338633    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:43:08.339123    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:43:11.339668    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:43:14.340104    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:43:17.340761    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:43:20.341823    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:43:23.342359    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:43:26.343175    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:43:29.343440    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:43:32.344031    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:43:35.345060    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:43:38.345435    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:43:41.346380    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:43:44.347566    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:43:47.347889    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:43:50.348656    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:43:53.349899    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:43:56.351022    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:43:59.351659    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:44:02.352285    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:44:05.352749    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:44:08.353140    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:44:11.354034    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:44:14.354992    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:44:17.355830    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:44:20.362955    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:44:23.363073    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:44:26.364144    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:44:29.365553    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:44:32.366556    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:44:35.367841    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:44:38.368082    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:44:41.368941    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:44:44.370117    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:44:47.370351    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:44:50.371182    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:44:53.372414    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:44:56.372728    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:44:59.379141    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:45:02.380198    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:45:05.381251    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:45:08.382636    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:45:11.383811    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:45:14.384716    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:45:17.386225    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:45:20.387055    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:45:23.387204    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:45:26.387373    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:45:29.388326    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:45:32.388973    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:45:35.389940    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:45:38.391033    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:45:41.391227    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:45:44.391665    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:45:47.392489    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:45:50.395182    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:45:53.396093    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:45:56.396205    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:45:59.396821    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:46:02.397489    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:46:05.398593    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:46:08.399249    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:46:11.399448    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:46:14.399673    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:46:17.400561    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:46:20.400724    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:46:23.401819    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:46:26.402490    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:46:29.403331    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:46:32.404466    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:46:35.404859    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:46:38.405280    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:46:41.405502    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:46:44.406485    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:46:47.409308    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:46:50.409586    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:46:53.409866    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:46:56.410271    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:46:59.410802    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:47:02.411544    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:47:05.412660    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:47:08.413415    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:47:11.413820    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:47:14.414056    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:47:17.414689    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:47:20.415721    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:47:23.416156    6587 runners.go:193] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I0103 06:47:23.649194    6587 runners.go:193] Pod affinity-nodeport-2r4nr	i-0c4c153cc3021d728	Running	<nil>
I0103 06:47:23.649254    6587 runners.go:193] Pod affinity-nodeport-fh67z	i-0887927f295dab249	Running	<nil>
I0103 06:47:23.649266    6587 runners.go:193] Pod affinity-nodeport-g4r5h	i-0f6d4ea509bfe3fbe	Pending	<nil>
Jan  3 06:47:23.649: INFO: Unexpected error: failed to create replication controller with service in the namespace: services-3405: 
    <*errors.errorString | 0xc00157a4e0>: {
        s: "only 2 pods started out of 3",
    }
Jan  3 06:47:23.649: FAIL: failed to create replication controller with service in the namespace: services-3405: only 2 pods started out of 3

Full Stack Trace
k8s.io/kubernetes/test/e2e/network.execAffinityTestForNonLBServiceWithOptionalTransition(0x75ecd08?, {0x801e128, 0xc000598820}, 0xc005046f00, 0x0)
	test/e2e/network/service.go:3912 +0x1d0
k8s.io/kubernetes/test/e2e/network.execAffinityTestForNonLBService(...)
	test/e2e/network/service.go:3897
k8s.io/kubernetes/test/e2e/network.glob..func26.28()
	test/e2e/network/service.go:2231 +0x8d
[AfterEach] [sig-network] Services
  test/e2e/framework/node/init/init.go:32
Jan  3 06:47:23.649: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-network] Services
  test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-network] Services
  dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/03/23 06:47:23.886�[0m
�[1mSTEP:�[0m Collecting events from namespace "services-3405". �[38;5;243m01/03/23 06:47:23.886�[0m
�[1mSTEP:�[0m Found 26 events. �[38;5;243m01/03/23 06:47:24.119�[0m
Jan  3 06:47:24.120: INFO: At 2023-01-03 06:41:28 +0000 UTC - event for affinity-nodeport: {replication-controller } SuccessfulCreate: Created pod: affinity-nodeport-g4r5h
Jan  3 06:47:24.120: INFO: At 2023-01-03 06:41:28 +0000 UTC - event for affinity-nodeport: {replication-controller } SuccessfulCreate: Created pod: affinity-nodeport-2r4nr
Jan  3 06:47:24.120: INFO: At 2023-01-03 06:41:28 +0000 UTC - event for affinity-nodeport: {replication-controller } SuccessfulCreate: Created pod: affinity-nodeport-fh67z
Jan  3 06:47:24.120: INFO: At 2023-01-03 06:41:28 +0000 UTC - event for affinity-nodeport-2r4nr: {default-scheduler } Scheduled: Successfully assigned services-3405/affinity-nodeport-2r4nr to i-0c4c153cc3021d728
Jan  3 06:47:24.120: INFO: At 2023-01-03 06:41:28 +0000 UTC - event for affinity-nodeport-fh67z: {default-scheduler } Scheduled: Successfully assigned services-3405/affinity-nodeport-fh67z to i-0887927f295dab249
Jan  3 06:47:24.120: INFO: At 2023-01-03 06:41:28 +0000 UTC - event for affinity-nodeport-g4r5h: {default-scheduler } Scheduled: Successfully assigned services-3405/affinity-nodeport-g4r5h to i-0f6d4ea509bfe3fbe
Jan  3 06:47:24.120: INFO: At 2023-01-03 06:41:29 +0000 UTC - event for affinity-nodeport-2r4nr: {kubelet i-0c4c153cc3021d728} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine
Jan  3 06:47:24.120: INFO: At 2023-01-03 06:41:29 +0000 UTC - event for affinity-nodeport-2r4nr: {kubelet i-0c4c153cc3021d728} Created: Created container affinity-nodeport
Jan  3 06:47:24.120: INFO: At 2023-01-03 06:41:29 +0000 UTC - event for affinity-nodeport-fh67z: {kubelet i-0887927f295dab249} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "bc293b8dd464e3575bef2584330bd7c51d642faaad7e549d32adf5502317ca0d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:47:24.120: INFO: At 2023-01-03 06:41:29 +0000 UTC - event for affinity-nodeport-g4r5h: {kubelet i-0f6d4ea509bfe3fbe} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "16ce9f227936e4819c0fc70d22a1ada2e6fd16c15a8e18cab7491e1c37f80681": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:47:24.120: INFO: At 2023-01-03 06:41:30 +0000 UTC - event for affinity-nodeport-2r4nr: {kubelet i-0c4c153cc3021d728} Started: Started container affinity-nodeport
Jan  3 06:47:24.120: INFO: At 2023-01-03 06:41:40 +0000 UTC - event for affinity-nodeport-g4r5h: {kubelet i-0f6d4ea509bfe3fbe} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "cbc2db9cbb2fe4952fa19796f84e43bc8b776e06c2b41052aa5d8c9f648c25d5": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:47:24.120: INFO: At 2023-01-03 06:41:42 +0000 UTC - event for affinity-nodeport-fh67z: {kubelet i-0887927f295dab249} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "df2ee2fa197aac817741e99b6690f628f3ef3c89ed78fc3c56c914e72a22ef1a": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:47:24.120: INFO: At 2023-01-03 06:41:53 +0000 UTC - event for affinity-nodeport-g4r5h: {kubelet i-0f6d4ea509bfe3fbe} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "97b9e0b47cbc6e3a6ed32a58f3335835b0e4e48243055ef80af171c95752acc3": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:47:24.120: INFO: At 2023-01-03 06:41:54 +0000 UTC - event for affinity-nodeport-fh67z: {kubelet i-0887927f295dab249} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "2c7ed848a877cb0d6da5b5c92c9c58756e3760ec6de4df1d00b8c4cfd0954b54": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:47:24.120: INFO: At 2023-01-03 06:42:07 +0000 UTC - event for affinity-nodeport-fh67z: {kubelet i-0887927f295dab249} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "c83a40f58c80e73a7b635ab91971822a6bfa5e471a25a5b67063074ab7d9c3c3": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:47:24.120: INFO: At 2023-01-03 06:42:07 +0000 UTC - event for affinity-nodeport-g4r5h: {kubelet i-0f6d4ea509bfe3fbe} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e61325c55e662a60531354d7c910607a3170ed9b9f96c9de8d84abb208db49b9": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:47:24.120: INFO: At 2023-01-03 06:42:21 +0000 UTC - event for affinity-nodeport-fh67z: {kubelet i-0887927f295dab249} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine
Jan  3 06:47:24.120: INFO: At 2023-01-03 06:42:21 +0000 UTC - event for affinity-nodeport-fh67z: {kubelet i-0887927f295dab249} Created: Created container affinity-nodeport
Jan  3 06:47:24.120: INFO: At 2023-01-03 06:42:21 +0000 UTC - event for affinity-nodeport-fh67z: {kubelet i-0887927f295dab249} Started: Started container affinity-nodeport
Jan  3 06:47:24.120: INFO: At 2023-01-03 06:42:21 +0000 UTC - event for affinity-nodeport-g4r5h: {kubelet i-0f6d4ea509bfe3fbe} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "47cbf9fd9fe8d7102b4f98ae161bf15bb673857e0bfcdc310cd04ff9bfbe0d34": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:47:24.120: INFO: At 2023-01-03 06:42:32 +0000 UTC - event for affinity-nodeport-g4r5h: {kubelet i-0f6d4ea509bfe3fbe} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "88d8e415fa6fd251bcbaa948fbe07c296115c998a7ad8b17db115b7c1bd38c3a": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:47:24.120: INFO: At 2023-01-03 06:42:44 +0000 UTC - event for affinity-nodeport-g4r5h: {kubelet i-0f6d4ea509bfe3fbe} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "2159471f4f0826d9b84e276e6ee96a28aac00a04aa8f30fd5123ad75cbd6adce": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:47:24.120: INFO: At 2023-01-03 06:42:57 +0000 UTC - event for affinity-nodeport-g4r5h: {kubelet i-0f6d4ea509bfe3fbe} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ecc0ca7642096d9605def4901072d58300810dc5158ef898a242e9cd52a1b791": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:47:24.120: INFO: At 2023-01-03 06:43:10 +0000 UTC - event for affinity-nodeport-g4r5h: {kubelet i-0f6d4ea509bfe3fbe} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "6b6c3ce03e6010a0fc67ee425ff77882d3918a6d412c379c4e5349516c7df280": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:47:24.120: INFO: At 2023-01-03 06:43:24 +0000 UTC - event for affinity-nodeport-g4r5h: {kubelet i-0f6d4ea509bfe3fbe} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "6de8962e8ddc32234401aac4fb2c7a02729dbd9d18e9d6bc115946d57f9545cd": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:47:24.353: INFO: POD                      NODE                 PHASE    GRACE  CONDITIONS
Jan  3 06:47:24.353: INFO: affinity-nodeport-2r4nr  i-0c4c153cc3021d728  Running         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-03 06:41:28 +0000 UTC  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-01-03 06:41:30 +0000 UTC  } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-01-03 06:41:30 +0000 UTC  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-03 06:41:28 +0000 UTC  }]
Jan  3 06:47:24.353: INFO: affinity-nodeport-fh67z  i-0887927f295dab249  Running         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-03 06:41:28 +0000 UTC  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-01-03 06:42:22 +0000 UTC  } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-01-03 06:42:22 +0000 UTC  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-03 06:41:28 +0000 UTC  }]
Jan  3 06:47:24.353: INFO: affinity-nodeport-g4r5h  i-0f6d4ea509bfe3fbe  Pending         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-03 06:41:28 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-03 06:41:28 +0000 UTC ContainersNotReady containers with unready status: [affinity-nodeport]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-03 06:41:28 +0000 UTC ContainersNotReady containers with unready status: [affinity-nodeport]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-03 06:41:28 +0000 UTC  }]
Jan  3 06:47:24.353: INFO: 
Jan  3 06:47:25.058: INFO: Unable to fetch services-3405/affinity-nodeport-g4r5h/affinity-nodeport logs: the server rejected our request for an unknown reason (get pods affinity-nodeport-g4r5h)
Jan  3 06:47:25.292: INFO: 
Logging node info for node i-0116ec5cfa0915363
Jan  3 06:47:25.525: INFO: Node Info: &Node{ObjectMeta:{i-0116ec5cfa0915363    845a5e73-b93d-4679-a025-6403fe91469b 27782 0 2023-01-03 06:24:27 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0116ec5cfa0915363 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:ap-south-1a topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.51.97 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0116ec5cfa0915363"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-03 06:24:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-03 06:24:54 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:25:11 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-03 06:25:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-03 06:25:13 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-03 06:42:20 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0116ec5cfa0915363,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892301824 0} {<nil>} 3801076Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787444224 0} {<nil>} 3698676Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-03 06:42:20 +0000 UTC,LastTransitionTime:2023-01-03 06:24:21 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-03 06:42:20 +0000 UTC,LastTransitionTime:2023-01-03 06:24:21 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-03 06:42:20 +0000 UTC,LastTransitionTime:2023-01-03 06:24:21 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-03 06:42:20 +0000 UTC,LastTransitionTime:2023-01-03 06:25:11 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.51.97,},NodeAddress{Type:ExternalIP,Address:35.154.4.55,},NodeAddress{Type:InternalDNS,Address:i-0116ec5cfa0915363.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0116ec5cfa0915363.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-154-4-55.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec291a4b21ade93e02dbfdea9af30b8c,SystemUUID:ec291a4b-21ad-e93e-02db-fdea9af30b8c,BootID:3cd177e4-da3b-4287-b5dc-70d163e7dd13,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.0],SizeBytes:135162323,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.0],SizeBytes:124991801,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.0],SizeBytes:57657656,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43446388,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42805548,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4967304,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan  3 06:47:25.525: INFO: 
Logging kubelet events for node i-0116ec5cfa0915363
Jan  3 06:47:25.760: INFO: 
Logging pods the kubelet thinks is on node i-0116ec5cfa0915363
Jan  3 06:47:26.000: INFO: etcd-manager-main-i-0116ec5cfa0915363 started at 2023-01-03 06:23:51 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:26.000: INFO: 	Container etcd-manager ready: true, restart count 0
Jan  3 06:47:26.000: INFO: cilium-operator-5dd44dc49f-nzbgs started at 2023-01-03 06:25:00 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:26.000: INFO: 	Container cilium-operator ready: true, restart count 0
Jan  3 06:47:26.000: INFO: ebs-csi-controller-89b649c94-4zgt2 started at 2023-01-03 06:25:00 +0000 UTC (0+5 container statuses recorded)
Jan  3 06:47:26.000: INFO: 	Container csi-attacher ready: true, restart count 0
Jan  3 06:47:26.000: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  3 06:47:26.000: INFO: 	Container csi-resizer ready: true, restart count 0
Jan  3 06:47:26.000: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  3 06:47:26.000: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:47:26.000: INFO: ebs-csi-node-pg7l9 started at 2023-01-03 06:24:59 +0000 UTC (0+3 container statuses recorded)
Jan  3 06:47:26.000: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  3 06:47:26.000: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:47:26.000: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:47:26.000: INFO: etcd-manager-events-i-0116ec5cfa0915363 started at 2023-01-03 06:23:51 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:26.000: INFO: 	Container etcd-manager ready: true, restart count 0
Jan  3 06:47:26.000: INFO: kube-apiserver-i-0116ec5cfa0915363 started at 2023-01-03 06:23:51 +0000 UTC (0+2 container statuses recorded)
Jan  3 06:47:26.000: INFO: 	Container healthcheck ready: true, restart count 0
Jan  3 06:47:26.000: INFO: 	Container kube-apiserver ready: true, restart count 1
Jan  3 06:47:26.000: INFO: kube-controller-manager-i-0116ec5cfa0915363 started at 2023-01-03 06:23:51 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:26.000: INFO: 	Container kube-controller-manager ready: true, restart count 2
Jan  3 06:47:26.000: INFO: kube-scheduler-i-0116ec5cfa0915363 started at 2023-01-03 06:23:51 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:26.000: INFO: 	Container kube-scheduler ready: true, restart count 0
Jan  3 06:47:26.000: INFO: kops-controller-9t2zt started at 2023-01-03 06:24:59 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:26.000: INFO: 	Container kops-controller ready: true, restart count 0
Jan  3 06:47:26.000: INFO: cilium-npb6w started at 2023-01-03 06:24:59 +0000 UTC (1+1 container statuses recorded)
Jan  3 06:47:26.000: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  3 06:47:26.000: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  3 06:47:26.000: INFO: aws-cloud-controller-manager-mvsjr started at 2023-01-03 06:24:59 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:26.000: INFO: 	Container aws-cloud-controller-manager ready: true, restart count 0
Jan  3 06:47:26.000: INFO: dns-controller-69987775c6-rgd5s started at 2023-01-03 06:25:00 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:26.000: INFO: 	Container dns-controller ready: true, restart count 0
Jan  3 06:47:26.775: INFO: 
Latency metrics for node i-0116ec5cfa0915363
Jan  3 06:47:26.775: INFO: 
Logging node info for node i-06675ed9fdf15131e
Jan  3 06:47:27.007: INFO: Node Info: &Node{ObjectMeta:{i-06675ed9fdf15131e    6a365a73-a0a0-47e1-83ac-1dd53dc6cb56 29432 0 2023-01-03 06:26:03 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-06675ed9fdf15131e kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-06675ed9fdf15131e topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.34.128 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-7802":"i-06675ed9fdf15131e","csi-mock-csi-mock-volumes-5893":"i-06675ed9fdf15131e","ebs.csi.aws.com":"i-06675ed9fdf15131e"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-03 06:26:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-03 06:26:03 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-03 06:26:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-03 06:26:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:26:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {e2e.test Update v1 2023-01-03 06:40:01 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:40:12 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-03 06:45:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-06675ed9fdf15131e,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-03 06:45:25 +0000 UTC,LastTransitionTime:2023-01-03 06:26:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-03 06:45:25 +0000 UTC,LastTransitionTime:2023-01-03 06:26:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-03 06:45:25 +0000 UTC,LastTransitionTime:2023-01-03 06:26:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-03 06:45:25 +0000 UTC,LastTransitionTime:2023-01-03 06:26:18 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.34.128,},NodeAddress{Type:ExternalIP,Address:13.233.53.249,},NodeAddress{Type:InternalDNS,Address:i-06675ed9fdf15131e.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-06675ed9fdf15131e.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-233-53-249.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec278d28e0e8aa5f9f5a88afed4c7357,SystemUUID:ec278d28-e0e8-aa5f-9f5a-88afed4c7357,BootID:60717d56-76f8-4838-8bb7-4a4ce6867c70,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-7802^78eb4252-8b31-11ed-a7cd-e699b846bc6a],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-7802^78eb4252-8b31-11ed-a7cd-e699b846bc6a,DevicePath:,},},Config:nil,},}
Jan  3 06:47:27.008: INFO: 
Logging kubelet events for node i-06675ed9fdf15131e
Jan  3 06:47:27.243: INFO: 
Logging pods the kubelet thinks is on node i-06675ed9fdf15131e
Jan  3 06:47:27.718: INFO: csi-hostpathplugin-0 started at 2023-01-03 06:42:46 +0000 UTC (0+7 container statuses recorded)
Jan  3 06:47:27.718: INFO: 	Container csi-attacher ready: false, restart count 0
Jan  3 06:47:27.718: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan  3 06:47:27.718: INFO: 	Container csi-resizer ready: false, restart count 0
Jan  3 06:47:27.718: INFO: 	Container csi-snapshotter ready: false, restart count 0
Jan  3 06:47:27.718: INFO: 	Container hostpath ready: false, restart count 0
Jan  3 06:47:27.718: INFO: 	Container liveness-probe ready: false, restart count 0
Jan  3 06:47:27.718: INFO: 	Container node-driver-registrar ready: false, restart count 0
Jan  3 06:47:27.718: INFO: coredns-autoscaler-7cb5c5b969-tg22d started at 2023-01-03 06:26:18 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:27.718: INFO: 	Container autoscaler ready: true, restart count 0
Jan  3 06:47:27.718: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-bhflv started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:27.718: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:27.718: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-qbds6 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:27.718: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:27.718: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-5qt2b started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:27.718: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:27.718: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-kn247 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:27.718: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:27.718: INFO: csi-hostpathplugin-0 started at 2023-01-03 06:43:56 +0000 UTC (0+7 container statuses recorded)
Jan  3 06:47:27.718: INFO: 	Container csi-attacher ready: false, restart count 0
Jan  3 06:47:27.718: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan  3 06:47:27.718: INFO: 	Container csi-resizer ready: false, restart count 0
Jan  3 06:47:27.718: INFO: 	Container csi-snapshotter ready: false, restart count 0
Jan  3 06:47:27.718: INFO: 	Container hostpath ready: false, restart count 0
Jan  3 06:47:27.718: INFO: 	Container liveness-probe ready: false, restart count 0
Jan  3 06:47:27.718: INFO: 	Container node-driver-registrar ready: false, restart count 0
Jan  3 06:47:27.718: INFO: csi-mockplugin-resizer-0 started at 2023-01-03 06:42:51 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:27.718: INFO: 	Container csi-resizer ready: false, restart count 0
Jan  3 06:47:27.718: INFO: ebs-csi-node-q24xb started at 2023-01-03 06:26:04 +0000 UTC (0+3 container statuses recorded)
Jan  3 06:47:27.718: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  3 06:47:27.718: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:47:27.718: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:47:27.718: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-vkxkf started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:27.718: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:27.718: INFO: csi-mockplugin-0 started at 2023-01-03 06:42:50 +0000 UTC (0+3 container statuses recorded)
Jan  3 06:47:27.718: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  3 06:47:27.718: INFO: 	Container driver-registrar ready: true, restart count 0
Jan  3 06:47:27.718: INFO: 	Container mock ready: true, restart count 0
Jan  3 06:47:27.718: INFO: inline-volume-tester-578zd started at 2023-01-03 06:43:56 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:27.718: INFO: 	Container csi-volume-tester ready: false, restart count 0
Jan  3 06:47:27.718: INFO: coredns-559769c974-xh6r4 started at 2023-01-03 06:26:18 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:27.718: INFO: 	Container coredns ready: true, restart count 0
Jan  3 06:47:27.718: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-gcftr started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:27.718: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:27.718: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-knmjr started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:27.718: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: false, restart count 0
Jan  3 06:47:27.718: INFO: pvc-volume-tester-tnqg4 started at 2023-01-03 06:43:36 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:27.718: INFO: 	Container volume-tester ready: false, restart count 0
Jan  3 06:47:27.718: INFO: csi-hostpathplugin-0 started at 2023-01-03 06:39:40 +0000 UTC (0+7 container statuses recorded)
Jan  3 06:47:27.718: INFO: 	Container csi-attacher ready: true, restart count 0
Jan  3 06:47:27.718: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  3 06:47:27.718: INFO: 	Container csi-resizer ready: true, restart count 0
Jan  3 06:47:27.718: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan  3 06:47:27.718: INFO: 	Container hostpath ready: true, restart count 0
Jan  3 06:47:27.718: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:47:27.718: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:47:27.718: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-vmn8b started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:27.718: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:27.718: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-gzk6r started at 2023-01-03 06:40:04 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:27.718: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: false, restart count 0
Jan  3 06:47:27.718: INFO: inline-volume-tester-7frp2 started at 2023-01-03 06:42:47 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:27.718: INFO: 	Container csi-volume-tester ready: false, restart count 0
Jan  3 06:47:27.718: INFO: cilium-88fm4 started at 2023-01-03 06:26:04 +0000 UTC (1+1 container statuses recorded)
Jan  3 06:47:27.718: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  3 06:47:27.718: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  3 06:47:27.718: INFO: hostpath-client started at 2023-01-03 06:40:11 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:27.718: INFO: 	Container hostpath-client ready: false, restart count 0
Jan  3 06:47:27.718: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-pn6rb started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:27.718: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:28.540: INFO: 
Latency metrics for node i-06675ed9fdf15131e
Jan  3 06:47:28.540: INFO: 
Logging node info for node i-0887927f295dab249
Jan  3 06:47:28.772: INFO: Node Info: &Node{ObjectMeta:{i-0887927f295dab249    8c537f9f-6ce2-4eae-a273-3e5dec0f5a97 29289 0 2023-01-03 06:26:08 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0887927f295dab249 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-0887927f295dab249 topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.43.47 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-7494":"i-0887927f295dab249","ebs.csi.aws.com":"i-0887927f295dab249"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-03 06:40:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:45:11 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-03 06:45:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0887927f295dab249,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-03 06:45:13 +0000 UTC,LastTransitionTime:2023-01-03 06:26:08 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-03 06:45:13 +0000 UTC,LastTransitionTime:2023-01-03 06:26:08 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-03 06:45:13 +0000 UTC,LastTransitionTime:2023-01-03 06:26:08 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-03 06:45:13 +0000 UTC,LastTransitionTime:2023-01-03 06:26:24 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.43.47,},NodeAddress{Type:ExternalIP,Address:65.0.96.201,},NodeAddress{Type:InternalDNS,Address:i-0887927f295dab249.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0887927f295dab249.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-65-0-96-201.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2d5f1c251f05fc398417508c564588,SystemUUID:ec2d5f1c-251f-05fc-3984-17508c564588,BootID:80a76b6c-5e81-478d-a15c-92ab635eebdb,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-7494^2a9b5c2b-8b32-11ed-9a17-02cea9609c51 kubernetes.io/csi/csi-hostpath-ephemeral-7494^2a9f4d2c-8b32-11ed-9a17-02cea9609c51 kubernetes.io/csi/ebs.csi.aws.com^vol-0747fe00dd5d5923d],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-7494^2a9b5c2b-8b32-11ed-9a17-02cea9609c51,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-7494^2a9f4d2c-8b32-11ed-9a17-02cea9609c51,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0747fe00dd5d5923d,DevicePath:,},},Config:nil,},}
Jan  3 06:47:28.773: INFO: 
Logging kubelet events for node i-0887927f295dab249
Jan  3 06:47:29.011: INFO: 
Logging pods the kubelet thinks is on node i-0887927f295dab249
Jan  3 06:47:29.252: INFO: cilium-s9l8s started at 2023-01-03 06:26:09 +0000 UTC (1+1 container statuses recorded)
Jan  3 06:47:29.252: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  3 06:47:29.252: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  3 06:47:29.252: INFO: startup-33131899-1a42-412a-9a76-c7ee101e12d3 started at 2023-01-03 06:44:39 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:29.252: INFO: 	Container busybox ready: false, restart count 0
Jan  3 06:47:29.252: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-dbt7p started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:29.252: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:29.252: INFO: affinity-nodeport-fh67z started at 2023-01-03 06:41:28 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:29.252: INFO: 	Container affinity-nodeport ready: true, restart count 0
Jan  3 06:47:29.252: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-87btk started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:29.252: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:29.252: INFO: test-deployment-swhng-54bc444df-8rmgv started at 2023-01-03 06:44:38 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:29.252: INFO: 	Container httpd ready: false, restart count 0
Jan  3 06:47:29.252: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-47hz9 started at 2023-01-03 06:40:04 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:29.252: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:29.252: INFO: pod-projected-configmaps-158e5277-3e7e-4278-a0c2-3078bcbd01de started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:29.252: INFO: pod-9d10df65-59e8-4966-a058-376431a1bbfe started at 2023-01-03 06:43:23 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:29.252: INFO: 	Container write-pod ready: false, restart count 0
Jan  3 06:47:29.252: INFO: csi-hostpathplugin-0 started at 2023-01-03 06:43:44 +0000 UTC (0+7 container statuses recorded)
Jan  3 06:47:29.252: INFO: 	Container csi-attacher ready: true, restart count 0
Jan  3 06:47:29.252: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  3 06:47:29.252: INFO: 	Container csi-resizer ready: true, restart count 0
Jan  3 06:47:29.252: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan  3 06:47:29.252: INFO: 	Container hostpath ready: true, restart count 0
Jan  3 06:47:29.252: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:47:29.252: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:47:29.252: INFO: test-pod-8f8b0f25-9283-406c-a37f-7b953461815d started at 2023-01-03 06:42:39 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:29.252: INFO: 	Container agnhost-container ready: false, restart count 0
Jan  3 06:47:29.252: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-5tzj6 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:29.252: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:29.252: INFO: pod-adoption-release started at 2023-01-03 06:46:06 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:29.252: INFO: 	Container pod-adoption-release ready: false, restart count 0
Jan  3 06:47:29.252: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-5sjfb started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:29.252: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:29.252: INFO: ss2-0 started at 2023-01-03 06:45:36 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:29.252: INFO: 	Container webserver ready: false, restart count 0
Jan  3 06:47:29.252: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-qs9vk started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:29.252: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:29.252: INFO: pod-configmaps-6ac65fd0-2362-460b-b401-dc12549b2575 started at 2023-01-03 06:45:42 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:29.252: INFO: 	Container agnhost-container ready: false, restart count 0
Jan  3 06:47:29.252: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-nzbt8 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:29.252: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:29.252: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-kmgz2 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:29.252: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:29.252: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-z8hhz started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:29.252: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:29.252: INFO: ebs-csi-node-22htr started at 2023-01-03 06:26:09 +0000 UTC (0+3 container statuses recorded)
Jan  3 06:47:29.252: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  3 06:47:29.252: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:47:29.252: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:47:29.252: INFO: inline-volume-tester-qwfhg started at 2023-01-03 06:45:10 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:29.252: INFO: 	Container csi-volume-tester ready: false, restart count 0
Jan  3 06:47:29.252: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-m9n4g started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:29.252: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:29.252: INFO: dns-test-71df1669-ca24-4488-bdc2-c2149686db55 started at 2023-01-03 06:46:44 +0000 UTC (0+3 container statuses recorded)
Jan  3 06:47:29.252: INFO: 	Container jessie-querier ready: false, restart count 0
Jan  3 06:47:29.252: INFO: 	Container querier ready: false, restart count 0
Jan  3 06:47:29.252: INFO: 	Container webserver ready: false, restart count 0
Jan  3 06:47:30.089: INFO: 
Latency metrics for node i-0887927f295dab249
Jan  3 06:47:30.089: INFO: 
Logging node info for node i-0c4c153cc3021d728
Jan  3 06:47:30.321: INFO: Node Info: &Node{ObjectMeta:{i-0c4c153cc3021d728    0fc330cf-9a4f-4650-8df2-bbc4962562bf 29761 0 2023-01-03 06:26:07 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a io.kubernetes.storage.mock/node:some-mock-node kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0c4c153cc3021d728 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-0c4c153cc3021d728 topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.34.232 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-volume-expand-9886":"i-0c4c153cc3021d728","ebs.csi.aws.com":"i-0c4c153cc3021d728"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-03 06:26:07 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-03 06:26:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-03 06:26:07 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:26:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-03 06:26:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-03 06:40:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-03 06:46:11 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-01-03 06:46:12 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0c4c153cc3021d728,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-03 06:46:11 +0000 UTC,LastTransitionTime:2023-01-03 06:26:07 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-03 06:46:11 +0000 UTC,LastTransitionTime:2023-01-03 06:26:07 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-03 06:46:11 +0000 UTC,LastTransitionTime:2023-01-03 06:26:07 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-03 06:46:11 +0000 UTC,LastTransitionTime:2023-01-03 06:26:23 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.34.232,},NodeAddress{Type:ExternalIP,Address:13.232.119.101,},NodeAddress{Type:InternalDNS,Address:i-0c4c153cc3021d728.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0c4c153cc3021d728.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-232-119-101.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec20ee6ab34ca9da624dd2e5f8c44780,SystemUUID:ec20ee6a-b34c-a9da-624d-d2e5f8c44780,BootID:960d66c3-58ec-4ea0-a76c-db5eb00e743c,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-volume-expand-9886^4e0f5548-8b32-11ed-8e7f-066d9af4aed6],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-volume-expand-9886^4e0f5548-8b32-11ed-8e7f-066d9af4aed6,DevicePath:,},},Config:nil,},}
Jan  3 06:47:30.322: INFO: 
Logging kubelet events for node i-0c4c153cc3021d728
Jan  3 06:47:30.557: INFO: 
Logging pods the kubelet thinks is on node i-0c4c153cc3021d728
Jan  3 06:47:30.801: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-l9w98 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:30.801: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:30.801: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-w8kkx started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:30.801: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:30.801: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-s8mtc started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:30.801: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:30.801: INFO: fail-once-non-local-82rmn started at 2023-01-03 06:44:35 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:30.801: INFO: 	Container c ready: false, restart count 0
Jan  3 06:47:30.801: INFO: fail-once-non-local-jk86f started at 2023-01-03 06:45:06 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:30.801: INFO: 	Container c ready: false, restart count 0
Jan  3 06:47:30.801: INFO: hostexec-i-0c4c153cc3021d728-s292j started at 2023-01-03 06:45:18 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:30.801: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  3 06:47:30.801: INFO: pod-subpath-test-preprovisionedpv-vsdz started at 2023-01-03 06:45:30 +0000 UTC (2+1 container statuses recorded)
Jan  3 06:47:30.801: INFO: 	Init container init-volume-preprovisionedpv-vsdz ready: false, restart count 0
Jan  3 06:47:30.801: INFO: 	Init container test-init-volume-preprovisionedpv-vsdz ready: false, restart count 0
Jan  3 06:47:30.801: INFO: 	Container test-container-subpath-preprovisionedpv-vsdz ready: false, restart count 0
Jan  3 06:47:30.801: INFO: ebs-csi-node-5sgcl started at 2023-01-03 06:26:08 +0000 UTC (0+3 container statuses recorded)
Jan  3 06:47:30.801: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  3 06:47:30.801: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:47:30.801: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:47:30.801: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-4sx4g started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:30.801: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:30.801: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-98hxx started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:30.801: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:30.801: INFO: csi-hostpathplugin-0 started at 2023-01-03 06:45:29 +0000 UTC (0+7 container statuses recorded)
Jan  3 06:47:30.801: INFO: 	Container csi-attacher ready: true, restart count 0
Jan  3 06:47:30.801: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  3 06:47:30.801: INFO: 	Container csi-resizer ready: true, restart count 0
Jan  3 06:47:30.801: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan  3 06:47:30.801: INFO: 	Container hostpath ready: true, restart count 0
Jan  3 06:47:30.801: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:47:30.801: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:47:30.801: INFO: pod-20c75720-f672-49af-b552-0eceef5b318c started at 2023-01-03 06:46:11 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:30.801: INFO: 	Container write-pod ready: false, restart count 0
Jan  3 06:47:30.801: INFO: pod-subpath-test-inlinevolume-z5hb started at 2023-01-03 06:46:53 +0000 UTC (2+2 container statuses recorded)
Jan  3 06:47:30.801: INFO: 	Init container init-volume-inlinevolume-z5hb ready: false, restart count 0
Jan  3 06:47:30.801: INFO: 	Init container test-init-subpath-inlinevolume-z5hb ready: false, restart count 0
Jan  3 06:47:30.801: INFO: 	Container test-container-subpath-inlinevolume-z5hb ready: false, restart count 0
Jan  3 06:47:30.801: INFO: 	Container test-container-volume-inlinevolume-z5hb ready: false, restart count 0
Jan  3 06:47:30.801: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-ljkk6 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:30.801: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:30.801: INFO: affinity-nodeport-2r4nr started at 2023-01-03 06:41:28 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:30.801: INFO: 	Container affinity-nodeport ready: true, restart count 0
Jan  3 06:47:30.801: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-tfhlj started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:30.801: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:30.801: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-44v74 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:30.801: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:30.801: INFO: cilium-87m98 started at 2023-01-03 06:26:08 +0000 UTC (1+1 container statuses recorded)
Jan  3 06:47:30.801: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  3 06:47:30.801: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  3 06:47:30.801: INFO: fail-once-non-local-ms76g started at 2023-01-03 06:45:23 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:30.801: INFO: 	Container c ready: false, restart count 0
Jan  3 06:47:30.801: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-fh8hc started at 2023-01-03 06:40:04 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:30.801: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:30.801: INFO: fail-once-non-local-27nz9 started at 2023-01-03 06:45:02 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:30.801: INFO: 	Container c ready: false, restart count 0
Jan  3 06:47:30.801: INFO: fail-once-non-local-wdcck started at 2023-01-03 06:44:35 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:30.801: INFO: 	Container c ready: false, restart count 0
Jan  3 06:47:30.801: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-55wkd started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:30.801: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:31.679: INFO: 
Latency metrics for node i-0c4c153cc3021d728
Jan  3 06:47:31.679: INFO: 
Logging node info for node i-0f6d4ea509bfe3fbe
Jan  3 06:47:31.911: INFO: Node Info: &Node{ObjectMeta:{i-0f6d4ea509bfe3fbe    d3d92523-9fe9-40c0-96cf-7de8a708f9e5 29995 0 2023-01-03 06:26:08 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0f6d4ea509bfe3fbe kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-0f6d4ea509bfe3fbe topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.56.168 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-1691":"i-0f6d4ea509bfe3fbe","ebs.csi.aws.com":"i-0f6d4ea509bfe3fbe"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-03 06:40:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:41:48 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-03 06:47:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0f6d4ea509bfe3fbe,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-03 06:47:03 +0000 UTC,LastTransitionTime:2023-01-03 06:26:08 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-03 06:47:03 +0000 UTC,LastTransitionTime:2023-01-03 06:26:08 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-03 06:47:03 +0000 UTC,LastTransitionTime:2023-01-03 06:26:08 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-03 06:47:03 +0000 UTC,LastTransitionTime:2023-01-03 06:26:23 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.56.168,},NodeAddress{Type:ExternalIP,Address:15.206.145.14,},NodeAddress{Type:InternalDNS,Address:i-0f6d4ea509bfe3fbe.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0f6d4ea509bfe3fbe.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-206-145-14.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2eebc156cceaa5905e74ada30878dd,SystemUUID:ec2eebc1-56cc-eaa5-905e-74ada30878dd,BootID:d561d40a-625b-4fa0-ad51-87e12466f6e1,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-1691^b1a35b91-8b31-11ed-a7c5-62d1175edcc5],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-1691^b1a35b91-8b31-11ed-a7c5-62d1175edcc5,DevicePath:,},},Config:nil,},}
Jan  3 06:47:31.912: INFO: 
Logging kubelet events for node i-0f6d4ea509bfe3fbe
Jan  3 06:47:32.152: INFO: 
Logging pods the kubelet thinks is on node i-0f6d4ea509bfe3fbe
Jan  3 06:47:32.393: INFO: inline-volume-tester-9wfs9 started at 2023-01-03 06:41:47 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:32.393: INFO: 	Container csi-volume-tester ready: false, restart count 0
Jan  3 06:47:32.393: INFO: pod-33511478-1f92-45f0-a4ad-dfec83a925bb started at 2023-01-03 06:44:42 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:32.393: INFO: 	Container write-pod ready: false, restart count 0
Jan  3 06:47:32.393: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-mdkxh started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:32.393: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:32.393: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-26j4z started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:32.393: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:32.393: INFO: hostexec-i-0f6d4ea509bfe3fbe-x62kt started at 2023-01-03 06:44:36 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:32.393: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  3 06:47:32.393: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-bv5tk started at 2023-01-03 06:40:04 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:32.393: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:32.393: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-9hzqt started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:32.393: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:32.393: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-7s22g started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:32.393: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:32.393: INFO: csi-hostpathplugin-0 started at 2023-01-03 06:41:05 +0000 UTC (0+7 container statuses recorded)
Jan  3 06:47:32.393: INFO: 	Container csi-attacher ready: true, restart count 0
Jan  3 06:47:32.393: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  3 06:47:32.393: INFO: 	Container csi-resizer ready: true, restart count 0
Jan  3 06:47:32.393: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan  3 06:47:32.393: INFO: 	Container hostpath ready: true, restart count 0
Jan  3 06:47:32.393: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:47:32.393: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:47:32.393: INFO: ebs-csi-node-78dfk started at 2023-01-03 06:26:09 +0000 UTC (0+3 container statuses recorded)
Jan  3 06:47:32.393: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  3 06:47:32.393: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:47:32.393: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:47:32.393: INFO: cilium-cd88p started at 2023-01-03 06:26:09 +0000 UTC (1+1 container statuses recorded)
Jan  3 06:47:32.393: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  3 06:47:32.393: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  3 06:47:32.393: INFO: affinity-nodeport-g4r5h started at 2023-01-03 06:41:28 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:32.393: INFO: 	Container affinity-nodeport ready: false, restart count 0
Jan  3 06:47:32.393: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-txkql started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:32.393: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:32.393: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-7cwlm started at 2023-01-03 06:40:04 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:32.393: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:32.393: INFO: coredns-559769c974-ls78k started at 2023-01-03 06:26:47 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:32.393: INFO: 	Container coredns ready: true, restart count 0
Jan  3 06:47:32.393: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-vgzx4 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:32.393: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:32.393: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-64hvj started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:32.393: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:32.393: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-mqf8m started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:32.393: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:33.292: INFO: 
Latency metrics for node i-0f6d4ea509bfe3fbe
[DeferCleanup (Each)] [sig-network] Services
  tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "services-3405" for this suite. �[38;5;243m01/03/23 06:47:33.292�[0m

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-node] Container Lifecycle Hook when create a pod with lifecycle hook should execute poststart https hook properly [MinimumKubeletVersion:1.23] [NodeConformance] 5m12s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-node\]\sContainer\sLifecycle\sHook\swhen\screate\sa\spod\swith\slifecycle\shook\sshould\sexecute\spoststart\shttps\shook\sproperly\s\[MinimumKubeletVersion\:1\.23\]\s\[NodeConformance\]$'

test/e2e/framework/pod/pod_client.go:107
k8s.io/kubernetes/test/e2e/framework/pod.(*PodClient).CreateSync(0xc001759e48, 0x38?)
	test/e2e/framework/pod/pod_client.go:107 +0x94
k8s.io/kubernetes/test/e2e/common/node.glob..func12.1.1()
	test/e2e/common/node/lifecycle_hook.go:87 +0x3da
				[BeforeEach] [sig-node] Container Lifecycle Hook
  set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/03/23 06:41:55.33�[0m
Jan  3 06:41:55.330: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename container-lifecycle-hook �[38;5;243m01/03/23 06:41:55.332�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/03/23 06:41:56.035�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/03/23 06:41:56.502�[0m
[BeforeEach] [sig-node] Container Lifecycle Hook
  test/e2e/framework/metrics/init/init.go:31
[BeforeEach] when create a pod with lifecycle hook
  test/e2e/common/node/lifecycle_hook.go:77
�[1mSTEP:�[0m create the container to handle the HTTPGet hook request. �[38;5;243m01/03/23 06:41:57.212�[0m
Jan  3 06:41:57.450: INFO: Waiting up to 5m0s for pod "pod-handle-http-request" in namespace "container-lifecycle-hook-681" to be "running and ready"
Jan  3 06:41:57.683: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 233.132146ms
Jan  3 06:41:57.683: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:41:59.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 2.467545631s
Jan  3 06:41:59.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:42:01.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 4.467555213s
Jan  3 06:42:01.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:42:03.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 6.467722843s
Jan  3 06:42:03.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:42:05.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 8.467610343s
Jan  3 06:42:05.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:42:07.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 10.467377463s
Jan  3 06:42:07.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:42:09.919: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 12.468953405s
Jan  3 06:42:09.919: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:42:11.919: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 14.468500465s
Jan  3 06:42:11.919: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:42:13.919: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 16.468511278s
Jan  3 06:42:13.919: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:42:15.919: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 18.468243532s
Jan  3 06:42:15.919: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:42:17.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 20.468199947s
Jan  3 06:42:17.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:42:19.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 22.467686369s
Jan  3 06:42:19.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:42:21.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 24.468008822s
Jan  3 06:42:21.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:42:23.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 26.46819686s
Jan  3 06:42:23.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:42:25.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 28.467837188s
Jan  3 06:42:25.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:42:27.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 30.46775276s
Jan  3 06:42:27.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:42:29.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 32.467546376s
Jan  3 06:42:29.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:42:31.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 34.467533591s
Jan  3 06:42:31.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:42:33.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 36.468130359s
Jan  3 06:42:33.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:42:35.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 38.467381619s
Jan  3 06:42:35.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:42:37.919: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 40.468311029s
Jan  3 06:42:37.919: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:42:39.919: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 42.468359431s
Jan  3 06:42:39.919: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:42:41.919: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 44.469058738s
Jan  3 06:42:41.919: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:42:43.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 46.46770818s
Jan  3 06:42:43.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:42:45.919: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 48.468811287s
Jan  3 06:42:45.919: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:42:47.919: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 50.46832896s
Jan  3 06:42:47.919: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:42:49.919: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 52.468553831s
Jan  3 06:42:49.919: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:42:51.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 54.467760738s
Jan  3 06:42:51.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:42:53.919: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 56.468981401s
Jan  3 06:42:53.919: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:42:55.919: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 58.468668639s
Jan  3 06:42:55.919: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:42:57.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.46811395s
Jan  3 06:42:57.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:42:59.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.467464979s
Jan  3 06:42:59.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:43:01.917: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.467197047s
Jan  3 06:43:01.917: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:43:03.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.467845851s
Jan  3 06:43:03.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:43:05.921: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.470518217s
Jan  3 06:43:05.921: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:43:07.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.468238529s
Jan  3 06:43:07.919: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:43:09.919: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.4688659s
Jan  3 06:43:09.919: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:43:11.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.467600833s
Jan  3 06:43:11.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:43:13.919: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.468818766s
Jan  3 06:43:13.919: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:43:15.919: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.468888066s
Jan  3 06:43:15.919: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:43:17.920: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.469699172s
Jan  3 06:43:17.920: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:43:19.919: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.468535399s
Jan  3 06:43:19.919: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:43:21.919: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.468494384s
Jan  3 06:43:21.919: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:43:23.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.467696319s
Jan  3 06:43:23.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:43:25.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.467731628s
Jan  3 06:43:25.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:43:27.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.467384857s
Jan  3 06:43:27.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:43:29.919: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.468301605s
Jan  3 06:43:29.919: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:43:31.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.467771822s
Jan  3 06:43:31.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:43:33.921: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.470832137s
Jan  3 06:43:33.921: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:43:35.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.467866509s
Jan  3 06:43:35.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:43:37.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.467326124s
Jan  3 06:43:37.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:43:39.917: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.466715208s
Jan  3 06:43:39.917: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:43:41.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.467673378s
Jan  3 06:43:41.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:43:43.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.467537167s
Jan  3 06:43:43.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:43:45.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.467592696s
Jan  3 06:43:45.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:43:47.919: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.468251752s
Jan  3 06:43:47.919: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:43:49.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.468082299s
Jan  3 06:43:49.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:43:51.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.467897257s
Jan  3 06:43:51.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:43:53.920: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.469307396s
Jan  3 06:43:53.920: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:43:55.922: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.47143634s
Jan  3 06:43:55.922: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:43:57.920: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.469784137s
Jan  3 06:43:57.920: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:43:59.919: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.468896515s
Jan  3 06:43:59.919: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:44:01.919: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.468537652s
Jan  3 06:44:01.919: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:44:03.921: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.470802297s
Jan  3 06:44:03.921: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:44:05.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.467584428s
Jan  3 06:44:05.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:44:07.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.46807551s
Jan  3 06:44:07.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:44:09.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.467626063s
Jan  3 06:44:09.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:44:11.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.467581241s
Jan  3 06:44:11.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:44:13.929: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.479150869s
Jan  3 06:44:13.929: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:44:15.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.467308428s
Jan  3 06:44:15.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:44:17.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.467586309s
Jan  3 06:44:17.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:44:19.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.468061675s
Jan  3 06:44:19.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:44:21.926: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.475654203s
Jan  3 06:44:21.926: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:44:23.920: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.47015405s
Jan  3 06:44:23.920: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:44:25.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.468230693s
Jan  3 06:44:25.919: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:44:27.925: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.474468456s
Jan  3 06:44:27.925: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:44:29.921: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.470996495s
Jan  3 06:44:29.921: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:44:31.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.467542225s
Jan  3 06:44:31.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:44:33.922: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.471797881s
Jan  3 06:44:33.922: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:44:35.924: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.474162167s
Jan  3 06:44:35.924: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:44:37.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.467812103s
Jan  3 06:44:37.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:44:39.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.467434558s
Jan  3 06:44:39.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:44:41.920: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.469419008s
Jan  3 06:44:41.920: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:44:43.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.468201393s
Jan  3 06:44:43.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:44:45.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.46765738s
Jan  3 06:44:45.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:44:47.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.467975567s
Jan  3 06:44:47.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:44:49.920: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.46993442s
Jan  3 06:44:49.920: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:44:51.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.468006995s
Jan  3 06:44:51.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:44:53.919: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.468251561s
Jan  3 06:44:53.919: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:44:55.928: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.478133067s
Jan  3 06:44:55.928: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:44:57.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.468105427s
Jan  3 06:44:57.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:44:59.919: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.468495651s
Jan  3 06:44:59.919: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:45:01.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.468224501s
Jan  3 06:45:01.919: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:45:03.919: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.468333879s
Jan  3 06:45:03.919: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:45:05.919: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.469201927s
Jan  3 06:45:05.920: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:45:07.919: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.46830237s
Jan  3 06:45:07.919: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:45:09.917: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.467200524s
Jan  3 06:45:09.917: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:45:11.919: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.468351116s
Jan  3 06:45:11.919: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:45:13.919: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.468390651s
Jan  3 06:45:13.919: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:45:15.919: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.468551828s
Jan  3 06:45:15.919: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:45:17.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.467296669s
Jan  3 06:45:17.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:45:19.917: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.466909013s
Jan  3 06:45:19.917: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:45:21.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.467674741s
Jan  3 06:45:21.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:45:23.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.46743827s
Jan  3 06:45:23.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:45:25.917: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.466984824s
Jan  3 06:45:25.917: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:45:27.917: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.46687396s
Jan  3 06:45:27.917: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:45:29.917: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.467134202s
Jan  3 06:45:29.917: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:45:31.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.467516151s
Jan  3 06:45:31.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:45:33.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.467281909s
Jan  3 06:45:33.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:45:35.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.467318499s
Jan  3 06:45:35.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:45:37.917: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.46709901s
Jan  3 06:45:37.917: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:45:39.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.467308754s
Jan  3 06:45:39.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:45:41.917: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.467098851s
Jan  3 06:45:41.917: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:45:43.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.467563395s
Jan  3 06:45:43.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:45:45.917: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.466918565s
Jan  3 06:45:45.917: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:45:47.917: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.466973741s
Jan  3 06:45:47.917: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:45:49.917: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.46665722s
Jan  3 06:45:49.917: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:45:51.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.467337457s
Jan  3 06:45:51.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:45:53.923: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.472480606s
Jan  3 06:45:53.923: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:45:55.917: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.467102238s
Jan  3 06:45:55.917: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:45:57.917: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.467220606s
Jan  3 06:45:57.917: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:45:59.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.467781256s
Jan  3 06:45:59.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:46:01.919: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.468522289s
Jan  3 06:46:01.919: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:46:03.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.467913213s
Jan  3 06:46:03.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:46:05.917: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.467009134s
Jan  3 06:46:05.917: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:46:07.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.467653034s
Jan  3 06:46:07.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:46:09.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.467399008s
Jan  3 06:46:09.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:46:11.917: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.467201223s
Jan  3 06:46:11.917: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:46:13.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.467347743s
Jan  3 06:46:13.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:46:15.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.467412639s
Jan  3 06:46:15.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:46:17.919: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.469138305s
Jan  3 06:46:17.919: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:46:19.917: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.467171683s
Jan  3 06:46:19.917: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:46:21.917: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.467143156s
Jan  3 06:46:21.917: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:46:23.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.467948167s
Jan  3 06:46:23.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:46:25.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.467473594s
Jan  3 06:46:25.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:46:27.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.46805018s
Jan  3 06:46:27.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:46:29.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.46799824s
Jan  3 06:46:29.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:46:31.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.467295909s
Jan  3 06:46:31.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:46:33.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.467865248s
Jan  3 06:46:33.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:46:35.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.467539912s
Jan  3 06:46:35.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:46:37.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.467303788s
Jan  3 06:46:37.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:46:39.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.467477309s
Jan  3 06:46:39.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:46:41.917: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.467175407s
Jan  3 06:46:41.917: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:46:43.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.467699448s
Jan  3 06:46:43.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:46:45.917: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.46717055s
Jan  3 06:46:45.917: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:46:47.917: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.466959231s
Jan  3 06:46:47.917: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:46:49.917: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.466992091s
Jan  3 06:46:49.917: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:46:51.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.467377068s
Jan  3 06:46:51.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:46:53.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.46756913s
Jan  3 06:46:53.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:46:55.918: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.46726658s
Jan  3 06:46:55.918: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:46:57.917: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.467049914s
Jan  3 06:46:57.917: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:46:58.151: INFO: Pod "pod-handle-http-request": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.700492847s
Jan  3 06:46:58.151: INFO: The phase of Pod pod-handle-http-request is Pending, waiting for it to be Running (with Ready = true)
Jan  3 06:46:58.152: INFO: Unexpected error: 
    <*pod.timeoutError | 0xc00476a510>: {
        msg: "timed out while waiting for pod container-lifecycle-hook-681/pod-handle-http-request to be running and ready",
        observedObjects: [
            <*v1.Pod | 0xc000a76000>{
                TypeMeta: {Kind: "", APIVersion: ""},
                ObjectMeta: {
                    Name: "pod-handle-http-request",
                    GenerateName: "",
                    Namespace: "container-lifecycle-hook-681",
                    SelfLink: "",
                    UID: "c36636de-3c23-4ee8-8ef7-39a803e95aa5",
                    ResourceVersion: "27511",
                    Generation: 0,
                    CreationTimestamp: {
                        Time: {
                            wall: 0,
                            ext: 63808324917,
                            loc: {
                                name: "Local",
                                zone: [
                                    {name: "UTC", offset: 0, isDST: false},
                                ],
                                tx: [
                                    {
                                        when: -576460752303423488,
                                        index: 0,
                                        isstd: false,
                                        isutc: false,
                                    },
                                ],
                                extend: "UTC0",
                                cacheStart: 9223372036854775807,
                                cacheEnd: 9223372036854775807,
                                cacheZone: {name: "UTC", offset: 0, isDST: false},
                            },
                        },
                    },
                    DeletionTimestamp: nil,
                    DeletionGracePeriodSeconds: nil,
                    Labels: nil,
                    Annotations: nil,
                    OwnerReferences: nil,
                    Finalizers: nil,
                    ManagedFields: [
                        {
                            Manager: "e2e.test",
                            Operation: "Update",
                            APIVersion: "v1",
                            Time: {
                                Time: {
                                    wall: 0,
                                    ext: 63808324917,
                                    loc: {
                                        name: "Local",
                                        zone: [...],
                                        tx: [...],
                                        extend: "UTC0",
                                        cacheStart: 9223372036854775807,
                                        cacheEnd: 9223372036854775807,
                                        cacheZone: {name: ..., offset: ..., isDST: ...},
                                    },
                                },
                            },
                            FieldsType: "FieldsV1",
                            FieldsV1: {
                                Raw: "{\"f:spec\":{\"f:affinity\":{\".\":{},\"f:nodeAffinity\":{\".\":{},\"f:requiredDuringSchedulingIgnoredDuringExecution\":{}}},\"f:containers\":{\"k:{\\\"name\\\":\\\"container-handle-http-request\\\"}\":{\".\":{},\"f:args\":{},\"f:image\":{},\"f:imagePullPolicy\":{},\"f:name\":{},\"f:ports\":{\".\":{},\"k:{\\\"containerPort\\\":8080,\\\"protocol\\\":\\\"TCP\\\"}\":{\".\":{},\"f:containerPort\":{},\"f:protocol\":{}}},\"f:resources\":{},\"f:securityContext\":{},\"f:terminationMessagePath\":{},\"f:terminationMessagePolicy\":{}},\"k:{\\\"name\\\":\\\"container-handle-https-request\\\"}\":{\".\":{},\"f:args\":{},\"f:image\":{},\"f:imagePullPolicy\":{},\"f:name\":{},\"f:ports\":{\".\":{},\"k:{\\\"containerPort\\\":9090,\\\"protocol\\\":\\\"TCP\\\"}\":{\".\":{},\"f:containerPort\":{},\"f:protocol\":{}}},\"f:resources\":{},\"f:securityContext\":{},\"f:terminationMessagePath\":{},\"f:terminationMessagePolicy\":{}}},\"f:dnsPolicy\":{},\"f:enableServiceLinks\":{},\"f:restartPolicy\":{},\"f:schedulerName\":{},\"f:securityContext\":{},\"f:terminationGracePeriodSeconds\":{}}}",
                            },
                            Subresource: "",
                        },
                        {
                            Manager: "kubelet",
                            Operation: "Update",
                            APIVersion: "v1",
                            Time: {
                                Time: {
                                    wall: 0,
                                    ext: 63808324917,
                                    loc: {
                                        name: "Local",
                                        zone: [...],
                                        tx: [...],
                                        extend: "UTC0",
                                        cacheStart: 9223372036854775807,
                                        cacheEnd: 9223372036854775807,
                                        cacheZone: {name: ..., offset: ..., isDST: ...},
                                    },
                                },
                            },
                            FieldsType: "FieldsV1",
                            FieldsV1: {
                                Raw: "{\"f:status\":{\"f:conditions\":{\"k:{\\\"type\\\":\\\"ContainersReady\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:message\":{},\"f:reason\":{},\"f:status\":{},\"f:type\":{}},\"k:{\\\"type\\\":\\\"Initialized\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:status\":{},\"f:type\":{}},\"k:{\\\"type\\\":\\\"Ready\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:message\":{},\"f:reason\":{},\"f:status\":{},\"f:type\":{}}},\"f:containerStatuses\":{},\"f:hostIP\":{},\"f:startTime\":{}}}",
                            },
                            Subresource: "status",
                        },
                    ],
                },
                Spec: {
                    Volumes: [
                        {
                            Name: "kube-api-access-hrn6f",
                            VolumeSource: {
                                HostPath: nil,
                                EmptyDir: nil,
                                GCEPersistentDisk: nil,
                                AWSElasticBlockStore: nil,
                                GitRepo: nil,
                                Secret: nil,
                                NFS: nil,
                                ISCSI: nil,
                                Glusterfs: nil,
                                PersistentVolumeClaim: nil,
                                RBD: nil,
                                FlexVolume: nil,
                                Cinder: nil,
                                CephFS: nil,
                                Flocker: nil,
                                DownwardAPI: nil,
                                FC: nil,
                                AzureFile: nil,
                                ConfigMap: nil,
                                VsphereVolume: nil,
                                Quobyte: nil,
                                AzureDisk: nil,
                                PhotonPersistentDisk: nil,
                                Projected: {
                                    Sources: [
                                        {
                                            Secret: ...,
                                            DownwardAPI: ...,
                                            ConfigMap: ...,
                                            ServiceAccountToken: ...,
                                        },
                                        {
                                            Secret: ...,
                                            DownwardAPI: ...,
                                            ConfigMap: ...,
                    ...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

Jan  3 06:46:58.152: FAIL: timed out while waiting for pod container-lifecycle-hook-681/pod-handle-http-request to be running and ready

Full Stack Trace
k8s.io/kubernetes/test/e2e/framework/pod.(*PodClient).CreateSync(0xc001759e48, 0x38?)
	test/e2e/framework/pod/pod_client.go:107 +0x94
k8s.io/kubernetes/test/e2e/common/node.glob..func12.1.1()
	test/e2e/common/node/lifecycle_hook.go:87 +0x3da
[AfterEach] [sig-node] Container Lifecycle Hook
  test/e2e/framework/node/init/init.go:32
Jan  3 06:46:58.153: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-node] Container Lifecycle Hook
  test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-node] Container Lifecycle Hook
  dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/03/23 06:46:58.388�[0m
�[1mSTEP:�[0m Collecting events from namespace "container-lifecycle-hook-681". �[38;5;243m01/03/23 06:46:58.388�[0m
�[1mSTEP:�[0m Found 11 events. �[38;5;243m01/03/23 06:46:58.622�[0m
Jan  3 06:46:58.622: INFO: At 2023-01-03 06:41:57 +0000 UTC - event for pod-handle-http-request: {default-scheduler } Scheduled: Successfully assigned container-lifecycle-hook-681/pod-handle-http-request to i-0f6d4ea509bfe3fbe
Jan  3 06:46:58.622: INFO: At 2023-01-03 06:41:57 +0000 UTC - event for pod-handle-http-request: {kubelet i-0f6d4ea509bfe3fbe} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ded141cc4e280f87f988d4c56e0a4c1546da3b90b35835d92b730b53be789684": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:46:58.622: INFO: At 2023-01-03 06:42:09 +0000 UTC - event for pod-handle-http-request: {kubelet i-0f6d4ea509bfe3fbe} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "314268a8b49e3086849fcea2281bf5114be3bcbbd52eabd362b9df1689dbe309": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:46:58.622: INFO: At 2023-01-03 06:42:21 +0000 UTC - event for pod-handle-http-request: {kubelet i-0f6d4ea509bfe3fbe} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e07b4cf5d0a6ffd5fbd22183b4718683078d984dda6f816e5902eb4587f93292": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:46:58.622: INFO: At 2023-01-03 06:42:35 +0000 UTC - event for pod-handle-http-request: {kubelet i-0f6d4ea509bfe3fbe} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "22288a4a79681af4eb823ab7bd6da4cf78ec9b1879706738b755a63f230b78c2": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:46:58.622: INFO: At 2023-01-03 06:42:49 +0000 UTC - event for pod-handle-http-request: {kubelet i-0f6d4ea509bfe3fbe} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "2b1db850f7f9484369574f24bbf1513e120b3ef8073325e3537db8095ee98724": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:46:58.622: INFO: At 2023-01-03 06:43:03 +0000 UTC - event for pod-handle-http-request: {kubelet i-0f6d4ea509bfe3fbe} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "75c3ae1c52958ce6e60d28fdf9cda748df54bc437aa539943cd6904caeba74db": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:46:58.622: INFO: At 2023-01-03 06:43:15 +0000 UTC - event for pod-handle-http-request: {kubelet i-0f6d4ea509bfe3fbe} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d0ff1493c3e1e61f653367878f3e0acf8f20c6b487d462a97b6202cef8aac4c1": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:46:58.622: INFO: At 2023-01-03 06:43:30 +0000 UTC - event for pod-handle-http-request: {kubelet i-0f6d4ea509bfe3fbe} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ef3cf2af7e393ac695d7ed805c484c4d8270a5aa72158c5797b0437d4b4183e4": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:46:58.622: INFO: At 2023-01-03 06:43:45 +0000 UTC - event for pod-handle-http-request: {kubelet i-0f6d4ea509bfe3fbe} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ea8dd074b1e12c6ec1610ec23d254a14e8dc6d61b5d1345b2bb25016634e9ff8": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:46:58.622: INFO: At 2023-01-03 06:44:00 +0000 UTC - event for pod-handle-http-request: {kubelet i-0f6d4ea509bfe3fbe} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "9de0d8de3d0ec992cb3d9bfc291b24c4c152d05148a35a415f54b510a784ed7b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:46:58.855: INFO: POD                      NODE                 PHASE    GRACE  CONDITIONS
Jan  3 06:46:58.855: INFO: pod-handle-http-request  i-0f6d4ea509bfe3fbe  Pending         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-03 06:41:57 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-03 06:41:57 +0000 UTC ContainersNotReady containers with unready status: [container-handle-http-request container-handle-https-request]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-03 06:41:57 +0000 UTC ContainersNotReady containers with unready status: [container-handle-http-request container-handle-https-request]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-03 06:41:57 +0000 UTC  }]
Jan  3 06:46:58.855: INFO: 
Jan  3 06:46:59.090: INFO: Unable to fetch container-lifecycle-hook-681/pod-handle-http-request/container-handle-http-request logs: the server rejected our request for an unknown reason (get pods pod-handle-http-request)
Jan  3 06:46:59.325: INFO: Unable to fetch container-lifecycle-hook-681/pod-handle-http-request/container-handle-https-request logs: the server rejected our request for an unknown reason (get pods pod-handle-http-request)
Jan  3 06:46:59.559: INFO: 
Logging node info for node i-0116ec5cfa0915363
Jan  3 06:46:59.793: INFO: Node Info: &Node{ObjectMeta:{i-0116ec5cfa0915363    845a5e73-b93d-4679-a025-6403fe91469b 27782 0 2023-01-03 06:24:27 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0116ec5cfa0915363 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:ap-south-1a topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.51.97 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0116ec5cfa0915363"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-03 06:24:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-03 06:24:54 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:25:11 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-03 06:25:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-03 06:25:13 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-03 06:42:20 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0116ec5cfa0915363,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892301824 0} {<nil>} 3801076Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787444224 0} {<nil>} 3698676Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-03 06:42:20 +0000 UTC,LastTransitionTime:2023-01-03 06:24:21 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-03 06:42:20 +0000 UTC,LastTransitionTime:2023-01-03 06:24:21 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-03 06:42:20 +0000 UTC,LastTransitionTime:2023-01-03 06:24:21 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-03 06:42:20 +0000 UTC,LastTransitionTime:2023-01-03 06:25:11 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.51.97,},NodeAddress{Type:ExternalIP,Address:35.154.4.55,},NodeAddress{Type:InternalDNS,Address:i-0116ec5cfa0915363.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0116ec5cfa0915363.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-154-4-55.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec291a4b21ade93e02dbfdea9af30b8c,SystemUUID:ec291a4b-21ad-e93e-02db-fdea9af30b8c,BootID:3cd177e4-da3b-4287-b5dc-70d163e7dd13,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.0],SizeBytes:135162323,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.0],SizeBytes:124991801,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.0],SizeBytes:57657656,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43446388,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42805548,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4967304,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan  3 06:46:59.793: INFO: 
Logging kubelet events for node i-0116ec5cfa0915363
Jan  3 06:47:00.029: INFO: 
Logging pods the kubelet thinks is on node i-0116ec5cfa0915363
Jan  3 06:47:00.270: INFO: etcd-manager-events-i-0116ec5cfa0915363 started at 2023-01-03 06:23:51 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:00.270: INFO: 	Container etcd-manager ready: true, restart count 0
Jan  3 06:47:00.270: INFO: kube-apiserver-i-0116ec5cfa0915363 started at 2023-01-03 06:23:51 +0000 UTC (0+2 container statuses recorded)
Jan  3 06:47:00.270: INFO: 	Container healthcheck ready: true, restart count 0
Jan  3 06:47:00.270: INFO: 	Container kube-apiserver ready: true, restart count 1
Jan  3 06:47:00.270: INFO: kube-controller-manager-i-0116ec5cfa0915363 started at 2023-01-03 06:23:51 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:00.270: INFO: 	Container kube-controller-manager ready: true, restart count 2
Jan  3 06:47:00.270: INFO: kube-scheduler-i-0116ec5cfa0915363 started at 2023-01-03 06:23:51 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:00.270: INFO: 	Container kube-scheduler ready: true, restart count 0
Jan  3 06:47:00.270: INFO: kops-controller-9t2zt started at 2023-01-03 06:24:59 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:00.271: INFO: 	Container kops-controller ready: true, restart count 0
Jan  3 06:47:00.271: INFO: cilium-npb6w started at 2023-01-03 06:24:59 +0000 UTC (1+1 container statuses recorded)
Jan  3 06:47:00.271: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  3 06:47:00.271: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  3 06:47:00.271: INFO: aws-cloud-controller-manager-mvsjr started at 2023-01-03 06:24:59 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:00.271: INFO: 	Container aws-cloud-controller-manager ready: true, restart count 0
Jan  3 06:47:00.271: INFO: ebs-csi-node-pg7l9 started at 2023-01-03 06:24:59 +0000 UTC (0+3 container statuses recorded)
Jan  3 06:47:00.271: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  3 06:47:00.271: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:47:00.271: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:47:00.271: INFO: dns-controller-69987775c6-rgd5s started at 2023-01-03 06:25:00 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:00.271: INFO: 	Container dns-controller ready: true, restart count 0
Jan  3 06:47:00.271: INFO: etcd-manager-main-i-0116ec5cfa0915363 started at 2023-01-03 06:23:51 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:00.271: INFO: 	Container etcd-manager ready: true, restart count 0
Jan  3 06:47:00.271: INFO: cilium-operator-5dd44dc49f-nzbgs started at 2023-01-03 06:25:00 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:00.271: INFO: 	Container cilium-operator ready: true, restart count 0
Jan  3 06:47:00.271: INFO: ebs-csi-controller-89b649c94-4zgt2 started at 2023-01-03 06:25:00 +0000 UTC (0+5 container statuses recorded)
Jan  3 06:47:00.271: INFO: 	Container csi-attacher ready: true, restart count 0
Jan  3 06:47:00.271: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  3 06:47:00.271: INFO: 	Container csi-resizer ready: true, restart count 0
Jan  3 06:47:00.271: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  3 06:47:00.271: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:47:01.035: INFO: 
Latency metrics for node i-0116ec5cfa0915363
Jan  3 06:47:01.035: INFO: 
Logging node info for node i-06675ed9fdf15131e
Jan  3 06:47:01.269: INFO: Node Info: &Node{ObjectMeta:{i-06675ed9fdf15131e    6a365a73-a0a0-47e1-83ac-1dd53dc6cb56 29432 0 2023-01-03 06:26:03 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-06675ed9fdf15131e kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-06675ed9fdf15131e topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.34.128 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-7802":"i-06675ed9fdf15131e","csi-mock-csi-mock-volumes-5893":"i-06675ed9fdf15131e","ebs.csi.aws.com":"i-06675ed9fdf15131e"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-03 06:26:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-03 06:26:03 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-03 06:26:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-03 06:26:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:26:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {e2e.test Update v1 2023-01-03 06:40:01 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:40:12 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-03 06:45:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-06675ed9fdf15131e,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-03 06:45:25 +0000 UTC,LastTransitionTime:2023-01-03 06:26:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-03 06:45:25 +0000 UTC,LastTransitionTime:2023-01-03 06:26:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-03 06:45:25 +0000 UTC,LastTransitionTime:2023-01-03 06:26:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-03 06:45:25 +0000 UTC,LastTransitionTime:2023-01-03 06:26:18 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.34.128,},NodeAddress{Type:ExternalIP,Address:13.233.53.249,},NodeAddress{Type:InternalDNS,Address:i-06675ed9fdf15131e.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-06675ed9fdf15131e.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-233-53-249.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec278d28e0e8aa5f9f5a88afed4c7357,SystemUUID:ec278d28-e0e8-aa5f-9f5a-88afed4c7357,BootID:60717d56-76f8-4838-8bb7-4a4ce6867c70,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-7802^78eb4252-8b31-11ed-a7cd-e699b846bc6a],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-7802^78eb4252-8b31-11ed-a7cd-e699b846bc6a,DevicePath:,},},Config:nil,},}
Jan  3 06:47:01.270: INFO: 
Logging kubelet events for node i-06675ed9fdf15131e
Jan  3 06:47:01.517: INFO: 
Logging pods the kubelet thinks is on node i-06675ed9fdf15131e
Jan  3 06:47:01.761: INFO: cilium-88fm4 started at 2023-01-03 06:26:04 +0000 UTC (1+1 container statuses recorded)
Jan  3 06:47:01.761: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  3 06:47:01.761: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  3 06:47:01.761: INFO: hostpath-client started at 2023-01-03 06:40:11 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:01.761: INFO: 	Container hostpath-client ready: false, restart count 0
Jan  3 06:47:01.761: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-pn6rb started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:01.762: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:01.762: INFO: coredns-autoscaler-7cb5c5b969-tg22d started at 2023-01-03 06:26:18 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:01.762: INFO: 	Container autoscaler ready: true, restart count 0
Jan  3 06:47:01.762: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-bhflv started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:01.762: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:01.762: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-qbds6 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:01.762: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:01.762: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-5qt2b started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:01.762: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:01.762: INFO: csi-hostpathplugin-0 started at 2023-01-03 06:42:46 +0000 UTC (0+7 container statuses recorded)
Jan  3 06:47:01.762: INFO: 	Container csi-attacher ready: false, restart count 0
Jan  3 06:47:01.762: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan  3 06:47:01.762: INFO: 	Container csi-resizer ready: false, restart count 0
Jan  3 06:47:01.762: INFO: 	Container csi-snapshotter ready: false, restart count 0
Jan  3 06:47:01.762: INFO: 	Container hostpath ready: false, restart count 0
Jan  3 06:47:01.762: INFO: 	Container liveness-probe ready: false, restart count 0
Jan  3 06:47:01.762: INFO: 	Container node-driver-registrar ready: false, restart count 0
Jan  3 06:47:01.762: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-kn247 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:01.762: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:01.762: INFO: csi-hostpathplugin-0 started at 2023-01-03 06:43:56 +0000 UTC (0+7 container statuses recorded)
Jan  3 06:47:01.762: INFO: 	Container csi-attacher ready: false, restart count 0
Jan  3 06:47:01.762: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan  3 06:47:01.762: INFO: 	Container csi-resizer ready: false, restart count 0
Jan  3 06:47:01.762: INFO: 	Container csi-snapshotter ready: false, restart count 0
Jan  3 06:47:01.762: INFO: 	Container hostpath ready: false, restart count 0
Jan  3 06:47:01.762: INFO: 	Container liveness-probe ready: false, restart count 0
Jan  3 06:47:01.762: INFO: 	Container node-driver-registrar ready: false, restart count 0
Jan  3 06:47:01.762: INFO: ebs-csi-node-q24xb started at 2023-01-03 06:26:04 +0000 UTC (0+3 container statuses recorded)
Jan  3 06:47:01.762: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  3 06:47:01.762: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:47:01.762: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:47:01.762: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-vkxkf started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:01.762: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:01.762: INFO: csi-mockplugin-0 started at 2023-01-03 06:42:50 +0000 UTC (0+3 container statuses recorded)
Jan  3 06:47:01.762: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  3 06:47:01.762: INFO: 	Container driver-registrar ready: true, restart count 0
Jan  3 06:47:01.762: INFO: 	Container mock ready: true, restart count 0
Jan  3 06:47:01.762: INFO: csi-mockplugin-resizer-0 started at 2023-01-03 06:42:51 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:01.762: INFO: 	Container csi-resizer ready: false, restart count 0
Jan  3 06:47:01.762: INFO: coredns-559769c974-xh6r4 started at 2023-01-03 06:26:18 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:01.762: INFO: 	Container coredns ready: true, restart count 0
Jan  3 06:47:01.762: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-gcftr started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:01.762: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:01.762: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-knmjr started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:01.762: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: false, restart count 0
Jan  3 06:47:01.762: INFO: pvc-volume-tester-tnqg4 started at 2023-01-03 06:43:36 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:01.762: INFO: 	Container volume-tester ready: false, restart count 0
Jan  3 06:47:01.762: INFO: inline-volume-tester-578zd started at 2023-01-03 06:43:56 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:01.762: INFO: 	Container csi-volume-tester ready: false, restart count 0
Jan  3 06:47:01.762: INFO: csi-hostpathplugin-0 started at 2023-01-03 06:39:40 +0000 UTC (0+7 container statuses recorded)
Jan  3 06:47:01.762: INFO: 	Container csi-attacher ready: true, restart count 0
Jan  3 06:47:01.762: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  3 06:47:01.762: INFO: 	Container csi-resizer ready: true, restart count 0
Jan  3 06:47:01.762: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan  3 06:47:01.762: INFO: 	Container hostpath ready: true, restart count 0
Jan  3 06:47:01.762: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:47:01.762: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:47:01.762: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-vmn8b started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:01.762: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:01.762: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-gzk6r started at 2023-01-03 06:40:04 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:01.762: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: false, restart count 0
Jan  3 06:47:01.762: INFO: inline-volume-tester-7frp2 started at 2023-01-03 06:42:47 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:01.762: INFO: 	Container csi-volume-tester ready: false, restart count 0
Jan  3 06:47:02.816: INFO: 
Latency metrics for node i-06675ed9fdf15131e
Jan  3 06:47:02.816: INFO: 
Logging node info for node i-0887927f295dab249
Jan  3 06:47:03.050: INFO: Node Info: &Node{ObjectMeta:{i-0887927f295dab249    8c537f9f-6ce2-4eae-a273-3e5dec0f5a97 29289 0 2023-01-03 06:26:08 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0887927f295dab249 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-0887927f295dab249 topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.43.47 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-7494":"i-0887927f295dab249","ebs.csi.aws.com":"i-0887927f295dab249"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-03 06:40:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:45:11 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-03 06:45:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0887927f295dab249,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-03 06:45:13 +0000 UTC,LastTransitionTime:2023-01-03 06:26:08 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-03 06:45:13 +0000 UTC,LastTransitionTime:2023-01-03 06:26:08 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-03 06:45:13 +0000 UTC,LastTransitionTime:2023-01-03 06:26:08 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-03 06:45:13 +0000 UTC,LastTransitionTime:2023-01-03 06:26:24 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.43.47,},NodeAddress{Type:ExternalIP,Address:65.0.96.201,},NodeAddress{Type:InternalDNS,Address:i-0887927f295dab249.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0887927f295dab249.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-65-0-96-201.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2d5f1c251f05fc398417508c564588,SystemUUID:ec2d5f1c-251f-05fc-3984-17508c564588,BootID:80a76b6c-5e81-478d-a15c-92ab635eebdb,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-7494^2a9b5c2b-8b32-11ed-9a17-02cea9609c51 kubernetes.io/csi/csi-hostpath-ephemeral-7494^2a9f4d2c-8b32-11ed-9a17-02cea9609c51 kubernetes.io/csi/ebs.csi.aws.com^vol-0747fe00dd5d5923d],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-7494^2a9b5c2b-8b32-11ed-9a17-02cea9609c51,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-7494^2a9f4d2c-8b32-11ed-9a17-02cea9609c51,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0747fe00dd5d5923d,DevicePath:,},},Config:nil,},}
Jan  3 06:47:03.051: INFO: 
Logging kubelet events for node i-0887927f295dab249
Jan  3 06:47:03.286: INFO: 
Logging pods the kubelet thinks is on node i-0887927f295dab249
Jan  3 06:47:03.536: INFO: test-deployment-swhng-54bc444df-8rmgv started at 2023-01-03 06:44:38 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:03.536: INFO: 	Container httpd ready: false, restart count 0
Jan  3 06:47:03.536: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-47hz9 started at 2023-01-03 06:40:04 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:03.536: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:03.536: INFO: pod-9d10df65-59e8-4966-a058-376431a1bbfe started at 2023-01-03 06:43:23 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:03.536: INFO: 	Container write-pod ready: false, restart count 0
Jan  3 06:47:03.536: INFO: csi-hostpathplugin-0 started at 2023-01-03 06:43:44 +0000 UTC (0+7 container statuses recorded)
Jan  3 06:47:03.536: INFO: 	Container csi-attacher ready: true, restart count 0
Jan  3 06:47:03.536: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  3 06:47:03.536: INFO: 	Container csi-resizer ready: true, restart count 0
Jan  3 06:47:03.536: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan  3 06:47:03.536: INFO: 	Container hostpath ready: true, restart count 0
Jan  3 06:47:03.536: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:47:03.536: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:47:03.536: INFO: test-pod-8f8b0f25-9283-406c-a37f-7b953461815d started at 2023-01-03 06:42:39 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:03.536: INFO: 	Container agnhost-container ready: false, restart count 0
Jan  3 06:47:03.536: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-5tzj6 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:03.536: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:03.536: INFO: pod-adoption-release started at 2023-01-03 06:46:06 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:03.536: INFO: 	Container pod-adoption-release ready: false, restart count 0
Jan  3 06:47:03.536: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-5sjfb started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:03.536: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:03.536: INFO: ss2-0 started at 2023-01-03 06:45:36 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:03.536: INFO: 	Container webserver ready: false, restart count 0
Jan  3 06:47:03.536: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-qs9vk started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:03.536: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:03.536: INFO: pod-configmaps-6ac65fd0-2362-460b-b401-dc12549b2575 started at 2023-01-03 06:45:42 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:03.536: INFO: 	Container agnhost-container ready: false, restart count 0
Jan  3 06:47:03.536: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-nzbt8 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:03.536: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:03.536: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-kmgz2 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:03.536: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:03.536: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-z8hhz started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:03.536: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:03.536: INFO: ebs-csi-node-22htr started at 2023-01-03 06:26:09 +0000 UTC (0+3 container statuses recorded)
Jan  3 06:47:03.536: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  3 06:47:03.536: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:47:03.536: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:47:03.536: INFO: inline-volume-tester-qwfhg started at 2023-01-03 06:45:10 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:03.536: INFO: 	Container csi-volume-tester ready: false, restart count 0
Jan  3 06:47:03.536: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-m9n4g started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:03.536: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:03.536: INFO: dns-test-71df1669-ca24-4488-bdc2-c2149686db55 started at 2023-01-03 06:46:44 +0000 UTC (0+3 container statuses recorded)
Jan  3 06:47:03.536: INFO: 	Container jessie-querier ready: false, restart count 0
Jan  3 06:47:03.536: INFO: 	Container querier ready: false, restart count 0
Jan  3 06:47:03.536: INFO: 	Container webserver ready: false, restart count 0
Jan  3 06:47:03.536: INFO: cilium-s9l8s started at 2023-01-03 06:26:09 +0000 UTC (1+1 container statuses recorded)
Jan  3 06:47:03.536: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  3 06:47:03.536: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  3 06:47:03.536: INFO: startup-33131899-1a42-412a-9a76-c7ee101e12d3 started at 2023-01-03 06:44:39 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:03.536: INFO: 	Container busybox ready: false, restart count 0
Jan  3 06:47:03.536: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-dbt7p started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:03.536: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:03.536: INFO: affinity-nodeport-fh67z started at 2023-01-03 06:41:28 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:03.536: INFO: 	Container affinity-nodeport ready: true, restart count 0
Jan  3 06:47:03.536: INFO: pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7 started at 2023-01-03 06:42:10 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:03.536: INFO: 	Container env-test ready: false, restart count 0
Jan  3 06:47:03.536: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-87btk started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:03.536: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:04.459: INFO: 
Latency metrics for node i-0887927f295dab249
Jan  3 06:47:04.459: INFO: 
Logging node info for node i-0c4c153cc3021d728
Jan  3 06:47:04.693: INFO: Node Info: &Node{ObjectMeta:{i-0c4c153cc3021d728    0fc330cf-9a4f-4650-8df2-bbc4962562bf 29761 0 2023-01-03 06:26:07 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a io.kubernetes.storage.mock/node:some-mock-node kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0c4c153cc3021d728 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-0c4c153cc3021d728 topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.34.232 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-volume-expand-9886":"i-0c4c153cc3021d728","ebs.csi.aws.com":"i-0c4c153cc3021d728"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-03 06:26:07 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-03 06:26:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-03 06:26:07 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:26:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-03 06:26:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-03 06:40:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-03 06:46:11 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-01-03 06:46:12 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0c4c153cc3021d728,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-03 06:46:11 +0000 UTC,LastTransitionTime:2023-01-03 06:26:07 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-03 06:46:11 +0000 UTC,LastTransitionTime:2023-01-03 06:26:07 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-03 06:46:11 +0000 UTC,LastTransitionTime:2023-01-03 06:26:07 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-03 06:46:11 +0000 UTC,LastTransitionTime:2023-01-03 06:26:23 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.34.232,},NodeAddress{Type:ExternalIP,Address:13.232.119.101,},NodeAddress{Type:InternalDNS,Address:i-0c4c153cc3021d728.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0c4c153cc3021d728.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-232-119-101.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec20ee6ab34ca9da624dd2e5f8c44780,SystemUUID:ec20ee6a-b34c-a9da-624d-d2e5f8c44780,BootID:960d66c3-58ec-4ea0-a76c-db5eb00e743c,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-volume-expand-9886^4e0f5548-8b32-11ed-8e7f-066d9af4aed6],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-volume-expand-9886^4e0f5548-8b32-11ed-8e7f-066d9af4aed6,DevicePath:,},},Config:nil,},}
Jan  3 06:47:04.694: INFO: 
Logging kubelet events for node i-0c4c153cc3021d728
Jan  3 06:47:04.929: INFO: 
Logging pods the kubelet thinks is on node i-0c4c153cc3021d728
Jan  3 06:47:05.174: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-44v74 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:05.174: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:05.174: INFO: downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704 started at 2023-01-03 06:42:24 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:05.174: INFO: 	Container dapi-container ready: false, restart count 0
Jan  3 06:47:05.174: INFO: cilium-87m98 started at 2023-01-03 06:26:08 +0000 UTC (1+1 container statuses recorded)
Jan  3 06:47:05.174: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  3 06:47:05.174: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  3 06:47:05.174: INFO: fail-once-non-local-ms76g started at 2023-01-03 06:45:23 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:05.174: INFO: 	Container c ready: false, restart count 0
Jan  3 06:47:05.174: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-tfhlj started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:05.174: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:05.174: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-fh8hc started at 2023-01-03 06:40:04 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:05.174: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:05.174: INFO: fail-once-non-local-27nz9 started at 2023-01-03 06:45:02 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:05.174: INFO: 	Container c ready: false, restart count 0
Jan  3 06:47:05.174: INFO: fail-once-non-local-wdcck started at 2023-01-03 06:44:35 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:05.174: INFO: 	Container c ready: false, restart count 0
Jan  3 06:47:05.174: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-55wkd started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:05.174: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:05.174: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-l9w98 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:05.174: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:05.174: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-w8kkx started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:05.174: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:05.174: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-s8mtc started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:05.174: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:05.174: INFO: fail-once-non-local-82rmn started at 2023-01-03 06:44:35 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:05.174: INFO: 	Container c ready: false, restart count 0
Jan  3 06:47:05.174: INFO: fail-once-non-local-jk86f started at 2023-01-03 06:45:06 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:05.174: INFO: 	Container c ready: false, restart count 0
Jan  3 06:47:05.174: INFO: hostexec-i-0c4c153cc3021d728-s292j started at 2023-01-03 06:45:18 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:05.174: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  3 06:47:05.174: INFO: pod-subpath-test-preprovisionedpv-vsdz started at 2023-01-03 06:45:30 +0000 UTC (2+1 container statuses recorded)
Jan  3 06:47:05.174: INFO: 	Init container init-volume-preprovisionedpv-vsdz ready: false, restart count 0
Jan  3 06:47:05.174: INFO: 	Init container test-init-volume-preprovisionedpv-vsdz ready: false, restart count 0
Jan  3 06:47:05.174: INFO: 	Container test-container-subpath-preprovisionedpv-vsdz ready: false, restart count 0
Jan  3 06:47:05.174: INFO: ebs-csi-node-5sgcl started at 2023-01-03 06:26:08 +0000 UTC (0+3 container statuses recorded)
Jan  3 06:47:05.174: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  3 06:47:05.175: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:47:05.175: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:47:05.175: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-98hxx started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:05.175: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:05.175: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-4sx4g started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:05.175: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:05.175: INFO: pod-20c75720-f672-49af-b552-0eceef5b318c started at 2023-01-03 06:46:11 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:05.175: INFO: 	Container write-pod ready: false, restart count 0
Jan  3 06:47:05.175: INFO: pod-subpath-test-inlinevolume-z5hb started at 2023-01-03 06:46:53 +0000 UTC (2+2 container statuses recorded)
Jan  3 06:47:05.175: INFO: 	Init container init-volume-inlinevolume-z5hb ready: false, restart count 0
Jan  3 06:47:05.175: INFO: 	Init container test-init-subpath-inlinevolume-z5hb ready: false, restart count 0
Jan  3 06:47:05.175: INFO: 	Container test-container-subpath-inlinevolume-z5hb ready: false, restart count 0
Jan  3 06:47:05.175: INFO: 	Container test-container-volume-inlinevolume-z5hb ready: false, restart count 0
Jan  3 06:47:05.175: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-ljkk6 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:05.175: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:05.175: INFO: affinity-nodeport-2r4nr started at 2023-01-03 06:41:28 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:05.175: INFO: 	Container affinity-nodeport ready: true, restart count 0
Jan  3 06:47:05.175: INFO: csi-hostpathplugin-0 started at 2023-01-03 06:45:29 +0000 UTC (0+7 container statuses recorded)
Jan  3 06:47:05.175: INFO: 	Container csi-attacher ready: true, restart count 0
Jan  3 06:47:05.175: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  3 06:47:05.175: INFO: 	Container csi-resizer ready: true, restart count 0
Jan  3 06:47:05.175: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan  3 06:47:05.175: INFO: 	Container hostpath ready: true, restart count 0
Jan  3 06:47:05.175: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:47:05.175: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:47:06.049: INFO: 
Latency metrics for node i-0c4c153cc3021d728
Jan  3 06:47:06.049: INFO: 
Logging node info for node i-0f6d4ea509bfe3fbe
Jan  3 06:47:06.283: INFO: Node Info: &Node{ObjectMeta:{i-0f6d4ea509bfe3fbe    d3d92523-9fe9-40c0-96cf-7de8a708f9e5 29995 0 2023-01-03 06:26:08 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0f6d4ea509bfe3fbe kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-0f6d4ea509bfe3fbe topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.56.168 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-1691":"i-0f6d4ea509bfe3fbe","ebs.csi.aws.com":"i-0f6d4ea509bfe3fbe"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-03 06:40:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:41:48 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-03 06:47:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0f6d4ea509bfe3fbe,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-03 06:47:03 +0000 UTC,LastTransitionTime:2023-01-03 06:26:08 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-03 06:47:03 +0000 UTC,LastTransitionTime:2023-01-03 06:26:08 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-03 06:47:03 +0000 UTC,LastTransitionTime:2023-01-03 06:26:08 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-03 06:47:03 +0000 UTC,LastTransitionTime:2023-01-03 06:26:23 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.56.168,},NodeAddress{Type:ExternalIP,Address:15.206.145.14,},NodeAddress{Type:InternalDNS,Address:i-0f6d4ea509bfe3fbe.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0f6d4ea509bfe3fbe.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-206-145-14.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2eebc156cceaa5905e74ada30878dd,SystemUUID:ec2eebc1-56cc-eaa5-905e-74ada30878dd,BootID:d561d40a-625b-4fa0-ad51-87e12466f6e1,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-1691^b1a35b91-8b31-11ed-a7c5-62d1175edcc5],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-1691^b1a35b91-8b31-11ed-a7c5-62d1175edcc5,DevicePath:,},},Config:nil,},}
Jan  3 06:47:06.284: INFO: 
Logging kubelet events for node i-0f6d4ea509bfe3fbe
Jan  3 06:47:06.520: INFO: 
Logging pods the kubelet thinks is on node i-0f6d4ea509bfe3fbe
Jan  3 06:47:06.763: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-9hzqt started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:06.763: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:06.763: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-7s22g started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:06.763: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:06.763: INFO: csi-hostpathplugin-0 started at 2023-01-03 06:41:05 +0000 UTC (0+7 container statuses recorded)
Jan  3 06:47:06.763: INFO: 	Container csi-attacher ready: true, restart count 0
Jan  3 06:47:06.763: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  3 06:47:06.763: INFO: 	Container csi-resizer ready: true, restart count 0
Jan  3 06:47:06.763: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan  3 06:47:06.763: INFO: 	Container hostpath ready: true, restart count 0
Jan  3 06:47:06.763: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:47:06.763: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:47:06.763: INFO: ebs-csi-node-78dfk started at 2023-01-03 06:26:09 +0000 UTC (0+3 container statuses recorded)
Jan  3 06:47:06.763: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  3 06:47:06.763: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:47:06.763: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:47:06.763: INFO: cilium-cd88p started at 2023-01-03 06:26:09 +0000 UTC (1+1 container statuses recorded)
Jan  3 06:47:06.763: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  3 06:47:06.763: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  3 06:47:06.763: INFO: affinity-nodeport-g4r5h started at 2023-01-03 06:41:28 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:06.763: INFO: 	Container affinity-nodeport ready: false, restart count 0
Jan  3 06:47:06.763: INFO: pod-handle-http-request started at 2023-01-03 06:41:57 +0000 UTC (0+2 container statuses recorded)
Jan  3 06:47:06.763: INFO: 	Container container-handle-http-request ready: false, restart count 0
Jan  3 06:47:06.763: INFO: 	Container container-handle-https-request ready: false, restart count 0
Jan  3 06:47:06.763: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-txkql started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:06.763: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:06.763: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-7cwlm started at 2023-01-03 06:40:04 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:06.763: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:06.763: INFO: coredns-559769c974-ls78k started at 2023-01-03 06:26:47 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:06.763: INFO: 	Container coredns ready: true, restart count 0
Jan  3 06:47:06.763: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-vgzx4 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:06.763: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:06.763: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-64hvj started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:06.763: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:06.763: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-mqf8m started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:06.763: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:06.763: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-26j4z started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:06.763: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:06.763: INFO: inline-volume-tester-9wfs9 started at 2023-01-03 06:41:47 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:06.763: INFO: 	Container csi-volume-tester ready: false, restart count 0
Jan  3 06:47:06.763: INFO: pod-33511478-1f92-45f0-a4ad-dfec83a925bb started at 2023-01-03 06:44:42 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:06.763: INFO: 	Container write-pod ready: false, restart count 0
Jan  3 06:47:06.763: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-mdkxh started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:06.763: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:06.763: INFO: hostexec-i-0f6d4ea509bfe3fbe-x62kt started at 2023-01-03 06:44:36 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:06.763: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  3 06:47:06.763: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-bv5tk started at 2023-01-03 06:40:04 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:06.763: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:07.614: INFO: 
Latency metrics for node i-0f6d4ea509bfe3fbe
[DeferCleanup (Each)] [sig-node] Container Lifecycle Hook
  tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "container-lifecycle-hook-681" for this suite. �[38;5;243m01/03/23 06:47:07.614�[0m

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-node] Downward API should provide pod UID as env vars [NodeConformance] [Conformance] 5m16s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-node\]\sDownward\sAPI\sshould\sprovide\spod\sUID\sas\senv\svars\s\[NodeConformance\]\s\[Conformance\]$'

test/e2e/framework/pod/output/output.go:237
k8s.io/kubernetes/test/e2e/framework/pod/output.TestContainerOutputMatcher(0x6d4d1a0?, {0x760764e?, 0x75bc097?}, 0xc001c22900, 0x0, {0xc001851f58, 0x1, 0x1}, 0x0?)
	test/e2e/framework/pod/output/output.go:237 +0x176
k8s.io/kubernetes/test/e2e/framework/pod/output.TestContainerOutputRegexp(...)
	test/e2e/framework/pod/output/output.go:221
k8s.io/kubernetes/test/e2e/common/node.testDownwardAPIUsingPod(...)
	test/e2e/common/node/downwardapi.go:422
k8s.io/kubernetes/test/e2e/common/node.testDownwardAPI(0x0?, {0xc004974880, 0x31}, {0xc003874330, 0x1, 0x1}, {0xc0028f7f58, 0x1, 0x1})
	test/e2e/common/node/downwardapi.go:418 +0x84b
k8s.io/kubernetes/test/e2e/common/node.glob..func4.6()
	test/e2e/common/node/downwardapi.go:285 +0x13e
				[BeforeEach] [sig-node] Downward API
  set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/03/23 06:42:22.353�[0m
Jan  3 06:42:22.353: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename downward-api �[38;5;243m01/03/23 06:42:22.354�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/03/23 06:42:23.049�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/03/23 06:42:23.51�[0m
[BeforeEach] [sig-node] Downward API
  test/e2e/framework/metrics/init/init.go:31
[It] should provide pod UID as env vars [NodeConformance] [Conformance]
  test/e2e/common/node/downwardapi.go:267
�[1mSTEP:�[0m Creating a pod to test downward api env vars �[38;5;243m01/03/23 06:42:23.978�[0m
Jan  3 06:42:24.213: INFO: Waiting up to 5m0s for pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704" in namespace "downward-api-2993" to be "Succeeded or Failed"
Jan  3 06:42:24.445: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 231.502401ms
Jan  3 06:42:26.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 2.46350915s
Jan  3 06:42:28.676: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 4.462958258s
Jan  3 06:42:30.676: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 6.462785334s
Jan  3 06:42:32.678: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 8.464471137s
Jan  3 06:42:34.676: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 10.462502051s
Jan  3 06:42:36.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 12.463872447s
Jan  3 06:42:38.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 14.463549576s
Jan  3 06:42:40.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 16.463974592s
Jan  3 06:42:42.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 18.463187324s
Jan  3 06:42:44.680: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 20.46693986s
Jan  3 06:42:46.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 22.46404155s
Jan  3 06:42:48.678: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 24.464312738s
Jan  3 06:42:50.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 26.46332421s
Jan  3 06:42:52.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 28.463835753s
Jan  3 06:42:54.678: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 30.464286189s
Jan  3 06:42:56.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 32.464004148s
Jan  3 06:42:58.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 34.463880699s
Jan  3 06:43:00.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 36.463331907s
Jan  3 06:43:02.678: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 38.464323012s
Jan  3 06:43:04.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 40.463936642s
Jan  3 06:43:06.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 42.464068652s
Jan  3 06:43:08.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 44.463965733s
Jan  3 06:43:10.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 46.46389093s
Jan  3 06:43:12.683: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 48.469963315s
Jan  3 06:43:14.678: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 50.464304615s
Jan  3 06:43:16.676: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 52.46289589s
Jan  3 06:43:18.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 54.463746983s
Jan  3 06:43:20.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 56.463569945s
Jan  3 06:43:22.678: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 58.464519307s
Jan  3 06:43:24.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.463174116s
Jan  3 06:43:26.678: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.464161647s
Jan  3 06:43:28.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.463425476s
Jan  3 06:43:30.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.464140949s
Jan  3 06:43:32.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.463896252s
Jan  3 06:43:34.678: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.464441438s
Jan  3 06:43:36.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.463899024s
Jan  3 06:43:38.678: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.464170886s
Jan  3 06:43:40.678: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.464453123s
Jan  3 06:43:42.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.463940865s
Jan  3 06:43:44.678: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.464955741s
Jan  3 06:43:46.682: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.468545499s
Jan  3 06:43:48.676: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.463133434s
Jan  3 06:43:50.676: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.463052737s
Jan  3 06:43:52.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.463467989s
Jan  3 06:43:54.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.463498812s
Jan  3 06:43:56.678: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.464163152s
Jan  3 06:43:58.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.463267467s
Jan  3 06:44:00.678: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.464143886s
Jan  3 06:44:02.682: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.468464936s
Jan  3 06:44:04.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.463673435s
Jan  3 06:44:06.676: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.463114055s
Jan  3 06:44:08.678: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.464787475s
Jan  3 06:44:10.678: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.46428539s
Jan  3 06:44:12.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.463397509s
Jan  3 06:44:14.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.463512353s
Jan  3 06:44:16.679: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.465948143s
Jan  3 06:44:18.678: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.464578465s
Jan  3 06:44:20.680: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.466265233s
Jan  3 06:44:22.683: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.469812585s
Jan  3 06:44:24.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.463477647s
Jan  3 06:44:26.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.463808568s
Jan  3 06:44:28.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.463341567s
Jan  3 06:44:30.678: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.46466676s
Jan  3 06:44:32.681: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.468120182s
Jan  3 06:44:34.676: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.46300977s
Jan  3 06:44:36.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.463213155s
Jan  3 06:44:38.679: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.465577765s
Jan  3 06:44:40.682: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.46858316s
Jan  3 06:44:42.678: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.464681662s
Jan  3 06:44:44.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.46343641s
Jan  3 06:44:46.678: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.464209591s
Jan  3 06:44:48.676: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.463131696s
Jan  3 06:44:50.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.463353084s
Jan  3 06:44:52.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.463764954s
Jan  3 06:44:54.678: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.464774618s
Jan  3 06:44:56.678: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.464887491s
Jan  3 06:44:58.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.463854072s
Jan  3 06:45:00.676: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.462890471s
Jan  3 06:45:02.678: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.46417741s
Jan  3 06:45:04.678: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.464603257s
Jan  3 06:45:06.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.46337249s
Jan  3 06:45:08.676: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.46291872s
Jan  3 06:45:10.679: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.465311944s
Jan  3 06:45:12.678: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.465098678s
Jan  3 06:45:14.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.463603606s
Jan  3 06:45:16.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.463978601s
Jan  3 06:45:18.679: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.465693162s
Jan  3 06:45:20.678: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.464190201s
Jan  3 06:45:22.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.463498334s
Jan  3 06:45:24.676: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.462698114s
Jan  3 06:45:26.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.463608266s
Jan  3 06:45:28.676: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.462410006s
Jan  3 06:45:30.676: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.462560237s
Jan  3 06:45:32.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.463673142s
Jan  3 06:45:34.676: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.462590076s
Jan  3 06:45:36.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.463840995s
Jan  3 06:45:38.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.463211494s
Jan  3 06:45:40.676: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.463009138s
Jan  3 06:45:42.676: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.46257008s
Jan  3 06:45:44.676: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.462674985s
Jan  3 06:45:46.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.463532835s
Jan  3 06:45:48.676: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.462931211s
Jan  3 06:45:50.680: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.466452373s
Jan  3 06:45:52.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.463544611s
Jan  3 06:45:54.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.463419738s
Jan  3 06:45:56.679: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.465306692s
Jan  3 06:45:58.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.463576355s
Jan  3 06:46:00.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.463842544s
Jan  3 06:46:02.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.463315245s
Jan  3 06:46:04.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.46329223s
Jan  3 06:46:06.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.463291024s
Jan  3 06:46:08.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.463406912s
Jan  3 06:46:10.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.463487178s
Jan  3 06:46:12.676: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.462792667s
Jan  3 06:46:14.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.463834016s
Jan  3 06:46:16.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.46351642s
Jan  3 06:46:18.676: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.462439711s
Jan  3 06:46:20.676: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.463045927s
Jan  3 06:46:22.676: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.462864531s
Jan  3 06:46:24.676: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.463000387s
Jan  3 06:46:26.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.463574518s
Jan  3 06:46:28.676: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.463128172s
Jan  3 06:46:30.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.463268367s
Jan  3 06:46:32.676: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.462750781s
Jan  3 06:46:34.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.463612232s
Jan  3 06:46:36.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.463561602s
Jan  3 06:46:38.676: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.462462245s
Jan  3 06:46:40.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.463767057s
Jan  3 06:46:42.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.463193289s
Jan  3 06:46:44.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.463673682s
Jan  3 06:46:46.676: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.46266459s
Jan  3 06:46:48.680: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.466231979s
Jan  3 06:46:50.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.463264851s
Jan  3 06:46:52.676: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.462352136s
Jan  3 06:46:54.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.463262619s
Jan  3 06:46:56.676: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.462773663s
Jan  3 06:46:58.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.463664652s
Jan  3 06:47:00.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.46359766s
Jan  3 06:47:02.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.463609104s
Jan  3 06:47:04.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.463685238s
Jan  3 06:47:06.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.463318196s
Jan  3 06:47:08.676: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.462748568s
Jan  3 06:47:10.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.463310413s
Jan  3 06:47:12.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.463582555s
Jan  3 06:47:14.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.463334451s
Jan  3 06:47:16.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.463203409s
Jan  3 06:47:18.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.463566618s
Jan  3 06:47:20.676: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.462177009s
Jan  3 06:47:22.676: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.462663713s
Jan  3 06:47:24.677: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.464132384s
Jan  3 06:47:24.911: INFO: Pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.697889355s
Jan  3 06:47:25.374: INFO: Failed to get logs from node "i-0c4c153cc3021d728" pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704" container "dapi-container": the server rejected our request for an unknown reason (get pods downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704)
�[1mSTEP:�[0m delete the pod �[38;5;243m01/03/23 06:47:25.374�[0m
Jan  3 06:47:25.608: INFO: Waiting for pod downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704 to disappear
Jan  3 06:47:25.839: INFO: Pod downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704 still exists
Jan  3 06:47:27.840: INFO: Waiting for pod downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704 to disappear
Jan  3 06:47:28.070: INFO: Pod downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704 still exists
Jan  3 06:47:29.840: INFO: Waiting for pod downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704 to disappear
Jan  3 06:47:30.071: INFO: Pod downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704 no longer exists
Jan  3 06:47:30.071: INFO: Unexpected error: 
    <*errors.errorString | 0xc0014c45e0>: {
        s: "expected pod \"downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704\" success: timed out while waiting for pod downward-api-2993/downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704 to be Succeeded or Failed",
    }
Jan  3 06:47:30.071: FAIL: expected pod "downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704" success: timed out while waiting for pod downward-api-2993/downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704 to be Succeeded or Failed

Full Stack Trace
k8s.io/kubernetes/test/e2e/framework/pod/output.TestContainerOutputMatcher(0x6d4d1a0?, {0x760764e?, 0x75bc097?}, 0xc001c22900, 0x0, {0xc001851f58, 0x1, 0x1}, 0x0?)
	test/e2e/framework/pod/output/output.go:237 +0x176
k8s.io/kubernetes/test/e2e/framework/pod/output.TestContainerOutputRegexp(...)
	test/e2e/framework/pod/output/output.go:221
k8s.io/kubernetes/test/e2e/common/node.testDownwardAPIUsingPod(...)
	test/e2e/common/node/downwardapi.go:422
k8s.io/kubernetes/test/e2e/common/node.testDownwardAPI(0x0?, {0xc004974880, 0x31}, {0xc003874330, 0x1, 0x1}, {0xc0028f7f58, 0x1, 0x1})
	test/e2e/common/node/downwardapi.go:418 +0x84b
k8s.io/kubernetes/test/e2e/common/node.glob..func4.6()
	test/e2e/common/node/downwardapi.go:285 +0x13e
[AfterEach] [sig-node] Downward API
  test/e2e/framework/node/init/init.go:32
Jan  3 06:47:30.071: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-node] Downward API
  test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-node] Downward API
  dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/03/23 06:47:30.303�[0m
�[1mSTEP:�[0m Collecting events from namespace "downward-api-2993". �[38;5;243m01/03/23 06:47:30.303�[0m
�[1mSTEP:�[0m Found 11 events. �[38;5;243m01/03/23 06:47:30.534�[0m
Jan  3 06:47:30.534: INFO: At 2023-01-03 06:42:24 +0000 UTC - event for downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704: {default-scheduler } Scheduled: Successfully assigned downward-api-2993/downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704 to i-0c4c153cc3021d728
Jan  3 06:47:30.534: INFO: At 2023-01-03 06:42:24 +0000 UTC - event for downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704: {kubelet i-0c4c153cc3021d728} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "6ea68ac512812e0f73444808b0f3fb23501c7ae4f6e9835f9b32290af5990651": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:47:30.534: INFO: At 2023-01-03 06:42:39 +0000 UTC - event for downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704: {kubelet i-0c4c153cc3021d728} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "806f2a04a446f446232da565fdf6e309377ff6eee9a45cd31117cd00ea35ee39": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:47:30.534: INFO: At 2023-01-03 06:42:52 +0000 UTC - event for downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704: {kubelet i-0c4c153cc3021d728} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "83ed4de1c125629f0b76203327855af0ba86b4dcc6d6419f24e73a8a2cf2434f": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:47:30.534: INFO: At 2023-01-03 06:43:07 +0000 UTC - event for downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704: {kubelet i-0c4c153cc3021d728} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "f5925d90a31e4d4c5c68e2f2e91553682c82e17a672fa9f94ce9df49f97087f4": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:47:30.534: INFO: At 2023-01-03 06:43:22 +0000 UTC - event for downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704: {kubelet i-0c4c153cc3021d728} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b42828af547eef6d75b0602b10b9ae354b6d1d2d7bf9c178fae406172b9f431f": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:47:30.534: INFO: At 2023-01-03 06:43:33 +0000 UTC - event for downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704: {kubelet i-0c4c153cc3021d728} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "052858a0c6505ceb896ee76f5a62010ed9966b94aadb6d6e5404f78507db3ec2": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:47:30.534: INFO: At 2023-01-03 06:43:45 +0000 UTC - event for downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704: {kubelet i-0c4c153cc3021d728} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "80bcd4e69b5429fe42b647564a4566673a1fce15961ab5a052bd354577e34da3": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:47:30.534: INFO: At 2023-01-03 06:43:59 +0000 UTC - event for downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704: {kubelet i-0c4c153cc3021d728} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "2b2edf2b47f8e7f34456dfc6a22a26123beea45b50e2ad75478a96496557b5f4": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:47:30.534: INFO: At 2023-01-03 06:44:10 +0000 UTC - event for downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704: {kubelet i-0c4c153cc3021d728} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "45af6a5f32d13e101122f84717b877b67dfcc9514e0917277cd292377fd23226": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:47:30.534: INFO: At 2023-01-03 06:44:23 +0000 UTC - event for downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704: {kubelet i-0c4c153cc3021d728} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "14d2e75429efdcbc8cc3e078b04af50c25badf51394336eea5190825e1941848": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:47:30.768: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Jan  3 06:47:30.768: INFO: 
Jan  3 06:47:31.000: INFO: 
Logging node info for node i-0116ec5cfa0915363
Jan  3 06:47:31.231: INFO: Node Info: &Node{ObjectMeta:{i-0116ec5cfa0915363    845a5e73-b93d-4679-a025-6403fe91469b 30693 0 2023-01-03 06:24:27 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0116ec5cfa0915363 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:ap-south-1a topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.51.97 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0116ec5cfa0915363"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-03 06:24:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-03 06:24:54 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:25:11 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-03 06:25:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-03 06:25:13 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-03 06:47:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0116ec5cfa0915363,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892301824 0} {<nil>} 3801076Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787444224 0} {<nil>} 3698676Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-03 06:47:26 +0000 UTC,LastTransitionTime:2023-01-03 06:24:21 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-03 06:47:26 +0000 UTC,LastTransitionTime:2023-01-03 06:24:21 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-03 06:47:26 +0000 UTC,LastTransitionTime:2023-01-03 06:24:21 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-03 06:47:26 +0000 UTC,LastTransitionTime:2023-01-03 06:25:11 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.51.97,},NodeAddress{Type:ExternalIP,Address:35.154.4.55,},NodeAddress{Type:InternalDNS,Address:i-0116ec5cfa0915363.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0116ec5cfa0915363.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-154-4-55.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec291a4b21ade93e02dbfdea9af30b8c,SystemUUID:ec291a4b-21ad-e93e-02db-fdea9af30b8c,BootID:3cd177e4-da3b-4287-b5dc-70d163e7dd13,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.0],SizeBytes:135162323,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.0],SizeBytes:124991801,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.0],SizeBytes:57657656,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43446388,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42805548,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4967304,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan  3 06:47:31.231: INFO: 
Logging kubelet events for node i-0116ec5cfa0915363
Jan  3 06:47:31.465: INFO: 
Logging pods the kubelet thinks is on node i-0116ec5cfa0915363
Jan  3 06:47:31.705: INFO: etcd-manager-main-i-0116ec5cfa0915363 started at 2023-01-03 06:23:51 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:31.705: INFO: 	Container etcd-manager ready: true, restart count 0
Jan  3 06:47:31.705: INFO: cilium-operator-5dd44dc49f-nzbgs started at 2023-01-03 06:25:00 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:31.705: INFO: 	Container cilium-operator ready: true, restart count 0
Jan  3 06:47:31.705: INFO: ebs-csi-controller-89b649c94-4zgt2 started at 2023-01-03 06:25:00 +0000 UTC (0+5 container statuses recorded)
Jan  3 06:47:31.705: INFO: 	Container csi-attacher ready: true, restart count 0
Jan  3 06:47:31.705: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  3 06:47:31.705: INFO: 	Container csi-resizer ready: true, restart count 0
Jan  3 06:47:31.705: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  3 06:47:31.705: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:47:31.705: INFO: cilium-npb6w started at 2023-01-03 06:24:59 +0000 UTC (1+1 container statuses recorded)
Jan  3 06:47:31.705: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  3 06:47:31.705: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  3 06:47:31.705: INFO: aws-cloud-controller-manager-mvsjr started at 2023-01-03 06:24:59 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:31.705: INFO: 	Container aws-cloud-controller-manager ready: true, restart count 0
Jan  3 06:47:31.705: INFO: ebs-csi-node-pg7l9 started at 2023-01-03 06:24:59 +0000 UTC (0+3 container statuses recorded)
Jan  3 06:47:31.705: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  3 06:47:31.705: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:47:31.705: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:47:31.705: INFO: etcd-manager-events-i-0116ec5cfa0915363 started at 2023-01-03 06:23:51 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:31.705: INFO: 	Container etcd-manager ready: true, restart count 0
Jan  3 06:47:31.705: INFO: kube-apiserver-i-0116ec5cfa0915363 started at 2023-01-03 06:23:51 +0000 UTC (0+2 container statuses recorded)
Jan  3 06:47:31.705: INFO: 	Container healthcheck ready: true, restart count 0
Jan  3 06:47:31.705: INFO: 	Container kube-apiserver ready: true, restart count 1
Jan  3 06:47:31.705: INFO: kube-controller-manager-i-0116ec5cfa0915363 started at 2023-01-03 06:23:51 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:31.705: INFO: 	Container kube-controller-manager ready: true, restart count 2
Jan  3 06:47:31.705: INFO: kube-scheduler-i-0116ec5cfa0915363 started at 2023-01-03 06:23:51 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:31.705: INFO: 	Container kube-scheduler ready: true, restart count 0
Jan  3 06:47:31.705: INFO: kops-controller-9t2zt started at 2023-01-03 06:24:59 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:31.705: INFO: 	Container kops-controller ready: true, restart count 0
Jan  3 06:47:31.705: INFO: dns-controller-69987775c6-rgd5s started at 2023-01-03 06:25:00 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:31.705: INFO: 	Container dns-controller ready: true, restart count 0
Jan  3 06:47:32.469: INFO: 
Latency metrics for node i-0116ec5cfa0915363
Jan  3 06:47:32.469: INFO: 
Logging node info for node i-06675ed9fdf15131e
Jan  3 06:47:32.700: INFO: Node Info: &Node{ObjectMeta:{i-06675ed9fdf15131e    6a365a73-a0a0-47e1-83ac-1dd53dc6cb56 29432 0 2023-01-03 06:26:03 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-06675ed9fdf15131e kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-06675ed9fdf15131e topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.34.128 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-7802":"i-06675ed9fdf15131e","csi-mock-csi-mock-volumes-5893":"i-06675ed9fdf15131e","ebs.csi.aws.com":"i-06675ed9fdf15131e"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-03 06:26:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-03 06:26:03 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-03 06:26:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-03 06:26:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:26:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {e2e.test Update v1 2023-01-03 06:40:01 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:40:12 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-03 06:45:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-06675ed9fdf15131e,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-03 06:45:25 +0000 UTC,LastTransitionTime:2023-01-03 06:26:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-03 06:45:25 +0000 UTC,LastTransitionTime:2023-01-03 06:26:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-03 06:45:25 +0000 UTC,LastTransitionTime:2023-01-03 06:26:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-03 06:45:25 +0000 UTC,LastTransitionTime:2023-01-03 06:26:18 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.34.128,},NodeAddress{Type:ExternalIP,Address:13.233.53.249,},NodeAddress{Type:InternalDNS,Address:i-06675ed9fdf15131e.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-06675ed9fdf15131e.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-233-53-249.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec278d28e0e8aa5f9f5a88afed4c7357,SystemUUID:ec278d28-e0e8-aa5f-9f5a-88afed4c7357,BootID:60717d56-76f8-4838-8bb7-4a4ce6867c70,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-7802^78eb4252-8b31-11ed-a7cd-e699b846bc6a],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-7802^78eb4252-8b31-11ed-a7cd-e699b846bc6a,DevicePath:,},},Config:nil,},}
Jan  3 06:47:32.700: INFO: 
Logging kubelet events for node i-06675ed9fdf15131e
Jan  3 06:47:32.933: INFO: 
Logging pods the kubelet thinks is on node i-06675ed9fdf15131e
Jan  3 06:47:33.178: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-vkxkf started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:33.178: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:33.178: INFO: csi-mockplugin-0 started at 2023-01-03 06:42:50 +0000 UTC (0+3 container statuses recorded)
Jan  3 06:47:33.178: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  3 06:47:33.178: INFO: 	Container driver-registrar ready: true, restart count 0
Jan  3 06:47:33.178: INFO: 	Container mock ready: true, restart count 0
Jan  3 06:47:33.178: INFO: csi-mockplugin-resizer-0 started at 2023-01-03 06:42:51 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:33.178: INFO: 	Container csi-resizer ready: false, restart count 0
Jan  3 06:47:33.178: INFO: ebs-csi-node-q24xb started at 2023-01-03 06:26:04 +0000 UTC (0+3 container statuses recorded)
Jan  3 06:47:33.178: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  3 06:47:33.178: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:47:33.178: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:47:33.178: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-gcftr started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:33.178: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:33.178: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-knmjr started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:33.178: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: false, restart count 0
Jan  3 06:47:33.178: INFO: pvc-volume-tester-tnqg4 started at 2023-01-03 06:43:36 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:33.178: INFO: 	Container volume-tester ready: false, restart count 0
Jan  3 06:47:33.178: INFO: inline-volume-tester-578zd started at 2023-01-03 06:43:56 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:33.178: INFO: 	Container csi-volume-tester ready: false, restart count 0
Jan  3 06:47:33.178: INFO: coredns-559769c974-xh6r4 started at 2023-01-03 06:26:18 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:33.178: INFO: 	Container coredns ready: true, restart count 0
Jan  3 06:47:33.178: INFO: csi-hostpathplugin-0 started at 2023-01-03 06:39:40 +0000 UTC (0+7 container statuses recorded)
Jan  3 06:47:33.178: INFO: 	Container csi-attacher ready: true, restart count 0
Jan  3 06:47:33.178: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  3 06:47:33.178: INFO: 	Container csi-resizer ready: true, restart count 0
Jan  3 06:47:33.178: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan  3 06:47:33.178: INFO: 	Container hostpath ready: true, restart count 0
Jan  3 06:47:33.178: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:47:33.178: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:47:33.178: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-gzk6r started at 2023-01-03 06:40:04 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:33.178: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: false, restart count 0
Jan  3 06:47:33.178: INFO: inline-volume-tester-7frp2 started at 2023-01-03 06:42:47 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:33.178: INFO: 	Container csi-volume-tester ready: false, restart count 0
Jan  3 06:47:33.178: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-vmn8b started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:33.178: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:33.178: INFO: hostpath-client started at 2023-01-03 06:40:11 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:33.178: INFO: 	Container hostpath-client ready: false, restart count 0
Jan  3 06:47:33.178: INFO: cilium-88fm4 started at 2023-01-03 06:26:04 +0000 UTC (1+1 container statuses recorded)
Jan  3 06:47:33.178: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  3 06:47:33.178: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  3 06:47:33.178: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-pn6rb started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:33.178: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:33.178: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-bhflv started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:33.178: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:33.178: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-qbds6 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:33.178: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:33.178: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-5qt2b started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:33.178: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:33.178: INFO: csi-hostpathplugin-0 started at 2023-01-03 06:42:46 +0000 UTC (0+7 container statuses recorded)
Jan  3 06:47:33.178: INFO: 	Container csi-attacher ready: false, restart count 0
Jan  3 06:47:33.178: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan  3 06:47:33.178: INFO: 	Container csi-resizer ready: false, restart count 0
Jan  3 06:47:33.178: INFO: 	Container csi-snapshotter ready: false, restart count 0
Jan  3 06:47:33.178: INFO: 	Container hostpath ready: false, restart count 0
Jan  3 06:47:33.178: INFO: 	Container liveness-probe ready: false, restart count 0
Jan  3 06:47:33.178: INFO: 	Container node-driver-registrar ready: false, restart count 0
Jan  3 06:47:33.178: INFO: coredns-autoscaler-7cb5c5b969-tg22d started at 2023-01-03 06:26:18 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:33.178: INFO: 	Container autoscaler ready: true, restart count 0
Jan  3 06:47:33.178: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-kn247 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:33.178: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:33.178: INFO: csi-hostpathplugin-0 started at 2023-01-03 06:43:56 +0000 UTC (0+7 container statuses recorded)
Jan  3 06:47:33.178: INFO: 	Container csi-attacher ready: false, restart count 0
Jan  3 06:47:33.178: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan  3 06:47:33.178: INFO: 	Container csi-resizer ready: false, restart count 0
Jan  3 06:47:33.178: INFO: 	Container csi-snapshotter ready: false, restart count 0
Jan  3 06:47:33.178: INFO: 	Container hostpath ready: false, restart count 0
Jan  3 06:47:33.178: INFO: 	Container liveness-probe ready: false, restart count 0
Jan  3 06:47:33.178: INFO: 	Container node-driver-registrar ready: false, restart count 0
Jan  3 06:47:34.002: INFO: 
Latency metrics for node i-06675ed9fdf15131e
Jan  3 06:47:34.002: INFO: 
Logging node info for node i-0887927f295dab249
Jan  3 06:47:34.238: INFO: Node Info: &Node{ObjectMeta:{i-0887927f295dab249    8c537f9f-6ce2-4eae-a273-3e5dec0f5a97 29289 0 2023-01-03 06:26:08 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0887927f295dab249 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-0887927f295dab249 topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.43.47 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-7494":"i-0887927f295dab249","ebs.csi.aws.com":"i-0887927f295dab249"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-03 06:40:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:45:11 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-03 06:45:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0887927f295dab249,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-03 06:45:13 +0000 UTC,LastTransitionTime:2023-01-03 06:26:08 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-03 06:45:13 +0000 UTC,LastTransitionTime:2023-01-03 06:26:08 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-03 06:45:13 +0000 UTC,LastTransitionTime:2023-01-03 06:26:08 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-03 06:45:13 +0000 UTC,LastTransitionTime:2023-01-03 06:26:24 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.43.47,},NodeAddress{Type:ExternalIP,Address:65.0.96.201,},NodeAddress{Type:InternalDNS,Address:i-0887927f295dab249.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0887927f295dab249.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-65-0-96-201.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2d5f1c251f05fc398417508c564588,SystemUUID:ec2d5f1c-251f-05fc-3984-17508c564588,BootID:80a76b6c-5e81-478d-a15c-92ab635eebdb,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-7494^2a9b5c2b-8b32-11ed-9a17-02cea9609c51 kubernetes.io/csi/csi-hostpath-ephemeral-7494^2a9f4d2c-8b32-11ed-9a17-02cea9609c51 kubernetes.io/csi/ebs.csi.aws.com^vol-0747fe00dd5d5923d],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-7494^2a9b5c2b-8b32-11ed-9a17-02cea9609c51,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-7494^2a9f4d2c-8b32-11ed-9a17-02cea9609c51,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0747fe00dd5d5923d,DevicePath:,},},Config:nil,},}
Jan  3 06:47:34.239: INFO: 
Logging kubelet events for node i-0887927f295dab249
Jan  3 06:47:34.472: INFO: 
Logging pods the kubelet thinks is on node i-0887927f295dab249
Jan  3 06:47:34.715: INFO: ss2-0 started at 2023-01-03 06:45:36 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:34.715: INFO: 	Container webserver ready: false, restart count 0
Jan  3 06:47:34.715: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-qs9vk started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:34.715: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:34.715: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-5sjfb started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:34.715: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:34.715: INFO: ebs-csi-node-22htr started at 2023-01-03 06:26:09 +0000 UTC (0+3 container statuses recorded)
Jan  3 06:47:34.715: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  3 06:47:34.715: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:47:34.715: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:47:34.715: INFO: inline-volume-tester-qwfhg started at 2023-01-03 06:45:10 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:34.715: INFO: 	Container csi-volume-tester ready: false, restart count 0
Jan  3 06:47:34.715: INFO: pod-configmaps-6ac65fd0-2362-460b-b401-dc12549b2575 started at 2023-01-03 06:45:42 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:34.715: INFO: 	Container agnhost-container ready: false, restart count 0
Jan  3 06:47:34.715: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-nzbt8 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:34.715: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:34.715: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-kmgz2 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:34.715: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:34.715: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-z8hhz started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:34.715: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:34.715: INFO: dns-test-71df1669-ca24-4488-bdc2-c2149686db55 started at 2023-01-03 06:46:44 +0000 UTC (0+3 container statuses recorded)
Jan  3 06:47:34.715: INFO: 	Container jessie-querier ready: false, restart count 0
Jan  3 06:47:34.715: INFO: 	Container querier ready: false, restart count 0
Jan  3 06:47:34.715: INFO: 	Container webserver ready: false, restart count 0
Jan  3 06:47:34.715: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-m9n4g started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:34.715: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:34.715: INFO: cilium-s9l8s started at 2023-01-03 06:26:09 +0000 UTC (1+1 container statuses recorded)
Jan  3 06:47:34.715: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  3 06:47:34.715: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  3 06:47:34.715: INFO: startup-33131899-1a42-412a-9a76-c7ee101e12d3 started at 2023-01-03 06:44:39 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:34.715: INFO: 	Container busybox ready: false, restart count 0
Jan  3 06:47:34.715: INFO: affinity-nodeport-fh67z started at 2023-01-03 06:41:28 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:34.715: INFO: 	Container affinity-nodeport ready: true, restart count 0
Jan  3 06:47:34.715: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-dbt7p started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:34.715: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:34.715: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-87btk started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:34.715: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:34.715: INFO: pod-9d10df65-59e8-4966-a058-376431a1bbfe started at 2023-01-03 06:43:23 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:34.715: INFO: 	Container write-pod ready: false, restart count 0
Jan  3 06:47:34.715: INFO: csi-hostpathplugin-0 started at 2023-01-03 06:43:44 +0000 UTC (0+7 container statuses recorded)
Jan  3 06:47:34.715: INFO: 	Container csi-attacher ready: true, restart count 0
Jan  3 06:47:34.715: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  3 06:47:34.715: INFO: 	Container csi-resizer ready: true, restart count 0
Jan  3 06:47:34.715: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan  3 06:47:34.715: INFO: 	Container hostpath ready: true, restart count 0
Jan  3 06:47:34.715: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:47:34.715: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:47:34.715: INFO: test-deployment-swhng-54bc444df-8rmgv started at 2023-01-03 06:44:38 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:34.715: INFO: 	Container httpd ready: false, restart count 0
Jan  3 06:47:34.715: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-47hz9 started at 2023-01-03 06:40:04 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:34.715: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:34.715: INFO: pod-projected-configmaps-158e5277-3e7e-4278-a0c2-3078bcbd01de started at 2023-01-03 06:47:24 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:34.715: INFO: 	Container agnhost-container ready: false, restart count 0
Jan  3 06:47:34.715: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-5tzj6 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:34.715: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:34.715: INFO: pod-adoption-release started at 2023-01-03 06:46:06 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:34.715: INFO: 	Container pod-adoption-release ready: false, restart count 0
Jan  3 06:47:34.715: INFO: test-pod-8f8b0f25-9283-406c-a37f-7b953461815d started at 2023-01-03 06:42:39 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:34.715: INFO: 	Container agnhost-container ready: false, restart count 0
Jan  3 06:47:35.606: INFO: 
Latency metrics for node i-0887927f295dab249
Jan  3 06:47:35.606: INFO: 
Logging node info for node i-0c4c153cc3021d728
Jan  3 06:47:35.843: INFO: Node Info: &Node{ObjectMeta:{i-0c4c153cc3021d728    0fc330cf-9a4f-4650-8df2-bbc4962562bf 29761 0 2023-01-03 06:26:07 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a io.kubernetes.storage.mock/node:some-mock-node kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0c4c153cc3021d728 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-0c4c153cc3021d728 topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.34.232 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-volume-expand-9886":"i-0c4c153cc3021d728","ebs.csi.aws.com":"i-0c4c153cc3021d728"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-03 06:26:07 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-03 06:26:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-03 06:26:07 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:26:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-03 06:26:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-03 06:40:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-03 06:46:11 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-01-03 06:46:12 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0c4c153cc3021d728,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-03 06:46:11 +0000 UTC,LastTransitionTime:2023-01-03 06:26:07 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-03 06:46:11 +0000 UTC,LastTransitionTime:2023-01-03 06:26:07 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-03 06:46:11 +0000 UTC,LastTransitionTime:2023-01-03 06:26:07 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-03 06:46:11 +0000 UTC,LastTransitionTime:2023-01-03 06:26:23 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.34.232,},NodeAddress{Type:ExternalIP,Address:13.232.119.101,},NodeAddress{Type:InternalDNS,Address:i-0c4c153cc3021d728.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0c4c153cc3021d728.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-232-119-101.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec20ee6ab34ca9da624dd2e5f8c44780,SystemUUID:ec20ee6a-b34c-a9da-624d-d2e5f8c44780,BootID:960d66c3-58ec-4ea0-a76c-db5eb00e743c,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-volume-expand-9886^4e0f5548-8b32-11ed-8e7f-066d9af4aed6],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-volume-expand-9886^4e0f5548-8b32-11ed-8e7f-066d9af4aed6,DevicePath:,},},Config:nil,},}
Jan  3 06:47:35.843: INFO: 
Logging kubelet events for node i-0c4c153cc3021d728
Jan  3 06:47:36.082: INFO: 
Logging pods the kubelet thinks is on node i-0c4c153cc3021d728
Jan  3 06:47:36.325: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-4sx4g started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:36.325: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:36.325: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-98hxx started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:36.325: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:36.325: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-ljkk6 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:36.325: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:36.325: INFO: affinity-nodeport-2r4nr started at 2023-01-03 06:41:28 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:36.325: INFO: 	Container affinity-nodeport ready: true, restart count 0
Jan  3 06:47:36.325: INFO: csi-hostpathplugin-0 started at 2023-01-03 06:45:29 +0000 UTC (0+7 container statuses recorded)
Jan  3 06:47:36.325: INFO: 	Container csi-attacher ready: true, restart count 0
Jan  3 06:47:36.325: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  3 06:47:36.325: INFO: 	Container csi-resizer ready: true, restart count 0
Jan  3 06:47:36.325: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan  3 06:47:36.325: INFO: 	Container hostpath ready: true, restart count 0
Jan  3 06:47:36.325: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:47:36.325: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:47:36.325: INFO: pod-20c75720-f672-49af-b552-0eceef5b318c started at 2023-01-03 06:46:11 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:36.325: INFO: 	Container write-pod ready: false, restart count 0
Jan  3 06:47:36.325: INFO: pod-subpath-test-inlinevolume-z5hb started at 2023-01-03 06:46:53 +0000 UTC (2+2 container statuses recorded)
Jan  3 06:47:36.325: INFO: 	Init container init-volume-inlinevolume-z5hb ready: false, restart count 0
Jan  3 06:47:36.325: INFO: 	Init container test-init-subpath-inlinevolume-z5hb ready: false, restart count 0
Jan  3 06:47:36.325: INFO: 	Container test-container-subpath-inlinevolume-z5hb ready: false, restart count 0
Jan  3 06:47:36.325: INFO: 	Container test-container-volume-inlinevolume-z5hb ready: false, restart count 0
Jan  3 06:47:36.325: INFO: cilium-87m98 started at 2023-01-03 06:26:08 +0000 UTC (1+1 container statuses recorded)
Jan  3 06:47:36.325: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  3 06:47:36.325: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  3 06:47:36.325: INFO: fail-once-non-local-ms76g started at 2023-01-03 06:45:23 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:36.325: INFO: 	Container c ready: false, restart count 0
Jan  3 06:47:36.325: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-tfhlj started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:36.325: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:36.325: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-44v74 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:36.325: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:36.325: INFO: fail-once-non-local-wdcck started at 2023-01-03 06:44:35 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:36.325: INFO: 	Container c ready: false, restart count 0
Jan  3 06:47:36.325: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-55wkd started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:36.325: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:36.325: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-fh8hc started at 2023-01-03 06:40:04 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:36.325: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:36.325: INFO: fail-once-non-local-27nz9 started at 2023-01-03 06:45:02 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:36.325: INFO: 	Container c ready: false, restart count 0
Jan  3 06:47:36.325: INFO: hostexec-i-0c4c153cc3021d728-cfppg started at 2023-01-03 06:47:35 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:36.325: INFO: 	Container agnhost-container ready: false, restart count 0
Jan  3 06:47:36.325: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-l9w98 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:36.325: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:36.325: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-w8kkx started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:36.325: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:36.325: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-s8mtc started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:36.325: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:36.325: INFO: ebs-csi-node-5sgcl started at 2023-01-03 06:26:08 +0000 UTC (0+3 container statuses recorded)
Jan  3 06:47:36.325: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  3 06:47:36.325: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:47:36.325: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:47:36.325: INFO: fail-once-non-local-82rmn started at 2023-01-03 06:44:35 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:36.325: INFO: 	Container c ready: false, restart count 0
Jan  3 06:47:36.325: INFO: fail-once-non-local-jk86f started at 2023-01-03 06:45:06 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:36.325: INFO: 	Container c ready: false, restart count 0
Jan  3 06:47:36.325: INFO: hostexec-i-0c4c153cc3021d728-s292j started at 2023-01-03 06:45:18 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:36.325: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  3 06:47:36.325: INFO: pod-subpath-test-preprovisionedpv-vsdz started at 2023-01-03 06:45:30 +0000 UTC (2+1 container statuses recorded)
Jan  3 06:47:36.325: INFO: 	Init container init-volume-preprovisionedpv-vsdz ready: false, restart count 0
Jan  3 06:47:36.325: INFO: 	Init container test-init-volume-preprovisionedpv-vsdz ready: false, restart count 0
Jan  3 06:47:36.325: INFO: 	Container test-container-subpath-preprovisionedpv-vsdz ready: false, restart count 0
Jan  3 06:47:37.178: INFO: 
Latency metrics for node i-0c4c153cc3021d728
Jan  3 06:47:37.178: INFO: 
Logging node info for node i-0f6d4ea509bfe3fbe
Jan  3 06:47:37.409: INFO: Node Info: &Node{ObjectMeta:{i-0f6d4ea509bfe3fbe    d3d92523-9fe9-40c0-96cf-7de8a708f9e5 29995 0 2023-01-03 06:26:08 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0f6d4ea509bfe3fbe kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-0f6d4ea509bfe3fbe topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.56.168 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-1691":"i-0f6d4ea509bfe3fbe","ebs.csi.aws.com":"i-0f6d4ea509bfe3fbe"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-03 06:40:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:41:48 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-03 06:47:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0f6d4ea509bfe3fbe,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-03 06:47:03 +0000 UTC,LastTransitionTime:2023-01-03 06:26:08 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-03 06:47:03 +0000 UTC,LastTransitionTime:2023-01-03 06:26:08 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-03 06:47:03 +0000 UTC,LastTransitionTime:2023-01-03 06:26:08 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-03 06:47:03 +0000 UTC,LastTransitionTime:2023-01-03 06:26:23 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.56.168,},NodeAddress{Type:ExternalIP,Address:15.206.145.14,},NodeAddress{Type:InternalDNS,Address:i-0f6d4ea509bfe3fbe.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0f6d4ea509bfe3fbe.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-206-145-14.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2eebc156cceaa5905e74ada30878dd,SystemUUID:ec2eebc1-56cc-eaa5-905e-74ada30878dd,BootID:d561d40a-625b-4fa0-ad51-87e12466f6e1,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-1691^b1a35b91-8b31-11ed-a7c5-62d1175edcc5],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-1691^b1a35b91-8b31-11ed-a7c5-62d1175edcc5,DevicePath:,},},Config:nil,},}
Jan  3 06:47:37.410: INFO: 
Logging kubelet events for node i-0f6d4ea509bfe3fbe
Jan  3 06:47:37.642: INFO: 
Logging pods the kubelet thinks is on node i-0f6d4ea509bfe3fbe
Jan  3 06:47:37.882: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-mdkxh started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:37.882: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:37.882: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-26j4z started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:37.882: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:37.882: INFO: inline-volume-tester-9wfs9 started at 2023-01-03 06:41:47 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:37.882: INFO: 	Container csi-volume-tester ready: false, restart count 0
Jan  3 06:47:37.882: INFO: pod-33511478-1f92-45f0-a4ad-dfec83a925bb started at 2023-01-03 06:44:42 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:37.882: INFO: 	Container write-pod ready: false, restart count 0
Jan  3 06:47:37.882: INFO: hostexec-i-0f6d4ea509bfe3fbe-x62kt started at 2023-01-03 06:44:36 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:37.882: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  3 06:47:37.882: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-bv5tk started at 2023-01-03 06:40:04 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:37.882: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:37.882: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-9hzqt started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:37.882: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:37.882: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-7s22g started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:37.882: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:37.882: INFO: csi-hostpathplugin-0 started at 2023-01-03 06:41:05 +0000 UTC (0+7 container statuses recorded)
Jan  3 06:47:37.882: INFO: 	Container csi-attacher ready: true, restart count 0
Jan  3 06:47:37.882: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  3 06:47:37.882: INFO: 	Container csi-resizer ready: true, restart count 0
Jan  3 06:47:37.882: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan  3 06:47:37.882: INFO: 	Container hostpath ready: true, restart count 0
Jan  3 06:47:37.882: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:47:37.882: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:47:37.882: INFO: ebs-csi-node-78dfk started at 2023-01-03 06:26:09 +0000 UTC (0+3 container statuses recorded)
Jan  3 06:47:37.882: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  3 06:47:37.882: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:47:37.882: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:47:37.882: INFO: cilium-cd88p started at 2023-01-03 06:26:09 +0000 UTC (1+1 container statuses recorded)
Jan  3 06:47:37.882: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  3 06:47:37.882: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  3 06:47:37.882: INFO: affinity-nodeport-g4r5h started at 2023-01-03 06:41:28 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:37.882: INFO: 	Container affinity-nodeport ready: false, restart count 0
Jan  3 06:47:37.882: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-txkql started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:37.882: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:37.882: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-7cwlm started at 2023-01-03 06:40:04 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:37.882: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:37.882: INFO: coredns-559769c974-ls78k started at 2023-01-03 06:26:47 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:37.882: INFO: 	Container coredns ready: true, restart count 0
Jan  3 06:47:37.882: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-vgzx4 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:37.883: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:37.883: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-64hvj started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:37.883: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:37.883: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-mqf8m started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:37.883: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:38.737: INFO: 
Latency metrics for node i-0f6d4ea509bfe3fbe
[DeferCleanup (Each)] [sig-node] Downward API
  tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "downward-api-2993" for this suite. �[38;5;243m01/03/23 06:47:38.738�[0m

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-node] Probing container should be restarted by liveness probe after startup probe enables it 5m12s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-node\]\sProbing\scontainer\sshould\sbe\srestarted\sby\sliveness\sprobe\safter\sstartup\sprobe\senables\sit$'

test/e2e/common/node/container_probe.go:955
k8s.io/kubernetes/test/e2e/common/node.RunLivenessTest(0xc000c963c0, 0xc0019c4480, 0x1, 0xc003aa31d0?)
	test/e2e/common/node/container_probe.go:955 +0x39a
k8s.io/kubernetes/test/e2e/common/node.glob..func2.17()
	test/e2e/common/node/container_probe.go:400 +0x1cf
				[BeforeEach] [sig-node] Probing container
  set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/03/23 06:44:37.652�[0m
Jan  3 06:44:37.652: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename container-probe �[38;5;243m01/03/23 06:44:37.655�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/03/23 06:44:38.362�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/03/23 06:44:38.829�[0m
[BeforeEach] [sig-node] Probing container
  test/e2e/framework/metrics/init/init.go:31
[BeforeEach] [sig-node] Probing container
  test/e2e/common/node/container_probe.go:63
[It] should be restarted by liveness probe after startup probe enables it
  test/e2e/common/node/container_probe.go:379
�[1mSTEP:�[0m Creating pod startup-33131899-1a42-412a-9a76-c7ee101e12d3 in namespace container-probe-6763 �[38;5;243m01/03/23 06:44:39.298�[0m
Jan  3 06:44:39.537: INFO: Waiting up to 5m0s for pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3" in namespace "container-probe-6763" to be "not pending"
Jan  3 06:44:39.771: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 234.309657ms
Jan  3 06:44:42.008: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 2.471554256s
Jan  3 06:44:44.007: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 4.470618393s
Jan  3 06:44:46.007: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 6.470127578s
Jan  3 06:44:48.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 8.469157973s
Jan  3 06:44:50.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 10.468938663s
Jan  3 06:44:52.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 12.46881373s
Jan  3 06:44:54.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 14.46890066s
Jan  3 06:44:56.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 16.469386111s
Jan  3 06:44:58.009: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 18.471899741s
Jan  3 06:45:00.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 20.469205209s
Jan  3 06:45:02.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 22.469704186s
Jan  3 06:45:04.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 24.469284463s
Jan  3 06:45:06.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 26.469366349s
Jan  3 06:45:08.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 28.468415387s
Jan  3 06:45:10.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 30.46875535s
Jan  3 06:45:12.021: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 32.484641579s
Jan  3 06:45:14.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 34.468403086s
Jan  3 06:45:16.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 36.46866629s
Jan  3 06:45:18.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 38.468468553s
Jan  3 06:45:20.010: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 40.47355488s
Jan  3 06:45:22.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 42.469722426s
Jan  3 06:45:24.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 44.468840102s
Jan  3 06:45:26.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 46.468627427s
Jan  3 06:45:28.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 48.46959693s
Jan  3 06:45:30.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 50.468791485s
Jan  3 06:45:32.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 52.468508028s
Jan  3 06:45:34.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 54.468323266s
Jan  3 06:45:36.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 56.469082602s
Jan  3 06:45:38.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 58.468163257s
Jan  3 06:45:40.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.468458547s
Jan  3 06:45:42.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.468531906s
Jan  3 06:45:44.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.469318887s
Jan  3 06:45:46.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.468564195s
Jan  3 06:45:48.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.468862353s
Jan  3 06:45:50.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.46883682s
Jan  3 06:45:52.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.468124427s
Jan  3 06:45:54.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.46864696s
Jan  3 06:45:56.011: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.474054565s
Jan  3 06:45:58.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.468900241s
Jan  3 06:46:00.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.46971798s
Jan  3 06:46:02.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.468400426s
Jan  3 06:46:04.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.468834594s
Jan  3 06:46:06.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.468234211s
Jan  3 06:46:08.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.468098289s
Jan  3 06:46:10.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.46861125s
Jan  3 06:46:12.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.468786735s
Jan  3 06:46:14.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.468547827s
Jan  3 06:46:16.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.46887026s
Jan  3 06:46:18.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.468760098s
Jan  3 06:46:20.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.468752464s
Jan  3 06:46:22.009: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.472555946s
Jan  3 06:46:24.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.468754841s
Jan  3 06:46:26.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.468472097s
Jan  3 06:46:28.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.468441085s
Jan  3 06:46:30.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.468440803s
Jan  3 06:46:32.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.468976649s
Jan  3 06:46:34.007: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.470401241s
Jan  3 06:46:36.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.469182496s
Jan  3 06:46:38.009: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.472734439s
Jan  3 06:46:40.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.468691435s
Jan  3 06:46:42.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.46933948s
Jan  3 06:46:44.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.469076233s
Jan  3 06:46:46.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.46846072s
Jan  3 06:46:48.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.46891352s
Jan  3 06:46:50.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.46973095s
Jan  3 06:46:52.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.468971568s
Jan  3 06:46:54.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.468256499s
Jan  3 06:46:56.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.46865054s
Jan  3 06:46:58.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.468840769s
Jan  3 06:47:00.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.46926871s
Jan  3 06:47:02.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.468327239s
Jan  3 06:47:04.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.469700132s
Jan  3 06:47:06.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.468780425s
Jan  3 06:47:08.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.468614052s
Jan  3 06:47:10.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.469266265s
Jan  3 06:47:12.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.46916971s
Jan  3 06:47:14.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.468199553s
Jan  3 06:47:16.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.468834184s
Jan  3 06:47:18.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.469012932s
Jan  3 06:47:20.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.469147295s
Jan  3 06:47:22.026: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.489571913s
Jan  3 06:47:24.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.469047717s
Jan  3 06:47:26.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.468759516s
Jan  3 06:47:28.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.469262018s
Jan  3 06:47:30.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.469094871s
Jan  3 06:47:32.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.468175516s
Jan  3 06:47:34.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.469468928s
Jan  3 06:47:36.009: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.472763457s
Jan  3 06:47:38.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.468974546s
Jan  3 06:47:40.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.469082115s
Jan  3 06:47:42.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.468559762s
Jan  3 06:47:44.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.468676166s
Jan  3 06:47:46.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.469169908s
Jan  3 06:47:48.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.469296623s
Jan  3 06:47:50.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.469232243s
Jan  3 06:47:52.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.468974381s
Jan  3 06:47:54.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.46823559s
Jan  3 06:47:56.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.468540709s
Jan  3 06:47:58.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.469142531s
Jan  3 06:48:00.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.468817661s
Jan  3 06:48:02.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.469292011s
Jan  3 06:48:04.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.468352691s
Jan  3 06:48:06.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.46895074s
Jan  3 06:48:08.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.469183096s
Jan  3 06:48:10.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.468915936s
Jan  3 06:48:12.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.468528662s
Jan  3 06:48:14.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.469379068s
Jan  3 06:48:16.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.468933123s
Jan  3 06:48:18.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.469048694s
Jan  3 06:48:20.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.468573838s
Jan  3 06:48:22.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.468703218s
Jan  3 06:48:24.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.468477278s
Jan  3 06:48:26.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.468917319s
Jan  3 06:48:28.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.468769167s
Jan  3 06:48:30.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.468768889s
Jan  3 06:48:32.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.468832429s
Jan  3 06:48:34.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.468851085s
Jan  3 06:48:36.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.46872747s
Jan  3 06:48:38.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.468921087s
Jan  3 06:48:40.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.468836094s
Jan  3 06:48:42.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.469148124s
Jan  3 06:48:44.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.468074391s
Jan  3 06:48:46.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.469058479s
Jan  3 06:48:48.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.468414272s
Jan  3 06:48:50.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.468988434s
Jan  3 06:48:52.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.469091983s
Jan  3 06:48:54.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.468918345s
Jan  3 06:48:56.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.469238613s
Jan  3 06:48:58.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.468642519s
Jan  3 06:49:00.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.469092076s
Jan  3 06:49:02.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.46897817s
Jan  3 06:49:04.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.469604111s
Jan  3 06:49:06.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.468797815s
Jan  3 06:49:08.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.469620995s
Jan  3 06:49:10.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.468266584s
Jan  3 06:49:12.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.468310243s
Jan  3 06:49:14.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.468734074s
Jan  3 06:49:16.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.468841124s
Jan  3 06:49:18.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.469244064s
Jan  3 06:49:20.009: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.472421189s
Jan  3 06:49:22.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.469397174s
Jan  3 06:49:24.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.468584864s
Jan  3 06:49:26.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.468914358s
Jan  3 06:49:28.013: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.476590991s
Jan  3 06:49:30.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.468454091s
Jan  3 06:49:32.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.469178779s
Jan  3 06:49:34.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.468247269s
Jan  3 06:49:36.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.468749042s
Jan  3 06:49:38.006: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.468800049s
Jan  3 06:49:40.005: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.468686516s
Jan  3 06:49:40.239: INFO: Pod "startup-33131899-1a42-412a-9a76-c7ee101e12d3": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.702426171s
Jan  3 06:49:40.241: INFO: Unexpected error: starting pod startup-33131899-1a42-412a-9a76-c7ee101e12d3 in namespace container-probe-6763: 
    <*pod.timeoutError | 0xc000cba7e0>: {
        msg: "timed out while waiting for pod container-probe-6763/startup-33131899-1a42-412a-9a76-c7ee101e12d3 to be not pending",
        observedObjects: [
            <*v1.Pod | 0xc000880d80>{
                TypeMeta: {Kind: "", APIVersion: ""},
                ObjectMeta: {
                    Name: "startup-33131899-1a42-412a-9a76-c7ee101e12d3",
                    GenerateName: "",
                    Namespace: "container-probe-6763",
                    SelfLink: "",
                    UID: "46b2b245-c801-41b5-830b-a9937353868c",
                    ResourceVersion: "29030",
                    Generation: 0,
                    CreationTimestamp: {
                        Time: {
                            wall: 0,
                            ext: 63808325079,
                            loc: {
                                name: "Local",
                                zone: [
                                    {name: "UTC", offset: 0, isDST: false},
                                ],
                                tx: [
                                    {
                                        when: -576460752303423488,
                                        index: 0,
                                        isstd: false,
                                        isutc: false,
                                    },
                                ],
                                extend: "UTC0",
                                cacheStart: 9223372036854775807,
                                cacheEnd: 9223372036854775807,
                                cacheZone: {name: "UTC", offset: 0, isDST: false},
                            },
                        },
                    },
                    DeletionTimestamp: nil,
                    DeletionGracePeriodSeconds: nil,
                    Labels: {"test": "startup"},
                    Annotations: nil,
                    OwnerReferences: nil,
                    Finalizers: nil,
                    ManagedFields: [
                        {
                            Manager: "e2e.test",
                            Operation: "Update",
                            APIVersion: "v1",
                            Time: {
                                Time: {
                                    wall: 0,
                                    ext: 63808325079,
                                    loc: {
                                        name: "Local",
                                        zone: [...],
                                        tx: [...],
                                        extend: "UTC0",
                                        cacheStart: 9223372036854775807,
                                        cacheEnd: 9223372036854775807,
                                        cacheZone: {name: ..., offset: ..., isDST: ...},
                                    },
                                },
                            },
                            FieldsType: "FieldsV1",
                            FieldsV1: {
                                Raw: "{\"f:metadata\":{\"f:labels\":{\".\":{},\"f:test\":{}}},\"f:spec\":{\"f:containers\":{\"k:{\\\"name\\\":\\\"busybox\\\"}\":{\".\":{},\"f:command\":{},\"f:image\":{},\"f:imagePullPolicy\":{},\"f:livenessProbe\":{\".\":{},\"f:exec\":{\".\":{},\"f:command\":{}},\"f:failureThreshold\":{},\"f:initialDelaySeconds\":{},\"f:periodSeconds\":{},\"f:successThreshold\":{},\"f:timeoutSeconds\":{}},\"f:name\":{},\"f:resources\":{},\"f:startupProbe\":{\".\":{},\"f:exec\":{\".\":{},\"f:command\":{}},\"f:failureThreshold\":{},\"f:initialDelaySeconds\":{},\"f:periodSeconds\":{},\"f:successThreshold\":{},\"f:timeoutSeconds\":{}},\"f:terminationMessagePath\":{},\"f:terminationMessagePolicy\":{}}},\"f:dnsPolicy\":{},\"f:enableServiceLinks\":{},\"f:restartPolicy\":{},\"f:schedulerName\":{},\"f:securityContext\":{},\"f:terminationGracePeriodSeconds\":{}}}",
                            },
                            Subresource: "",
                        },
                        {
                            Manager: "kubelet",
                            Operation: "Update",
                            APIVersion: "v1",
                            Time: {
                                Time: {
                                    wall: 0,
                                    ext: 63808325079,
                                    loc: {
                                        name: "Local",
                                        zone: [...],
                                        tx: [...],
                                        extend: "UTC0",
                                        cacheStart: 9223372036854775807,
                                        cacheEnd: 9223372036854775807,
                                        cacheZone: {name: ..., offset: ..., isDST: ...},
                                    },
                                },
                            },
                            FieldsType: "FieldsV1",
                            FieldsV1: {
                                Raw: "{\"f:status\":{\"f:conditions\":{\"k:{\\\"type\\\":\\\"ContainersReady\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:message\":{},\"f:reason\":{},\"f:status\":{},\"f:type\":{}},\"k:{\\\"type\\\":\\\"Initialized\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:status\":{},\"f:type\":{}},\"k:{\\\"type\\\":\\\"Ready\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:message\":{},\"f:reason\":{},\"f:status\":{},\"f:type\":{}}},\"f:containerStatuses\":{},\"f:hostIP\":{},\"f:startTime\":{}}}",
                            },
                            Subresource: "status",
                        },
                    ],
                },
                Spec: {
                    Volumes: [
                        {
                            Name: "kube-api-access-hdqg9",
                            VolumeSource: {
                                HostPath: nil,
                                EmptyDir: nil,
                                GCEPersistentDisk: nil,
                                AWSElasticBlockStore: nil,
                                GitRepo: nil,
                                Secret: nil,
                                NFS: nil,
                                ISCSI: nil,
                                Glusterfs: nil,
                                PersistentVolumeClaim: nil,
                                RBD: nil,
                                FlexVolume: nil,
                                Cinder: nil,
                                CephFS: nil,
                                Flocker: nil,
                                DownwardAPI: nil,
                                FC: nil,
                                AzureFile: nil,
                                ConfigMap: nil,
                                VsphereVolume: nil,
                                Quobyte: nil,
                                AzureDisk: nil,
                                PhotonPersistentDisk: nil,
                                Projected: {
                                    Sources: [
                                        {
                                            Secret: ...,
                                            DownwardAPI: ...,
                                            ConfigMap: ...,
                                            ServiceAccountToken: ...,
                                        },
                                        {
                                            Secret: ...,
                                            DownwardAPI: ...,
                                            ConfigMap: ...,
                                            ServiceAccountToken: ...,
                                        },
                                        {
                                            Secret: ...,
     ...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

Jan  3 06:49:40.241: FAIL: starting pod startup-33131899-1a42-412a-9a76-c7ee101e12d3 in namespace container-probe-6763: timed out while waiting for pod container-probe-6763/startup-33131899-1a42-412a-9a76-c7ee101e12d3 to be not pending

Full Stack Trace
k8s.io/kubernetes/test/e2e/common/node.RunLivenessTest(0xc000c963c0, 0xc0019c4480, 0x1, 0xc003aa31d0?)
	test/e2e/common/node/container_probe.go:955 +0x39a
k8s.io/kubernetes/test/e2e/common/node.glob..func2.17()
	test/e2e/common/node/container_probe.go:400 +0x1cf
�[1mSTEP:�[0m deleting the pod �[38;5;243m01/03/23 06:49:40.241�[0m
[AfterEach] [sig-node] Probing container
  test/e2e/framework/node/init/init.go:32
Jan  3 06:49:40.482: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-node] Probing container
  test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-node] Probing container
  dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/03/23 06:49:40.718�[0m
�[1mSTEP:�[0m Collecting events from namespace "container-probe-6763". �[38;5;243m01/03/23 06:49:40.719�[0m
�[1mSTEP:�[0m Found 11 events. �[38;5;243m01/03/23 06:49:40.953�[0m
Jan  3 06:49:40.953: INFO: At 2023-01-03 06:44:39 +0000 UTC - event for startup-33131899-1a42-412a-9a76-c7ee101e12d3: {default-scheduler } Scheduled: Successfully assigned container-probe-6763/startup-33131899-1a42-412a-9a76-c7ee101e12d3 to i-0887927f295dab249
Jan  3 06:49:40.953: INFO: At 2023-01-03 06:44:40 +0000 UTC - event for startup-33131899-1a42-412a-9a76-c7ee101e12d3: {kubelet i-0887927f295dab249} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "1e896e5420a8ecb792057c644134df081a61d44975b932fb1a9e36e6750f69a1": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:49:40.953: INFO: At 2023-01-03 06:44:50 +0000 UTC - event for startup-33131899-1a42-412a-9a76-c7ee101e12d3: {kubelet i-0887927f295dab249} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "139e772293acf877361852477cc9732513b5d2943888be001df1ee2428090280": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:49:40.953: INFO: At 2023-01-03 06:45:02 +0000 UTC - event for startup-33131899-1a42-412a-9a76-c7ee101e12d3: {kubelet i-0887927f295dab249} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "de6b7efc7d7971cadc2dfdef792872ecc5f4623e29e204069f639b35ea772660": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:49:40.953: INFO: At 2023-01-03 06:45:13 +0000 UTC - event for startup-33131899-1a42-412a-9a76-c7ee101e12d3: {kubelet i-0887927f295dab249} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e182c0ae3362a68eb8de58952c8f980b554ae36fc6ec9636dde0a40b278fb5fb": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:49:40.953: INFO: At 2023-01-03 06:45:25 +0000 UTC - event for startup-33131899-1a42-412a-9a76-c7ee101e12d3: {kubelet i-0887927f295dab249} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "8a4eeeac97878640d2ac45e7e71484c7502bd82ac238db086eb7fd1da4b0d1e0": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:49:40.953: INFO: At 2023-01-03 06:45:38 +0000 UTC - event for startup-33131899-1a42-412a-9a76-c7ee101e12d3: {kubelet i-0887927f295dab249} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "f53d254a0fa04997d0fbd08bcf0dd81c37e3a93b02300fd8668645ca76b41d5b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:49:40.953: INFO: At 2023-01-03 06:45:54 +0000 UTC - event for startup-33131899-1a42-412a-9a76-c7ee101e12d3: {kubelet i-0887927f295dab249} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "35a71d4c18a8d099219ee31200abb17cd5af191a271a085cb11575fba5234149": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:49:40.953: INFO: At 2023-01-03 06:46:07 +0000 UTC - event for startup-33131899-1a42-412a-9a76-c7ee101e12d3: {kubelet i-0887927f295dab249} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b85fa9e342c975308de3a64a7f54ecc2940a4affddabdbcd4a46ae63c995f1d3": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:49:40.953: INFO: At 2023-01-03 06:46:22 +0000 UTC - event for startup-33131899-1a42-412a-9a76-c7ee101e12d3: {kubelet i-0887927f295dab249} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "11a6affd8c4ab1206bbaa8d33f5b78516af5ca5a7931adec0808de6d98d218d4": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:49:40.953: INFO: At 2023-01-03 06:46:34 +0000 UTC - event for startup-33131899-1a42-412a-9a76-c7ee101e12d3: {kubelet i-0887927f295dab249} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "23e7252e88a48118f7531a566e2aa06e93e39843ac6a456be256611db7c72df4": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:49:41.186: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Jan  3 06:49:41.186: INFO: 
Jan  3 06:49:41.423: INFO: 
Logging node info for node i-0116ec5cfa0915363
Jan  3 06:49:41.656: INFO: Node Info: &Node{ObjectMeta:{i-0116ec5cfa0915363    845a5e73-b93d-4679-a025-6403fe91469b 30693 0 2023-01-03 06:24:27 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0116ec5cfa0915363 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:ap-south-1a topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.51.97 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0116ec5cfa0915363"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-03 06:24:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-03 06:24:54 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:25:11 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-03 06:25:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-03 06:25:13 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-03 06:47:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0116ec5cfa0915363,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892301824 0} {<nil>} 3801076Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787444224 0} {<nil>} 3698676Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-03 06:47:26 +0000 UTC,LastTransitionTime:2023-01-03 06:24:21 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-03 06:47:26 +0000 UTC,LastTransitionTime:2023-01-03 06:24:21 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-03 06:47:26 +0000 UTC,LastTransitionTime:2023-01-03 06:24:21 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-03 06:47:26 +0000 UTC,LastTransitionTime:2023-01-03 06:25:11 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.51.97,},NodeAddress{Type:ExternalIP,Address:35.154.4.55,},NodeAddress{Type:InternalDNS,Address:i-0116ec5cfa0915363.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0116ec5cfa0915363.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-154-4-55.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec291a4b21ade93e02dbfdea9af30b8c,SystemUUID:ec291a4b-21ad-e93e-02db-fdea9af30b8c,BootID:3cd177e4-da3b-4287-b5dc-70d163e7dd13,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.0],SizeBytes:135162323,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.0],SizeBytes:124991801,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.0],SizeBytes:57657656,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43446388,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42805548,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4967304,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan  3 06:49:41.657: INFO: 
Logging kubelet events for node i-0116ec5cfa0915363
Jan  3 06:49:41.893: INFO: 
Logging pods the kubelet thinks is on node i-0116ec5cfa0915363
Jan  3 06:49:42.134: INFO: etcd-manager-main-i-0116ec5cfa0915363 started at 2023-01-03 06:23:51 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:42.134: INFO: 	Container etcd-manager ready: true, restart count 0
Jan  3 06:49:42.134: INFO: cilium-operator-5dd44dc49f-nzbgs started at 2023-01-03 06:25:00 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:42.134: INFO: 	Container cilium-operator ready: true, restart count 0
Jan  3 06:49:42.134: INFO: ebs-csi-controller-89b649c94-4zgt2 started at 2023-01-03 06:25:00 +0000 UTC (0+5 container statuses recorded)
Jan  3 06:49:42.134: INFO: 	Container csi-attacher ready: true, restart count 0
Jan  3 06:49:42.134: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  3 06:49:42.134: INFO: 	Container csi-resizer ready: true, restart count 0
Jan  3 06:49:42.134: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  3 06:49:42.134: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:49:42.134: INFO: cilium-npb6w started at 2023-01-03 06:24:59 +0000 UTC (1+1 container statuses recorded)
Jan  3 06:49:42.134: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  3 06:49:42.134: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  3 06:49:42.134: INFO: aws-cloud-controller-manager-mvsjr started at 2023-01-03 06:24:59 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:42.134: INFO: 	Container aws-cloud-controller-manager ready: true, restart count 0
Jan  3 06:49:42.134: INFO: ebs-csi-node-pg7l9 started at 2023-01-03 06:24:59 +0000 UTC (0+3 container statuses recorded)
Jan  3 06:49:42.134: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  3 06:49:42.134: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:49:42.134: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:49:42.134: INFO: etcd-manager-events-i-0116ec5cfa0915363 started at 2023-01-03 06:23:51 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:42.134: INFO: 	Container etcd-manager ready: true, restart count 0
Jan  3 06:49:42.134: INFO: kube-apiserver-i-0116ec5cfa0915363 started at 2023-01-03 06:23:51 +0000 UTC (0+2 container statuses recorded)
Jan  3 06:49:42.134: INFO: 	Container healthcheck ready: true, restart count 0
Jan  3 06:49:42.134: INFO: 	Container kube-apiserver ready: true, restart count 1
Jan  3 06:49:42.134: INFO: kube-controller-manager-i-0116ec5cfa0915363 started at 2023-01-03 06:23:51 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:42.134: INFO: 	Container kube-controller-manager ready: true, restart count 2
Jan  3 06:49:42.134: INFO: kube-scheduler-i-0116ec5cfa0915363 started at 2023-01-03 06:23:51 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:42.134: INFO: 	Container kube-scheduler ready: true, restart count 0
Jan  3 06:49:42.134: INFO: kops-controller-9t2zt started at 2023-01-03 06:24:59 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:42.134: INFO: 	Container kops-controller ready: true, restart count 0
Jan  3 06:49:42.134: INFO: dns-controller-69987775c6-rgd5s started at 2023-01-03 06:25:00 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:42.134: INFO: 	Container dns-controller ready: true, restart count 0
Jan  3 06:49:42.907: INFO: 
Latency metrics for node i-0116ec5cfa0915363
Jan  3 06:49:42.907: INFO: 
Logging node info for node i-06675ed9fdf15131e
Jan  3 06:49:43.143: INFO: Node Info: &Node{ObjectMeta:{i-06675ed9fdf15131e    6a365a73-a0a0-47e1-83ac-1dd53dc6cb56 31837 0 2023-01-03 06:26:03 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-06675ed9fdf15131e kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-06675ed9fdf15131e topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.34.128 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-3132":"i-06675ed9fdf15131e","csi-hostpath-provisioning-7802":"i-06675ed9fdf15131e","ebs.csi.aws.com":"i-06675ed9fdf15131e"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-03 06:26:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-03 06:26:03 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-03 06:26:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-03 06:26:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:26:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {e2e.test Update v1 2023-01-03 06:40:01 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:40:12 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-03 06:49:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-06675ed9fdf15131e,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-03 06:45:25 +0000 UTC,LastTransitionTime:2023-01-03 06:26:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-03 06:45:25 +0000 UTC,LastTransitionTime:2023-01-03 06:26:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-03 06:45:25 +0000 UTC,LastTransitionTime:2023-01-03 06:26:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-03 06:45:25 +0000 UTC,LastTransitionTime:2023-01-03 06:26:18 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.34.128,},NodeAddress{Type:ExternalIP,Address:13.233.53.249,},NodeAddress{Type:InternalDNS,Address:i-06675ed9fdf15131e.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-06675ed9fdf15131e.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-233-53-249.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec278d28e0e8aa5f9f5a88afed4c7357,SystemUUID:ec278d28-e0e8-aa5f-9f5a-88afed4c7357,BootID:60717d56-76f8-4838-8bb7-4a4ce6867c70,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-7802^78eb4252-8b31-11ed-a7cd-e699b846bc6a],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-7802^78eb4252-8b31-11ed-a7cd-e699b846bc6a,DevicePath:,},},Config:nil,},}
Jan  3 06:49:43.143: INFO: 
Logging kubelet events for node i-06675ed9fdf15131e
Jan  3 06:49:43.379: INFO: 
Logging pods the kubelet thinks is on node i-06675ed9fdf15131e
Jan  3 06:49:43.621: INFO: ebs-csi-node-q24xb started at 2023-01-03 06:26:04 +0000 UTC (0+3 container statuses recorded)
Jan  3 06:49:43.621: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  3 06:49:43.621: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:49:43.621: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:49:43.621: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-vkxkf started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:43.621: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:49:43.621: INFO: coredns-559769c974-xh6r4 started at 2023-01-03 06:26:18 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:43.621: INFO: 	Container coredns ready: true, restart count 0
Jan  3 06:49:43.621: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-gcftr started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:43.621: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:49:43.621: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-knmjr started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:43.621: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: false, restart count 0
Jan  3 06:49:43.621: INFO: inline-volume-tester-578zd started at 2023-01-03 06:43:56 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:43.621: INFO: 	Container csi-volume-tester ready: false, restart count 0
Jan  3 06:49:43.621: INFO: csi-hostpathplugin-0 started at 2023-01-03 06:39:40 +0000 UTC (0+7 container statuses recorded)
Jan  3 06:49:43.621: INFO: 	Container csi-attacher ready: true, restart count 0
Jan  3 06:49:43.621: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  3 06:49:43.621: INFO: 	Container csi-resizer ready: true, restart count 0
Jan  3 06:49:43.621: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan  3 06:49:43.621: INFO: 	Container hostpath ready: true, restart count 0
Jan  3 06:49:43.621: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:49:43.621: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:49:43.621: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-vmn8b started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:43.621: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:49:43.621: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-gzk6r started at 2023-01-03 06:40:04 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:43.621: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: false, restart count 0
Jan  3 06:49:43.621: INFO: inline-volume-tester-7frp2 started at 2023-01-03 06:42:47 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:43.621: INFO: 	Container csi-volume-tester ready: false, restart count 0
Jan  3 06:49:43.621: INFO: cilium-88fm4 started at 2023-01-03 06:26:04 +0000 UTC (1+1 container statuses recorded)
Jan  3 06:49:43.621: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  3 06:49:43.621: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  3 06:49:43.621: INFO: hostpath-client started at 2023-01-03 06:40:11 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:43.621: INFO: 	Container hostpath-client ready: false, restart count 0
Jan  3 06:49:43.621: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-pn6rb started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:43.621: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:49:43.621: INFO: coredns-autoscaler-7cb5c5b969-tg22d started at 2023-01-03 06:26:18 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:43.621: INFO: 	Container autoscaler ready: true, restart count 0
Jan  3 06:49:43.621: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-bhflv started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:43.621: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:49:43.622: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-qbds6 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:43.622: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:49:43.622: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-5qt2b started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:43.622: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:49:43.622: INFO: csi-hostpathplugin-0 started at 2023-01-03 06:42:46 +0000 UTC (0+7 container statuses recorded)
Jan  3 06:49:43.622: INFO: 	Container csi-attacher ready: true, restart count 0
Jan  3 06:49:43.622: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  3 06:49:43.622: INFO: 	Container csi-resizer ready: true, restart count 0
Jan  3 06:49:43.622: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan  3 06:49:43.622: INFO: 	Container hostpath ready: true, restart count 0
Jan  3 06:49:43.622: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:49:43.622: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:49:43.622: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-kn247 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:43.622: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:49:43.622: INFO: csi-hostpathplugin-0 started at 2023-01-03 06:43:56 +0000 UTC (0+7 container statuses recorded)
Jan  3 06:49:43.622: INFO: 	Container csi-attacher ready: false, restart count 0
Jan  3 06:49:43.622: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan  3 06:49:43.622: INFO: 	Container csi-resizer ready: false, restart count 0
Jan  3 06:49:43.622: INFO: 	Container csi-snapshotter ready: false, restart count 0
Jan  3 06:49:43.622: INFO: 	Container hostpath ready: false, restart count 0
Jan  3 06:49:43.622: INFO: 	Container liveness-probe ready: false, restart count 0
Jan  3 06:49:43.622: INFO: 	Container node-driver-registrar ready: false, restart count 0
Jan  3 06:49:44.437: INFO: 
Latency metrics for node i-06675ed9fdf15131e
Jan  3 06:49:44.437: INFO: 
Logging node info for node i-0887927f295dab249
Jan  3 06:49:44.670: INFO: Node Info: &Node{ObjectMeta:{i-0887927f295dab249    8c537f9f-6ce2-4eae-a273-3e5dec0f5a97 31741 0 2023-01-03 06:26:08 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0887927f295dab249 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-0887927f295dab249 topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.43.47 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-7494":"i-0887927f295dab249","ebs.csi.aws.com":"i-0887927f295dab249"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-03 06:40:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:48:54 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-03 06:48:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0887927f295dab249,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-03 06:48:57 +0000 UTC,LastTransitionTime:2023-01-03 06:26:08 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-03 06:48:57 +0000 UTC,LastTransitionTime:2023-01-03 06:26:08 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-03 06:48:57 +0000 UTC,LastTransitionTime:2023-01-03 06:26:08 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-03 06:48:57 +0000 UTC,LastTransitionTime:2023-01-03 06:26:24 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.43.47,},NodeAddress{Type:ExternalIP,Address:65.0.96.201,},NodeAddress{Type:InternalDNS,Address:i-0887927f295dab249.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0887927f295dab249.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-65-0-96-201.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2d5f1c251f05fc398417508c564588,SystemUUID:ec2d5f1c-251f-05fc-3984-17508c564588,BootID:80a76b6c-5e81-478d-a15c-92ab635eebdb,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-7494^2a9b5c2b-8b32-11ed-9a17-02cea9609c51 kubernetes.io/csi/csi-hostpath-ephemeral-7494^2a9f4d2c-8b32-11ed-9a17-02cea9609c51 kubernetes.io/csi/ebs.csi.aws.com^vol-0747fe00dd5d5923d kubernetes.io/csi/ebs.csi.aws.com^vol-0c219034d4beab5b8 kubernetes.io/csi/ebs.csi.aws.com^vol-0e0e80dfc2d2b174b],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0c219034d4beab5b8,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-7494^2a9b5c2b-8b32-11ed-9a17-02cea9609c51,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-7494^2a9f4d2c-8b32-11ed-9a17-02cea9609c51,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0747fe00dd5d5923d,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0e0e80dfc2d2b174b,DevicePath:,},},Config:nil,},}
Jan  3 06:49:44.671: INFO: 
Logging kubelet events for node i-0887927f295dab249
Jan  3 06:49:44.907: INFO: 
Logging pods the kubelet thinks is on node i-0887927f295dab249
Jan  3 06:49:45.151: INFO: ss2-0 started at 2023-01-03 06:45:36 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:45.151: INFO: 	Container webserver ready: false, restart count 0
Jan  3 06:49:45.151: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-qs9vk started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:45.151: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:49:45.151: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-5sjfb started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:45.151: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:49:45.151: INFO: ebs-csi-node-22htr started at 2023-01-03 06:26:09 +0000 UTC (0+3 container statuses recorded)
Jan  3 06:49:45.151: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  3 06:49:45.151: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:49:45.151: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:49:45.151: INFO: inline-volume-tester-qwfhg started at 2023-01-03 06:45:10 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:45.151: INFO: 	Container csi-volume-tester ready: false, restart count 0
Jan  3 06:49:45.151: INFO: pod-configmaps-6ac65fd0-2362-460b-b401-dc12549b2575 started at 2023-01-03 06:45:42 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:45.151: INFO: 	Container agnhost-container ready: false, restart count 0
Jan  3 06:49:45.151: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-nzbt8 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:45.151: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:49:45.151: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-kmgz2 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:45.151: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:49:45.151: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-z8hhz started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:45.151: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:49:45.151: INFO: hostexec-i-0887927f295dab249-k9ffc started at 2023-01-03 06:48:57 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:45.151: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  3 06:49:45.151: INFO: pod-disruption-failure-ignore-0-mtcbk started at 2023-01-03 06:49:24 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:45.151: INFO: 	Container c ready: false, restart count 0
Jan  3 06:49:45.151: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-m9n4g started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:45.151: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:49:45.151: INFO: cilium-s9l8s started at 2023-01-03 06:26:09 +0000 UTC (1+1 container statuses recorded)
Jan  3 06:49:45.151: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  3 06:49:45.151: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  3 06:49:45.151: INFO: sysctl-a19af871-72a5-462d-b2f8-c18c5cadcfbf started at 2023-01-03 06:48:40 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:45.151: INFO: 	Container test-container ready: false, restart count 0
Jan  3 06:49:45.151: INFO: busybox-a4e63ed3-dcae-481c-bc71-a916c133ab48 started at 2023-01-03 06:49:29 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:45.151: INFO: 	Container busybox ready: false, restart count 0
Jan  3 06:49:45.151: INFO: exec-volume-test-dynamicpv-dr79 started at 2023-01-03 06:48:52 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:45.151: INFO: 	Container exec-container-dynamicpv-dr79 ready: false, restart count 0
Jan  3 06:49:45.151: INFO: pod-08d9a359-10dd-4a70-9331-75e097f67e47 started at 2023-01-03 06:49:06 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:45.151: INFO: 	Container write-pod ready: false, restart count 0
Jan  3 06:49:45.151: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-dbt7p started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:45.151: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:49:45.151: INFO: pod-disruption-failure-ignore-1-t7p4h started at 2023-01-03 06:49:24 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:45.151: INFO: 	Container c ready: false, restart count 0
Jan  3 06:49:45.151: INFO: pod-logs-websocket-0ecb888b-2ab2-453b-a368-7389d79527e5 started at 2023-01-03 06:48:33 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:45.151: INFO: 	Container main ready: false, restart count 0
Jan  3 06:49:45.151: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-87btk started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:45.151: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:49:45.151: INFO: pod-9d10df65-59e8-4966-a058-376431a1bbfe started at 2023-01-03 06:43:23 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:45.151: INFO: 	Container write-pod ready: true, restart count 0
Jan  3 06:49:45.151: INFO: csi-hostpathplugin-0 started at 2023-01-03 06:43:44 +0000 UTC (0+7 container statuses recorded)
Jan  3 06:49:45.151: INFO: 	Container csi-attacher ready: true, restart count 0
Jan  3 06:49:45.151: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  3 06:49:45.151: INFO: 	Container csi-resizer ready: true, restart count 0
Jan  3 06:49:45.151: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan  3 06:49:45.151: INFO: 	Container hostpath ready: true, restart count 0
Jan  3 06:49:45.151: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:49:45.151: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:49:45.151: INFO: agnhost-primary-x2zdc started at 2023-01-03 06:48:14 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:45.151: INFO: 	Container agnhost-primary ready: false, restart count 0
Jan  3 06:49:45.151: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-47hz9 started at 2023-01-03 06:40:04 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:45.151: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:49:45.151: INFO: pod-projected-configmaps-158e5277-3e7e-4278-a0c2-3078bcbd01de started at 2023-01-03 06:47:24 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:45.151: INFO: 	Container agnhost-container ready: false, restart count 0
Jan  3 06:49:45.151: INFO: pvc-tester-7bfxw started at 2023-01-03 06:47:37 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:45.151: INFO: 	Container write-pod ready: false, restart count 0
Jan  3 06:49:45.151: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-5tzj6 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:45.151: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:49:45.151: INFO: pod-adoption-release started at 2023-01-03 06:46:06 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:45.151: INFO: 	Container pod-adoption-release ready: false, restart count 0
Jan  3 06:49:46.114: INFO: 
Latency metrics for node i-0887927f295dab249
Jan  3 06:49:46.114: INFO: 
Logging node info for node i-0c4c153cc3021d728
Jan  3 06:49:46.348: INFO: Node Info: &Node{ObjectMeta:{i-0c4c153cc3021d728    0fc330cf-9a4f-4650-8df2-bbc4962562bf 32250 0 2023-01-03 06:26:07 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a io.kubernetes.storage.mock/node:some-mock-node kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0c4c153cc3021d728 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-0c4c153cc3021d728 topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.34.232 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-9859":"i-0c4c153cc3021d728","ebs.csi.aws.com":"i-0c4c153cc3021d728"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-03 06:26:07 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-03 06:26:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-03 06:26:07 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:26:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-03 06:26:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-03 06:40:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-03 06:49:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {kube-controller-manager Update v1 2023-01-03 06:49:40 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0c4c153cc3021d728,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-03 06:49:26 +0000 UTC,LastTransitionTime:2023-01-03 06:26:07 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-03 06:49:26 +0000 UTC,LastTransitionTime:2023-01-03 06:26:07 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-03 06:49:26 +0000 UTC,LastTransitionTime:2023-01-03 06:26:07 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-03 06:49:26 +0000 UTC,LastTransitionTime:2023-01-03 06:26:23 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.34.232,},NodeAddress{Type:ExternalIP,Address:13.232.119.101,},NodeAddress{Type:InternalDNS,Address:i-0c4c153cc3021d728.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0c4c153cc3021d728.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-232-119-101.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec20ee6ab34ca9da624dd2e5f8c44780,SystemUUID:ec20ee6a-b34c-a9da-624d-d2e5f8c44780,BootID:960d66c3-58ec-4ea0-a76c-db5eb00e743c,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-9859^cb580395-8b32-11ed-afca-2e7cd3dc881a,DevicePath:,},},Config:nil,},}
Jan  3 06:49:46.348: INFO: 
Logging kubelet events for node i-0c4c153cc3021d728
Jan  3 06:49:46.584: INFO: 
Logging pods the kubelet thinks is on node i-0c4c153cc3021d728
Jan  3 06:49:46.826: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-s8mtc started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:46.826: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:49:46.826: INFO: inline-volume-tester-4p2n2 started at 2023-01-03 06:49:39 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:46.826: INFO: 	Container csi-volume-tester ready: false, restart count 0
Jan  3 06:49:46.826: INFO: ebs-csi-node-5sgcl started at 2023-01-03 06:26:08 +0000 UTC (0+3 container statuses recorded)
Jan  3 06:49:46.826: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  3 06:49:46.826: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:49:46.826: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:49:46.826: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-4sx4g started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:46.826: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:49:46.826: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-98hxx started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:46.826: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:49:46.826: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-ljkk6 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:46.826: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:49:46.826: INFO: cilium-87m98 started at 2023-01-03 06:26:08 +0000 UTC (1+1 container statuses recorded)
Jan  3 06:49:46.826: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  3 06:49:46.826: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  3 06:49:46.826: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-tfhlj started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:46.826: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:49:46.826: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-44v74 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:46.826: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:49:46.826: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-55wkd started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:46.826: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:49:46.826: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-fh8hc started at 2023-01-03 06:40:04 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:46.826: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:49:46.826: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-l9w98 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:46.826: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:49:46.826: INFO: csi-hostpathplugin-0 started at 2023-01-03 06:49:13 +0000 UTC (0+7 container statuses recorded)
Jan  3 06:49:46.826: INFO: 	Container csi-attacher ready: true, restart count 0
Jan  3 06:49:46.826: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  3 06:49:46.826: INFO: 	Container csi-resizer ready: true, restart count 0
Jan  3 06:49:46.826: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan  3 06:49:46.826: INFO: 	Container hostpath ready: true, restart count 0
Jan  3 06:49:46.826: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:49:46.826: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:49:46.826: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-w8kkx started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:46.826: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:49:46.826: INFO: pod-configmaps-10669edb-860a-4ad7-afc7-64e3f0e9ebff started at 2023-01-03 06:47:50 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:46.826: INFO: 	Container agnhost-container ready: false, restart count 0
Jan  3 06:49:47.863: INFO: 
Latency metrics for node i-0c4c153cc3021d728
Jan  3 06:49:47.863: INFO: 
Logging node info for node i-0f6d4ea509bfe3fbe
Jan  3 06:49:48.096: INFO: Node Info: &Node{ObjectMeta:{i-0f6d4ea509bfe3fbe    d3d92523-9fe9-40c0-96cf-7de8a708f9e5 29995 0 2023-01-03 06:26:08 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0f6d4ea509bfe3fbe kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-0f6d4ea509bfe3fbe topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.56.168 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-1691":"i-0f6d4ea509bfe3fbe","ebs.csi.aws.com":"i-0f6d4ea509bfe3fbe"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-03 06:40:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:41:48 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-03 06:47:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0f6d4ea509bfe3fbe,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-03 06:47:03 +0000 UTC,LastTransitionTime:2023-01-03 06:26:08 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-03 06:47:03 +0000 UTC,LastTransitionTime:2023-01-03 06:26:08 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-03 06:47:03 +0000 UTC,LastTransitionTime:2023-01-03 06:26:08 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-03 06:47:03 +0000 UTC,LastTransitionTime:2023-01-03 06:26:23 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.56.168,},NodeAddress{Type:ExternalIP,Address:15.206.145.14,},NodeAddress{Type:InternalDNS,Address:i-0f6d4ea509bfe3fbe.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0f6d4ea509bfe3fbe.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-206-145-14.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2eebc156cceaa5905e74ada30878dd,SystemUUID:ec2eebc1-56cc-eaa5-905e-74ada30878dd,BootID:d561d40a-625b-4fa0-ad51-87e12466f6e1,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-1691^b1a35b91-8b31-11ed-a7c5-62d1175edcc5],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-1691^b1a35b91-8b31-11ed-a7c5-62d1175edcc5,DevicePath:,},},Config:nil,},}
Jan  3 06:49:48.097: INFO: 
Logging kubelet events for node i-0f6d4ea509bfe3fbe
Jan  3 06:49:48.332: INFO: 
Logging pods the kubelet thinks is on node i-0f6d4ea509bfe3fbe
Jan  3 06:49:48.572: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-64hvj started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:48.572: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:49:48.572: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-mqf8m started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:48.572: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:49:48.572: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-26j4z started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:48.572: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:49:48.572: INFO: inline-volume-tester-9wfs9 started at 2023-01-03 06:41:47 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:48.572: INFO: 	Container csi-volume-tester ready: false, restart count 0
Jan  3 06:49:48.572: INFO: pod-33511478-1f92-45f0-a4ad-dfec83a925bb started at 2023-01-03 06:44:42 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:48.572: INFO: 	Container write-pod ready: false, restart count 0
Jan  3 06:49:48.572: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-mdkxh started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:48.572: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:49:48.572: INFO: hostexec-i-0f6d4ea509bfe3fbe-x62kt started at 2023-01-03 06:44:36 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:48.572: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  3 06:49:48.572: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-bv5tk started at 2023-01-03 06:40:04 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:48.572: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:49:48.572: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-9hzqt started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:48.572: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:49:48.572: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-7s22g started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:48.572: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:49:48.572: INFO: csi-hostpathplugin-0 started at 2023-01-03 06:41:05 +0000 UTC (0+7 container statuses recorded)
Jan  3 06:49:48.572: INFO: 	Container csi-attacher ready: true, restart count 0
Jan  3 06:49:48.572: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  3 06:49:48.572: INFO: 	Container csi-resizer ready: true, restart count 0
Jan  3 06:49:48.572: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan  3 06:49:48.572: INFO: 	Container hostpath ready: true, restart count 0
Jan  3 06:49:48.572: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:49:48.572: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:49:48.572: INFO: ebs-csi-node-78dfk started at 2023-01-03 06:26:09 +0000 UTC (0+3 container statuses recorded)
Jan  3 06:49:48.572: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  3 06:49:48.572: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:49:48.572: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:49:48.572: INFO: cilium-cd88p started at 2023-01-03 06:26:09 +0000 UTC (1+1 container statuses recorded)
Jan  3 06:49:48.572: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  3 06:49:48.572: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  3 06:49:48.572: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-txkql started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:48.572: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:49:48.572: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-7cwlm started at 2023-01-03 06:40:04 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:48.572: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:49:48.572: INFO: coredns-559769c974-ls78k started at 2023-01-03 06:26:47 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:48.572: INFO: 	Container coredns ready: true, restart count 0
Jan  3 06:49:48.572: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-vgzx4 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:49:48.572: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:49:49.420: INFO: 
Latency metrics for node i-0f6d4ea509bfe3fbe
[DeferCleanup (Each)] [sig-node] Probing container
  tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "container-probe-6763" for this suite. �[38;5;243m01/03/23 06:49:49.42�[0m

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-node] Secrets should be consumable via the environment [NodeConformance] [Conformance] 5m13s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-node\]\sSecrets\sshould\sbe\sconsumable\svia\sthe\senvironment\s\[NodeConformance\]\s\[Conformance\]$'

test/e2e/framework/pod/output/output.go:237
k8s.io/kubernetes/test/e2e/framework/pod/output.TestContainerOutputMatcher(0x75c08ff?, {0x75e0b45?, 0xc003f7bed8?}, 0xc001a7a000, 0x0, {0xc003f7bf08, 0x6, 0x6}, 0x0?)
	test/e2e/framework/pod/output/output.go:237 +0x176
k8s.io/kubernetes/test/e2e/framework/pod/output.TestContainerOutput(...)
	test/e2e/framework/pod/output/output.go:214
k8s.io/kubernetes/test/e2e/common/node.glob..func20.2()
	test/e2e/common/node/secrets.go:129 +0x9cb
				[BeforeEach] [sig-node] Secrets
  set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/03/23 06:42:08.817�[0m
Jan  3 06:42:08.817: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename secrets �[38;5;243m01/03/23 06:42:08.819�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/03/23 06:42:09.519�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/03/23 06:42:09.986�[0m
[BeforeEach] [sig-node] Secrets
  test/e2e/framework/metrics/init/init.go:31
[It] should be consumable via the environment [NodeConformance] [Conformance]
  test/e2e/common/node/secrets.go:95
�[1mSTEP:�[0m creating secret secrets-1394/secret-test-82a29a26-e1bb-4876-8560-af50de8a8503 �[38;5;243m01/03/23 06:42:10.452�[0m
�[1mSTEP:�[0m Creating a pod to test consume secrets �[38;5;243m01/03/23 06:42:10.688�[0m
Jan  3 06:42:10.924: INFO: Waiting up to 5m0s for pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7" in namespace "secrets-1394" to be "Succeeded or Failed"
Jan  3 06:42:11.158: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 234.430683ms
Jan  3 06:42:13.394: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 2.47047344s
Jan  3 06:42:15.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 4.46853829s
Jan  3 06:42:17.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 6.469534106s
Jan  3 06:42:19.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 8.469926726s
Jan  3 06:42:21.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 10.46957251s
Jan  3 06:42:23.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 12.469544617s
Jan  3 06:42:25.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 14.46894865s
Jan  3 06:42:27.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 16.469306389s
Jan  3 06:42:29.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 18.469696819s
Jan  3 06:42:31.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 20.468443503s
Jan  3 06:42:33.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 22.469736579s
Jan  3 06:42:35.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 24.469572074s
Jan  3 06:42:37.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 26.468493541s
Jan  3 06:42:39.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 28.468707165s
Jan  3 06:42:41.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 30.469750904s
Jan  3 06:42:43.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 32.468820205s
Jan  3 06:42:45.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 34.468919677s
Jan  3 06:42:47.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 36.468182886s
Jan  3 06:42:49.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 38.468754527s
Jan  3 06:42:51.395: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 40.471104807s
Jan  3 06:42:53.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 42.468247881s
Jan  3 06:42:55.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 44.469065924s
Jan  3 06:42:57.394: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 46.470672038s
Jan  3 06:42:59.391: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 48.467659231s
Jan  3 06:43:01.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 50.469371628s
Jan  3 06:43:03.395: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 52.471119157s
Jan  3 06:43:05.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 54.469122526s
Jan  3 06:43:07.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 56.469424485s
Jan  3 06:43:09.394: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 58.470771028s
Jan  3 06:43:11.396: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.472123667s
Jan  3 06:43:13.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.468689543s
Jan  3 06:43:15.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.468970997s
Jan  3 06:43:17.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.469699s
Jan  3 06:43:19.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.469186296s
Jan  3 06:43:21.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.469274078s
Jan  3 06:43:23.397: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.473638904s
Jan  3 06:43:25.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.468786837s
Jan  3 06:43:27.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.469218259s
Jan  3 06:43:29.394: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.470422414s
Jan  3 06:43:31.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.469590487s
Jan  3 06:43:33.394: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.470172105s
Jan  3 06:43:35.394: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.469975506s
Jan  3 06:43:37.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.46921272s
Jan  3 06:43:39.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.468857564s
Jan  3 06:43:41.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.469385813s
Jan  3 06:43:43.402: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.478181546s
Jan  3 06:43:45.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.469195156s
Jan  3 06:43:47.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.469573809s
Jan  3 06:43:49.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.46914873s
Jan  3 06:43:51.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.469419569s
Jan  3 06:43:53.394: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.470006776s
Jan  3 06:43:55.394: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.470265091s
Jan  3 06:43:57.395: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.471337921s
Jan  3 06:43:59.394: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.470802732s
Jan  3 06:44:01.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.468404671s
Jan  3 06:44:03.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.469682517s
Jan  3 06:44:05.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.468997152s
Jan  3 06:44:07.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.46916905s
Jan  3 06:44:09.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.468953722s
Jan  3 06:44:11.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.469576674s
Jan  3 06:44:13.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.468609098s
Jan  3 06:44:15.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.469340128s
Jan  3 06:44:17.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.469192099s
Jan  3 06:44:19.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.468764675s
Jan  3 06:44:21.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.469552607s
Jan  3 06:44:23.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.469052771s
Jan  3 06:44:25.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.469948699s
Jan  3 06:44:27.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.468632707s
Jan  3 06:44:29.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.469924027s
Jan  3 06:44:31.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.469315363s
Jan  3 06:44:33.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.469167561s
Jan  3 06:44:35.395: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.471321091s
Jan  3 06:44:37.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.468692027s
Jan  3 06:44:39.394: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.470368877s
Jan  3 06:44:41.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.469489932s
Jan  3 06:44:43.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.469552012s
Jan  3 06:44:45.395: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.471780673s
Jan  3 06:44:47.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.468864934s
Jan  3 06:44:49.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.46963763s
Jan  3 06:44:51.395: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.471213064s
Jan  3 06:44:53.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.46972561s
Jan  3 06:44:55.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.468708857s
Jan  3 06:44:57.399: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.475028317s
Jan  3 06:44:59.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.469523091s
Jan  3 06:45:01.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.46949878s
Jan  3 06:45:03.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.468682218s
Jan  3 06:45:05.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.469160103s
Jan  3 06:45:07.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.469134559s
Jan  3 06:45:09.397: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.473875008s
Jan  3 06:45:11.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.468261896s
Jan  3 06:45:13.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.469224243s
Jan  3 06:45:15.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.469026406s
Jan  3 06:45:17.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.469053345s
Jan  3 06:45:19.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.468910179s
Jan  3 06:45:21.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.468532638s
Jan  3 06:45:23.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.468887304s
Jan  3 06:45:25.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.469944962s
Jan  3 06:45:27.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.467993537s
Jan  3 06:45:29.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.468941104s
Jan  3 06:45:31.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.469015493s
Jan  3 06:45:33.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.468503146s
Jan  3 06:45:35.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.468396501s
Jan  3 06:45:37.391: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.46777715s
Jan  3 06:45:39.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.468674211s
Jan  3 06:45:41.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.468366937s
Jan  3 06:45:43.394: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.470638422s
Jan  3 06:45:45.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.468481874s
Jan  3 06:45:47.391: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.46773355s
Jan  3 06:45:49.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.46807619s
Jan  3 06:45:51.391: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.467886595s
Jan  3 06:45:53.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.468321826s
Jan  3 06:45:55.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.468346356s
Jan  3 06:45:57.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.468068424s
Jan  3 06:45:59.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.468565252s
Jan  3 06:46:01.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.468615965s
Jan  3 06:46:03.395: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.471345521s
Jan  3 06:46:05.395: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.471061726s
Jan  3 06:46:07.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.468093586s
Jan  3 06:46:09.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.468629886s
Jan  3 06:46:11.391: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.467909532s
Jan  3 06:46:13.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.469880529s
Jan  3 06:46:15.391: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.467841002s
Jan  3 06:46:17.391: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.46775567s
Jan  3 06:46:19.391: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.467860489s
Jan  3 06:46:21.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.468673518s
Jan  3 06:46:23.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.468566742s
Jan  3 06:46:25.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.468583846s
Jan  3 06:46:27.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.467976705s
Jan  3 06:46:29.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.469931446s
Jan  3 06:46:31.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.468695504s
Jan  3 06:46:33.391: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.46784206s
Jan  3 06:46:35.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.468434772s
Jan  3 06:46:37.394: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.470435124s
Jan  3 06:46:39.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.468279761s
Jan  3 06:46:41.391: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.467685787s
Jan  3 06:46:43.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.468891697s
Jan  3 06:46:45.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.469399363s
Jan  3 06:46:47.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.468008067s
Jan  3 06:46:49.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.469487748s
Jan  3 06:46:51.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.468885194s
Jan  3 06:46:53.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.468412359s
Jan  3 06:46:55.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.468676569s
Jan  3 06:46:57.409: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.485781344s
Jan  3 06:46:59.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.468717625s
Jan  3 06:47:01.391: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.467934828s
Jan  3 06:47:03.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.469126294s
Jan  3 06:47:05.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.468077903s
Jan  3 06:47:07.391: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.467924976s
Jan  3 06:47:09.392: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.468292047s
Jan  3 06:47:11.393: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.469272294s
Jan  3 06:47:11.628: INFO: Pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.704462092s
Jan  3 06:47:12.096: INFO: Failed to get logs from node "i-0887927f295dab249" pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7" container "env-test": the server rejected our request for an unknown reason (get pods pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7)
�[1mSTEP:�[0m delete the pod �[38;5;243m01/03/23 06:47:12.096�[0m
Jan  3 06:47:12.331: INFO: Waiting for pod pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7 to disappear
Jan  3 06:47:12.564: INFO: Pod pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7 no longer exists
Jan  3 06:47:12.564: INFO: Unexpected error: 
    <*errors.errorString | 0xc00158c8b0>: {
        s: "expected pod \"pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7\" success: timed out while waiting for pod secrets-1394/pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7 to be Succeeded or Failed",
    }
Jan  3 06:47:12.564: FAIL: expected pod "pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7" success: timed out while waiting for pod secrets-1394/pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7 to be Succeeded or Failed

Full Stack Trace
k8s.io/kubernetes/test/e2e/framework/pod/output.TestContainerOutputMatcher(0x75c08ff?, {0x75e0b45?, 0xc003f7bed8?}, 0xc001a7a000, 0x0, {0xc003f7bf08, 0x6, 0x6}, 0x0?)
	test/e2e/framework/pod/output/output.go:237 +0x176
k8s.io/kubernetes/test/e2e/framework/pod/output.TestContainerOutput(...)
	test/e2e/framework/pod/output/output.go:214
k8s.io/kubernetes/test/e2e/common/node.glob..func20.2()
	test/e2e/common/node/secrets.go:129 +0x9cb
[AfterEach] [sig-node] Secrets
  test/e2e/framework/node/init/init.go:32
Jan  3 06:47:12.565: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-node] Secrets
  test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-node] Secrets
  dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/03/23 06:47:12.808�[0m
�[1mSTEP:�[0m Collecting events from namespace "secrets-1394". �[38;5;243m01/03/23 06:47:12.808�[0m
�[1mSTEP:�[0m Found 11 events. �[38;5;243m01/03/23 06:47:13.042�[0m
Jan  3 06:47:13.042: INFO: At 2023-01-03 06:42:10 +0000 UTC - event for pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7: {default-scheduler } Scheduled: Successfully assigned secrets-1394/pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7 to i-0887927f295dab249
Jan  3 06:47:13.042: INFO: At 2023-01-03 06:42:11 +0000 UTC - event for pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7: {kubelet i-0887927f295dab249} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d3cd4bfea99e3b52f7fea1fbdcd52cae206faf21dfc0322e0b30c9e01c10e743": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:47:13.042: INFO: At 2023-01-03 06:42:25 +0000 UTC - event for pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7: {kubelet i-0887927f295dab249} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a8cd5a81fa2ccc5b9a2f0dc697eb04eea9c446ca09a472422d8eb1a063d2eba1": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:47:13.042: INFO: At 2023-01-03 06:42:36 +0000 UTC - event for pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7: {kubelet i-0887927f295dab249} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "88c8091053510c1e37ef027e0e89fccbac130db40c17a7bd0b3bfd736b401305": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:47:13.042: INFO: At 2023-01-03 06:42:49 +0000 UTC - event for pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7: {kubelet i-0887927f295dab249} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "68574d10fc0719a1744a2c5645cec843feccf82be66ad54f74d4164c1ca2da3b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:47:13.042: INFO: At 2023-01-03 06:43:05 +0000 UTC - event for pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7: {kubelet i-0887927f295dab249} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "bd7d8c5aa8945dccbacade85e9fc1c877aaa8b1815a3fb38c8b833c7f77967b8": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:47:13.042: INFO: At 2023-01-03 06:43:17 +0000 UTC - event for pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7: {kubelet i-0887927f295dab249} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d6196cd9cea558406ddd4907d6368b5d415773ece98058bca9ebc479bf1980d4": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:47:13.042: INFO: At 2023-01-03 06:43:30 +0000 UTC - event for pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7: {kubelet i-0887927f295dab249} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "3aa0b1a9b906ea9d75bf5f80b6b610ceac1d153a408fadc23ca2b3c814668c7b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:47:13.042: INFO: At 2023-01-03 06:43:45 +0000 UTC - event for pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7: {kubelet i-0887927f295dab249} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a1ae99c50de0fd9599a3b6d514e1ebbc74c54b5cd0f75b27b72b76c8b6a42c9c": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:47:13.042: INFO: At 2023-01-03 06:43:56 +0000 UTC - event for pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7: {kubelet i-0887927f295dab249} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "cdfee9f066e7d10c8c766b5b9e5c87ccaa9a9c7b003f228afbfd15ae7625bdba": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:47:13.042: INFO: At 2023-01-03 06:44:10 +0000 UTC - event for pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7: {kubelet i-0887927f295dab249} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ae1251a50fafcbdcd50ce46608c2f412132a12bceecaa4de15d689c245a721fb": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:47:13.277: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Jan  3 06:47:13.277: INFO: 
Jan  3 06:47:13.512: INFO: 
Logging node info for node i-0116ec5cfa0915363
Jan  3 06:47:13.750: INFO: Node Info: &Node{ObjectMeta:{i-0116ec5cfa0915363    845a5e73-b93d-4679-a025-6403fe91469b 27782 0 2023-01-03 06:24:27 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0116ec5cfa0915363 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:ap-south-1a topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.51.97 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0116ec5cfa0915363"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-03 06:24:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-03 06:24:54 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:25:11 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-03 06:25:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-03 06:25:13 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-03 06:42:20 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0116ec5cfa0915363,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892301824 0} {<nil>} 3801076Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787444224 0} {<nil>} 3698676Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-03 06:42:20 +0000 UTC,LastTransitionTime:2023-01-03 06:24:21 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-03 06:42:20 +0000 UTC,LastTransitionTime:2023-01-03 06:24:21 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-03 06:42:20 +0000 UTC,LastTransitionTime:2023-01-03 06:24:21 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-03 06:42:20 +0000 UTC,LastTransitionTime:2023-01-03 06:25:11 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.51.97,},NodeAddress{Type:ExternalIP,Address:35.154.4.55,},NodeAddress{Type:InternalDNS,Address:i-0116ec5cfa0915363.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0116ec5cfa0915363.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-154-4-55.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec291a4b21ade93e02dbfdea9af30b8c,SystemUUID:ec291a4b-21ad-e93e-02db-fdea9af30b8c,BootID:3cd177e4-da3b-4287-b5dc-70d163e7dd13,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.0],SizeBytes:135162323,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.0],SizeBytes:124991801,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.0],SizeBytes:57657656,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43446388,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42805548,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4967304,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan  3 06:47:13.750: INFO: 
Logging kubelet events for node i-0116ec5cfa0915363
Jan  3 06:47:13.986: INFO: 
Logging pods the kubelet thinks is on node i-0116ec5cfa0915363
Jan  3 06:47:14.464: INFO: kube-scheduler-i-0116ec5cfa0915363 started at 2023-01-03 06:23:51 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:14.464: INFO: 	Container kube-scheduler ready: true, restart count 0
Jan  3 06:47:14.464: INFO: kops-controller-9t2zt started at 2023-01-03 06:24:59 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:14.464: INFO: 	Container kops-controller ready: true, restart count 0
Jan  3 06:47:14.464: INFO: cilium-npb6w started at 2023-01-03 06:24:59 +0000 UTC (1+1 container statuses recorded)
Jan  3 06:47:14.464: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  3 06:47:14.464: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  3 06:47:14.464: INFO: aws-cloud-controller-manager-mvsjr started at 2023-01-03 06:24:59 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:14.464: INFO: 	Container aws-cloud-controller-manager ready: true, restart count 0
Jan  3 06:47:14.464: INFO: ebs-csi-node-pg7l9 started at 2023-01-03 06:24:59 +0000 UTC (0+3 container statuses recorded)
Jan  3 06:47:14.464: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  3 06:47:14.464: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:47:14.464: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:47:14.464: INFO: etcd-manager-events-i-0116ec5cfa0915363 started at 2023-01-03 06:23:51 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:14.464: INFO: 	Container etcd-manager ready: true, restart count 0
Jan  3 06:47:14.464: INFO: kube-apiserver-i-0116ec5cfa0915363 started at 2023-01-03 06:23:51 +0000 UTC (0+2 container statuses recorded)
Jan  3 06:47:14.464: INFO: 	Container healthcheck ready: true, restart count 0
Jan  3 06:47:14.464: INFO: 	Container kube-apiserver ready: true, restart count 1
Jan  3 06:47:14.464: INFO: kube-controller-manager-i-0116ec5cfa0915363 started at 2023-01-03 06:23:51 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:14.464: INFO: 	Container kube-controller-manager ready: true, restart count 2
Jan  3 06:47:14.464: INFO: dns-controller-69987775c6-rgd5s started at 2023-01-03 06:25:00 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:14.464: INFO: 	Container dns-controller ready: true, restart count 0
Jan  3 06:47:14.464: INFO: etcd-manager-main-i-0116ec5cfa0915363 started at 2023-01-03 06:23:51 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:14.464: INFO: 	Container etcd-manager ready: true, restart count 0
Jan  3 06:47:14.464: INFO: cilium-operator-5dd44dc49f-nzbgs started at 2023-01-03 06:25:00 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:14.464: INFO: 	Container cilium-operator ready: true, restart count 0
Jan  3 06:47:14.464: INFO: ebs-csi-controller-89b649c94-4zgt2 started at 2023-01-03 06:25:00 +0000 UTC (0+5 container statuses recorded)
Jan  3 06:47:14.464: INFO: 	Container csi-attacher ready: true, restart count 0
Jan  3 06:47:14.464: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  3 06:47:14.464: INFO: 	Container csi-resizer ready: true, restart count 0
Jan  3 06:47:14.464: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  3 06:47:14.464: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:47:15.255: INFO: 
Latency metrics for node i-0116ec5cfa0915363
Jan  3 06:47:15.255: INFO: 
Logging node info for node i-06675ed9fdf15131e
Jan  3 06:47:15.488: INFO: Node Info: &Node{ObjectMeta:{i-06675ed9fdf15131e    6a365a73-a0a0-47e1-83ac-1dd53dc6cb56 29432 0 2023-01-03 06:26:03 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-06675ed9fdf15131e kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-06675ed9fdf15131e topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.34.128 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-7802":"i-06675ed9fdf15131e","csi-mock-csi-mock-volumes-5893":"i-06675ed9fdf15131e","ebs.csi.aws.com":"i-06675ed9fdf15131e"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-03 06:26:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-03 06:26:03 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-03 06:26:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-03 06:26:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:26:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {e2e.test Update v1 2023-01-03 06:40:01 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:40:12 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-03 06:45:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-06675ed9fdf15131e,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-03 06:45:25 +0000 UTC,LastTransitionTime:2023-01-03 06:26:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-03 06:45:25 +0000 UTC,LastTransitionTime:2023-01-03 06:26:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-03 06:45:25 +0000 UTC,LastTransitionTime:2023-01-03 06:26:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-03 06:45:25 +0000 UTC,LastTransitionTime:2023-01-03 06:26:18 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.34.128,},NodeAddress{Type:ExternalIP,Address:13.233.53.249,},NodeAddress{Type:InternalDNS,Address:i-06675ed9fdf15131e.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-06675ed9fdf15131e.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-233-53-249.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec278d28e0e8aa5f9f5a88afed4c7357,SystemUUID:ec278d28-e0e8-aa5f-9f5a-88afed4c7357,BootID:60717d56-76f8-4838-8bb7-4a4ce6867c70,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-7802^78eb4252-8b31-11ed-a7cd-e699b846bc6a],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-7802^78eb4252-8b31-11ed-a7cd-e699b846bc6a,DevicePath:,},},Config:nil,},}
Jan  3 06:47:15.488: INFO: 
Logging kubelet events for node i-06675ed9fdf15131e
Jan  3 06:47:15.731: INFO: 
Logging pods the kubelet thinks is on node i-06675ed9fdf15131e
Jan  3 06:47:16.214: INFO: csi-mockplugin-0 started at 2023-01-03 06:42:50 +0000 UTC (0+3 container statuses recorded)
Jan  3 06:47:16.214: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  3 06:47:16.214: INFO: 	Container driver-registrar ready: true, restart count 0
Jan  3 06:47:16.214: INFO: 	Container mock ready: true, restart count 0
Jan  3 06:47:16.214: INFO: csi-mockplugin-resizer-0 started at 2023-01-03 06:42:51 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:16.214: INFO: 	Container csi-resizer ready: false, restart count 0
Jan  3 06:47:16.214: INFO: simpletest.rc-t5ft6 started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:16.214: INFO: simpletest.rc-rp4kk started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:16.214: INFO: ebs-csi-node-q24xb started at 2023-01-03 06:26:04 +0000 UTC (0+3 container statuses recorded)
Jan  3 06:47:16.214: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  3 06:47:16.214: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:47:16.214: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:47:16.214: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-vkxkf started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:16.214: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:16.214: INFO: simpletest.rc-rmwtw started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:16.214: INFO: pvc-volume-tester-tnqg4 started at 2023-01-03 06:43:36 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:16.214: INFO: 	Container volume-tester ready: false, restart count 0
Jan  3 06:47:16.214: INFO: inline-volume-tester-578zd started at 2023-01-03 06:43:56 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:16.214: INFO: 	Container csi-volume-tester ready: false, restart count 0
Jan  3 06:47:16.214: INFO: simpletest.rc-zmzj2 started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:16.214: INFO: simpletest.rc-6ctjj started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:16.214: INFO: coredns-559769c974-xh6r4 started at 2023-01-03 06:26:18 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:16.214: INFO: 	Container coredns ready: true, restart count 0
Jan  3 06:47:16.214: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-gcftr started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:16.214: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:16.214: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-knmjr started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:16.214: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: false, restart count 0
Jan  3 06:47:16.214: INFO: csi-hostpathplugin-0 started at 2023-01-03 06:39:40 +0000 UTC (0+7 container statuses recorded)
Jan  3 06:47:16.214: INFO: 	Container csi-attacher ready: true, restart count 0
Jan  3 06:47:16.214: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  3 06:47:16.214: INFO: 	Container csi-resizer ready: true, restart count 0
Jan  3 06:47:16.214: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan  3 06:47:16.214: INFO: 	Container hostpath ready: true, restart count 0
Jan  3 06:47:16.214: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:47:16.214: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:47:16.214: INFO: simpletest.rc-pz9j7 started at 2023-01-03 06:47:12 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:16.214: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:47:16.214: INFO: simpletest.rc-cn5f9 started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:16.214: INFO: simpletest.rc-8d5wd started at 2023-01-03 06:47:12 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:16.214: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:47:16.214: INFO: simpletest.rc-95bsx started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:16.214: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-vmn8b started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:16.214: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:16.214: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-gzk6r started at 2023-01-03 06:40:04 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:16.214: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: false, restart count 0
Jan  3 06:47:16.214: INFO: inline-volume-tester-7frp2 started at 2023-01-03 06:42:47 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:16.214: INFO: 	Container csi-volume-tester ready: false, restart count 0
Jan  3 06:47:16.214: INFO: simpletest.rc-scqc4 started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:16.214: INFO: simpletest.rc-jtd7b started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:16.214: INFO: simpletest.rc-l54f8 started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:16.214: INFO: simpletest.rc-q6tgz started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:16.214: INFO: cilium-88fm4 started at 2023-01-03 06:26:04 +0000 UTC (1+1 container statuses recorded)
Jan  3 06:47:16.214: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  3 06:47:16.214: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  3 06:47:16.214: INFO: hostpath-client started at 2023-01-03 06:40:11 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:16.214: INFO: 	Container hostpath-client ready: false, restart count 0
Jan  3 06:47:16.214: INFO: simpletest.rc-t97fb started at 2023-01-03 06:47:12 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:16.214: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:47:16.214: INFO: simpletest.rc-k622w started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:16.214: INFO: simpletest.rc-xb5t8 started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:16.214: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-pn6rb started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:16.214: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:16.214: INFO: simpletest.rc-dmt6g started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:16.214: INFO: simpletest.rc-lt4t8 started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:16.214: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-5qt2b started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:16.214: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:16.214: INFO: csi-hostpathplugin-0 started at 2023-01-03 06:42:46 +0000 UTC (0+7 container statuses recorded)
Jan  3 06:47:16.214: INFO: 	Container csi-attacher ready: false, restart count 0
Jan  3 06:47:16.214: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan  3 06:47:16.214: INFO: 	Container csi-resizer ready: false, restart count 0
Jan  3 06:47:16.214: INFO: 	Container csi-snapshotter ready: false, restart count 0
Jan  3 06:47:16.214: INFO: 	Container hostpath ready: false, restart count 0
Jan  3 06:47:16.214: INFO: 	Container liveness-probe ready: false, restart count 0
Jan  3 06:47:16.214: INFO: 	Container node-driver-registrar ready: false, restart count 0
Jan  3 06:47:16.214: INFO: simpletest.rc-q2qnx started at 2023-01-03 06:47:12 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:16.214: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:47:16.214: INFO: coredns-autoscaler-7cb5c5b969-tg22d started at 2023-01-03 06:26:18 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:16.214: INFO: 	Container autoscaler ready: true, restart count 0
Jan  3 06:47:16.214: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-bhflv started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:16.214: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:16.214: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-qbds6 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:16.214: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:16.214: INFO: simpletest.rc-rfgp2 started at 2023-01-03 06:47:12 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:16.214: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:47:16.214: INFO: simpletest.rc-ndz5s started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:16.214: INFO: simpletest.rc-vcgnx started at 2023-01-03 06:47:12 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:16.214: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:47:16.214: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-kn247 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:16.214: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:16.214: INFO: csi-hostpathplugin-0 started at 2023-01-03 06:43:56 +0000 UTC (0+7 container statuses recorded)
Jan  3 06:47:16.214: INFO: 	Container csi-attacher ready: false, restart count 0
Jan  3 06:47:16.215: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan  3 06:47:16.215: INFO: 	Container csi-resizer ready: false, restart count 0
Jan  3 06:47:16.215: INFO: 	Container csi-snapshotter ready: false, restart count 0
Jan  3 06:47:16.215: INFO: 	Container hostpath ready: false, restart count 0
Jan  3 06:47:16.215: INFO: 	Container liveness-probe ready: false, restart count 0
Jan  3 06:47:16.215: INFO: 	Container node-driver-registrar ready: false, restart count 0
Jan  3 06:47:17.085: INFO: 
Latency metrics for node i-06675ed9fdf15131e
Jan  3 06:47:17.085: INFO: 
Logging node info for node i-0887927f295dab249
Jan  3 06:47:17.319: INFO: Node Info: &Node{ObjectMeta:{i-0887927f295dab249    8c537f9f-6ce2-4eae-a273-3e5dec0f5a97 29289 0 2023-01-03 06:26:08 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0887927f295dab249 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-0887927f295dab249 topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.43.47 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-7494":"i-0887927f295dab249","ebs.csi.aws.com":"i-0887927f295dab249"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-03 06:40:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:45:11 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-03 06:45:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0887927f295dab249,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-03 06:45:13 +0000 UTC,LastTransitionTime:2023-01-03 06:26:08 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-03 06:45:13 +0000 UTC,LastTransitionTime:2023-01-03 06:26:08 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-03 06:45:13 +0000 UTC,LastTransitionTime:2023-01-03 06:26:08 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-03 06:45:13 +0000 UTC,LastTransitionTime:2023-01-03 06:26:24 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.43.47,},NodeAddress{Type:ExternalIP,Address:65.0.96.201,},NodeAddress{Type:InternalDNS,Address:i-0887927f295dab249.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0887927f295dab249.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-65-0-96-201.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2d5f1c251f05fc398417508c564588,SystemUUID:ec2d5f1c-251f-05fc-3984-17508c564588,BootID:80a76b6c-5e81-478d-a15c-92ab635eebdb,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-7494^2a9b5c2b-8b32-11ed-9a17-02cea9609c51 kubernetes.io/csi/csi-hostpath-ephemeral-7494^2a9f4d2c-8b32-11ed-9a17-02cea9609c51 kubernetes.io/csi/ebs.csi.aws.com^vol-0747fe00dd5d5923d],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-7494^2a9b5c2b-8b32-11ed-9a17-02cea9609c51,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-7494^2a9f4d2c-8b32-11ed-9a17-02cea9609c51,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0747fe00dd5d5923d,DevicePath:,},},Config:nil,},}
Jan  3 06:47:17.320: INFO: 
Logging kubelet events for node i-0887927f295dab249
Jan  3 06:47:17.559: INFO: 
Logging pods the kubelet thinks is on node i-0887927f295dab249
Jan  3 06:47:17.811: INFO: simpletest.rc-c9z5q started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:17.811: INFO: dns-test-71df1669-ca24-4488-bdc2-c2149686db55 started at 2023-01-03 06:46:44 +0000 UTC (0+3 container statuses recorded)
Jan  3 06:47:17.811: INFO: 	Container jessie-querier ready: false, restart count 0
Jan  3 06:47:17.811: INFO: 	Container querier ready: false, restart count 0
Jan  3 06:47:17.811: INFO: 	Container webserver ready: false, restart count 0
Jan  3 06:47:17.811: INFO: simpletest.rc-65xdf started at 2023-01-03 06:47:12 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:17.811: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:47:17.811: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-m9n4g started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:17.811: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:17.811: INFO: simpletest.rc-hgkdm started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:17.811: INFO: simpletest.rc-gqp2d started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:17.811: INFO: simpletest.rc-5gjj9 started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:17.811: INFO: cilium-s9l8s started at 2023-01-03 06:26:09 +0000 UTC (1+1 container statuses recorded)
Jan  3 06:47:17.811: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  3 06:47:17.811: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  3 06:47:17.811: INFO: startup-33131899-1a42-412a-9a76-c7ee101e12d3 started at 2023-01-03 06:44:39 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:17.811: INFO: 	Container busybox ready: false, restart count 0
Jan  3 06:47:17.811: INFO: simpletest.rc-sg497 started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:17.811: INFO: simpletest.rc-zk9p4 started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:17.812: INFO: affinity-nodeport-fh67z started at 2023-01-03 06:41:28 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:17.812: INFO: 	Container affinity-nodeport ready: true, restart count 0
Jan  3 06:47:17.812: INFO: simpletest.rc-bh5xr started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:17.812: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-dbt7p started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:17.812: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:17.812: INFO: simpletest.rc-frd6f started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:17.812: INFO: simpletest.rc-lf4hv started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:17.812: INFO: simpletest.rc-sq7jx started at 2023-01-03 06:47:12 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:17.812: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:47:17.812: INFO: simpletest.rc-zvhkg started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:17.812: INFO: simpletest.rc-jb6jj started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:17.812: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-87btk started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:17.812: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:17.812: INFO: simpletest.rc-msq55 started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:17.812: INFO: pod-9d10df65-59e8-4966-a058-376431a1bbfe started at 2023-01-03 06:43:23 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:17.812: INFO: 	Container write-pod ready: false, restart count 0
Jan  3 06:47:17.812: INFO: csi-hostpathplugin-0 started at 2023-01-03 06:43:44 +0000 UTC (0+7 container statuses recorded)
Jan  3 06:47:17.812: INFO: 	Container csi-attacher ready: true, restart count 0
Jan  3 06:47:17.812: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  3 06:47:17.812: INFO: 	Container csi-resizer ready: true, restart count 0
Jan  3 06:47:17.812: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan  3 06:47:17.812: INFO: 	Container hostpath ready: true, restart count 0
Jan  3 06:47:17.812: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:47:17.812: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:47:17.812: INFO: test-deployment-swhng-54bc444df-8rmgv started at 2023-01-03 06:44:38 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:17.812: INFO: 	Container httpd ready: false, restart count 0
Jan  3 06:47:17.812: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-47hz9 started at 2023-01-03 06:40:04 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:17.812: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:17.812: INFO: simpletest.rc-x5cdw started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:17.812: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-5tzj6 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:17.812: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:17.812: INFO: pod-adoption-release started at 2023-01-03 06:46:06 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:17.812: INFO: 	Container pod-adoption-release ready: false, restart count 0
Jan  3 06:47:17.812: INFO: simpletest.rc-xb2lr started at 2023-01-03 06:47:12 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:17.812: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:47:17.812: INFO: test-pod-8f8b0f25-9283-406c-a37f-7b953461815d started at 2023-01-03 06:42:39 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:17.812: INFO: 	Container agnhost-container ready: false, restart count 0
Jan  3 06:47:17.812: INFO: simpletest.rc-26tkd started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:17.812: INFO: simpletest.rc-snzxl started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:17.812: INFO: simpletest.rc-9h4tv started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:17.812: INFO: ss2-0 started at 2023-01-03 06:45:36 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:17.812: INFO: 	Container webserver ready: false, restart count 0
Jan  3 06:47:17.812: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-qs9vk started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:17.812: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:17.812: INFO: simpletest.rc-4rl2t started at 2023-01-03 06:47:12 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:17.812: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:47:17.812: INFO: simpletest.rc-2z477 started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:17.812: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-5sjfb started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:17.812: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:17.812: INFO: simpletest.rc-7bbvw started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:17.812: INFO: simpletest.rc-wckj2 started at 2023-01-03 06:47:12 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:17.812: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:47:17.812: INFO: simpletest.rc-2h8tx started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:17.812: INFO: ebs-csi-node-22htr started at 2023-01-03 06:26:09 +0000 UTC (0+3 container statuses recorded)
Jan  3 06:47:17.812: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  3 06:47:17.812: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:47:17.812: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:47:17.812: INFO: inline-volume-tester-qwfhg started at 2023-01-03 06:45:10 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:17.812: INFO: 	Container csi-volume-tester ready: false, restart count 0
Jan  3 06:47:17.812: INFO: pod-configmaps-6ac65fd0-2362-460b-b401-dc12549b2575 started at 2023-01-03 06:45:42 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:17.812: INFO: 	Container agnhost-container ready: false, restart count 0
Jan  3 06:47:17.812: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-nzbt8 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:17.812: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:17.812: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-kmgz2 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:17.812: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:17.812: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-z8hhz started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:17.812: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:17.812: INFO: simpletest.rc-696df started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:17.812: INFO: simpletest.rc-lstqj started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:18.701: INFO: 
Latency metrics for node i-0887927f295dab249
Jan  3 06:47:18.701: INFO: 
Logging node info for node i-0c4c153cc3021d728
Jan  3 06:47:18.934: INFO: Node Info: &Node{ObjectMeta:{i-0c4c153cc3021d728    0fc330cf-9a4f-4650-8df2-bbc4962562bf 29761 0 2023-01-03 06:26:07 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a io.kubernetes.storage.mock/node:some-mock-node kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0c4c153cc3021d728 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-0c4c153cc3021d728 topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.34.232 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-volume-expand-9886":"i-0c4c153cc3021d728","ebs.csi.aws.com":"i-0c4c153cc3021d728"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-03 06:26:07 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-03 06:26:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-03 06:26:07 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:26:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-03 06:26:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-03 06:40:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-03 06:46:11 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-01-03 06:46:12 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0c4c153cc3021d728,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-03 06:46:11 +0000 UTC,LastTransitionTime:2023-01-03 06:26:07 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-03 06:46:11 +0000 UTC,LastTransitionTime:2023-01-03 06:26:07 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-03 06:46:11 +0000 UTC,LastTransitionTime:2023-01-03 06:26:07 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-03 06:46:11 +0000 UTC,LastTransitionTime:2023-01-03 06:26:23 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.34.232,},NodeAddress{Type:ExternalIP,Address:13.232.119.101,},NodeAddress{Type:InternalDNS,Address:i-0c4c153cc3021d728.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0c4c153cc3021d728.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-232-119-101.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec20ee6ab34ca9da624dd2e5f8c44780,SystemUUID:ec20ee6a-b34c-a9da-624d-d2e5f8c44780,BootID:960d66c3-58ec-4ea0-a76c-db5eb00e743c,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-volume-expand-9886^4e0f5548-8b32-11ed-8e7f-066d9af4aed6],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-volume-expand-9886^4e0f5548-8b32-11ed-8e7f-066d9af4aed6,DevicePath:,},},Config:nil,},}
Jan  3 06:47:18.935: INFO: 
Logging kubelet events for node i-0c4c153cc3021d728
Jan  3 06:47:19.170: INFO: 
Logging pods the kubelet thinks is on node i-0c4c153cc3021d728
Jan  3 06:47:19.418: INFO: simpletest.rc-v7xdz started at 2023-01-03 06:47:12 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:19.418: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:47:19.418: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-4sx4g started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:19.418: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:19.418: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-98hxx started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:19.418: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:19.418: INFO: simpletest.rc-8pwbb started at 2023-01-03 06:47:12 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:19.418: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:47:19.418: INFO: simpletest.rc-7rvhv started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:19.418: INFO: affinity-nodeport-2r4nr started at 2023-01-03 06:41:28 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:19.418: INFO: 	Container affinity-nodeport ready: true, restart count 0
Jan  3 06:47:19.418: INFO: csi-hostpathplugin-0 started at 2023-01-03 06:45:29 +0000 UTC (0+7 container statuses recorded)
Jan  3 06:47:19.418: INFO: 	Container csi-attacher ready: true, restart count 0
Jan  3 06:47:19.418: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  3 06:47:19.418: INFO: 	Container csi-resizer ready: true, restart count 0
Jan  3 06:47:19.418: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan  3 06:47:19.418: INFO: 	Container hostpath ready: true, restart count 0
Jan  3 06:47:19.418: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:47:19.418: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:47:19.418: INFO: simpletest.rc-sc5mf started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:19.418: INFO: pod-20c75720-f672-49af-b552-0eceef5b318c started at 2023-01-03 06:46:11 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:19.418: INFO: 	Container write-pod ready: false, restart count 0
Jan  3 06:47:19.418: INFO: pod-subpath-test-inlinevolume-z5hb started at 2023-01-03 06:46:53 +0000 UTC (2+2 container statuses recorded)
Jan  3 06:47:19.418: INFO: 	Init container init-volume-inlinevolume-z5hb ready: false, restart count 0
Jan  3 06:47:19.418: INFO: 	Init container test-init-subpath-inlinevolume-z5hb ready: false, restart count 0
Jan  3 06:47:19.418: INFO: 	Container test-container-subpath-inlinevolume-z5hb ready: false, restart count 0
Jan  3 06:47:19.418: INFO: 	Container test-container-volume-inlinevolume-z5hb ready: false, restart count 0
Jan  3 06:47:19.418: INFO: simpletest.rc-glx8q started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:19.418: INFO: simpletest.rc-lzfr2 started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:19.418: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-ljkk6 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:19.418: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:19.418: INFO: simpletest.rc-r5w2m started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:19.418: INFO: fail-once-non-local-ms76g started at 2023-01-03 06:45:23 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:19.418: INFO: 	Container c ready: false, restart count 0
Jan  3 06:47:19.418: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-tfhlj started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:19.418: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:19.418: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-44v74 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:19.418: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:19.418: INFO: simpletest.rc-w2f69 started at 2023-01-03 06:47:12 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:19.418: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:47:19.418: INFO: downward-api-c1b0829d-9fa5-418b-8a60-8e96219e4704 started at 2023-01-03 06:42:24 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:19.418: INFO: 	Container dapi-container ready: false, restart count 0
Jan  3 06:47:19.418: INFO: cilium-87m98 started at 2023-01-03 06:26:08 +0000 UTC (1+1 container statuses recorded)
Jan  3 06:47:19.418: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  3 06:47:19.418: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  3 06:47:19.418: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-55wkd started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:19.418: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:19.418: INFO: simpletest.rc-6h6tf started at 2023-01-03 06:47:12 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:19.418: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:47:19.418: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-fh8hc started at 2023-01-03 06:40:04 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:19.418: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:19.418: INFO: fail-once-non-local-27nz9 started at 2023-01-03 06:45:02 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:19.418: INFO: 	Container c ready: false, restart count 0
Jan  3 06:47:19.418: INFO: simpletest.rc-gwnxn started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:19.418: INFO: fail-once-non-local-wdcck started at 2023-01-03 06:44:35 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:19.418: INFO: 	Container c ready: false, restart count 0
Jan  3 06:47:19.418: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-l9w98 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:19.418: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:19.418: INFO: simpletest.rc-cckl2 started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:19.418: INFO: simpletest.rc-tqhk4 started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:19.418: INFO: simpletest.rc-kqnnc started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:19.418: INFO: simpletest.rc-jmk9r started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:19.418: INFO: simpletest.rc-cvfzg started at 2023-01-03 06:47:14 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:19.418: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:47:19.418: INFO: simpletest.rc-qrwnz started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:19.418: INFO: simpletest.rc-4mj6g started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:19.418: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-w8kkx started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:19.418: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:19.418: INFO: simpletest.rc-lbzvv started at 2023-01-03 06:47:12 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:19.418: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:47:19.418: INFO: simpletest.rc-9jwk4 started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:19.418: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-s8mtc started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:19.418: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:19.418: INFO: simpletest.rc-q99cx started at 2023-01-03 06:47:12 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:19.418: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:47:19.418: INFO: simpletest.rc-8kp29 started at 2023-01-03 06:47:13 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:19.418: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:47:19.418: INFO: fail-once-non-local-82rmn started at 2023-01-03 06:44:35 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:19.418: INFO: 	Container c ready: false, restart count 0
Jan  3 06:47:19.418: INFO: fail-once-non-local-jk86f started at 2023-01-03 06:45:06 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:19.418: INFO: 	Container c ready: false, restart count 0
Jan  3 06:47:19.418: INFO: hostexec-i-0c4c153cc3021d728-s292j started at 2023-01-03 06:45:18 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:19.418: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  3 06:47:19.418: INFO: pod-subpath-test-preprovisionedpv-vsdz started at 2023-01-03 06:45:30 +0000 UTC (2+1 container statuses recorded)
Jan  3 06:47:19.418: INFO: 	Init container init-volume-preprovisionedpv-vsdz ready: false, restart count 0
Jan  3 06:47:19.418: INFO: 	Init container test-init-volume-preprovisionedpv-vsdz ready: false, restart count 0
Jan  3 06:47:19.418: INFO: 	Container test-container-subpath-preprovisionedpv-vsdz ready: false, restart count 0
Jan  3 06:47:19.418: INFO: simpletest.rc-fhvzt started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:19.418: INFO: ebs-csi-node-5sgcl started at 2023-01-03 06:26:08 +0000 UTC (0+3 container statuses recorded)
Jan  3 06:47:19.418: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  3 06:47:19.418: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:47:19.418: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:47:20.350: INFO: 
Latency metrics for node i-0c4c153cc3021d728
Jan  3 06:47:20.350: INFO: 
Logging node info for node i-0f6d4ea509bfe3fbe
Jan  3 06:47:20.586: INFO: Node Info: &Node{ObjectMeta:{i-0f6d4ea509bfe3fbe    d3d92523-9fe9-40c0-96cf-7de8a708f9e5 29995 0 2023-01-03 06:26:08 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0f6d4ea509bfe3fbe kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-0f6d4ea509bfe3fbe topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.56.168 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-1691":"i-0f6d4ea509bfe3fbe","ebs.csi.aws.com":"i-0f6d4ea509bfe3fbe"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-03 06:40:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:41:48 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-03 06:47:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0f6d4ea509bfe3fbe,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-03 06:47:03 +0000 UTC,LastTransitionTime:2023-01-03 06:26:08 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-03 06:47:03 +0000 UTC,LastTransitionTime:2023-01-03 06:26:08 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-03 06:47:03 +0000 UTC,LastTransitionTime:2023-01-03 06:26:08 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-03 06:47:03 +0000 UTC,LastTransitionTime:2023-01-03 06:26:23 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.56.168,},NodeAddress{Type:ExternalIP,Address:15.206.145.14,},NodeAddress{Type:InternalDNS,Address:i-0f6d4ea509bfe3fbe.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0f6d4ea509bfe3fbe.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-206-145-14.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2eebc156cceaa5905e74ada30878dd,SystemUUID:ec2eebc1-56cc-eaa5-905e-74ada30878dd,BootID:d561d40a-625b-4fa0-ad51-87e12466f6e1,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-1691^b1a35b91-8b31-11ed-a7c5-62d1175edcc5],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-1691^b1a35b91-8b31-11ed-a7c5-62d1175edcc5,DevicePath:,},},Config:nil,},}
Jan  3 06:47:20.586: INFO: 
Logging kubelet events for node i-0f6d4ea509bfe3fbe
Jan  3 06:47:20.822: INFO: 
Logging pods the kubelet thinks is on node i-0f6d4ea509bfe3fbe
Jan  3 06:47:21.067: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-7s22g started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:21.067: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:21.067: INFO: csi-hostpathplugin-0 started at 2023-01-03 06:41:05 +0000 UTC (0+7 container statuses recorded)
Jan  3 06:47:21.067: INFO: 	Container csi-attacher ready: true, restart count 0
Jan  3 06:47:21.067: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  3 06:47:21.067: INFO: 	Container csi-resizer ready: true, restart count 0
Jan  3 06:47:21.067: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan  3 06:47:21.067: INFO: 	Container hostpath ready: true, restart count 0
Jan  3 06:47:21.067: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:47:21.067: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:47:21.067: INFO: simpletest.rc-xz8wx started at 2023-01-03 06:47:12 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:21.067: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:47:21.067: INFO: ebs-csi-node-78dfk started at 2023-01-03 06:26:09 +0000 UTC (0+3 container statuses recorded)
Jan  3 06:47:21.067: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  3 06:47:21.067: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:47:21.067: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:47:21.067: INFO: cilium-cd88p started at 2023-01-03 06:26:09 +0000 UTC (1+1 container statuses recorded)
Jan  3 06:47:21.067: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  3 06:47:21.067: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  3 06:47:21.067: INFO: affinity-nodeport-g4r5h started at 2023-01-03 06:41:28 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:21.067: INFO: 	Container affinity-nodeport ready: false, restart count 0
Jan  3 06:47:21.067: INFO: simpletest.rc-spmmc started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:21.067: INFO: simpletest.rc-7sbfv started at 2023-01-03 06:47:12 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:21.067: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:47:21.067: INFO: simpletest.rc-4z57v started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:21.067: INFO: simpletest.rc-l9cwv started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:21.067: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-txkql started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:21.067: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:21.067: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-7cwlm started at 2023-01-03 06:40:04 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:21.067: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:21.067: INFO: simpletest.rc-b4cgp started at 2023-01-03 06:47:12 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:21.067: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:47:21.067: INFO: simpletest.rc-dz55h started at 2023-01-03 06:47:12 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:21.067: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:47:21.067: INFO: simpletest.rc-gmwpn started at 2023-01-03 06:47:12 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:21.067: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:47:21.067: INFO: simpletest.rc-pzqj8 started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:21.067: INFO: coredns-559769c974-ls78k started at 2023-01-03 06:26:47 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:21.067: INFO: 	Container coredns ready: true, restart count 0
Jan  3 06:47:21.067: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-vgzx4 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:21.067: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:21.067: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-64hvj started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:21.067: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:21.067: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-mqf8m started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:21.067: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:21.067: INFO: simpletest.rc-q2bxt started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:21.067: INFO: inline-volume-tester-9wfs9 started at 2023-01-03 06:41:47 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:21.067: INFO: 	Container csi-volume-tester ready: false, restart count 0
Jan  3 06:47:21.067: INFO: pod-33511478-1f92-45f0-a4ad-dfec83a925bb started at 2023-01-03 06:44:42 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:21.067: INFO: 	Container write-pod ready: false, restart count 0
Jan  3 06:47:21.067: INFO: simpletest.rc-qgbkv started at 2023-01-03 06:47:12 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:21.067: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:47:21.067: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-mdkxh started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:21.067: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:21.067: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-26j4z started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:21.067: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:21.067: INFO: simpletest.rc-tx6hj started at 2023-01-03 06:47:14 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:21.067: INFO: 	Container nginx ready: false, restart count 0
Jan  3 06:47:21.067: INFO: simpletest.rc-9n86h started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:21.067: INFO: simpletest.rc-mmhjd started at <nil> (0+0 container statuses recorded)
Jan  3 06:47:21.067: INFO: hostexec-i-0f6d4ea509bfe3fbe-x62kt started at 2023-01-03 06:44:36 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:21.067: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  3 06:47:21.067: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-bv5tk started at 2023-01-03 06:40:04 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:21.067: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:21.067: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-9hzqt started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:47:21.067: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:47:21.938: INFO: 
Latency metrics for node i-0f6d4ea509bfe3fbe
[DeferCleanup (Each)] [sig-node] Secrets
  tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "secrets-1394" for this suite. �[38;5;243m01/03/23 06:47:21.939�[0m

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-node] Security Context should support seccomp runtime/default [LinuxOnly] 5m14s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-node\]\sSecurity\sContext\sshould\ssupport\sseccomp\sruntime\/default\s\[LinuxOnly\]$'

test/e2e/framework/pod/output/output.go:237
k8s.io/kubernetes/test/e2e/framework/pod/output.TestContainerOutputMatcher(0xc001470000?, {0x7616a7e?, 0x18?}, 0xc0022b3b00, 0x0, {0xc00436df58, 0x1, 0x1}, 0xc0004fb090?)
	test/e2e/framework/pod/output/output.go:237 +0x176
k8s.io/kubernetes/test/e2e/framework/pod/output.TestContainerOutput(...)
	test/e2e/framework/pod/output/output.go:214
k8s.io/kubernetes/test/e2e/node.glob..func13.12()
	test/e2e/node/security_context.go:214 +0x1bf
				[BeforeEach] [sig-node] Security Context
  set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/03/23 06:40:02.298�[0m
Jan  3 06:40:02.298: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename security-context �[38;5;243m01/03/23 06:40:02.3�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/03/23 06:40:03.008�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/03/23 06:40:03.488�[0m
[BeforeEach] [sig-node] Security Context
  test/e2e/framework/metrics/init/init.go:31
[It] should support seccomp runtime/default [LinuxOnly]
  test/e2e/node/security_context.go:210
�[1mSTEP:�[0m Creating a pod to test seccomp runtime/default �[38;5;243m01/03/23 06:40:03.952�[0m
Jan  3 06:40:04.187: INFO: Waiting up to 5m0s for pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2" in namespace "security-context-9468" to be "Succeeded or Failed"
Jan  3 06:40:04.419: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 231.504504ms
Jan  3 06:40:06.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 2.464464711s
Jan  3 06:40:08.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 4.464933905s
Jan  3 06:40:10.651: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 6.463795876s
Jan  3 06:40:12.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 8.464379941s
Jan  3 06:40:14.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 10.464551139s
Jan  3 06:40:16.651: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 12.463305748s
Jan  3 06:40:18.656: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 14.468388491s
Jan  3 06:40:20.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 16.464407175s
Jan  3 06:40:22.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 18.465014249s
Jan  3 06:40:24.661: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 20.473284544s
Jan  3 06:40:26.651: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 22.463446836s
Jan  3 06:40:28.651: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 24.463326266s
Jan  3 06:40:30.650: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 26.463011117s
Jan  3 06:40:32.651: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 28.463545668s
Jan  3 06:40:34.651: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 30.463683283s
Jan  3 06:40:36.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 32.464411033s
Jan  3 06:40:38.651: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 34.464101111s
Jan  3 06:40:40.651: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 36.463410183s
Jan  3 06:40:42.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 38.46441836s
Jan  3 06:40:44.651: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 40.463780655s
Jan  3 06:40:46.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 42.46453785s
Jan  3 06:40:48.651: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 44.463590483s
Jan  3 06:40:50.651: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 46.463579934s
Jan  3 06:40:52.651: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 48.463491515s
Jan  3 06:40:54.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 50.464789542s
Jan  3 06:40:56.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 52.464486658s
Jan  3 06:40:58.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 54.46511695s
Jan  3 06:41:00.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 56.464425958s
Jan  3 06:41:02.653: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 58.46538814s
Jan  3 06:41:04.651: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.464144348s
Jan  3 06:41:06.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.465099471s
Jan  3 06:41:08.653: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.465594138s
Jan  3 06:41:10.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.464438146s
Jan  3 06:41:12.651: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.464179649s
Jan  3 06:41:14.651: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.463932241s
Jan  3 06:41:16.651: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.463521959s
Jan  3 06:41:18.651: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.463513751s
Jan  3 06:41:20.650: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.46322044s
Jan  3 06:41:22.651: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.463395081s
Jan  3 06:41:24.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.464403535s
Jan  3 06:41:26.651: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.46351992s
Jan  3 06:41:28.651: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.463473832s
Jan  3 06:41:30.651: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.46326322s
Jan  3 06:41:32.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.464435555s
Jan  3 06:41:34.651: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.463499632s
Jan  3 06:41:36.651: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.464025537s
Jan  3 06:41:38.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.46509779s
Jan  3 06:41:40.651: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.463439337s
Jan  3 06:41:42.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.464623088s
Jan  3 06:41:44.651: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.463642419s
Jan  3 06:41:46.653: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.465361575s
Jan  3 06:41:48.651: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.463970637s
Jan  3 06:41:50.651: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.463893773s
Jan  3 06:41:52.651: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.464250723s
Jan  3 06:41:54.651: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.463829905s
Jan  3 06:41:56.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.464580772s
Jan  3 06:41:58.657: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.470125385s
Jan  3 06:42:00.651: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.46351837s
Jan  3 06:42:02.651: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.4639579s
Jan  3 06:42:04.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.464475114s
Jan  3 06:42:06.651: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.463743445s
Jan  3 06:42:08.651: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.463454434s
Jan  3 06:42:10.651: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.464108549s
Jan  3 06:42:12.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.464873875s
Jan  3 06:42:14.651: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.463790886s
Jan  3 06:42:16.651: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.464073992s
Jan  3 06:42:18.651: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.463510354s
Jan  3 06:42:20.651: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.463919326s
Jan  3 06:42:22.651: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.463927252s
Jan  3 06:42:24.653: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.466182699s
Jan  3 06:42:26.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.465144053s
Jan  3 06:42:28.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.464554948s
Jan  3 06:42:30.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.464570476s
Jan  3 06:42:32.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.464567122s
Jan  3 06:42:34.651: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.464194138s
Jan  3 06:42:36.651: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.4640496s
Jan  3 06:42:38.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.464960552s
Jan  3 06:42:40.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.464955123s
Jan  3 06:42:42.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.464734209s
Jan  3 06:42:44.651: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.463941471s
Jan  3 06:42:46.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.464553575s
Jan  3 06:42:48.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.464987398s
Jan  3 06:42:50.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.464544939s
Jan  3 06:42:52.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.46499188s
Jan  3 06:42:54.651: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.463878527s
Jan  3 06:42:56.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.464529575s
Jan  3 06:42:58.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.464683942s
Jan  3 06:43:00.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.464577187s
Jan  3 06:43:02.651: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.463760454s
Jan  3 06:43:04.651: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.46417375s
Jan  3 06:43:06.651: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.463681901s
Jan  3 06:43:08.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.464538198s
Jan  3 06:43:10.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.464484629s
Jan  3 06:43:12.651: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.463788421s
Jan  3 06:43:14.651: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.463782631s
Jan  3 06:43:16.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.464638545s
Jan  3 06:43:18.651: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.464101401s
Jan  3 06:43:20.653: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.465281995s
Jan  3 06:43:22.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.464894005s
Jan  3 06:43:24.655: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.467510304s
Jan  3 06:43:26.653: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.466081546s
Jan  3 06:43:28.651: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.463871787s
Jan  3 06:43:30.651: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.463553955s
Jan  3 06:43:32.654: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.466761253s
Jan  3 06:43:34.654: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.466518342s
Jan  3 06:43:36.651: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.463903766s
Jan  3 06:43:38.654: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.466538969s
Jan  3 06:43:40.656: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.468702188s
Jan  3 06:43:42.655: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.467609366s
Jan  3 06:43:44.653: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.465340294s
Jan  3 06:43:46.653: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.465789969s
Jan  3 06:43:48.656: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.468883634s
Jan  3 06:43:50.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.464669735s
Jan  3 06:43:52.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.464999532s
Jan  3 06:43:54.657: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.470079111s
Jan  3 06:43:56.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.464555565s
Jan  3 06:43:58.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.465154625s
Jan  3 06:44:00.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.46428177s
Jan  3 06:44:02.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.464873666s
Jan  3 06:44:04.653: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.465429908s
Jan  3 06:44:06.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.465009887s
Jan  3 06:44:08.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.464517994s
Jan  3 06:44:10.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.464851734s
Jan  3 06:44:12.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.464262975s
Jan  3 06:44:14.653: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.466061173s
Jan  3 06:44:16.653: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.465288221s
Jan  3 06:44:18.654: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.467134008s
Jan  3 06:44:20.654: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.466612585s
Jan  3 06:44:22.654: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.46671941s
Jan  3 06:44:24.653: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.465276032s
Jan  3 06:44:26.655: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.467948664s
Jan  3 06:44:28.666: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.478420105s
Jan  3 06:44:30.653: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.465889828s
Jan  3 06:44:32.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.46459544s
Jan  3 06:44:34.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.464818121s
Jan  3 06:44:36.653: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.465428001s
Jan  3 06:44:38.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.46465338s
Jan  3 06:44:40.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.464454873s
Jan  3 06:44:42.653: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.465444676s
Jan  3 06:44:44.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.464920977s
Jan  3 06:44:46.655: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.46813405s
Jan  3 06:44:48.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.464741354s
Jan  3 06:44:50.662: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.474446162s
Jan  3 06:44:52.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.464326477s
Jan  3 06:44:54.657: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.469720549s
Jan  3 06:44:56.652: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.464609345s
Jan  3 06:44:58.651: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.463729009s
Jan  3 06:45:00.653: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.466180486s
Jan  3 06:45:02.654: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.467055083s
Jan  3 06:45:04.653: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.466237815s
Jan  3 06:45:04.886: INFO: Pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.699021684s
Jan  3 06:45:05.353: INFO: Failed to get logs from node "i-0c4c153cc3021d728" pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2" container "test-container": the server rejected our request for an unknown reason (get pods security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2)
�[1mSTEP:�[0m delete the pod �[38;5;243m01/03/23 06:45:05.353�[0m
Jan  3 06:45:05.590: INFO: Waiting for pod security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2 to disappear
Jan  3 06:45:05.823: INFO: Pod security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2 still exists
Jan  3 06:45:07.823: INFO: Waiting for pod security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2 to disappear
Jan  3 06:45:08.057: INFO: Pod security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2 no longer exists
Jan  3 06:45:08.057: INFO: Unexpected error: 
    <*errors.errorString | 0xc0030637c0>: {
        s: "expected pod \"security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2\" success: timed out while waiting for pod security-context-9468/security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2 to be Succeeded or Failed",
    }
Jan  3 06:45:08.057: FAIL: expected pod "security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2" success: timed out while waiting for pod security-context-9468/security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2 to be Succeeded or Failed

Full Stack Trace
k8s.io/kubernetes/test/e2e/framework/pod/output.TestContainerOutputMatcher(0xc001470000?, {0x7616a7e?, 0x18?}, 0xc0022b3b00, 0x0, {0xc00436df58, 0x1, 0x1}, 0xc0004fb090?)
	test/e2e/framework/pod/output/output.go:237 +0x176
k8s.io/kubernetes/test/e2e/framework/pod/output.TestContainerOutput(...)
	test/e2e/framework/pod/output/output.go:214
k8s.io/kubernetes/test/e2e/node.glob..func13.12()
	test/e2e/node/security_context.go:214 +0x1bf
[AfterEach] [sig-node] Security Context
  test/e2e/framework/node/init/init.go:32
Jan  3 06:45:08.057: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-node] Security Context
  test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-node] Security Context
  dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/03/23 06:45:08.291�[0m
�[1mSTEP:�[0m Collecting events from namespace "security-context-9468". �[38;5;243m01/03/23 06:45:08.291�[0m
�[1mSTEP:�[0m Found 11 events. �[38;5;243m01/03/23 06:45:08.526�[0m
Jan  3 06:45:08.526: INFO: At 2023-01-03 06:40:04 +0000 UTC - event for security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2: {default-scheduler } Scheduled: Successfully assigned security-context-9468/security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2 to i-0c4c153cc3021d728
Jan  3 06:45:08.526: INFO: At 2023-01-03 06:40:06 +0000 UTC - event for security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2: {kubelet i-0c4c153cc3021d728} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ced8c3ef6b0d97d2bb6655c646ee85d506bfd567a08ac43ba047f8f6f7d4e5d6": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:45:08.526: INFO: At 2023-01-03 06:40:17 +0000 UTC - event for security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2: {kubelet i-0c4c153cc3021d728} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d838dacbf2ac591c168963fae05ffca61b055122f8f29312ef15040b3fa6abcb": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:45:08.526: INFO: At 2023-01-03 06:40:32 +0000 UTC - event for security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2: {kubelet i-0c4c153cc3021d728} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "205ea2a3ba2fef442057717c12fedaaf48d05fb6b237848cdc2aa77fe17b83b7": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:45:08.526: INFO: At 2023-01-03 06:40:43 +0000 UTC - event for security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2: {kubelet i-0c4c153cc3021d728} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "430d774d43e2e3173f067c24092f18ead308e883f91bc14f5f7f9ad1038a9069": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:45:08.526: INFO: At 2023-01-03 06:40:54 +0000 UTC - event for security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2: {kubelet i-0c4c153cc3021d728} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "18cd023f42a2826ac5ff4c8f013b09db5c5daddb6b025949a181f98c6cee9bb9": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:45:08.526: INFO: At 2023-01-03 06:41:09 +0000 UTC - event for security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2: {kubelet i-0c4c153cc3021d728} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "4261e3190b1f5779ed51e8e92e4fec295b111a13bcd33786a96d312eaec057a2": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:45:08.526: INFO: At 2023-01-03 06:41:23 +0000 UTC - event for security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2: {kubelet i-0c4c153cc3021d728} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "4a6698b7d379676a281497dcfc2cf76a262b48e6fe94db3ad942235f51d59809": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:45:08.526: INFO: At 2023-01-03 06:41:35 +0000 UTC - event for security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2: {kubelet i-0c4c153cc3021d728} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "85cd094a0ce1bf70dc4182b5b25a224cce0e54a0a48aa8b19db2d1ab410f524a": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:45:08.526: INFO: At 2023-01-03 06:41:47 +0000 UTC - event for security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2: {kubelet i-0c4c153cc3021d728} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "6253c232844ae6587c291085de3f15e976eb58bd893c63e33edf3b9eaae05d4e": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:45:08.526: INFO: At 2023-01-03 06:42:01 +0000 UTC - event for security-context-c9a1eb4c-7e00-49b4-9cfc-775197caa0b2: {kubelet i-0c4c153cc3021d728} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "8cc8d45b63d8c59b0ed47979e95925972ce6efe1d31dd7aefb57091efb306efd": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  3 06:45:08.758: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Jan  3 06:45:08.758: INFO: 
Jan  3 06:45:09.017: INFO: 
Logging node info for node i-0116ec5cfa0915363
Jan  3 06:45:09.250: INFO: Node Info: &Node{ObjectMeta:{i-0116ec5cfa0915363    845a5e73-b93d-4679-a025-6403fe91469b 27782 0 2023-01-03 06:24:27 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0116ec5cfa0915363 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:ap-south-1a topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.51.97 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0116ec5cfa0915363"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-03 06:24:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-03 06:24:54 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:25:11 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-03 06:25:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-03 06:25:13 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-03 06:42:20 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0116ec5cfa0915363,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892301824 0} {<nil>} 3801076Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787444224 0} {<nil>} 3698676Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-03 06:42:20 +0000 UTC,LastTransitionTime:2023-01-03 06:24:21 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-03 06:42:20 +0000 UTC,LastTransitionTime:2023-01-03 06:24:21 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-03 06:42:20 +0000 UTC,LastTransitionTime:2023-01-03 06:24:21 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-03 06:42:20 +0000 UTC,LastTransitionTime:2023-01-03 06:25:11 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.51.97,},NodeAddress{Type:ExternalIP,Address:35.154.4.55,},NodeAddress{Type:InternalDNS,Address:i-0116ec5cfa0915363.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0116ec5cfa0915363.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-154-4-55.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec291a4b21ade93e02dbfdea9af30b8c,SystemUUID:ec291a4b-21ad-e93e-02db-fdea9af30b8c,BootID:3cd177e4-da3b-4287-b5dc-70d163e7dd13,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.0],SizeBytes:135162323,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.0],SizeBytes:124991801,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.0],SizeBytes:57657656,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43446388,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42805548,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4967304,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan  3 06:45:09.250: INFO: 
Logging kubelet events for node i-0116ec5cfa0915363
Jan  3 06:45:09.485: INFO: 
Logging pods the kubelet thinks is on node i-0116ec5cfa0915363
Jan  3 06:45:09.725: INFO: kops-controller-9t2zt started at 2023-01-03 06:24:59 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:45:09.725: INFO: 	Container kops-controller ready: true, restart count 0
Jan  3 06:45:09.725: INFO: cilium-npb6w started at 2023-01-03 06:24:59 +0000 UTC (1+1 container statuses recorded)
Jan  3 06:45:09.725: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  3 06:45:09.725: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  3 06:45:09.725: INFO: aws-cloud-controller-manager-mvsjr started at 2023-01-03 06:24:59 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:45:09.725: INFO: 	Container aws-cloud-controller-manager ready: true, restart count 0
Jan  3 06:45:09.725: INFO: ebs-csi-node-pg7l9 started at 2023-01-03 06:24:59 +0000 UTC (0+3 container statuses recorded)
Jan  3 06:45:09.725: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  3 06:45:09.725: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:45:09.725: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:45:09.725: INFO: etcd-manager-events-i-0116ec5cfa0915363 started at 2023-01-03 06:23:51 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:45:09.725: INFO: 	Container etcd-manager ready: true, restart count 0
Jan  3 06:45:09.725: INFO: kube-apiserver-i-0116ec5cfa0915363 started at 2023-01-03 06:23:51 +0000 UTC (0+2 container statuses recorded)
Jan  3 06:45:09.725: INFO: 	Container healthcheck ready: true, restart count 0
Jan  3 06:45:09.725: INFO: 	Container kube-apiserver ready: true, restart count 1
Jan  3 06:45:09.725: INFO: kube-controller-manager-i-0116ec5cfa0915363 started at 2023-01-03 06:23:51 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:45:09.725: INFO: 	Container kube-controller-manager ready: true, restart count 2
Jan  3 06:45:09.725: INFO: kube-scheduler-i-0116ec5cfa0915363 started at 2023-01-03 06:23:51 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:45:09.725: INFO: 	Container kube-scheduler ready: true, restart count 0
Jan  3 06:45:09.725: INFO: dns-controller-69987775c6-rgd5s started at 2023-01-03 06:25:00 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:45:09.725: INFO: 	Container dns-controller ready: true, restart count 0
Jan  3 06:45:09.725: INFO: etcd-manager-main-i-0116ec5cfa0915363 started at 2023-01-03 06:23:51 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:45:09.725: INFO: 	Container etcd-manager ready: true, restart count 0
Jan  3 06:45:09.725: INFO: cilium-operator-5dd44dc49f-nzbgs started at 2023-01-03 06:25:00 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:45:09.725: INFO: 	Container cilium-operator ready: true, restart count 0
Jan  3 06:45:09.725: INFO: ebs-csi-controller-89b649c94-4zgt2 started at 2023-01-03 06:25:00 +0000 UTC (0+5 container statuses recorded)
Jan  3 06:45:09.725: INFO: 	Container csi-attacher ready: true, restart count 0
Jan  3 06:45:09.725: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  3 06:45:09.725: INFO: 	Container csi-resizer ready: true, restart count 0
Jan  3 06:45:09.725: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  3 06:45:09.725: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:45:10.519: INFO: 
Latency metrics for node i-0116ec5cfa0915363
Jan  3 06:45:10.519: INFO: 
Logging node info for node i-06675ed9fdf15131e
Jan  3 06:45:10.751: INFO: Node Info: &Node{ObjectMeta:{i-06675ed9fdf15131e    6a365a73-a0a0-47e1-83ac-1dd53dc6cb56 28532 0 2023-01-03 06:26:03 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-06675ed9fdf15131e kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-06675ed9fdf15131e topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.34.128 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-7802":"i-06675ed9fdf15131e","csi-mock-csi-mock-volumes-5893":"i-06675ed9fdf15131e","ebs.csi.aws.com":"i-06675ed9fdf15131e"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-03 06:26:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-03 06:26:03 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-03 06:26:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-03 06:26:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:26:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {e2e.test Update v1 2023-01-03 06:40:01 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:40:12 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-03 06:43:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-06675ed9fdf15131e,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-03 06:40:19 +0000 UTC,LastTransitionTime:2023-01-03 06:26:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-03 06:40:19 +0000 UTC,LastTransitionTime:2023-01-03 06:26:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-03 06:40:19 +0000 UTC,LastTransitionTime:2023-01-03 06:26:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-03 06:40:19 +0000 UTC,LastTransitionTime:2023-01-03 06:26:18 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.34.128,},NodeAddress{Type:ExternalIP,Address:13.233.53.249,},NodeAddress{Type:InternalDNS,Address:i-06675ed9fdf15131e.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-06675ed9fdf15131e.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-233-53-249.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec278d28e0e8aa5f9f5a88afed4c7357,SystemUUID:ec278d28-e0e8-aa5f-9f5a-88afed4c7357,BootID:60717d56-76f8-4838-8bb7-4a4ce6867c70,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-7802^78eb4252-8b31-11ed-a7cd-e699b846bc6a],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-7802^78eb4252-8b31-11ed-a7cd-e699b846bc6a,DevicePath:,},},Config:nil,},}
Jan  3 06:45:10.752: INFO: 
Logging kubelet events for node i-06675ed9fdf15131e
Jan  3 06:45:10.986: INFO: 
Logging pods the kubelet thinks is on node i-06675ed9fdf15131e
Jan  3 06:45:11.233: INFO: coredns-559769c974-xh6r4 started at 2023-01-03 06:26:18 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:45:11.233: INFO: 	Container coredns ready: true, restart count 0
Jan  3 06:45:11.233: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-gcftr started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:45:11.233: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:45:11.233: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-knmjr started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:45:11.233: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: false, restart count 0
Jan  3 06:45:11.233: INFO: pvc-volume-tester-tnqg4 started at 2023-01-03 06:43:36 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:45:11.233: INFO: 	Container volume-tester ready: false, restart count 0
Jan  3 06:45:11.233: INFO: inline-volume-tester-578zd started at 2023-01-03 06:43:56 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:45:11.233: INFO: 	Container csi-volume-tester ready: false, restart count 0
Jan  3 06:45:11.233: INFO: csi-hostpathplugin-0 started at 2023-01-03 06:39:40 +0000 UTC (0+7 container statuses recorded)
Jan  3 06:45:11.233: INFO: 	Container csi-attacher ready: true, restart count 0
Jan  3 06:45:11.234: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  3 06:45:11.234: INFO: 	Container csi-resizer ready: true, restart count 0
Jan  3 06:45:11.234: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan  3 06:45:11.234: INFO: 	Container hostpath ready: true, restart count 0
Jan  3 06:45:11.234: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:45:11.234: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:45:11.234: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-vmn8b started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:45:11.234: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:45:11.234: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-gzk6r started at 2023-01-03 06:40:04 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:45:11.234: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: false, restart count 0
Jan  3 06:45:11.234: INFO: inline-volume-tester-7frp2 started at 2023-01-03 06:42:47 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:45:11.234: INFO: 	Container csi-volume-tester ready: false, restart count 0
Jan  3 06:45:11.234: INFO: cilium-88fm4 started at 2023-01-03 06:26:04 +0000 UTC (1+1 container statuses recorded)
Jan  3 06:45:11.234: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  3 06:45:11.234: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  3 06:45:11.234: INFO: hostpath-client started at 2023-01-03 06:40:11 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:45:11.234: INFO: 	Container hostpath-client ready: false, restart count 0
Jan  3 06:45:11.234: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-pn6rb started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:45:11.234: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:45:11.234: INFO: coredns-autoscaler-7cb5c5b969-tg22d started at 2023-01-03 06:26:18 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:45:11.234: INFO: 	Container autoscaler ready: true, restart count 0
Jan  3 06:45:11.234: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-bhflv started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:45:11.234: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:45:11.234: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-qbds6 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:45:11.234: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:45:11.234: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-5qt2b started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:45:11.234: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:45:11.234: INFO: csi-hostpathplugin-0 started at 2023-01-03 06:42:46 +0000 UTC (0+7 container statuses recorded)
Jan  3 06:45:11.234: INFO: 	Container csi-attacher ready: false, restart count 0
Jan  3 06:45:11.234: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan  3 06:45:11.234: INFO: 	Container csi-resizer ready: false, restart count 0
Jan  3 06:45:11.234: INFO: 	Container csi-snapshotter ready: false, restart count 0
Jan  3 06:45:11.234: INFO: 	Container hostpath ready: false, restart count 0
Jan  3 06:45:11.234: INFO: 	Container liveness-probe ready: false, restart count 0
Jan  3 06:45:11.234: INFO: 	Container node-driver-registrar ready: false, restart count 0
Jan  3 06:45:11.234: INFO: hostexec-i-06675ed9fdf15131e-t9flq started at 2023-01-03 06:39:55 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:45:11.234: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  3 06:45:11.234: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-kn247 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:45:11.234: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:45:11.234: INFO: csi-hostpathplugin-0 started at 2023-01-03 06:43:56 +0000 UTC (0+7 container statuses recorded)
Jan  3 06:45:11.234: INFO: 	Container csi-attacher ready: false, restart count 0
Jan  3 06:45:11.234: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan  3 06:45:11.234: INFO: 	Container csi-resizer ready: false, restart count 0
Jan  3 06:45:11.234: INFO: 	Container csi-snapshotter ready: false, restart count 0
Jan  3 06:45:11.234: INFO: 	Container hostpath ready: false, restart count 0
Jan  3 06:45:11.234: INFO: 	Container liveness-probe ready: false, restart count 0
Jan  3 06:45:11.234: INFO: 	Container node-driver-registrar ready: false, restart count 0
Jan  3 06:45:11.234: INFO: ebs-csi-node-q24xb started at 2023-01-03 06:26:04 +0000 UTC (0+3 container statuses recorded)
Jan  3 06:45:11.234: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  3 06:45:11.234: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:45:11.234: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:45:11.234: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-vkxkf started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:45:11.234: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:45:11.234: INFO: pod-subpath-test-preprovisionedpv-9bhp started at 2023-01-03 06:40:17 +0000 UTC (2+1 container statuses recorded)
Jan  3 06:45:11.234: INFO: 	Init container init-volume-preprovisionedpv-9bhp ready: false, restart count 0
Jan  3 06:45:11.234: INFO: 	Init container test-init-volume-preprovisionedpv-9bhp ready: false, restart count 0
Jan  3 06:45:11.234: INFO: 	Container test-container-subpath-preprovisionedpv-9bhp ready: false, restart count 0
Jan  3 06:45:11.234: INFO: csi-mockplugin-0 started at 2023-01-03 06:42:50 +0000 UTC (0+3 container statuses recorded)
Jan  3 06:45:11.234: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  3 06:45:11.234: INFO: 	Container driver-registrar ready: true, restart count 0
Jan  3 06:45:11.234: INFO: 	Container mock ready: true, restart count 0
Jan  3 06:45:11.234: INFO: csi-mockplugin-resizer-0 started at 2023-01-03 06:42:51 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:45:11.234: INFO: 	Container csi-resizer ready: false, restart count 0
Jan  3 06:45:12.065: INFO: 
Latency metrics for node i-06675ed9fdf15131e
Jan  3 06:45:12.065: INFO: 
Logging node info for node i-0887927f295dab249
Jan  3 06:45:12.298: INFO: Node Info: &Node{ObjectMeta:{i-0887927f295dab249    8c537f9f-6ce2-4eae-a273-3e5dec0f5a97 29281 0 2023-01-03 06:26:08 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0887927f295dab249 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-0887927f295dab249 topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.43.47 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-7494":"i-0887927f295dab249","ebs.csi.aws.com":"i-0887927f295dab249"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-03 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-03 06:40:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-03 06:45:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-01-03 06:45:11 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0887927f295dab249,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-03 06:44:22 +0000 UTC,LastTransitionTime:2023-01-03 06:26:08 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-03 06:44:22 +0000 UTC,LastTransitionTime:2023-01-03 06:26:08 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-03 06:44:22 +0000 UTC,LastTransitionTime:2023-01-03 06:26:08 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-03 06:44:22 +0000 UTC,LastTransitionTime:2023-01-03 06:26:24 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.43.47,},NodeAddress{Type:ExternalIP,Address:65.0.96.201,},NodeAddress{Type:InternalDNS,Address:i-0887927f295dab249.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0887927f295dab249.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-65-0-96-201.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2d5f1c251f05fc398417508c564588,SystemUUID:ec2d5f1c-251f-05fc-3984-17508c564588,BootID:80a76b6c-5e81-478d-a15c-92ab635eebdb,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0747fe00dd5d5923d],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-7494^2a9b5c2b-8b32-11ed-9a17-02cea9609c51,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-7494^2a9f4d2c-8b32-11ed-9a17-02cea9609c51,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0747fe00dd5d5923d,DevicePath:,},},Config:nil,},}
Jan  3 06:45:12.301: INFO: 
Logging kubelet events for node i-0887927f295dab249
Jan  3 06:45:12.535: INFO: 
Logging pods the kubelet thinks is on node i-0887927f295dab249
Jan  3 06:45:12.782: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-87btk started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:45:12.782: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:45:12.782: INFO: test-deployment-swhng-54bc444df-8rmgv started at 2023-01-03 06:44:38 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:45:12.782: INFO: 	Container httpd ready: false, restart count 0
Jan  3 06:45:12.782: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-47hz9 started at 2023-01-03 06:40:04 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:45:12.782: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:45:12.782: INFO: pod-9d10df65-59e8-4966-a058-376431a1bbfe started at 2023-01-03 06:43:23 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:45:12.782: INFO: 	Container write-pod ready: false, restart count 0
Jan  3 06:45:12.782: INFO: csi-hostpathplugin-0 started at 2023-01-03 06:43:44 +0000 UTC (0+7 container statuses recorded)
Jan  3 06:45:12.782: INFO: 	Container csi-attacher ready: true, restart count 0
Jan  3 06:45:12.782: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  3 06:45:12.782: INFO: 	Container csi-resizer ready: true, restart count 0
Jan  3 06:45:12.782: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan  3 06:45:12.782: INFO: 	Container hostpath ready: true, restart count 0
Jan  3 06:45:12.782: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:45:12.782: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:45:12.782: INFO: test-pod-8f8b0f25-9283-406c-a37f-7b953461815d started at 2023-01-03 06:42:39 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:45:12.782: INFO: 	Container agnhost-container ready: false, restart count 0
Jan  3 06:45:12.782: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-5tzj6 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:45:12.782: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:45:12.782: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-5sjfb started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:45:12.782: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:45:12.782: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-qs9vk started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:45:12.782: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:45:12.782: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-nzbt8 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:45:12.782: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:45:12.782: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-kmgz2 started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:45:12.782: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:45:12.782: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-z8hhz started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:45:12.782: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:45:12.782: INFO: ebs-csi-node-22htr started at 2023-01-03 06:26:09 +0000 UTC (0+3 container statuses recorded)
Jan  3 06:45:12.782: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  3 06:45:12.782: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  3 06:45:12.782: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  3 06:45:12.782: INFO: inline-volume-tester-qwfhg started at 2023-01-03 06:45:10 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:45:12.782: INFO: 	Container csi-volume-tester ready: false, restart count 0
Jan  3 06:45:12.782: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-m9n4g started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:45:12.782: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:45:12.782: INFO: cilium-s9l8s started at 2023-01-03 06:26:09 +0000 UTC (1+1 container statuses recorded)
Jan  3 06:45:12.782: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  3 06:45:12.782: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  3 06:45:12.782: INFO: startup-33131899-1a42-412a-9a76-c7ee101e12d3 started at 2023-01-03 06:44:39 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:45:12.782: INFO: 	Container busybox ready: false, restart count 0
Jan  3 06:45:12.782: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-dbt7p started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:45:12.782: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: true, restart count 0
Jan  3 06:45:12.782: INFO: affinity-nodeport-fh67z started at 2023-01-03 06:41:28 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:45:12.782: INFO: 	Container affinity-nodeport ready: true, restart count 0
Jan  3 06:45:12.782: INFO: pod-configmaps-3c06e399-bdc5-4edf-916c-a1c9f0a24fd7 started at 2023-01-03 06:42:10 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:45:12.782: INFO: 	Container env-test ready: false, restart count 0
Jan  3 06:45:13.714: INFO: 
Latency metrics for node i-0887927f295dab249
Jan  3 06:45:13.714: INFO: 
Logging node info for node i-0c4c153cc3021d728
Jan  3 06:45:13.946: INFO: Node Info: &Node{ObjectMeta:{i-0c4c153cc3021d728    0fc330cf-9a4f-4650-8df2-bbc4962562bf 28133 0 2023-01-03 06:26:07 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a io.kubernetes.storage.mock/node:some-mock-node kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0c4c153cc3021d728 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-0c4c153cc3021d728 topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.34.232 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-volumemode-7427":"i-0c4c153cc3021d728","ebs.csi.aws.com":"i-0c4c153cc3021d728"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-03 06:26:07 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-03 06:26:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-03 06:26:07 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-03 06:26:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-03 06:26:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-03 06:40:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-03 06:42:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {kube-controller-manager Update v1 2023-01-03 06:42:44 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0c4c153cc3021d728,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-03 06:41:56 +0000 UTC,LastTransitionTime:2023-01-03 06:26:07 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-03 06:41:56 +0000 UTC,LastTransitionTime:2023-01-03 06:26:07 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-03 06:41:56 +0000 UTC,LastTransitionTime:2023-01-03 06:26:07 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-03 06:41:56 +0000 UTC,LastTransitionTime:2023-01-03 06:26:23 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.34.232,},NodeAddress{Type:ExternalIP,Address:13.232.119.101,},NodeAddress{Type:InternalDNS,Address:i-0c4c153cc3021d728.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0c4c153cc3021d728.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-232-119-101.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec20ee6ab34ca9da624dd2e5f8c44780,SystemUUID:ec20ee6a-b34c-a9da-624d-d2e5f8c44780,BootID:960d66c3-58ec-4ea0-a76c-db5eb00e743c,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-volumemode-7427^d2b0c49a-8b31-11ed-80c0-9a1c05d7c9e2,DevicePath:,},},Config:nil,},}
Jan  3 06:45:13.946: INFO: 
Logging kubelet events for node i-0c4c153cc3021d728
Jan  3 06:45:14.180: INFO: 
Logging pods the kubelet thinks is on node i-0c4c153cc3021d728
Jan  3 06:45:14.425: INFO: cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c-s8mtc started at 2023-01-03 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:45:14.425: INFO: 	Container cleanup40-c77b844c-d7b6-485d-9cb4-48db1fa5432c ready: false, restart count 0
Jan  3 06:45:14.425: INFO: hostexec-i-0c4c153cc3021d728-4dmdb started at 2023-01-03 06:45:07 +0000 UTC (0+1 container statuses recorded)
Jan  3 06:45:14.425: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  3 06:45:14.425: INFO: ebs-csi-node-5sgcl started at 2023-01-03 06:26:08 +0000 UTC (0+3 container statuses recorded)
Jan  3 06:45:14.425: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  3 06:45:14.425: INFO: 	Container livenes

Result	FAILURE
Tests	17 failed / 869 succeeded
Started	2023-01-03 06:20
Elapsed	45m44s
Revision	master