e2e-kops-grid-cilium-eni-u2004-k26 #1616681983033741312 Results

Test Failures

Kubernetes e2e suite [It] External Storage [Driver: ebs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed via chgrp in first pod, new pod with same fsgroup applied to the volume contents 10m52s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\sExternal\sStorage\s\[Driver\:\sebs\.csi\.aws\.com\]\s\[Testpattern\:\sDynamic\sPV\s\(default\sfs\)\]\sfsgroupchangepolicy\s\(Always\)\[LinuxOnly\]\,\spod\screated\swith\san\sinitial\sfsgroup\,\svolume\scontents\sownership\schanged\svia\schgrp\sin\sfirst\spod\,\snew\spod\swith\ssame\sfsgroup\sapplied\sto\sthe\svolume\scontents$'

test/e2e/storage/testsuites/fsgroupchangepolicy.go:258
k8s.io/kubernetes/test/e2e/storage/testsuites.createPodAndVerifyContentGid(0xc00174af00, 0xc00254fe10, 0x0, {0xc002e442b8, 0x4}, {0xc002e442bc, 0x4})
	test/e2e/storage/testsuites/fsgroupchangepolicy.go:258 +0x151
k8s.io/kubernetes/test/e2e/storage/testsuites.(*fsGroupChangePolicyTestSuite).DefineTests.func3()
	test/e2e/storage/testsuites/fsgroupchangepolicy.go:247 +0x556
				[BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/21/23 06:34:21.192�[0m
Jan 21 06:34:21.192: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename fsgroupchangepolicy �[38;5;243m01/21/23 06:34:21.193�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/21/23 06:34:21.543�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/21/23 06:34:21.783�[0m
[BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  test/e2e/framework/metrics/init/init.go:31
[It] (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed via chgrp in first pod, new pod with same fsgroup applied to the volume contents
  test/e2e/storage/testsuites/fsgroupchangepolicy.go:210
Jan 21 06:34:22.010: INFO: Creating resource for dynamic PV
Jan 21 06:34:22.010: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} 
�[1mSTEP:�[0m creating a StorageClass fsgroupchangepolicy-3963-e2e-scb9xlk �[38;5;243m01/21/23 06:34:22.011�[0m
�[1mSTEP:�[0m creating a claim �[38;5;243m01/21/23 06:34:22.126�[0m
Jan 21 06:34:22.126: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
�[1mSTEP:�[0m Creating Pod in namespace fsgroupchangepolicy-3963 with fsgroup 1000 �[38;5;243m01/21/23 06:34:22.357�[0m
Jan 21 06:34:22.474: INFO: Waiting up to 5m0s for pod "pod-df5987d1-d52e-4887-a27a-427e82ebcd78" in namespace "fsgroupchangepolicy-3963" to be "running"
Jan 21 06:34:22.588: INFO: Pod "pod-df5987d1-d52e-4887-a27a-427e82ebcd78": Phase="Pending", Reason="", readiness=false. Elapsed: 113.977315ms
Jan 21 06:34:24.703: INFO: Pod "pod-df5987d1-d52e-4887-a27a-427e82ebcd78": Phase="Pending", Reason="", readiness=false. Elapsed: 2.229318967s
Jan 21 06:34:26.703: INFO: Pod "pod-df5987d1-d52e-4887-a27a-427e82ebcd78": Phase="Pending", Reason="", readiness=false. Elapsed: 4.228896939s
Jan 21 06:34:28.703: INFO: Pod "pod-df5987d1-d52e-4887-a27a-427e82ebcd78": Phase="Pending", Reason="", readiness=false. Elapsed: 6.228923382s
Jan 21 06:34:30.703: INFO: Pod "pod-df5987d1-d52e-4887-a27a-427e82ebcd78": Phase="Pending", Reason="", readiness=false. Elapsed: 8.229653314s
Jan 21 06:34:32.703: INFO: Pod "pod-df5987d1-d52e-4887-a27a-427e82ebcd78": Phase="Pending", Reason="", readiness=false. Elapsed: 10.229511642s
Jan 21 06:34:34.702: INFO: Pod "pod-df5987d1-d52e-4887-a27a-427e82ebcd78": Phase="Pending", Reason="", readiness=false. Elapsed: 12.228746093s
Jan 21 06:34:36.703: INFO: Pod "pod-df5987d1-d52e-4887-a27a-427e82ebcd78": Phase="Pending", Reason="", readiness=false. Elapsed: 14.229583606s
Jan 21 06:34:38.702: INFO: Pod "pod-df5987d1-d52e-4887-a27a-427e82ebcd78": Phase="Pending", Reason="", readiness=false. Elapsed: 16.22817913s
Jan 21 06:34:40.703: INFO: Pod "pod-df5987d1-d52e-4887-a27a-427e82ebcd78": Phase="Pending", Reason="", readiness=false. Elapsed: 18.22919129s
Jan 21 06:34:42.703: INFO: Pod "pod-df5987d1-d52e-4887-a27a-427e82ebcd78": Phase="Pending", Reason="", readiness=false. Elapsed: 20.229125319s
Jan 21 06:34:44.704: INFO: Pod "pod-df5987d1-d52e-4887-a27a-427e82ebcd78": Phase="Pending", Reason="", readiness=false. Elapsed: 22.23055209s
Jan 21 06:34:46.703: INFO: Pod "pod-df5987d1-d52e-4887-a27a-427e82ebcd78": Phase="Pending", Reason="", readiness=false. Elapsed: 24.2291597s
Jan 21 06:34:48.704: INFO: Pod "pod-df5987d1-d52e-4887-a27a-427e82ebcd78": Phase="Pending", Reason="", readiness=false. Elapsed: 26.230459499s
Jan 21 06:34:50.703: INFO: Pod "pod-df5987d1-d52e-4887-a27a-427e82ebcd78": Phase="Pending", Reason="", readiness=false. Elapsed: 28.229012599s
Jan 21 06:34:52.702: INFO: Pod "pod-df5987d1-d52e-4887-a27a-427e82ebcd78": Phase="Pending", Reason="", readiness=false. Elapsed: 30.228779623s
Jan 21 06:34:54.703: INFO: Pod "pod-df5987d1-d52e-4887-a27a-427e82ebcd78": Phase="Pending", Reason="", readiness=false. Elapsed: 32.22936284s
Jan 21 06:34:56.703: INFO: Pod "pod-df5987d1-d52e-4887-a27a-427e82ebcd78": Phase="Running", Reason="", readiness=true. Elapsed: 34.229429492s
Jan 21 06:34:56.703: INFO: Pod "pod-df5987d1-d52e-4887-a27a-427e82ebcd78" satisfied condition "running"
Jan 21 06:34:56.817: INFO: Pod fsgroupchangepolicy-3963/pod-df5987d1-d52e-4887-a27a-427e82ebcd78 started successfully
�[1mSTEP:�[0m Creating a sub-directory and file, and verifying their ownership is 1000 �[38;5;243m01/21/23 06:34:56.817�[0m
Jan 21 06:34:56.817: INFO: ExecWithOptions {Command:[/bin/sh -c touch /mnt/volume1/file1] Namespace:fsgroupchangepolicy-3963 PodName:pod-df5987d1-d52e-4887-a27a-427e82ebcd78 ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false}
Jan 21 06:34:56.817: INFO: >>> kubeConfig: /root/.kube/config
Jan 21 06:34:56.818: INFO: ExecWithOptions: Clientset creation
Jan 21 06:34:56.818: INFO: ExecWithOptions: execute(POST https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io/api/v1/namespaces/fsgroupchangepolicy-3963/pods/pod-df5987d1-d52e-4887-a27a-427e82ebcd78/exec?command=%2Fbin%2Fsh&command=-c&command=touch+%2Fmnt%2Fvolume1%2Ffile1&container=write-pod&container=write-pod&stderr=true&stdout=true)
Jan 21 06:34:57.840: INFO: ExecWithOptions {Command:[/bin/sh -c ls -l /mnt/volume1/file1] Namespace:fsgroupchangepolicy-3963 PodName:pod-df5987d1-d52e-4887-a27a-427e82ebcd78 ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false}
Jan 21 06:34:57.840: INFO: >>> kubeConfig: /root/.kube/config
Jan 21 06:34:57.841: INFO: ExecWithOptions: Clientset creation
Jan 21 06:34:57.841: INFO: ExecWithOptions: execute(POST https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io/api/v1/namespaces/fsgroupchangepolicy-3963/pods/pod-df5987d1-d52e-4887-a27a-427e82ebcd78/exec?command=%2Fbin%2Fsh&command=-c&command=ls+-l+%2Fmnt%2Fvolume1%2Ffile1&container=write-pod&container=write-pod&stderr=true&stdout=true)
Jan 21 06:34:58.581: INFO: pod fsgroupchangepolicy-3963/pod-df5987d1-d52e-4887-a27a-427e82ebcd78 exec for cmd ls -l /mnt/volume1/file1, stdout: -rw-r--r--    1 root     1000             0 Jan 21 06:34 /mnt/volume1/file1, stderr: 
Jan 21 06:34:58.581: INFO: stdout split: [-rw-r--r-- 1 root 1000 0 Jan 21 06:34 /mnt/volume1/file1], expected gid: 1000
Jan 21 06:34:58.582: INFO: ExecWithOptions {Command:[/bin/sh -c mkdir /mnt/volume1/subdir] Namespace:fsgroupchangepolicy-3963 PodName:pod-df5987d1-d52e-4887-a27a-427e82ebcd78 ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false}
Jan 21 06:34:58.582: INFO: >>> kubeConfig: /root/.kube/config
Jan 21 06:34:58.582: INFO: ExecWithOptions: Clientset creation
Jan 21 06:34:58.582: INFO: ExecWithOptions: execute(POST https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io/api/v1/namespaces/fsgroupchangepolicy-3963/pods/pod-df5987d1-d52e-4887-a27a-427e82ebcd78/exec?command=%2Fbin%2Fsh&command=-c&command=mkdir+%2Fmnt%2Fvolume1%2Fsubdir&container=write-pod&container=write-pod&stderr=true&stdout=true)
Jan 21 06:34:59.359: INFO: ExecWithOptions {Command:[/bin/sh -c touch /mnt/volume1/subdir/file2] Namespace:fsgroupchangepolicy-3963 PodName:pod-df5987d1-d52e-4887-a27a-427e82ebcd78 ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false}
Jan 21 06:34:59.359: INFO: >>> kubeConfig: /root/.kube/config
Jan 21 06:34:59.360: INFO: ExecWithOptions: Clientset creation
Jan 21 06:34:59.360: INFO: ExecWithOptions: execute(POST https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io/api/v1/namespaces/fsgroupchangepolicy-3963/pods/pod-df5987d1-d52e-4887-a27a-427e82ebcd78/exec?command=%2Fbin%2Fsh&command=-c&command=touch+%2Fmnt%2Fvolume1%2Fsubdir%2Ffile2&container=write-pod&container=write-pod&stderr=true&stdout=true)
Jan 21 06:35:00.136: INFO: ExecWithOptions {Command:[/bin/sh -c ls -l /mnt/volume1/subdir/file2] Namespace:fsgroupchangepolicy-3963 PodName:pod-df5987d1-d52e-4887-a27a-427e82ebcd78 ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false}
Jan 21 06:35:00.136: INFO: >>> kubeConfig: /root/.kube/config
Jan 21 06:35:00.137: INFO: ExecWithOptions: Clientset creation
Jan 21 06:35:00.137: INFO: ExecWithOptions: execute(POST https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io/api/v1/namespaces/fsgroupchangepolicy-3963/pods/pod-df5987d1-d52e-4887-a27a-427e82ebcd78/exec?command=%2Fbin%2Fsh&command=-c&command=ls+-l+%2Fmnt%2Fvolume1%2Fsubdir%2Ffile2&container=write-pod&container=write-pod&stderr=true&stdout=true)
Jan 21 06:35:00.883: INFO: pod fsgroupchangepolicy-3963/pod-df5987d1-d52e-4887-a27a-427e82ebcd78 exec for cmd ls -l /mnt/volume1/subdir/file2, stdout: -rw-r--r--    1 root     1000             0 Jan 21 06:35 /mnt/volume1/subdir/file2, stderr: 
Jan 21 06:35:00.883: INFO: stdout split: [-rw-r--r-- 1 root 1000 0 Jan 21 06:35 /mnt/volume1/subdir/file2], expected gid: 1000
�[1mSTEP:�[0m Changing the root directory file ownership to 2000 �[38;5;243m01/21/23 06:35:00.883�[0m
Jan 21 06:35:00.883: INFO: ExecWithOptions {Command:[/bin/sh -c chgrp 2000 /mnt/volume1/file1] Namespace:fsgroupchangepolicy-3963 PodName:pod-df5987d1-d52e-4887-a27a-427e82ebcd78 ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false}
Jan 21 06:35:00.883: INFO: >>> kubeConfig: /root/.kube/config
Jan 21 06:35:00.884: INFO: ExecWithOptions: Clientset creation
Jan 21 06:35:00.884: INFO: ExecWithOptions: execute(POST https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io/api/v1/namespaces/fsgroupchangepolicy-3963/pods/pod-df5987d1-d52e-4887-a27a-427e82ebcd78/exec?command=%2Fbin%2Fsh&command=-c&command=chgrp+2000+%2Fmnt%2Fvolume1%2Ffile1&container=write-pod&container=write-pod&stderr=true&stdout=true)
Jan 21 06:35:02.118: INFO: ExecWithOptions {Command:[/bin/sh -c ls -l /mnt/volume1/file1] Namespace:fsgroupchangepolicy-3963 PodName:pod-df5987d1-d52e-4887-a27a-427e82ebcd78 ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false}
Jan 21 06:35:02.118: INFO: >>> kubeConfig: /root/.kube/config
Jan 21 06:35:02.119: INFO: ExecWithOptions: Clientset creation
Jan 21 06:35:02.119: INFO: ExecWithOptions: execute(POST https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io/api/v1/namespaces/fsgroupchangepolicy-3963/pods/pod-df5987d1-d52e-4887-a27a-427e82ebcd78/exec?command=%2Fbin%2Fsh&command=-c&command=ls+-l+%2Fmnt%2Fvolume1%2Ffile1&container=write-pod&container=write-pod&stderr=true&stdout=true)
Jan 21 06:35:02.916: INFO: pod fsgroupchangepolicy-3963/pod-df5987d1-d52e-4887-a27a-427e82ebcd78 exec for cmd ls -l /mnt/volume1/file1, stdout: -rw-r--r--    1 root     2000             0 Jan 21 06:34 /mnt/volume1/file1, stderr: 
Jan 21 06:35:02.916: INFO: stdout split: [-rw-r--r-- 1 root 2000 0 Jan 21 06:34 /mnt/volume1/file1], expected gid: 2000
�[1mSTEP:�[0m Changing the sub-directory file ownership to 3000 �[38;5;243m01/21/23 06:35:02.916�[0m
Jan 21 06:35:02.917: INFO: ExecWithOptions {Command:[/bin/sh -c chgrp 3000 /mnt/volume1/subdir/file2] Namespace:fsgroupchangepolicy-3963 PodName:pod-df5987d1-d52e-4887-a27a-427e82ebcd78 ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false}
Jan 21 06:35:02.917: INFO: >>> kubeConfig: /root/.kube/config
Jan 21 06:35:02.917: INFO: ExecWithOptions: Clientset creation
Jan 21 06:35:02.917: INFO: ExecWithOptions: execute(POST https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io/api/v1/namespaces/fsgroupchangepolicy-3963/pods/pod-df5987d1-d52e-4887-a27a-427e82ebcd78/exec?command=%2Fbin%2Fsh&command=-c&command=chgrp+3000+%2Fmnt%2Fvolume1%2Fsubdir%2Ffile2&container=write-pod&container=write-pod&stderr=true&stdout=true)
Jan 21 06:35:03.683: INFO: ExecWithOptions {Command:[/bin/sh -c ls -l /mnt/volume1/subdir/file2] Namespace:fsgroupchangepolicy-3963 PodName:pod-df5987d1-d52e-4887-a27a-427e82ebcd78 ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false}
Jan 21 06:35:03.683: INFO: >>> kubeConfig: /root/.kube/config
Jan 21 06:35:03.684: INFO: ExecWithOptions: Clientset creation
Jan 21 06:35:03.684: INFO: ExecWithOptions: execute(POST https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io/api/v1/namespaces/fsgroupchangepolicy-3963/pods/pod-df5987d1-d52e-4887-a27a-427e82ebcd78/exec?command=%2Fbin%2Fsh&command=-c&command=ls+-l+%2Fmnt%2Fvolume1%2Fsubdir%2Ffile2&container=write-pod&container=write-pod&stderr=true&stdout=true)
Jan 21 06:35:04.427: INFO: pod fsgroupchangepolicy-3963/pod-df5987d1-d52e-4887-a27a-427e82ebcd78 exec for cmd ls -l /mnt/volume1/subdir/file2, stdout: -rw-r--r--    1 root     3000             0 Jan 21 06:35 /mnt/volume1/subdir/file2, stderr: 
Jan 21 06:35:04.427: INFO: stdout split: [-rw-r--r-- 1 root 3000 0 Jan 21 06:35 /mnt/volume1/subdir/file2], expected gid: 3000
�[1mSTEP:�[0m Deleting Pod fsgroupchangepolicy-3963/pod-df5987d1-d52e-4887-a27a-427e82ebcd78 �[38;5;243m01/21/23 06:35:04.427�[0m
Jan 21 06:35:04.427: INFO: Deleting pod "pod-df5987d1-d52e-4887-a27a-427e82ebcd78" in namespace "fsgroupchangepolicy-3963"
Jan 21 06:35:04.545: INFO: Wait up to 5m0s for pod "pod-df5987d1-d52e-4887-a27a-427e82ebcd78" to be fully deleted
�[1mSTEP:�[0m Creating Pod in namespace fsgroupchangepolicy-3963 with fsgroup 1000 �[38;5;243m01/21/23 06:35:06.789�[0m
Jan 21 06:35:06.915: INFO: Waiting up to 5m0s for pod "pod-42c3941f-639f-4962-ae44-973a160407e8" in namespace "fsgroupchangepolicy-3963" to be "running"
Jan 21 06:35:07.033: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 118.163283ms
Jan 21 06:35:09.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 2.232920653s
Jan 21 06:35:11.152: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 4.237761333s
Jan 21 06:35:13.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 6.233583774s
Jan 21 06:35:15.151: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 8.235952541s
Jan 21 06:35:17.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 10.233479818s
Jan 21 06:35:19.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 12.232580083s
Jan 21 06:35:21.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 14.233163397s
Jan 21 06:35:23.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 16.233523601s
Jan 21 06:35:25.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 18.233058726s
Jan 21 06:35:27.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 20.232602232s
Jan 21 06:35:29.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 22.23286941s
Jan 21 06:35:31.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 24.233067685s
Jan 21 06:35:33.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 26.233135536s
Jan 21 06:35:35.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 28.233337798s
Jan 21 06:35:37.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 30.233822184s
Jan 21 06:35:39.149: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 32.233894774s
Jan 21 06:35:41.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 34.232848433s
Jan 21 06:35:43.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 36.23277848s
Jan 21 06:35:45.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 38.232723557s
Jan 21 06:35:47.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 40.232513744s
Jan 21 06:35:49.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 42.233554109s
Jan 21 06:35:51.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 44.232609803s
Jan 21 06:35:53.151: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 46.23654184s
Jan 21 06:35:55.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 48.232853395s
Jan 21 06:35:57.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 50.233148817s
Jan 21 06:35:59.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 52.232982821s
Jan 21 06:36:01.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 54.232839729s
Jan 21 06:36:03.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 56.232692044s
Jan 21 06:36:05.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 58.233526234s
Jan 21 06:36:07.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.23317579s
Jan 21 06:36:09.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.232833496s
Jan 21 06:36:11.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.232709593s
Jan 21 06:36:13.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.233566604s
Jan 21 06:36:15.151: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.23630842s
Jan 21 06:36:17.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.233731928s
Jan 21 06:36:19.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.233573131s
Jan 21 06:36:21.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.232896165s
Jan 21 06:36:23.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.232466277s
Jan 21 06:36:25.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.233595727s
Jan 21 06:36:27.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.232930451s
Jan 21 06:36:29.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.232798512s
Jan 21 06:36:31.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.233294353s
Jan 21 06:36:33.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.233615088s
Jan 21 06:36:35.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.233043388s
Jan 21 06:36:37.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.233435116s
Jan 21 06:36:39.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.233473196s
Jan 21 06:36:41.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.232843511s
Jan 21 06:36:43.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.232681661s
Jan 21 06:36:45.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.232833697s
Jan 21 06:36:47.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.233415545s
Jan 21 06:36:49.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.233858027s
Jan 21 06:36:51.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.232712995s
Jan 21 06:36:53.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.23254135s
Jan 21 06:36:55.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.233313473s
Jan 21 06:36:57.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.233311069s
Jan 21 06:36:59.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.23263081s
Jan 21 06:37:01.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.232931012s
Jan 21 06:37:03.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.23269906s
Jan 21 06:37:05.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.233725622s
Jan 21 06:37:07.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.232948901s
Jan 21 06:37:09.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.232763412s
Jan 21 06:37:11.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.232738527s
Jan 21 06:37:13.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.232772272s
Jan 21 06:37:15.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.233584027s
Jan 21 06:37:17.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.233166996s
Jan 21 06:37:19.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.232775589s
Jan 21 06:37:21.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.233575463s
Jan 21 06:37:23.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.232782045s
Jan 21 06:37:25.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.232641664s
Jan 21 06:37:27.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.232779956s
Jan 21 06:37:29.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.23377853s
Jan 21 06:37:31.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.232485074s
Jan 21 06:37:33.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.233354591s
Jan 21 06:37:35.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.233166327s
Jan 21 06:37:37.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.23338875s
Jan 21 06:37:39.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.232772134s
Jan 21 06:37:41.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.233079158s
Jan 21 06:37:43.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.233599361s
Jan 21 06:37:45.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.23281964s
Jan 21 06:37:47.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.232588217s
Jan 21 06:37:49.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.232799186s
Jan 21 06:37:51.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.232416257s
Jan 21 06:37:53.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.232879337s
Jan 21 06:37:55.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.232669722s
Jan 21 06:37:57.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.232521747s
Jan 21 06:37:59.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.232698782s
Jan 21 06:38:01.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.232362871s
Jan 21 06:38:03.150: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.235259754s
Jan 21 06:38:05.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.233574693s
Jan 21 06:38:07.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.233463376s
Jan 21 06:38:09.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.233300997s
Jan 21 06:38:11.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.233272787s
Jan 21 06:38:13.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.232863364s
Jan 21 06:38:15.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.23262186s
Jan 21 06:38:17.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.232697725s
Jan 21 06:38:19.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.233543642s
Jan 21 06:38:21.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.233640012s
Jan 21 06:38:23.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.232924454s
Jan 21 06:38:25.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.232831812s
Jan 21 06:38:27.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.233172203s
Jan 21 06:38:29.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.232849828s
Jan 21 06:38:31.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.232762319s
Jan 21 06:38:33.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.232730054s
Jan 21 06:38:35.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.232870945s
Jan 21 06:38:37.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.232667923s
Jan 21 06:38:39.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.232447201s
Jan 21 06:38:41.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.233589027s
Jan 21 06:38:43.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.23323394s
Jan 21 06:38:45.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.2322771s
Jan 21 06:38:47.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.233639927s
Jan 21 06:38:49.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.232458562s
Jan 21 06:38:51.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.232997741s
Jan 21 06:38:53.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.232426772s
Jan 21 06:38:55.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.233224358s
Jan 21 06:38:57.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.233397795s
Jan 21 06:38:59.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.232567271s
Jan 21 06:39:01.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.232589177s
Jan 21 06:39:03.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.232640602s
Jan 21 06:39:05.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.233504034s
Jan 21 06:39:07.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.233080332s
Jan 21 06:39:09.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.233589307s
Jan 21 06:39:11.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.233596684s
Jan 21 06:39:13.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.232532569s
Jan 21 06:39:15.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.232586881s
Jan 21 06:39:17.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.232872647s
Jan 21 06:39:19.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.232594243s
Jan 21 06:39:21.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.233621832s
Jan 21 06:39:23.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.23287603s
Jan 21 06:39:25.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.233678784s
Jan 21 06:39:27.149: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.234208176s
Jan 21 06:39:29.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.233666494s
Jan 21 06:39:31.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.23251661s
Jan 21 06:39:33.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.233648404s
Jan 21 06:39:35.150: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.235313921s
Jan 21 06:39:37.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.233562337s
Jan 21 06:39:39.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.232812427s
Jan 21 06:39:41.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.232781915s
Jan 21 06:39:43.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.233486985s
Jan 21 06:39:45.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.232202807s
Jan 21 06:39:47.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.233318508s
Jan 21 06:39:49.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.232617559s
Jan 21 06:39:51.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.233563117s
Jan 21 06:39:53.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.23298043s
Jan 21 06:39:55.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.23335584s
Jan 21 06:39:57.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.233665968s
Jan 21 06:39:59.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.233359042s
Jan 21 06:40:01.148: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.233161188s
Jan 21 06:40:03.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.232732324s
Jan 21 06:40:05.147: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.23256161s
Jan 21 06:40:07.151: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.236816008s
Jan 21 06:40:07.266: INFO: Pod "pod-42c3941f-639f-4962-ae44-973a160407e8": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.350996684s
Jan 21 06:40:07.266: INFO: Unexpected error: 
    <*errors.errorString | 0xc001076590>: {
        s: "pod \"pod-42c3941f-639f-4962-ae44-973a160407e8\" is not Running: timed out while waiting for pod fsgroupchangepolicy-3963/pod-42c3941f-639f-4962-ae44-973a160407e8 to be running",
    }
Jan 21 06:40:07.266: FAIL: pod "pod-42c3941f-639f-4962-ae44-973a160407e8" is not Running: timed out while waiting for pod fsgroupchangepolicy-3963/pod-42c3941f-639f-4962-ae44-973a160407e8 to be running

Full Stack Trace
k8s.io/kubernetes/test/e2e/storage/testsuites.createPodAndVerifyContentGid(0xc00174af00, 0xc00254fe10, 0x0, {0xc002e442b8, 0x4}, {0xc002e442bc, 0x4})
	test/e2e/storage/testsuites/fsgroupchangepolicy.go:258 +0x151
k8s.io/kubernetes/test/e2e/storage/testsuites.(*fsGroupChangePolicyTestSuite).DefineTests.func3()
	test/e2e/storage/testsuites/fsgroupchangepolicy.go:247 +0x556
�[1mSTEP:�[0m Deleting pvc �[38;5;243m01/21/23 06:40:07.266�[0m
Jan 21 06:40:07.494: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.comc67wm"
Jan 21 06:40:07.610: INFO: Waiting up to 5m0s for PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 to get deleted
Jan 21 06:40:07.724: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (113.820003ms)
Jan 21 06:40:12.840: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (5.22954034s)
Jan 21 06:40:17.955: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (10.344624273s)
Jan 21 06:40:23.070: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (15.459447956s)
Jan 21 06:40:28.185: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (20.574783196s)
Jan 21 06:40:33.299: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (25.688950992s)
Jan 21 06:40:38.414: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (30.803451738s)
Jan 21 06:40:43.529: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (35.918323059s)
Jan 21 06:40:48.643: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (41.032607212s)
Jan 21 06:40:53.757: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (46.146867632s)
Jan 21 06:40:58.872: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (51.261232712s)
Jan 21 06:41:03.986: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (56.375247439s)
Jan 21 06:41:09.100: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (1m1.48922432s)
Jan 21 06:41:14.214: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (1m6.603827382s)
Jan 21 06:41:19.328: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (1m11.71778191s)
Jan 21 06:41:24.442: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (1m16.831668919s)
Jan 21 06:41:29.557: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (1m21.946243296s)
Jan 21 06:41:34.671: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (1m27.061058932s)
Jan 21 06:41:39.793: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (1m32.182439279s)
Jan 21 06:41:44.908: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (1m37.2973019s)
Jan 21 06:41:50.022: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (1m42.411592992s)
Jan 21 06:41:55.137: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (1m47.526571641s)
Jan 21 06:42:00.251: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (1m52.640654816s)
Jan 21 06:42:05.365: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (1m57.754576994s)
Jan 21 06:42:10.480: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (2m2.869811257s)
Jan 21 06:42:15.594: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (2m7.98382259s)
Jan 21 06:42:20.715: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (2m13.104741331s)
Jan 21 06:42:25.829: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (2m18.21865535s)
Jan 21 06:42:30.944: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (2m23.33343264s)
Jan 21 06:42:36.059: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (2m28.448236804s)
Jan 21 06:42:41.174: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (2m33.563197681s)
Jan 21 06:42:46.288: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (2m38.677636998s)
Jan 21 06:42:51.403: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (2m43.792187579s)
Jan 21 06:42:56.517: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (2m48.906192087s)
Jan 21 06:43:01.631: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (2m54.020363114s)
Jan 21 06:43:06.745: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (2m59.134864811s)
Jan 21 06:43:11.859: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (3m4.248975273s)
Jan 21 06:43:16.973: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (3m9.363073054s)
Jan 21 06:43:22.088: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (3m14.477225592s)
Jan 21 06:43:27.201: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (3m19.590394666s)
Jan 21 06:43:32.314: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (3m24.703996866s)
Jan 21 06:43:37.427: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (3m29.816645505s)
Jan 21 06:43:42.540: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (3m34.929944575s)
Jan 21 06:43:47.653: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (3m40.042370165s)
Jan 21 06:43:52.766: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (3m45.155977404s)
Jan 21 06:43:57.879: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (3m50.26829515s)
Jan 21 06:44:02.985: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (3m55.37469977s)
Jan 21 06:44:08.091: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (4m0.480455621s)
Jan 21 06:44:13.197: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (4m5.586206752s)
Jan 21 06:44:18.303: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (4m10.692525786s)
Jan 21 06:44:23.409: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (4m15.798694927s)
Jan 21 06:44:28.515: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (4m20.905000795s)
Jan 21 06:44:33.621: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (4m26.010816232s)
Jan 21 06:44:38.727: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (4m31.116175232s)
Jan 21 06:44:43.833: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (4m36.222497302s)
Jan 21 06:44:48.938: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (4m41.327796817s)
Jan 21 06:44:54.044: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (4m46.433979476s)
Jan 21 06:44:59.155: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (4m51.544549503s)
Jan 21 06:45:04.261: INFO: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 found and phase=Bound (4m56.65055855s)
�[1mSTEP:�[0m Deleting sc �[38;5;243m01/21/23 06:45:09.262�[0m
Jan 21 06:45:09.368: INFO: Unexpected error: while cleanup resource: 
    <errors.aggregate | len:1, cap:1>: [
        <errors.aggregate | len:1, cap:1>[
            <*fmt.wrapError | 0xc003584480>{
                msg: "persistent Volume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 not deleted by dynamic provisioner: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 still exists within 5m0s",
                err: <*errors.errorString | 0xc001076bd0>{
                    s: "PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 still exists within 5m0s",
                },
            },
        ],
    ]
Jan 21 06:45:09.368: FAIL: while cleanup resource: persistent Volume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 not deleted by dynamic provisioner: PersistentVolume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71 still exists within 5m0s

Full Stack Trace
k8s.io/kubernetes/test/e2e/storage/testsuites.(*fsGroupChangePolicyTestSuite).DefineTests.func2()
	test/e2e/storage/testsuites/fsgroupchangepolicy.go:128 +0x14e
panic({0x70efe60, 0xc0008752d0})
	/usr/local/go/src/runtime/panic.go:884 +0x212
k8s.io/kubernetes/test/e2e/framework.Fail({0xc002da0160, 0xae}, {0xc002501c30?, 0xc002da0160?, 0xc002501c58?})
	test/e2e/framework/log.go:61 +0x145
k8s.io/kubernetes/test/e2e/framework.ExpectNoErrorWithOffset(0x1, {0x7fa8f20, 0xc001076590}, {0x0?, 0x2?, 0x0?})
	test/e2e/framework/expect.go:76 +0x267
k8s.io/kubernetes/test/e2e/framework.ExpectNoError(...)
	test/e2e/framework/expect.go:43
k8s.io/kubernetes/test/e2e/storage/testsuites.createPodAndVerifyContentGid(0xc00174af00, 0xc00254fe10, 0x0, {0xc002e442b8, 0x4}, {0xc002e442bc, 0x4})
	test/e2e/storage/testsuites/fsgroupchangepolicy.go:258 +0x151
k8s.io/kubernetes/test/e2e/storage/testsuites.(*fsGroupChangePolicyTestSuite).DefineTests.func3()
	test/e2e/storage/testsuites/fsgroupchangepolicy.go:247 +0x556
[AfterEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  test/e2e/framework/node/init/init.go:32
Jan 21 06:45:09.369: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/21/23 06:45:09.475�[0m
�[1mSTEP:�[0m Collecting events from namespace "fsgroupchangepolicy-3963". �[38;5;243m01/21/23 06:45:09.475�[0m
�[1mSTEP:�[0m Found 25 events. �[38;5;243m01/21/23 06:45:09.581�[0m
Jan 21 06:45:09.581: INFO: At 2023-01-21 06:34:22 +0000 UTC - event for ebs.csi.aws.comc67wm: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding
Jan 21 06:45:09.581: INFO: At 2023-01-21 06:34:22 +0000 UTC - event for ebs.csi.aws.comc67wm: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "ebs.csi.aws.com" or manually created by system administrator
Jan 21 06:45:09.581: INFO: At 2023-01-21 06:34:22 +0000 UTC - event for ebs.csi.aws.comc67wm: {ebs.csi.aws.com_i-0d2f2d71d5d6f8b5a_799f6cfd-1878-47ca-8ea3-4b6a1dd1b7f8 } Provisioning: External provisioner is provisioning volume for claim "fsgroupchangepolicy-3963/ebs.csi.aws.comc67wm"
Jan 21 06:45:09.581: INFO: At 2023-01-21 06:34:25 +0000 UTC - event for ebs.csi.aws.comc67wm: {ebs.csi.aws.com_i-0d2f2d71d5d6f8b5a_799f6cfd-1878-47ca-8ea3-4b6a1dd1b7f8 } ProvisioningSucceeded: Successfully provisioned volume pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71
Jan 21 06:45:09.581: INFO: At 2023-01-21 06:34:26 +0000 UTC - event for pod-df5987d1-d52e-4887-a27a-427e82ebcd78: {default-scheduler } Scheduled: Successfully assigned fsgroupchangepolicy-3963/pod-df5987d1-d52e-4887-a27a-427e82ebcd78 to i-0483840d8e13a9e6f
Jan 21 06:45:09.581: INFO: At 2023-01-21 06:34:28 +0000 UTC - event for pod-df5987d1-d52e-4887-a27a-427e82ebcd78: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71" 
Jan 21 06:45:09.581: INFO: At 2023-01-21 06:34:39 +0000 UTC - event for pod-df5987d1-d52e-4887-a27a-427e82ebcd78: {kubelet i-0483840d8e13a9e6f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "1d0565dd2f62ffe92775df16055d0c01f0ca85fe3a89b9abb44c7766a1d0a315": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:45:09.581: INFO: At 2023-01-21 06:34:54 +0000 UTC - event for pod-df5987d1-d52e-4887-a27a-427e82ebcd78: {kubelet i-0483840d8e13a9e6f} Started: Started container write-pod
Jan 21 06:45:09.581: INFO: At 2023-01-21 06:34:54 +0000 UTC - event for pod-df5987d1-d52e-4887-a27a-427e82ebcd78: {kubelet i-0483840d8e13a9e6f} Created: Created container write-pod
Jan 21 06:45:09.581: INFO: At 2023-01-21 06:34:54 +0000 UTC - event for pod-df5987d1-d52e-4887-a27a-427e82ebcd78: {kubelet i-0483840d8e13a9e6f} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine
Jan 21 06:45:09.581: INFO: At 2023-01-21 06:35:04 +0000 UTC - event for pod-df5987d1-d52e-4887-a27a-427e82ebcd78: {kubelet i-0483840d8e13a9e6f} Killing: Stopping container write-pod
Jan 21 06:45:09.581: INFO: At 2023-01-21 06:35:06 +0000 UTC - event for pod-42c3941f-639f-4962-ae44-973a160407e8: {default-scheduler } Scheduled: Successfully assigned fsgroupchangepolicy-3963/pod-42c3941f-639f-4962-ae44-973a160407e8 to i-0ce901feb1d51fd3c
Jan 21 06:45:09.581: INFO: At 2023-01-21 06:35:15 +0000 UTC - event for pod-42c3941f-639f-4962-ae44-973a160407e8: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-69299f1d-6f81-40f7-ab3e-8fead9ddfb71" 
Jan 21 06:45:09.581: INFO: At 2023-01-21 06:35:17 +0000 UTC - event for pod-42c3941f-639f-4962-ae44-973a160407e8: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e861f64633f432894fb665b62f88c8877431cca56b805ae9bf0c15862dd2dc4a": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:45:09.581: INFO: At 2023-01-21 06:35:31 +0000 UTC - event for pod-42c3941f-639f-4962-ae44-973a160407e8: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "29fb5aa2df5fa42b2d7d58bd2a7662b72a5e4258c0116f82164771bcc4eaa763": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:45:09.581: INFO: At 2023-01-21 06:35:46 +0000 UTC - event for pod-42c3941f-639f-4962-ae44-973a160407e8: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "89a0494d2ea4087594923d4f9938f5edc5e43895626899aedf622b596f1526c2": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:45:09.581: INFO: At 2023-01-21 06:36:01 +0000 UTC - event for pod-42c3941f-639f-4962-ae44-973a160407e8: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "15138191c14fae77022768441fdb80a4f9e7e8ec12420ca79a1b0e2aa0d32e0b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:45:09.581: INFO: At 2023-01-21 06:36:12 +0000 UTC - event for pod-42c3941f-639f-4962-ae44-973a160407e8: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "faed43236bb27d8266160e209fd7961204bb337e86e360e4304c547da1ccf6c7": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:45:09.581: INFO: At 2023-01-21 06:36:24 +0000 UTC - event for pod-42c3941f-639f-4962-ae44-973a160407e8: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b2a59ba4bbe392213d361dfca67226589bc284eeb800687324ec005bccd97a7b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:45:09.581: INFO: At 2023-01-21 06:36:39 +0000 UTC - event for pod-42c3941f-639f-4962-ae44-973a160407e8: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "19519acab54c42709120f0aa1950a7fc8d3018f412a98684ca990d1e131541c4": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:45:09.581: INFO: At 2023-01-21 06:36:50 +0000 UTC - event for pod-42c3941f-639f-4962-ae44-973a160407e8: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "10ce98169c863637e2063e1259b40853f6f2baac4d07dad228f009eaf2f9a3bb": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:45:09.581: INFO: At 2023-01-21 06:37:01 +0000 UTC - event for pod-42c3941f-639f-4962-ae44-973a160407e8: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "293d994f3f265a49cedbec84bfbbd8ad5c0991454c2884014fc83b3a76b8bb63": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:45:09.581: INFO: At 2023-01-21 06:37:15 +0000 UTC - event for pod-42c3941f-639f-4962-ae44-973a160407e8: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "913684fc697e7af629f1bbd36caa9901ba99e7dd8ec4b44cc678ccb6bcd7f79d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:45:09.581: INFO: At 2023-01-21 06:40:31 +0000 UTC - event for pod-42c3941f-639f-4962-ae44-973a160407e8: {kubelet i-0ce901feb1d51fd3c} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine
Jan 21 06:45:09.581: INFO: At 2023-01-21 06:40:31 +0000 UTC - event for pod-42c3941f-639f-4962-ae44-973a160407e8: {kubelet i-0ce901feb1d51fd3c} Created: Created container write-pod
Jan 21 06:45:09.686: INFO: POD                                       NODE                 PHASE    GRACE  CONDITIONS
Jan 21 06:45:09.686: INFO: pod-42c3941f-639f-4962-ae44-973a160407e8  i-0ce901feb1d51fd3c  Running         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:35:06 +0000 UTC  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:40:32 +0000 UTC  } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:40:32 +0000 UTC  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:35:06 +0000 UTC  }]
Jan 21 06:45:09.686: INFO: 
Jan 21 06:45:09.899: INFO: 
Logging node info for node i-034aa8120dbcec79b
Jan 21 06:45:10.005: INFO: Node Info: &Node{ObjectMeta:{i-034aa8120dbcec79b    c2b3eda9-6144-4855-b163-8deafef2a413 18293 0 2023-01-21 06:26:22 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-034aa8120dbcec79b kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-1a topology.hostpath.csi/node:i-034aa8120dbcec79b topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.44.197 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-034aa8120dbcec79b"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-21 06:26:22 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 06:26:22 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 06:26:22 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-21 06:26:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-21 06:26:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {e2e.test Update v1 2023-01-21 06:33:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-21 06:43:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-034aa8120dbcec79b,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 06:43:43 +0000 UTC,LastTransitionTime:2023-01-21 06:26:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 06:43:43 +0000 UTC,LastTransitionTime:2023-01-21 06:26:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 06:43:43 +0000 UTC,LastTransitionTime:2023-01-21 06:26:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 06:43:43 +0000 UTC,LastTransitionTime:2023-01-21 06:26:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.44.197,},NodeAddress{Type:ExternalIP,Address:3.250.148.238,},NodeAddress{Type:InternalDNS,Address:i-034aa8120dbcec79b.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-034aa8120dbcec79b.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-250-148-238.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec24052f5b49538b50ca690553c9978a,SystemUUID:ec24052f-5b49-538b-50ca-690553c9978a,BootID:e582450b-04c2-4204-a2a8-58ecc23f099e,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 06:45:10.005: INFO: 
Logging kubelet events for node i-034aa8120dbcec79b
Jan 21 06:45:10.113: INFO: 
Logging pods the kubelet thinks is on node i-034aa8120dbcec79b
Jan 21 06:45:10.331: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-26nnl started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:10.331: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:10.331: INFO: ebs-csi-node-4mfqt started at 2023-01-21 06:26:22 +0000 UTC (0+3 container statuses recorded)
Jan 21 06:45:10.331: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 21 06:45:10.331: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 21 06:45:10.331: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 21 06:45:10.331: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-gwjcc started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:10.331: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:10.331: INFO: pod-disruption-failure-ignore-0-lktw9 started at 2023-01-21 06:34:51 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:10.331: INFO: 	Container c ready: true, restart count 0
Jan 21 06:45:10.331: INFO: coredns-autoscaler-7cb5c5b969-slvzq started at 2023-01-21 06:26:33 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:10.331: INFO: 	Container autoscaler ready: true, restart count 0
Jan 21 06:45:10.331: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-4xkqd started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:10.331: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: false, restart count 0
Jan 21 06:45:10.331: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-sqpxl started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:10.331: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:10.331: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-sjgwj started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:10.331: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:10.331: INFO: pod-disruption-failure-ignore-1-lmh2f started at 2023-01-21 06:34:51 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:10.331: INFO: 	Container c ready: false, restart count 0
Jan 21 06:45:10.331: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-lnlh9 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:10.331: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:10.331: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-l9cqk started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:10.331: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:10.331: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-nf6xx started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:10.331: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:10.331: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-wf6j2 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:10.331: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:10.331: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-tjrzg started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:10.331: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:10.331: INFO: coredns-559769c974-f8ncw started at 2023-01-21 06:26:33 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:10.331: INFO: 	Container coredns ready: true, restart count 0
Jan 21 06:45:10.331: INFO: pod-subpath-test-preprovisionedpv-rd6z started at 2023-01-21 06:40:39 +0000 UTC (1+1 container statuses recorded)
Jan 21 06:45:10.331: INFO: 	Init container init-volume-preprovisionedpv-rd6z ready: false, restart count 0
Jan 21 06:45:10.331: INFO: 	Container test-container-subpath-preprovisionedpv-rd6z ready: false, restart count 0
Jan 21 06:45:10.331: INFO: netserver-0 started at 2023-01-21 06:42:05 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:10.331: INFO: 	Container webserver ready: false, restart count 0
Jan 21 06:45:10.331: INFO: cilium-rbcn6 started at 2023-01-21 06:26:22 +0000 UTC (1+1 container statuses recorded)
Jan 21 06:45:10.331: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 21 06:45:10.331: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 21 06:45:10.331: INFO: hostexec-i-034aa8120dbcec79b-fclfv started at 2023-01-21 06:40:23 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:10.331: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 21 06:45:10.737: INFO: 
Latency metrics for node i-034aa8120dbcec79b
Jan 21 06:45:10.737: INFO: 
Logging node info for node i-0483840d8e13a9e6f
Jan 21 06:45:10.843: INFO: Node Info: &Node{ObjectMeta:{i-0483840d8e13a9e6f    6e63ffcd-a34b-47ab-888c-fb980b98335e 17988 0 2023-01-21 06:26:26 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0483840d8e13a9e6f kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-1a topology.hostpath.csi/node:i-0483840d8e13a9e6f topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.35.162 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0483840d8e13a9e6f"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-21 06:26:26 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 06:26:26 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 06:26:26 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-21 06:26:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-21 06:26:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-21 06:33:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-21 06:40:57 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-21 06:42:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-0483840d8e13a9e6f,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 06:42:35 +0000 UTC,LastTransitionTime:2023-01-21 06:26:26 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 06:42:35 +0000 UTC,LastTransitionTime:2023-01-21 06:26:26 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 06:42:35 +0000 UTC,LastTransitionTime:2023-01-21 06:26:26 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 06:42:35 +0000 UTC,LastTransitionTime:2023-01-21 06:26:38 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.35.162,},NodeAddress{Type:ExternalIP,Address:54.220.210.148,},NodeAddress{Type:InternalDNS,Address:i-0483840d8e13a9e6f.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0483840d8e13a9e6f.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-220-210-148.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2945f38534f04be1d719a5a69e0c27,SystemUUID:ec2945f3-8534-f04b-e1d7-19a5a69e0c27,BootID:dc551b58-3eaf-4442-8a18-f820d5bb2e66,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-075484b5e61c2a96e],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-075484b5e61c2a96e,DevicePath:,},},Config:nil,},}
Jan 21 06:45:10.843: INFO: 
Logging kubelet events for node i-0483840d8e13a9e6f
Jan 21 06:45:10.951: INFO: 
Logging pods the kubelet thinks is on node i-0483840d8e13a9e6f
Jan 21 06:45:11.065: INFO: httpd started at 2023-01-21 06:40:23 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:11.065: INFO: 	Container httpd ready: false, restart count 0
Jan 21 06:45:11.065: INFO: test-grpc-57f4153d-bee5-4b1a-b84c-59b84c632ef9 started at 2023-01-21 06:38:49 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:11.065: INFO: 	Container etcd ready: true, restart count 0
Jan 21 06:45:11.065: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-nzzv4 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:11.065: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:11.065: INFO: suspend-false-to-true-cxr2f started at 2023-01-21 06:35:20 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:11.065: INFO: 	Container c ready: false, restart count 0
Jan 21 06:45:11.065: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-jkplr started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:11.065: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:11.065: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-jtcl9 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:11.065: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:11.065: INFO: externalsvc-hgg2f started at 2023-01-21 06:42:57 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:11.065: INFO: 	Container externalsvc ready: false, restart count 0
Jan 21 06:45:11.065: INFO: hostexec-i-0483840d8e13a9e6f-wmjxz started at 2023-01-21 06:44:39 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:11.065: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 21 06:45:11.065: INFO: pfpod started at 2023-01-21 06:45:05 +0000 UTC (0+2 container statuses recorded)
Jan 21 06:45:11.065: INFO: 	Container portforwardtester ready: false, restart count 0
Jan 21 06:45:11.065: INFO: 	Container readiness ready: false, restart count 0
Jan 21 06:45:11.065: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-ljtgd started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:11.065: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:11.065: INFO: netserver-1 started at 2023-01-21 06:42:05 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:11.065: INFO: 	Container webserver ready: false, restart count 0
Jan 21 06:45:11.065: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-xl5pw started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:11.065: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:11.065: INFO: cilium-gjcpw started at 2023-01-21 06:26:27 +0000 UTC (1+1 container statuses recorded)
Jan 21 06:45:11.065: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 21 06:45:11.065: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 21 06:45:11.065: INFO: ss2-0 started at 2023-01-21 06:35:58 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:11.065: INFO: 	Container webserver ready: true, restart count 0
Jan 21 06:45:11.065: INFO: csi-hostpathplugin-0 started at 2023-01-21 06:35:03 +0000 UTC (0+7 container statuses recorded)
Jan 21 06:45:11.065: INFO: 	Container csi-attacher ready: false, restart count 0
Jan 21 06:45:11.065: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan 21 06:45:11.065: INFO: 	Container csi-resizer ready: false, restart count 0
Jan 21 06:45:11.065: INFO: 	Container csi-snapshotter ready: false, restart count 0
Jan 21 06:45:11.065: INFO: 	Container hostpath ready: false, restart count 0
Jan 21 06:45:11.065: INFO: 	Container liveness-probe ready: false, restart count 0
Jan 21 06:45:11.065: INFO: 	Container node-driver-registrar ready: false, restart count 0
Jan 21 06:45:11.065: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-59wl4 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:11.065: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: false, restart count 0
Jan 21 06:45:11.065: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-wrc8q started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:11.065: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:11.065: INFO: pod-update-1731a417-e5ea-48ed-9b52-307dd7ddf57f started at 2023-01-21 06:42:17 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:11.065: INFO: 	Container pause ready: false, restart count 0
Jan 21 06:45:11.065: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-lx5wh started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:11.065: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:11.065: INFO: suspend-false-to-true-l6rxb started at 2023-01-21 06:35:20 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:11.065: INFO: 	Container c ready: true, restart count 0
Jan 21 06:45:11.065: INFO: pod-subpath-test-preprovisionedpv-rl8c started at 2023-01-21 06:44:54 +0000 UTC (0+2 container statuses recorded)
Jan 21 06:45:11.065: INFO: 	Container test-container-subpath-preprovisionedpv-rl8c ready: false, restart count 0
Jan 21 06:45:11.065: INFO: 	Container test-container-volume-preprovisionedpv-rl8c ready: false, restart count 0
Jan 21 06:45:11.065: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-gx9qk started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:11.065: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:11.065: INFO: inline-volume-tester-7hmk6 started at 2023-01-21 06:40:55 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:11.065: INFO: 	Container csi-volume-tester ready: false, restart count 0
Jan 21 06:45:11.065: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-5cg9n started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:11.065: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:11.065: INFO: ebs-csi-node-4fv8j started at 2023-01-21 06:26:27 +0000 UTC (0+3 container statuses recorded)
Jan 21 06:45:11.065: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 21 06:45:11.065: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 21 06:45:11.065: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 21 06:45:11.469: INFO: 
Latency metrics for node i-0483840d8e13a9e6f
Jan 21 06:45:11.469: INFO: 
Logging node info for node i-0ce901feb1d51fd3c
Jan 21 06:45:11.575: INFO: Node Info: &Node{ObjectMeta:{i-0ce901feb1d51fd3c    7d82d388-0267-44ad-a74d-b2eb46841c68 18629 0 2023-01-21 06:26:22 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0ce901feb1d51fd3c kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-1a topology.hostpath.csi/node:i-0ce901feb1d51fd3c topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.55.1 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0ce901feb1d51fd3c"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-21 06:26:22 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 06:26:22 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 06:26:22 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-21 06:26:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-21 06:26:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-21 06:33:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-21 06:44:53 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-21 06:44:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-0ce901feb1d51fd3c,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 06:44:53 +0000 UTC,LastTransitionTime:2023-01-21 06:26:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 06:44:53 +0000 UTC,LastTransitionTime:2023-01-21 06:26:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 06:44:53 +0000 UTC,LastTransitionTime:2023-01-21 06:26:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 06:44:53 +0000 UTC,LastTransitionTime:2023-01-21 06:26:34 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.55.1,},NodeAddress{Type:ExternalIP,Address:54.74.114.32,},NodeAddress{Type:InternalDNS,Address:i-0ce901feb1d51fd3c.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0ce901feb1d51fd3c.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-74-114-32.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec284d9c2eebc996a6b6d4cf4e0f52b7,SystemUUID:ec284d9c-2eeb-c996-a6b6-d4cf4e0f52b7,BootID:e32d5483-bf35-4be2-9254-c24e37c024a3,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0136a6452541f2af3 kubernetes.io/csi/ebs.csi.aws.com^vol-09ae70f9bff51a6a7],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-09ae70f9bff51a6a7,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0136a6452541f2af3,DevicePath:,},},Config:nil,},}
Jan 21 06:45:11.575: INFO: 
Logging kubelet events for node i-0ce901feb1d51fd3c
Jan 21 06:45:11.682: INFO: 
Logging pods the kubelet thinks is on node i-0ce901feb1d51fd3c
Jan 21 06:45:11.797: INFO: ss2-1 started at 2023-01-21 06:36:27 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:11.797: INFO: 	Container webserver ready: false, restart count 0
Jan 21 06:45:11.797: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-mxx2t started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:11.797: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:11.797: INFO: pod-2 started at 2023-01-21 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:11.797: INFO: 	Container donothing ready: true, restart count 0
Jan 21 06:45:11.797: INFO: pod-1 started at 2023-01-21 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:11.797: INFO: 	Container donothing ready: true, restart count 0
Jan 21 06:45:11.797: INFO: netserver-2 started at 2023-01-21 06:42:05 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:11.797: INFO: 	Container webserver ready: false, restart count 0
Jan 21 06:45:11.797: INFO: pod-a202bbe2-d16a-40d8-81e4-37e789c8fe6b started at 2023-01-21 06:40:58 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:11.797: INFO: 	Container write-pod ready: false, restart count 0
Jan 21 06:45:11.797: INFO: ebs-csi-node-qp79b started at 2023-01-21 06:26:23 +0000 UTC (0+3 container statuses recorded)
Jan 21 06:45:11.797: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 21 06:45:11.797: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 21 06:45:11.797: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 21 06:45:11.797: INFO: hostexec-i-0ce901feb1d51fd3c-96hxq started at 2023-01-21 06:40:47 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:11.797: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 21 06:45:11.797: INFO: pod-2214d111-6f9f-4cf4-938a-ea98d46a830a started at 2023-01-21 06:40:51 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:11.797: INFO: 	Container write-pod ready: false, restart count 0
Jan 21 06:45:11.797: INFO: pod-0 started at 2023-01-21 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:11.797: INFO: 	Container donothing ready: false, restart count 0
Jan 21 06:45:11.797: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-72ss9 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:11.797: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:11.797: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-tsmhc started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:11.797: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:11.797: INFO: pod-2d889885-3f7a-479c-a414-791defb1b96e started at 2023-01-21 06:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:11.797: INFO: 	Container write-pod ready: false, restart count 0
Jan 21 06:45:11.797: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-q9jl2 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:11.797: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: false, restart count 0
Jan 21 06:45:11.797: INFO: hostexec-i-0ce901feb1d51fd3c-2pbs6 started at 2023-01-21 06:40:41 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:11.797: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 21 06:45:11.797: INFO: service-deletion-zzk4s started at 2023-01-21 06:40:23 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:11.797: INFO: 	Container service-deletion ready: false, restart count 0
Jan 21 06:45:11.797: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-zz7mm started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:11.797: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:11.797: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-pkhl6 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:11.797: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:11.797: INFO: test-recreate-deployment-795566c5cb-cw79n started at 2023-01-21 06:42:04 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:11.797: INFO: 	Container agnhost ready: false, restart count 0
Jan 21 06:45:11.797: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-nz2r7 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:11.797: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:11.797: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-lfwx4 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:11.797: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:11.797: INFO: hostpath-symlink-prep-provisioning-3092 started at 2023-01-21 06:44:27 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:11.797: INFO: 	Container init-volume-provisioning-3092 ready: false, restart count 0
Jan 21 06:45:11.797: INFO: cilium-qs82l started at 2023-01-21 06:26:23 +0000 UTC (1+1 container statuses recorded)
Jan 21 06:45:11.797: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 21 06:45:11.797: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 21 06:45:11.797: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-wtrk9 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:11.797: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:11.797: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-dw85q started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:11.797: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:11.797: INFO: externalsvc-cjcvt started at 2023-01-21 06:42:57 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:11.797: INFO: 	Container externalsvc ready: false, restart count 0
Jan 21 06:45:11.797: INFO: pod-42c3941f-639f-4962-ae44-973a160407e8 started at 2023-01-21 06:35:06 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:11.797: INFO: 	Container write-pod ready: true, restart count 0
Jan 21 06:45:11.797: INFO: pod2 started at 2023-01-21 06:44:52 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:11.797: INFO: 	Container agnhost-container ready: false, restart count 0
Jan 21 06:45:12.238: INFO: 
Latency metrics for node i-0ce901feb1d51fd3c
Jan 21 06:45:12.238: INFO: 
Logging node info for node i-0d2f2d71d5d6f8b5a
Jan 21 06:45:12.343: INFO: Node Info: &Node{ObjectMeta:{i-0d2f2d71d5d6f8b5a    d2f1894b-950d-45a2-a42f-7d9213bb75b8 17658 0 2023-01-21 06:24:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0d2f2d71d5d6f8b5a kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:eu-west-1a topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.42.168 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0d2f2d71d5d6f8b5a"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-21 06:24:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-21 06:25:04 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-01-21 06:25:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-21 06:25:18 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 06:25:18 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-21 06:41:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-0d2f2d71d5d6f8b5a,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892310016 0} {<nil>} 3801084Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787452416 0} {<nil>} 3698684Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 06:41:55 +0000 UTC,LastTransitionTime:2023-01-21 06:24:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 06:41:55 +0000 UTC,LastTransitionTime:2023-01-21 06:24:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 06:41:55 +0000 UTC,LastTransitionTime:2023-01-21 06:24:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 06:41:55 +0000 UTC,LastTransitionTime:2023-01-21 06:25:16 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.168,},NodeAddress{Type:ExternalIP,Address:3.249.87.249,},NodeAddress{Type:InternalDNS,Address:i-0d2f2d71d5d6f8b5a.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0d2f2d71d5d6f8b5a.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-249-87-249.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2326005f1a498ecb0bcf8cde478bd4,SystemUUID:ec232600-5f1a-498e-cb0b-cf8cde478bd4,BootID:45d9d2b8-2840-49c2-9bdc-aa7244b00f22,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.1],SizeBytes:135178704,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.1],SizeBytes:124995897,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.1],SizeBytes:57661752,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43643671,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42841306,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4965794,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 06:45:12.344: INFO: 
Logging kubelet events for node i-0d2f2d71d5d6f8b5a
Jan 21 06:45:12.451: INFO: 
Logging pods the kubelet thinks is on node i-0d2f2d71d5d6f8b5a
Jan 21 06:45:12.562: INFO: kops-controller-hffbm started at 2023-01-21 06:25:08 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:12.562: INFO: 	Container kops-controller ready: true, restart count 0
Jan 21 06:45:12.562: INFO: cilium-6bgng started at 2023-01-21 06:25:08 +0000 UTC (1+1 container statuses recorded)
Jan 21 06:45:12.562: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 21 06:45:12.562: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 21 06:45:12.562: INFO: dns-controller-69987775c6-vgxml started at 2023-01-21 06:25:08 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:12.562: INFO: 	Container dns-controller ready: true, restart count 0
Jan 21 06:45:12.562: INFO: etcd-manager-events-i-0d2f2d71d5d6f8b5a started at 2023-01-21 06:24:03 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:12.562: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 21 06:45:12.562: INFO: kube-apiserver-i-0d2f2d71d5d6f8b5a started at 2023-01-21 06:24:04 +0000 UTC (0+2 container statuses recorded)
Jan 21 06:45:12.562: INFO: 	Container healthcheck ready: true, restart count 0
Jan 21 06:45:12.562: INFO: 	Container kube-apiserver ready: true, restart count 1
Jan 21 06:45:12.562: INFO: kube-scheduler-i-0d2f2d71d5d6f8b5a started at 2023-01-21 06:24:04 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:12.562: INFO: 	Container kube-scheduler ready: true, restart count 0
Jan 21 06:45:12.562: INFO: aws-cloud-controller-manager-cqjd9 started at 2023-01-21 06:25:08 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:12.562: INFO: 	Container aws-cloud-controller-manager ready: true, restart count 0
Jan 21 06:45:12.562: INFO: ebs-csi-node-tb6br started at 2023-01-21 06:25:08 +0000 UTC (0+3 container statuses recorded)
Jan 21 06:45:12.562: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 21 06:45:12.562: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 21 06:45:12.562: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 21 06:45:12.562: INFO: cilium-operator-5dd44dc49f-fld4m started at 2023-01-21 06:25:08 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:12.562: INFO: 	Container cilium-operator ready: true, restart count 0
Jan 21 06:45:12.562: INFO: ebs-csi-controller-5bd98b456f-b9lnh started at 2023-01-21 06:25:08 +0000 UTC (0+5 container statuses recorded)
Jan 21 06:45:12.562: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 21 06:45:12.562: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 21 06:45:12.562: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 21 06:45:12.562: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 21 06:45:12.562: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 21 06:45:12.562: INFO: etcd-manager-main-i-0d2f2d71d5d6f8b5a started at 2023-01-21 06:24:04 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:12.562: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 21 06:45:12.562: INFO: kube-controller-manager-i-0d2f2d71d5d6f8b5a started at 2023-01-21 06:24:04 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:12.562: INFO: 	Container kube-controller-manager ready: true, restart count 2
Jan 21 06:45:12.946: INFO: 
Latency metrics for node i-0d2f2d71d5d6f8b5a
Jan 21 06:45:12.946: INFO: 
Logging node info for node i-0f3b8117f4ecfc9ec
Jan 21 06:45:13.051: INFO: Node Info: &Node{ObjectMeta:{i-0f3b8117f4ecfc9ec    019b5e58-b8c2-4ac5-ba8d-47ba49f9fe9c 17313 0 2023-01-21 06:26:29 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0f3b8117f4ecfc9ec kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-1a topology.hostpath.csi/node:i-0f3b8117f4ecfc9ec topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.36.94 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0f3b8117f4ecfc9ec"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-21 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 06:26:29 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-21 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-21 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-21 06:33:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-21 06:40:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-0f3b8117f4ecfc9ec,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 06:40:57 +0000 UTC,LastTransitionTime:2023-01-21 06:26:29 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 06:40:57 +0000 UTC,LastTransitionTime:2023-01-21 06:26:29 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 06:40:57 +0000 UTC,LastTransitionTime:2023-01-21 06:26:29 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 06:40:57 +0000 UTC,LastTransitionTime:2023-01-21 06:26:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.36.94,},NodeAddress{Type:ExternalIP,Address:54.72.134.71,},NodeAddress{Type:InternalDNS,Address:i-0f3b8117f4ecfc9ec.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0f3b8117f4ecfc9ec.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-72-134-71.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2c9416b8fb84b0403f690a294bd09b,SystemUUID:ec2c9416-b8fb-84b0-403f-690a294bd09b,BootID:4e9f8b9b-5350-48ad-8083-40ed7929b713,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 06:45:13.051: INFO: 
Logging kubelet events for node i-0f3b8117f4ecfc9ec
Jan 21 06:45:13.159: INFO: 
Logging pods the kubelet thinks is on node i-0f3b8117f4ecfc9ec
Jan 21 06:45:13.270: INFO: hostexec-i-0f3b8117f4ecfc9ec-h88h7 started at 2023-01-21 06:42:01 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:13.270: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 21 06:45:13.270: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-wzrc6 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:13.270: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:13.270: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-5pk66 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:13.270: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:13.270: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-fjkff started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:13.270: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:13.270: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-4sr7v started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:13.270: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:13.270: INFO: ebs-csi-node-5dm54 started at 2023-01-21 06:26:30 +0000 UTC (0+3 container statuses recorded)
Jan 21 06:45:13.270: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 21 06:45:13.270: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 21 06:45:13.270: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 21 06:45:13.270: INFO: cilium-2brsw started at 2023-01-21 06:26:30 +0000 UTC (1+1 container statuses recorded)
Jan 21 06:45:13.270: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 21 06:45:13.270: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 21 06:45:13.270: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-8zpkj started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:13.270: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:13.270: INFO: pod1 started at 2023-01-21 06:44:49 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:13.270: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 21 06:45:13.270: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-zgzjd started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:13.270: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:13.270: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-7vwsn started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:13.270: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:13.270: INFO: netserver-3 started at 2023-01-21 06:42:05 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:13.270: INFO: 	Container webserver ready: false, restart count 0
Jan 21 06:45:13.270: INFO: coredns-559769c974-7fbns started at 2023-01-21 06:26:59 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:13.270: INFO: 	Container coredns ready: true, restart count 0
Jan 21 06:45:13.270: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-28wx9 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:13.270: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:13.270: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-mlsc7 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:13.270: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:13.270: INFO: pod-50b10bdb-b71a-4475-a054-a7d09c720326 started at 2023-01-21 06:42:06 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:13.270: INFO: 	Container write-pod ready: false, restart count 0
Jan 21 06:45:13.270: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-frfcl started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:13.270: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:13.659: INFO: 
Latency metrics for node i-0f3b8117f4ecfc9ec
[DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "fsgroupchangepolicy-3963" for this suite. �[38;5;243m01/21/23 06:45:13.659�[0m

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-apps] Deployment deployment should support proportional scaling [Conformance] 5m7s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-apps\]\sDeployment\sdeployment\sshould\ssupport\sproportional\sscaling\s\[Conformance\]$'

test/e2e/apps/deployment.go:1203
k8s.io/kubernetes/test/e2e/apps.testProportionalScalingDeployment(0xc00030c658?)
	test/e2e/apps/deployment.go:1203 +0x705
k8s.io/kubernetes/test/e2e/apps.glob..func5.11()
	test/e2e/apps/deployment.go:161 +0x1d
				[BeforeEach] [sig-apps] Deployment
  set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/21/23 06:35:14.165�[0m
Jan 21 06:35:14.166: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename deployment �[38;5;243m01/21/23 06:35:14.166�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/21/23 06:35:14.507�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/21/23 06:35:14.732�[0m
[BeforeEach] [sig-apps] Deployment
  test/e2e/framework/metrics/init/init.go:31
[BeforeEach] [sig-apps] Deployment
  test/e2e/apps/deployment.go:91
[It] deployment should support proportional scaling [Conformance]
  test/e2e/apps/deployment.go:160
Jan 21 06:35:14.957: INFO: Creating deployment "webserver-deployment"
Jan 21 06:35:15.071: INFO: Waiting for observed generation 1
Jan 21 06:35:15.217: INFO: Waiting for all required pods to come up
Jan 21 06:35:15.336: INFO: Pod name httpd: Found 10 pods out of 10
�[1mSTEP:�[0m ensuring each pod is running �[38;5;243m01/21/23 06:35:15.336�[0m
Jan 21 06:35:15.336: INFO: Waiting up to 5m0s for pod "webserver-deployment-7f5969cbc7-tzpsw" in namespace "deployment-9980" to be "running"
Jan 21 06:35:15.336: INFO: Waiting up to 5m0s for pod "webserver-deployment-7f5969cbc7-46bv8" in namespace "deployment-9980" to be "running"
Jan 21 06:35:15.336: INFO: Waiting up to 5m0s for pod "webserver-deployment-7f5969cbc7-bnzlj" in namespace "deployment-9980" to be "running"
Jan 21 06:35:15.336: INFO: Waiting up to 5m0s for pod "webserver-deployment-7f5969cbc7-bw8rr" in namespace "deployment-9980" to be "running"
Jan 21 06:35:15.336: INFO: Waiting up to 5m0s for pod "webserver-deployment-7f5969cbc7-db4fk" in namespace "deployment-9980" to be "running"
Jan 21 06:35:15.337: INFO: Waiting up to 5m0s for pod "webserver-deployment-7f5969cbc7-gsxt2" in namespace "deployment-9980" to be "running"
Jan 21 06:35:15.337: INFO: Waiting up to 5m0s for pod "webserver-deployment-7f5969cbc7-gwmd9" in namespace "deployment-9980" to be "running"
Jan 21 06:35:15.337: INFO: Waiting up to 5m0s for pod "webserver-deployment-7f5969cbc7-mgqtv" in namespace "deployment-9980" to be "running"
Jan 21 06:35:15.337: INFO: Waiting up to 5m0s for pod "webserver-deployment-7f5969cbc7-n88qc" in namespace "deployment-9980" to be "running"
Jan 21 06:35:15.337: INFO: Waiting up to 5m0s for pod "webserver-deployment-7f5969cbc7-qnq9n" in namespace "deployment-9980" to be "running"
Jan 21 06:35:15.452: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 114.994727ms
Jan 21 06:35:15.452: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 115.201434ms
Jan 21 06:35:15.452: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 115.45856ms
Jan 21 06:35:15.452: INFO: Pod "webserver-deployment-7f5969cbc7-bw8rr": Phase="Pending", Reason="", readiness=false. Elapsed: 115.381274ms
Jan 21 06:35:15.454: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 118.329333ms
Jan 21 06:35:15.454: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 117.718577ms
Jan 21 06:35:15.454: INFO: Pod "webserver-deployment-7f5969cbc7-qnq9n": Phase="Pending", Reason="", readiness=false. Elapsed: 117.614815ms
Jan 21 06:35:15.455: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 117.781506ms
Jan 21 06:35:15.455: INFO: Pod "webserver-deployment-7f5969cbc7-46bv8": Phase="Pending", Reason="", readiness=false. Elapsed: 118.505445ms
Jan 21 06:35:15.456: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 119.182648ms
Jan 21 06:35:17.567: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 2.230365672s
Jan 21 06:35:17.567: INFO: Pod "webserver-deployment-7f5969cbc7-bw8rr": Phase="Running", Reason="", readiness=true. Elapsed: 2.230250114s
Jan 21 06:35:17.567: INFO: Pod "webserver-deployment-7f5969cbc7-bw8rr" satisfied condition "running"
Jan 21 06:35:17.567: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 2.230171558s
Jan 21 06:35:17.567: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 2.230306862s
Jan 21 06:35:17.571: INFO: Pod "webserver-deployment-7f5969cbc7-46bv8": Phase="Pending", Reason="", readiness=false. Elapsed: 2.235110494s
Jan 21 06:35:17.571: INFO: Pod "webserver-deployment-7f5969cbc7-qnq9n": Phase="Pending", Reason="", readiness=false. Elapsed: 2.23440139s
Jan 21 06:35:17.571: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 2.234736181s
Jan 21 06:35:17.571: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 2.235461465s
Jan 21 06:35:17.572: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 2.234716371s
Jan 21 06:35:17.571: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2.234735754s
Jan 21 06:35:19.573: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 4.236213296s
Jan 21 06:35:19.573: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4.236270395s
Jan 21 06:35:19.573: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 4.236343472s
Jan 21 06:35:19.573: INFO: Pod "webserver-deployment-7f5969cbc7-qnq9n": Phase="Pending", Reason="", readiness=false. Elapsed: 4.236184969s
Jan 21 06:35:19.573: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 4.237070042s
Jan 21 06:35:19.573: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 4.236518821s
Jan 21 06:35:19.573: INFO: Pod "webserver-deployment-7f5969cbc7-46bv8": Phase="Pending", Reason="", readiness=false. Elapsed: 4.236957753s
Jan 21 06:35:19.573: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 4.236903734s
Jan 21 06:35:19.573: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 4.236720501s
Jan 21 06:35:21.567: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 6.23027934s
Jan 21 06:35:21.567: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 6.230114677s
Jan 21 06:35:21.567: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 6.229997767s
Jan 21 06:35:21.570: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 6.234215889s
Jan 21 06:35:21.570: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 6.233558497s
Jan 21 06:35:21.570: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 6.233444712s
Jan 21 06:35:21.570: INFO: Pod "webserver-deployment-7f5969cbc7-46bv8": Phase="Pending", Reason="", readiness=false. Elapsed: 6.234073681s
Jan 21 06:35:21.570: INFO: Pod "webserver-deployment-7f5969cbc7-qnq9n": Phase="Pending", Reason="", readiness=false. Elapsed: 6.233418936s
Jan 21 06:35:21.570: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 6.233595756s
Jan 21 06:35:23.565: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 8.22876296s
Jan 21 06:35:23.565: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 8.228928539s
Jan 21 06:35:23.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 8.229265428s
Jan 21 06:35:23.569: INFO: Pod "webserver-deployment-7f5969cbc7-46bv8": Phase="Pending", Reason="", readiness=false. Elapsed: 8.233058931s
Jan 21 06:35:23.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 8.233390699s
Jan 21 06:35:23.569: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 8.232739659s
Jan 21 06:35:23.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 8.232710504s
Jan 21 06:35:23.570: INFO: Pod "webserver-deployment-7f5969cbc7-qnq9n": Phase="Pending", Reason="", readiness=false. Elapsed: 8.232648381s
Jan 21 06:35:23.570: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 8.233521849s
Jan 21 06:35:25.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 10.229449789s
Jan 21 06:35:25.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 10.229721357s
Jan 21 06:35:25.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 10.229391341s
Jan 21 06:35:25.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 10.233146541s
Jan 21 06:35:25.569: INFO: Pod "webserver-deployment-7f5969cbc7-46bv8": Phase="Pending", Reason="", readiness=false. Elapsed: 10.233291627s
Jan 21 06:35:25.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 10.232709783s
Jan 21 06:35:25.570: INFO: Pod "webserver-deployment-7f5969cbc7-qnq9n": Phase="Pending", Reason="", readiness=false. Elapsed: 10.232666792s
Jan 21 06:35:25.570: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 10.232897491s
Jan 21 06:35:25.570: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 10.233246961s
Jan 21 06:35:27.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 12.229776932s
Jan 21 06:35:27.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 12.229641535s
Jan 21 06:35:27.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 12.230074738s
Jan 21 06:35:27.569: INFO: Pod "webserver-deployment-7f5969cbc7-46bv8": Phase="Pending", Reason="", readiness=false. Elapsed: 12.232744023s
Jan 21 06:35:27.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 12.233136713s
Jan 21 06:35:27.569: INFO: Pod "webserver-deployment-7f5969cbc7-qnq9n": Phase="Pending", Reason="", readiness=false. Elapsed: 12.232266649s
Jan 21 06:35:27.570: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 12.232845232s
Jan 21 06:35:27.571: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 12.233941478s
Jan 21 06:35:27.571: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 12.234185284s
Jan 21 06:35:29.567: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 14.229936768s
Jan 21 06:35:29.567: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 14.230314355s
Jan 21 06:35:29.567: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 14.230190388s
Jan 21 06:35:29.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 14.232442533s
Jan 21 06:35:29.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 14.233272887s
Jan 21 06:35:29.570: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 14.232840051s
Jan 21 06:35:29.570: INFO: Pod "webserver-deployment-7f5969cbc7-46bv8": Phase="Running", Reason="", readiness=true. Elapsed: 14.233415869s
Jan 21 06:35:29.570: INFO: Pod "webserver-deployment-7f5969cbc7-46bv8" satisfied condition "running"
Jan 21 06:35:29.570: INFO: Pod "webserver-deployment-7f5969cbc7-qnq9n": Phase="Pending", Reason="", readiness=false. Elapsed: 14.232703124s
Jan 21 06:35:29.570: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 14.233714254s
Jan 21 06:35:31.567: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 16.229986316s
Jan 21 06:35:31.567: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 16.23015854s
Jan 21 06:35:31.567: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 16.230383087s
Jan 21 06:35:31.570: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 16.234122443s
Jan 21 06:35:31.570: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 16.23342701s
Jan 21 06:35:31.570: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 16.233557265s
Jan 21 06:35:31.570: INFO: Pod "webserver-deployment-7f5969cbc7-qnq9n": Phase="Pending", Reason="", readiness=false. Elapsed: 16.233341516s
Jan 21 06:35:31.570: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 16.233471071s
Jan 21 06:35:33.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 18.229888365s
Jan 21 06:35:33.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 18.230256605s
Jan 21 06:35:33.567: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 18.230082954s
Jan 21 06:35:33.569: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 18.231824298s
Jan 21 06:35:33.569: INFO: Pod "webserver-deployment-7f5969cbc7-qnq9n": Phase="Pending", Reason="", readiness=false. Elapsed: 18.231728647s
Jan 21 06:35:33.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 18.232607392s
Jan 21 06:35:33.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 18.231861463s
Jan 21 06:35:33.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 18.23253032s
Jan 21 06:35:35.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 20.229365759s
Jan 21 06:35:35.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 20.229725481s
Jan 21 06:35:35.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 20.229570368s
Jan 21 06:35:35.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 20.232058126s
Jan 21 06:35:35.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 20.23140946s
Jan 21 06:35:35.568: INFO: Pod "webserver-deployment-7f5969cbc7-qnq9n": Phase="Pending", Reason="", readiness=false. Elapsed: 20.231368122s
Jan 21 06:35:35.569: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 20.232286176s
Jan 21 06:35:35.570: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 20.232905105s
Jan 21 06:35:37.570: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 22.233805703s
Jan 21 06:35:37.570: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 22.233674364s
Jan 21 06:35:37.570: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 22.234442198s
Jan 21 06:35:37.570: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 22.233769764s
Jan 21 06:35:37.571: INFO: Pod "webserver-deployment-7f5969cbc7-qnq9n": Phase="Pending", Reason="", readiness=false. Elapsed: 22.233622049s
Jan 21 06:35:37.570: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 22.234051809s
Jan 21 06:35:37.571: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 22.234649654s
Jan 21 06:35:37.571: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 22.23511601s
Jan 21 06:35:39.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 24.229848388s
Jan 21 06:35:39.568: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 24.231879676s
Jan 21 06:35:39.568: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 24.232223027s
Jan 21 06:35:39.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 24.232450874s
Jan 21 06:35:39.569: INFO: Pod "webserver-deployment-7f5969cbc7-qnq9n": Phase="Pending", Reason="", readiness=false. Elapsed: 24.232395442s
Jan 21 06:35:39.570: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 24.23279293s
Jan 21 06:35:39.570: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 24.233733413s
Jan 21 06:35:39.570: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 24.233186052s
Jan 21 06:35:41.565: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 26.228853518s
Jan 21 06:35:41.565: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 26.228774986s
Jan 21 06:35:41.565: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 26.22917029s
Jan 21 06:35:41.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 26.232263253s
Jan 21 06:35:41.569: INFO: Pod "webserver-deployment-7f5969cbc7-qnq9n": Phase="Pending", Reason="", readiness=false. Elapsed: 26.232171337s
Jan 21 06:35:41.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 26.233050707s
Jan 21 06:35:41.569: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 26.232374184s
Jan 21 06:35:41.570: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 26.232960549s
Jan 21 06:35:43.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 28.229806329s
Jan 21 06:35:43.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 28.22962317s
Jan 21 06:35:43.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 28.230082487s
Jan 21 06:35:43.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 28.232913984s
Jan 21 06:35:43.569: INFO: Pod "webserver-deployment-7f5969cbc7-qnq9n": Phase="Pending", Reason="", readiness=false. Elapsed: 28.232040181s
Jan 21 06:35:43.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 28.232205052s
Jan 21 06:35:43.570: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 28.232821124s
Jan 21 06:35:43.570: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 28.233053793s
Jan 21 06:35:45.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 30.229258791s
Jan 21 06:35:45.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 30.229281138s
Jan 21 06:35:45.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 30.229668973s
Jan 21 06:35:45.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 30.232310162s
Jan 21 06:35:45.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 30.231663851s
Jan 21 06:35:45.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 30.23192811s
Jan 21 06:35:45.569: INFO: Pod "webserver-deployment-7f5969cbc7-qnq9n": Phase="Pending", Reason="", readiness=false. Elapsed: 30.232088607s
Jan 21 06:35:45.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 30.23238278s
Jan 21 06:35:47.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 32.229505663s
Jan 21 06:35:47.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 32.229644368s
Jan 21 06:35:47.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 32.229844364s
Jan 21 06:35:47.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 32.231889167s
Jan 21 06:35:47.569: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 32.232001943s
Jan 21 06:35:47.569: INFO: Pod "webserver-deployment-7f5969cbc7-qnq9n": Phase="Pending", Reason="", readiness=false. Elapsed: 32.231869285s
Jan 21 06:35:47.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 32.23278069s
Jan 21 06:35:47.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 32.232784694s
Jan 21 06:35:49.565: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 34.229157436s
Jan 21 06:35:49.565: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 34.228881331s
Jan 21 06:35:49.565: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 34.229055509s
Jan 21 06:35:49.568: INFO: Pod "webserver-deployment-7f5969cbc7-qnq9n": Phase="Pending", Reason="", readiness=false. Elapsed: 34.231489906s
Jan 21 06:35:49.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 34.231596074s
Jan 21 06:35:49.569: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 34.232644983s
Jan 21 06:35:49.570: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 34.233624178s
Jan 21 06:35:49.570: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 34.233003263s
Jan 21 06:35:51.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 36.229851677s
Jan 21 06:35:51.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 36.229689499s
Jan 21 06:35:51.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 36.229602353s
Jan 21 06:35:51.568: INFO: Pod "webserver-deployment-7f5969cbc7-qnq9n": Phase="Pending", Reason="", readiness=false. Elapsed: 36.23151176s
Jan 21 06:35:51.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 36.23239013s
Jan 21 06:35:51.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 36.231647591s
Jan 21 06:35:51.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 36.231720165s
Jan 21 06:35:51.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 36.232707624s
Jan 21 06:35:53.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 38.2295854s
Jan 21 06:35:53.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 38.229721353s
Jan 21 06:35:53.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 38.229968303s
Jan 21 06:35:53.570: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 38.233723041s
Jan 21 06:35:53.570: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 38.233184396s
Jan 21 06:35:53.570: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 38.233171642s
Jan 21 06:35:53.570: INFO: Pod "webserver-deployment-7f5969cbc7-qnq9n": Phase="Pending", Reason="", readiness=false. Elapsed: 38.233033156s
Jan 21 06:35:53.570: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 38.233143101s
Jan 21 06:35:55.567: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 40.230575448s
Jan 21 06:35:55.567: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 40.230375576s
Jan 21 06:35:55.567: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 40.230329858s
Jan 21 06:35:55.570: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 40.232991962s
Jan 21 06:35:55.570: INFO: Pod "webserver-deployment-7f5969cbc7-qnq9n": Phase="Pending", Reason="", readiness=false. Elapsed: 40.232902976s
Jan 21 06:35:55.570: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 40.233432542s
Jan 21 06:35:55.570: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 40.234167951s
Jan 21 06:35:55.571: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 40.233892597s
Jan 21 06:35:57.565: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 42.228980348s
Jan 21 06:35:57.565: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 42.228839205s
Jan 21 06:35:57.565: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 42.229178481s
Jan 21 06:35:57.569: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 42.23203772s
Jan 21 06:35:57.569: INFO: Pod "webserver-deployment-7f5969cbc7-qnq9n": Phase="Pending", Reason="", readiness=false. Elapsed: 42.231893498s
Jan 21 06:35:57.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 42.232139299s
Jan 21 06:35:57.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 42.233147854s
Jan 21 06:35:57.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 42.232743702s
Jan 21 06:35:59.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 44.229886661s
Jan 21 06:35:59.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 44.230086618s
Jan 21 06:35:59.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 44.229841631s
Jan 21 06:35:59.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 44.233274246s
Jan 21 06:35:59.569: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 44.232582924s
Jan 21 06:35:59.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 44.232610141s
Jan 21 06:35:59.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 44.232813624s
Jan 21 06:35:59.569: INFO: Pod "webserver-deployment-7f5969cbc7-qnq9n": Phase="Pending", Reason="", readiness=false. Elapsed: 44.232620026s
Jan 21 06:36:01.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 46.229942336s
Jan 21 06:36:01.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 46.229869008s
Jan 21 06:36:01.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 46.22973381s
Jan 21 06:36:01.568: INFO: Pod "webserver-deployment-7f5969cbc7-qnq9n": Phase="Pending", Reason="", readiness=false. Elapsed: 46.231360469s
Jan 21 06:36:01.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 46.232337704s
Jan 21 06:36:01.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 46.23165023s
Jan 21 06:36:01.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 46.23164659s
Jan 21 06:36:01.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 46.232455904s
Jan 21 06:36:03.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 48.229156017s
Jan 21 06:36:03.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 48.229780267s
Jan 21 06:36:03.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 48.229614078s
Jan 21 06:36:03.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 48.231909527s
Jan 21 06:36:03.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 48.232742064s
Jan 21 06:36:03.569: INFO: Pod "webserver-deployment-7f5969cbc7-qnq9n": Phase="Pending", Reason="", readiness=false. Elapsed: 48.231912942s
Jan 21 06:36:03.569: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 48.232129538s
Jan 21 06:36:03.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 48.232495776s
Jan 21 06:36:05.565: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 50.228982529s
Jan 21 06:36:05.565: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 50.229182564s
Jan 21 06:36:05.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 50.229032672s
Jan 21 06:36:05.569: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 50.232299646s
Jan 21 06:36:05.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 50.233049025s
Jan 21 06:36:05.569: INFO: Pod "webserver-deployment-7f5969cbc7-qnq9n": Phase="Pending", Reason="", readiness=false. Elapsed: 50.232190075s
Jan 21 06:36:05.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 50.232321914s
Jan 21 06:36:05.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 50.232807731s
Jan 21 06:36:07.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 52.230168706s
Jan 21 06:36:07.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 52.229861765s
Jan 21 06:36:07.567: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 52.23019075s
Jan 21 06:36:07.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 52.231799048s
Jan 21 06:36:07.569: INFO: Pod "webserver-deployment-7f5969cbc7-qnq9n": Phase="Pending", Reason="", readiness=false. Elapsed: 52.231733281s
Jan 21 06:36:07.569: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 52.232559398s
Jan 21 06:36:07.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 52.233329807s
Jan 21 06:36:07.570: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 52.232938778s
Jan 21 06:36:09.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 54.229951593s
Jan 21 06:36:09.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 54.23021197s
Jan 21 06:36:09.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 54.229883899s
Jan 21 06:36:09.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 54.23175535s
Jan 21 06:36:09.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 54.232357261s
Jan 21 06:36:09.570: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 54.233560845s
Jan 21 06:36:09.571: INFO: Pod "webserver-deployment-7f5969cbc7-qnq9n": Phase="Pending", Reason="", readiness=false. Elapsed: 54.234002803s
Jan 21 06:36:09.571: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 54.23438072s
Jan 21 06:36:11.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 56.230021775s
Jan 21 06:36:11.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 56.230214787s
Jan 21 06:36:11.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 56.22987945s
Jan 21 06:36:11.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 56.232481245s
Jan 21 06:36:11.569: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 56.23190441s
Jan 21 06:36:11.569: INFO: Pod "webserver-deployment-7f5969cbc7-qnq9n": Phase="Pending", Reason="", readiness=false. Elapsed: 56.231750229s
Jan 21 06:36:11.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 56.231871492s
Jan 21 06:36:11.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 56.232737628s
Jan 21 06:36:13.567: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 58.230313636s
Jan 21 06:36:13.567: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 58.230006931s
Jan 21 06:36:13.567: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 58.230194678s
Jan 21 06:36:13.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 58.232997106s
Jan 21 06:36:13.569: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 58.232339181s
Jan 21 06:36:13.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 58.232338205s
Jan 21 06:36:13.569: INFO: Pod "webserver-deployment-7f5969cbc7-qnq9n": Phase="Pending", Reason="", readiness=false. Elapsed: 58.232275386s
Jan 21 06:36:13.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 58.232585545s
Jan 21 06:36:15.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.229012221s
Jan 21 06:36:15.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.229147135s
Jan 21 06:36:15.567: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.2304994s
Jan 21 06:36:15.575: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.238619672s
Jan 21 06:36:15.575: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.238017659s
Jan 21 06:36:15.575: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.238010427s
Jan 21 06:36:15.575: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.238043509s
Jan 21 06:36:15.575: INFO: Pod "webserver-deployment-7f5969cbc7-qnq9n": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.237984748s
Jan 21 06:36:17.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.229507194s
Jan 21 06:36:17.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.229860331s
Jan 21 06:36:17.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.229745628s
Jan 21 06:36:17.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.232438762s
Jan 21 06:36:17.568: INFO: Pod "webserver-deployment-7f5969cbc7-qnq9n": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.23156429s
Jan 21 06:36:17.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.231710854s
Jan 21 06:36:17.569: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.231781178s
Jan 21 06:36:17.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.232497217s
Jan 21 06:36:19.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.229275795s
Jan 21 06:36:19.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.228940593s
Jan 21 06:36:19.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.229094237s
Jan 21 06:36:19.569: INFO: Pod "webserver-deployment-7f5969cbc7-qnq9n": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.23193634s
Jan 21 06:36:19.570: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.233620597s
Jan 21 06:36:19.570: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.232963135s
Jan 21 06:36:19.570: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.232909155s
Jan 21 06:36:19.570: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.232966015s
Jan 21 06:36:21.567: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.230636987s
Jan 21 06:36:21.567: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.230972694s
Jan 21 06:36:21.567: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.23090039s
Jan 21 06:36:21.571: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.234574224s
Jan 21 06:36:21.571: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.233916543s
Jan 21 06:36:21.571: INFO: Pod "webserver-deployment-7f5969cbc7-qnq9n": Phase="Running", Reason="", readiness=true. Elapsed: 1m6.233756169s
Jan 21 06:36:21.571: INFO: Pod "webserver-deployment-7f5969cbc7-qnq9n" satisfied condition "running"
Jan 21 06:36:21.571: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.233860819s
Jan 21 06:36:21.571: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.233989221s
Jan 21 06:36:23.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.229410162s
Jan 21 06:36:23.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.229276217s
Jan 21 06:36:23.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.22916768s
Jan 21 06:36:23.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.231185746s
Jan 21 06:36:23.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.23201247s
Jan 21 06:36:23.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.231306366s
Jan 21 06:36:23.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.232051504s
Jan 21 06:36:25.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.229045023s
Jan 21 06:36:25.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.229180239s
Jan 21 06:36:25.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.22943996s
Jan 21 06:36:25.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.231813736s
Jan 21 06:36:25.569: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.231981616s
Jan 21 06:36:25.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.232748398s
Jan 21 06:36:25.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.23252221s
Jan 21 06:36:27.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.230164872s
Jan 21 06:36:27.567: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.229983421s
Jan 21 06:36:27.567: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.230279324s
Jan 21 06:36:27.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.232809466s
Jan 21 06:36:27.569: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.232117402s
Jan 21 06:36:27.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.23206053s
Jan 21 06:36:27.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.23227593s
Jan 21 06:36:29.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.229025944s
Jan 21 06:36:29.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.229386446s
Jan 21 06:36:29.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.229244614s
Jan 21 06:36:29.569: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.231990238s
Jan 21 06:36:29.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.231939679s
Jan 21 06:36:29.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.232712328s
Jan 21 06:36:29.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.23246795s
Jan 21 06:36:31.565: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.22884356s
Jan 21 06:36:31.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.22926409s
Jan 21 06:36:31.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.229064032s
Jan 21 06:36:31.569: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.232241162s
Jan 21 06:36:31.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.23298026s
Jan 21 06:36:31.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.232488995s
Jan 21 06:36:31.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.232395914s
Jan 21 06:36:33.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.229298118s
Jan 21 06:36:33.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.229499518s
Jan 21 06:36:33.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.229246945s
Jan 21 06:36:33.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.23188828s
Jan 21 06:36:33.569: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.231944833s
Jan 21 06:36:33.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.232714921s
Jan 21 06:36:33.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.232666142s
Jan 21 06:36:35.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.228973145s
Jan 21 06:36:35.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.229305778s
Jan 21 06:36:35.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.229118533s
Jan 21 06:36:35.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.230929793s
Jan 21 06:36:35.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.231691085s
Jan 21 06:36:35.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.230933132s
Jan 21 06:36:35.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.232182843s
Jan 21 06:36:37.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.229886093s
Jan 21 06:36:37.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.230218324s
Jan 21 06:36:37.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.229883327s
Jan 21 06:36:37.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.232208645s
Jan 21 06:36:37.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.231493389s
Jan 21 06:36:37.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.231478103s
Jan 21 06:36:37.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.232575982s
Jan 21 06:36:39.565: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.228861917s
Jan 21 06:36:39.565: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.228997231s
Jan 21 06:36:39.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.229289981s
Jan 21 06:36:39.569: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.232609966s
Jan 21 06:36:39.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.232717616s
Jan 21 06:36:39.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.232623741s
Jan 21 06:36:39.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.233450299s
Jan 21 06:36:41.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.229399869s
Jan 21 06:36:41.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.229534948s
Jan 21 06:36:41.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.22979479s
Jan 21 06:36:41.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.231190824s
Jan 21 06:36:41.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.23149634s
Jan 21 06:36:41.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.232260311s
Jan 21 06:36:41.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.232610284s
Jan 21 06:36:43.565: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.228606452s
Jan 21 06:36:43.565: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.228741777s
Jan 21 06:36:43.565: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.2289978s
Jan 21 06:36:43.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.231918445s
Jan 21 06:36:43.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.231584247s
Jan 21 06:36:43.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.231688562s
Jan 21 06:36:43.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.232415948s
Jan 21 06:36:45.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.230040502s
Jan 21 06:36:45.567: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.230264892s
Jan 21 06:36:45.567: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.229928662s
Jan 21 06:36:45.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.231266228s
Jan 21 06:36:45.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.231435026s
Jan 21 06:36:45.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.232593497s
Jan 21 06:36:45.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.23264985s
Jan 21 06:36:47.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.228968675s
Jan 21 06:36:47.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.229304979s
Jan 21 06:36:47.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.229115541s
Jan 21 06:36:47.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.231508284s
Jan 21 06:36:47.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.231685765s
Jan 21 06:36:47.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.232555402s
Jan 21 06:36:47.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.232512832s
Jan 21 06:36:49.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.23010388s
Jan 21 06:36:49.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.229909315s
Jan 21 06:36:49.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.229768986s
Jan 21 06:36:49.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.232072535s
Jan 21 06:36:49.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.231353668s
Jan 21 06:36:49.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.231428252s
Jan 21 06:36:49.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.232353512s
Jan 21 06:36:51.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.229815845s
Jan 21 06:36:51.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.229697701s
Jan 21 06:36:51.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.23000747s
Jan 21 06:36:51.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.232517526s
Jan 21 06:36:51.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.231781339s
Jan 21 06:36:51.569: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.23183445s
Jan 21 06:36:51.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.23275341s
Jan 21 06:36:53.565: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.228805877s
Jan 21 06:36:53.565: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.228670784s
Jan 21 06:36:53.565: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.229145858s
Jan 21 06:36:53.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.232273841s
Jan 21 06:36:53.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.231551833s
Jan 21 06:36:53.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.231665693s
Jan 21 06:36:53.570: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.232901587s
Jan 21 06:36:55.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.22963909s
Jan 21 06:36:55.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.229504227s
Jan 21 06:36:55.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.229839084s
Jan 21 06:36:55.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.231140961s
Jan 21 06:36:55.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.231086649s
Jan 21 06:36:55.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.23196485s
Jan 21 06:36:55.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.232074204s
Jan 21 06:36:57.567: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.230133941s
Jan 21 06:36:57.567: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.230013674s
Jan 21 06:36:57.567: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.23048443s
Jan 21 06:36:57.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.231736514s
Jan 21 06:36:57.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.232556791s
Jan 21 06:36:57.569: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.231904801s
Jan 21 06:36:57.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.232794527s
Jan 21 06:36:59.565: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.229060248s
Jan 21 06:36:59.565: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.228735171s
Jan 21 06:36:59.565: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.228925184s
Jan 21 06:36:59.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.231612822s
Jan 21 06:36:59.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.231704557s
Jan 21 06:36:59.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.232482608s
Jan 21 06:36:59.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.232423619s
Jan 21 06:37:01.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.229276448s
Jan 21 06:37:01.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.228941191s
Jan 21 06:37:01.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.229076329s
Jan 21 06:37:01.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.231548098s
Jan 21 06:37:01.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.232272303s
Jan 21 06:37:01.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.231537151s
Jan 21 06:37:01.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.232416047s
Jan 21 06:37:03.565: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.229091768s
Jan 21 06:37:03.565: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.22883306s
Jan 21 06:37:03.565: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.228996438s
Jan 21 06:37:03.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.231656983s
Jan 21 06:37:03.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.232477503s
Jan 21 06:37:03.569: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.231803268s
Jan 21 06:37:03.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.232462675s
Jan 21 06:37:05.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.229288945s
Jan 21 06:37:05.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.22959743s
Jan 21 06:37:05.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.229466826s
Jan 21 06:37:05.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.231481594s
Jan 21 06:37:05.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.232309277s
Jan 21 06:37:05.569: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.231797732s
Jan 21 06:37:05.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.232444917s
Jan 21 06:37:07.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.229788797s
Jan 21 06:37:07.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.229948764s
Jan 21 06:37:07.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.230154548s
Jan 21 06:37:07.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.23171106s
Jan 21 06:37:07.569: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.231956685s
Jan 21 06:37:07.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.232696232s
Jan 21 06:37:07.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.232409963s
Jan 21 06:37:09.570: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.233223386s
Jan 21 06:37:09.570: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.233358862s
Jan 21 06:37:09.570: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.233558678s
Jan 21 06:37:09.571: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.233837497s
Jan 21 06:37:09.571: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.234300322s
Jan 21 06:37:09.571: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.235030471s
Jan 21 06:37:09.571: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.234317933s
Jan 21 06:37:11.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.229347583s
Jan 21 06:37:11.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.229060972s
Jan 21 06:37:11.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.229228862s
Jan 21 06:37:11.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.231763814s
Jan 21 06:37:11.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.232589215s
Jan 21 06:37:11.569: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.23189722s
Jan 21 06:37:11.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.232750115s
Jan 21 06:37:13.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.228996662s
Jan 21 06:37:13.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.229187252s
Jan 21 06:37:13.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.229417814s
Jan 21 06:37:13.567: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.230688556s
Jan 21 06:37:13.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.230785611s
Jan 21 06:37:13.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.231572117s
Jan 21 06:37:13.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.232477883s
Jan 21 06:37:15.567: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.230337992s
Jan 21 06:37:15.567: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.230554613s
Jan 21 06:37:15.567: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.230303516s
Jan 21 06:37:15.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.231439366s
Jan 21 06:37:15.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.231565192s
Jan 21 06:37:15.568: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.231762677s
Jan 21 06:37:15.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.232432727s
Jan 21 06:37:17.565: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.228939174s
Jan 21 06:37:17.565: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.22913904s
Jan 21 06:37:17.565: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.228864065s
Jan 21 06:37:17.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.231598505s
Jan 21 06:37:17.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.23272184s
Jan 21 06:37:17.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.231983465s
Jan 21 06:37:17.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.232663141s
Jan 21 06:37:19.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.229912532s
Jan 21 06:37:19.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.229877704s
Jan 21 06:37:19.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.230254503s
Jan 21 06:37:19.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.232168255s
Jan 21 06:37:19.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.231589791s
Jan 21 06:37:19.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.231573013s
Jan 21 06:37:19.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.232378093s
Jan 21 06:37:21.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.229192119s
Jan 21 06:37:21.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.229527721s
Jan 21 06:37:21.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.229345446s
Jan 21 06:37:21.570: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.232790101s
Jan 21 06:37:21.570: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.232733359s
Jan 21 06:37:21.570: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.23351213s
Jan 21 06:37:21.570: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.233436279s
Jan 21 06:37:23.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.229766865s
Jan 21 06:37:23.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.229964361s
Jan 21 06:37:23.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.23018995s
Jan 21 06:37:23.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.230947434s
Jan 21 06:37:23.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.232707455s
Jan 21 06:37:23.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.231981209s
Jan 21 06:37:23.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.232122568s
Jan 21 06:37:25.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.229431036s
Jan 21 06:37:25.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.229357458s
Jan 21 06:37:25.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.229727537s
Jan 21 06:37:25.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.230875737s
Jan 21 06:37:25.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.232300457s
Jan 21 06:37:25.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.23164385s
Jan 21 06:37:25.568: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.2318261s
Jan 21 06:37:27.567: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.230336904s
Jan 21 06:37:27.567: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.230156886s
Jan 21 06:37:27.567: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.230095688s
Jan 21 06:37:27.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.231732133s
Jan 21 06:37:27.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.232539092s
Jan 21 06:37:27.569: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.231908381s
Jan 21 06:37:27.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.23276058s
Jan 21 06:37:29.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.229846133s
Jan 21 06:37:29.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.230046065s
Jan 21 06:37:29.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.22978642s
Jan 21 06:37:29.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.231519177s
Jan 21 06:37:29.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.232241091s
Jan 21 06:37:29.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.231524585s
Jan 21 06:37:29.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.232446068s
Jan 21 06:37:31.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.229964733s
Jan 21 06:37:31.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.22982958s
Jan 21 06:37:31.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.230164767s
Jan 21 06:37:31.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.231388615s
Jan 21 06:37:31.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.231543777s
Jan 21 06:37:31.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.232360364s
Jan 21 06:37:31.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.232828958s
Jan 21 06:37:33.565: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.228658861s
Jan 21 06:37:33.565: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.228864369s
Jan 21 06:37:33.565: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.22906478s
Jan 21 06:37:33.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.231512126s
Jan 21 06:37:33.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.231585404s
Jan 21 06:37:33.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.232379357s
Jan 21 06:37:33.570: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.232877494s
Jan 21 06:37:35.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.229307325s
Jan 21 06:37:35.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.228989505s
Jan 21 06:37:35.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.229230791s
Jan 21 06:37:35.569: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.231966926s
Jan 21 06:37:35.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.231920528s
Jan 21 06:37:35.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.232769283s
Jan 21 06:37:35.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.232646875s
Jan 21 06:37:37.565: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.228597749s
Jan 21 06:37:37.565: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.22875568s
Jan 21 06:37:37.565: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.228964279s
Jan 21 06:37:37.569: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.232714606s
Jan 21 06:37:37.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.232784787s
Jan 21 06:37:37.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.233461006s
Jan 21 06:37:37.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.232701736s
Jan 21 06:37:39.565: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.228795347s
Jan 21 06:37:39.565: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.229029601s
Jan 21 06:37:39.565: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.228757803s
Jan 21 06:37:39.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.231661461s
Jan 21 06:37:39.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.232488676s
Jan 21 06:37:39.569: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.231789064s
Jan 21 06:37:39.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.232701731s
Jan 21 06:37:41.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.229909902s
Jan 21 06:37:41.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.229838123s
Jan 21 06:37:41.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.230224195s
Jan 21 06:37:41.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.231579392s
Jan 21 06:37:41.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.232003761s
Jan 21 06:37:41.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.23284149s
Jan 21 06:37:41.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.232568867s
Jan 21 06:37:43.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.229625999s
Jan 21 06:37:43.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.229760212s
Jan 21 06:37:43.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.230020927s
Jan 21 06:37:43.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.231652888s
Jan 21 06:37:43.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.232431776s
Jan 21 06:37:43.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.231766911s
Jan 21 06:37:43.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.232093521s
Jan 21 06:37:45.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.229814505s
Jan 21 06:37:45.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.230048219s
Jan 21 06:37:45.567: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.230276983s
Jan 21 06:37:45.569: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.232006829s
Jan 21 06:37:45.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.232734004s
Jan 21 06:37:45.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.232019926s
Jan 21 06:37:45.570: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.232894025s
Jan 21 06:37:47.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.229344922s
Jan 21 06:37:47.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.229144918s
Jan 21 06:37:47.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.22901458s
Jan 21 06:37:47.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.23248203s
Jan 21 06:37:47.569: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.231791686s
Jan 21 06:37:47.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.231759475s
Jan 21 06:37:47.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.232519506s
Jan 21 06:37:49.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.22996734s
Jan 21 06:37:49.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.229757414s
Jan 21 06:37:49.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.229695877s
Jan 21 06:37:49.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.231036928s
Jan 21 06:37:49.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.231570496s
Jan 21 06:37:49.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.232411267s
Jan 21 06:37:49.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.232199365s
Jan 21 06:37:51.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.229905615s
Jan 21 06:37:51.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.230177729s
Jan 21 06:37:51.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.229877042s
Jan 21 06:37:51.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.231141216s
Jan 21 06:37:51.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.231494518s
Jan 21 06:37:51.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.232580912s
Jan 21 06:37:51.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.232567548s
Jan 21 06:37:53.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.229059099s
Jan 21 06:37:53.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.229270897s
Jan 21 06:37:53.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.228981447s
Jan 21 06:37:53.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.232408825s
Jan 21 06:37:53.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.23174464s
Jan 21 06:37:53.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.231756466s
Jan 21 06:37:53.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.232645196s
Jan 21 06:37:55.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.229089418s
Jan 21 06:37:55.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.229295507s
Jan 21 06:37:55.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.229025937s
Jan 21 06:37:55.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.232825974s
Jan 21 06:37:55.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.232458475s
Jan 21 06:37:55.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.232380864s
Jan 21 06:37:55.569: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.232400605s
Jan 21 06:37:57.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.229679293s
Jan 21 06:37:57.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.229883137s
Jan 21 06:37:57.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.23010615s
Jan 21 06:37:57.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.231215081s
Jan 21 06:37:57.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.231279992s
Jan 21 06:37:57.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.232177252s
Jan 21 06:37:57.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.232175564s
Jan 21 06:37:59.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.229681374s
Jan 21 06:37:59.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.229505978s
Jan 21 06:37:59.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.229417478s
Jan 21 06:37:59.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.231470254s
Jan 21 06:37:59.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.231418112s
Jan 21 06:37:59.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.232242834s
Jan 21 06:37:59.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.232275206s
Jan 21 06:38:01.565: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.229159599s
Jan 21 06:38:01.565: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.228974693s
Jan 21 06:38:01.565: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.228890514s
Jan 21 06:38:01.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.231757413s
Jan 21 06:38:01.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.23258176s
Jan 21 06:38:01.569: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.231859879s
Jan 21 06:38:01.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.232439518s
Jan 21 06:38:03.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.229917321s
Jan 21 06:38:03.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.229782184s
Jan 21 06:38:03.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.230136088s
Jan 21 06:38:03.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.231464921s
Jan 21 06:38:03.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.231411379s
Jan 21 06:38:03.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.232231878s
Jan 21 06:38:03.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.232306506s
Jan 21 06:38:05.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.22946405s
Jan 21 06:38:05.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.229864625s
Jan 21 06:38:05.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.229672848s
Jan 21 06:38:05.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.232777729s
Jan 21 06:38:05.570: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.232792387s
Jan 21 06:38:05.570: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.233560744s
Jan 21 06:38:05.570: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.232797425s
Jan 21 06:38:07.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.229594466s
Jan 21 06:38:07.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.229794397s
Jan 21 06:38:07.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.229501251s
Jan 21 06:38:07.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.231677717s
Jan 21 06:38:07.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.232399947s
Jan 21 06:38:07.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.231621071s
Jan 21 06:38:07.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.232211164s
Jan 21 06:38:09.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.229848931s
Jan 21 06:38:09.567: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.230533455s
Jan 21 06:38:09.567: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.230419561s
Jan 21 06:38:09.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.231560897s
Jan 21 06:38:09.569: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.232400824s
Jan 21 06:38:09.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.232548415s
Jan 21 06:38:09.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.233341995s
Jan 21 06:38:11.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.229616597s
Jan 21 06:38:11.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.229481441s
Jan 21 06:38:11.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.229873673s
Jan 21 06:38:11.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.231445365s
Jan 21 06:38:11.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.232222025s
Jan 21 06:38:11.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.231506821s
Jan 21 06:38:11.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.232188818s
Jan 21 06:38:13.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.229640372s
Jan 21 06:38:13.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.229768652s
Jan 21 06:38:13.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.2296542s
Jan 21 06:38:13.567: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.230753174s
Jan 21 06:38:13.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.232670988s
Jan 21 06:38:13.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.23191927s
Jan 21 06:38:13.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.232340324s
Jan 21 06:38:15.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.229293249s
Jan 21 06:38:15.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.229649033s
Jan 21 06:38:15.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.229480873s
Jan 21 06:38:15.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.231075825s
Jan 21 06:38:15.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.231829926s
Jan 21 06:38:15.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.231088518s
Jan 21 06:38:15.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.232076288s
Jan 21 06:38:17.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.22920255s
Jan 21 06:38:17.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.229337955s
Jan 21 06:38:17.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.229544276s
Jan 21 06:38:17.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.231798436s
Jan 21 06:38:17.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.232609527s
Jan 21 06:38:17.569: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.231902361s
Jan 21 06:38:17.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.232167922s
Jan 21 06:38:19.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.229393855s
Jan 21 06:38:19.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.229260904s
Jan 21 06:38:19.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.22966951s
Jan 21 06:38:19.567: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.230671929s
Jan 21 06:38:19.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.232052652s
Jan 21 06:38:19.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.231497598s
Jan 21 06:38:19.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.232195583s
Jan 21 06:38:21.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.22988929s
Jan 21 06:38:21.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.230241192s
Jan 21 06:38:21.567: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.230096533s
Jan 21 06:38:21.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.231161387s
Jan 21 06:38:21.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.231624733s
Jan 21 06:38:21.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.232434408s
Jan 21 06:38:21.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.232611858s
Jan 21 06:38:23.565: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.229190074s
Jan 21 06:38:23.565: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.228854803s
Jan 21 06:38:23.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.22908063s
Jan 21 06:38:23.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.231968568s
Jan 21 06:38:23.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.232758479s
Jan 21 06:38:23.569: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.232085322s
Jan 21 06:38:23.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.232725325s
Jan 21 06:38:25.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.229624516s
Jan 21 06:38:25.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.229462114s
Jan 21 06:38:25.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.229342288s
Jan 21 06:38:25.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.231297821s
Jan 21 06:38:25.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.23218635s
Jan 21 06:38:25.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.231505304s
Jan 21 06:38:25.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.232132599s
Jan 21 06:38:27.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.229153829s
Jan 21 06:38:27.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.229510037s
Jan 21 06:38:27.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.229348216s
Jan 21 06:38:27.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.231258804s
Jan 21 06:38:27.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.231819423s
Jan 21 06:38:27.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.232656693s
Jan 21 06:38:27.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.232496989s
Jan 21 06:38:29.565: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.229056665s
Jan 21 06:38:29.565: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.228721379s
Jan 21 06:38:29.565: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.228856725s
Jan 21 06:38:29.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.232438489s
Jan 21 06:38:29.569: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.231797195s
Jan 21 06:38:29.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.231753297s
Jan 21 06:38:29.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.232330681s
Jan 21 06:38:31.565: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.228757916s
Jan 21 06:38:31.565: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.22842263s
Jan 21 06:38:31.565: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.228619698s
Jan 21 06:38:31.575: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.238043558s
Jan 21 06:38:31.575: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.238186114s
Jan 21 06:38:31.575: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.238876076s
Jan 21 06:38:31.575: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.238168957s
Jan 21 06:38:33.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.229773743s
Jan 21 06:38:33.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.22969076s
Jan 21 06:38:33.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.230025466s
Jan 21 06:38:33.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.231689626s
Jan 21 06:38:33.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.2325737s
Jan 21 06:38:33.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.232288969s
Jan 21 06:38:33.570: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.233086239s
Jan 21 06:38:35.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.229202301s
Jan 21 06:38:35.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.229066965s
Jan 21 06:38:35.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.229461747s
Jan 21 06:38:35.567: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.230609407s
Jan 21 06:38:35.567: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.231413096s
Jan 21 06:38:35.567: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.230718634s
Jan 21 06:38:35.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.232527027s
Jan 21 06:38:37.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.229833579s
Jan 21 06:38:37.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.229683928s
Jan 21 06:38:37.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.229797589s
Jan 21 06:38:37.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.231910744s
Jan 21 06:38:37.569: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.232316252s
Jan 21 06:38:37.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.23303826s
Jan 21 06:38:37.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.232709099s
Jan 21 06:38:39.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.229807751s
Jan 21 06:38:39.567: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.230376203s
Jan 21 06:38:39.570: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.233549783s
Jan 21 06:38:39.570: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.232890211s
Jan 21 06:38:39.570: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.232930679s
Jan 21 06:38:39.570: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.233307332s
Jan 21 06:38:39.570: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.233718194s
Jan 21 06:38:41.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.23004374s
Jan 21 06:38:41.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.229908223s
Jan 21 06:38:41.567: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.230375931s
Jan 21 06:38:41.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.231730198s
Jan 21 06:38:41.569: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.231803563s
Jan 21 06:38:41.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.232559212s
Jan 21 06:38:41.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.23237673s
Jan 21 06:38:43.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.229299297s
Jan 21 06:38:43.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.229499286s
Jan 21 06:38:43.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.22916409s
Jan 21 06:38:43.569: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.232476943s
Jan 21 06:38:43.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.232488273s
Jan 21 06:38:43.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.23326889s
Jan 21 06:38:43.570: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.233749997s
Jan 21 06:38:45.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.229465691s
Jan 21 06:38:45.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.229328203s
Jan 21 06:38:45.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.229204053s
Jan 21 06:38:45.567: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.231302884s
Jan 21 06:38:45.569: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.231973468s
Jan 21 06:38:45.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.23205447s
Jan 21 06:38:45.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.23205008s
Jan 21 06:38:47.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.229358947s
Jan 21 06:38:47.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.229223584s
Jan 21 06:38:47.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.230114005s
Jan 21 06:38:47.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.231484793s
Jan 21 06:38:47.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.231478728s
Jan 21 06:38:47.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.232255299s
Jan 21 06:38:47.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.232441447s
Jan 21 06:38:49.567: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.23011456s
Jan 21 06:38:49.567: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.230721257s
Jan 21 06:38:49.567: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.230447931s
Jan 21 06:38:49.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.232450771s
Jan 21 06:38:49.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.23316543s
Jan 21 06:38:49.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.232416943s
Jan 21 06:38:49.569: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.232511003s
Jan 21 06:38:51.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.229058883s
Jan 21 06:38:51.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.229449253s
Jan 21 06:38:51.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.22934536s
Jan 21 06:38:51.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.231590719s
Jan 21 06:38:51.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.232373462s
Jan 21 06:38:51.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.231703149s
Jan 21 06:38:51.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.232337753s
Jan 21 06:38:53.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.229688801s
Jan 21 06:38:53.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.229894134s
Jan 21 06:38:53.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.229573958s
Jan 21 06:38:53.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.231193025s
Jan 21 06:38:53.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.232303208s
Jan 21 06:38:53.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.231874258s
Jan 21 06:38:53.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.232720288s
Jan 21 06:38:55.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.229204321s
Jan 21 06:38:55.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.229404326s
Jan 21 06:38:55.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.229069119s
Jan 21 06:38:55.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.233301866s
Jan 21 06:38:55.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.232683376s
Jan 21 06:38:55.570: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.232811238s
Jan 21 06:38:55.570: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.232844526s
Jan 21 06:38:57.565: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.228915651s
Jan 21 06:38:57.565: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.229050832s
Jan 21 06:38:57.565: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.229250677s
Jan 21 06:38:57.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.231476374s
Jan 21 06:38:57.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.232154678s
Jan 21 06:38:57.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.232951282s
Jan 21 06:38:57.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.232792636s
Jan 21 06:38:59.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.22988115s
Jan 21 06:38:59.567: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.231019173s
Jan 21 06:38:59.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.231627309s
Jan 21 06:38:59.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.232124675s
Jan 21 06:38:59.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.232790693s
Jan 21 06:38:59.570: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.233531267s
Jan 21 06:38:59.570: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.233043413s
Jan 21 06:39:01.565: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.229255068s
Jan 21 06:39:01.565: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.228919865s
Jan 21 06:39:01.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.229122227s
Jan 21 06:39:01.571: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.234021918s
Jan 21 06:39:01.571: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.233965273s
Jan 21 06:39:01.571: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.234803499s
Jan 21 06:39:01.571: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.234222329s
Jan 21 06:39:03.567: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.230120518s
Jan 21 06:39:03.567: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.230006031s
Jan 21 06:39:03.567: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.230341473s
Jan 21 06:39:03.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.232522932s
Jan 21 06:39:03.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.231823712s
Jan 21 06:39:03.569: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.232439575s
Jan 21 06:39:03.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.232611128s
Jan 21 06:39:05.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.229746816s
Jan 21 06:39:05.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.229546933s
Jan 21 06:39:05.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.229483521s
Jan 21 06:39:05.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.232839109s
Jan 21 06:39:05.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.232059929s
Jan 21 06:39:05.569: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.232308557s
Jan 21 06:39:05.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.232378622s
Jan 21 06:39:07.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.230102578s
Jan 21 06:39:07.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.229994145s
Jan 21 06:39:07.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.229890433s
Jan 21 06:39:07.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.231493768s
Jan 21 06:39:07.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.231600159s
Jan 21 06:39:07.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.232351722s
Jan 21 06:39:07.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.232460755s
Jan 21 06:39:09.565: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.228737366s
Jan 21 06:39:09.565: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.229072255s
Jan 21 06:39:09.565: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.228932532s
Jan 21 06:39:09.570: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.233622607s
Jan 21 06:39:09.570: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.232852027s
Jan 21 06:39:09.570: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.233029688s
Jan 21 06:39:09.570: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.233012247s
Jan 21 06:39:11.567: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.230378265s
Jan 21 06:39:11.567: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.230043151s
Jan 21 06:39:11.567: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.230178467s
Jan 21 06:39:11.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.232530419s
Jan 21 06:39:11.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.231754835s
Jan 21 06:39:11.569: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.231852355s
Jan 21 06:39:11.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.232658646s
Jan 21 06:39:13.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.23015399s
Jan 21 06:39:13.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.229953999s
Jan 21 06:39:13.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.229880892s
Jan 21 06:39:13.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.231263853s
Jan 21 06:39:13.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.232482709s
Jan 21 06:39:13.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.231720431s
Jan 21 06:39:13.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.23261779s
Jan 21 06:39:15.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.229927637s
Jan 21 06:39:15.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.230188312s
Jan 21 06:39:15.567: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.229936976s
Jan 21 06:39:15.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.230897123s
Jan 21 06:39:15.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.231721673s
Jan 21 06:39:15.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.231022593s
Jan 21 06:39:15.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.23258509s
Jan 21 06:39:17.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.229205313s
Jan 21 06:39:17.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.229560104s
Jan 21 06:39:17.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.229403451s
Jan 21 06:39:17.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.232099547s
Jan 21 06:39:17.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.231339249s
Jan 21 06:39:17.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.231433921s
Jan 21 06:39:17.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.232267992s
Jan 21 06:39:19.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.229478893s
Jan 21 06:39:19.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.229853453s
Jan 21 06:39:19.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.229549297s
Jan 21 06:39:19.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.231072743s
Jan 21 06:39:19.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.23118432s
Jan 21 06:39:19.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.231941734s
Jan 21 06:39:19.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.231897413s
Jan 21 06:39:21.567: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.230534465s
Jan 21 06:39:21.567: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.230674619s
Jan 21 06:39:21.567: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.230874471s
Jan 21 06:39:21.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.23159301s
Jan 21 06:39:21.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.232372691s
Jan 21 06:39:21.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.23166182s
Jan 21 06:39:21.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.232580135s
Jan 21 06:39:23.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.229836494s
Jan 21 06:39:23.567: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.230433912s
Jan 21 06:39:23.567: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.230710364s
Jan 21 06:39:23.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.233005574s
Jan 21 06:39:23.570: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.232965778s
Jan 21 06:39:23.570: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.232926881s
Jan 21 06:39:23.570: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.233449067s
Jan 21 06:39:25.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.229522264s
Jan 21 06:39:25.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.22919533s
Jan 21 06:39:25.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.229383953s
Jan 21 06:39:25.569: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.232212371s
Jan 21 06:39:25.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.232934575s
Jan 21 06:39:25.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.232211844s
Jan 21 06:39:25.570: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.233020206s
Jan 21 06:39:27.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.229773204s
Jan 21 06:39:27.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.229921809s
Jan 21 06:39:27.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.230108525s
Jan 21 06:39:27.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.231710909s
Jan 21 06:39:27.569: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.231876643s
Jan 21 06:39:27.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.232609596s
Jan 21 06:39:27.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.232441111s
Jan 21 06:39:29.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.230046333s
Jan 21 06:39:29.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.229895652s
Jan 21 06:39:29.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.229760383s
Jan 21 06:39:29.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.231284473s
Jan 21 06:39:29.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.231902059s
Jan 21 06:39:29.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.232753433s
Jan 21 06:39:29.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.232607352s
Jan 21 06:39:31.565: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.228929843s
Jan 21 06:39:31.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.228944154s
Jan 21 06:39:31.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.229296902s
Jan 21 06:39:31.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.232624809s
Jan 21 06:39:31.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.231892701s
Jan 21 06:39:31.569: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.232008903s
Jan 21 06:39:31.570: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.232913955s
Jan 21 06:39:33.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.229559394s
Jan 21 06:39:33.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.229794122s
Jan 21 06:39:33.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.230203203s
Jan 21 06:39:33.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.232910715s
Jan 21 06:39:33.570: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.232824757s
Jan 21 06:39:33.570: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.232812608s
Jan 21 06:39:33.570: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.232970043s
Jan 21 06:39:35.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.229489435s
Jan 21 06:39:35.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.229353953s
Jan 21 06:39:35.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.229689219s
Jan 21 06:39:35.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.231921969s
Jan 21 06:39:35.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.231188102s
Jan 21 06:39:35.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.231279452s
Jan 21 06:39:35.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.232160431s
Jan 21 06:39:37.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.229579006s
Jan 21 06:39:37.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.22978812s
Jan 21 06:39:37.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.229981097s
Jan 21 06:39:37.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.231545275s
Jan 21 06:39:37.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.232346122s
Jan 21 06:39:37.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.231740332s
Jan 21 06:39:37.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.232493733s
Jan 21 06:39:39.567: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.229924071s
Jan 21 06:39:39.567: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.230059491s
Jan 21 06:39:39.567: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.230259432s
Jan 21 06:39:39.569: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.231973587s
Jan 21 06:39:39.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.232915887s
Jan 21 06:39:39.570: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.233123768s
Jan 21 06:39:39.571: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.234223964s
Jan 21 06:39:41.565: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.228476997s
Jan 21 06:39:41.565: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.228825565s
Jan 21 06:39:41.565: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.228857679s
Jan 21 06:39:41.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.232053115s
Jan 21 06:39:41.569: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.231822825s
Jan 21 06:39:41.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.231848384s
Jan 21 06:39:41.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.23247413s
Jan 21 06:39:43.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.229551245s
Jan 21 06:39:43.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.229416415s
Jan 21 06:39:43.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.229848325s
Jan 21 06:39:43.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.231694203s
Jan 21 06:39:43.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.231432023s
Jan 21 06:39:43.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.231637314s
Jan 21 06:39:43.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.232092069s
Jan 21 06:39:45.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.230008362s
Jan 21 06:39:45.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.229844872s
Jan 21 06:39:45.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.229733806s
Jan 21 06:39:45.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.231688784s
Jan 21 06:39:45.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.232507837s
Jan 21 06:39:45.569: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.231823807s
Jan 21 06:39:45.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.232296214s
Jan 21 06:39:47.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.229576681s
Jan 21 06:39:47.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.2298051s
Jan 21 06:39:47.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.229544592s
Jan 21 06:39:47.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.231760767s
Jan 21 06:39:47.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.231544321s
Jan 21 06:39:47.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.2316552s
Jan 21 06:39:47.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.232319905s
Jan 21 06:39:49.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.229731184s
Jan 21 06:39:49.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.229596388s
Jan 21 06:39:49.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.230002749s
Jan 21 06:39:49.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.231390734s
Jan 21 06:39:49.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.231350952s
Jan 21 06:39:49.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.232210329s
Jan 21 06:39:49.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.232058602s
Jan 21 06:39:51.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.229852897s
Jan 21 06:39:51.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.22971785s
Jan 21 06:39:51.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.230053177s
Jan 21 06:39:51.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.231116957s
Jan 21 06:39:51.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.232004708s
Jan 21 06:39:51.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.231629971s
Jan 21 06:39:51.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.232548845s
Jan 21 06:39:53.570: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.233444133s
Jan 21 06:39:53.570: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.233643211s
Jan 21 06:39:53.570: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.233870989s
Jan 21 06:39:53.571: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.234663463s
Jan 21 06:39:53.572: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.2353861s
Jan 21 06:39:53.572: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.236050464s
Jan 21 06:39:53.572: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.235365538s
Jan 21 06:39:55.565: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.228829333s
Jan 21 06:39:55.565: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.229038833s
Jan 21 06:39:55.565: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.228694124s
Jan 21 06:39:55.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.231785469s
Jan 21 06:39:55.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.232621881s
Jan 21 06:39:55.569: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.231962752s
Jan 21 06:39:55.570: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.233124336s
Jan 21 06:39:57.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.229951951s
Jan 21 06:39:57.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.230198343s
Jan 21 06:39:57.567: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.230215884s
Jan 21 06:39:57.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.231346296s
Jan 21 06:39:57.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.231584881s
Jan 21 06:39:57.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.232419238s
Jan 21 06:39:57.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.232037155s
Jan 21 06:39:59.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.229916873s
Jan 21 06:39:59.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.229818122s
Jan 21 06:39:59.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.230211429s
Jan 21 06:39:59.569: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.232312024s
Jan 21 06:39:59.569: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.233386842s
Jan 21 06:39:59.570: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.232783529s
Jan 21 06:39:59.570: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.233032731s
Jan 21 06:40:01.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.229921093s
Jan 21 06:40:01.567: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.230319366s
Jan 21 06:40:01.567: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.23014799s
Jan 21 06:40:01.569: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.231997137s
Jan 21 06:40:01.571: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.233791209s
Jan 21 06:40:01.571: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.233974178s
Jan 21 06:40:01.571: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.234735408s
Jan 21 06:40:03.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.229786616s
Jan 21 06:40:03.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.229996252s
Jan 21 06:40:03.567: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.230418693s
Jan 21 06:40:03.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw": Phase="Running", Reason="", readiness=true. Elapsed: 4m48.232215848s
Jan 21 06:40:03.568: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw" satisfied condition "running"
Jan 21 06:40:03.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.231498141s
Jan 21 06:40:03.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.231576471s
Jan 21 06:40:03.570: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.232872578s
Jan 21 06:40:05.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.230005415s
Jan 21 06:40:05.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.229670325s
Jan 21 06:40:05.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.229805573s
Jan 21 06:40:05.567: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.230541289s
Jan 21 06:40:05.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.230849679s
Jan 21 06:40:05.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.232813493s
Jan 21 06:40:07.567: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.230572533s
Jan 21 06:40:07.567: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.230299887s
Jan 21 06:40:07.567: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.230538912s
Jan 21 06:40:07.570: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.233599578s
Jan 21 06:40:07.571: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.234363146s
Jan 21 06:40:07.572: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.235112692s
Jan 21 06:40:09.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.229587451s
Jan 21 06:40:09.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.229534113s
Jan 21 06:40:09.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.229996457s
Jan 21 06:40:09.572: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.235056578s
Jan 21 06:40:09.572: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.235022337s
Jan 21 06:40:09.572: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.234976964s
Jan 21 06:40:11.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.229615467s
Jan 21 06:40:11.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.229765049s
Jan 21 06:40:11.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.23001301s
Jan 21 06:40:11.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.230950557s
Jan 21 06:40:11.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.231021517s
Jan 21 06:40:11.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.231902771s
Jan 21 06:40:13.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.229320158s
Jan 21 06:40:13.566: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.229137863s
Jan 21 06:40:13.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.229256686s
Jan 21 06:40:13.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.231239849s
Jan 21 06:40:13.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.231211426s
Jan 21 06:40:13.569: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.232624756s
Jan 21 06:40:15.566: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.230160559s
Jan 21 06:40:15.566: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.229889534s
Jan 21 06:40:15.567: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.230134433s
Jan 21 06:40:15.568: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.230736811s
Jan 21 06:40:15.568: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.230826924s
Jan 21 06:40:15.568: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.231806686s
Jan 21 06:40:15.680: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.343052651s
Jan 21 06:40:15.680: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.34339275s
Jan 21 06:40:15.680: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.34325696s
Jan 21 06:40:15.681: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.344041736s
Jan 21 06:40:15.681: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.344045311s
Jan 21 06:40:15.681: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.34459229s
Jan 21 06:40:15.681: INFO: Unexpected error: error in waiting for pods to come up: failed to wait for pods running: [timed out while waiting for pod deployment-9980/webserver-deployment-7f5969cbc7-gsxt2 to be running timed out while waiting for pod deployment-9980/webserver-deployment-7f5969cbc7-bnzlj to be running timed out while waiting for pod deployment-9980/webserver-deployment-7f5969cbc7-db4fk to be running timed out while waiting for pod deployment-9980/webserver-deployment-7f5969cbc7-mgqtv to be running timed out while waiting for pod deployment-9980/webserver-deployment-7f5969cbc7-n88qc to be running timed out while waiting for pod deployment-9980/webserver-deployment-7f5969cbc7-gwmd9 to be running]: 
    <*errors.errorString | 0xc000c042f0>: {
        s: "failed to wait for pods running: [timed out while waiting for pod deployment-9980/webserver-deployment-7f5969cbc7-gsxt2 to be running timed out while waiting for pod deployment-9980/webserver-deployment-7f5969cbc7-bnzlj to be running timed out while waiting for pod deployment-9980/webserver-deployment-7f5969cbc7-db4fk to be running timed out while waiting for pod deployment-9980/webserver-deployment-7f5969cbc7-mgqtv to be running timed out while waiting for pod deployment-9980/webserver-deployment-7f5969cbc7-n88qc to be running timed out while waiting for pod deployment-9980/webserver-deployment-7f5969cbc7-gwmd9 to be running]",
    }
Jan 21 06:40:15.681: FAIL: error in waiting for pods to come up: failed to wait for pods running: [timed out while waiting for pod deployment-9980/webserver-deployment-7f5969cbc7-gsxt2 to be running timed out while waiting for pod deployment-9980/webserver-deployment-7f5969cbc7-bnzlj to be running timed out while waiting for pod deployment-9980/webserver-deployment-7f5969cbc7-db4fk to be running timed out while waiting for pod deployment-9980/webserver-deployment-7f5969cbc7-mgqtv to be running timed out while waiting for pod deployment-9980/webserver-deployment-7f5969cbc7-n88qc to be running timed out while waiting for pod deployment-9980/webserver-deployment-7f5969cbc7-gwmd9 to be running]: failed to wait for pods running: [timed out while waiting for pod deployment-9980/webserver-deployment-7f5969cbc7-gsxt2 to be running timed out while waiting for pod deployment-9980/webserver-deployment-7f5969cbc7-bnzlj to be running timed out while waiting for pod deployment-9980/webserver-deployment-7f5969cbc7-db4fk to be running timed out while waiting for pod deployment-9980/webserver-deployment-7f5969cbc7-mgqtv to be running timed out while waiting for pod deployment-9980/webserver-deployment-7f5969cbc7-n88qc to be running timed out while waiting for pod deployment-9980/webserver-deployment-7f5969cbc7-gwmd9 to be running]

Full Stack Trace
k8s.io/kubernetes/test/e2e/apps.testProportionalScalingDeployment(0xc00030c658?)
	test/e2e/apps/deployment.go:1203 +0x705
k8s.io/kubernetes/test/e2e/apps.glob..func5.11()
	test/e2e/apps/deployment.go:161 +0x1d
[AfterEach] [sig-apps] Deployment
  test/e2e/apps/deployment.go:84
Jan 21 06:40:15.795: INFO: Deployment "webserver-deployment":
&Deployment{ObjectMeta:{webserver-deployment  deployment-9980  644f55a0-53ec-4f27-9d5b-48c287d8e85c 16498 1 2023-01-21 06:35:15 +0000 UTC <nil> <nil> map[name:httpd] map[deployment.kubernetes.io/revision:1] [] [] [{e2e.test Update apps/v1 2023-01-21 06:35:15 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{".":{},"f:name":{}}},"f:spec":{"f:progressDeadlineSeconds":{},"f:replicas":{},"f:revisionHistoryLimit":{},"f:selector":{},"f:strategy":{"f:rollingUpdate":{".":{},"f:maxSurge":{},"f:maxUnavailable":{}},"f:type":{}},"f:template":{"f:metadata":{"f:labels":{".":{},"f:name":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}}} } {kube-controller-manager Update apps/v1 2023-01-21 06:40:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:deployment.kubernetes.io/revision":{}}},"f:status":{"f:availableReplicas":{},"f:conditions":{".":{},"k:{\"type\":\"Available\"}":{".":{},"f:lastTransitionTime":{},"f:lastUpdateTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Progressing\"}":{".":{},"f:lastTransitionTime":{},"f:lastUpdateTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:observedGeneration":{},"f:readyReplicas":{},"f:replicas":{},"f:unavailableReplicas":{},"f:updatedReplicas":{}}} status}]},Spec:DeploymentSpec{Replicas:*10,Selector:&v1.LabelSelector{MatchLabels:map[string]string{name: httpd,},MatchExpressions:[]LabelSelectorRequirement{},},Template:{{      0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[name:httpd] map[] [] [] []} {[] [] [{httpd registry.k8s.io/e2e-test-images/httpd:2.4.38-4 [] []  [] [] [] {map[] map[] []} [] [] nil nil nil nil /dev/termination-log File IfNotPresent SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,} false false false}] [] Always 0xc00376a138 <nil> ClusterFirst map[]   <nil>  false false false <nil> &PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,} []   nil default-scheduler [] []  <nil> nil [] <nil> <nil> <nil> map[] [] <nil> nil <nil> [] []}},Strategy:DeploymentStrategy{Type:RollingUpdate,RollingUpdate:&RollingUpdateDeployment{MaxUnavailable:2,MaxSurge:3,},},MinReadySeconds:0,RevisionHistoryLimit:*10,Paused:false,ProgressDeadlineSeconds:*600,},Status:DeploymentStatus{ObservedGeneration:1,Replicas:10,UpdatedReplicas:10,AvailableReplicas:4,UnavailableReplicas:6,Conditions:[]DeploymentCondition{DeploymentCondition{Type:Available,Status:False,Reason:MinimumReplicasUnavailable,Message:Deployment does not have minimum availability.,LastUpdateTime:2023-01-21 06:35:15 +0000 UTC,LastTransitionTime:2023-01-21 06:35:15 +0000 UTC,},DeploymentCondition{Type:Progressing,Status:True,Reason:ReplicaSetUpdated,Message:ReplicaSet "webserver-deployment-7f5969cbc7" is progressing.,LastUpdateTime:2023-01-21 06:40:01 +0000 UTC,LastTransitionTime:2023-01-21 06:35:15 +0000 UTC,},},ReadyReplicas:4,CollisionCount:nil,},}

Jan 21 06:40:15.908: INFO: New ReplicaSet "webserver-deployment-7f5969cbc7" of Deployment "webserver-deployment":
&ReplicaSet{ObjectMeta:{webserver-deployment-7f5969cbc7  deployment-9980  1ccc5883-bf0b-408c-af7d-b8de4a660bef 16497 1 2023-01-21 06:35:15 +0000 UTC <nil> <nil> map[name:httpd pod-template-hash:7f5969cbc7] map[deployment.kubernetes.io/desired-replicas:10 deployment.kubernetes.io/max-replicas:13 deployment.kubernetes.io/revision:1] [{apps/v1 Deployment webserver-deployment 644f55a0-53ec-4f27-9d5b-48c287d8e85c 0xc00376a917 0xc00376a918}] [] [{kube-controller-manager Update apps/v1 2023-01-21 06:35:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:deployment.kubernetes.io/desired-replicas":{},"f:deployment.kubernetes.io/max-replicas":{},"f:deployment.kubernetes.io/revision":{}},"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"644f55a0-53ec-4f27-9d5b-48c287d8e85c\"}":{}}},"f:spec":{"f:replicas":{},"f:selector":{},"f:template":{"f:metadata":{"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}}} } {kube-controller-manager Update apps/v1 2023-01-21 06:40:01 +0000 UTC FieldsV1 {"f:status":{"f:availableReplicas":{},"f:fullyLabeledReplicas":{},"f:observedGeneration":{},"f:readyReplicas":{},"f:replicas":{}}} status}]},Spec:ReplicaSetSpec{Replicas:*10,Selector:&v1.LabelSelector{MatchLabels:map[string]string{name: httpd,pod-template-hash: 7f5969cbc7,},MatchExpressions:[]LabelSelectorRequirement{},},Template:{{      0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[name:httpd pod-template-hash:7f5969cbc7] map[] [] [] []} {[] [] [{httpd registry.k8s.io/e2e-test-images/httpd:2.4.38-4 [] []  [] [] [] {map[] map[] []} [] [] nil nil nil nil /dev/termination-log File IfNotPresent SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,} false false false}] [] Always 0xc00376a9a8 <nil> ClusterFirst map[]   <nil>  false false false <nil> &PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,} []   nil default-scheduler [] []  <nil> nil [] <nil> <nil> <nil> map[] [] <nil> nil <nil> [] []}},MinReadySeconds:0,},Status:ReplicaSetStatus{Replicas:10,FullyLabeledReplicas:10,ObservedGeneration:1,ReadyReplicas:4,AvailableReplicas:4,Conditions:[]ReplicaSetCondition{},},}
Jan 21 06:40:16.022: INFO: Pod "webserver-deployment-7f5969cbc7-46bv8" is available:
&Pod{ObjectMeta:{webserver-deployment-7f5969cbc7-46bv8 webserver-deployment-7f5969cbc7- deployment-9980  551ce1a9-8d76-46b6-9bf4-ad17799b16c6 15108 0 2023-01-21 06:35:15 +0000 UTC <nil> <nil> map[name:httpd pod-template-hash:7f5969cbc7] map[] [{apps/v1 ReplicaSet webserver-deployment-7f5969cbc7 1ccc5883-bf0b-408c-af7d-b8de4a660bef 0xc0038e64f7 0xc0038e64f8}] [] [{kube-controller-manager Update v1 2023-01-21 06:35:15 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"1ccc5883-bf0b-408c-af7d-b8de4a660bef\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}} } {kubelet Update v1 2023-01-21 06:35:28 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:phase":{},"f:podIP":{},"f:podIPs":{".":{},"k:{\"ip\":\"172.20.58.2\"}":{".":{},"f:ip":{}}},"f:startTime":{}}} status}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-pcqtn,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:httpd,Image:registry.k8s.io/e2e-test-images/httpd:2.4.38-4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-pcqtn,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:i-0483840d8e13a9e6f,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,OS:nil,HostUsers:nil,SchedulingGates:[]PodSchedulingGate{},ResourceClaims:[]PodResourceClaim{},},Status:PodStatus{Phase:Running,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-21 06:35:15 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-21 06:35:28 +0000 UTC,Reason:,Message:,},PodCondition{Type:ContainersReady,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-21 06:35:28 +0000 UTC,Reason:,Message:,},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-21 06:35:15 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:172.20.35.162,PodIP:172.20.58.2,StartTime:2023-01-21 06:35:15 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:httpd,State:ContainerState{Waiting:nil,Running:&ContainerStateRunning{StartedAt:2023-01-21 06:35:28 +0000 UTC,},Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:true,RestartCount:0,Image:registry.k8s.io/e2e-test-images/httpd:2.4.38-4,ImageID:registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22,ContainerID:containerd://640b6a77389f1c3c5b6761ea7fa3b18e6058fd20739b263f451d1be20d35fdcf,Started:*true,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{PodIP{IP:172.20.58.2,},},EphemeralContainerStatuses:[]ContainerStatus{},},}
Jan 21 06:40:16.022: INFO: Pod "webserver-deployment-7f5969cbc7-bnzlj" is not available:
&Pod{ObjectMeta:{webserver-deployment-7f5969cbc7-bnzlj webserver-deployment-7f5969cbc7- deployment-9980  3b2ec30b-d1b9-4ee0-a693-2f3e4d319e5f 14890 0 2023-01-21 06:35:15 +0000 UTC <nil> <nil> map[name:httpd pod-template-hash:7f5969cbc7] map[] [{apps/v1 ReplicaSet webserver-deployment-7f5969cbc7 1ccc5883-bf0b-408c-af7d-b8de4a660bef 0xc0038e66d0 0xc0038e66d1}] [] [{kube-controller-manager Update v1 2023-01-21 06:35:15 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"1ccc5883-bf0b-408c-af7d-b8de4a660bef\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}} } {kubelet Update v1 2023-01-21 06:35:15 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:startTime":{}}} status}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-jwq95,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:httpd,Image:registry.k8s.io/e2e-test-images/httpd:2.4.38-4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-jwq95,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:i-0483840d8e13a9e6f,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,OS:nil,HostUsers:nil,SchedulingGates:[]PodSchedulingGate{},ResourceClaims:[]PodResourceClaim{},},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-21 06:35:15 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-21 06:35:15 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-21 06:35:15 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-21 06:35:15 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:172.20.35.162,PodIP:,StartTime:2023-01-21 06:35:15 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:httpd,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ContainerCreating,Message:,},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:registry.k8s.io/e2e-test-images/httpd:2.4.38-4,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{},EphemeralContainerStatuses:[]ContainerStatus{},},}
Jan 21 06:40:16.022: INFO: Pod "webserver-deployment-7f5969cbc7-bw8rr" is available:
&Pod{ObjectMeta:{webserver-deployment-7f5969cbc7-bw8rr webserver-deployment-7f5969cbc7- deployment-9980  896ec44d-5810-4f02-bce4-b6fa386d439f 14925 0 2023-01-21 06:35:15 +0000 UTC <nil> <nil> map[name:httpd pod-template-hash:7f5969cbc7] map[] [{apps/v1 ReplicaSet webserver-deployment-7f5969cbc7 1ccc5883-bf0b-408c-af7d-b8de4a660bef 0xc0038e6887 0xc0038e6888}] [] [{kube-controller-manager Update v1 2023-01-21 06:35:15 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"1ccc5883-bf0b-408c-af7d-b8de4a660bef\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}} } {kubelet Update v1 2023-01-21 06:35:17 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:phase":{},"f:podIP":{},"f:podIPs":{".":{},"k:{\"ip\":\"172.20.46.55\"}":{".":{},"f:ip":{}}},"f:startTime":{}}} status}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-66ckz,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:httpd,Image:registry.k8s.io/e2e-test-images/httpd:2.4.38-4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-66ckz,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:i-0f3b8117f4ecfc9ec,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,OS:nil,HostUsers:nil,SchedulingGates:[]PodSchedulingGate{},ResourceClaims:[]PodResourceClaim{},},Status:PodStatus{Phase:Running,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-21 06:35:15 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-21 06:35:17 +0000 UTC,Reason:,Message:,},PodCondition{Type:ContainersReady,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-21 06:35:17 +0000 UTC,Reason:,Message:,},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-21 06:35:15 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:172.20.36.94,PodIP:172.20.46.55,StartTime:2023-01-21 06:35:15 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:httpd,State:ContainerState{Waiting:nil,Running:&ContainerStateRunning{StartedAt:2023-01-21 06:35:16 +0000 UTC,},Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:true,RestartCount:0,Image:registry.k8s.io/e2e-test-images/httpd:2.4.38-4,ImageID:registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22,ContainerID:containerd://041e2510b75f97ce0cd7c55548513f022969c3e5674a2be461669ea1eb9c9463,Started:*true,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{PodIP{IP:172.20.46.55,},},EphemeralContainerStatuses:[]ContainerStatus{},},}
Jan 21 06:40:16.022: INFO: Pod "webserver-deployment-7f5969cbc7-db4fk" is not available:
&Pod{ObjectMeta:{webserver-deployment-7f5969cbc7-db4fk webserver-deployment-7f5969cbc7- deployment-9980  4553b9f0-dd06-415b-b7c1-60724b0f02af 14895 0 2023-01-21 06:35:15 +0000 UTC <nil> <nil> map[name:httpd pod-template-hash:7f5969cbc7] map[] [{apps/v1 ReplicaSet webserver-deployment-7f5969cbc7 1ccc5883-bf0b-408c-af7d-b8de4a660bef 0xc0038e6a67 0xc0038e6a68}] [] [{kube-controller-manager Update v1 2023-01-21 06:35:15 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"1ccc5883-bf0b-408c-af7d-b8de4a660bef\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}} } {kubelet Update v1 2023-01-21 06:35:15 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:startTime":{}}} status}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-d69v9,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:httpd,Image:registry.k8s.io/e2e-test-images/httpd:2.4.38-4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-d69v9,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:i-0483840d8e13a9e6f,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,OS:nil,HostUsers:nil,SchedulingGates:[]PodSchedulingGate{},ResourceClaims:[]PodResourceClaim{},},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-21 06:35:15 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-21 06:35:15 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-21 06:35:15 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-21 06:35:15 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:172.20.35.162,PodIP:,StartTime:2023-01-21 06:35:15 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:httpd,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ContainerCreating,Message:,},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:registry.k8s.io/e2e-test-images/httpd:2.4.38-4,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{},EphemeralContainerStatuses:[]ContainerStatus{},},}
Jan 21 06:40:16.022: INFO: Pod "webserver-deployment-7f5969cbc7-gsxt2" is not available:
&Pod{ObjectMeta:{webserver-deployment-7f5969cbc7-gsxt2 webserver-deployment-7f5969cbc7- deployment-9980  28d680a0-d2c9-4bff-9d68-30bf13aa86a9 14893 0 2023-01-21 06:35:15 +0000 UTC <nil> <nil> map[name:httpd pod-template-hash:7f5969cbc7] map[] [{apps/v1 ReplicaSet webserver-deployment-7f5969cbc7 1ccc5883-bf0b-408c-af7d-b8de4a660bef 0xc0038e6c27 0xc0038e6c28}] [] [{kube-controller-manager Update v1 2023-01-21 06:35:15 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"1ccc5883-bf0b-408c-af7d-b8de4a660bef\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}} } {kubelet Update v1 2023-01-21 06:35:15 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:startTime":{}}} status}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-vvphc,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:httpd,Image:registry.k8s.io/e2e-test-images/httpd:2.4.38-4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-vvphc,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:i-034aa8120dbcec79b,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,OS:nil,HostUsers:nil,SchedulingGates:[]PodSchedulingGate{},ResourceClaims:[]PodResourceClaim{},},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-21 06:35:15 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-21 06:35:15 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-21 06:35:15 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-21 06:35:15 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:172.20.44.197,PodIP:,StartTime:2023-01-21 06:35:15 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:httpd,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ContainerCreating,Message:,},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:registry.k8s.io/e2e-test-images/httpd:2.4.38-4,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{},EphemeralContainerStatuses:[]ContainerStatus{},},}
Jan 21 06:40:16.022: INFO: Pod "webserver-deployment-7f5969cbc7-gwmd9" is not available:
&Pod{ObjectMeta:{webserver-deployment-7f5969cbc7-gwmd9 webserver-deployment-7f5969cbc7- deployment-9980  3435c8f7-0bd1-455e-af4f-1ff27e9cc072 14884 0 2023-01-21 06:35:15 +0000 UTC <nil> <nil> map[name:httpd pod-template-hash:7f5969cbc7] map[] [{apps/v1 ReplicaSet webserver-deployment-7f5969cbc7 1ccc5883-bf0b-408c-af7d-b8de4a660bef 0xc0038e6df7 0xc0038e6df8}] [] [{kube-controller-manager Update v1 2023-01-21 06:35:15 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"1ccc5883-bf0b-408c-af7d-b8de4a660bef\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}} } {kubelet Update v1 2023-01-21 06:35:15 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:startTime":{}}} status}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-vsc7d,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:httpd,Image:registry.k8s.io/e2e-test-images/httpd:2.4.38-4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-vsc7d,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:i-034aa8120dbcec79b,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,OS:nil,HostUsers:nil,SchedulingGates:[]PodSchedulingGate{},ResourceClaims:[]PodResourceClaim{},},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-21 06:35:15 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-21 06:35:15 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-21 06:35:15 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-21 06:35:15 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:172.20.44.197,PodIP:,StartTime:2023-01-21 06:35:15 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:httpd,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ContainerCreating,Message:,},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:registry.k8s.io/e2e-test-images/httpd:2.4.38-4,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{},EphemeralContainerStatuses:[]ContainerStatus{},},}
Jan 21 06:40:16.022: INFO: Pod "webserver-deployment-7f5969cbc7-mgqtv" is not available:
&Pod{ObjectMeta:{webserver-deployment-7f5969cbc7-mgqtv webserver-deployment-7f5969cbc7- deployment-9980  90c8fde1-4872-49c7-88ad-42c2d2dd76a5 14886 0 2023-01-21 06:35:15 +0000 UTC <nil> <nil> map[name:httpd pod-template-hash:7f5969cbc7] map[] [{apps/v1 ReplicaSet webserver-deployment-7f5969cbc7 1ccc5883-bf0b-408c-af7d-b8de4a660bef 0xc0038e6fb7 0xc0038e6fb8}] [] [{kube-controller-manager Update v1 2023-01-21 06:35:15 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"1ccc5883-bf0b-408c-af7d-b8de4a660bef\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}} } {kubelet Update v1 2023-01-21 06:35:15 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:startTime":{}}} status}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-4l7r2,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:httpd,Image:registry.k8s.io/e2e-test-images/httpd:2.4.38-4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-4l7r2,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:i-0ce901feb1d51fd3c,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,OS:nil,HostUsers:nil,SchedulingGates:[]PodSchedulingGate{},ResourceClaims:[]PodResourceClaim{},},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-21 06:35:15 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-21 06:35:15 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-21 06:35:15 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-21 06:35:15 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:172.20.55.1,PodIP:,StartTime:2023-01-21 06:35:15 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:httpd,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ContainerCreating,Message:,},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:registry.k8s.io/e2e-test-images/httpd:2.4.38-4,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{},EphemeralContainerStatuses:[]ContainerStatus{},},}
Jan 21 06:40:16.023: INFO: Pod "webserver-deployment-7f5969cbc7-n88qc" is not available:
&Pod{ObjectMeta:{webserver-deployment-7f5969cbc7-n88qc webserver-deployment-7f5969cbc7- deployment-9980  f346b38d-fcae-4ff9-9748-77a780a878f6 14898 0 2023-01-21 06:35:15 +0000 UTC <nil> <nil> map[name:httpd pod-template-hash:7f5969cbc7] map[] [{apps/v1 ReplicaSet webserver-deployment-7f5969cbc7 1ccc5883-bf0b-408c-af7d-b8de4a660bef 0xc0038e7187 0xc0038e7188}] [] [{kube-controller-manager Update v1 2023-01-21 06:35:15 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"1ccc5883-bf0b-408c-af7d-b8de4a660bef\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}} } {kubelet Update v1 2023-01-21 06:35:15 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:startTime":{}}} status}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-vtlnd,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:httpd,Image:registry.k8s.io/e2e-test-images/httpd:2.4.38-4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-vtlnd,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:i-0f3b8117f4ecfc9ec,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,OS:nil,HostUsers:nil,SchedulingGates:[]PodSchedulingGate{},ResourceClaims:[]PodResourceClaim{},},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-21 06:35:15 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-21 06:35:15 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-21 06:35:15 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-21 06:35:15 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:172.20.36.94,PodIP:,StartTime:2023-01-21 06:35:15 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:httpd,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ContainerCreating,Message:,},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:registry.k8s.io/e2e-test-images/httpd:2.4.38-4,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{},EphemeralContainerStatuses:[]ContainerStatus{},},}
Jan 21 06:40:16.023: INFO: Pod "webserver-deployment-7f5969cbc7-qnq9n" is available:
&Pod{ObjectMeta:{webserver-deployment-7f5969cbc7-qnq9n webserver-deployment-7f5969cbc7- deployment-9980  8b3beecd-2165-49ff-8c98-8b4d38cf0573 15424 0 2023-01-21 06:35:15 +0000 UTC <nil> <nil> map[name:httpd pod-template-hash:7f5969cbc7] map[] [{apps/v1 ReplicaSet webserver-deployment-7f5969cbc7 1ccc5883-bf0b-408c-af7d-b8de4a660bef 0xc0038e7347 0xc0038e7348}] [] [{kube-controller-manager Update v1 2023-01-21 06:35:15 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"1ccc5883-bf0b-408c-af7d-b8de4a660bef\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}} } {kubelet Update v1 2023-01-21 06:36:20 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:phase":{},"f:podIP":{},"f:podIPs":{".":{},"k:{\"ip\":\"172.20.59.126\"}":{".":{},"f:ip":{}}},"f:startTime":{}}} status}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-7cqd9,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:httpd,Image:registry.k8s.io/e2e-test-images/httpd:2.4.38-4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-7cqd9,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:i-0ce901feb1d51fd3c,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,OS:nil,HostUsers:nil,SchedulingGates:[]PodSchedulingGate{},ResourceClaims:[]PodResourceClaim{},},Status:PodStatus{Phase:Running,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-21 06:35:15 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-21 06:36:20 +0000 UTC,Reason:,Message:,},PodCondition{Type:ContainersReady,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-21 06:36:20 +0000 UTC,Reason:,Message:,},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-21 06:35:15 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:172.20.55.1,PodIP:172.20.59.126,StartTime:2023-01-21 06:35:15 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:httpd,State:ContainerState{Waiting:nil,Running:&ContainerStateRunning{StartedAt:2023-01-21 06:36:19 +0000 UTC,},Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:true,RestartCount:0,Image:registry.k8s.io/e2e-test-images/httpd:2.4.38-4,ImageID:registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22,ContainerID:containerd://02fe47c09cf1cfaf378f0a320f58c20a9d5176aee3a4e5db51977467e1ee3d44,Started:*true,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{PodIP{IP:172.20.59.126,},},EphemeralContainerStatuses:[]ContainerStatus{},},}
Jan 21 06:40:16.023: INFO: Pod "webserver-deployment-7f5969cbc7-tzpsw" is available:
&Pod{ObjectMeta:{webserver-deployment-7f5969cbc7-tzpsw webserver-deployment-7f5969cbc7- deployment-9980  26576b03-9fa7-43e7-b24b-076f1ab3b94c 16496 0 2023-01-21 06:35:15 +0000 UTC <nil> <nil> map[name:httpd pod-template-hash:7f5969cbc7] map[] [{apps/v1 ReplicaSet webserver-deployment-7f5969cbc7 1ccc5883-bf0b-408c-af7d-b8de4a660bef 0xc0038e7527 0xc0038e7528}] [] [{kube-controller-manager Update v1 2023-01-21 06:35:15 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"1ccc5883-bf0b-408c-af7d-b8de4a660bef\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}} } {kubelet Update v1 2023-01-21 06:40:01 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:phase":{},"f:podIP":{},"f:podIPs":{".":{},"k:{\"ip\":\"172.20.34.119\"}":{".":{},"f:ip":{}}},"f:startTime":{}}} status}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-qcwwq,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:httpd,Image:registry.k8s.io/e2e-test-images/httpd:2.4.38-4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-qcwwq,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:i-0ce901feb1d51fd3c,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,OS:nil,HostUsers:nil,SchedulingGates:[]PodSchedulingGate{},ResourceClaims:[]PodResourceClaim{},},Status:PodStatus{Phase:Running,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-21 06:35:15 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-21 06:40:01 +0000 UTC,Reason:,Message:,},PodCondition{Type:ContainersReady,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-21 06:40:01 +0000 UTC,Reason:,Message:,},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-21 06:35:15 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:172.20.55.1,PodIP:172.20.34.119,StartTime:2023-01-21 06:35:15 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:httpd,State:ContainerState{Waiting:nil,Running:&ContainerStateRunning{StartedAt:2023-01-21 06:40:01 +0000 UTC,},Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:true,RestartCount:0,Image:registry.k8s.io/e2e-test-images/httpd:2.4.38-4,ImageID:registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22,ContainerID:containerd://ccca9d2a98473ff5c17fa918178b7dd741c73a7fad9a111ce3d90e6bba8b03e5,Started:*true,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{PodIP{IP:172.20.34.119,},},EphemeralContainerStatuses:[]ContainerStatus{},},}
[AfterEach] [sig-apps] Deployment
  test/e2e/framework/node/init/init.go:32
Jan 21 06:40:16.023: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-apps] Deployment
  test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-apps] Deployment
  dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/21/23 06:40:16.137�[0m
�[1mSTEP:�[0m Collecting events from namespace "deployment-9980". �[38;5;243m01/21/23 06:40:16.137�[0m
�[1mSTEP:�[0m Found 109 events. �[38;5;243m01/21/23 06:40:16.253�[0m
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:15 +0000 UTC - event for webserver-deployment: {deployment-controller } ScalingReplicaSet: Scaled up replica set webserver-deployment-7f5969cbc7 to 10
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:15 +0000 UTC - event for webserver-deployment-7f5969cbc7: {replicaset-controller } SuccessfulCreate: Created pod: webserver-deployment-7f5969cbc7-gwmd9
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:15 +0000 UTC - event for webserver-deployment-7f5969cbc7: {replicaset-controller } SuccessfulCreate: Created pod: webserver-deployment-7f5969cbc7-qnq9n
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:15 +0000 UTC - event for webserver-deployment-7f5969cbc7: {replicaset-controller } SuccessfulCreate: Created pod: webserver-deployment-7f5969cbc7-gsxt2
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:15 +0000 UTC - event for webserver-deployment-7f5969cbc7: {replicaset-controller } SuccessfulCreate: Created pod: webserver-deployment-7f5969cbc7-bw8rr
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:15 +0000 UTC - event for webserver-deployment-7f5969cbc7: {replicaset-controller } SuccessfulCreate: Created pod: webserver-deployment-7f5969cbc7-n88qc
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:15 +0000 UTC - event for webserver-deployment-7f5969cbc7: {replicaset-controller } SuccessfulCreate: (combined from similar events): Created pod: webserver-deployment-7f5969cbc7-tzpsw
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:15 +0000 UTC - event for webserver-deployment-7f5969cbc7: {replicaset-controller } SuccessfulCreate: Created pod: webserver-deployment-7f5969cbc7-bnzlj
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:15 +0000 UTC - event for webserver-deployment-7f5969cbc7: {replicaset-controller } SuccessfulCreate: Created pod: webserver-deployment-7f5969cbc7-mgqtv
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:15 +0000 UTC - event for webserver-deployment-7f5969cbc7: {replicaset-controller } SuccessfulCreate: Created pod: webserver-deployment-7f5969cbc7-db4fk
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:15 +0000 UTC - event for webserver-deployment-7f5969cbc7: {replicaset-controller } SuccessfulCreate: Created pod: webserver-deployment-7f5969cbc7-46bv8
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:15 +0000 UTC - event for webserver-deployment-7f5969cbc7-46bv8: {default-scheduler } Scheduled: Successfully assigned deployment-9980/webserver-deployment-7f5969cbc7-46bv8 to i-0483840d8e13a9e6f
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:15 +0000 UTC - event for webserver-deployment-7f5969cbc7-46bv8: {kubelet i-0483840d8e13a9e6f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "382922903baab07a46fd3dbf3cbdd172ec7f2d0f2b96c02698423fdff19d4db0": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:15 +0000 UTC - event for webserver-deployment-7f5969cbc7-bnzlj: {kubelet i-0483840d8e13a9e6f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "2855e1e4959d8ecf00c518d0c21c3529a80eaa210fa0eebc831093db1d306c36": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:15 +0000 UTC - event for webserver-deployment-7f5969cbc7-bnzlj: {default-scheduler } Scheduled: Successfully assigned deployment-9980/webserver-deployment-7f5969cbc7-bnzlj to i-0483840d8e13a9e6f
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:15 +0000 UTC - event for webserver-deployment-7f5969cbc7-bw8rr: {default-scheduler } Scheduled: Successfully assigned deployment-9980/webserver-deployment-7f5969cbc7-bw8rr to i-0f3b8117f4ecfc9ec
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:15 +0000 UTC - event for webserver-deployment-7f5969cbc7-db4fk: {default-scheduler } Scheduled: Successfully assigned deployment-9980/webserver-deployment-7f5969cbc7-db4fk to i-0483840d8e13a9e6f
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:15 +0000 UTC - event for webserver-deployment-7f5969cbc7-db4fk: {kubelet i-0483840d8e13a9e6f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "c1305f06869c69606883424b858e46139623d8e1d224a25caaf1071c5539f548": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:15 +0000 UTC - event for webserver-deployment-7f5969cbc7-gsxt2: {default-scheduler } Scheduled: Successfully assigned deployment-9980/webserver-deployment-7f5969cbc7-gsxt2 to i-034aa8120dbcec79b
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:15 +0000 UTC - event for webserver-deployment-7f5969cbc7-gsxt2: {kubelet i-034aa8120dbcec79b} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "19b775735f1ddcc3dec1125f437eb5f321af714737049a00fb44606a5b7cdc2c": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:15 +0000 UTC - event for webserver-deployment-7f5969cbc7-gwmd9: {kubelet i-034aa8120dbcec79b} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "4d01d2643fedebe172a65b05029b37558f5cc0ddbfab418d3b394b7e4399bc1b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:15 +0000 UTC - event for webserver-deployment-7f5969cbc7-gwmd9: {default-scheduler } Scheduled: Successfully assigned deployment-9980/webserver-deployment-7f5969cbc7-gwmd9 to i-034aa8120dbcec79b
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:15 +0000 UTC - event for webserver-deployment-7f5969cbc7-mgqtv: {default-scheduler } Scheduled: Successfully assigned deployment-9980/webserver-deployment-7f5969cbc7-mgqtv to i-0ce901feb1d51fd3c
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:15 +0000 UTC - event for webserver-deployment-7f5969cbc7-mgqtv: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "170b96ce09be9cd2d9dafe46ebfb3bf8257413ba7159a75798b8312d0b3450ea": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:15 +0000 UTC - event for webserver-deployment-7f5969cbc7-n88qc: {default-scheduler } Scheduled: Successfully assigned deployment-9980/webserver-deployment-7f5969cbc7-n88qc to i-0f3b8117f4ecfc9ec
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:15 +0000 UTC - event for webserver-deployment-7f5969cbc7-qnq9n: {default-scheduler } Scheduled: Successfully assigned deployment-9980/webserver-deployment-7f5969cbc7-qnq9n to i-0ce901feb1d51fd3c
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:15 +0000 UTC - event for webserver-deployment-7f5969cbc7-tzpsw: {default-scheduler } Scheduled: Successfully assigned deployment-9980/webserver-deployment-7f5969cbc7-tzpsw to i-0ce901feb1d51fd3c
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:16 +0000 UTC - event for webserver-deployment-7f5969cbc7-bw8rr: {kubelet i-0f3b8117f4ecfc9ec} Started: Started container httpd
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:16 +0000 UTC - event for webserver-deployment-7f5969cbc7-bw8rr: {kubelet i-0f3b8117f4ecfc9ec} Created: Created container httpd
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:16 +0000 UTC - event for webserver-deployment-7f5969cbc7-bw8rr: {kubelet i-0f3b8117f4ecfc9ec} Pulled: Container image "registry.k8s.io/e2e-test-images/httpd:2.4.38-4" already present on machine
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:16 +0000 UTC - event for webserver-deployment-7f5969cbc7-n88qc: {kubelet i-0f3b8117f4ecfc9ec} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "05e5db52252f5691dd5a5e7292bbac09c4a797fe6dc4c584044801083de49f17": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:16 +0000 UTC - event for webserver-deployment-7f5969cbc7-qnq9n: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "7b3e07caa99196168115a169b599f46c96e6b97846eba2af3f47111d34c9c338": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:16 +0000 UTC - event for webserver-deployment-7f5969cbc7-tzpsw: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "644fd03c2d18b41a63e8ac83ce212bea62637938b971b1561f5f7b32f2616155": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:27 +0000 UTC - event for webserver-deployment-7f5969cbc7-46bv8: {kubelet i-0483840d8e13a9e6f} Pulled: Container image "registry.k8s.io/e2e-test-images/httpd:2.4.38-4" already present on machine
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:27 +0000 UTC - event for webserver-deployment-7f5969cbc7-46bv8: {kubelet i-0483840d8e13a9e6f} Created: Created container httpd
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:27 +0000 UTC - event for webserver-deployment-7f5969cbc7-gwmd9: {kubelet i-034aa8120dbcec79b} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "2baa7064884df0c5d07bda655bfedeaacd5db90b789c9e2b148e91b85f4aba9f": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:27 +0000 UTC - event for webserver-deployment-7f5969cbc7-qnq9n: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "8c7a73036fed2bd0dfb48ebc03a0c1b198ee327ecfd6da7ceb0befb3da476e8c": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:27 +0000 UTC - event for webserver-deployment-7f5969cbc7-tzpsw: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "376313eed6502feebf1c0ddab32b89d02c75f82b7686bea112d469727b17aba9": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:28 +0000 UTC - event for webserver-deployment-7f5969cbc7-46bv8: {kubelet i-0483840d8e13a9e6f} Started: Started container httpd
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:28 +0000 UTC - event for webserver-deployment-7f5969cbc7-db4fk: {kubelet i-0483840d8e13a9e6f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "89549200b8faca8e086a4913a93482ad06aab3b87aaf26a2e6a5cc52eb061846": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:28 +0000 UTC - event for webserver-deployment-7f5969cbc7-n88qc: {kubelet i-0f3b8117f4ecfc9ec} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "f5c307843fe5c85b680d71208b355532ed2772326e605f17bf22bee1d4efe93f": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:29 +0000 UTC - event for webserver-deployment-7f5969cbc7-bnzlj: {kubelet i-0483840d8e13a9e6f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "44938a76a028d8b3f2f124dd652b8ee1bf7183de3e11bd64b4e062bbab853552": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:29 +0000 UTC - event for webserver-deployment-7f5969cbc7-mgqtv: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e0092f8e0c1840a12c5884fb6b7db4da26ca8f6c1d0ba091542d185a54e6f1b1": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:31 +0000 UTC - event for webserver-deployment-7f5969cbc7-gsxt2: {kubelet i-034aa8120dbcec79b} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "cb8a1226478612345c1289c104c904310247037361032291f270c92eaedc94d6": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:38 +0000 UTC - event for webserver-deployment-7f5969cbc7-qnq9n: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d632e003f4ad7186443869f6b5930cf8c68a653fc40bb972be8b85e2645a898d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:39 +0000 UTC - event for webserver-deployment-7f5969cbc7-db4fk: {kubelet i-0483840d8e13a9e6f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "63601b80dbf0eaefe81cc1061fcbdc226ee7fc2a6cb9399fb4d2565d326a58ee": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:40 +0000 UTC - event for webserver-deployment-7f5969cbc7-tzpsw: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "f191c8a0c24ae058237c24f1f8a0768866b5d02e70d7df7c37edbaadc3a830d0": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:42 +0000 UTC - event for webserver-deployment-7f5969cbc7-bnzlj: {kubelet i-0483840d8e13a9e6f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b4fb1d94b7e07bc52d54aa0234055b26e60bb24d6e760a0b42f52b54204c984a": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:42 +0000 UTC - event for webserver-deployment-7f5969cbc7-gsxt2: {kubelet i-034aa8120dbcec79b} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d44dc22cd653f7642a57e98f1eefb6b4b02e61af4b6b0d4613de2b1bbb6968b8": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:42 +0000 UTC - event for webserver-deployment-7f5969cbc7-gwmd9: {kubelet i-034aa8120dbcec79b} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "f750833561e92d66ef396fbb2660f1a8a0fdd4d4920131009a71bd04a6a4d456": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:43 +0000 UTC - event for webserver-deployment-7f5969cbc7-n88qc: {kubelet i-0f3b8117f4ecfc9ec} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "4fb88dd69c335f8bb22c0e4ba74d00df14605084a2138daea4e6d970f1f21f5b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:44 +0000 UTC - event for webserver-deployment-7f5969cbc7-mgqtv: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "23e88d7330b680deee29b46682839ac37a0e7ae9df5384b8713abd033ef23c2b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:52 +0000 UTC - event for webserver-deployment-7f5969cbc7-db4fk: {kubelet i-0483840d8e13a9e6f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "439a84d15dff9f103b1108dd6ff4dca39422dbd3b7bded5a3efd27b1343a7aa1": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:52 +0000 UTC - event for webserver-deployment-7f5969cbc7-qnq9n: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "eca2134dafeec5c233b73bc2783766ebf96aecdbc551a9ab378bed66dc25c2a0": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:54 +0000 UTC - event for webserver-deployment-7f5969cbc7-gsxt2: {kubelet i-034aa8120dbcec79b} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "796cd32360ec6831192404845d2e43e1202c394f1981a9c61784f1945e73d334": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:54 +0000 UTC - event for webserver-deployment-7f5969cbc7-n88qc: {kubelet i-0f3b8117f4ecfc9ec} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "25cbec7178deff56a9c0c1f795d15237073b062f8322ea7424e0427141817b66": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:55 +0000 UTC - event for webserver-deployment-7f5969cbc7-bnzlj: {kubelet i-0483840d8e13a9e6f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "953219ca0236a878d060eeebcfacf654804ec59f5ae7a6a21320aa30741fd480": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:56 +0000 UTC - event for webserver-deployment-7f5969cbc7-gwmd9: {kubelet i-034aa8120dbcec79b} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "731224adb34902f769e793820dd288c749f5fa70d962dc168701db38231fffab": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:56 +0000 UTC - event for webserver-deployment-7f5969cbc7-mgqtv: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b3835be0f55f99026f74195ab86d5aa26247365e2155c137dbb9decb6ad368f2": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:35:56 +0000 UTC - event for webserver-deployment-7f5969cbc7-tzpsw: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "8b1b9ae2609dae898d2e45182818a9b0104ea4eae8536a897575a51396f49565": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:36:03 +0000 UTC - event for webserver-deployment-7f5969cbc7-db4fk: {kubelet i-0483840d8e13a9e6f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "6c3c36dc20feb4d39204fc7051ab89b3dadacb97105831a4c30dd7a991aa9399": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:36:04 +0000 UTC - event for webserver-deployment-7f5969cbc7-qnq9n: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d872e590d38151d0e4c2952d6e5538785f649ca424ae1e992d78afbb4cdb1278": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:36:07 +0000 UTC - event for webserver-deployment-7f5969cbc7-gsxt2: {kubelet i-034aa8120dbcec79b} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "1b25a7e0560530efd09dbd6b011545f2c589b0b6ce269cc92587e32fc7fa10ce": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:36:08 +0000 UTC - event for webserver-deployment-7f5969cbc7-bnzlj: {kubelet i-0483840d8e13a9e6f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "95d1f4c211caa45fd7e30daf035779a4f7ad8b47a57e1e8da5b50e80f0ec5f3f": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:36:08 +0000 UTC - event for webserver-deployment-7f5969cbc7-gwmd9: {kubelet i-034aa8120dbcec79b} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a09acbcb7e27681f562e8aafe522cdbde4288c8ac8baa0176bb4233eaf1af6fd": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:36:09 +0000 UTC - event for webserver-deployment-7f5969cbc7-n88qc: {kubelet i-0f3b8117f4ecfc9ec} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "da5220c29fdabfd692ba36e14604bd81dbd66fb2512ff9497b0b31796c70926e": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:36:10 +0000 UTC - event for webserver-deployment-7f5969cbc7-mgqtv: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "69fff1bb813584b5b8c7894f9b56717862bed1c93c241f82e436fb65bc70b046": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:36:10 +0000 UTC - event for webserver-deployment-7f5969cbc7-tzpsw: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "91aeee1a1084419e78d0ba1909742280ed1bc2a3ca446285921efc4a92035402": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:36:16 +0000 UTC - event for webserver-deployment-7f5969cbc7-db4fk: {kubelet i-0483840d8e13a9e6f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "2f51895d8b3d84b904e32d7c86a21aed2bec9d2ee97e33718afcd2d2ea215fdf": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:36:18 +0000 UTC - event for webserver-deployment-7f5969cbc7-gsxt2: {kubelet i-034aa8120dbcec79b} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "bfad9c758602b832094912a2dcfb7b4bbb04bd83de761fad1fb6773cdde34639": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.253: INFO: At 2023-01-21 06:36:19 +0000 UTC - event for webserver-deployment-7f5969cbc7-bnzlj: {kubelet i-0483840d8e13a9e6f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "6624d42eaf40e9912e9024376a400c890851cd25d9cf106c648b79c46fd185b6": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.254: INFO: At 2023-01-21 06:36:19 +0000 UTC - event for webserver-deployment-7f5969cbc7-qnq9n: {kubelet i-0ce901feb1d51fd3c} Pulled: Container image "registry.k8s.io/e2e-test-images/httpd:2.4.38-4" already present on machine
Jan 21 06:40:16.254: INFO: At 2023-01-21 06:36:19 +0000 UTC - event for webserver-deployment-7f5969cbc7-qnq9n: {kubelet i-0ce901feb1d51fd3c} Created: Created container httpd
Jan 21 06:40:16.254: INFO: At 2023-01-21 06:36:19 +0000 UTC - event for webserver-deployment-7f5969cbc7-qnq9n: {kubelet i-0ce901feb1d51fd3c} Started: Started container httpd
Jan 21 06:40:16.254: INFO: At 2023-01-21 06:36:21 +0000 UTC - event for webserver-deployment-7f5969cbc7-tzpsw: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "46de9b4eb3e58b5b3da6b66090c4c9fa713a54a5e73bbddf60de538e275850c9": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.254: INFO: At 2023-01-21 06:36:22 +0000 UTC - event for webserver-deployment-7f5969cbc7-gwmd9: {kubelet i-034aa8120dbcec79b} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "093033211d80df2ba24ca738166f57e2275a806a75365649c21d96edeb0fa5e6": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.254: INFO: At 2023-01-21 06:36:22 +0000 UTC - event for webserver-deployment-7f5969cbc7-mgqtv: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "22f7816d4171c59981b20439d2283211212f6701a16c7b6805d1125a9e57d4e3": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.254: INFO: At 2023-01-21 06:36:24 +0000 UTC - event for webserver-deployment-7f5969cbc7-n88qc: {kubelet i-0f3b8117f4ecfc9ec} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "1b83f8a8981fe411f5191784ca0682db4fbb7f45c37dfcf829dd19d5fdacbc47": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.254: INFO: At 2023-01-21 06:36:27 +0000 UTC - event for webserver-deployment-7f5969cbc7-db4fk: {kubelet i-0483840d8e13a9e6f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b5597a9295f158be34f59d7fab1d052eec42c9a304e331af413efde99f97af59": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.254: INFO: At 2023-01-21 06:36:33 +0000 UTC - event for webserver-deployment-7f5969cbc7-gsxt2: {kubelet i-034aa8120dbcec79b} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "92c7a7d1a2f7c428949763dd102e589d4e735c757dedcd033bace379d93f2ad6": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.254: INFO: At 2023-01-21 06:36:35 +0000 UTC - event for webserver-deployment-7f5969cbc7-bnzlj: {kubelet i-0483840d8e13a9e6f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "0f930bfc3d8f4f247974422197735f35e5c78d84826df22cd02d060556ca0bd9": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.254: INFO: At 2023-01-21 06:36:35 +0000 UTC - event for webserver-deployment-7f5969cbc7-gwmd9: {kubelet i-034aa8120dbcec79b} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "161685b678e71c29db7e65a2ff2c4839253190fcdd6aafb51de373174f2f6ee3": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.254: INFO: At 2023-01-21 06:36:35 +0000 UTC - event for webserver-deployment-7f5969cbc7-n88qc: {kubelet i-0f3b8117f4ecfc9ec} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "cddcef04c7b088f6ffa744212201899bcc1d963ed2ed15813093fc925a41e144": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.254: INFO: At 2023-01-21 06:36:35 +0000 UTC - event for webserver-deployment-7f5969cbc7-tzpsw: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "9f8570badeb6698fbcb33246007818797b6374842d26ac13909abd248e38a7fb": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.254: INFO: At 2023-01-21 06:36:37 +0000 UTC - event for webserver-deployment-7f5969cbc7-mgqtv: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e514b7616aa4ea7dee3a37ae6110658adb2b819046ea50e11e4b4596c216ddd7": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.254: INFO: At 2023-01-21 06:36:42 +0000 UTC - event for webserver-deployment-7f5969cbc7-db4fk: {kubelet i-0483840d8e13a9e6f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "327712d55d46535bf49868e4f52c3150a863443eca83cab4da012b2372690177": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.254: INFO: At 2023-01-21 06:36:44 +0000 UTC - event for webserver-deployment-7f5969cbc7-gsxt2: {kubelet i-034aa8120dbcec79b} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "22417ca70d571ad54d47145c795ed5b272aee1df987f2faaaca981076ec1d3ea": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.254: INFO: At 2023-01-21 06:36:46 +0000 UTC - event for webserver-deployment-7f5969cbc7-tzpsw: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "40af22a01f46664a0a6c780d77d7b5b313c8b5fcef39ee253edc432ce8c89bd3": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.254: INFO: At 2023-01-21 06:36:47 +0000 UTC - event for webserver-deployment-7f5969cbc7-n88qc: {kubelet i-0f3b8117f4ecfc9ec} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "43d7d9267f471004bec6c2e84f07237238bae21d4c9e23aef288634d1a167aa0": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.254: INFO: At 2023-01-21 06:36:50 +0000 UTC - event for webserver-deployment-7f5969cbc7-gwmd9: {kubelet i-034aa8120dbcec79b} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "83ac23b8706d9a5efc052eb6361ab091d607db53fe144d2627103f225c24626c": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.254: INFO: At 2023-01-21 06:36:50 +0000 UTC - event for webserver-deployment-7f5969cbc7-mgqtv: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "dd2517aecc70664238b21c5110823782f7ea3b792da670dd1c907b434179dcfd": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.254: INFO: At 2023-01-21 06:36:51 +0000 UTC - event for webserver-deployment-7f5969cbc7-bnzlj: {kubelet i-0483840d8e13a9e6f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "21bdee5e1ee32c8fe463e86da5fc2d6a7e33f62f3b9794d0ccf49e2a19d34564": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.254: INFO: At 2023-01-21 06:36:54 +0000 UTC - event for webserver-deployment-7f5969cbc7-db4fk: {kubelet i-0483840d8e13a9e6f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "991afdb3bea0c83e639764e55a07266b5fada504d669c1b9e443d831654d7842": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.254: INFO: At 2023-01-21 06:36:58 +0000 UTC - event for webserver-deployment-7f5969cbc7-gsxt2: {kubelet i-034aa8120dbcec79b} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "bd02260b54f01ce85466c514ec81dbec9e9e5f8e9848037ab14b5e9aef1b6edf": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.254: INFO: At 2023-01-21 06:36:59 +0000 UTC - event for webserver-deployment-7f5969cbc7-tzpsw: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "5fa89262470f21783376eec300df5926ec68b9c7a21a36844f4a5abc46bf4c6f": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.254: INFO: At 2023-01-21 06:37:02 +0000 UTC - event for webserver-deployment-7f5969cbc7-n88qc: {kubelet i-0f3b8117f4ecfc9ec} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d16fc9eab654dbd55c5afbb6b353fd027bceb3937fc596ee046e5266a4aac1a9": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.254: INFO: At 2023-01-21 06:37:04 +0000 UTC - event for webserver-deployment-7f5969cbc7-bnzlj: {kubelet i-0483840d8e13a9e6f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d1debecc1391a21627408d369c4966953ab133ba76bfca7de0c9f4d02cba9d28": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.254: INFO: At 2023-01-21 06:37:04 +0000 UTC - event for webserver-deployment-7f5969cbc7-gwmd9: {kubelet i-034aa8120dbcec79b} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "12a72f6b0600a4afc4aa64f9500cd23740e2c7aa0b89bed8c7321edab104260d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.254: INFO: At 2023-01-21 06:37:04 +0000 UTC - event for webserver-deployment-7f5969cbc7-mgqtv: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b824dfd72bad9b84fb9badec2a3e189895d5de550ef2613d8967f23bc1f81e15": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.254: INFO: At 2023-01-21 06:37:06 +0000 UTC - event for webserver-deployment-7f5969cbc7-db4fk: {kubelet i-0483840d8e13a9e6f} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "70eb21f743bd2657ede82622a0c657ae89e088cdb6028aaecd39c4f7ce6d6b57": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.254: INFO: At 2023-01-21 06:37:10 +0000 UTC - event for webserver-deployment-7f5969cbc7-gsxt2: {kubelet i-034aa8120dbcec79b} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "840fafb17aa766b6c7ed818cdd7e0bc80479b95f92f2db4f9a71421cb58f7b48": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.254: INFO: At 2023-01-21 06:37:13 +0000 UTC - event for webserver-deployment-7f5969cbc7-tzpsw: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "42cdf0863af6fd356db439918ce95811773451dfa77d8b5cd4c5a9dd18138793": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.254: INFO: At 2023-01-21 06:37:14 +0000 UTC - event for webserver-deployment-7f5969cbc7-n88qc: {kubelet i-0f3b8117f4ecfc9ec} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "f06c21630d6be62d876eb6b4842187b555f821a3a73ed63d943729e700125e0a": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.254: INFO: At 2023-01-21 06:37:16 +0000 UTC - event for webserver-deployment-7f5969cbc7-bnzlj: {kubelet i-0483840d8e13a9e6f} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e204810a4c28572bbd3fdd4047069b310fb922c13d7dbf9ae532727daa0eb341": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.254: INFO: At 2023-01-21 06:37:16 +0000 UTC - event for webserver-deployment-7f5969cbc7-mgqtv: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "f5b6b614d1bb0f8c71cbbb9c6e4d30a619018f8cf89f80faa3db0c2d18f9a13a": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.254: INFO: At 2023-01-21 06:37:17 +0000 UTC - event for webserver-deployment-7f5969cbc7-gwmd9: {kubelet i-034aa8120dbcec79b} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "884b9d9967631c81fa87adffafd45a7482759fc960e0684d310d87d957de7e5e": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:40:16.254: INFO: At 2023-01-21 06:40:00 +0000 UTC - event for webserver-deployment-7f5969cbc7-tzpsw: {kubelet i-0ce901feb1d51fd3c} Created: Created container httpd
Jan 21 06:40:16.254: INFO: At 2023-01-21 06:40:00 +0000 UTC - event for webserver-deployment-7f5969cbc7-tzpsw: {kubelet i-0ce901feb1d51fd3c} Pulled: Container image "registry.k8s.io/e2e-test-images/httpd:2.4.38-4" already present on machine
Jan 21 06:40:16.254: INFO: At 2023-01-21 06:40:01 +0000 UTC - event for webserver-deployment-7f5969cbc7-tzpsw: {kubelet i-0ce901feb1d51fd3c} Started: Started container httpd
Jan 21 06:40:16.367: INFO: POD                                    NODE                 PHASE    GRACE  CONDITIONS
Jan 21 06:40:16.367: INFO: webserver-deployment-7f5969cbc7-46bv8  i-0483840d8e13a9e6f  Running         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:35:15 +0000 UTC  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:35:28 +0000 UTC  } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:35:28 +0000 UTC  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:35:15 +0000 UTC  }]
Jan 21 06:40:16.367: INFO: webserver-deployment-7f5969cbc7-bnzlj  i-0483840d8e13a9e6f  Pending         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:35:15 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:35:15 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:35:15 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:35:15 +0000 UTC  }]
Jan 21 06:40:16.367: INFO: webserver-deployment-7f5969cbc7-bw8rr  i-0f3b8117f4ecfc9ec  Running         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:35:15 +0000 UTC  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:35:17 +0000 UTC  } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:35:17 +0000 UTC  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:35:15 +0000 UTC  }]
Jan 21 06:40:16.367: INFO: webserver-deployment-7f5969cbc7-db4fk  i-0483840d8e13a9e6f  Pending         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:35:15 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:35:15 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:35:15 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:35:15 +0000 UTC  }]
Jan 21 06:40:16.367: INFO: webserver-deployment-7f5969cbc7-gsxt2  i-034aa8120dbcec79b  Pending         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:35:15 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:35:15 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:35:15 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:35:15 +0000 UTC  }]
Jan 21 06:40:16.367: INFO: webserver-deployment-7f5969cbc7-gwmd9  i-034aa8120dbcec79b  Pending         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:35:15 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:35:15 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:35:15 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:35:15 +0000 UTC  }]
Jan 21 06:40:16.367: INFO: webserver-deployment-7f5969cbc7-mgqtv  i-0ce901feb1d51fd3c  Pending         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:35:15 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:35:15 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:35:15 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:35:15 +0000 UTC  }]
Jan 21 06:40:16.367: INFO: webserver-deployment-7f5969cbc7-n88qc  i-0f3b8117f4ecfc9ec  Pending         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:35:15 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:35:15 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:35:15 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:35:15 +0000 UTC  }]
Jan 21 06:40:16.367: INFO: webserver-deployment-7f5969cbc7-qnq9n  i-0ce901feb1d51fd3c  Running         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:35:15 +0000 UTC  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:36:20 +0000 UTC  } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:36:20 +0000 UTC  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:35:15 +0000 UTC  }]
Jan 21 06:40:16.367: INFO: webserver-deployment-7f5969cbc7-tzpsw  i-0ce901feb1d51fd3c  Running         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:35:15 +0000 UTC  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:40:01 +0000 UTC  } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:40:01 +0000 UTC  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:35:15 +0000 UTC  }]
Jan 21 06:40:16.367: INFO: 
Jan 21 06:40:16.639: INFO: Unable to fetch deployment-9980/webserver-deployment-7f5969cbc7-bnzlj/httpd logs: the server rejected our request for an unknown reason (get pods webserver-deployment-7f5969cbc7-bnzlj)
Jan 21 06:40:16.868: INFO: Unable to fetch deployment-9980/webserver-deployment-7f5969cbc7-db4fk/httpd logs: the server rejected our request for an unknown reason (get pods webserver-deployment-7f5969cbc7-db4fk)
Jan 21 06:40:16.983: INFO: Unable to fetch deployment-9980/webserver-deployment-7f5969cbc7-gsxt2/httpd logs: the server rejected our request for an unknown reason (get pods webserver-deployment-7f5969cbc7-gsxt2)
Jan 21 06:40:17.097: INFO: 
Logging node info for node i-034aa8120dbcec79b
Jan 21 06:40:17.209: INFO: Node Info: &Node{ObjectMeta:{i-034aa8120dbcec79b    c2b3eda9-6144-4855-b163-8deafef2a413 15935 0 2023-01-21 06:26:22 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-034aa8120dbcec79b kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-1a topology.hostpath.csi/node:i-034aa8120dbcec79b topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.44.197 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-034aa8120dbcec79b"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-21 06:26:22 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 06:26:22 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 06:26:22 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-21 06:26:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-21 06:26:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {e2e.test Update v1 2023-01-21 06:33:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-21 06:38:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-034aa8120dbcec79b,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 06:38:37 +0000 UTC,LastTransitionTime:2023-01-21 06:26:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 06:38:37 +0000 UTC,LastTransitionTime:2023-01-21 06:26:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 06:38:37 +0000 UTC,LastTransitionTime:2023-01-21 06:26:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 06:38:37 +0000 UTC,LastTransitionTime:2023-01-21 06:26:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.44.197,},NodeAddress{Type:ExternalIP,Address:3.250.148.238,},NodeAddress{Type:InternalDNS,Address:i-034aa8120dbcec79b.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-034aa8120dbcec79b.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-250-148-238.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec24052f5b49538b50ca690553c9978a,SystemUUID:ec24052f-5b49-538b-50ca-690553c9978a,BootID:e582450b-04c2-4204-a2a8-58ecc23f099e,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 06:40:17.210: INFO: 
Logging kubelet events for node i-034aa8120dbcec79b
Jan 21 06:40:17.325: INFO: 
Logging pods the kubelet thinks is on node i-034aa8120dbcec79b
Jan 21 06:40:17.447: INFO: ebs-csi-node-4mfqt started at 2023-01-21 06:26:22 +0000 UTC (0+3 container statuses recorded)
Jan 21 06:40:17.447: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 21 06:40:17.447: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 21 06:40:17.447: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 21 06:40:17.447: INFO: pod-disruption-failure-ignore-0-lktw9 started at 2023-01-21 06:34:51 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:17.447: INFO: 	Container c ready: true, restart count 0
Jan 21 06:40:17.447: INFO: coredns-autoscaler-7cb5c5b969-slvzq started at 2023-01-21 06:26:33 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:17.447: INFO: 	Container autoscaler ready: true, restart count 0
Jan 21 06:40:17.447: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-4xkqd started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:17.447: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: false, restart count 0
Jan 21 06:40:17.447: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-gwjcc started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:17.447: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:40:17.447: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-sqpxl started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:17.447: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: false, restart count 0
Jan 21 06:40:17.447: INFO: local-injector started at 2023-01-21 06:35:23 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:17.447: INFO: 	Container local-injector ready: false, restart count 0
Jan 21 06:40:17.447: INFO: service-headless-rv7mm started at 2023-01-21 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:17.447: INFO: 	Container service-headless ready: true, restart count 0
Jan 21 06:40:17.447: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-sjgwj started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:17.447: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:40:17.447: INFO: pod-disruption-failure-ignore-1-lmh2f started at 2023-01-21 06:34:51 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:17.447: INFO: 	Container c ready: false, restart count 0
Jan 21 06:40:17.447: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-l9cqk started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:17.447: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:40:17.447: INFO: webserver-deployment-7f5969cbc7-gsxt2 started at 2023-01-21 06:35:15 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:17.447: INFO: 	Container httpd ready: false, restart count 0
Jan 21 06:40:17.447: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-lnlh9 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:17.447: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:40:17.447: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-wf6j2 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:17.447: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:40:17.447: INFO: webserver-deployment-7f5969cbc7-gwmd9 started at 2023-01-21 06:35:15 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:17.447: INFO: 	Container httpd ready: false, restart count 0
Jan 21 06:40:17.447: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-nf6xx started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:17.447: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:40:17.447: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-tjrzg started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:17.447: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:40:17.447: INFO: coredns-559769c974-f8ncw started at 2023-01-21 06:26:33 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:17.447: INFO: 	Container coredns ready: true, restart count 0
Jan 21 06:40:17.447: INFO: cilium-rbcn6 started at 2023-01-21 06:26:22 +0000 UTC (1+1 container statuses recorded)
Jan 21 06:40:17.447: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 21 06:40:17.447: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 21 06:40:17.447: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-26nnl started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:17.447: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:40:17.447: INFO: hostexec-i-034aa8120dbcec79b-kq49z started at 2023-01-21 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:17.447: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 21 06:40:17.865: INFO: 
Latency metrics for node i-034aa8120dbcec79b
Jan 21 06:40:17.865: INFO: 
Logging node info for node i-0483840d8e13a9e6f
Jan 21 06:40:17.978: INFO: Node Info: &Node{ObjectMeta:{i-0483840d8e13a9e6f    6e63ffcd-a34b-47ab-888c-fb980b98335e 16568 0 2023-01-21 06:26:26 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0483840d8e13a9e6f kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-1a topology.hostpath.csi/node:i-0483840d8e13a9e6f topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.35.162 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0483840d8e13a9e6f"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-21 06:26:26 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 06:26:26 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 06:26:26 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-21 06:26:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-21 06:26:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-21 06:33:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-21 06:40:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-0483840d8e13a9e6f,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 06:40:12 +0000 UTC,LastTransitionTime:2023-01-21 06:26:26 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 06:40:12 +0000 UTC,LastTransitionTime:2023-01-21 06:26:26 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 06:40:12 +0000 UTC,LastTransitionTime:2023-01-21 06:26:26 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 06:40:12 +0000 UTC,LastTransitionTime:2023-01-21 06:26:38 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.35.162,},NodeAddress{Type:ExternalIP,Address:54.220.210.148,},NodeAddress{Type:InternalDNS,Address:i-0483840d8e13a9e6f.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0483840d8e13a9e6f.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-220-210-148.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2945f38534f04be1d719a5a69e0c27,SystemUUID:ec2945f3-8534-f04b-e1d7-19a5a69e0c27,BootID:dc551b58-3eaf-4442-8a18-f820d5bb2e66,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 06:40:17.978: INFO: 
Logging kubelet events for node i-0483840d8e13a9e6f
Jan 21 06:40:18.094: INFO: 
Logging pods the kubelet thinks is on node i-0483840d8e13a9e6f
Jan 21 06:40:18.216: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-nzzv4 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:18.216: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:40:18.216: INFO: test-grpc-57f4153d-bee5-4b1a-b84c-59b84c632ef9 started at 2023-01-21 06:38:49 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:18.216: INFO: 	Container etcd ready: false, restart count 0
Jan 21 06:40:18.216: INFO: service-headless-toggled-g5m7l started at 2023-01-21 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:18.216: INFO: 	Container service-headless-toggled ready: false, restart count 0
Jan 21 06:40:18.216: INFO: webserver-deployment-7f5969cbc7-bnzlj started at 2023-01-21 06:35:15 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:18.216: INFO: 	Container httpd ready: false, restart count 0
Jan 21 06:40:18.216: INFO: suspend-false-to-true-cxr2f started at 2023-01-21 06:35:20 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:18.216: INFO: 	Container c ready: false, restart count 0
Jan 21 06:40:18.216: INFO: webserver-deployment-7f5969cbc7-46bv8 started at 2023-01-21 06:35:15 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:18.216: INFO: 	Container httpd ready: true, restart count 0
Jan 21 06:40:18.216: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-ljtgd started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:18.216: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:40:18.216: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-jkplr started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:18.216: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:40:18.216: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-jtcl9 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:18.216: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:40:18.216: INFO: cilium-gjcpw started at 2023-01-21 06:26:27 +0000 UTC (1+1 container statuses recorded)
Jan 21 06:40:18.216: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 21 06:40:18.216: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 21 06:40:18.216: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-xl5pw started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:18.216: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:40:18.216: INFO: ss2-0 started at 2023-01-21 06:35:58 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:18.216: INFO: 	Container webserver ready: true, restart count 0
Jan 21 06:40:18.216: INFO: csi-hostpathplugin-0 started at 2023-01-21 06:35:03 +0000 UTC (0+7 container statuses recorded)
Jan 21 06:40:18.216: INFO: 	Container csi-attacher ready: false, restart count 0
Jan 21 06:40:18.216: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan 21 06:40:18.216: INFO: 	Container csi-resizer ready: false, restart count 0
Jan 21 06:40:18.216: INFO: 	Container csi-snapshotter ready: false, restart count 0
Jan 21 06:40:18.216: INFO: 	Container hostpath ready: false, restart count 0
Jan 21 06:40:18.216: INFO: 	Container liveness-probe ready: false, restart count 0
Jan 21 06:40:18.216: INFO: 	Container node-driver-registrar ready: false, restart count 0
Jan 21 06:40:18.216: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-59wl4 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:18.216: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: false, restart count 0
Jan 21 06:40:18.216: INFO: csi-hostpathplugin-0 started at 2023-01-21 06:35:13 +0000 UTC (0+7 container statuses recorded)
Jan 21 06:40:18.216: INFO: 	Container csi-attacher ready: false, restart count 0
Jan 21 06:40:18.216: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan 21 06:40:18.216: INFO: 	Container csi-resizer ready: false, restart count 0
Jan 21 06:40:18.216: INFO: 	Container csi-snapshotter ready: false, restart count 0
Jan 21 06:40:18.216: INFO: 	Container hostpath ready: false, restart count 0
Jan 21 06:40:18.216: INFO: 	Container liveness-probe ready: false, restart count 0
Jan 21 06:40:18.216: INFO: 	Container node-driver-registrar ready: false, restart count 0
Jan 21 06:40:18.216: INFO: service-headless-4vd8s started at 2023-01-21 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:18.216: INFO: 	Container service-headless ready: true, restart count 0
Jan 21 06:40:18.216: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-lx5wh started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:18.216: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:40:18.216: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-wrc8q started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:18.216: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:40:18.216: INFO: webserver-deployment-7f5969cbc7-db4fk started at 2023-01-21 06:35:15 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:18.216: INFO: 	Container httpd ready: false, restart count 0
Jan 21 06:40:18.216: INFO: csi-mockplugin-0 started at 2023-01-21 06:35:54 +0000 UTC (0+3 container statuses recorded)
Jan 21 06:40:18.216: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan 21 06:40:18.216: INFO: 	Container driver-registrar ready: false, restart count 0
Jan 21 06:40:18.216: INFO: 	Container mock ready: false, restart count 0
Jan 21 06:40:18.216: INFO: httpd started at 2023-01-21 06:36:15 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:18.216: INFO: 	Container httpd ready: false, restart count 0
Jan 21 06:40:18.216: INFO: suspend-false-to-true-l6rxb started at 2023-01-21 06:35:20 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:18.216: INFO: 	Container c ready: false, restart count 0
Jan 21 06:40:18.216: INFO: pod-8ff5b737-e4da-45ee-b5dc-3c66641e69cd started at 2023-01-21 06:40:00 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:18.216: INFO: 	Container write-pod ready: false, restart count 0
Jan 21 06:40:18.216: INFO: csi-mockplugin-attacher-0 started at 2023-01-21 06:35:54 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:18.216: INFO: 	Container csi-attacher ready: false, restart count 0
Jan 21 06:40:18.216: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-gx9qk started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:18.216: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:40:18.216: INFO: ebs-csi-node-4fv8j started at 2023-01-21 06:26:27 +0000 UTC (0+3 container statuses recorded)
Jan 21 06:40:18.216: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 21 06:40:18.216: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 21 06:40:18.216: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 21 06:40:18.216: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-5cg9n started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:18.216: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:40:18.216: INFO: pod-1 started at 2023-01-21 06:39:59 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:18.216: INFO: 	Container donothing ready: false, restart count 0
Jan 21 06:40:18.216: INFO: hostexec-i-0483840d8e13a9e6f-q9zpc started at 2023-01-21 06:39:55 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:18.216: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 21 06:40:18.736: INFO: 
Latency metrics for node i-0483840d8e13a9e6f
Jan 21 06:40:18.736: INFO: 
Logging node info for node i-0ce901feb1d51fd3c
Jan 21 06:40:18.849: INFO: Node Info: &Node{ObjectMeta:{i-0ce901feb1d51fd3c    7d82d388-0267-44ad-a74d-b2eb46841c68 16305 0 2023-01-21 06:26:22 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0ce901feb1d51fd3c kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-1a topology.hostpath.csi/node:i-0ce901feb1d51fd3c topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.55.1 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0ce901feb1d51fd3c"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-21 06:26:22 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 06:26:22 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 06:26:22 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-21 06:26:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-21 06:26:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-21 06:33:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-21 06:39:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-01-21 06:39:40 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-0ce901feb1d51fd3c,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 06:39:38 +0000 UTC,LastTransitionTime:2023-01-21 06:26:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 06:39:38 +0000 UTC,LastTransitionTime:2023-01-21 06:26:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 06:39:38 +0000 UTC,LastTransitionTime:2023-01-21 06:26:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 06:39:38 +0000 UTC,LastTransitionTime:2023-01-21 06:26:34 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.55.1,},NodeAddress{Type:ExternalIP,Address:54.74.114.32,},NodeAddress{Type:InternalDNS,Address:i-0ce901feb1d51fd3c.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0ce901feb1d51fd3c.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-74-114-32.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec284d9c2eebc996a6b6d4cf4e0f52b7,SystemUUID:ec284d9c-2eeb-c996-a6b6-d4cf4e0f52b7,BootID:e32d5483-bf35-4be2-9254-c24e37c024a3,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0136a6452541f2af3 kubernetes.io/csi/ebs.csi.aws.com^vol-0f488a07e0987edd1],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0136a6452541f2af3,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0f488a07e0987edd1,DevicePath:,},},Config:nil,},}
Jan 21 06:40:18.849: INFO: 
Logging kubelet events for node i-0ce901feb1d51fd3c
Jan 21 06:40:18.965: INFO: 
Logging pods the kubelet thinks is on node i-0ce901feb1d51fd3c
Jan 21 06:40:19.196: INFO: csi-mockplugin-0 started at 2023-01-21 06:39:10 +0000 UTC (0+4 container statuses recorded)
Jan 21 06:40:19.196: INFO: 	Container busybox ready: false, restart count 0
Jan 21 06:40:19.196: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan 21 06:40:19.197: INFO: 	Container driver-registrar ready: false, restart count 0
Jan 21 06:40:19.197: INFO: 	Container mock ready: false, restart count 0
Jan 21 06:40:19.197: INFO: ss2-1 started at 2023-01-21 06:36:27 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:19.197: INFO: 	Container webserver ready: false, restart count 0
Jan 21 06:40:19.197: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-mxx2t started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:19.197: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:40:19.197: INFO: service-headless-ts4kv started at 2023-01-21 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:19.197: INFO: 	Container service-headless ready: true, restart count 0
Jan 21 06:40:19.197: INFO: pod-2 started at 2023-01-21 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:19.197: INFO: 	Container donothing ready: false, restart count 0
Jan 21 06:40:19.197: INFO: send-events-dede08bb-dc2e-45be-ab88-2efdfe2ce16b started at 2023-01-21 06:39:21 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:19.197: INFO: 	Container p ready: false, restart count 0
Jan 21 06:40:19.197: INFO: pod-1 started at 2023-01-21 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:19.197: INFO: 	Container donothing ready: false, restart count 0
Jan 21 06:40:19.197: INFO: pod-projected-secrets-a5a99c27-0163-4aa0-99eb-8d0126e1af69 started at 2023-01-21 06:35:23 +0000 UTC (0+3 container statuses recorded)
Jan 21 06:40:19.197: INFO: 	Container creates-volume-test ready: false, restart count 0
Jan 21 06:40:19.197: INFO: 	Container dels-volume-test ready: false, restart count 0
Jan 21 06:40:19.197: INFO: 	Container upds-volume-test ready: false, restart count 0
Jan 21 06:40:19.197: INFO: downwardapi-volume-2904cdf8-ccb0-44c1-ad2d-3050667b110e started at 2023-01-21 06:38:58 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:19.197: INFO: 	Container client-container ready: false, restart count 0
Jan 21 06:40:19.197: INFO: ebs-csi-node-qp79b started at 2023-01-21 06:26:23 +0000 UTC (0+3 container statuses recorded)
Jan 21 06:40:19.197: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 21 06:40:19.197: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 21 06:40:19.197: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 21 06:40:19.197: INFO: busybox-readonly-false-7268cb51-6f0f-4f9f-9eff-11701d05d37b started at 2023-01-21 06:40:01 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:19.197: INFO: 	Container busybox-readonly-false-7268cb51-6f0f-4f9f-9eff-11701d05d37b ready: false, restart count 0
Jan 21 06:40:19.197: INFO: pod-0 started at 2023-01-21 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:19.197: INFO: 	Container donothing ready: false, restart count 0
Jan 21 06:40:19.197: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-72ss9 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:19.197: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:40:19.197: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-tsmhc started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:19.197: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:40:19.197: INFO: pod-0 started at 2023-01-21 06:39:59 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:19.197: INFO: 	Container donothing ready: false, restart count 0
Jan 21 06:40:19.197: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-q9jl2 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:19.197: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: false, restart count 0
Jan 21 06:40:19.197: INFO: webserver-deployment-7f5969cbc7-qnq9n started at 2023-01-21 06:35:15 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:19.197: INFO: 	Container httpd ready: true, restart count 0
Jan 21 06:40:19.197: INFO: pod-b5a81e47-c996-4d6d-89a7-b7b072b032f7 started at 2023-01-21 06:39:57 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:19.197: INFO: 	Container test-container ready: false, restart count 0
Jan 21 06:40:19.197: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-zz7mm started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:19.197: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:40:19.197: INFO: pvc-tester-wmpgc started at 2023-01-21 06:39:38 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:19.197: INFO: 	Container write-pod ready: false, restart count 0
Jan 21 06:40:19.197: INFO: service-headless-toggled-7gf2d started at 2023-01-21 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:19.197: INFO: 	Container service-headless-toggled ready: false, restart count 0
Jan 21 06:40:19.197: INFO: webserver-deployment-7f5969cbc7-tzpsw started at 2023-01-21 06:35:15 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:19.197: INFO: 	Container httpd ready: true, restart count 0
Jan 21 06:40:19.197: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-pkhl6 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:19.197: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:40:19.197: INFO: webserver-deployment-7f5969cbc7-mgqtv started at 2023-01-21 06:35:15 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:19.197: INFO: 	Container httpd ready: false, restart count 0
Jan 21 06:40:19.197: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-nz2r7 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:19.197: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:40:19.197: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-lfwx4 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:19.197: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:40:19.197: INFO: cilium-qs82l started at 2023-01-21 06:26:23 +0000 UTC (1+1 container statuses recorded)
Jan 21 06:40:19.197: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 21 06:40:19.197: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 21 06:40:19.197: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-wtrk9 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:19.197: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:40:19.197: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-dw85q started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:19.197: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:40:19.197: INFO: pod-42c3941f-639f-4962-ae44-973a160407e8 started at 2023-01-21 06:35:06 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:19.197: INFO: 	Container write-pod ready: false, restart count 0
Jan 21 06:40:19.197: INFO: pod-update-activedeadlineseconds-7507343d-d7be-41e1-9f14-1379d6b98a8f started at 2023-01-21 06:35:27 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:19.197: INFO: 	Container pause ready: false, restart count 0
Jan 21 06:40:19.608: INFO: 
Latency metrics for node i-0ce901feb1d51fd3c
Jan 21 06:40:19.608: INFO: 
Logging node info for node i-0d2f2d71d5d6f8b5a
Jan 21 06:40:19.721: INFO: Node Info: &Node{ObjectMeta:{i-0d2f2d71d5d6f8b5a    d2f1894b-950d-45a2-a42f-7d9213bb75b8 15550 0 2023-01-21 06:24:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0d2f2d71d5d6f8b5a kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:eu-west-1a topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.42.168 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0d2f2d71d5d6f8b5a"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-21 06:24:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-21 06:25:04 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-01-21 06:25:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-21 06:25:18 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 06:25:18 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-21 06:36:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-0d2f2d71d5d6f8b5a,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892310016 0} {<nil>} 3801084Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787452416 0} {<nil>} 3698684Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 06:36:50 +0000 UTC,LastTransitionTime:2023-01-21 06:24:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 06:36:50 +0000 UTC,LastTransitionTime:2023-01-21 06:24:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 06:36:50 +0000 UTC,LastTransitionTime:2023-01-21 06:24:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 06:36:50 +0000 UTC,LastTransitionTime:2023-01-21 06:25:16 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.168,},NodeAddress{Type:ExternalIP,Address:3.249.87.249,},NodeAddress{Type:InternalDNS,Address:i-0d2f2d71d5d6f8b5a.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0d2f2d71d5d6f8b5a.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-249-87-249.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2326005f1a498ecb0bcf8cde478bd4,SystemUUID:ec232600-5f1a-498e-cb0b-cf8cde478bd4,BootID:45d9d2b8-2840-49c2-9bdc-aa7244b00f22,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.1],SizeBytes:135178704,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.1],SizeBytes:124995897,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.1],SizeBytes:57661752,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43643671,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42841306,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4965794,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 06:40:19.721: INFO: 
Logging kubelet events for node i-0d2f2d71d5d6f8b5a
Jan 21 06:40:19.836: INFO: 
Logging pods the kubelet thinks is on node i-0d2f2d71d5d6f8b5a
Jan 21 06:40:19.964: INFO: cilium-6bgng started at 2023-01-21 06:25:08 +0000 UTC (1+1 container statuses recorded)
Jan 21 06:40:19.964: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 21 06:40:19.964: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 21 06:40:19.964: INFO: dns-controller-69987775c6-vgxml started at 2023-01-21 06:25:08 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:19.964: INFO: 	Container dns-controller ready: true, restart count 0
Jan 21 06:40:19.964: INFO: etcd-manager-events-i-0d2f2d71d5d6f8b5a started at 2023-01-21 06:24:03 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:19.964: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 21 06:40:19.964: INFO: kube-apiserver-i-0d2f2d71d5d6f8b5a started at 2023-01-21 06:24:04 +0000 UTC (0+2 container statuses recorded)
Jan 21 06:40:19.964: INFO: 	Container healthcheck ready: true, restart count 0
Jan 21 06:40:19.964: INFO: 	Container kube-apiserver ready: true, restart count 1
Jan 21 06:40:19.964: INFO: kops-controller-hffbm started at 2023-01-21 06:25:08 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:19.964: INFO: 	Container kops-controller ready: true, restart count 0
Jan 21 06:40:19.964: INFO: aws-cloud-controller-manager-cqjd9 started at 2023-01-21 06:25:08 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:19.964: INFO: 	Container aws-cloud-controller-manager ready: true, restart count 0
Jan 21 06:40:19.964: INFO: ebs-csi-node-tb6br started at 2023-01-21 06:25:08 +0000 UTC (0+3 container statuses recorded)
Jan 21 06:40:19.964: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 21 06:40:19.964: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 21 06:40:19.964: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 21 06:40:19.964: INFO: cilium-operator-5dd44dc49f-fld4m started at 2023-01-21 06:25:08 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:19.964: INFO: 	Container cilium-operator ready: true, restart count 0
Jan 21 06:40:19.964: INFO: ebs-csi-controller-5bd98b456f-b9lnh started at 2023-01-21 06:25:08 +0000 UTC (0+5 container statuses recorded)
Jan 21 06:40:19.964: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 21 06:40:19.964: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 21 06:40:19.964: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 21 06:40:19.964: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 21 06:40:19.964: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 21 06:40:19.964: INFO: etcd-manager-main-i-0d2f2d71d5d6f8b5a started at 2023-01-21 06:24:04 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:19.964: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 21 06:40:19.964: INFO: kube-controller-manager-i-0d2f2d71d5d6f8b5a started at 2023-01-21 06:24:04 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:19.964: INFO: 	Container kube-controller-manager ready: true, restart count 2
Jan 21 06:40:19.964: INFO: kube-scheduler-i-0d2f2d71d5d6f8b5a started at 2023-01-21 06:24:04 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:19.964: INFO: 	Container kube-scheduler ready: true, restart count 0
Jan 21 06:40:20.364: INFO: 
Latency metrics for node i-0d2f2d71d5d6f8b5a
Jan 21 06:40:20.364: INFO: 
Logging node info for node i-0f3b8117f4ecfc9ec
Jan 21 06:40:20.478: INFO: Node Info: &Node{ObjectMeta:{i-0f3b8117f4ecfc9ec    019b5e58-b8c2-4ac5-ba8d-47ba49f9fe9c 16021 0 2023-01-21 06:26:29 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0f3b8117f4ecfc9ec kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-1a topology.hostpath.csi/node:i-0f3b8117f4ecfc9ec topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.36.94 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0f3b8117f4ecfc9ec"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-21 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 06:26:29 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-21 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-21 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-21 06:33:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-21 06:38:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-0f3b8117f4ecfc9ec,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 06:38:55 +0000 UTC,LastTransitionTime:2023-01-21 06:26:29 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 06:38:55 +0000 UTC,LastTransitionTime:2023-01-21 06:26:29 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 06:38:55 +0000 UTC,LastTransitionTime:2023-01-21 06:26:29 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 06:38:55 +0000 UTC,LastTransitionTime:2023-01-21 06:26:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.36.94,},NodeAddress{Type:ExternalIP,Address:54.72.134.71,},NodeAddress{Type:InternalDNS,Address:i-0f3b8117f4ecfc9ec.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0f3b8117f4ecfc9ec.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-72-134-71.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2c9416b8fb84b0403f690a294bd09b,SystemUUID:ec2c9416-b8fb-84b0-403f-690a294bd09b,BootID:4e9f8b9b-5350-48ad-8083-40ed7929b713,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 06:40:20.478: INFO: 
Logging kubelet events for node i-0f3b8117f4ecfc9ec
Jan 21 06:40:20.593: INFO: 
Logging pods the kubelet thinks is on node i-0f3b8117f4ecfc9ec
Jan 21 06:40:20.711: INFO: webserver-deployment-7f5969cbc7-bw8rr started at 2023-01-21 06:35:15 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:20.711: INFO: 	Container httpd ready: true, restart count 0
Jan 21 06:40:20.711: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-7vwsn started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:20.711: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:40:20.711: INFO: service-headless-toggled-66qnj started at 2023-01-21 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:20.711: INFO: 	Container service-headless-toggled ready: false, restart count 0
Jan 21 06:40:20.711: INFO: coredns-559769c974-7fbns started at 2023-01-21 06:26:59 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:20.711: INFO: 	Container coredns ready: true, restart count 0
Jan 21 06:40:20.711: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-28wx9 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:20.711: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:40:20.711: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-mlsc7 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:20.711: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:40:20.711: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-frfcl started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:20.711: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:40:20.711: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-wzrc6 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:20.711: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:40:20.711: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-5pk66 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:20.711: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:40:20.711: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-fjkff started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:20.711: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:40:20.711: INFO: webserver-deployment-7f5969cbc7-n88qc started at 2023-01-21 06:35:15 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:20.711: INFO: 	Container httpd ready: false, restart count 0
Jan 21 06:40:20.711: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-4sr7v started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:20.711: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:40:20.711: INFO: ebs-csi-node-5dm54 started at 2023-01-21 06:26:30 +0000 UTC (0+3 container statuses recorded)
Jan 21 06:40:20.711: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 21 06:40:20.711: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 21 06:40:20.711: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 21 06:40:20.711: INFO: cilium-2brsw started at 2023-01-21 06:26:30 +0000 UTC (1+1 container statuses recorded)
Jan 21 06:40:20.711: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 21 06:40:20.711: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 21 06:40:20.711: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-8zpkj started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:20.711: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:40:20.711: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-zgzjd started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:40:20.711: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:40:21.136: INFO: 
Latency metrics for node i-0f3b8117f4ecfc9ec
[DeferCleanup (Each)] [sig-apps] Deployment
  tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "deployment-9980" for this suite. �[38;5;243m01/21/23 06:40:21.136�[0m

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-apps] DisruptionController should observe that the PodDisruptionBudget status is not updated for unmanaged pods 10m6s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-apps\]\sDisruptionController\sshould\sobserve\sthat\sthe\sPodDisruptionBudget\sstatus\sis\snot\supdated\sfor\sunmanaged\spods$'

test/e2e/apps/disruption.go:580
k8s.io/kubernetes/test/e2e/apps.waitForPodsOrDie({0x8022ee8?, 0xc0007ad520}, {0xc0051fd680, 0xf}, 0x3)
	test/e2e/apps/disruption.go:580 +0x167
k8s.io/kubernetes/test/e2e/apps.glob..func6.6()
	test/e2e/apps/disruption.go:200 +0xf0
				[BeforeEach] [sig-apps] DisruptionController
  set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/21/23 06:35:11.71�[0m
Jan 21 06:35:11.710: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename disruption �[38;5;243m01/21/23 06:35:11.711�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/21/23 06:35:12.047�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/21/23 06:35:12.269�[0m
[BeforeEach] [sig-apps] DisruptionController
  test/e2e/framework/metrics/init/init.go:31
[BeforeEach] [sig-apps] DisruptionController
  test/e2e/apps/disruption.go:72
[It] should observe that the PodDisruptionBudget status is not updated for unmanaged pods
  test/e2e/apps/disruption.go:195
�[1mSTEP:�[0m Waiting for the pdb to be processed �[38;5;243m01/21/23 06:35:12.605�[0m
�[1mSTEP:�[0m Waiting for all pods to be running �[38;5;243m01/21/23 06:35:13.06�[0m
Jan 21 06:35:13.172: INFO: running pods: 0 < 3
Jan 21 06:35:15.289: INFO: running pods: 0 < 3
Jan 21 06:35:17.285: INFO: running pods: 0 < 3
Jan 21 06:35:19.285: INFO: running pods: 0 < 3
Jan 21 06:35:21.286: INFO: running pods: 0 < 3
Jan 21 06:35:23.285: INFO: running pods: 0 < 3
Jan 21 06:35:25.308: INFO: running pods: 0 < 3
Jan 21 06:35:27.285: INFO: running pods: 0 < 3
Jan 21 06:35:29.285: INFO: running pods: 0 < 3
Jan 21 06:35:31.285: INFO: running pods: 0 < 3
Jan 21 06:35:33.285: INFO: running pods: 0 < 3
Jan 21 06:35:35.284: INFO: running pods: 0 < 3
Jan 21 06:35:37.285: INFO: running pods: 0 < 3
Jan 21 06:35:39.286: INFO: running pods: 0 < 3
Jan 21 06:35:41.285: INFO: running pods: 0 < 3
Jan 21 06:35:43.285: INFO: running pods: 0 < 3
Jan 21 06:35:45.284: INFO: running pods: 0 < 3
Jan 21 06:35:47.286: INFO: running pods: 0 < 3
Jan 21 06:35:49.285: INFO: running pods: 0 < 3
Jan 21 06:35:51.285: INFO: running pods: 0 < 3
Jan 21 06:35:53.285: INFO: running pods: 0 < 3
Jan 21 06:35:55.285: INFO: running pods: 0 < 3
Jan 21 06:35:57.285: INFO: running pods: 0 < 3
Jan 21 06:35:59.284: INFO: running pods: 0 < 3
Jan 21 06:36:01.285: INFO: running pods: 0 < 3
Jan 21 06:36:03.285: INFO: running pods: 0 < 3
Jan 21 06:36:05.285: INFO: running pods: 0 < 3
Jan 21 06:36:07.284: INFO: running pods: 0 < 3
Jan 21 06:36:09.285: INFO: running pods: 0 < 3
Jan 21 06:36:11.285: INFO: running pods: 0 < 3
Jan 21 06:36:13.286: INFO: running pods: 0 < 3
Jan 21 06:36:15.285: INFO: running pods: 0 < 3
Jan 21 06:36:17.285: INFO: running pods: 0 < 3
Jan 21 06:36:19.285: INFO: running pods: 0 < 3
Jan 21 06:36:21.285: INFO: running pods: 0 < 3
Jan 21 06:36:23.285: INFO: running pods: 0 < 3
Jan 21 06:36:25.285: INFO: running pods: 0 < 3
Jan 21 06:36:27.285: INFO: running pods: 0 < 3
Jan 21 06:36:29.285: INFO: running pods: 0 < 3
Jan 21 06:36:31.285: INFO: running pods: 0 < 3
Jan 21 06:36:33.285: INFO: running pods: 0 < 3
Jan 21 06:36:35.284: INFO: running pods: 0 < 3
Jan 21 06:36:37.285: INFO: running pods: 0 < 3
Jan 21 06:36:39.285: INFO: running pods: 0 < 3
Jan 21 06:36:41.285: INFO: running pods: 0 < 3
Jan 21 06:36:43.285: INFO: running pods: 0 < 3
Jan 21 06:36:45.284: INFO: running pods: 0 < 3
Jan 21 06:36:47.285: INFO: running pods: 0 < 3
Jan 21 06:36:49.285: INFO: running pods: 0 < 3
Jan 21 06:36:51.285: INFO: running pods: 0 < 3
Jan 21 06:36:53.285: INFO: running pods: 0 < 3
Jan 21 06:36:55.284: INFO: running pods: 0 < 3
Jan 21 06:36:57.285: INFO: running pods: 0 < 3
Jan 21 06:36:59.285: INFO: running pods: 0 < 3
Jan 21 06:37:01.285: INFO: running pods: 0 < 3
Jan 21 06:37:03.285: INFO: running pods: 0 < 3
Jan 21 06:37:05.284: INFO: running pods: 0 < 3
Jan 21 06:37:07.285: INFO: running pods: 0 < 3
Jan 21 06:37:09.285: INFO: running pods: 0 < 3
Jan 21 06:37:11.285: INFO: running pods: 0 < 3
Jan 21 06:37:13.286: INFO: running pods: 0 < 3
Jan 21 06:37:15.284: INFO: running pods: 0 < 3
Jan 21 06:37:17.284: INFO: running pods: 0 < 3
Jan 21 06:37:19.285: INFO: running pods: 0 < 3
Jan 21 06:37:21.285: INFO: running pods: 0 < 3
Jan 21 06:37:23.286: INFO: running pods: 0 < 3
Jan 21 06:37:25.285: INFO: running pods: 0 < 3
Jan 21 06:37:27.285: INFO: running pods: 0 < 3
Jan 21 06:37:29.285: INFO: running pods: 0 < 3
Jan 21 06:37:31.285: INFO: running pods: 0 < 3
Jan 21 06:37:33.285: INFO: running pods: 0 < 3
Jan 21 06:37:35.284: INFO: running pods: 0 < 3
Jan 21 06:37:37.285: INFO: running pods: 0 < 3
Jan 21 06:37:39.285: INFO: running pods: 0 < 3
Jan 21 06:37:41.285: INFO: running pods: 0 < 3
Jan 21 06:37:43.285: INFO: running pods: 0 < 3
Jan 21 06:37:45.284: INFO: running pods: 0 < 3
Jan 21 06:37:47.285: INFO: running pods: 0 < 3
Jan 21 06:37:49.285: INFO: running pods: 0 < 3
Jan 21 06:37:51.285: INFO: running pods: 0 < 3
Jan 21 06:37:53.285: INFO: running pods: 0 < 3
Jan 21 06:37:55.286: INFO: running pods: 0 < 3
Jan 21 06:37:57.284: INFO: running pods: 0 < 3
Jan 21 06:37:59.285: INFO: running pods: 0 < 3
Jan 21 06:38:01.285: INFO: running pods: 0 < 3
Jan 21 06:38:03.285: INFO: running pods: 0 < 3
Jan 21 06:38:05.286: INFO: running pods: 0 < 3
Jan 21 06:38:07.285: INFO: running pods: 0 < 3
Jan 21 06:38:09.285: INFO: running pods: 0 < 3
Jan 21 06:38:11.284: INFO: running pods: 0 < 3
Jan 21 06:38:13.285: INFO: running pods: 0 < 3
Jan 21 06:38:15.285: INFO: running pods: 0 < 3
Jan 21 06:38:17.285: INFO: running pods: 0 < 3
Jan 21 06:38:19.285: INFO: running pods: 0 < 3
Jan 21 06:38:21.285: INFO: running pods: 0 < 3
Jan 21 06:38:23.285: INFO: running pods: 0 < 3
Jan 21 06:38:25.284: INFO: running pods: 0 < 3
Jan 21 06:38:27.285: INFO: running pods: 0 < 3
Jan 21 06:38:29.285: INFO: running pods: 0 < 3
Jan 21 06:38:31.285: INFO: running pods: 0 < 3
Jan 21 06:38:33.285: INFO: running pods: 0 < 3
Jan 21 06:38:35.284: INFO: running pods: 0 < 3
Jan 21 06:38:37.285: INFO: running pods: 0 < 3
Jan 21 06:38:39.285: INFO: running pods: 0 < 3
Jan 21 06:38:41.285: INFO: running pods: 0 < 3
Jan 21 06:38:43.284: INFO: running pods: 0 < 3
Jan 21 06:38:45.285: INFO: running pods: 0 < 3
Jan 21 06:38:47.285: INFO: running pods: 0 < 3
Jan 21 06:38:49.285: INFO: running pods: 0 < 3
Jan 21 06:38:51.285: INFO: running pods: 0 < 3
Jan 21 06:38:53.285: INFO: running pods: 0 < 3
Jan 21 06:38:55.284: INFO: running pods: 0 < 3
Jan 21 06:38:57.285: INFO: running pods: 0 < 3
Jan 21 06:38:59.291: INFO: running pods: 0 < 3
Jan 21 06:39:01.285: INFO: running pods: 0 < 3
Jan 21 06:39:03.285: INFO: running pods: 0 < 3
Jan 21 06:39:05.285: INFO: running pods: 0 < 3
Jan 21 06:39:07.285: INFO: running pods: 0 < 3
Jan 21 06:39:09.285: INFO: running pods: 0 < 3
Jan 21 06:39:11.285: INFO: running pods: 0 < 3
Jan 21 06:39:13.285: INFO: running pods: 0 < 3
Jan 21 06:39:15.285: INFO: running pods: 0 < 3
Jan 21 06:39:17.285: INFO: running pods: 0 < 3
Jan 21 06:39:19.285: INFO: running pods: 0 < 3
Jan 21 06:39:21.285: INFO: running pods: 0 < 3
Jan 21 06:39:23.288: INFO: running pods: 0 < 3
Jan 21 06:39:25.284: INFO: running pods: 0 < 3
Jan 21 06:39:27.285: INFO: running pods: 0 < 3
Jan 21 06:39:29.284: INFO: running pods: 0 < 3
Jan 21 06:39:31.285: INFO: running pods: 0 < 3
Jan 21 06:39:33.286: INFO: running pods: 0 < 3
Jan 21 06:39:35.285: INFO: running pods: 0 < 3
Jan 21 06:39:37.284: INFO: running pods: 0 < 3
Jan 21 06:39:39.286: INFO: running pods: 0 < 3
Jan 21 06:39:41.285: INFO: running pods: 0 < 3
Jan 21 06:39:43.285: INFO: running pods: 0 < 3
Jan 21 06:39:45.284: INFO: running pods: 0 < 3
Jan 21 06:39:47.285: INFO: running pods: 0 < 3
Jan 21 06:39:49.285: INFO: running pods: 0 < 3
Jan 21 06:39:51.285: INFO: running pods: 0 < 3
Jan 21 06:39:53.285: INFO: running pods: 0 < 3
Jan 21 06:39:55.287: INFO: running pods: 0 < 3
Jan 21 06:39:57.285: INFO: running pods: 0 < 3
Jan 21 06:39:59.286: INFO: running pods: 0 < 3
Jan 21 06:40:01.285: INFO: running pods: 0 < 3
Jan 21 06:40:03.284: INFO: running pods: 0 < 3
Jan 21 06:40:05.284: INFO: running pods: 0 < 3
Jan 21 06:40:07.285: INFO: running pods: 0 < 3
Jan 21 06:40:09.285: INFO: running pods: 0 < 3
Jan 21 06:40:11.284: INFO: running pods: 0 < 3
Jan 21 06:40:13.285: INFO: running pods: 0 < 3
Jan 21 06:40:15.284: INFO: running pods: 0 < 3
Jan 21 06:40:17.285: INFO: running pods: 0 < 3
Jan 21 06:40:19.285: INFO: running pods: 0 < 3
Jan 21 06:40:21.285: INFO: running pods: 0 < 3
Jan 21 06:40:23.285: INFO: running pods: 0 < 3
Jan 21 06:40:25.284: INFO: running pods: 0 < 3
Jan 21 06:40:27.285: INFO: running pods: 0 < 3
Jan 21 06:40:29.285: INFO: running pods: 0 < 3
Jan 21 06:40:31.286: INFO: running pods: 1 < 3
Jan 21 06:40:33.287: INFO: running pods: 1 < 3
Jan 21 06:40:35.284: INFO: running pods: 1 < 3
Jan 21 06:40:37.285: INFO: running pods: 2 < 3
Jan 21 06:40:39.285: INFO: running pods: 2 < 3
Jan 21 06:40:41.285: INFO: running pods: 2 < 3
Jan 21 06:40:43.285: INFO: running pods: 2 < 3
Jan 21 06:40:45.286: INFO: running pods: 2 < 3
Jan 21 06:40:47.285: INFO: running pods: 2 < 3
Jan 21 06:40:49.284: INFO: running pods: 2 < 3
Jan 21 06:40:51.285: INFO: running pods: 2 < 3
Jan 21 06:40:53.285: INFO: running pods: 2 < 3
Jan 21 06:40:55.285: INFO: running pods: 2 < 3
Jan 21 06:40:57.285: INFO: running pods: 2 < 3
Jan 21 06:40:59.285: INFO: running pods: 2 < 3
Jan 21 06:41:01.285: INFO: running pods: 2 < 3
Jan 21 06:41:03.285: INFO: running pods: 2 < 3
Jan 21 06:41:05.284: INFO: running pods: 2 < 3
Jan 21 06:41:07.284: INFO: running pods: 2 < 3
Jan 21 06:41:09.285: INFO: running pods: 2 < 3
Jan 21 06:41:11.285: INFO: running pods: 2 < 3
Jan 21 06:41:13.285: INFO: running pods: 2 < 3
Jan 21 06:41:15.285: INFO: running pods: 2 < 3
Jan 21 06:41:17.285: INFO: running pods: 2 < 3
Jan 21 06:41:19.285: INFO: running pods: 2 < 3
Jan 21 06:41:21.286: INFO: running pods: 2 < 3
Jan 21 06:41:23.285: INFO: running pods: 2 < 3
Jan 21 06:41:25.285: INFO: running pods: 2 < 3
Jan 21 06:41:27.285: INFO: running pods: 2 < 3
Jan 21 06:41:29.285: INFO: running pods: 2 < 3
Jan 21 06:41:31.285: INFO: running pods: 2 < 3
Jan 21 06:41:33.285: INFO: running pods: 2 < 3
Jan 21 06:41:35.285: INFO: running pods: 2 < 3
Jan 21 06:41:37.286: INFO: running pods: 2 < 3
Jan 21 06:41:39.286: INFO: running pods: 2 < 3
Jan 21 06:41:41.285: INFO: running pods: 2 < 3
Jan 21 06:41:43.286: INFO: running pods: 2 < 3
Jan 21 06:41:45.285: INFO: running pods: 2 < 3
Jan 21 06:41:47.286: INFO: running pods: 2 < 3
Jan 21 06:41:49.287: INFO: running pods: 2 < 3
Jan 21 06:41:51.285: INFO: running pods: 2 < 3
Jan 21 06:41:53.287: INFO: running pods: 2 < 3
Jan 21 06:41:55.286: INFO: running pods: 2 < 3
Jan 21 06:41:57.286: INFO: running pods: 2 < 3
Jan 21 06:41:59.286: INFO: running pods: 2 < 3
Jan 21 06:42:01.285: INFO: running pods: 2 < 3
Jan 21 06:42:03.285: INFO: running pods: 2 < 3
Jan 21 06:42:05.286: INFO: running pods: 2 < 3
Jan 21 06:42:07.288: INFO: running pods: 2 < 3
Jan 21 06:42:09.286: INFO: running pods: 2 < 3
Jan 21 06:42:11.286: INFO: running pods: 2 < 3
Jan 21 06:42:13.285: INFO: running pods: 2 < 3
Jan 21 06:42:15.286: INFO: running pods: 2 < 3
Jan 21 06:42:17.285: INFO: running pods: 2 < 3
Jan 21 06:42:19.286: INFO: running pods: 2 < 3
Jan 21 06:42:21.286: INFO: running pods: 2 < 3
Jan 21 06:42:23.286: INFO: running pods: 2 < 3
Jan 21 06:42:25.285: INFO: running pods: 2 < 3
Jan 21 06:42:27.286: INFO: running pods: 2 < 3
Jan 21 06:42:29.286: INFO: running pods: 2 < 3
Jan 21 06:42:31.286: INFO: running pods: 2 < 3
Jan 21 06:42:33.286: INFO: running pods: 2 < 3
Jan 21 06:42:35.285: INFO: running pods: 2 < 3
Jan 21 06:42:37.285: INFO: running pods: 2 < 3
Jan 21 06:42:39.286: INFO: running pods: 2 < 3
Jan 21 06:42:41.286: INFO: running pods: 2 < 3
Jan 21 06:42:43.286: INFO: running pods: 2 < 3
Jan 21 06:42:45.285: INFO: running pods: 2 < 3
Jan 21 06:42:47.286: INFO: running pods: 2 < 3
Jan 21 06:42:49.286: INFO: running pods: 2 < 3
Jan 21 06:42:51.285: INFO: running pods: 2 < 3
Jan 21 06:42:53.286: INFO: running pods: 2 < 3
Jan 21 06:42:55.285: INFO: running pods: 2 < 3
Jan 21 06:42:57.289: INFO: running pods: 2 < 3
Jan 21 06:42:59.286: INFO: running pods: 2 < 3
Jan 21 06:43:01.286: INFO: running pods: 2 < 3
Jan 21 06:43:03.285: INFO: running pods: 2 < 3
Jan 21 06:43:05.285: INFO: running pods: 2 < 3
Jan 21 06:43:07.286: INFO: running pods: 2 < 3
Jan 21 06:43:09.285: INFO: running pods: 2 < 3
Jan 21 06:43:11.286: INFO: running pods: 2 < 3
Jan 21 06:43:13.286: INFO: running pods: 2 < 3
Jan 21 06:43:15.285: INFO: running pods: 2 < 3
Jan 21 06:43:17.286: INFO: running pods: 2 < 3
Jan 21 06:43:19.286: INFO: running pods: 2 < 3
Jan 21 06:43:21.285: INFO: running pods: 2 < 3
Jan 21 06:43:23.285: INFO: running pods: 2 < 3
Jan 21 06:43:25.285: INFO: running pods: 2 < 3
Jan 21 06:43:27.285: INFO: running pods: 2 < 3
Jan 21 06:43:29.286: INFO: running pods: 2 < 3
Jan 21 06:43:31.286: INFO: running pods: 2 < 3
Jan 21 06:43:33.285: INFO: running pods: 2 < 3
Jan 21 06:43:35.285: INFO: running pods: 2 < 3
Jan 21 06:43:37.286: INFO: running pods: 2 < 3
Jan 21 06:43:39.286: INFO: running pods: 2 < 3
Jan 21 06:43:41.285: INFO: running pods: 2 < 3
Jan 21 06:43:43.285: INFO: running pods: 2 < 3
Jan 21 06:43:45.285: INFO: running pods: 2 < 3
Jan 21 06:43:47.285: INFO: running pods: 2 < 3
Jan 21 06:43:49.286: INFO: running pods: 2 < 3
Jan 21 06:43:51.285: INFO: running pods: 2 < 3
Jan 21 06:43:53.285: INFO: running pods: 2 < 3
Jan 21 06:43:55.285: INFO: running pods: 2 < 3
Jan 21 06:43:57.285: INFO: running pods: 2 < 3
Jan 21 06:43:59.286: INFO: running pods: 2 < 3
Jan 21 06:44:01.286: INFO: running pods: 2 < 3
Jan 21 06:44:03.279: INFO: running pods: 2 < 3
Jan 21 06:44:05.279: INFO: running pods: 2 < 3
Jan 21 06:44:07.279: INFO: running pods: 2 < 3
Jan 21 06:44:09.279: INFO: running pods: 2 < 3
Jan 21 06:44:11.278: INFO: running pods: 2 < 3
Jan 21 06:44:13.279: INFO: running pods: 2 < 3
Jan 21 06:44:15.278: INFO: running pods: 2 < 3
Jan 21 06:44:17.280: INFO: running pods: 2 < 3
Jan 21 06:44:19.279: INFO: running pods: 2 < 3
Jan 21 06:44:21.279: INFO: running pods: 2 < 3
Jan 21 06:44:23.279: INFO: running pods: 2 < 3
Jan 21 06:44:25.278: INFO: running pods: 2 < 3
Jan 21 06:44:27.278: INFO: running pods: 2 < 3
Jan 21 06:44:29.279: INFO: running pods: 2 < 3
Jan 21 06:44:31.279: INFO: running pods: 2 < 3
Jan 21 06:44:33.279: INFO: running pods: 2 < 3
Jan 21 06:44:35.279: INFO: running pods: 2 < 3
Jan 21 06:44:37.279: INFO: running pods: 2 < 3
Jan 21 06:44:39.278: INFO: running pods: 2 < 3
Jan 21 06:44:41.278: INFO: running pods: 2 < 3
Jan 21 06:44:43.279: INFO: running pods: 2 < 3
Jan 21 06:44:45.278: INFO: running pods: 2 < 3
Jan 21 06:44:47.279: INFO: running pods: 2 < 3
Jan 21 06:44:49.280: INFO: running pods: 2 < 3
Jan 21 06:44:51.279: INFO: running pods: 2 < 3
Jan 21 06:44:53.279: INFO: running pods: 2 < 3
Jan 21 06:44:55.279: INFO: running pods: 2 < 3
Jan 21 06:44:57.279: INFO: running pods: 2 < 3
Jan 21 06:44:59.279: INFO: running pods: 2 < 3
Jan 21 06:45:01.279: INFO: running pods: 2 < 3
Jan 21 06:45:03.278: INFO: running pods: 2 < 3
Jan 21 06:45:05.278: INFO: running pods: 2 < 3
Jan 21 06:45:07.279: INFO: running pods: 2 < 3
Jan 21 06:45:09.279: INFO: running pods: 2 < 3
Jan 21 06:45:11.279: INFO: running pods: 2 < 3
Jan 21 06:45:13.280: INFO: running pods: 2 < 3
Jan 21 06:45:13.385: INFO: running pods: 2 < 3
Jan 21 06:45:13.385: INFO: Unexpected error: Waiting for pods in namespace "disruption-9769" to be ready: 
    <*errors.errorString | 0xc0001c5960>: {
        s: "timed out waiting for the condition",
    }
Jan 21 06:45:13.385: FAIL: Waiting for pods in namespace "disruption-9769" to be ready: timed out waiting for the condition

Full Stack Trace
k8s.io/kubernetes/test/e2e/apps.waitForPodsOrDie({0x8022ee8?, 0xc0007ad520}, {0xc0051fd680, 0xf}, 0x3)
	test/e2e/apps/disruption.go:580 +0x167
k8s.io/kubernetes/test/e2e/apps.glob..func6.6()
	test/e2e/apps/disruption.go:200 +0xf0
[AfterEach] [sig-apps] DisruptionController
  test/e2e/framework/node/init/init.go:32
Jan 21 06:45:13.385: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-apps] DisruptionController
  test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-apps] DisruptionController
  dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/21/23 06:45:13.492�[0m
�[1mSTEP:�[0m Collecting events from namespace "disruption-9769". �[38;5;243m01/21/23 06:45:13.492�[0m
�[1mSTEP:�[0m Found 38 events. �[38;5;243m01/21/23 06:45:13.599�[0m
Jan 21 06:45:13.599: INFO: At 2023-01-21 06:35:12 +0000 UTC - event for foo: {controllermanager } NoPods: No matching pods found
Jan 21 06:45:13.599: INFO: At 2023-01-21 06:35:12 +0000 UTC - event for pod-0: {default-scheduler } Scheduled: Successfully assigned disruption-9769/pod-0 to i-0ce901feb1d51fd3c
Jan 21 06:45:13.599: INFO: At 2023-01-21 06:35:12 +0000 UTC - event for pod-1: {default-scheduler } Scheduled: Successfully assigned disruption-9769/pod-1 to i-0ce901feb1d51fd3c
Jan 21 06:45:13.599: INFO: At 2023-01-21 06:35:13 +0000 UTC - event for pod-0: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "0cf604c4990bd41ad168bcf0f2ad036b75b8e65fe8e0ec716cd2840358d5ff80": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:45:13.599: INFO: At 2023-01-21 06:35:13 +0000 UTC - event for pod-1: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a839feb9c692474355c5f6eabafaa17b09fd72c857d41df380fa8198ffe7cf88": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:45:13.599: INFO: At 2023-01-21 06:35:13 +0000 UTC - event for pod-2: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "483f4a757701cc3b8f358f9bf0bd7385d71ef3c8181e9a6be4f4b73876f8ebd9": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:45:13.599: INFO: At 2023-01-21 06:35:13 +0000 UTC - event for pod-2: {default-scheduler } Scheduled: Successfully assigned disruption-9769/pod-2 to i-0ce901feb1d51fd3c
Jan 21 06:45:13.599: INFO: At 2023-01-21 06:35:25 +0000 UTC - event for pod-1: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "0599707057fe59e00e1b912da8198fbff06050098d276aeb9243c202412a971d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:45:13.599: INFO: At 2023-01-21 06:35:26 +0000 UTC - event for pod-0: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "1c726e1eb17163c4a1a65141f887807e3bb7f931590da44436a03919cced90f6": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:45:13.599: INFO: At 2023-01-21 06:35:28 +0000 UTC - event for pod-2: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ab66255c4ddc04996b6cba03cea456f59b5334dbf382fedff2e412294785703e": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:45:13.599: INFO: At 2023-01-21 06:35:37 +0000 UTC - event for pod-1: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "1a5a6cdc4e804e69a9c2b9012d8ee5f7cd26eb8a55208e244565c7ee7f15af62": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:45:13.599: INFO: At 2023-01-21 06:35:39 +0000 UTC - event for pod-0: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "5e12a3a31d2b474ec72d5f85666e71f94bc624e8d492e558a08430cd59ebb327": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:45:13.599: INFO: At 2023-01-21 06:35:42 +0000 UTC - event for pod-2: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b13f9096dbcd47c52861b4d249879c0b9946fb432e194d9b7c3f74bb3e3c8ad4": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:45:13.599: INFO: At 2023-01-21 06:35:51 +0000 UTC - event for pod-1: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "3b334990ff671f6ba9c590b5d633fe67bd13102da0e5530a644ac243f6900f77": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:45:13.599: INFO: At 2023-01-21 06:35:53 +0000 UTC - event for pod-0: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "7abcd51bb35e8a18cb56c2a03b83c95b85f4442ed057f438b2d78b50b135b9c7": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:45:13.599: INFO: At 2023-01-21 06:35:55 +0000 UTC - event for pod-2: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "98fbc7907bce653219bd566e8b2b85c3d2e8975c596a9ef17243c43c35016d8d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:45:13.599: INFO: At 2023-01-21 06:36:03 +0000 UTC - event for pod-1: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "8058294f8e53d96364ab48ece80841ee16f6d04da586edacf3daa5770e1cfc16": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:45:13.599: INFO: At 2023-01-21 06:36:07 +0000 UTC - event for pod-0: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "8d6ded3f53c78f8bca4ee0122cd89c1d7aabf210ef04a1ea0e2fb3e6da4c3d19": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:45:13.599: INFO: At 2023-01-21 06:36:09 +0000 UTC - event for pod-2: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "3e09f2f25fca08a819be5130767db83949eb0de11b895294fc7e6a983733f845": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:45:13.599: INFO: At 2023-01-21 06:36:16 +0000 UTC - event for pod-1: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "de980bafe472e07c46009bd3ae5ccba3ebcc67ee700c96ea99280c654ab129c0": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:45:13.599: INFO: At 2023-01-21 06:36:20 +0000 UTC - event for pod-0: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ed504822d5f6d3aee62b8b606433f84f193b5282086008e7d67c11710017442c": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:45:13.599: INFO: At 2023-01-21 06:36:23 +0000 UTC - event for pod-2: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d32b57d88ceb9068b241db3f5383b9b52fe699d3a3bf4cad546d4731a50b5295": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:45:13.599: INFO: At 2023-01-21 06:36:27 +0000 UTC - event for pod-1: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "2599fe53e7850c2fd3c33e9a643bf097df08dc8c14e5fdea9e06c3bf5bb992ea": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:45:13.599: INFO: At 2023-01-21 06:36:32 +0000 UTC - event for pod-0: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "f70bf7bd139eb4ff1b25b5f79c5b3279b89a4535cfcd39c148355dae7b0c8dfd": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:45:13.599: INFO: At 2023-01-21 06:36:38 +0000 UTC - event for pod-2: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "3a41b53d080eb2be98bb469f9d9f733fb69d1dfae7eb92bc18320e231d3b7339": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:45:13.599: INFO: At 2023-01-21 06:36:41 +0000 UTC - event for pod-1: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "0064eda56e616ad3f76acb3574302adf4c39411f088f5f587460df4c40be28c1": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:45:13.599: INFO: At 2023-01-21 06:36:45 +0000 UTC - event for pod-0: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "28def42814648af9d5044702dee2b4427a315463ecb190d8d115f7f2e0f2a0d9": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:45:13.599: INFO: At 2023-01-21 06:36:51 +0000 UTC - event for pod-2: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "aec9bcd7ec186f45a01d20bacd5e0cf37cddfb9cc01fcfe8c74ced70bfe6b30e": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:45:13.599: INFO: At 2023-01-21 06:36:55 +0000 UTC - event for pod-1: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e8a6104ea8a0993764b3435ce147b3d4901b58873648727cf195fa2a3c5d9639": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:45:13.599: INFO: At 2023-01-21 06:37:00 +0000 UTC - event for pod-0: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "586a19118d2235a115a21d9f77eb868a5a69d7d89c395fa197c2a3e52288b20e": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:45:13.599: INFO: At 2023-01-21 06:37:04 +0000 UTC - event for pod-2: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "cfc332d237a127dd4c23d6f55780ebfe667b8c513f63cdb9d0795ec2c4d5a7a6": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:45:13.599: INFO: At 2023-01-21 06:37:09 +0000 UTC - event for pod-1: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "9b5e469f29c373c19b4aac66375f17769d1932e5cf5b3754efcbf6badb3ed438": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:45:13.599: INFO: At 2023-01-21 06:37:11 +0000 UTC - event for pod-0: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "71bbaf7228e0f1c079239cd175db23c1a5be30b9f989dd312de72e44e74a6ecf": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:45:13.599: INFO: At 2023-01-21 06:37:17 +0000 UTC - event for pod-2: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "bb8f72776f1098fbeec71deb326a35b072705b048aaeb4f77bb17c01a5b99d53": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:45:13.599: INFO: At 2023-01-21 06:40:29 +0000 UTC - event for pod-1: {kubelet i-0ce901feb1d51fd3c} Created: Created container donothing
Jan 21 06:45:13.599: INFO: At 2023-01-21 06:40:29 +0000 UTC - event for pod-1: {kubelet i-0ce901feb1d51fd3c} Pulled: Container image "registry.k8s.io/pause:3.9" already present on machine
Jan 21 06:45:13.599: INFO: At 2023-01-21 06:40:36 +0000 UTC - event for pod-2: {kubelet i-0ce901feb1d51fd3c} Pulled: Container image "registry.k8s.io/pause:3.9" already present on machine
Jan 21 06:45:13.599: INFO: At 2023-01-21 06:40:36 +0000 UTC - event for pod-2: {kubelet i-0ce901feb1d51fd3c} Created: Created container donothing
Jan 21 06:45:13.705: INFO: POD    NODE                 PHASE    GRACE  CONDITIONS
Jan 21 06:45:13.705: INFO: pod-0  i-0ce901feb1d51fd3c  Pending         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:35:12 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:35:12 +0000 UTC ContainersNotReady containers with unready status: [donothing]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:35:12 +0000 UTC ContainersNotReady containers with unready status: [donothing]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:35:12 +0000 UTC  }]
Jan 21 06:45:13.705: INFO: pod-1  i-0ce901feb1d51fd3c  Running         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:35:12 +0000 UTC  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:40:30 +0000 UTC  } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:40:30 +0000 UTC  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:35:12 +0000 UTC  }]
Jan 21 06:45:13.705: INFO: pod-2  i-0ce901feb1d51fd3c  Running         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:35:13 +0000 UTC  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:40:37 +0000 UTC  } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:40:37 +0000 UTC  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:35:13 +0000 UTC  }]
Jan 21 06:45:13.705: INFO: 
Jan 21 06:45:13.811: INFO: Unable to fetch disruption-9769/pod-0/donothing logs: the server rejected our request for an unknown reason (get pods pod-0)
Jan 21 06:45:14.132: INFO: 
Logging node info for node i-034aa8120dbcec79b
Jan 21 06:45:14.238: INFO: Node Info: &Node{ObjectMeta:{i-034aa8120dbcec79b    c2b3eda9-6144-4855-b163-8deafef2a413 18293 0 2023-01-21 06:26:22 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-034aa8120dbcec79b kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-1a topology.hostpath.csi/node:i-034aa8120dbcec79b topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.44.197 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-034aa8120dbcec79b"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-21 06:26:22 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 06:26:22 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 06:26:22 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-21 06:26:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-21 06:26:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {e2e.test Update v1 2023-01-21 06:33:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-21 06:43:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-034aa8120dbcec79b,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 06:43:43 +0000 UTC,LastTransitionTime:2023-01-21 06:26:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 06:43:43 +0000 UTC,LastTransitionTime:2023-01-21 06:26:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 06:43:43 +0000 UTC,LastTransitionTime:2023-01-21 06:26:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 06:43:43 +0000 UTC,LastTransitionTime:2023-01-21 06:26:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.44.197,},NodeAddress{Type:ExternalIP,Address:3.250.148.238,},NodeAddress{Type:InternalDNS,Address:i-034aa8120dbcec79b.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-034aa8120dbcec79b.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-250-148-238.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec24052f5b49538b50ca690553c9978a,SystemUUID:ec24052f-5b49-538b-50ca-690553c9978a,BootID:e582450b-04c2-4204-a2a8-58ecc23f099e,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 06:45:14.238: INFO: 
Logging kubelet events for node i-034aa8120dbcec79b
Jan 21 06:45:14.346: INFO: 
Logging pods the kubelet thinks is on node i-034aa8120dbcec79b
Jan 21 06:45:14.457: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-l9cqk started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:14.457: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:14.457: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-lnlh9 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:14.457: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:14.457: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-wf6j2 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:14.457: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:14.457: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-nf6xx started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:14.457: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:14.457: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-tjrzg started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:14.457: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:14.457: INFO: coredns-559769c974-f8ncw started at 2023-01-21 06:26:33 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:14.457: INFO: 	Container coredns ready: true, restart count 0
Jan 21 06:45:14.457: INFO: pod-subpath-test-preprovisionedpv-rd6z started at 2023-01-21 06:40:39 +0000 UTC (1+1 container statuses recorded)
Jan 21 06:45:14.457: INFO: 	Init container init-volume-preprovisionedpv-rd6z ready: false, restart count 0
Jan 21 06:45:14.457: INFO: 	Container test-container-subpath-preprovisionedpv-rd6z ready: false, restart count 0
Jan 21 06:45:14.457: INFO: netserver-0 started at 2023-01-21 06:42:05 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:14.457: INFO: 	Container webserver ready: false, restart count 0
Jan 21 06:45:14.457: INFO: cilium-rbcn6 started at 2023-01-21 06:26:22 +0000 UTC (1+1 container statuses recorded)
Jan 21 06:45:14.457: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 21 06:45:14.457: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 21 06:45:14.457: INFO: hostexec-i-034aa8120dbcec79b-fclfv started at 2023-01-21 06:40:23 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:14.457: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 21 06:45:14.457: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-26nnl started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:14.457: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:14.457: INFO: ebs-csi-node-4mfqt started at 2023-01-21 06:26:22 +0000 UTC (0+3 container statuses recorded)
Jan 21 06:45:14.457: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 21 06:45:14.457: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 21 06:45:14.457: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 21 06:45:14.457: INFO: coredns-autoscaler-7cb5c5b969-slvzq started at 2023-01-21 06:26:33 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:14.457: INFO: 	Container autoscaler ready: true, restart count 0
Jan 21 06:45:14.457: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-4xkqd started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:14.457: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: false, restart count 0
Jan 21 06:45:14.457: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-gwjcc started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:14.457: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:14.457: INFO: pod-disruption-failure-ignore-0-lktw9 started at 2023-01-21 06:34:51 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:14.457: INFO: 	Container c ready: true, restart count 0
Jan 21 06:45:14.457: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-sqpxl started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:14.457: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:14.457: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-sjgwj started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:14.457: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:14.457: INFO: pod-disruption-failure-ignore-1-lmh2f started at 2023-01-21 06:34:51 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:14.457: INFO: 	Container c ready: false, restart count 0
Jan 21 06:45:14.849: INFO: 
Latency metrics for node i-034aa8120dbcec79b
Jan 21 06:45:14.849: INFO: 
Logging node info for node i-0483840d8e13a9e6f
Jan 21 06:45:14.955: INFO: Node Info: &Node{ObjectMeta:{i-0483840d8e13a9e6f    6e63ffcd-a34b-47ab-888c-fb980b98335e 17988 0 2023-01-21 06:26:26 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0483840d8e13a9e6f kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-1a topology.hostpath.csi/node:i-0483840d8e13a9e6f topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.35.162 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0483840d8e13a9e6f"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-21 06:26:26 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 06:26:26 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 06:26:26 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-21 06:26:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-21 06:26:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-21 06:33:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-21 06:40:57 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-21 06:42:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-0483840d8e13a9e6f,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 06:42:35 +0000 UTC,LastTransitionTime:2023-01-21 06:26:26 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 06:42:35 +0000 UTC,LastTransitionTime:2023-01-21 06:26:26 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 06:42:35 +0000 UTC,LastTransitionTime:2023-01-21 06:26:26 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 06:42:35 +0000 UTC,LastTransitionTime:2023-01-21 06:26:38 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.35.162,},NodeAddress{Type:ExternalIP,Address:54.220.210.148,},NodeAddress{Type:InternalDNS,Address:i-0483840d8e13a9e6f.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0483840d8e13a9e6f.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-220-210-148.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2945f38534f04be1d719a5a69e0c27,SystemUUID:ec2945f3-8534-f04b-e1d7-19a5a69e0c27,BootID:dc551b58-3eaf-4442-8a18-f820d5bb2e66,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-075484b5e61c2a96e],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-075484b5e61c2a96e,DevicePath:,},},Config:nil,},}
Jan 21 06:45:14.955: INFO: 
Logging kubelet events for node i-0483840d8e13a9e6f
Jan 21 06:45:15.063: INFO: 
Logging pods the kubelet thinks is on node i-0483840d8e13a9e6f
Jan 21 06:45:15.177: INFO: suspend-false-to-true-l6rxb started at 2023-01-21 06:35:20 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:15.177: INFO: 	Container c ready: true, restart count 0
Jan 21 06:45:15.177: INFO: pod-subpath-test-preprovisionedpv-rl8c started at 2023-01-21 06:44:54 +0000 UTC (0+2 container statuses recorded)
Jan 21 06:45:15.177: INFO: 	Container test-container-subpath-preprovisionedpv-rl8c ready: false, restart count 0
Jan 21 06:45:15.177: INFO: 	Container test-container-volume-preprovisionedpv-rl8c ready: false, restart count 0
Jan 21 06:45:15.177: INFO: inline-volume-tester-7hmk6 started at 2023-01-21 06:40:55 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:15.177: INFO: 	Container csi-volume-tester ready: false, restart count 0
Jan 21 06:45:15.177: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-gx9qk started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:15.177: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:15.177: INFO: ebs-csi-node-4fv8j started at 2023-01-21 06:26:27 +0000 UTC (0+3 container statuses recorded)
Jan 21 06:45:15.177: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 21 06:45:15.177: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 21 06:45:15.177: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 21 06:45:15.177: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-5cg9n started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:15.177: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:15.177: INFO: httpd started at 2023-01-21 06:40:23 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:15.177: INFO: 	Container httpd ready: false, restart count 0
Jan 21 06:45:15.177: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-nzzv4 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:15.177: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:15.177: INFO: test-grpc-57f4153d-bee5-4b1a-b84c-59b84c632ef9 started at 2023-01-21 06:38:49 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:15.177: INFO: 	Container etcd ready: true, restart count 0
Jan 21 06:45:15.177: INFO: suspend-false-to-true-cxr2f started at 2023-01-21 06:35:20 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:15.178: INFO: 	Container c ready: false, restart count 0
Jan 21 06:45:15.178: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-ljtgd started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:15.178: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:15.178: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-jkplr started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:15.178: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:15.178: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-jtcl9 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:15.178: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:15.178: INFO: externalsvc-hgg2f started at 2023-01-21 06:42:57 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:15.178: INFO: 	Container externalsvc ready: false, restart count 0
Jan 21 06:45:15.178: INFO: hostexec-i-0483840d8e13a9e6f-wmjxz started at 2023-01-21 06:44:39 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:15.178: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 21 06:45:15.178: INFO: pfpod started at 2023-01-21 06:45:05 +0000 UTC (0+2 container statuses recorded)
Jan 21 06:45:15.178: INFO: 	Container portforwardtester ready: false, restart count 0
Jan 21 06:45:15.178: INFO: 	Container readiness ready: false, restart count 0
Jan 21 06:45:15.178: INFO: cilium-gjcpw started at 2023-01-21 06:26:27 +0000 UTC (1+1 container statuses recorded)
Jan 21 06:45:15.178: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 21 06:45:15.178: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 21 06:45:15.178: INFO: netserver-1 started at 2023-01-21 06:42:05 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:15.178: INFO: 	Container webserver ready: false, restart count 0
Jan 21 06:45:15.178: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-xl5pw started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:15.178: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:15.178: INFO: ss2-0 started at 2023-01-21 06:35:58 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:15.178: INFO: 	Container webserver ready: true, restart count 0
Jan 21 06:45:15.178: INFO: csi-hostpathplugin-0 started at 2023-01-21 06:35:03 +0000 UTC (0+7 container statuses recorded)
Jan 21 06:45:15.178: INFO: 	Container csi-attacher ready: false, restart count 0
Jan 21 06:45:15.178: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan 21 06:45:15.178: INFO: 	Container csi-resizer ready: false, restart count 0
Jan 21 06:45:15.178: INFO: 	Container csi-snapshotter ready: false, restart count 0
Jan 21 06:45:15.178: INFO: 	Container hostpath ready: false, restart count 0
Jan 21 06:45:15.178: INFO: 	Container liveness-probe ready: false, restart count 0
Jan 21 06:45:15.178: INFO: 	Container node-driver-registrar ready: false, restart count 0
Jan 21 06:45:15.178: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-59wl4 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:15.178: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: false, restart count 0
Jan 21 06:45:15.178: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-lx5wh started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:15.178: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:15.178: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-wrc8q started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:15.178: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:15.178: INFO: pod-update-1731a417-e5ea-48ed-9b52-307dd7ddf57f started at 2023-01-21 06:42:17 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:15.178: INFO: 	Container pause ready: false, restart count 0
Jan 21 06:45:15.784: INFO: 
Latency metrics for node i-0483840d8e13a9e6f
Jan 21 06:45:15.784: INFO: 
Logging node info for node i-0ce901feb1d51fd3c
Jan 21 06:45:15.889: INFO: Node Info: &Node{ObjectMeta:{i-0ce901feb1d51fd3c    7d82d388-0267-44ad-a74d-b2eb46841c68 18629 0 2023-01-21 06:26:22 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0ce901feb1d51fd3c kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-1a topology.hostpath.csi/node:i-0ce901feb1d51fd3c topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.55.1 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0ce901feb1d51fd3c"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-21 06:26:22 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 06:26:22 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 06:26:22 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-21 06:26:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-21 06:26:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-21 06:33:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-21 06:44:53 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-21 06:44:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-0ce901feb1d51fd3c,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 06:44:53 +0000 UTC,LastTransitionTime:2023-01-21 06:26:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 06:44:53 +0000 UTC,LastTransitionTime:2023-01-21 06:26:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 06:44:53 +0000 UTC,LastTransitionTime:2023-01-21 06:26:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 06:44:53 +0000 UTC,LastTransitionTime:2023-01-21 06:26:34 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.55.1,},NodeAddress{Type:ExternalIP,Address:54.74.114.32,},NodeAddress{Type:InternalDNS,Address:i-0ce901feb1d51fd3c.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0ce901feb1d51fd3c.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-74-114-32.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec284d9c2eebc996a6b6d4cf4e0f52b7,SystemUUID:ec284d9c-2eeb-c996-a6b6-d4cf4e0f52b7,BootID:e32d5483-bf35-4be2-9254-c24e37c024a3,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0136a6452541f2af3 kubernetes.io/csi/ebs.csi.aws.com^vol-09ae70f9bff51a6a7],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-09ae70f9bff51a6a7,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0136a6452541f2af3,DevicePath:,},},Config:nil,},}
Jan 21 06:45:15.890: INFO: 
Logging kubelet events for node i-0ce901feb1d51fd3c
Jan 21 06:45:15.997: INFO: 
Logging pods the kubelet thinks is on node i-0ce901feb1d51fd3c
Jan 21 06:45:16.111: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-q9jl2 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:16.111: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: false, restart count 0
Jan 21 06:45:16.111: INFO: hostexec-i-0ce901feb1d51fd3c-2pbs6 started at 2023-01-21 06:40:41 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:16.111: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 21 06:45:16.111: INFO: pod-2d889885-3f7a-479c-a414-791defb1b96e started at 2023-01-21 06:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:16.111: INFO: 	Container write-pod ready: false, restart count 0
Jan 21 06:45:16.111: INFO: service-deletion-zzk4s started at 2023-01-21 06:40:23 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:16.111: INFO: 	Container service-deletion ready: false, restart count 0
Jan 21 06:45:16.111: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-zz7mm started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:16.111: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:16.111: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-pkhl6 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:16.111: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:16.111: INFO: test-recreate-deployment-795566c5cb-cw79n started at 2023-01-21 06:42:04 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:16.111: INFO: 	Container agnhost ready: false, restart count 0
Jan 21 06:45:16.111: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-nz2r7 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:16.111: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:16.111: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-lfwx4 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:16.111: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:16.111: INFO: hostpath-symlink-prep-provisioning-3092 started at 2023-01-21 06:44:27 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:16.111: INFO: 	Container init-volume-provisioning-3092 ready: false, restart count 0
Jan 21 06:45:16.111: INFO: cilium-qs82l started at 2023-01-21 06:26:23 +0000 UTC (1+1 container statuses recorded)
Jan 21 06:45:16.111: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 21 06:45:16.111: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 21 06:45:16.111: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-wtrk9 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:16.111: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:16.111: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-dw85q started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:16.111: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:16.111: INFO: externalsvc-cjcvt started at 2023-01-21 06:42:57 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:16.111: INFO: 	Container externalsvc ready: false, restart count 0
Jan 21 06:45:16.111: INFO: pod-42c3941f-639f-4962-ae44-973a160407e8 started at 2023-01-21 06:35:06 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:16.111: INFO: 	Container write-pod ready: true, restart count 0
Jan 21 06:45:16.111: INFO: pod2 started at 2023-01-21 06:44:52 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:16.111: INFO: 	Container agnhost-container ready: false, restart count 0
Jan 21 06:45:16.111: INFO: ss2-1 started at 2023-01-21 06:36:27 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:16.111: INFO: 	Container webserver ready: false, restart count 0
Jan 21 06:45:16.111: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-mxx2t started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:16.111: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:16.111: INFO: pod-2 started at 2023-01-21 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:16.111: INFO: 	Container donothing ready: true, restart count 0
Jan 21 06:45:16.111: INFO: pod-1 started at 2023-01-21 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:16.111: INFO: 	Container donothing ready: true, restart count 0
Jan 21 06:45:16.111: INFO: netserver-2 started at 2023-01-21 06:42:05 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:16.111: INFO: 	Container webserver ready: false, restart count 0
Jan 21 06:45:16.111: INFO: ebs-csi-node-qp79b started at 2023-01-21 06:26:23 +0000 UTC (0+3 container statuses recorded)
Jan 21 06:45:16.111: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 21 06:45:16.111: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 21 06:45:16.111: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 21 06:45:16.111: INFO: hostexec-i-0ce901feb1d51fd3c-96hxq started at 2023-01-21 06:40:47 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:16.111: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 21 06:45:16.111: INFO: pod-2214d111-6f9f-4cf4-938a-ea98d46a830a started at 2023-01-21 06:40:51 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:16.111: INFO: 	Container write-pod ready: false, restart count 0
Jan 21 06:45:16.111: INFO: pod-a202bbe2-d16a-40d8-81e4-37e789c8fe6b started at 2023-01-21 06:40:58 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:16.111: INFO: 	Container write-pod ready: false, restart count 0
Jan 21 06:45:16.111: INFO: pod-0 started at 2023-01-21 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:16.111: INFO: 	Container donothing ready: false, restart count 0
Jan 21 06:45:16.111: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-72ss9 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:16.111: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:16.111: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-tsmhc started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:16.111: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:16.577: INFO: 
Latency metrics for node i-0ce901feb1d51fd3c
Jan 21 06:45:16.577: INFO: 
Logging node info for node i-0d2f2d71d5d6f8b5a
Jan 21 06:45:16.683: INFO: Node Info: &Node{ObjectMeta:{i-0d2f2d71d5d6f8b5a    d2f1894b-950d-45a2-a42f-7d9213bb75b8 17658 0 2023-01-21 06:24:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0d2f2d71d5d6f8b5a kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:eu-west-1a topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.42.168 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0d2f2d71d5d6f8b5a"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-21 06:24:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-21 06:25:04 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-01-21 06:25:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-21 06:25:18 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 06:25:18 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-21 06:41:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-0d2f2d71d5d6f8b5a,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892310016 0} {<nil>} 3801084Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787452416 0} {<nil>} 3698684Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 06:41:55 +0000 UTC,LastTransitionTime:2023-01-21 06:24:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 06:41:55 +0000 UTC,LastTransitionTime:2023-01-21 06:24:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 06:41:55 +0000 UTC,LastTransitionTime:2023-01-21 06:24:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 06:41:55 +0000 UTC,LastTransitionTime:2023-01-21 06:25:16 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.168,},NodeAddress{Type:ExternalIP,Address:3.249.87.249,},NodeAddress{Type:InternalDNS,Address:i-0d2f2d71d5d6f8b5a.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0d2f2d71d5d6f8b5a.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-249-87-249.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2326005f1a498ecb0bcf8cde478bd4,SystemUUID:ec232600-5f1a-498e-cb0b-cf8cde478bd4,BootID:45d9d2b8-2840-49c2-9bdc-aa7244b00f22,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.1],SizeBytes:135178704,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.1],SizeBytes:124995897,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.1],SizeBytes:57661752,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43643671,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42841306,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4965794,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 06:45:16.683: INFO: 
Logging kubelet events for node i-0d2f2d71d5d6f8b5a
Jan 21 06:45:16.791: INFO: 
Logging pods the kubelet thinks is on node i-0d2f2d71d5d6f8b5a
Jan 21 06:45:16.903: INFO: kube-controller-manager-i-0d2f2d71d5d6f8b5a started at 2023-01-21 06:24:04 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:16.903: INFO: 	Container kube-controller-manager ready: true, restart count 2
Jan 21 06:45:16.903: INFO: kube-scheduler-i-0d2f2d71d5d6f8b5a started at 2023-01-21 06:24:04 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:16.903: INFO: 	Container kube-scheduler ready: true, restart count 0
Jan 21 06:45:16.903: INFO: aws-cloud-controller-manager-cqjd9 started at 2023-01-21 06:25:08 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:16.903: INFO: 	Container aws-cloud-controller-manager ready: true, restart count 0
Jan 21 06:45:16.903: INFO: ebs-csi-node-tb6br started at 2023-01-21 06:25:08 +0000 UTC (0+3 container statuses recorded)
Jan 21 06:45:16.903: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 21 06:45:16.903: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 21 06:45:16.903: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 21 06:45:16.903: INFO: cilium-operator-5dd44dc49f-fld4m started at 2023-01-21 06:25:08 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:16.903: INFO: 	Container cilium-operator ready: true, restart count 0
Jan 21 06:45:16.903: INFO: ebs-csi-controller-5bd98b456f-b9lnh started at 2023-01-21 06:25:08 +0000 UTC (0+5 container statuses recorded)
Jan 21 06:45:16.903: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 21 06:45:16.903: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 21 06:45:16.903: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 21 06:45:16.903: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 21 06:45:16.903: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 21 06:45:16.903: INFO: etcd-manager-main-i-0d2f2d71d5d6f8b5a started at 2023-01-21 06:24:04 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:16.903: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 21 06:45:16.903: INFO: kube-apiserver-i-0d2f2d71d5d6f8b5a started at 2023-01-21 06:24:04 +0000 UTC (0+2 container statuses recorded)
Jan 21 06:45:16.903: INFO: 	Container healthcheck ready: true, restart count 0
Jan 21 06:45:16.903: INFO: 	Container kube-apiserver ready: true, restart count 1
Jan 21 06:45:16.903: INFO: kops-controller-hffbm started at 2023-01-21 06:25:08 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:16.903: INFO: 	Container kops-controller ready: true, restart count 0
Jan 21 06:45:16.903: INFO: cilium-6bgng started at 2023-01-21 06:25:08 +0000 UTC (1+1 container statuses recorded)
Jan 21 06:45:16.903: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 21 06:45:16.903: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 21 06:45:16.903: INFO: dns-controller-69987775c6-vgxml started at 2023-01-21 06:25:08 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:16.903: INFO: 	Container dns-controller ready: true, restart count 0
Jan 21 06:45:16.903: INFO: etcd-manager-events-i-0d2f2d71d5d6f8b5a started at 2023-01-21 06:24:03 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:16.903: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 21 06:45:17.282: INFO: 
Latency metrics for node i-0d2f2d71d5d6f8b5a
Jan 21 06:45:17.282: INFO: 
Logging node info for node i-0f3b8117f4ecfc9ec
Jan 21 06:45:17.390: INFO: Node Info: &Node{ObjectMeta:{i-0f3b8117f4ecfc9ec    019b5e58-b8c2-4ac5-ba8d-47ba49f9fe9c 17313 0 2023-01-21 06:26:29 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0f3b8117f4ecfc9ec kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-1a topology.hostpath.csi/node:i-0f3b8117f4ecfc9ec topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.36.94 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0f3b8117f4ecfc9ec"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-21 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 06:26:29 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-21 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-21 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-21 06:33:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-21 06:40:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-0f3b8117f4ecfc9ec,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 06:40:57 +0000 UTC,LastTransitionTime:2023-01-21 06:26:29 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 06:40:57 +0000 UTC,LastTransitionTime:2023-01-21 06:26:29 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 06:40:57 +0000 UTC,LastTransitionTime:2023-01-21 06:26:29 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 06:40:57 +0000 UTC,LastTransitionTime:2023-01-21 06:26:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.36.94,},NodeAddress{Type:ExternalIP,Address:54.72.134.71,},NodeAddress{Type:InternalDNS,Address:i-0f3b8117f4ecfc9ec.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0f3b8117f4ecfc9ec.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-72-134-71.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2c9416b8fb84b0403f690a294bd09b,SystemUUID:ec2c9416-b8fb-84b0-403f-690a294bd09b,BootID:4e9f8b9b-5350-48ad-8083-40ed7929b713,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 06:45:17.390: INFO: 
Logging kubelet events for node i-0f3b8117f4ecfc9ec
Jan 21 06:45:17.497: INFO: 
Logging pods the kubelet thinks is on node i-0f3b8117f4ecfc9ec
Jan 21 06:45:17.615: INFO: ebs-csi-node-5dm54 started at 2023-01-21 06:26:30 +0000 UTC (0+3 container statuses recorded)
Jan 21 06:45:17.615: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 21 06:45:17.615: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 21 06:45:17.615: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 21 06:45:17.615: INFO: cilium-2brsw started at 2023-01-21 06:26:30 +0000 UTC (1+1 container statuses recorded)
Jan 21 06:45:17.615: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 21 06:45:17.615: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 21 06:45:17.615: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-8zpkj started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:17.615: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:17.615: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-zgzjd started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:17.615: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:17.615: INFO: pod1 started at 2023-01-21 06:44:49 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:17.615: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 21 06:45:17.615: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-7vwsn started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:17.615: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:17.615: INFO: coredns-559769c974-7fbns started at 2023-01-21 06:26:59 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:17.615: INFO: 	Container coredns ready: true, restart count 0
Jan 21 06:45:17.615: INFO: netserver-3 started at 2023-01-21 06:42:05 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:17.615: INFO: 	Container webserver ready: false, restart count 0
Jan 21 06:45:17.615: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-28wx9 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:17.615: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:17.615: INFO: pod-50b10bdb-b71a-4475-a054-a7d09c720326 started at 2023-01-21 06:42:06 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:17.615: INFO: 	Container write-pod ready: false, restart count 0
Jan 21 06:45:17.615: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-mlsc7 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:17.615: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:17.615: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-frfcl started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:17.615: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:17.615: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-wzrc6 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:17.615: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:17.615: INFO: hostexec-i-0f3b8117f4ecfc9ec-h88h7 started at 2023-01-21 06:42:01 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:17.615: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 21 06:45:17.615: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-5pk66 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:17.615: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:17.615: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-fjkff started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:17.615: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:17.615: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-4sr7v started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:45:17.615: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:45:18.097: INFO: 
Latency metrics for node i-0f3b8117f4ecfc9ec
[DeferCleanup (Each)] [sig-apps] DisruptionController
  tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "disruption-9769" for this suite. �[38;5;243m01/21/23 06:45:18.097�[0m

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] should perform rolling updates and roll backs of template modifications [Conformance] 10m30s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-apps\]\sStatefulSet\sBasic\sStatefulSet\sfunctionality\s\[StatefulSetBasic\]\sshould\sperform\srolling\supdates\sand\sroll\sbacks\sof\stemplate\smodifications\s\[Conformance\]$'

test/e2e/framework/statefulset/wait.go:58
k8s.io/kubernetes/test/e2e/framework/statefulset.WaitForRunning({0x8022ee8?, 0xc000a3a000}, 0x3, 0x3, 0xc001cc7900)
	test/e2e/framework/statefulset/wait.go:58 +0xf9
k8s.io/kubernetes/test/e2e/framework/statefulset.WaitForRunningAndReady(...)
	test/e2e/framework/statefulset/wait.go:80
k8s.io/kubernetes/test/e2e/apps.rollbackTest({0x8022ee8, 0xc000a3a000}, {0xc0048fad60, 0xf}, 0xc001cc7400)
	test/e2e/apps/statefulset.go:1569 +0x155
k8s.io/kubernetes/test/e2e/apps.glob..func10.2.7()
	test/e2e/apps/statefulset.go:309 +0xe6
				[BeforeEach] [sig-apps] StatefulSet
  set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/21/23 06:35:57.53�[0m
Jan 21 06:35:57.530: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename statefulset �[38;5;243m01/21/23 06:35:57.531�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/21/23 06:35:57.87�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/21/23 06:35:58.094�[0m
[BeforeEach] [sig-apps] StatefulSet
  test/e2e/framework/metrics/init/init.go:31
[BeforeEach] [sig-apps] StatefulSet
  test/e2e/apps/statefulset.go:98
[BeforeEach] Basic StatefulSet functionality [StatefulSetBasic]
  test/e2e/apps/statefulset.go:113
�[1mSTEP:�[0m Creating service test in namespace statefulset-433 �[38;5;243m01/21/23 06:35:58.319�[0m
[It] should perform rolling updates and roll backs of template modifications [Conformance]
  test/e2e/apps/statefulset.go:306
�[1mSTEP:�[0m Creating a new StatefulSet �[38;5;243m01/21/23 06:35:58.432�[0m
Jan 21 06:35:58.661: INFO: Found 1 stateful pods, waiting for 3
Jan 21 06:36:08.774: INFO: Found 1 stateful pods, waiting for 3
Jan 21 06:36:18.774: INFO: Found 1 stateful pods, waiting for 3
Jan 21 06:36:28.774: INFO: Found 2 stateful pods, waiting for 3
Jan 21 06:36:38.774: INFO: Found 2 stateful pods, waiting for 3
Jan 21 06:36:48.774: INFO: Found 2 stateful pods, waiting for 3
Jan 21 06:36:58.774: INFO: Found 2 stateful pods, waiting for 3
Jan 21 06:37:08.775: INFO: Found 2 stateful pods, waiting for 3
Jan 21 06:37:18.774: INFO: Found 2 stateful pods, waiting for 3
Jan 21 06:37:28.774: INFO: Found 2 stateful pods, waiting for 3
Jan 21 06:37:38.774: INFO: Found 2 stateful pods, waiting for 3
Jan 21 06:37:48.774: INFO: Found 2 stateful pods, waiting for 3
Jan 21 06:37:58.774: INFO: Found 2 stateful pods, waiting for 3
Jan 21 06:38:08.774: INFO: Found 2 stateful pods, waiting for 3
Jan 21 06:38:18.774: INFO: Found 2 stateful pods, waiting for 3
Jan 21 06:38:28.774: INFO: Found 2 stateful pods, waiting for 3
Jan 21 06:38:38.775: INFO: Found 2 stateful pods, waiting for 3
Jan 21 06:38:48.775: INFO: Found 2 stateful pods, waiting for 3
Jan 21 06:38:58.775: INFO: Found 2 stateful pods, waiting for 3
Jan 21 06:39:08.775: INFO: Found 2 stateful pods, waiting for 3
Jan 21 06:39:18.775: INFO: Found 2 stateful pods, waiting for 3
Jan 21 06:39:28.775: INFO: Found 2 stateful pods, waiting for 3
Jan 21 06:39:38.775: INFO: Found 2 stateful pods, waiting for 3
Jan 21 06:39:48.775: INFO: Found 2 stateful pods, waiting for 3
Jan 21 06:39:58.774: INFO: Found 2 stateful pods, waiting for 3
Jan 21 06:40:08.780: INFO: Found 2 stateful pods, waiting for 3
Jan 21 06:40:18.775: INFO: Found 2 stateful pods, waiting for 3
Jan 21 06:40:28.775: INFO: Found 2 stateful pods, waiting for 3
Jan 21 06:40:38.776: INFO: Found 2 stateful pods, waiting for 3
Jan 21 06:40:48.775: INFO: Found 2 stateful pods, waiting for 3
Jan 21 06:40:58.774: INFO: Found 2 stateful pods, waiting for 3
Jan 21 06:41:08.775: INFO: Found 2 stateful pods, waiting for 3
Jan 21 06:41:18.774: INFO: Found 2 stateful pods, waiting for 3
Jan 21 06:41:28.774: INFO: Found 2 stateful pods, waiting for 3
Jan 21 06:41:38.774: INFO: Found 2 stateful pods, waiting for 3
Jan 21 06:41:48.775: INFO: Found 2 stateful pods, waiting for 3
Jan 21 06:41:58.774: INFO: Found 2 stateful pods, waiting for 3
Jan 21 06:42:08.775: INFO: Found 2 stateful pods, waiting for 3
Jan 21 06:42:18.776: INFO: Found 2 stateful pods, waiting for 3
Jan 21 06:42:28.774: INFO: Found 2 stateful pods, waiting for 3
Jan 21 06:42:38.774: INFO: Found 2 stateful pods, waiting for 3
Jan 21 06:42:48.774: INFO: Found 2 stateful pods, waiting for 3
Jan 21 06:42:58.775: INFO: Found 2 stateful pods, waiting for 3
Jan 21 06:43:08.774: INFO: Found 2 stateful pods, waiting for 3
Jan 21 06:43:18.774: INFO: Found 2 stateful pods, waiting for 3
Jan 21 06:43:28.775: INFO: Found 2 stateful pods, waiting for 3
Jan 21 06:43:38.775: INFO: Found 2 stateful pods, waiting for 3
Jan 21 06:43:48.774: INFO: Found 2 stateful pods, waiting for 3
Jan 21 06:43:58.775: INFO: Found 2 stateful pods, waiting for 3
Jan 21 06:44:08.768: INFO: Found 2 stateful pods, waiting for 3
Jan 21 06:44:18.768: INFO: Found 2 stateful pods, waiting for 3
Jan 21 06:44:28.767: INFO: Found 2 stateful pods, waiting for 3
Jan 21 06:44:38.767: INFO: Found 2 stateful pods, waiting for 3
Jan 21 06:44:48.767: INFO: Found 2 stateful pods, waiting for 3
Jan 21 06:44:58.767: INFO: Found 2 stateful pods, waiting for 3
Jan 21 06:45:08.767: INFO: Found 2 stateful pods, waiting for 3
Jan 21 06:45:18.767: INFO: Found 2 stateful pods, waiting for 3
Jan 21 06:45:28.768: INFO: Found 2 stateful pods, waiting for 3
Jan 21 06:45:38.767: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan 21 06:45:38.767: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan 21 06:45:38.767: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan 21 06:45:48.767: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan 21 06:45:48.767: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan 21 06:45:48.767: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan 21 06:45:58.791: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan 21 06:45:58.791: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan 21 06:45:58.791: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan 21 06:45:58.901: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan 21 06:45:58.901: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan 21 06:45:58.901: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan 21 06:45:58.901: FAIL: Failed waiting for pods to enter running: timed out waiting for the condition

Full Stack Trace
k8s.io/kubernetes/test/e2e/framework/statefulset.WaitForRunning({0x8022ee8?, 0xc000a3a000}, 0x3, 0x3, 0xc001cc7900)
	test/e2e/framework/statefulset/wait.go:58 +0xf9
k8s.io/kubernetes/test/e2e/framework/statefulset.WaitForRunningAndReady(...)
	test/e2e/framework/statefulset/wait.go:80
k8s.io/kubernetes/test/e2e/apps.rollbackTest({0x8022ee8, 0xc000a3a000}, {0xc0048fad60, 0xf}, 0xc001cc7400)
	test/e2e/apps/statefulset.go:1569 +0x155
k8s.io/kubernetes/test/e2e/apps.glob..func10.2.7()
	test/e2e/apps/statefulset.go:309 +0xe6
[AfterEach] Basic StatefulSet functionality [StatefulSetBasic]
  test/e2e/apps/statefulset.go:124
Jan 21 06:45:59.012: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/9fb2ac9e-9953-11ed-a697-56ea552f9d82/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=statefulset-433 describe po ss2-0'
Jan 21 06:45:59.643: INFO: stderr: ""
Jan 21 06:45:59.643: INFO: stdout: "Name:             ss2-0\nNamespace:        statefulset-433\nPriority:         0\nService Account:  default\nNode:             i-0483840d8e13a9e6f/172.20.35.162\nStart Time:       Sat, 21 Jan 2023 06:35:58 +0000\nLabels:           baz=blah\n                  controller-revision-hash=ss2-7b6c9599d5\n                  foo=bar\n                  statefulset.kubernetes.io/pod-name=ss2-0\nAnnotations:      <none>\nStatus:           Running\nIP:               172.20.39.189\nIPs:\n  IP:           172.20.39.189\nControlled By:  StatefulSet/ss2\nContainers:\n  webserver:\n    Container ID:   containerd://494dc26d8dbf3c72c6e062aaa08a5213cff3481842f73e3e1166e553bf9b794f\n    Image:          registry.k8s.io/e2e-test-images/httpd:2.4.38-4\n    Image ID:       registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22\n    Port:           <none>\n    Host Port:      <none>\n    State:          Running\n      Started:      Sat, 21 Jan 2023 06:36:27 +0000\n    Ready:          True\n    Restart Count:  0\n    Readiness:      http-get http://:80/index.html delay=0s timeout=1s period=1s #success=1 #failure=1\n    Environment:    <none>\n    Mounts:\n      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-hl2f9 (ro)\nConditions:\n  Type              Status\n  Initialized       True \n  Ready             True \n  ContainersReady   True \n  PodScheduled      True \nVolumes:\n  kube-api-access-hl2f9:\n    Type:                    Projected (a volume that contains injected data from multiple sources)\n    TokenExpirationSeconds:  3607\n    ConfigMapName:           kube-root-ca.crt\n    ConfigMapOptional:       <nil>\n    DownwardAPI:             true\nQoS Class:                   BestEffort\nNode-Selectors:              <none>\nTolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s\n                             node.kubernetes.io/unreachable:NoExecute op=Exists for 300s\nEvents:\n  Type     Reason                  Age    From               Message\n  ----     ------                  ----   ----               -------\n  Normal   Scheduled               10m    default-scheduler  Successfully assigned statefulset-433/ss2-0 to i-0483840d8e13a9e6f\n  Warning  FailedCreatePodSandBox  10m    kubelet            Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"f4f07b48ec754a08977484dce63b92a54ce24dc4429814ead699a4a128a0c8f0\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available\n  Warning  FailedCreatePodSandBox  9m47s  kubelet            Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"2243252badbebf303909edf936444242554c66cb6a043f6bca8c1172303eea4e\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available\n  Normal   Pulled                  9m32s  kubelet            Container image \"registry.k8s.io/e2e-test-images/httpd:2.4.38-4\" already present on machine\n  Normal   Created                 9m32s  kubelet            Created container webserver\n  Normal   Started                 9m32s  kubelet            Started container webserver\n"
Jan 21 06:45:59.643: INFO: 
Output of kubectl describe ss2-0:
Name:             ss2-0
Namespace:        statefulset-433
Priority:         0
Service Account:  default
Node:             i-0483840d8e13a9e6f/172.20.35.162
Start Time:       Sat, 21 Jan 2023 06:35:58 +0000
Labels:           baz=blah
                  controller-revision-hash=ss2-7b6c9599d5
                  foo=bar
                  statefulset.kubernetes.io/pod-name=ss2-0
Annotations:      <none>
Status:           Running
IP:               172.20.39.189
IPs:
  IP:           172.20.39.189
Controlled By:  StatefulSet/ss2
Containers:
  webserver:
    Container ID:   containerd://494dc26d8dbf3c72c6e062aaa08a5213cff3481842f73e3e1166e553bf9b794f
    Image:          registry.k8s.io/e2e-test-images/httpd:2.4.38-4
    Image ID:       registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22
    Port:           <none>
    Host Port:      <none>
    State:          Running
      Started:      Sat, 21 Jan 2023 06:36:27 +0000
    Ready:          True
    Restart Count:  0
    Readiness:      http-get http://:80/index.html delay=0s timeout=1s period=1s #success=1 #failure=1
    Environment:    <none>
    Mounts:
      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-hl2f9 (ro)
Conditions:
  Type              Status
  Initialized       True 
  Ready             True 
  ContainersReady   True 
  PodScheduled      True 
Volumes:
  kube-api-access-hl2f9:
    Type:                    Projected (a volume that contains injected data from multiple sources)
    TokenExpirationSeconds:  3607
    ConfigMapName:           kube-root-ca.crt
    ConfigMapOptional:       <nil>
    DownwardAPI:             true
QoS Class:                   BestEffort
Node-Selectors:              <none>
Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
                             node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
  Type     Reason                  Age    From               Message
  ----     ------                  ----   ----               -------
  Normal   Scheduled               10m    default-scheduler  Successfully assigned statefulset-433/ss2-0 to i-0483840d8e13a9e6f
  Warning  FailedCreatePodSandBox  10m    kubelet            Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "f4f07b48ec754a08977484dce63b92a54ce24dc4429814ead699a4a128a0c8f0": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
  Warning  FailedCreatePodSandBox  9m47s  kubelet            Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "2243252badbebf303909edf936444242554c66cb6a043f6bca8c1172303eea4e": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
  Normal   Pulled                  9m32s  kubelet            Container image "registry.k8s.io/e2e-test-images/httpd:2.4.38-4" already present on machine
  Normal   Created                 9m32s  kubelet            Created container webserver
  Normal   Started                 9m32s  kubelet            Started container webserver

Jan 21 06:45:59.643: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/9fb2ac9e-9953-11ed-a697-56ea552f9d82/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=statefulset-433 logs ss2-0 --tail=100'
Jan 21 06:46:00.201: INFO: stderr: ""
Jan 21 06:46:00.201: INFO: stdout: "172.20.35.162 - - [21/Jan/2023:06:44:20 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:44:21 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:44:22 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:44:23 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:44:24 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:44:25 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:44:26 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:44:27 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:44:28 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:44:29 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:44:30 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:44:31 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:44:32 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:44:33 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:44:34 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:44:35 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:44:36 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:44:37 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:44:38 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:44:39 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:44:40 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:44:41 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:44:42 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:44:43 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:44:44 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:44:45 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:44:46 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:44:47 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:44:48 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:44:49 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:44:50 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:44:51 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:44:52 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:44:53 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:44:54 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:44:55 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:44:56 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:44:57 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:44:58 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:44:59 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:00 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:01 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:02 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:03 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:04 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:05 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:06 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:07 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:08 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:09 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:10 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:11 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:12 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:13 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:14 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:15 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:16 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:17 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:18 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:19 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:20 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:21 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:22 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:23 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:24 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:25 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:26 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:27 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:28 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:29 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:30 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:31 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:32 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:33 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:34 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:35 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:36 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:37 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:38 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:39 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:40 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:41 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:42 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:43 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:44 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:45 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:46 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:47 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:48 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:49 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:50 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:51 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:52 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:53 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:54 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:55 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:56 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:57 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:58 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.162 - - [21/Jan/2023:06:45:59 +0000] \"GET /index.html HTTP/1.1\" 200 45\n"
Jan 21 06:46:00.201: INFO: 
Last 100 log lines of ss2-0:
172.20.35.162 - - [21/Jan/2023:06:44:20 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:44:21 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:44:22 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:44:23 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:44:24 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:44:25 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:44:26 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:44:27 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:44:28 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:44:29 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:44:30 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:44:31 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:44:32 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:44:33 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:44:34 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:44:35 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:44:36 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:44:37 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:44:38 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:44:39 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:44:40 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:44:41 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:44:42 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:44:43 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:44:44 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:44:45 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:44:46 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:44:47 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:44:48 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:44:49 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:44:50 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:44:51 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:44:52 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:44:53 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:44:54 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:44:55 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:44:56 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:44:57 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:44:58 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:44:59 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:00 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:01 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:02 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:03 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:04 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:05 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:06 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:07 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:08 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:09 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:10 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:11 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:12 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:13 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:14 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:15 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:16 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:17 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:18 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:19 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:20 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:21 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:22 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:23 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:24 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:25 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:26 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:27 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:28 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:29 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:30 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:31 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:32 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:33 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:34 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:35 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:36 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:37 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:38 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:39 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:40 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:41 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:42 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:43 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:44 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:45 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:46 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:47 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:48 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:49 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:50 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:51 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:52 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:53 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:54 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:55 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:56 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:57 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:58 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.162 - - [21/Jan/2023:06:45:59 +0000] "GET /index.html HTTP/1.1" 200 45

Jan 21 06:46:00.201: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/9fb2ac9e-9953-11ed-a697-56ea552f9d82/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=statefulset-433 describe po ss2-1'
Jan 21 06:46:00.834: INFO: stderr: ""
Jan 21 06:46:00.834: INFO: stdout: "Name:             ss2-1\nNamespace:        statefulset-433\nPriority:         0\nService Account:  default\nNode:             i-0ce901feb1d51fd3c/172.20.55.1\nStart Time:       Sat, 21 Jan 2023 06:36:27 +0000\nLabels:           baz=blah\n                  controller-revision-hash=ss2-7b6c9599d5\n                  foo=bar\n                  statefulset.kubernetes.io/pod-name=ss2-1\nAnnotations:      <none>\nStatus:           Running\nIP:               172.20.59.126\nIPs:\n  IP:           172.20.59.126\nControlled By:  StatefulSet/ss2\nContainers:\n  webserver:\n    Container ID:   containerd://7a45339e2a7d8583e9ffe63087c4ee4e643299f06d91b3dfe86f5e892558c299\n    Image:          registry.k8s.io/e2e-test-images/httpd:2.4.38-4\n    Image ID:       registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22\n    Port:           <none>\n    Host Port:      <none>\n    State:          Running\n      Started:      Sat, 21 Jan 2023 06:45:36 +0000\n    Ready:          True\n    Restart Count:  0\n    Readiness:      http-get http://:80/index.html delay=0s timeout=1s period=1s #success=1 #failure=1\n    Environment:    <none>\n    Mounts:\n      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-b7sf9 (ro)\nConditions:\n  Type              Status\n  Initialized       True \n  Ready             True \n  ContainersReady   True \n  PodScheduled      True \nVolumes:\n  kube-api-access-b7sf9:\n    Type:                    Projected (a volume that contains injected data from multiple sources)\n    TokenExpirationSeconds:  3607\n    ConfigMapName:           kube-root-ca.crt\n    ConfigMapOptional:       <nil>\n    DownwardAPI:             true\nQoS Class:                   BestEffort\nNode-Selectors:              <none>\nTolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s\n                             node.kubernetes.io/unreachable:NoExecute op=Exists for 300s\nEvents:\n  Type     Reason                  Age                    From               Message\n  ----     ------                  ----                   ----               -------\n  Normal   Scheduled               9m33s                  default-scheduler  Successfully assigned statefulset-433/ss2-1 to i-0ce901feb1d51fd3c\n  Warning  FailedCreatePodSandBox  9m33s                  kubelet            Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"a41e2db2c51cbe0c9e1dfd634c3855999c8f4007c58b1f6596d0d6cc64804e71\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available\n  Warning  FailedCreatePodSandBox  9m18s                  kubelet            Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"4f723295b0b64de1feea1c44291aaf72ab97f28d599cf718bac91603e25384bf\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available\n  Warning  FailedCreatePodSandBox  9m4s                   kubelet            Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"1abb7765711307fee5cc996490844d81028a47b0ae2586fae171e2e44128a468\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available\n  Warning  FailedCreatePodSandBox  8m50s                  kubelet            Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"7a547dec463e6a4ae3d2d3bfe5c3b4ac75e23d46c51f59037c478e371384464b\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available\n  Warning  FailedCreatePodSandBox  8m37s                  kubelet            Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"558809c1981a8fba88a57ae15aeb1665f9ecf649bb9a5cb3f76adfe496610720\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available\n  Warning  FailedCreatePodSandBox  8m23s                  kubelet            Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"d984067004892d17f967347fc98e4d8e5b91a762a619acfcfbd787b26c411fcf\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available\n  Warning  FailedCreatePodSandBox  8m11s                  kubelet            Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"02f7b63f460ede378650f4c74c884fdeb345acad97ed5953b3ba60346d01d2f2\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available\n  Warning  FailedCreatePodSandBox  7m57s                  kubelet            Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"63acd81fabdb89c575bd1cecf10f4cf33bee70ea171571fb0ebbc2ab91aa239f\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available\n  Warning  FailedCreatePodSandBox  7m44s                  kubelet            Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"65bd0abcfe6a73e8277e50ce31d1547809ced4180ee27778d0b906dd082aeac3\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available\n  Warning  FailedCreatePodSandBox  4m7s (x17 over 7m33s)  kubelet            (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"79ed4ec6a68fef2cf16562a0e1ce14d2769a55f9c09c0e5bd311621440e9c4fd\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available\n"
Jan 21 06:46:00.834: INFO: 
Output of kubectl describe ss2-1:
Name:             ss2-1
Namespace:        statefulset-433
Priority:         0
Service Account:  default
Node:             i-0ce901feb1d51fd3c/172.20.55.1
Start Time:       Sat, 21 Jan 2023 06:36:27 +0000
Labels:           baz=blah
                  controller-revision-hash=ss2-7b6c9599d5
                  foo=bar
                  statefulset.kubernetes.io/pod-name=ss2-1
Annotations:      <none>
Status:           Running
IP:               172.20.59.126
IPs:
  IP:           172.20.59.126
Controlled By:  StatefulSet/ss2
Containers:
  webserver:
    Container ID:   containerd://7a45339e2a7d8583e9ffe63087c4ee4e643299f06d91b3dfe86f5e892558c299
    Image:          registry.k8s.io/e2e-test-images/httpd:2.4.38-4
    Image ID:       registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22
    Port:           <none>
    Host Port:      <none>
    State:          Running
      Started:      Sat, 21 Jan 2023 06:45:36 +0000
    Ready:          True
    Restart Count:  0
    Readiness:      http-get http://:80/index.html delay=0s timeout=1s period=1s #success=1 #failure=1
    Environment:    <none>
    Mounts:
      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-b7sf9 (ro)
Conditions:
  Type              Status
  Initialized       True 
  Ready             True 
  ContainersReady   True 
  PodScheduled      True 
Volumes:
  kube-api-access-b7sf9:
    Type:                    Projected (a volume that contains injected data from multiple sources)
    TokenExpirationSeconds:  3607
    ConfigMapName:           kube-root-ca.crt
    ConfigMapOptional:       <nil>
    DownwardAPI:             true
QoS Class:                   BestEffort
Node-Selectors:              <none>
Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
                             node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
  Type     Reason                  Age                    From               Message
  ----     ------                  ----                   ----               -------
  Normal   Scheduled               9m33s                  default-scheduler  Successfully assigned statefulset-433/ss2-1 to i-0ce901feb1d51fd3c
  Warning  FailedCreatePodSandBox  9m33s                  kubelet            Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a41e2db2c51cbe0c9e1dfd634c3855999c8f4007c58b1f6596d0d6cc64804e71": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
  Warning  FailedCreatePodSandBox  9m18s                  kubelet            Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "4f723295b0b64de1feea1c44291aaf72ab97f28d599cf718bac91603e25384bf": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
  Warning  FailedCreatePodSandBox  9m4s                   kubelet            Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "1abb7765711307fee5cc996490844d81028a47b0ae2586fae171e2e44128a468": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
  Warning  FailedCreatePodSandBox  8m50s                  kubelet            Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "7a547dec463e6a4ae3d2d3bfe5c3b4ac75e23d46c51f59037c478e371384464b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
  Warning  FailedCreatePodSandBox  8m37s                  kubelet            Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "558809c1981a8fba88a57ae15aeb1665f9ecf649bb9a5cb3f76adfe496610720": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
  Warning  FailedCreatePodSandBox  8m23s                  kubelet            Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d984067004892d17f967347fc98e4d8e5b91a762a619acfcfbd787b26c411fcf": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
  Warning  FailedCreatePodSandBox  8m11s                  kubelet            Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "02f7b63f460ede378650f4c74c884fdeb345acad97ed5953b3ba60346d01d2f2": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
  Warning  FailedCreatePodSandBox  7m57s                  kubelet            Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "63acd81fabdb89c575bd1cecf10f4cf33bee70ea171571fb0ebbc2ab91aa239f": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
  Warning  FailedCreatePodSandBox  7m44s                  kubelet            Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "65bd0abcfe6a73e8277e50ce31d1547809ced4180ee27778d0b906dd082aeac3": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
  Warning  FailedCreatePodSandBox  4m7s (x17 over 7m33s)  kubelet            (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "79ed4ec6a68fef2cf16562a0e1ce14d2769a55f9c09c0e5bd311621440e9c4fd": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available

Jan 21 06:46:00.834: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/9fb2ac9e-9953-11ed-a697-56ea552f9d82/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=statefulset-433 logs ss2-1 --tail=100'
Jan 21 06:46:01.343: INFO: stderr: ""
Jan 21 06:46:01.343: INFO: stdout: "[Sat Jan 21 06:45:36.047835 2023] [mpm_event:notice] [pid 1:tid 139673372519272] AH00489: Apache/2.4.38 (Unix) configured -- resuming normal operations\n[Sat Jan 21 06:45:36.048022 2023] [core:notice] [pid 1:tid 139673372519272] AH00094: Command line: 'httpd -D FOREGROUND'\n172.20.55.1 - - [21/Jan/2023:06:45:36 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.55.1 - - [21/Jan/2023:06:45:36 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.55.1 - - [21/Jan/2023:06:45:37 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.55.1 - - [21/Jan/2023:06:45:38 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.55.1 - - [21/Jan/2023:06:45:39 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.55.1 - - [21/Jan/2023:06:45:40 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.55.1 - - [21/Jan/2023:06:45:41 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.55.1 - - [21/Jan/2023:06:45:42 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.55.1 - - [21/Jan/2023:06:45:43 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.55.1 - - [21/Jan/2023:06:45:44 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.55.1 - - [21/Jan/2023:06:45:45 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.55.1 - - [21/Jan/2023:06:45:46 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.55.1 - - [21/Jan/2023:06:45:47 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.55.1 - - [21/Jan/2023:06:45:48 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.55.1 - - [21/Jan/2023:06:45:49 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.55.1 - - [21/Jan/2023:06:45:50 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.55.1 - - [21/Jan/2023:06:45:51 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.55.1 - - [21/Jan/2023:06:45:52 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.55.1 - - [21/Jan/2023:06:45:53 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.55.1 - - [21/Jan/2023:06:45:54 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.55.1 - - [21/Jan/2023:06:45:55 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.55.1 - - [21/Jan/2023:06:45:56 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.55.1 - - [21/Jan/2023:06:45:57 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.55.1 - - [21/Jan/2023:06:45:58 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.55.1 - - [21/Jan/2023:06:45:59 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.55.1 - - [21/Jan/2023:06:46:00 +0000] \"GET /index.html HTTP/1.1\" 200 45\n"
Jan 21 06:46:01.343: INFO: 
Last 100 log lines of ss2-1:
[Sat Jan 21 06:45:36.047835 2023] [mpm_event:notice] [pid 1:tid 139673372519272] AH00489: Apache/2.4.38 (Unix) configured -- resuming normal operations
[Sat Jan 21 06:45:36.048022 2023] [core:notice] [pid 1:tid 139673372519272] AH00094: Command line: 'httpd -D FOREGROUND'
172.20.55.1 - - [21/Jan/2023:06:45:36 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.55.1 - - [21/Jan/2023:06:45:36 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.55.1 - - [21/Jan/2023:06:45:37 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.55.1 - - [21/Jan/2023:06:45:38 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.55.1 - - [21/Jan/2023:06:45:39 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.55.1 - - [21/Jan/2023:06:45:40 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.55.1 - - [21/Jan/2023:06:45:41 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.55.1 - - [21/Jan/2023:06:45:42 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.55.1 - - [21/Jan/2023:06:45:43 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.55.1 - - [21/Jan/2023:06:45:44 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.55.1 - - [21/Jan/2023:06:45:45 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.55.1 - - [21/Jan/2023:06:45:46 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.55.1 - - [21/Jan/2023:06:45:47 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.55.1 - - [21/Jan/2023:06:45:48 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.55.1 - - [21/Jan/2023:06:45:49 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.55.1 - - [21/Jan/2023:06:45:50 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.55.1 - - [21/Jan/2023:06:45:51 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.55.1 - - [21/Jan/2023:06:45:52 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.55.1 - - [21/Jan/2023:06:45:53 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.55.1 - - [21/Jan/2023:06:45:54 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.55.1 - - [21/Jan/2023:06:45:55 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.55.1 - - [21/Jan/2023:06:45:56 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.55.1 - - [21/Jan/2023:06:45:57 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.55.1 - - [21/Jan/2023:06:45:58 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.55.1 - - [21/Jan/2023:06:45:59 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.55.1 - - [21/Jan/2023:06:46:00 +0000] "GET /index.html HTTP/1.1" 200 45

Jan 21 06:46:01.343: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/9fb2ac9e-9953-11ed-a697-56ea552f9d82/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=statefulset-433 describe po ss2-2'
Jan 21 06:46:01.982: INFO: stderr: ""
Jan 21 06:46:01.982: INFO: stdout: "Name:             ss2-2\nNamespace:        statefulset-433\nPriority:         0\nService Account:  default\nNode:             i-034aa8120dbcec79b/172.20.44.197\nStart Time:       Sat, 21 Jan 2023 06:45:38 +0000\nLabels:           baz=blah\n                  controller-revision-hash=ss2-7b6c9599d5\n                  foo=bar\n                  statefulset.kubernetes.io/pod-name=ss2-2\nAnnotations:      <none>\nStatus:           Pending\nIP:               \nIPs:              <none>\nControlled By:    StatefulSet/ss2\nContainers:\n  webserver:\n    Container ID:   \n    Image:          registry.k8s.io/e2e-test-images/httpd:2.4.38-4\n    Image ID:       \n    Port:           <none>\n    Host Port:      <none>\n    State:          Waiting\n      Reason:       ContainerCreating\n    Ready:          False\n    Restart Count:  0\n    Readiness:      http-get http://:80/index.html delay=0s timeout=1s period=1s #success=1 #failure=1\n    Environment:    <none>\n    Mounts:\n      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-v7mp2 (ro)\nConditions:\n  Type              Status\n  Initialized       True \n  Ready             False \n  ContainersReady   False \n  PodScheduled      True \nVolumes:\n  kube-api-access-v7mp2:\n    Type:                    Projected (a volume that contains injected data from multiple sources)\n    TokenExpirationSeconds:  3607\n    ConfigMapName:           kube-root-ca.crt\n    ConfigMapOptional:       <nil>\n    DownwardAPI:             true\nQoS Class:                   BestEffort\nNode-Selectors:              <none>\nTolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s\n                             node.kubernetes.io/unreachable:NoExecute op=Exists for 300s\nEvents:\n  Type     Reason                  Age   From               Message\n  ----     ------                  ----  ----               -------\n  Normal   Scheduled               23s   default-scheduler  Successfully assigned statefulset-433/ss2-2 to i-034aa8120dbcec79b\n  Warning  FailedCreatePodSandBox  23s   kubelet            Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"bb7f10324dafbd3c8199ba0c44e1b2cbb17435573ef02b11d496a6b240ae0b96\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available\n  Warning  FailedCreatePodSandBox  7s    kubelet            Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"9d2792e08261f9312633106869e3a0e74387caeeb8ec01a1588dbeb3dcc5d4d0\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available\n"
Jan 21 06:46:01.982: INFO: 
Output of kubectl describe ss2-2:
Name:             ss2-2
Namespace:        statefulset-433
Priority:         0
Service Account:  default
Node:             i-034aa8120dbcec79b/172.20.44.197
Start Time:       Sat, 21 Jan 2023 06:45:38 +0000
Labels:           baz=blah
                  controller-revision-hash=ss2-7b6c9599d5
                  foo=bar
                  statefulset.kubernetes.io/pod-name=ss2-2
Annotations:      <none>
Status:           Pending
IP:               
IPs:              <none>
Controlled By:    StatefulSet/ss2
Containers:
  webserver:
    Container ID:   
    Image:          registry.k8s.io/e2e-test-images/httpd:2.4.38-4
    Image ID:       
    Port:           <none>
    Host Port:      <none>
    State:          Waiting
      Reason:       ContainerCreating
    Ready:          False
    Restart Count:  0
    Readiness:      http-get http://:80/index.html delay=0s timeout=1s period=1s #success=1 #failure=1
    Environment:    <none>
    Mounts:
      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-v7mp2 (ro)
Conditions:
  Type              Status
  Initialized       True 
  Ready             False 
  ContainersReady   False 
  PodScheduled      True 
Volumes:
  kube-api-access-v7mp2:
    Type:                    Projected (a volume that contains injected data from multiple sources)
    TokenExpirationSeconds:  3607
    ConfigMapName:           kube-root-ca.crt
    ConfigMapOptional:       <nil>
    DownwardAPI:             true
QoS Class:                   BestEffort
Node-Selectors:              <none>
Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
                             node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
  Type     Reason                  Age   From               Message
  ----     ------                  ----  ----               -------
  Normal   Scheduled               23s   default-scheduler  Successfully assigned statefulset-433/ss2-2 to i-034aa8120dbcec79b
  Warning  FailedCreatePodSandBox  23s   kubelet            Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "bb7f10324dafbd3c8199ba0c44e1b2cbb17435573ef02b11d496a6b240ae0b96": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
  Warning  FailedCreatePodSandBox  7s    kubelet            Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "9d2792e08261f9312633106869e3a0e74387caeeb8ec01a1588dbeb3dcc5d4d0": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available

Jan 21 06:46:01.982: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/9fb2ac9e-9953-11ed-a697-56ea552f9d82/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=statefulset-433 logs ss2-2 --tail=100'
Jan 21 06:46:02.509: INFO: rc: 1
Jan 21 06:46:02.509: INFO: 
Last 100 log lines of ss2-2:

Jan 21 06:46:02.509: INFO: Deleting all statefulset in ns statefulset-433
Jan 21 06:46:02.614: INFO: Scaling statefulset ss2 to 0
Jan 21 06:46:23.045: INFO: Waiting for statefulset status.replicas updated to 0
Jan 21 06:46:23.151: INFO: Deleting statefulset ss2
[AfterEach] [sig-apps] StatefulSet
  test/e2e/framework/node/init/init.go:32
Jan 21 06:46:23.484: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-apps] StatefulSet
  test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-apps] StatefulSet
  dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/21/23 06:46:23.593�[0m
�[1mSTEP:�[0m Collecting events from namespace "statefulset-433". �[38;5;243m01/21/23 06:46:23.593�[0m
�[1mSTEP:�[0m Found 27 events. �[38;5;243m01/21/23 06:46:23.701�[0m
Jan 21 06:46:23.701: INFO: At 2023-01-21 06:35:58 +0000 UTC - event for ss2: {statefulset-controller } SuccessfulCreate: create Pod ss2-0 in StatefulSet ss2 successful
Jan 21 06:46:23.702: INFO: At 2023-01-21 06:35:58 +0000 UTC - event for ss2-0: {default-scheduler } Scheduled: Successfully assigned statefulset-433/ss2-0 to i-0483840d8e13a9e6f
Jan 21 06:46:23.702: INFO: At 2023-01-21 06:35:58 +0000 UTC - event for ss2-0: {kubelet i-0483840d8e13a9e6f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "f4f07b48ec754a08977484dce63b92a54ce24dc4429814ead699a4a128a0c8f0": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:46:23.702: INFO: At 2023-01-21 06:36:12 +0000 UTC - event for ss2-0: {kubelet i-0483840d8e13a9e6f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "2243252badbebf303909edf936444242554c66cb6a043f6bca8c1172303eea4e": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:46:23.702: INFO: At 2023-01-21 06:36:27 +0000 UTC - event for ss2: {statefulset-controller } SuccessfulCreate: create Pod ss2-1 in StatefulSet ss2 successful
Jan 21 06:46:23.702: INFO: At 2023-01-21 06:36:27 +0000 UTC - event for ss2-0: {kubelet i-0483840d8e13a9e6f} Pulled: Container image "registry.k8s.io/e2e-test-images/httpd:2.4.38-4" already present on machine
Jan 21 06:46:23.702: INFO: At 2023-01-21 06:36:27 +0000 UTC - event for ss2-0: {kubelet i-0483840d8e13a9e6f} Created: Created container webserver
Jan 21 06:46:23.702: INFO: At 2023-01-21 06:36:27 +0000 UTC - event for ss2-0: {kubelet i-0483840d8e13a9e6f} Started: Started container webserver
Jan 21 06:46:23.702: INFO: At 2023-01-21 06:36:27 +0000 UTC - event for ss2-1: {default-scheduler } Scheduled: Successfully assigned statefulset-433/ss2-1 to i-0ce901feb1d51fd3c
Jan 21 06:46:23.702: INFO: At 2023-01-21 06:36:27 +0000 UTC - event for ss2-1: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a41e2db2c51cbe0c9e1dfd634c3855999c8f4007c58b1f6596d0d6cc64804e71": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:46:23.702: INFO: At 2023-01-21 06:36:42 +0000 UTC - event for ss2-1: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "4f723295b0b64de1feea1c44291aaf72ab97f28d599cf718bac91603e25384bf": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:46:23.702: INFO: At 2023-01-21 06:36:56 +0000 UTC - event for ss2-1: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "1abb7765711307fee5cc996490844d81028a47b0ae2586fae171e2e44128a468": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:46:23.702: INFO: At 2023-01-21 06:37:10 +0000 UTC - event for ss2-1: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "7a547dec463e6a4ae3d2d3bfe5c3b4ac75e23d46c51f59037c478e371384464b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:46:23.702: INFO: At 2023-01-21 06:37:23 +0000 UTC - event for ss2-1: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "558809c1981a8fba88a57ae15aeb1665f9ecf649bb9a5cb3f76adfe496610720": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:46:23.702: INFO: At 2023-01-21 06:37:37 +0000 UTC - event for ss2-1: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d984067004892d17f967347fc98e4d8e5b91a762a619acfcfbd787b26c411fcf": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:46:23.702: INFO: At 2023-01-21 06:37:49 +0000 UTC - event for ss2-1: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "02f7b63f460ede378650f4c74c884fdeb345acad97ed5953b3ba60346d01d2f2": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:46:23.702: INFO: At 2023-01-21 06:38:03 +0000 UTC - event for ss2-1: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "63acd81fabdb89c575bd1cecf10f4cf33bee70ea171571fb0ebbc2ab91aa239f": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:46:23.702: INFO: At 2023-01-21 06:38:16 +0000 UTC - event for ss2-1: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "65bd0abcfe6a73e8277e50ce31d1547809ced4180ee27778d0b906dd082aeac3": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:46:23.702: INFO: At 2023-01-21 06:38:27 +0000 UTC - event for ss2-1: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "79ed4ec6a68fef2cf16562a0e1ce14d2769a55f9c09c0e5bd311621440e9c4fd": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:46:23.702: INFO: At 2023-01-21 06:45:38 +0000 UTC - event for ss2: {statefulset-controller } SuccessfulCreate: create Pod ss2-2 in StatefulSet ss2 successful
Jan 21 06:46:23.702: INFO: At 2023-01-21 06:45:38 +0000 UTC - event for ss2-2: {default-scheduler } Scheduled: Successfully assigned statefulset-433/ss2-2 to i-034aa8120dbcec79b
Jan 21 06:46:23.702: INFO: At 2023-01-21 06:45:38 +0000 UTC - event for ss2-2: {kubelet i-034aa8120dbcec79b} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "bb7f10324dafbd3c8199ba0c44e1b2cbb17435573ef02b11d496a6b240ae0b96": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:46:23.702: INFO: At 2023-01-21 06:45:54 +0000 UTC - event for ss2-2: {kubelet i-034aa8120dbcec79b} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "9d2792e08261f9312633106869e3a0e74387caeeb8ec01a1588dbeb3dcc5d4d0": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:46:23.702: INFO: At 2023-01-21 06:46:02 +0000 UTC - event for ss2: {statefulset-controller } SuccessfulDelete: delete Pod ss2-2 in StatefulSet ss2 successful
Jan 21 06:46:23.702: INFO: At 2023-01-21 06:46:07 +0000 UTC - event for ss2: {statefulset-controller } SuccessfulDelete: delete Pod ss2-1 in StatefulSet ss2 successful
Jan 21 06:46:23.702: INFO: At 2023-01-21 06:46:13 +0000 UTC - event for ss2: {statefulset-controller } SuccessfulDelete: delete Pod ss2-0 in StatefulSet ss2 successful
Jan 21 06:46:23.702: INFO: At 2023-01-21 06:46:13 +0000 UTC - event for ss2-0: {kubelet i-0483840d8e13a9e6f} Killing: Stopping container webserver
Jan 21 06:46:23.807: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Jan 21 06:46:23.807: INFO: 
Jan 21 06:46:23.913: INFO: 
Logging node info for node i-034aa8120dbcec79b
Jan 21 06:46:24.018: INFO: Node Info: &Node{ObjectMeta:{i-034aa8120dbcec79b    c2b3eda9-6144-4855-b163-8deafef2a413 19148 0 2023-01-21 06:26:22 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kubernetes.io/arch:amd64 kubernetes.io/hostname:i-034aa8120dbcec79b kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-1a topology.hostpath.csi/node:i-034aa8120dbcec79b topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.44.197 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-034aa8120dbcec79b"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-21 06:26:22 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 06:26:22 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 06:26:22 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-21 06:26:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-21 06:26:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-21 06:43:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-034aa8120dbcec79b,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 06:43:43 +0000 UTC,LastTransitionTime:2023-01-21 06:26:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 06:43:43 +0000 UTC,LastTransitionTime:2023-01-21 06:26:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 06:43:43 +0000 UTC,LastTransitionTime:2023-01-21 06:26:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 06:43:43 +0000 UTC,LastTransitionTime:2023-01-21 06:26:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.44.197,},NodeAddress{Type:ExternalIP,Address:3.250.148.238,},NodeAddress{Type:InternalDNS,Address:i-034aa8120dbcec79b.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-034aa8120dbcec79b.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-250-148-238.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec24052f5b49538b50ca690553c9978a,SystemUUID:ec24052f-5b49-538b-50ca-690553c9978a,BootID:e582450b-04c2-4204-a2a8-58ecc23f099e,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 06:46:24.019: INFO: 
Logging kubelet events for node i-034aa8120dbcec79b
Jan 21 06:46:24.129: INFO: 
Logging pods the kubelet thinks is on node i-034aa8120dbcec79b
Jan 21 06:46:24.249: INFO: cilium-rbcn6 started at 2023-01-21 06:26:22 +0000 UTC (1+1 container statuses recorded)
Jan 21 06:46:24.249: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 21 06:46:24.249: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 21 06:46:24.249: INFO: pod-disruption-failure-ignore-2-2rtdb started at 2023-01-21 06:46:05 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:24.249: INFO: 	Container c ready: false, restart count 0
Jan 21 06:46:24.249: INFO: metadata-volume-af609390-18e6-4550-b773-52aed8e0d05b started at 2023-01-21 06:46:22 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:24.249: INFO: 	Container client-container ready: false, restart count 0
Jan 21 06:46:24.249: INFO: ebs-csi-node-4mfqt started at 2023-01-21 06:26:22 +0000 UTC (0+3 container statuses recorded)
Jan 21 06:46:24.249: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 21 06:46:24.249: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 21 06:46:24.249: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 21 06:46:24.249: INFO: pod-disruption-failure-ignore-0-lktw9 started at 2023-01-21 06:34:51 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:24.249: INFO: 	Container c ready: true, restart count 0
Jan 21 06:46:24.249: INFO: coredns-autoscaler-7cb5c5b969-slvzq started at 2023-01-21 06:26:33 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:24.249: INFO: 	Container autoscaler ready: true, restart count 0
Jan 21 06:46:24.249: INFO: execpodqdvl2 started at 2023-01-21 06:46:13 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:24.249: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 21 06:46:24.249: INFO: pod1 started at 2023-01-21 06:46:21 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:24.249: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 21 06:46:24.249: INFO: pod-disruption-failure-ignore-1-lmh2f started at 2023-01-21 06:34:51 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:24.249: INFO: 	Container c ready: false, restart count 0
Jan 21 06:46:24.249: INFO: alpine-nnp-true-1393db65-dee7-4809-a2fc-c5ffa2ab4421 started at 2023-01-21 06:46:20 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:24.249: INFO: 	Container alpine-nnp-true-1393db65-dee7-4809-a2fc-c5ffa2ab4421 ready: false, restart count 0
Jan 21 06:46:24.249: INFO: pod-disruption-failure-ignore-3-cdjkq started at 2023-01-21 06:46:10 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:24.249: INFO: 	Container c ready: false, restart count 0
Jan 21 06:46:24.249: INFO: coredns-559769c974-f8ncw started at 2023-01-21 06:26:33 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:24.249: INFO: 	Container coredns ready: true, restart count 0
Jan 21 06:46:24.249: INFO: pod-disruption-failure-ignore-0-gw6md started at 2023-01-21 06:46:19 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:24.249: INFO: 	Container c ready: false, restart count 0
Jan 21 06:46:24.249: INFO: netserver-0 started at 2023-01-21 06:42:05 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:24.249: INFO: 	Container webserver ready: false, restart count 0
Jan 21 06:46:24.634: INFO: 
Latency metrics for node i-034aa8120dbcec79b
Jan 21 06:46:24.634: INFO: 
Logging node info for node i-0483840d8e13a9e6f
Jan 21 06:46:24.740: INFO: Node Info: &Node{ObjectMeta:{i-0483840d8e13a9e6f    6e63ffcd-a34b-47ab-888c-fb980b98335e 19974 0 2023-01-21 06:26:26 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0483840d8e13a9e6f kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-1a topology.hostpath.csi/node:i-0483840d8e13a9e6f topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.35.162 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-2039":"i-0483840d8e13a9e6f","ebs.csi.aws.com":"i-0483840d8e13a9e6f"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-21 06:26:26 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 06:26:26 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 06:26:26 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-21 06:26:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-21 06:26:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-21 06:46:12 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-21 06:46:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-0483840d8e13a9e6f,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 06:46:19 +0000 UTC,LastTransitionTime:2023-01-21 06:26:26 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 06:46:19 +0000 UTC,LastTransitionTime:2023-01-21 06:26:26 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 06:46:19 +0000 UTC,LastTransitionTime:2023-01-21 06:26:26 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 06:46:19 +0000 UTC,LastTransitionTime:2023-01-21 06:26:38 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.35.162,},NodeAddress{Type:ExternalIP,Address:54.220.210.148,},NodeAddress{Type:InternalDNS,Address:i-0483840d8e13a9e6f.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0483840d8e13a9e6f.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-220-210-148.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2945f38534f04be1d719a5a69e0c27,SystemUUID:ec2945f3-8534-f04b-e1d7-19a5a69e0c27,BootID:dc551b58-3eaf-4442-8a18-f820d5bb2e66,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-2039^4a991560-9957-11ed-bc95-26cc86e27cba kubernetes.io/csi/ebs.csi.aws.com^vol-075484b5e61c2a96e kubernetes.io/csi/ebs.csi.aws.com^vol-07cd4ff2e01c90cd0],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-075484b5e61c2a96e,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-07cd4ff2e01c90cd0,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-2039^4a991560-9957-11ed-bc95-26cc86e27cba,DevicePath:,},},Config:nil,},}
Jan 21 06:46:24.740: INFO: 
Logging kubelet events for node i-0483840d8e13a9e6f
Jan 21 06:46:24.848: INFO: 
Logging pods the kubelet thinks is on node i-0483840d8e13a9e6f
Jan 21 06:46:24.961: INFO: ebs-csi-node-4fv8j started at 2023-01-21 06:26:27 +0000 UTC (0+3 container statuses recorded)
Jan 21 06:46:24.961: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 21 06:46:24.961: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 21 06:46:24.961: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 21 06:46:24.961: INFO: ss-0 started at 2023-01-21 06:45:54 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:24.961: INFO: 	Container webserver ready: true, restart count 0
Jan 21 06:46:24.961: INFO: suspend-false-to-true-cxr2f started at 2023-01-21 06:35:20 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:24.961: INFO: 	Container c ready: false, restart count 0
Jan 21 06:46:24.961: INFO: dns-test-3cd32f06-3364-4fc1-a11e-dd22cf199550 started at 2023-01-21 06:45:20 +0000 UTC (0+3 container statuses recorded)
Jan 21 06:46:24.961: INFO: 	Container jessie-querier ready: true, restart count 0
Jan 21 06:46:24.961: INFO: 	Container querier ready: true, restart count 0
Jan 21 06:46:24.961: INFO: 	Container webserver ready: true, restart count 0
Jan 21 06:46:24.961: INFO: externalsvc-hgg2f started at 2023-01-21 06:42:57 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:24.961: INFO: 	Container externalsvc ready: true, restart count 0
Jan 21 06:46:24.961: INFO: pfpod started at 2023-01-21 06:45:05 +0000 UTC (0+2 container statuses recorded)
Jan 21 06:46:24.961: INFO: 	Container portforwardtester ready: false, restart count 0
Jan 21 06:46:24.961: INFO: 	Container readiness ready: false, restart count 0
Jan 21 06:46:24.961: INFO: cilium-gjcpw started at 2023-01-21 06:26:27 +0000 UTC (1+1 container statuses recorded)
Jan 21 06:46:24.961: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 21 06:46:24.961: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 21 06:46:24.961: INFO: netserver-1 started at 2023-01-21 06:42:05 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:24.961: INFO: 	Container webserver ready: false, restart count 0
Jan 21 06:46:24.961: INFO: inline-volume-tester-qtrcn started at 2023-01-21 06:46:11 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:24.961: INFO: 	Container csi-volume-tester ready: false, restart count 0
Jan 21 06:46:24.961: INFO: csi-hostpathplugin-0 started at 2023-01-21 06:35:03 +0000 UTC (0+7 container statuses recorded)
Jan 21 06:46:24.961: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 21 06:46:24.961: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 21 06:46:24.961: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 21 06:46:24.961: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 21 06:46:24.961: INFO: 	Container hostpath ready: true, restart count 0
Jan 21 06:46:24.961: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 21 06:46:24.961: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 21 06:46:24.961: INFO: pod-update-1731a417-e5ea-48ed-9b52-307dd7ddf57f started at 2023-01-21 06:42:17 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:24.961: INFO: 	Container pause ready: true, restart count 0
Jan 21 06:46:24.961: INFO: suspend-false-to-true-l6rxb started at 2023-01-21 06:35:20 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:24.961: INFO: 	Container c ready: true, restart count 0
Jan 21 06:46:24.961: INFO: inline-volume-tester-7hmk6 started at 2023-01-21 06:40:55 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:24.961: INFO: 	Container csi-volume-tester ready: true, restart count 0
Jan 21 06:46:24.961: INFO: hostexec-i-0483840d8e13a9e6f-7rr6c started at 2023-01-21 06:46:14 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:24.961: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 21 06:46:24.961: INFO: pod-1e492938-12f5-4c29-8544-043cf498580e started at <nil> (0+0 container statuses recorded)
Jan 21 06:46:25.508: INFO: 
Latency metrics for node i-0483840d8e13a9e6f
Jan 21 06:46:25.508: INFO: 
Logging node info for node i-0ce901feb1d51fd3c
Jan 21 06:46:25.614: INFO: Node Info: &Node{ObjectMeta:{i-0ce901feb1d51fd3c    7d82d388-0267-44ad-a74d-b2eb46841c68 20196 0 2023-01-21 06:26:22 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0ce901feb1d51fd3c kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-1a topology.hostpath.csi/node:i-0ce901feb1d51fd3c topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.55.1 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-4569":"i-0ce901feb1d51fd3c","csi-mock-csi-mock-volumes-7832":"i-0ce901feb1d51fd3c","ebs.csi.aws.com":"i-0ce901feb1d51fd3c"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-21 06:26:22 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 06:26:22 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 06:26:22 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-21 06:26:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-21 06:26:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-01-21 06:46:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-01-21 06:46:24 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-0ce901feb1d51fd3c,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 06:45:45 +0000 UTC,LastTransitionTime:2023-01-21 06:26:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 06:45:45 +0000 UTC,LastTransitionTime:2023-01-21 06:26:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 06:45:45 +0000 UTC,LastTransitionTime:2023-01-21 06:26:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 06:45:45 +0000 UTC,LastTransitionTime:2023-01-21 06:26:34 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.55.1,},NodeAddress{Type:ExternalIP,Address:54.74.114.32,},NodeAddress{Type:InternalDNS,Address:i-0ce901feb1d51fd3c.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0ce901feb1d51fd3c.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-74-114-32.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec284d9c2eebc996a6b6d4cf4e0f52b7,SystemUUID:ec284d9c-2eeb-c996-a6b6-d4cf4e0f52b7,BootID:e32d5483-bf35-4be2-9254-c24e37c024a3,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0b135fa1ce8020ce6],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0b135fa1ce8020ce6,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-4569^51be247d-9957-11ed-8268-fe169258750a,DevicePath:,},},Config:nil,},}
Jan 21 06:46:25.614: INFO: 
Logging kubelet events for node i-0ce901feb1d51fd3c
Jan 21 06:46:25.723: INFO: 
Logging pods the kubelet thinks is on node i-0ce901feb1d51fd3c
Jan 21 06:46:25.848: INFO: verify-service-up-host-exec-pod started at 2023-01-21 06:45:27 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:25.848: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 21 06:46:25.848: INFO: service-deletion-zzk4s started at 2023-01-21 06:40:23 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:25.848: INFO: 	Container service-deletion ready: true, restart count 0
Jan 21 06:46:25.848: INFO: csi-mockplugin-0 started at 2023-01-21 06:45:18 +0000 UTC (0+3 container statuses recorded)
Jan 21 06:46:25.848: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 21 06:46:25.848: INFO: 	Container driver-registrar ready: true, restart count 0
Jan 21 06:46:25.848: INFO: 	Container mock ready: true, restart count 0
Jan 21 06:46:25.848: INFO: csi-hostpathplugin-0 started at 2023-01-21 06:46:20 +0000 UTC (0+7 container statuses recorded)
Jan 21 06:46:25.848: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 21 06:46:25.848: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 21 06:46:25.848: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 21 06:46:25.848: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 21 06:46:25.848: INFO: 	Container hostpath ready: true, restart count 0
Jan 21 06:46:25.848: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 21 06:46:25.848: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 21 06:46:25.848: INFO: e2e-test-httpd-pod started at 2023-01-21 06:45:55 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:25.848: INFO: 	Container e2e-test-httpd-pod ready: true, restart count 0
Jan 21 06:46:25.848: INFO: pod-e5eacbe0-30d8-4006-9c57-2072fd145c59 started at 2023-01-21 06:46:07 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:25.848: INFO: 	Container write-pod ready: true, restart count 0
Jan 21 06:46:25.848: INFO: cilium-qs82l started at 2023-01-21 06:26:23 +0000 UTC (1+1 container statuses recorded)
Jan 21 06:46:25.848: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 21 06:46:25.848: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 21 06:46:25.848: INFO: externalsvc-cjcvt started at 2023-01-21 06:42:57 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:25.848: INFO: 	Container externalsvc ready: true, restart count 0
Jan 21 06:46:25.848: INFO: inline-volume-tester-wjjpl started at 2023-01-21 06:46:23 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:25.848: INFO: 	Container csi-volume-tester ready: false, restart count 0
Jan 21 06:46:25.848: INFO: pod-f184b504-58cc-454d-aa21-3a2254168139 started at 2023-01-21 06:45:25 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:25.848: INFO: 	Container write-pod ready: true, restart count 0
Jan 21 06:46:25.848: INFO: pod-subpath-test-inlinevolume-gqdb started at 2023-01-21 06:46:17 +0000 UTC (0+2 container statuses recorded)
Jan 21 06:46:25.848: INFO: 	Container test-container-subpath-inlinevolume-gqdb ready: false, restart count 0
Jan 21 06:46:25.848: INFO: 	Container test-container-volume-inlinevolume-gqdb ready: true, restart count 0
Jan 21 06:46:25.848: INFO: verify-service-up-exec-pod-ptmds started at 2023-01-21 06:45:31 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:25.848: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 21 06:46:25.848: INFO: csi-mockplugin-attacher-0 started at 2023-01-21 06:45:18 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:25.848: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 21 06:46:25.848: INFO: netserver-2 started at 2023-01-21 06:42:05 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:25.848: INFO: 	Container webserver ready: true, restart count 0
Jan 21 06:46:25.848: INFO: ebs-csi-node-qp79b started at 2023-01-21 06:26:23 +0000 UTC (0+3 container statuses recorded)
Jan 21 06:46:25.848: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 21 06:46:25.848: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 21 06:46:25.848: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 21 06:46:25.848: INFO: hostexec-i-0ce901feb1d51fd3c-s8r9z started at 2023-01-21 06:45:59 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:25.848: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 21 06:46:26.298: INFO: 
Latency metrics for node i-0ce901feb1d51fd3c
Jan 21 06:46:26.298: INFO: 
Logging node info for node i-0d2f2d71d5d6f8b5a
Jan 21 06:46:26.404: INFO: Node Info: &Node{ObjectMeta:{i-0d2f2d71d5d6f8b5a    d2f1894b-950d-45a2-a42f-7d9213bb75b8 17658 0 2023-01-21 06:24:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0d2f2d71d5d6f8b5a kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:eu-west-1a topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.42.168 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0d2f2d71d5d6f8b5a"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-21 06:24:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-21 06:25:04 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-01-21 06:25:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-21 06:25:18 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 06:25:18 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-21 06:41:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-0d2f2d71d5d6f8b5a,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892310016 0} {<nil>} 3801084Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787452416 0} {<nil>} 3698684Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 06:41:55 +0000 UTC,LastTransitionTime:2023-01-21 06:24:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 06:41:55 +0000 UTC,LastTransitionTime:2023-01-21 06:24:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 06:41:55 +0000 UTC,LastTransitionTime:2023-01-21 06:24:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 06:41:55 +0000 UTC,LastTransitionTime:2023-01-21 06:25:16 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.168,},NodeAddress{Type:ExternalIP,Address:3.249.87.249,},NodeAddress{Type:InternalDNS,Address:i-0d2f2d71d5d6f8b5a.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0d2f2d71d5d6f8b5a.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-249-87-249.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2326005f1a498ecb0bcf8cde478bd4,SystemUUID:ec232600-5f1a-498e-cb0b-cf8cde478bd4,BootID:45d9d2b8-2840-49c2-9bdc-aa7244b00f22,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.1],SizeBytes:135178704,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.1],SizeBytes:124995897,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.1],SizeBytes:57661752,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43643671,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42841306,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4965794,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 06:46:26.404: INFO: 
Logging kubelet events for node i-0d2f2d71d5d6f8b5a
Jan 21 06:46:26.516: INFO: 
Logging pods the kubelet thinks is on node i-0d2f2d71d5d6f8b5a
Jan 21 06:46:26.627: INFO: cilium-operator-5dd44dc49f-fld4m started at 2023-01-21 06:25:08 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:26.627: INFO: 	Container cilium-operator ready: true, restart count 0
Jan 21 06:46:26.627: INFO: ebs-csi-controller-5bd98b456f-b9lnh started at 2023-01-21 06:25:08 +0000 UTC (0+5 container statuses recorded)
Jan 21 06:46:26.627: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 21 06:46:26.627: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 21 06:46:26.627: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 21 06:46:26.627: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 21 06:46:26.627: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 21 06:46:26.627: INFO: etcd-manager-main-i-0d2f2d71d5d6f8b5a started at 2023-01-21 06:24:04 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:26.627: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 21 06:46:26.627: INFO: kube-controller-manager-i-0d2f2d71d5d6f8b5a started at 2023-01-21 06:24:04 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:26.627: INFO: 	Container kube-controller-manager ready: true, restart count 2
Jan 21 06:46:26.627: INFO: kube-scheduler-i-0d2f2d71d5d6f8b5a started at 2023-01-21 06:24:04 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:26.627: INFO: 	Container kube-scheduler ready: true, restart count 0
Jan 21 06:46:26.627: INFO: aws-cloud-controller-manager-cqjd9 started at 2023-01-21 06:25:08 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:26.627: INFO: 	Container aws-cloud-controller-manager ready: true, restart count 0
Jan 21 06:46:26.627: INFO: ebs-csi-node-tb6br started at 2023-01-21 06:25:08 +0000 UTC (0+3 container statuses recorded)
Jan 21 06:46:26.627: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 21 06:46:26.627: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 21 06:46:26.627: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 21 06:46:26.627: INFO: etcd-manager-events-i-0d2f2d71d5d6f8b5a started at 2023-01-21 06:24:03 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:26.627: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 21 06:46:26.627: INFO: kube-apiserver-i-0d2f2d71d5d6f8b5a started at 2023-01-21 06:24:04 +0000 UTC (0+2 container statuses recorded)
Jan 21 06:46:26.627: INFO: 	Container healthcheck ready: true, restart count 0
Jan 21 06:46:26.627: INFO: 	Container kube-apiserver ready: true, restart count 1
Jan 21 06:46:26.627: INFO: kops-controller-hffbm started at 2023-01-21 06:25:08 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:26.627: INFO: 	Container kops-controller ready: true, restart count 0
Jan 21 06:46:26.627: INFO: cilium-6bgng started at 2023-01-21 06:25:08 +0000 UTC (1+1 container statuses recorded)
Jan 21 06:46:26.627: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 21 06:46:26.627: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 21 06:46:26.627: INFO: dns-controller-69987775c6-vgxml started at 2023-01-21 06:25:08 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:26.627: INFO: 	Container dns-controller ready: true, restart count 0
Jan 21 06:46:27.012: INFO: 
Latency metrics for node i-0d2f2d71d5d6f8b5a
Jan 21 06:46:27.012: INFO: 
Logging node info for node i-0f3b8117f4ecfc9ec
Jan 21 06:46:27.117: INFO: Node Info: &Node{ObjectMeta:{i-0f3b8117f4ecfc9ec    019b5e58-b8c2-4ac5-ba8d-47ba49f9fe9c 19841 0 2023-01-21 06:26:29 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0f3b8117f4ecfc9ec kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-1a topology.hostpath.csi/node:i-0f3b8117f4ecfc9ec topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.36.94 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-9303":"i-0f3b8117f4ecfc9ec","ebs.csi.aws.com":"i-0f3b8117f4ecfc9ec"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-21 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 06:26:29 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-21 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-21 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-01-21 06:46:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-0f3b8117f4ecfc9ec,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 06:46:03 +0000 UTC,LastTransitionTime:2023-01-21 06:26:29 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 06:46:03 +0000 UTC,LastTransitionTime:2023-01-21 06:26:29 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 06:46:03 +0000 UTC,LastTransitionTime:2023-01-21 06:26:29 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 06:46:03 +0000 UTC,LastTransitionTime:2023-01-21 06:26:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.36.94,},NodeAddress{Type:ExternalIP,Address:54.72.134.71,},NodeAddress{Type:InternalDNS,Address:i-0f3b8117f4ecfc9ec.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0f3b8117f4ecfc9ec.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-72-134-71.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2c9416b8fb84b0403f690a294bd09b,SystemUUID:ec2c9416-b8fb-84b0-403f-690a294bd09b,BootID:4e9f8b9b-5350-48ad-8083-40ed7929b713,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 06:46:27.117: INFO: 
Logging kubelet events for node i-0f3b8117f4ecfc9ec
Jan 21 06:46:27.228: INFO: 
Logging pods the kubelet thinks is on node i-0f3b8117f4ecfc9ec
Jan 21 06:46:27.339: INFO: coredns-559769c974-7fbns started at 2023-01-21 06:26:59 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:27.339: INFO: 	Container coredns ready: true, restart count 0
Jan 21 06:46:27.339: INFO: netserver-3 started at 2023-01-21 06:42:05 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:27.339: INFO: 	Container webserver ready: true, restart count 0
Jan 21 06:46:27.339: INFO: execpod44sjc started at 2023-01-21 06:46:22 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:27.339: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 21 06:46:27.339: INFO: csi-mockplugin-attacher-0 started at 2023-01-21 06:46:12 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:27.339: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 21 06:46:27.339: INFO: csi-mockplugin-0 started at 2023-01-21 06:46:25 +0000 UTC (0+3 container statuses recorded)
Jan 21 06:46:27.339: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 21 06:46:27.339: INFO: 	Container driver-registrar ready: true, restart count 0
Jan 21 06:46:27.339: INFO: 	Container mock ready: true, restart count 0
Jan 21 06:46:27.339: INFO: ebs-csi-node-5dm54 started at 2023-01-21 06:26:30 +0000 UTC (0+3 container statuses recorded)
Jan 21 06:46:27.339: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 21 06:46:27.339: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 21 06:46:27.339: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 21 06:46:27.339: INFO: cilium-2brsw started at 2023-01-21 06:26:30 +0000 UTC (1+1 container statuses recorded)
Jan 21 06:46:27.339: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 21 06:46:27.339: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 21 06:46:27.339: INFO: csi-mockplugin-attacher-0 started at 2023-01-21 06:46:25 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:27.339: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 21 06:46:27.339: INFO: csi-mockplugin-0 started at 2023-01-21 06:46:12 +0000 UTC (0+3 container statuses recorded)
Jan 21 06:46:27.339: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 21 06:46:27.339: INFO: 	Container driver-registrar ready: true, restart count 0
Jan 21 06:46:27.339: INFO: 	Container mock ready: true, restart count 0
Jan 21 06:46:27.748: INFO: 
Latency metrics for node i-0f3b8117f4ecfc9ec
[DeferCleanup (Each)] [sig-apps] StatefulSet
  tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "statefulset-433" for this suite. �[38;5;243m01/21/23 06:46:27.748�[0m

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl events should show event when pod is created 26s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-cli\]\sKubectl\sclient\sKubectl\sevents\sshould\sshow\sevent\swhen\spod\sis\screated$'

test/e2e/kubectl/kubectl.go:1969
k8s.io/kubernetes/test/e2e/kubectl.glob..func1.30.1()
	test/e2e/kubectl/kubectl.go:1969 +0x53d
				[BeforeEach] [sig-cli] Kubectl client
  set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/21/23 06:45:54.019�[0m
Jan 21 06:45:54.019: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename kubectl �[38;5;243m01/21/23 06:45:54.02�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/21/23 06:45:54.342�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/21/23 06:45:54.556�[0m
[BeforeEach] [sig-cli] Kubectl client
  test/e2e/framework/metrics/init/init.go:31
[BeforeEach] [sig-cli] Kubectl client
  test/e2e/kubectl/kubectl.go:274
[It] should show event when pod is created
  test/e2e/kubectl/kubectl.go:1945
�[1mSTEP:�[0m running the image registry.k8s.io/e2e-test-images/httpd:2.4.38-4 �[38;5;243m01/21/23 06:45:54.769�[0m
Jan 21 06:45:54.769: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/9fb2ac9e-9953-11ed-a697-56ea552f9d82/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-7259 run e2e-test-httpd-pod --image=registry.k8s.io/e2e-test-images/httpd:2.4.38-4 --pod-running-timeout=2m0s --labels=run=e2e-test-httpd-pod'
Jan 21 06:45:55.181: INFO: stderr: ""
Jan 21 06:45:55.181: INFO: stdout: "pod/e2e-test-httpd-pod created\n"
�[1mSTEP:�[0m verifying the pod e2e-test-httpd-pod is running �[38;5;243m01/21/23 06:45:55.181�[0m
�[1mSTEP:�[0m show started event for this pod �[38;5;243m01/21/23 06:46:15.332�[0m
Jan 21 06:46:15.333: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/9fb2ac9e-9953-11ed-a697-56ea552f9d82/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-7259 events --for=pod/e2e-test-httpd-pod'
Jan 21 06:46:15.748: INFO: stderr: ""
Jan 21 06:46:15.748: INFO: stdout: "LAST SEEN   TYPE      REASON                   OBJECT                   MESSAGE\n20s         Normal    Scheduled                Pod/e2e-test-httpd-pod   Successfully assigned kubectl-7259/e2e-test-httpd-pod to i-0ce901feb1d51fd3c\n20s         Warning   FailedCreatePodSandBox   Pod/e2e-test-httpd-pod   Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"0d5488affa1f69cbe906a9541ff725b24b6d75bb7ee235c9cd110c9b0e49d2af\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available\n7s          Normal    Pulled                   Pod/e2e-test-httpd-pod   Container image \"registry.k8s.io/e2e-test-images/httpd:2.4.38-4\" already present on machine\n7s          Normal    Created                  Pod/e2e-test-httpd-pod   Created container e2e-test-httpd-pod\n7s          Normal    Started                  Pod/e2e-test-httpd-pod   Started container e2e-test-httpd-pod\n"
�[1mSTEP:�[0m expect not showing any WARNING message except timeouts �[38;5;243m01/21/23 06:46:15.748�[0m
Jan 21 06:46:15.748: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/9fb2ac9e-9953-11ed-a697-56ea552f9d82/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-7259 events --types=WARNING --for=pod/e2e-test-httpd-pod'
Jan 21 06:46:16.150: INFO: stderr: ""
Jan 21 06:46:16.150: INFO: stdout: "LAST SEEN   TYPE      REASON                   OBJECT                   MESSAGE\n21s         Warning   FailedCreatePodSandBox   Pod/e2e-test-httpd-pod   Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"0d5488affa1f69cbe906a9541ff725b24b6d75bb7ee235c9cd110c9b0e49d2af\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available\n"
Jan 21 06:46:16.150: FAIL: unexpected WARNING event fired

Full Stack Trace
k8s.io/kubernetes/test/e2e/kubectl.glob..func1.30.1()
	test/e2e/kubectl/kubectl.go:1969 +0x53d
[AfterEach] [sig-cli] Kubectl client
  test/e2e/framework/node/init/init.go:32
Jan 21 06:46:16.150: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-cli] Kubectl client
  test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-cli] Kubectl client
  dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/21/23 06:46:16.258�[0m
�[1mSTEP:�[0m Collecting events from namespace "kubectl-7259". �[38;5;243m01/21/23 06:46:16.258�[0m
�[1mSTEP:�[0m Found 5 events. �[38;5;243m01/21/23 06:46:16.365�[0m
Jan 21 06:46:16.366: INFO: At 2023-01-21 06:45:55 +0000 UTC - event for e2e-test-httpd-pod: {default-scheduler } Scheduled: Successfully assigned kubectl-7259/e2e-test-httpd-pod to i-0ce901feb1d51fd3c
Jan 21 06:46:16.366: INFO: At 2023-01-21 06:45:55 +0000 UTC - event for e2e-test-httpd-pod: {kubelet i-0ce901feb1d51fd3c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "0d5488affa1f69cbe906a9541ff725b24b6d75bb7ee235c9cd110c9b0e49d2af": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:46:16.366: INFO: At 2023-01-21 06:46:08 +0000 UTC - event for e2e-test-httpd-pod: {kubelet i-0ce901feb1d51fd3c} Pulled: Container image "registry.k8s.io/e2e-test-images/httpd:2.4.38-4" already present on machine
Jan 21 06:46:16.366: INFO: At 2023-01-21 06:46:08 +0000 UTC - event for e2e-test-httpd-pod: {kubelet i-0ce901feb1d51fd3c} Created: Created container e2e-test-httpd-pod
Jan 21 06:46:16.366: INFO: At 2023-01-21 06:46:08 +0000 UTC - event for e2e-test-httpd-pod: {kubelet i-0ce901feb1d51fd3c} Started: Started container e2e-test-httpd-pod
Jan 21 06:46:16.475: INFO: POD                 NODE                 PHASE    GRACE  CONDITIONS
Jan 21 06:46:16.475: INFO: e2e-test-httpd-pod  i-0ce901feb1d51fd3c  Running         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:45:55 +0000 UTC  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:46:09 +0000 UTC  } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:46:09 +0000 UTC  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:45:55 +0000 UTC  }]
Jan 21 06:46:16.476: INFO: 
Jan 21 06:46:16.695: INFO: 
Logging node info for node i-034aa8120dbcec79b
Jan 21 06:46:16.802: INFO: Node Info: &Node{ObjectMeta:{i-034aa8120dbcec79b    c2b3eda9-6144-4855-b163-8deafef2a413 19148 0 2023-01-21 06:26:22 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kubernetes.io/arch:amd64 kubernetes.io/hostname:i-034aa8120dbcec79b kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-1a topology.hostpath.csi/node:i-034aa8120dbcec79b topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.44.197 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-034aa8120dbcec79b"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-21 06:26:22 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 06:26:22 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 06:26:22 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-21 06:26:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-21 06:26:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-21 06:43:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-034aa8120dbcec79b,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 06:43:43 +0000 UTC,LastTransitionTime:2023-01-21 06:26:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 06:43:43 +0000 UTC,LastTransitionTime:2023-01-21 06:26:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 06:43:43 +0000 UTC,LastTransitionTime:2023-01-21 06:26:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 06:43:43 +0000 UTC,LastTransitionTime:2023-01-21 06:26:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.44.197,},NodeAddress{Type:ExternalIP,Address:3.250.148.238,},NodeAddress{Type:InternalDNS,Address:i-034aa8120dbcec79b.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-034aa8120dbcec79b.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-250-148-238.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec24052f5b49538b50ca690553c9978a,SystemUUID:ec24052f-5b49-538b-50ca-690553c9978a,BootID:e582450b-04c2-4204-a2a8-58ecc23f099e,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 06:46:16.802: INFO: 
Logging kubelet events for node i-034aa8120dbcec79b
Jan 21 06:46:16.912: INFO: 
Logging pods the kubelet thinks is on node i-034aa8120dbcec79b
Jan 21 06:46:17.025: INFO: ebs-csi-node-4mfqt started at 2023-01-21 06:26:22 +0000 UTC (0+3 container statuses recorded)
Jan 21 06:46:17.025: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 21 06:46:17.025: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 21 06:46:17.025: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 21 06:46:17.025: INFO: coredns-autoscaler-7cb5c5b969-slvzq started at 2023-01-21 06:26:33 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:17.025: INFO: 	Container autoscaler ready: true, restart count 0
Jan 21 06:46:17.025: INFO: execpodqdvl2 started at 2023-01-21 06:46:13 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:17.025: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 21 06:46:17.025: INFO: pod-disruption-failure-ignore-0-lktw9 started at 2023-01-21 06:34:51 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:17.025: INFO: 	Container c ready: true, restart count 0
Jan 21 06:46:17.025: INFO: test-recreate-deployment-cff6dc657-kskdj started at 2023-01-21 06:46:13 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:17.025: INFO: 	Container httpd ready: true, restart count 0
Jan 21 06:46:17.025: INFO: pod-disruption-failure-ignore-1-lmh2f started at 2023-01-21 06:34:51 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:17.025: INFO: 	Container c ready: false, restart count 0
Jan 21 06:46:17.025: INFO: pod-disruption-failure-ignore-3-cdjkq started at 2023-01-21 06:46:10 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:17.025: INFO: 	Container c ready: false, restart count 0
Jan 21 06:46:17.025: INFO: coredns-559769c974-f8ncw started at 2023-01-21 06:26:33 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:17.025: INFO: 	Container coredns ready: true, restart count 0
Jan 21 06:46:17.025: INFO: netserver-0 started at 2023-01-21 06:42:05 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:17.025: INFO: 	Container webserver ready: false, restart count 0
Jan 21 06:46:17.025: INFO: cilium-rbcn6 started at 2023-01-21 06:26:22 +0000 UTC (1+1 container statuses recorded)
Jan 21 06:46:17.025: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 21 06:46:17.025: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 21 06:46:17.025: INFO: pod-disruption-failure-ignore-2-2rtdb started at 2023-01-21 06:46:05 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:17.025: INFO: 	Container c ready: false, restart count 0
Jan 21 06:46:17.431: INFO: 
Latency metrics for node i-034aa8120dbcec79b
Jan 21 06:46:17.431: INFO: 
Logging node info for node i-0483840d8e13a9e6f
Jan 21 06:46:17.539: INFO: Node Info: &Node{ObjectMeta:{i-0483840d8e13a9e6f    6e63ffcd-a34b-47ab-888c-fb980b98335e 19705 0 2023-01-21 06:26:26 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0483840d8e13a9e6f kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-1a topology.hostpath.csi/node:i-0483840d8e13a9e6f topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.35.162 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-2039":"i-0483840d8e13a9e6f","ebs.csi.aws.com":"i-0483840d8e13a9e6f"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-21 06:26:26 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 06:26:26 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 06:26:26 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-21 06:26:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-21 06:26:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-01-21 06:46:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-01-21 06:46:12 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-0483840d8e13a9e6f,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 06:45:59 +0000 UTC,LastTransitionTime:2023-01-21 06:26:26 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 06:45:59 +0000 UTC,LastTransitionTime:2023-01-21 06:26:26 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 06:45:59 +0000 UTC,LastTransitionTime:2023-01-21 06:26:26 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 06:45:59 +0000 UTC,LastTransitionTime:2023-01-21 06:26:38 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.35.162,},NodeAddress{Type:ExternalIP,Address:54.220.210.148,},NodeAddress{Type:InternalDNS,Address:i-0483840d8e13a9e6f.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0483840d8e13a9e6f.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-220-210-148.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2945f38534f04be1d719a5a69e0c27,SystemUUID:ec2945f3-8534-f04b-e1d7-19a5a69e0c27,BootID:dc551b58-3eaf-4442-8a18-f820d5bb2e66,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-075484b5e61c2a96e kubernetes.io/csi/ebs.csi.aws.com^vol-07cd4ff2e01c90cd0],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-075484b5e61c2a96e,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-07cd4ff2e01c90cd0,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-2039^4a991560-9957-11ed-bc95-26cc86e27cba,DevicePath:,},},Config:nil,},}
Jan 21 06:46:17.539: INFO: 
Logging kubelet events for node i-0483840d8e13a9e6f
Jan 21 06:46:17.648: INFO: 
Logging pods the kubelet thinks is on node i-0483840d8e13a9e6f
Jan 21 06:46:17.768: INFO: suspend-false-to-true-cxr2f started at 2023-01-21 06:35:20 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:17.768: INFO: 	Container c ready: false, restart count 0
Jan 21 06:46:17.768: INFO: externalsvc-hgg2f started at 2023-01-21 06:42:57 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:17.768: INFO: 	Container externalsvc ready: false, restart count 0
Jan 21 06:46:17.768: INFO: hostexec-i-0483840d8e13a9e6f-wmjxz started at 2023-01-21 06:44:39 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:17.768: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 21 06:46:17.768: INFO: pfpod started at 2023-01-21 06:45:05 +0000 UTC (0+2 container statuses recorded)
Jan 21 06:46:17.768: INFO: 	Container portforwardtester ready: true, restart count 0
Jan 21 06:46:17.768: INFO: 	Container readiness ready: true, restart count 0
Jan 21 06:46:17.768: INFO: dns-test-3cd32f06-3364-4fc1-a11e-dd22cf199550 started at 2023-01-21 06:45:20 +0000 UTC (0+3 container statuses recorded)
Jan 21 06:46:17.768: INFO: 	Container jessie-querier ready: true, restart count 0
Jan 21 06:46:17.768: INFO: 	Container querier ready: true, restart count 0
Jan 21 06:46:17.768: INFO: 	Container webserver ready: true, restart count 0
Jan 21 06:46:17.768: INFO: cilium-gjcpw started at 2023-01-21 06:26:27 +0000 UTC (1+1 container statuses recorded)
Jan 21 06:46:17.768: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 21 06:46:17.768: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 21 06:46:17.768: INFO: netserver-1 started at 2023-01-21 06:42:05 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:17.768: INFO: 	Container webserver ready: false, restart count 0
Jan 21 06:46:17.768: INFO: inline-volume-tester-qtrcn started at 2023-01-21 06:46:11 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:17.768: INFO: 	Container csi-volume-tester ready: false, restart count 0
Jan 21 06:46:17.768: INFO: ss2-0 started at 2023-01-21 06:35:58 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:17.768: INFO: 	Container webserver ready: true, restart count 0
Jan 21 06:46:17.768: INFO: csi-hostpathplugin-0 started at 2023-01-21 06:35:03 +0000 UTC (0+7 container statuses recorded)
Jan 21 06:46:17.768: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 21 06:46:17.768: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 21 06:46:17.768: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 21 06:46:17.768: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 21 06:46:17.768: INFO: 	Container hostpath ready: true, restart count 0
Jan 21 06:46:17.768: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 21 06:46:17.768: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 21 06:46:17.768: INFO: hostexec-i-0483840d8e13a9e6f-q7wlt started at 2023-01-21 06:45:30 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:17.768: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 21 06:46:17.768: INFO: pod-update-1731a417-e5ea-48ed-9b52-307dd7ddf57f started at 2023-01-21 06:42:17 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:17.768: INFO: 	Container pause ready: true, restart count 0
Jan 21 06:46:17.768: INFO: suspend-false-to-true-l6rxb started at 2023-01-21 06:35:20 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:17.768: INFO: 	Container c ready: true, restart count 0
Jan 21 06:46:17.768: INFO: pod-subpath-test-preprovisionedpv-rl8c started at 2023-01-21 06:44:54 +0000 UTC (0+2 container statuses recorded)
Jan 21 06:46:17.768: INFO: 	Container test-container-subpath-preprovisionedpv-rl8c ready: false, restart count 0
Jan 21 06:46:17.768: INFO: 	Container test-container-volume-preprovisionedpv-rl8c ready: true, restart count 0
Jan 21 06:46:17.768: INFO: pod-subpath-test-preprovisionedpv-2mg5 started at 2023-01-21 06:45:38 +0000 UTC (0+2 container statuses recorded)
Jan 21 06:46:17.768: INFO: 	Container test-container-subpath-preprovisionedpv-2mg5 ready: false, restart count 0
Jan 21 06:46:17.768: INFO: 	Container test-container-volume-preprovisionedpv-2mg5 ready: true, restart count 0
Jan 21 06:46:17.768: INFO: inline-volume-tester-7hmk6 started at 2023-01-21 06:40:55 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:17.768: INFO: 	Container csi-volume-tester ready: true, restart count 0
Jan 21 06:46:17.768: INFO: hostexec-i-0483840d8e13a9e6f-7rr6c started at <nil> (0+0 container statuses recorded)
Jan 21 06:46:17.768: INFO: ebs-csi-node-4fv8j started at 2023-01-21 06:26:27 +0000 UTC (0+3 container statuses recorded)
Jan 21 06:46:17.768: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 21 06:46:17.768: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 21 06:46:17.768: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 21 06:46:17.768: INFO: ss-0 started at 2023-01-21 06:45:54 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:17.768: INFO: 	Container webserver ready: false, restart count 0
Jan 21 06:46:17.768: INFO: test-grpc-57f4153d-bee5-4b1a-b84c-59b84c632ef9 started at 2023-01-21 06:38:49 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:17.768: INFO: 	Container etcd ready: true, restart count 0
Jan 21 06:46:18.300: INFO: 
Latency metrics for node i-0483840d8e13a9e6f
Jan 21 06:46:18.300: INFO: 
Logging node info for node i-0ce901feb1d51fd3c
Jan 21 06:46:18.407: INFO: Node Info: &Node{ObjectMeta:{i-0ce901feb1d51fd3c    7d82d388-0267-44ad-a74d-b2eb46841c68 19470 0 2023-01-21 06:26:22 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0ce901feb1d51fd3c kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-1a topology.hostpath.csi/node:i-0ce901feb1d51fd3c topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.55.1 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-7832":"i-0ce901feb1d51fd3c","ebs.csi.aws.com":"i-0ce901feb1d51fd3c"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-21 06:26:22 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 06:26:22 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 06:26:22 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-21 06:26:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-21 06:26:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-21 06:45:45 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-21 06:46:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-0ce901feb1d51fd3c,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 06:45:45 +0000 UTC,LastTransitionTime:2023-01-21 06:26:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 06:45:45 +0000 UTC,LastTransitionTime:2023-01-21 06:26:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 06:45:45 +0000 UTC,LastTransitionTime:2023-01-21 06:26:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 06:45:45 +0000 UTC,LastTransitionTime:2023-01-21 06:26:34 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.55.1,},NodeAddress{Type:ExternalIP,Address:54.74.114.32,},NodeAddress{Type:InternalDNS,Address:i-0ce901feb1d51fd3c.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0ce901feb1d51fd3c.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-74-114-32.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec284d9c2eebc996a6b6d4cf4e0f52b7,SystemUUID:ec284d9c-2eeb-c996-a6b6-d4cf4e0f52b7,BootID:e32d5483-bf35-4be2-9254-c24e37c024a3,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0b135fa1ce8020ce6],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0b135fa1ce8020ce6,DevicePath:,},},Config:nil,},}
Jan 21 06:46:18.407: INFO: 
Logging kubelet events for node i-0ce901feb1d51fd3c
Jan 21 06:46:18.517: INFO: 
Logging pods the kubelet thinks is on node i-0ce901feb1d51fd3c
Jan 21 06:46:18.630: INFO: pod-e5eacbe0-30d8-4006-9c57-2072fd145c59 started at 2023-01-21 06:46:07 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:18.630: INFO: 	Container write-pod ready: false, restart count 0
Jan 21 06:46:18.630: INFO: cilium-qs82l started at 2023-01-21 06:26:23 +0000 UTC (1+1 container statuses recorded)
Jan 21 06:46:18.630: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 21 06:46:18.630: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 21 06:46:18.630: INFO: pod2 started at 2023-01-21 06:44:52 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:18.630: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 21 06:46:18.630: INFO: externalsvc-cjcvt started at 2023-01-21 06:42:57 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:18.630: INFO: 	Container externalsvc ready: true, restart count 0
Jan 21 06:46:18.630: INFO: pod-f184b504-58cc-454d-aa21-3a2254168139 started at 2023-01-21 06:45:25 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:18.630: INFO: 	Container write-pod ready: true, restart count 0
Jan 21 06:46:18.630: INFO: pod-subpath-test-inlinevolume-gqdb started at 2023-01-21 06:46:17 +0000 UTC (0+2 container statuses recorded)
Jan 21 06:46:18.630: INFO: 	Container test-container-subpath-inlinevolume-gqdb ready: false, restart count 0
Jan 21 06:46:18.630: INFO: 	Container test-container-volume-inlinevolume-gqdb ready: false, restart count 0
Jan 21 06:46:18.630: INFO: verify-service-up-exec-pod-ptmds started at 2023-01-21 06:45:31 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:18.630: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 21 06:46:18.630: INFO: netserver-2 started at 2023-01-21 06:42:05 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:18.630: INFO: 	Container webserver ready: true, restart count 0
Jan 21 06:46:18.630: INFO: csi-mockplugin-attacher-0 started at 2023-01-21 06:45:18 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:18.630: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 21 06:46:18.630: INFO: hostexec-i-0ce901feb1d51fd3c-s8r9z started at 2023-01-21 06:45:59 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:18.630: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 21 06:46:18.630: INFO: hostexec-i-0ce901feb1d51fd3c-c55ct started at 2023-01-21 06:45:35 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:18.630: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 21 06:46:18.630: INFO: ebs-csi-node-qp79b started at 2023-01-21 06:26:23 +0000 UTC (0+3 container statuses recorded)
Jan 21 06:46:18.630: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 21 06:46:18.630: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 21 06:46:18.630: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 21 06:46:18.630: INFO: verify-service-up-host-exec-pod started at 2023-01-21 06:45:27 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:18.630: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 21 06:46:18.630: INFO: service-deletion-zzk4s started at 2023-01-21 06:40:23 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:18.630: INFO: 	Container service-deletion ready: true, restart count 0
Jan 21 06:46:18.630: INFO: csi-mockplugin-0 started at 2023-01-21 06:45:18 +0000 UTC (0+3 container statuses recorded)
Jan 21 06:46:18.630: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 21 06:46:18.630: INFO: 	Container driver-registrar ready: true, restart count 0
Jan 21 06:46:18.630: INFO: 	Container mock ready: true, restart count 0
Jan 21 06:46:18.630: INFO: e2e-test-httpd-pod started at 2023-01-21 06:45:55 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:18.630: INFO: 	Container e2e-test-httpd-pod ready: true, restart count 0
Jan 21 06:46:18.630: INFO: pod-subpath-test-preprovisionedpv-s87v started at 2023-01-21 06:46:16 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:18.630: INFO: 	Container test-container-subpath-preprovisionedpv-s87v ready: false, restart count 0
Jan 21 06:46:19.070: INFO: 
Latency metrics for node i-0ce901feb1d51fd3c
Jan 21 06:46:19.070: INFO: 
Logging node info for node i-0d2f2d71d5d6f8b5a
Jan 21 06:46:19.177: INFO: Node Info: &Node{ObjectMeta:{i-0d2f2d71d5d6f8b5a    d2f1894b-950d-45a2-a42f-7d9213bb75b8 17658 0 2023-01-21 06:24:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0d2f2d71d5d6f8b5a kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:eu-west-1a topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.42.168 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0d2f2d71d5d6f8b5a"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-21 06:24:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-21 06:25:04 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-01-21 06:25:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-21 06:25:18 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 06:25:18 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-21 06:41:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-0d2f2d71d5d6f8b5a,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892310016 0} {<nil>} 3801084Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787452416 0} {<nil>} 3698684Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 06:41:55 +0000 UTC,LastTransitionTime:2023-01-21 06:24:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 06:41:55 +0000 UTC,LastTransitionTime:2023-01-21 06:24:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 06:41:55 +0000 UTC,LastTransitionTime:2023-01-21 06:24:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 06:41:55 +0000 UTC,LastTransitionTime:2023-01-21 06:25:16 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.168,},NodeAddress{Type:ExternalIP,Address:3.249.87.249,},NodeAddress{Type:InternalDNS,Address:i-0d2f2d71d5d6f8b5a.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0d2f2d71d5d6f8b5a.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-249-87-249.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2326005f1a498ecb0bcf8cde478bd4,SystemUUID:ec232600-5f1a-498e-cb0b-cf8cde478bd4,BootID:45d9d2b8-2840-49c2-9bdc-aa7244b00f22,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.1],SizeBytes:135178704,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.1],SizeBytes:124995897,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.1],SizeBytes:57661752,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43643671,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42841306,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4965794,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 06:46:19.178: INFO: 
Logging kubelet events for node i-0d2f2d71d5d6f8b5a
Jan 21 06:46:19.287: INFO: 
Logging pods the kubelet thinks is on node i-0d2f2d71d5d6f8b5a
Jan 21 06:46:19.403: INFO: etcd-manager-events-i-0d2f2d71d5d6f8b5a started at 2023-01-21 06:24:03 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:19.403: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 21 06:46:19.403: INFO: kube-apiserver-i-0d2f2d71d5d6f8b5a started at 2023-01-21 06:24:04 +0000 UTC (0+2 container statuses recorded)
Jan 21 06:46:19.403: INFO: 	Container healthcheck ready: true, restart count 0
Jan 21 06:46:19.403: INFO: 	Container kube-apiserver ready: true, restart count 1
Jan 21 06:46:19.403: INFO: kops-controller-hffbm started at 2023-01-21 06:25:08 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:19.403: INFO: 	Container kops-controller ready: true, restart count 0
Jan 21 06:46:19.403: INFO: cilium-6bgng started at 2023-01-21 06:25:08 +0000 UTC (1+1 container statuses recorded)
Jan 21 06:46:19.403: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 21 06:46:19.403: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 21 06:46:19.403: INFO: dns-controller-69987775c6-vgxml started at 2023-01-21 06:25:08 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:19.403: INFO: 	Container dns-controller ready: true, restart count 0
Jan 21 06:46:19.403: INFO: ebs-csi-controller-5bd98b456f-b9lnh started at 2023-01-21 06:25:08 +0000 UTC (0+5 container statuses recorded)
Jan 21 06:46:19.403: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 21 06:46:19.403: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 21 06:46:19.403: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 21 06:46:19.403: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 21 06:46:19.403: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 21 06:46:19.403: INFO: etcd-manager-main-i-0d2f2d71d5d6f8b5a started at 2023-01-21 06:24:04 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:19.403: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 21 06:46:19.403: INFO: kube-controller-manager-i-0d2f2d71d5d6f8b5a started at 2023-01-21 06:24:04 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:19.403: INFO: 	Container kube-controller-manager ready: true, restart count 2
Jan 21 06:46:19.403: INFO: kube-scheduler-i-0d2f2d71d5d6f8b5a started at 2023-01-21 06:24:04 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:19.403: INFO: 	Container kube-scheduler ready: true, restart count 0
Jan 21 06:46:19.403: INFO: aws-cloud-controller-manager-cqjd9 started at 2023-01-21 06:25:08 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:19.403: INFO: 	Container aws-cloud-controller-manager ready: true, restart count 0
Jan 21 06:46:19.403: INFO: ebs-csi-node-tb6br started at 2023-01-21 06:25:08 +0000 UTC (0+3 container statuses recorded)
Jan 21 06:46:19.403: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 21 06:46:19.403: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 21 06:46:19.403: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 21 06:46:19.403: INFO: cilium-operator-5dd44dc49f-fld4m started at 2023-01-21 06:25:08 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:19.403: INFO: 	Container cilium-operator ready: true, restart count 0
Jan 21 06:46:19.844: INFO: 
Latency metrics for node i-0d2f2d71d5d6f8b5a
Jan 21 06:46:19.844: INFO: 
Logging node info for node i-0f3b8117f4ecfc9ec
Jan 21 06:46:19.952: INFO: Node Info: &Node{ObjectMeta:{i-0f3b8117f4ecfc9ec    019b5e58-b8c2-4ac5-ba8d-47ba49f9fe9c 19841 0 2023-01-21 06:26:29 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0f3b8117f4ecfc9ec kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-1a topology.hostpath.csi/node:i-0f3b8117f4ecfc9ec topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.36.94 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-9303":"i-0f3b8117f4ecfc9ec","ebs.csi.aws.com":"i-0f3b8117f4ecfc9ec"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-21 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 06:26:29 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-21 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-21 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-01-21 06:46:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-0f3b8117f4ecfc9ec,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 06:46:03 +0000 UTC,LastTransitionTime:2023-01-21 06:26:29 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 06:46:03 +0000 UTC,LastTransitionTime:2023-01-21 06:26:29 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 06:46:03 +0000 UTC,LastTransitionTime:2023-01-21 06:26:29 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 06:46:03 +0000 UTC,LastTransitionTime:2023-01-21 06:26:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.36.94,},NodeAddress{Type:ExternalIP,Address:54.72.134.71,},NodeAddress{Type:InternalDNS,Address:i-0f3b8117f4ecfc9ec.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0f3b8117f4ecfc9ec.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-72-134-71.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2c9416b8fb84b0403f690a294bd09b,SystemUUID:ec2c9416-b8fb-84b0-403f-690a294bd09b,BootID:4e9f8b9b-5350-48ad-8083-40ed7929b713,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 06:46:19.952: INFO: 
Logging kubelet events for node i-0f3b8117f4ecfc9ec
Jan 21 06:46:20.062: INFO: 
Logging pods the kubelet thinks is on node i-0f3b8117f4ecfc9ec
Jan 21 06:46:20.178: INFO: csi-mockplugin-attacher-0 started at 2023-01-21 06:46:12 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:20.178: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 21 06:46:20.178: INFO: ebs-csi-node-5dm54 started at 2023-01-21 06:26:30 +0000 UTC (0+3 container statuses recorded)
Jan 21 06:46:20.178: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 21 06:46:20.178: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 21 06:46:20.178: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 21 06:46:20.178: INFO: cilium-2brsw started at 2023-01-21 06:26:30 +0000 UTC (1+1 container statuses recorded)
Jan 21 06:46:20.178: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 21 06:46:20.178: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 21 06:46:20.178: INFO: csi-mockplugin-0 started at 2023-01-21 06:46:12 +0000 UTC (0+3 container statuses recorded)
Jan 21 06:46:20.178: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 21 06:46:20.178: INFO: 	Container driver-registrar ready: true, restart count 0
Jan 21 06:46:20.178: INFO: 	Container mock ready: true, restart count 0
Jan 21 06:46:20.178: INFO: pod1 started at 2023-01-21 06:44:49 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:20.178: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 21 06:46:20.178: INFO: coredns-559769c974-7fbns started at 2023-01-21 06:26:59 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:20.178: INFO: 	Container coredns ready: true, restart count 0
Jan 21 06:46:20.178: INFO: netserver-3 started at 2023-01-21 06:42:05 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:46:20.178: INFO: 	Container webserver ready: false, restart count 0
Jan 21 06:46:20.636: INFO: 
Latency metrics for node i-0f3b8117f4ecfc9ec
[DeferCleanup (Each)] [sig-cli] Kubectl client
  tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "kubectl-7259" for this suite. �[38;5;243m01/21/23 06:46:20.637�[0m

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-cli] Kubectl client Simple pod should return command exit codes running a successful command 6m40s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-cli\]\sKubectl\sclient\sSimple\spod\sshould\sreturn\scommand\sexit\scodes\srunning\sa\ssuccessful\scommand$'

test/e2e/kubectl/kubectl.go:546
k8s.io/kubernetes/test/e2e/kubectl.glob..func1.8.7.3()
	test/e2e/kubectl/kubectl.go:546 +0x1a5
				[BeforeEach] [sig-cli] Kubectl client
  set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/21/23 06:36:13.355�[0m
Jan 21 06:36:13.355: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename kubectl �[38;5;243m01/21/23 06:36:13.356�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/21/23 06:36:13.693�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/21/23 06:36:13.916�[0m
[BeforeEach] [sig-cli] Kubectl client
  test/e2e/framework/metrics/init/init.go:31
[BeforeEach] [sig-cli] Kubectl client
  test/e2e/kubectl/kubectl.go:274
[BeforeEach] Simple pod
  test/e2e/kubectl/kubectl.go:411
�[1mSTEP:�[0m creating the pod from  �[38;5;243m01/21/23 06:36:14.139�[0m
Jan 21 06:36:14.139: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/9fb2ac9e-9953-11ed-a697-56ea552f9d82/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-2376 create -f -'
Jan 21 06:36:15.428: INFO: stderr: ""
Jan 21 06:36:15.428: INFO: stdout: "pod/httpd created\n"
Jan 21 06:36:15.428: INFO: Waiting up to 5m0s for 1 pods to be running and ready: [httpd]
Jan 21 06:36:15.428: INFO: Waiting up to 5m0s for pod "httpd" in namespace "kubectl-2376" to be "running and ready"
Jan 21 06:36:15.540: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 112.005592ms
Jan 21 06:36:15.540: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:36:17.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2.225299665s
Jan 21 06:36:17.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:36:19.652: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4.224260394s
Jan 21 06:36:19.652: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:36:21.652: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 6.224436225s
Jan 21 06:36:21.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:36:23.652: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 8.224267128s
Jan 21 06:36:23.652: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:36:25.652: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 10.224381652s
Jan 21 06:36:25.652: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:36:27.652: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 12.224344721s
Jan 21 06:36:27.652: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:36:29.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 14.224594169s
Jan 21 06:36:29.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:36:31.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 16.224741666s
Jan 21 06:36:31.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:36:33.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 18.224634933s
Jan 21 06:36:33.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:36:35.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 20.22493091s
Jan 21 06:36:35.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:36:37.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 22.224512294s
Jan 21 06:36:37.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:36:39.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 24.224501441s
Jan 21 06:36:39.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:36:41.652: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 26.224223788s
Jan 21 06:36:41.652: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:36:43.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 28.224761599s
Jan 21 06:36:43.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:36:45.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 30.225115217s
Jan 21 06:36:45.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:36:47.654: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 32.225892831s
Jan 21 06:36:47.654: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:36:49.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 34.224593606s
Jan 21 06:36:49.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:36:51.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 36.224495984s
Jan 21 06:36:51.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:36:53.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 38.224586635s
Jan 21 06:36:53.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:36:55.652: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 40.223929173s
Jan 21 06:36:55.652: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:36:57.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 42.224711587s
Jan 21 06:36:57.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:36:59.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 44.224470211s
Jan 21 06:36:59.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:37:01.652: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 46.224288147s
Jan 21 06:37:01.652: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:37:03.652: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 48.224414051s
Jan 21 06:37:03.652: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:37:05.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 50.224503561s
Jan 21 06:37:05.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:37:07.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 52.224690459s
Jan 21 06:37:07.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:37:09.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 54.224654531s
Jan 21 06:37:09.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:37:11.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 56.224685473s
Jan 21 06:37:11.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:37:13.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 58.224743716s
Jan 21 06:37:13.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:37:15.652: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.224179372s
Jan 21 06:37:15.652: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:37:17.655: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.227014353s
Jan 21 06:37:17.655: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:37:19.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.224857998s
Jan 21 06:37:19.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:37:21.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.224705878s
Jan 21 06:37:21.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:37:23.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.224648599s
Jan 21 06:37:23.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:37:25.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.225226221s
Jan 21 06:37:25.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:37:27.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.2253403s
Jan 21 06:37:27.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:37:29.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.224725747s
Jan 21 06:37:29.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:37:31.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.224879853s
Jan 21 06:37:31.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:37:33.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.225042386s
Jan 21 06:37:33.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:37:35.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.224936354s
Jan 21 06:37:35.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:37:37.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.224553982s
Jan 21 06:37:37.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:37:39.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.225045119s
Jan 21 06:37:39.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:37:41.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.224649213s
Jan 21 06:37:41.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:37:43.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.224529977s
Jan 21 06:37:43.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:37:45.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.225166888s
Jan 21 06:37:45.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:37:47.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.224767424s
Jan 21 06:37:47.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:37:49.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.224862935s
Jan 21 06:37:49.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:37:51.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.22450106s
Jan 21 06:37:51.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:37:53.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.225031711s
Jan 21 06:37:53.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:37:55.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.225312203s
Jan 21 06:37:55.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:37:57.652: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.224335219s
Jan 21 06:37:57.652: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:37:59.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.22474777s
Jan 21 06:37:59.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:38:01.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.224565409s
Jan 21 06:38:01.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:38:03.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.224627286s
Jan 21 06:38:03.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:38:05.652: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.224418851s
Jan 21 06:38:05.652: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:38:07.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.224950366s
Jan 21 06:38:07.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:38:09.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.22476814s
Jan 21 06:38:09.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:38:11.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.22464958s
Jan 21 06:38:11.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:38:13.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.224790483s
Jan 21 06:38:13.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:38:15.652: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.224427072s
Jan 21 06:38:15.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:38:17.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.224656361s
Jan 21 06:38:17.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:38:19.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.224825555s
Jan 21 06:38:19.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:38:21.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.224975813s
Jan 21 06:38:21.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:38:23.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.224533805s
Jan 21 06:38:23.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:38:25.652: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.223968162s
Jan 21 06:38:25.652: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:38:27.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.224464352s
Jan 21 06:38:27.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:38:29.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.22459272s
Jan 21 06:38:29.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:38:31.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.224961932s
Jan 21 06:38:31.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:38:33.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.224515127s
Jan 21 06:38:33.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:38:35.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.22514425s
Jan 21 06:38:35.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:38:37.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.224554532s
Jan 21 06:38:37.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:38:39.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.224525277s
Jan 21 06:38:39.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:38:41.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.225352792s
Jan 21 06:38:41.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:38:43.655: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.226916558s
Jan 21 06:38:43.655: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:38:45.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.225412261s
Jan 21 06:38:45.654: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:38:47.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.224511373s
Jan 21 06:38:47.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:38:49.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.22453572s
Jan 21 06:38:49.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:38:51.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.224753905s
Jan 21 06:38:51.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:38:53.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.224926381s
Jan 21 06:38:53.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:38:55.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.224879369s
Jan 21 06:38:55.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:38:57.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.224717094s
Jan 21 06:38:57.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:38:59.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.2246366s
Jan 21 06:38:59.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:39:01.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.224985663s
Jan 21 06:39:01.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:39:03.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.224548459s
Jan 21 06:39:03.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:39:05.652: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.224243865s
Jan 21 06:39:05.652: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:39:07.652: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.22384776s
Jan 21 06:39:07.652: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:39:09.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.224633033s
Jan 21 06:39:09.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:39:11.652: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.224178687s
Jan 21 06:39:11.652: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:39:13.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.224534858s
Jan 21 06:39:13.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:39:15.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.224879669s
Jan 21 06:39:15.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:39:17.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.224755359s
Jan 21 06:39:17.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:39:19.652: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.224399319s
Jan 21 06:39:19.652: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:39:21.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.224590077s
Jan 21 06:39:21.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:39:23.652: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.224195889s
Jan 21 06:39:23.652: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:39:25.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.224608031s
Jan 21 06:39:25.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:39:27.652: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.224428932s
Jan 21 06:39:27.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:39:29.652: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.224348166s
Jan 21 06:39:29.652: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:39:31.652: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.224072894s
Jan 21 06:39:31.652: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:39:33.652: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.22398451s
Jan 21 06:39:33.652: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:39:35.652: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.224421269s
Jan 21 06:39:35.652: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:39:37.652: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.22390233s
Jan 21 06:39:37.652: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:39:39.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.224854679s
Jan 21 06:39:39.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:39:41.652: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.223940966s
Jan 21 06:39:41.652: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:39:43.652: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.223895473s
Jan 21 06:39:43.652: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:39:45.652: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.223896113s
Jan 21 06:39:45.652: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:39:47.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.22444963s
Jan 21 06:39:47.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:39:49.652: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.224394717s
Jan 21 06:39:49.652: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:39:51.652: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.224181098s
Jan 21 06:39:51.652: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:39:53.652: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.223683345s
Jan 21 06:39:53.652: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:39:55.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.224875453s
Jan 21 06:39:55.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:39:57.652: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.224394406s
Jan 21 06:39:57.652: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:39:59.652: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.224215985s
Jan 21 06:39:59.652: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:40:01.652: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.223985323s
Jan 21 06:40:01.652: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:40:03.652: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.224253828s
Jan 21 06:40:03.652: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:40:05.652: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.223955762s
Jan 21 06:40:05.652: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:40:07.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.224882309s
Jan 21 06:40:07.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:40:09.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.224623583s
Jan 21 06:40:09.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:40:11.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.22510756s
Jan 21 06:40:11.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:40:13.652: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.224435616s
Jan 21 06:40:13.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:40:15.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.224727308s
Jan 21 06:40:15.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:40:17.652: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.224154572s
Jan 21 06:40:17.652: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:40:19.652: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.223817352s
Jan 21 06:40:19.652: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:40:21.652: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.224257517s
Jan 21 06:40:21.652: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:40:23.652: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.223717451s
Jan 21 06:40:23.652: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:40:25.652: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.223614705s
Jan 21 06:40:25.652: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:40:27.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.22483642s
Jan 21 06:40:27.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:40:29.652: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.223757247s
Jan 21 06:40:29.652: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:40:31.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.224811777s
Jan 21 06:40:31.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:40:33.652: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.224294489s
Jan 21 06:40:33.652: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:40:35.653: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.224491131s
Jan 21 06:40:35.653: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:40:37.652: INFO: Pod "httpd": Phase="Running", Reason="", readiness=false. Elapsed: 4m22.224050586s
Jan 21 06:40:37.652: INFO: Error evaluating pod condition running and ready: pod 'httpd' on 'i-0483840d8e13a9e6f' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:36:15 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:36:15 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:36:15 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:36:15 +0000 UTC  }]
Jan 21 06:40:39.652: INFO: Pod "httpd": Phase="Running", Reason="", readiness=false. Elapsed: 4m24.224124622s
Jan 21 06:40:39.652: INFO: Error evaluating pod condition running and ready: pod 'httpd' on 'i-0483840d8e13a9e6f' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:36:15 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:36:15 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:36:15 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:36:15 +0000 UTC  }]
Jan 21 06:40:41.652: INFO: Pod "httpd": Phase="Running", Reason="", readiness=false. Elapsed: 4m26.224039503s
Jan 21 06:40:41.652: INFO: Error evaluating pod condition running and ready: pod 'httpd' on 'i-0483840d8e13a9e6f' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:36:15 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:36:15 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:36:15 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:36:15 +0000 UTC  }]
Jan 21 06:40:43.653: INFO: Pod "httpd": Phase="Running", Reason="", readiness=false. Elapsed: 4m28.225371767s
Jan 21 06:40:43.653: INFO: Error evaluating pod condition running and ready: pod 'httpd' on 'i-0483840d8e13a9e6f' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:36:15 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:36:15 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:36:15 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:36:15 +0000 UTC  }]
Jan 21 06:40:45.653: INFO: Pod "httpd": Phase="Running", Reason="", readiness=false. Elapsed: 4m30.224814621s
Jan 21 06:40:45.653: INFO: Error evaluating pod condition running and ready: pod 'httpd' on 'i-0483840d8e13a9e6f' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:36:15 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:36:15 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:36:15 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:36:15 +0000 UTC  }]
Jan 21 06:40:47.653: INFO: Pod "httpd": Phase="Running", Reason="", readiness=true. Elapsed: 4m32.224468938s
Jan 21 06:40:47.653: INFO: Pod "httpd" satisfied condition "running and ready"
Jan 21 06:40:47.653: INFO: Wanted all 1 pods to be running and ready. Result: true. Pods: [httpd]
[It] running a successful command
  test/e2e/kubectl/kubectl.go:544
Jan 21 06:40:47.653: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/9fb2ac9e-9953-11ed-a697-56ea552f9d82/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-2376 run -i --image=registry.k8s.io/e2e-test-images/busybox:1.29-4 --restart=Never --pod-running-timeout=2m0s success -- /bin/sh -c exit 0'
Jan 21 06:42:48.089: INFO: rc: 1
Jan 21 06:42:48.089: INFO: Unexpected error: 
    <exec.CodeExitError>: {
        Err: <*errors.errorString | 0xc0012dc0a0>{
            s: "error running /home/prow/go/src/k8s.io/kops/_rundir/9fb2ac9e-9953-11ed-a697-56ea552f9d82/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-2376 run -i --image=registry.k8s.io/e2e-test-images/busybox:1.29-4 --restart=Never --pod-running-timeout=2m0s success -- /bin/sh -c exit 0:\nCommand stdout:\n\nstderr:\nerror: timed out waiting for the condition\n\nerror:\nexit status 1",
        },
        Code: 1,
    }
Jan 21 06:42:48.089: FAIL: error running /home/prow/go/src/k8s.io/kops/_rundir/9fb2ac9e-9953-11ed-a697-56ea552f9d82/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-2376 run -i --image=registry.k8s.io/e2e-test-images/busybox:1.29-4 --restart=Never --pod-running-timeout=2m0s success -- /bin/sh -c exit 0:
Command stdout:

stderr:
error: timed out waiting for the condition

error:
exit status 1

Full Stack Trace
k8s.io/kubernetes/test/e2e/kubectl.glob..func1.8.7.3()
	test/e2e/kubectl/kubectl.go:546 +0x1a5
[AfterEach] Simple pod
  test/e2e/kubectl/kubectl.go:417
�[1mSTEP:�[0m using delete to clean up resources �[38;5;243m01/21/23 06:42:48.09�[0m
Jan 21 06:42:48.090: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/9fb2ac9e-9953-11ed-a697-56ea552f9d82/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-2376 delete --grace-period=0 --force -f -'
Jan 21 06:42:48.657: INFO: stderr: "Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely.\n"
Jan 21 06:42:48.657: INFO: stdout: "pod \"httpd\" force deleted\n"
Jan 21 06:42:48.657: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/9fb2ac9e-9953-11ed-a697-56ea552f9d82/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-2376 get rc,svc -l name=httpd --no-headers'
Jan 21 06:42:49.213: INFO: stderr: "No resources found in kubectl-2376 namespace.\n"
Jan 21 06:42:49.213: INFO: stdout: ""
Jan 21 06:42:49.213: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/9fb2ac9e-9953-11ed-a697-56ea552f9d82/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-2376 get pods -l name=httpd -o go-template={{ range .items }}{{ if not .metadata.deletionTimestamp }}{{ .metadata.name }}{{ "\n" }}{{ end }}{{ end }}'
Jan 21 06:42:49.659: INFO: stderr: ""
Jan 21 06:42:49.659: INFO: stdout: ""
[AfterEach] [sig-cli] Kubectl client
  test/e2e/framework/node/init/init.go:32
Jan 21 06:42:49.659: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-cli] Kubectl client
  test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-cli] Kubectl client
  dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/21/23 06:42:49.773�[0m
�[1mSTEP:�[0m Collecting events from namespace "kubectl-2376". �[38;5;243m01/21/23 06:42:49.773�[0m
�[1mSTEP:�[0m Found 26 events. �[38;5;243m01/21/23 06:42:49.886�[0m
Jan 21 06:42:49.886: INFO: At 2023-01-21 06:36:15 +0000 UTC - event for httpd: {default-scheduler } Scheduled: Successfully assigned kubectl-2376/httpd to i-0483840d8e13a9e6f
Jan 21 06:42:49.886: INFO: At 2023-01-21 06:36:15 +0000 UTC - event for httpd: {kubelet i-0483840d8e13a9e6f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "debc4c788a8c2b5622224e75b3db52264d2f12e1f125cb097720c72ae54cd734": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:42:49.886: INFO: At 2023-01-21 06:36:27 +0000 UTC - event for httpd: {kubelet i-0483840d8e13a9e6f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "36a5b8a7334520787197e533f1698f9de25befc04c3b4f94e74547ef552d9e67": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:42:49.886: INFO: At 2023-01-21 06:36:40 +0000 UTC - event for httpd: {kubelet i-0483840d8e13a9e6f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "61c2f6be528951679fa7016f0cbedd772d6036af32870f4fa3aacc8d1d428671": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:42:49.886: INFO: At 2023-01-21 06:36:54 +0000 UTC - event for httpd: {kubelet i-0483840d8e13a9e6f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "023f25ff79a15bd4407d104eb7b89cef6a785c409d074365b876b0a661a4b074": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:42:49.886: INFO: At 2023-01-21 06:37:06 +0000 UTC - event for httpd: {kubelet i-0483840d8e13a9e6f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "5bf0f772ba1eff9bd5bccd1609fac231e1b28163a42fa691e3ad0269021c8f92": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:42:49.886: INFO: At 2023-01-21 06:37:17 +0000 UTC - event for httpd: {kubelet i-0483840d8e13a9e6f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "343ae17171ae3acecb0ae862cd1cf91ecc8621e630d828f50bab380201f70a8b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:42:49.886: INFO: At 2023-01-21 06:37:32 +0000 UTC - event for httpd: {kubelet i-0483840d8e13a9e6f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "bd974fde389c3f129a4753ca651380cf6f8d31421cb0ace42112f7e6f0b715a8": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:42:49.886: INFO: At 2023-01-21 06:37:46 +0000 UTC - event for httpd: {kubelet i-0483840d8e13a9e6f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "fb4b91617ed5f1aec5330c774fabe10c9edfe4f2811a17dae1e17202ff9869f1": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:42:49.886: INFO: At 2023-01-21 06:37:58 +0000 UTC - event for httpd: {kubelet i-0483840d8e13a9e6f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "485d74f4e08959f4ab28eae10523f6d3a3a599f2385acdfd2d7684eea82f703d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:42:49.886: INFO: At 2023-01-21 06:38:09 +0000 UTC - event for httpd: {kubelet i-0483840d8e13a9e6f} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "36969b618f1876b2de5389c9a4b4e9aec13387ddf3dd1d87586dc34ab8ee6613": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:42:49.886: INFO: At 2023-01-21 06:40:35 +0000 UTC - event for httpd: {kubelet i-0483840d8e13a9e6f} Created: Created container httpd
Jan 21 06:42:49.886: INFO: At 2023-01-21 06:40:35 +0000 UTC - event for httpd: {kubelet i-0483840d8e13a9e6f} Started: Started container httpd
Jan 21 06:42:49.886: INFO: At 2023-01-21 06:40:35 +0000 UTC - event for httpd: {kubelet i-0483840d8e13a9e6f} Pulled: Container image "registry.k8s.io/e2e-test-images/httpd:2.4.38-4" already present on machine
Jan 21 06:42:49.886: INFO: At 2023-01-21 06:40:48 +0000 UTC - event for success: {default-scheduler } Scheduled: Successfully assigned kubectl-2376/success to i-0f3b8117f4ecfc9ec
Jan 21 06:42:49.886: INFO: At 2023-01-21 06:40:48 +0000 UTC - event for success: {kubelet i-0f3b8117f4ecfc9ec} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "279c5d474b8371f03bc0794d4f5815d37f1fe258e21bf82e107bb52fbba7e053": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:42:49.886: INFO: At 2023-01-21 06:40:59 +0000 UTC - event for success: {kubelet i-0f3b8117f4ecfc9ec} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "bf79a4e775d2f2e2ede80c53bd6f430e2b9d140fabd6fae48a46008c3dea2c50": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:42:49.886: INFO: At 2023-01-21 06:41:11 +0000 UTC - event for success: {kubelet i-0f3b8117f4ecfc9ec} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "5ce41eb4dfce3d6b9074d7b4652aaef0f8766f5a3a53f9e4f361c06e61027053": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:42:49.886: INFO: At 2023-01-21 06:41:25 +0000 UTC - event for success: {kubelet i-0f3b8117f4ecfc9ec} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "00b7afc0aa225ef4a19b0d76ad52053ba6033fe4a3ca342eb6ab69fa8b4309a0": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:42:49.886: INFO: At 2023-01-21 06:41:38 +0000 UTC - event for success: {kubelet i-0f3b8117f4ecfc9ec} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d2537787d1ed528398c224abd33b8a909f63a6656c86399ab81d95d88f7d7a45": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:42:49.886: INFO: At 2023-01-21 06:41:52 +0000 UTC - event for success: {kubelet i-0f3b8117f4ecfc9ec} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "1a0c89e1d2f72da61809d7c8b43334df3ea926d9e6ba1560172d9c64014ba417": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:42:49.886: INFO: At 2023-01-21 06:42:06 +0000 UTC - event for success: {kubelet i-0f3b8117f4ecfc9ec} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "456339b4e0df50a523cc1ca76455675a62de0ff47c108b5185b7e89491c5ad4d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:42:49.886: INFO: At 2023-01-21 06:42:21 +0000 UTC - event for success: {kubelet i-0f3b8117f4ecfc9ec} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "8b37c547436a97fa2547118430537bd8a7bb855dd2a4d521c42fa4389ce01e7b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:42:49.886: INFO: At 2023-01-21 06:42:32 +0000 UTC - event for success: {kubelet i-0f3b8117f4ecfc9ec} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "7054f8a9df4d38e40f3a277bf16ca3d87e577eed5dffb5b20b8503c403d93d10": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:42:49.886: INFO: At 2023-01-21 06:42:46 +0000 UTC - event for success: {kubelet i-0f3b8117f4ecfc9ec} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "4a57b85960115664260ef444722e1929c3ae220c0d7daff59a4d274455f5354e": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 21 06:42:49.886: INFO: At 2023-01-21 06:42:48 +0000 UTC - event for httpd: {kubelet i-0483840d8e13a9e6f} Killing: Stopping container httpd
Jan 21 06:42:49.998: INFO: POD      NODE                 PHASE    GRACE  CONDITIONS
Jan 21 06:42:49.998: INFO: success  i-0f3b8117f4ecfc9ec  Pending         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:40:48 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:40:48 +0000 UTC ContainersNotReady containers with unready status: [success]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:40:48 +0000 UTC ContainersNotReady containers with unready status: [success]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 06:40:48 +0000 UTC  }]
Jan 21 06:42:49.998: INFO: 
Jan 21 06:42:50.112: INFO: Unable to fetch kubectl-2376/success/success logs: the server rejected our request for an unknown reason (get pods success)
Jan 21 06:42:50.225: INFO: 
Logging node info for node i-034aa8120dbcec79b
Jan 21 06:42:50.337: INFO: Node Info: &Node{ObjectMeta:{i-034aa8120dbcec79b    c2b3eda9-6144-4855-b163-8deafef2a413 15935 0 2023-01-21 06:26:22 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-034aa8120dbcec79b kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-1a topology.hostpath.csi/node:i-034aa8120dbcec79b topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.44.197 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-034aa8120dbcec79b"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-21 06:26:22 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 06:26:22 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 06:26:22 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-21 06:26:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-21 06:26:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {e2e.test Update v1 2023-01-21 06:33:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-21 06:38:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-034aa8120dbcec79b,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 06:38:37 +0000 UTC,LastTransitionTime:2023-01-21 06:26:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 06:38:37 +0000 UTC,LastTransitionTime:2023-01-21 06:26:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 06:38:37 +0000 UTC,LastTransitionTime:2023-01-21 06:26:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 06:38:37 +0000 UTC,LastTransitionTime:2023-01-21 06:26:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.44.197,},NodeAddress{Type:ExternalIP,Address:3.250.148.238,},NodeAddress{Type:InternalDNS,Address:i-034aa8120dbcec79b.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-034aa8120dbcec79b.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-250-148-238.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec24052f5b49538b50ca690553c9978a,SystemUUID:ec24052f-5b49-538b-50ca-690553c9978a,BootID:e582450b-04c2-4204-a2a8-58ecc23f099e,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 06:42:50.338: INFO: 
Logging kubelet events for node i-034aa8120dbcec79b
Jan 21 06:42:50.454: INFO: 
Logging pods the kubelet thinks is on node i-034aa8120dbcec79b
Jan 21 06:42:50.575: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-sjgwj started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:50.575: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:42:50.575: INFO: pod-disruption-failure-ignore-1-lmh2f started at 2023-01-21 06:34:51 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:50.575: INFO: 	Container c ready: false, restart count 0
Jan 21 06:42:50.575: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-l9cqk started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:50.575: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:42:50.575: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-lnlh9 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:50.575: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:42:50.575: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-wf6j2 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:50.575: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:42:50.575: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-nf6xx started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:50.575: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:42:50.575: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-tjrzg started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:50.575: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:42:50.575: INFO: coredns-559769c974-f8ncw started at 2023-01-21 06:26:33 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:50.575: INFO: 	Container coredns ready: true, restart count 0
Jan 21 06:42:50.575: INFO: pod-subpath-test-preprovisionedpv-rd6z started at 2023-01-21 06:40:39 +0000 UTC (1+1 container statuses recorded)
Jan 21 06:42:50.575: INFO: 	Init container init-volume-preprovisionedpv-rd6z ready: false, restart count 0
Jan 21 06:42:50.575: INFO: 	Container test-container-subpath-preprovisionedpv-rd6z ready: false, restart count 0
Jan 21 06:42:50.575: INFO: netserver-0 started at 2023-01-21 06:42:05 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:50.575: INFO: 	Container webserver ready: false, restart count 0
Jan 21 06:42:50.575: INFO: cilium-rbcn6 started at 2023-01-21 06:26:22 +0000 UTC (1+1 container statuses recorded)
Jan 21 06:42:50.575: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 21 06:42:50.575: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 21 06:42:50.575: INFO: hostexec-i-034aa8120dbcec79b-fclfv started at 2023-01-21 06:40:23 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:50.575: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 21 06:42:50.575: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-26nnl started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:50.575: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:42:50.575: INFO: ebs-csi-node-4mfqt started at 2023-01-21 06:26:22 +0000 UTC (0+3 container statuses recorded)
Jan 21 06:42:50.575: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 21 06:42:50.575: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 21 06:42:50.575: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 21 06:42:50.575: INFO: pod-disruption-failure-ignore-0-lktw9 started at 2023-01-21 06:34:51 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:50.575: INFO: 	Container c ready: true, restart count 0
Jan 21 06:42:50.575: INFO: coredns-autoscaler-7cb5c5b969-slvzq started at 2023-01-21 06:26:33 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:50.575: INFO: 	Container autoscaler ready: true, restart count 0
Jan 21 06:42:50.575: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-4xkqd started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:50.575: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: false, restart count 0
Jan 21 06:42:50.575: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-gwjcc started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:50.575: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:42:50.575: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-sqpxl started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:50.575: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:42:50.992: INFO: 
Latency metrics for node i-034aa8120dbcec79b
Jan 21 06:42:50.992: INFO: 
Logging node info for node i-0483840d8e13a9e6f
Jan 21 06:42:51.105: INFO: Node Info: &Node{ObjectMeta:{i-0483840d8e13a9e6f    6e63ffcd-a34b-47ab-888c-fb980b98335e 17988 0 2023-01-21 06:26:26 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0483840d8e13a9e6f kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-1a topology.hostpath.csi/node:i-0483840d8e13a9e6f topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.35.162 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0483840d8e13a9e6f"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-21 06:26:26 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 06:26:26 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 06:26:26 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-21 06:26:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-21 06:26:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-21 06:33:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-21 06:40:57 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-21 06:42:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-0483840d8e13a9e6f,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 06:42:35 +0000 UTC,LastTransitionTime:2023-01-21 06:26:26 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 06:42:35 +0000 UTC,LastTransitionTime:2023-01-21 06:26:26 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 06:42:35 +0000 UTC,LastTransitionTime:2023-01-21 06:26:26 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 06:42:35 +0000 UTC,LastTransitionTime:2023-01-21 06:26:38 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.35.162,},NodeAddress{Type:ExternalIP,Address:54.220.210.148,},NodeAddress{Type:InternalDNS,Address:i-0483840d8e13a9e6f.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0483840d8e13a9e6f.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-220-210-148.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2945f38534f04be1d719a5a69e0c27,SystemUUID:ec2945f3-8534-f04b-e1d7-19a5a69e0c27,BootID:dc551b58-3eaf-4442-8a18-f820d5bb2e66,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-075484b5e61c2a96e],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-075484b5e61c2a96e,DevicePath:,},},Config:nil,},}
Jan 21 06:42:51.105: INFO: 
Logging kubelet events for node i-0483840d8e13a9e6f
Jan 21 06:42:51.220: INFO: 
Logging pods the kubelet thinks is on node i-0483840d8e13a9e6f
Jan 21 06:42:51.339: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-nzzv4 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:51.339: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:42:51.339: INFO: test-grpc-57f4153d-bee5-4b1a-b84c-59b84c632ef9 started at 2023-01-21 06:38:49 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:51.339: INFO: 	Container etcd ready: true, restart count 0
Jan 21 06:42:51.339: INFO: suspend-false-to-true-cxr2f started at 2023-01-21 06:35:20 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:51.339: INFO: 	Container c ready: false, restart count 0
Jan 21 06:42:51.339: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-ljtgd started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:51.339: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:42:51.339: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-jkplr started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:51.339: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:42:51.339: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-jtcl9 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:51.339: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:42:51.339: INFO: cilium-gjcpw started at 2023-01-21 06:26:27 +0000 UTC (1+1 container statuses recorded)
Jan 21 06:42:51.339: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 21 06:42:51.339: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 21 06:42:51.339: INFO: netserver-1 started at 2023-01-21 06:42:05 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:51.339: INFO: 	Container webserver ready: false, restart count 0
Jan 21 06:42:51.339: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-xl5pw started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:51.339: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:42:51.339: INFO: ss2-0 started at 2023-01-21 06:35:58 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:51.339: INFO: 	Container webserver ready: true, restart count 0
Jan 21 06:42:51.339: INFO: csi-hostpathplugin-0 started at 2023-01-21 06:35:03 +0000 UTC (0+7 container statuses recorded)
Jan 21 06:42:51.339: INFO: 	Container csi-attacher ready: false, restart count 0
Jan 21 06:42:51.339: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan 21 06:42:51.339: INFO: 	Container csi-resizer ready: false, restart count 0
Jan 21 06:42:51.339: INFO: 	Container csi-snapshotter ready: false, restart count 0
Jan 21 06:42:51.339: INFO: 	Container hostpath ready: false, restart count 0
Jan 21 06:42:51.339: INFO: 	Container liveness-probe ready: false, restart count 0
Jan 21 06:42:51.339: INFO: 	Container node-driver-registrar ready: false, restart count 0
Jan 21 06:42:51.339: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-59wl4 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:51.339: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: false, restart count 0
Jan 21 06:42:51.339: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-lx5wh started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:51.339: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:42:51.339: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-wrc8q started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:51.339: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:42:51.339: INFO: pod-update-1731a417-e5ea-48ed-9b52-307dd7ddf57f started at 2023-01-21 06:42:17 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:51.339: INFO: 	Container pause ready: false, restart count 0
Jan 21 06:42:51.339: INFO: suspend-false-to-true-l6rxb started at 2023-01-21 06:35:20 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:51.339: INFO: 	Container c ready: false, restart count 0
Jan 21 06:42:51.339: INFO: inline-volume-tester-7hmk6 started at 2023-01-21 06:40:55 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:51.339: INFO: 	Container csi-volume-tester ready: false, restart count 0
Jan 21 06:42:51.339: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-gx9qk started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:51.339: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:42:51.339: INFO: ebs-csi-node-4fv8j started at 2023-01-21 06:26:27 +0000 UTC (0+3 container statuses recorded)
Jan 21 06:42:51.339: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 21 06:42:51.339: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 21 06:42:51.339: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 21 06:42:51.339: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-5cg9n started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:51.339: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:42:51.339: INFO: httpd started at 2023-01-21 06:40:23 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:51.339: INFO: 	Container httpd ready: false, restart count 0
Jan 21 06:42:51.759: INFO: 
Latency metrics for node i-0483840d8e13a9e6f
Jan 21 06:42:51.759: INFO: 
Logging node info for node i-0ce901feb1d51fd3c
Jan 21 06:42:51.871: INFO: Node Info: &Node{ObjectMeta:{i-0ce901feb1d51fd3c    7d82d388-0267-44ad-a74d-b2eb46841c68 17384 0 2023-01-21 06:26:22 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0ce901feb1d51fd3c kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-1a topology.hostpath.csi/node:i-0ce901feb1d51fd3c topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.55.1 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0ce901feb1d51fd3c"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-21 06:26:22 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 06:26:22 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 06:26:22 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-21 06:26:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-21 06:26:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-21 06:33:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-21 06:40:59 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-01-21 06:41:06 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-0ce901feb1d51fd3c,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 06:40:59 +0000 UTC,LastTransitionTime:2023-01-21 06:26:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 06:40:59 +0000 UTC,LastTransitionTime:2023-01-21 06:26:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 06:40:59 +0000 UTC,LastTransitionTime:2023-01-21 06:26:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 06:40:59 +0000 UTC,LastTransitionTime:2023-01-21 06:26:34 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.55.1,},NodeAddress{Type:ExternalIP,Address:54.74.114.32,},NodeAddress{Type:InternalDNS,Address:i-0ce901feb1d51fd3c.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0ce901feb1d51fd3c.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-74-114-32.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec284d9c2eebc996a6b6d4cf4e0f52b7,SystemUUID:ec284d9c-2eeb-c996-a6b6-d4cf4e0f52b7,BootID:e32d5483-bf35-4be2-9254-c24e37c024a3,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0136a6452541f2af3 kubernetes.io/csi/ebs.csi.aws.com^vol-09ae70f9bff51a6a7 kubernetes.io/csi/ebs.csi.aws.com^vol-0f488a07e0987edd1],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0136a6452541f2af3,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0f488a07e0987edd1,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-09ae70f9bff51a6a7,DevicePath:,},},Config:nil,},}
Jan 21 06:42:51.872: INFO: 
Logging kubelet events for node i-0ce901feb1d51fd3c
Jan 21 06:42:51.987: INFO: 
Logging pods the kubelet thinks is on node i-0ce901feb1d51fd3c
Jan 21 06:42:52.108: INFO: test-recreate-deployment-795566c5cb-cw79n started at 2023-01-21 06:42:04 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:52.108: INFO: 	Container agnhost ready: false, restart count 0
Jan 21 06:42:52.108: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-nz2r7 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:52.108: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:42:52.108: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-lfwx4 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:52.108: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:42:52.108: INFO: cilium-qs82l started at 2023-01-21 06:26:23 +0000 UTC (1+1 container statuses recorded)
Jan 21 06:42:52.108: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 21 06:42:52.108: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 21 06:42:52.108: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-wtrk9 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:52.108: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:42:52.108: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-dw85q started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:52.108: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:42:52.108: INFO: pod-42c3941f-639f-4962-ae44-973a160407e8 started at 2023-01-21 06:35:06 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:52.108: INFO: 	Container write-pod ready: true, restart count 0
Jan 21 06:42:52.108: INFO: csi-mockplugin-0 started at 2023-01-21 06:39:10 +0000 UTC (0+4 container statuses recorded)
Jan 21 06:42:52.108: INFO: 	Container busybox ready: false, restart count 0
Jan 21 06:42:52.108: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan 21 06:42:52.108: INFO: 	Container driver-registrar ready: false, restart count 0
Jan 21 06:42:52.108: INFO: 	Container mock ready: false, restart count 0
Jan 21 06:42:52.108: INFO: ss2-1 started at 2023-01-21 06:36:27 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:52.108: INFO: 	Container webserver ready: false, restart count 0
Jan 21 06:42:52.108: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-mxx2t started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:52.108: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:42:52.108: INFO: pod-2 started at 2023-01-21 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:52.108: INFO: 	Container donothing ready: true, restart count 0
Jan 21 06:42:52.108: INFO: send-events-dede08bb-dc2e-45be-ab88-2efdfe2ce16b started at 2023-01-21 06:39:21 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:52.108: INFO: 	Container p ready: false, restart count 0
Jan 21 06:42:52.108: INFO: pod-1 started at 2023-01-21 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:52.108: INFO: 	Container donothing ready: true, restart count 0
Jan 21 06:42:52.108: INFO: netserver-2 started at 2023-01-21 06:42:05 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:52.108: INFO: 	Container webserver ready: false, restart count 0
Jan 21 06:42:52.108: INFO: pod-a202bbe2-d16a-40d8-81e4-37e789c8fe6b started at 2023-01-21 06:40:58 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:52.108: INFO: 	Container write-pod ready: false, restart count 0
Jan 21 06:42:52.108: INFO: ebs-csi-node-qp79b started at 2023-01-21 06:26:23 +0000 UTC (0+3 container statuses recorded)
Jan 21 06:42:52.108: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 21 06:42:52.108: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 21 06:42:52.108: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 21 06:42:52.108: INFO: hostexec-i-0ce901feb1d51fd3c-96hxq started at 2023-01-21 06:40:47 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:52.108: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 21 06:42:52.108: INFO: pod-2214d111-6f9f-4cf4-938a-ea98d46a830a started at 2023-01-21 06:40:51 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:52.108: INFO: 	Container write-pod ready: false, restart count 0
Jan 21 06:42:52.108: INFO: pod-0 started at 2023-01-21 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:52.108: INFO: 	Container donothing ready: false, restart count 0
Jan 21 06:42:52.108: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-72ss9 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:52.108: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:42:52.108: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-tsmhc started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:52.108: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:42:52.108: INFO: pod-2d889885-3f7a-479c-a414-791defb1b96e started at 2023-01-21 06:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:52.108: INFO: 	Container write-pod ready: false, restart count 0
Jan 21 06:42:52.108: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-q9jl2 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:52.108: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: false, restart count 0
Jan 21 06:42:52.108: INFO: hostexec-i-0ce901feb1d51fd3c-2pbs6 started at 2023-01-21 06:40:41 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:52.108: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 21 06:42:52.108: INFO: pod-b5a81e47-c996-4d6d-89a7-b7b072b032f7 started at 2023-01-21 06:39:57 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:52.108: INFO: 	Container test-container ready: false, restart count 0
Jan 21 06:42:52.108: INFO: service-deletion-zzk4s started at 2023-01-21 06:40:23 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:52.108: INFO: 	Container service-deletion ready: false, restart count 0
Jan 21 06:42:52.108: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-zz7mm started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:52.108: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:42:52.108: INFO: pvc-tester-wmpgc started at 2023-01-21 06:39:38 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:52.108: INFO: 	Container write-pod ready: false, restart count 0
Jan 21 06:42:52.108: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-pkhl6 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:52.108: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:42:52.562: INFO: 
Latency metrics for node i-0ce901feb1d51fd3c
Jan 21 06:42:52.562: INFO: 
Logging node info for node i-0d2f2d71d5d6f8b5a
Jan 21 06:42:52.675: INFO: Node Info: &Node{ObjectMeta:{i-0d2f2d71d5d6f8b5a    d2f1894b-950d-45a2-a42f-7d9213bb75b8 17658 0 2023-01-21 06:24:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0d2f2d71d5d6f8b5a kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:eu-west-1a topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.42.168 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0d2f2d71d5d6f8b5a"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-21 06:24:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-21 06:25:04 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-01-21 06:25:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-21 06:25:18 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 06:25:18 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-21 06:41:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-0d2f2d71d5d6f8b5a,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892310016 0} {<nil>} 3801084Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787452416 0} {<nil>} 3698684Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 06:41:55 +0000 UTC,LastTransitionTime:2023-01-21 06:24:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 06:41:55 +0000 UTC,LastTransitionTime:2023-01-21 06:24:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 06:41:55 +0000 UTC,LastTransitionTime:2023-01-21 06:24:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 06:41:55 +0000 UTC,LastTransitionTime:2023-01-21 06:25:16 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.168,},NodeAddress{Type:ExternalIP,Address:3.249.87.249,},NodeAddress{Type:InternalDNS,Address:i-0d2f2d71d5d6f8b5a.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0d2f2d71d5d6f8b5a.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-249-87-249.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2326005f1a498ecb0bcf8cde478bd4,SystemUUID:ec232600-5f1a-498e-cb0b-cf8cde478bd4,BootID:45d9d2b8-2840-49c2-9bdc-aa7244b00f22,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.1],SizeBytes:135178704,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.1],SizeBytes:124995897,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.1],SizeBytes:57661752,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43643671,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42841306,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4965794,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 06:42:52.675: INFO: 
Logging kubelet events for node i-0d2f2d71d5d6f8b5a
Jan 21 06:42:52.790: INFO: 
Logging pods the kubelet thinks is on node i-0d2f2d71d5d6f8b5a
Jan 21 06:42:52.909: INFO: kube-apiserver-i-0d2f2d71d5d6f8b5a started at 2023-01-21 06:24:04 +0000 UTC (0+2 container statuses recorded)
Jan 21 06:42:52.909: INFO: 	Container healthcheck ready: true, restart count 0
Jan 21 06:42:52.909: INFO: 	Container kube-apiserver ready: true, restart count 1
Jan 21 06:42:52.909: INFO: kops-controller-hffbm started at 2023-01-21 06:25:08 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:52.909: INFO: 	Container kops-controller ready: true, restart count 0
Jan 21 06:42:52.909: INFO: cilium-6bgng started at 2023-01-21 06:25:08 +0000 UTC (1+1 container statuses recorded)
Jan 21 06:42:52.909: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 21 06:42:52.909: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 21 06:42:52.909: INFO: dns-controller-69987775c6-vgxml started at 2023-01-21 06:25:08 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:52.909: INFO: 	Container dns-controller ready: true, restart count 0
Jan 21 06:42:52.909: INFO: etcd-manager-events-i-0d2f2d71d5d6f8b5a started at 2023-01-21 06:24:03 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:52.909: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 21 06:42:52.909: INFO: kube-controller-manager-i-0d2f2d71d5d6f8b5a started at 2023-01-21 06:24:04 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:52.909: INFO: 	Container kube-controller-manager ready: true, restart count 2
Jan 21 06:42:52.909: INFO: kube-scheduler-i-0d2f2d71d5d6f8b5a started at 2023-01-21 06:24:04 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:52.909: INFO: 	Container kube-scheduler ready: true, restart count 0
Jan 21 06:42:52.909: INFO: aws-cloud-controller-manager-cqjd9 started at 2023-01-21 06:25:08 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:52.909: INFO: 	Container aws-cloud-controller-manager ready: true, restart count 0
Jan 21 06:42:52.909: INFO: ebs-csi-node-tb6br started at 2023-01-21 06:25:08 +0000 UTC (0+3 container statuses recorded)
Jan 21 06:42:52.909: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 21 06:42:52.909: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 21 06:42:52.909: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 21 06:42:52.909: INFO: cilium-operator-5dd44dc49f-fld4m started at 2023-01-21 06:25:08 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:52.909: INFO: 	Container cilium-operator ready: true, restart count 0
Jan 21 06:42:52.909: INFO: ebs-csi-controller-5bd98b456f-b9lnh started at 2023-01-21 06:25:08 +0000 UTC (0+5 container statuses recorded)
Jan 21 06:42:52.909: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 21 06:42:52.909: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 21 06:42:52.909: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 21 06:42:52.909: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 21 06:42:52.909: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 21 06:42:52.909: INFO: etcd-manager-main-i-0d2f2d71d5d6f8b5a started at 2023-01-21 06:24:04 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:52.909: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 21 06:42:53.314: INFO: 
Latency metrics for node i-0d2f2d71d5d6f8b5a
Jan 21 06:42:53.314: INFO: 
Logging node info for node i-0f3b8117f4ecfc9ec
Jan 21 06:42:53.426: INFO: Node Info: &Node{ObjectMeta:{i-0f3b8117f4ecfc9ec    019b5e58-b8c2-4ac5-ba8d-47ba49f9fe9c 17313 0 2023-01-21 06:26:29 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0f3b8117f4ecfc9ec kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-1a topology.hostpath.csi/node:i-0f3b8117f4ecfc9ec topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.36.94 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0f3b8117f4ecfc9ec"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-21 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 06:26:29 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-21 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-21 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-21 06:33:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-21 06:40:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-0f3b8117f4ecfc9ec,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 06:40:57 +0000 UTC,LastTransitionTime:2023-01-21 06:26:29 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 06:40:57 +0000 UTC,LastTransitionTime:2023-01-21 06:26:29 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 06:40:57 +0000 UTC,LastTransitionTime:2023-01-21 06:26:29 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 06:40:57 +0000 UTC,LastTransitionTime:2023-01-21 06:26:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.36.94,},NodeAddress{Type:ExternalIP,Address:54.72.134.71,},NodeAddress{Type:InternalDNS,Address:i-0f3b8117f4ecfc9ec.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0f3b8117f4ecfc9ec.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-72-134-71.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2c9416b8fb84b0403f690a294bd09b,SystemUUID:ec2c9416-b8fb-84b0-403f-690a294bd09b,BootID:4e9f8b9b-5350-48ad-8083-40ed7929b713,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 06:42:53.427: INFO: 
Logging kubelet events for node i-0f3b8117f4ecfc9ec
Jan 21 06:42:53.541: INFO: 
Logging pods the kubelet thinks is on node i-0f3b8117f4ecfc9ec
Jan 21 06:42:53.659: INFO: success started at 2023-01-21 06:40:48 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:53.659: INFO: 	Container success ready: false, restart count 0
Jan 21 06:42:53.659: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-28wx9 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:53.659: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:42:53.659: INFO: pod-50b10bdb-b71a-4475-a054-a7d09c720326 started at 2023-01-21 06:42:06 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:53.659: INFO: 	Container write-pod ready: false, restart count 0
Jan 21 06:42:53.659: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-mlsc7 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:53.659: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:42:53.659: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-frfcl started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:53.659: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:42:53.659: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-wzrc6 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:53.659: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:42:53.659: INFO: hostexec-i-0f3b8117f4ecfc9ec-h88h7 started at 2023-01-21 06:42:01 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:53.659: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 21 06:42:53.659: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-5pk66 started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:53.659: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:42:53.659: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-fjkff started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:53.659: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:42:53.659: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-4sr7v started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:53.659: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:42:53.659: INFO: ebs-csi-node-5dm54 started at 2023-01-21 06:26:30 +0000 UTC (0+3 container statuses recorded)
Jan 21 06:42:53.659: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 21 06:42:53.659: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 21 06:42:53.659: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 21 06:42:53.659: INFO: cilium-2brsw started at 2023-01-21 06:26:30 +0000 UTC (1+1 container statuses recorded)
Jan 21 06:42:53.659: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 21 06:42:53.659: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 21 06:42:53.659: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-8zpkj started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:53.659: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:42:53.659: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-zgzjd started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:53.659: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:42:53.659: INFO: cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3-7vwsn started at 2023-01-21 06:33:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:53.659: INFO: 	Container cleanup40-85437cbe-ce8b-4226-b609-5886304c69f3 ready: true, restart count 0
Jan 21 06:42:53.659: INFO: liveness-ab0dfacf-f357-4bc1-8afa-01c26e98f46c started at 2023-01-21 06:42:03 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:53.659: INFO: 	Container agnhost-container ready: true, restart count 1
Jan 21 06:42:53.659: INFO: coredns-559769c974-7fbns started at 2023-01-21 06:26:59 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:53.659: INFO: 	Container coredns ready: true, restart count 0
Jan 21 06:42:53.659: INFO: netserver-3 started at 2023-01-21 06:42:05 +0000 UTC (0+1 container statuses recorded)
Jan 21 06:42:53.659: INFO: 	Container webserver ready: false, restart count 0
Jan 21 06:42:54.088: INFO: 
Latency metrics for node i-0f3b8117f4ecfc9ec
[DeferCleanup (Each)] [sig-cli] Kubectl client
  tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "kubectl-2376" for this suite. �[38;5;243m01/21/23 06:42:54.089�[0m

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-cli] Kubectl client Simple pod should support exec using resource/name 5m8s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-cli\]\sKubectl\sclient\sSimple\spod\sshould\ssupport\sexec\susing\sresource\/name$'

test/e2e/kubectl/kubectl.go:415
k8s.io/kubernetes/test/e2e/kubectl.glob..func1.8.1()
	test/e2e/kubectl/kubectl.go:415 +0x245
				[BeforeEach] [sig-cli] Kubectl client
  set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/21/23 06:40:21.626�[0m
Jan 21 06:40:21.626: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename kubectl �[38;5;243m01/21/23 06:40:21.627�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/21/23 06:40:21.968�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/21/23 06:40:22.193�[0m
[BeforeEach] [sig-cli] Kubectl client
  test/e2e/framework/metrics/init/init.go:31
[BeforeEach] [sig-cli] Kubectl client
  test/e2e/kubectl/kubectl.go:274
[BeforeEach] Simple pod
  test/e2e/kubectl/kubectl.go:411
�[1mSTEP:�[0m creating the pod from  �[38;5;243m01/21/23 06:40:22.418�[0m
Jan 21 06:40:22.419: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/9fb2ac9e-9953-11ed-a697-56ea552f9d82/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-2851 create -f -'
Jan 21 06:40:23.134: INFO: stderr: ""
Jan 21 06:40:23.134: INFO: stdout: "pod/httpd created\n"
Jan 21 06:40:23.134: INFO: Waiting up to 5m0s for 1 pods to be running and ready: [httpd]
Jan 21 06:40:23.134: INFO: Waiting up to 5m0s for pod "httpd" in namespace "kubectl-2851" to be "running and ready"
Jan 21 06:40:23.248: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 113.164412ms
Jan 21 06:40:23.248: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:40:25.362: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2.227594281s
Jan 21 06:40:25.362: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:40:27.363: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4.228818097s
Jan 21 06:40:27.363: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:40:29.361: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 6.226763154s
Jan 21 06:40:29.361: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:40:31.362: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 8.227096078s
Jan 21 06:40:31.362: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:40:33.362: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 10.227414565s
Jan 21 06:40:33.362: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:40:35.362: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 12.227352057s
Jan 21 06:40:35.362: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:40:37.362: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 14.2271855s
Jan 21 06:40:37.362: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:40:39.362: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 16.227205532s
Jan 21 06:40:39.362: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:40:41.362: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 18.227384595s
Jan 21 06:40:41.362: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:40:43.362: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 20.227066945s
Jan 21 06:40:43.362: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:40:45.362: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 22.22777327s
Jan 21 06:40:45.362: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:40:47.362: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 24.22707335s
Jan 21 06:40:47.362: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:40:49.362: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 26.227510587s
Jan 21 06:40:49.362: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:40:51.362: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 28.227571114s
Jan 21 06:40:51.362: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:40:53.362: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 30.227552605s
Jan 21 06:40:53.362: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:40:55.361: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 32.226975858s
Jan 21 06:40:55.361: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:40:57.362: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 34.227819823s
Jan 21 06:40:57.362: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:40:59.362: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 36.227596158s
Jan 21 06:40:59.362: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:41:01.362: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 38.227376495s
Jan 21 06:41:01.362: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:41:03.362: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 40.22730617s
Jan 21 06:41:03.362: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:41:05.362: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 42.227837156s
Jan 21 06:41:05.362: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:41:07.362: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 44.227233503s
Jan 21 06:41:07.362: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:41:09.362: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 46.227515311s
Jan 21 06:41:09.362: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:41:11.362: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 48.227263732s
Jan 21 06:41:11.362: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:41:13.362: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 50.227772661s
Jan 21 06:41:13.362: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:41:15.362: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 52.22752741s
Jan 21 06:41:15.362: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:41:17.362: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 54.227644793s
Jan 21 06:41:17.362: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:41:19.361: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 56.22670497s
Jan 21 06:41:19.361: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:41:21.362: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 58.227145532s
Jan 21 06:41:21.362: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:41:23.362: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.227819113s
Jan 21 06:41:23.362: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:41:25.362: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.227226474s
Jan 21 06:41:25.362: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:41:27.363: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.228664602s
Jan 21 06:41:27.363: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:41:29.361: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.227031779s
Jan 21 06:41:29.362: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:41:31.362: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.227746249s
Jan 21 06:41:31.362: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:41:33.362: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.227209388s
Jan 21 06:41:33.362: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:41:35.361: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.226972655s
Jan 21 06:41:35.361: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:41:37.362: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.227667647s
Jan 21 06:41:37.362: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:41:39.362: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.227097093s
Jan 21 06:41:39.362: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:41:41.361: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.226746436s
Jan 21 06:41:41.361: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:41:43.362: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.227732417s
Jan 21 06:41:43.362: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:41:45.362: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.227511091s
Jan 21 06:41:45.362: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:41:47.362: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.227592107s
Jan 21 06:41:47.362: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:41:49.362: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.227471988s
Jan 21 06:41:49.362: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:41:51.362: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.227138336s
Jan 21 06:41:51.362: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:41:53.362: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.227364377s
Jan 21 06:41:53.362: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:41:55.362: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.227322733s
Jan 21 06:41:55.362: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:41:57.362: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.22734461s
Jan 21 06:41:57.362: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:41:59.362: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.227473205s
Jan 21 06:41:59.362: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:42:01.362: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.22731009s
Jan 21 06:42:01.362: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0483840d8e13a9e6f' to be 'Running' but was 'Pending'
Jan 21 06:42:03.362: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40

Result	FAILURE
Tests	31 failed / 857 succeeded
Started	2023-01-21 06:20
Elapsed	43m12s
Revision	master