Result | FAILURE |
Tests | 27 failed / 741 succeeded |
Started | |
Elapsed | 39m22s |
Revision | master |
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\sExternal\sStorage\s\[Driver\:\sebs\.csi\.aws\.com\]\s\[Testpattern\:\sDynamic\sPV\s\(block\svolmode\)\(allowExpansion\)\]\svolume\-expand\sVerify\sif\soffline\sPVC\sexpansion\sworks$'
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volume_expand.go:174 Dec 2 23:40:30.796: while recreating pod for resizing Unexpected error: <*errors.errorString | 0xc003d4e3d0>: { s: "pod \"pod-55255ec9-bf45-4208-865d-6ef51afe9599\" is not Running: timed out waiting for the condition", } pod "pod-55255ec9-bf45-4208-865d-6ef51afe9599" is not Running: timed out waiting for the condition occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volume_expand.go:236from junit_21.xml
[BeforeEach] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51 [BeforeEach] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Dec 2 23:29:53.216: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename volume-expand �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [It] Verify if offline PVC expansion works /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volume_expand.go:174 Dec 2 23:29:53.541: INFO: Creating resource for dynamic PV Dec 2 23:29:53.541: INFO: Using claimSize:1Gi, test suite supported size:{ 1Gi}, driver(ebs.csi.aws.com) supported size:{ 1Gi} �[1mSTEP�[0m: creating a StorageClass volume-expand-3868-e2e-sc77qh5 �[1mSTEP�[0m: creating a claim �[1mSTEP�[0m: Creating a pod with dynamically provisioned volume �[1mSTEP�[0m: Deleting the previously created pod Dec 2 23:30:22.020: INFO: Deleting pod "pod-b15858eb-3954-4425-b069-4e928ab0a951" in namespace "volume-expand-3868" Dec 2 23:30:22.085: INFO: Wait up to 5m0s for pod "pod-b15858eb-3954-4425-b069-4e928ab0a951" to be fully deleted �[1mSTEP�[0m: Expanding current pvc Dec 2 23:30:26.214: INFO: currentPvcSize {{1073741824 0} {<nil>} 1Gi BinarySI}, newSize {{2147483648 0} {<nil>} BinarySI} �[1mSTEP�[0m: Waiting for cloudprovider resize to finish �[1mSTEP�[0m: Checking for conditions on pvc �[1mSTEP�[0m: Creating a new pod with same volume Dec 2 23:40:30.795: FAIL: while recreating pod for resizing Unexpected error: <*errors.errorString | 0xc003d4e3d0>: { s: "pod \"pod-55255ec9-bf45-4208-865d-6ef51afe9599\" is not Running: timed out waiting for the condition", } pod "pod-55255ec9-bf45-4208-865d-6ef51afe9599" is not Running: timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/storage/testsuites.(*volumeExpandTestSuite).DefineTests.func4() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volume_expand.go:236 +0xe6d k8s.io/kubernetes/test/e2e.RunE2ETests(0xc000960480) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x36c k8s.io/kubernetes/test/e2e.TestE2E(0xc000960480) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:136 +0x2b testing.tRunner(0xc000960480, 0x729c8b8) /usr/local/go/src/testing/testing.go:1203 +0xe5 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1248 +0x2b3 Dec 2 23:40:30.796: INFO: Deleting pod "pod-55255ec9-bf45-4208-865d-6ef51afe9599" in namespace "volume-expand-3868" Dec 2 23:40:30.859: INFO: Wait up to 5m0s for pod "pod-55255ec9-bf45-4208-865d-6ef51afe9599" to be fully deleted Dec 2 23:40:32.984: INFO: Deleting pod "pod-b15858eb-3954-4425-b069-4e928ab0a951" in namespace "volume-expand-3868" �[1mSTEP�[0m: Deleting pod Dec 2 23:40:33.046: INFO: Deleting pod "pod-b15858eb-3954-4425-b069-4e928ab0a951" in namespace "volume-expand-3868" �[1mSTEP�[0m: Deleting pod2 Dec 2 23:40:33.109: INFO: Deleting pod "pod-55255ec9-bf45-4208-865d-6ef51afe9599" in namespace "volume-expand-3868" �[1mSTEP�[0m: Deleting pvc Dec 2 23:40:33.295: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.com9gx6w" Dec 2 23:40:33.358: INFO: Waiting up to 5m0s for PersistentVolume pvc-7efc802d-c884-413d-91cc-4c105e896e6f to get deleted Dec 2 23:40:33.420: INFO: PersistentVolume pvc-7efc802d-c884-413d-91cc-4c105e896e6f found and phase=Released (61.976841ms) Dec 2 23:40:38.483: INFO: PersistentVolume pvc-7efc802d-c884-413d-91cc-4c105e896e6f found and phase=Released (5.124543393s) Dec 2 23:40:43.545: INFO: PersistentVolume pvc-7efc802d-c884-413d-91cc-4c105e896e6f found and phase=Released (10.187005946s) Dec 2 23:40:48.608: INFO: PersistentVolume pvc-7efc802d-c884-413d-91cc-4c105e896e6f was removed �[1mSTEP�[0m: Deleting sc [AfterEach] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "volume-expand-3868". �[1mSTEP�[0m: Found 31 events. Dec 2 23:40:48.741: INFO: At 2022-12-02 23:29:53 +0000 UTC - event for ebs.csi.aws.com9gx6w: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding Dec 2 23:40:48.741: INFO: At 2022-12-02 23:29:53 +0000 UTC - event for ebs.csi.aws.com9gx6w: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "ebs.csi.aws.com" or manually created by system administrator Dec 2 23:40:48.741: INFO: At 2022-12-02 23:29:53 +0000 UTC - event for ebs.csi.aws.com9gx6w: {ebs.csi.aws.com_ebs-csi-controller-764b64d679-rnjp4_1978fc76-a891-4d6a-a65e-5c4612a92e24 } Provisioning: External provisioner is provisioning volume for claim "volume-expand-3868/ebs.csi.aws.com9gx6w" Dec 2 23:40:48.741: INFO: At 2022-12-02 23:29:57 +0000 UTC - event for ebs.csi.aws.com9gx6w: {ebs.csi.aws.com_ebs-csi-controller-764b64d679-rnjp4_1978fc76-a891-4d6a-a65e-5c4612a92e24 } ProvisioningSucceeded: Successfully provisioned volume pvc-7efc802d-c884-413d-91cc-4c105e896e6f Dec 2 23:40:48.741: INFO: At 2022-12-02 23:29:57 +0000 UTC - event for pod-b15858eb-3954-4425-b069-4e928ab0a951: {default-scheduler } Scheduled: Successfully assigned volume-expand-3868/pod-b15858eb-3954-4425-b069-4e928ab0a951 to ip-172-20-43-150.us-west-2.compute.internal Dec 2 23:40:48.741: INFO: At 2022-12-02 23:29:59 +0000 UTC - event for pod-b15858eb-3954-4425-b069-4e928ab0a951: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-7efc802d-c884-413d-91cc-4c105e896e6f" Dec 2 23:40:48.741: INFO: At 2022-12-02 23:30:06 +0000 UTC - event for pod-b15858eb-3954-4425-b069-4e928ab0a951: {kubelet ip-172-20-43-150.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "15aeace602271fdb88e198b84bdd0a69fac4073c90c24597dba3b19c9c1f4301": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:40:48.741: INFO: At 2022-12-02 23:30:06 +0000 UTC - event for pod-b15858eb-3954-4425-b069-4e928ab0a951: {kubelet ip-172-20-43-150.us-west-2.compute.internal} SuccessfulMountVolume: MapVolume.MapPodDevice succeeded for volume "pvc-7efc802d-c884-413d-91cc-4c105e896e6f" volumeMapPath "/var/lib/kubelet/pods/915f70a2-8fd8-44aa-bc25-f7ce9847fa26/volumeDevices/kubernetes.io~csi" Dec 2 23:40:48.741: INFO: At 2022-12-02 23:30:06 +0000 UTC - event for pod-b15858eb-3954-4425-b069-4e928ab0a951: {kubelet ip-172-20-43-150.us-west-2.compute.internal} SuccessfulMountVolume: MapVolume.MapPodDevice succeeded for volume "pvc-7efc802d-c884-413d-91cc-4c105e896e6f" globalMapPath "/var/lib/kubelet/plugins/kubernetes.io/csi/volumeDevices/pvc-7efc802d-c884-413d-91cc-4c105e896e6f/dev" Dec 2 23:40:48.741: INFO: At 2022-12-02 23:30:21 +0000 UTC - event for pod-b15858eb-3954-4425-b069-4e928ab0a951: {kubelet ip-172-20-43-150.us-west-2.compute.internal} Pulled: Container image "k8s.gcr.io/e2e-test-images/busybox:1.29-1" already present on machine Dec 2 23:40:48.741: INFO: At 2022-12-02 23:30:21 +0000 UTC - event for pod-b15858eb-3954-4425-b069-4e928ab0a951: {kubelet ip-172-20-43-150.us-west-2.compute.internal} Started: Started container write-pod Dec 2 23:40:48.741: INFO: At 2022-12-02 23:30:21 +0000 UTC - event for pod-b15858eb-3954-4425-b069-4e928ab0a951: {kubelet ip-172-20-43-150.us-west-2.compute.internal} Created: Created container write-pod Dec 2 23:40:48.741: INFO: At 2022-12-02 23:30:23 +0000 UTC - event for pod-b15858eb-3954-4425-b069-4e928ab0a951: {kubelet ip-172-20-43-150.us-west-2.compute.internal} Killing: Stopping container write-pod Dec 2 23:40:48.741: INFO: At 2022-12-02 23:30:26 +0000 UTC - event for ebs.csi.aws.com9gx6w: {volume_expand } ExternalExpanding: Ignoring the PVC: didn't find a plugin capable of expanding the volume; waiting for an external controller to process this PVC. Dec 2 23:40:48.741: INFO: At 2022-12-02 23:30:26 +0000 UTC - event for ebs.csi.aws.com9gx6w: {external-resizer ebs.csi.aws.com } Resizing: External resizer is resizing volume pvc-7efc802d-c884-413d-91cc-4c105e896e6f Dec 2 23:40:48.741: INFO: At 2022-12-02 23:30:29 +0000 UTC - event for ebs.csi.aws.com9gx6w: {external-resizer ebs.csi.aws.com } VolumeResizeSuccessful: Resize volume succeeded Dec 2 23:40:48.741: INFO: At 2022-12-02 23:30:30 +0000 UTC - event for pod-55255ec9-bf45-4208-865d-6ef51afe9599: {attachdetach-controller } FailedAttachVolume: Multi-Attach error for volume "pvc-7efc802d-c884-413d-91cc-4c105e896e6f" Volume is already exclusively attached to one node and can't be attached to another Dec 2 23:40:48.741: INFO: At 2022-12-02 23:30:30 +0000 UTC - event for pod-55255ec9-bf45-4208-865d-6ef51afe9599: {default-scheduler } Scheduled: Successfully assigned volume-expand-3868/pod-55255ec9-bf45-4208-865d-6ef51afe9599 to ip-172-20-41-32.us-west-2.compute.internal Dec 2 23:40:48.741: INFO: At 2022-12-02 23:30:43 +0000 UTC - event for pod-55255ec9-bf45-4208-865d-6ef51afe9599: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-7efc802d-c884-413d-91cc-4c105e896e6f" Dec 2 23:40:48.741: INFO: At 2022-12-02 23:30:44 +0000 UTC - event for pod-55255ec9-bf45-4208-865d-6ef51afe9599: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "03217a4ebb69f0b5ea430358594f1ba68ffeb61b549935e7655bbf39094a4850": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:40:48.741: INFO: At 2022-12-02 23:30:44 +0000 UTC - event for pod-55255ec9-bf45-4208-865d-6ef51afe9599: {kubelet ip-172-20-41-32.us-west-2.compute.internal} SuccessfulMountVolume: MapVolume.MapPodDevice succeeded for volume "pvc-7efc802d-c884-413d-91cc-4c105e896e6f" volumeMapPath "/var/lib/kubelet/pods/4967d50c-60da-4634-ae9c-cfc6c513d302/volumeDevices/kubernetes.io~csi" Dec 2 23:40:48.741: INFO: At 2022-12-02 23:30:44 +0000 UTC - event for pod-55255ec9-bf45-4208-865d-6ef51afe9599: {kubelet ip-172-20-41-32.us-west-2.compute.internal} SuccessfulMountVolume: MapVolume.MapPodDevice succeeded for volume "pvc-7efc802d-c884-413d-91cc-4c105e896e6f" globalMapPath "/var/lib/kubelet/plugins/kubernetes.io/csi/volumeDevices/pvc-7efc802d-c884-413d-91cc-4c105e896e6f/dev" Dec 2 23:40:48.741: INFO: At 2022-12-02 23:30:58 +0000 UTC - event for pod-55255ec9-bf45-4208-865d-6ef51afe9599: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "85b24c5ac67ccc27eed11111233512c760ccce0eef7402c90027b73d20d141de": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:40:48.741: INFO: At 2022-12-02 23:31:10 +0000 UTC - event for pod-55255ec9-bf45-4208-865d-6ef51afe9599: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "bde13629d6aa0eb5d8a8ed285b7eb5ad49e7042fa0ec03bb1d434de0c1e673f9": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:40:48.741: INFO: At 2022-12-02 23:31:25 +0000 UTC - event for pod-55255ec9-bf45-4208-865d-6ef51afe9599: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "3793a6c4cdead495b4ab4f5b2a9482624e0b5d4e0fba4dc9e9efe85c743d8ff2": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:40:48.741: INFO: At 2022-12-02 23:31:41 +0000 UTC - event for pod-55255ec9-bf45-4208-865d-6ef51afe9599: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b9e5b67ebe31f5c7348378fe3e33cc5c60e1cc2c281f63d1362265594b941a74": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:40:48.741: INFO: At 2022-12-02 23:31:55 +0000 UTC - event for pod-55255ec9-bf45-4208-865d-6ef51afe9599: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "f07b9742b2cbed792649c5f5350e812e0d06fa2e5264a5d60af5068c3c76eaf9": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:40:48.741: INFO: At 2022-12-02 23:32:09 +0000 UTC - event for pod-55255ec9-bf45-4208-865d-6ef51afe9599: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "3b0aab15b1207a6968c18d8f16b4e9bcc13e8ada8ff41873d907b525a58d4f41": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:40:48.741: INFO: At 2022-12-02 23:32:21 +0000 UTC - event for pod-55255ec9-bf45-4208-865d-6ef51afe9599: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d800f3eee44bdc5d2f97803a6863a47d1e59c786f2270130fd182529c40bf9c9": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:40:48.741: INFO: At 2022-12-02 23:32:36 +0000 UTC - event for pod-55255ec9-bf45-4208-865d-6ef51afe9599: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e88af5d299f3e82b28b8da40fa856fb38294dfb6ff73e3950c3d1259257b7ad9": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:40:48.741: INFO: At 2022-12-02 23:32:49 +0000 UTC - event for pod-55255ec9-bf45-4208-865d-6ef51afe9599: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "2d8bd7b25ecaa34db44e59202193e12a58e1fb039157b7388eb07f437713d543": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:40:48.807: INFO: POD NODE PHASE GRACE CONDITIONS Dec 2 23:40:48.807: INFO: Dec 2 23:40:48.871: INFO: Logging node info for node ip-172-20-33-254.us-west-2.compute.internal Dec 2 23:40:48.934: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-33-254.us-west-2.compute.internal 6236393f-0a33-4aea-a2e2-fedaf7becdd4 31837 0 2022-12-02 23:17:15 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-33-254.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:ip-172-20-33-254.us-west-2.compute.internal topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0d507bb204448139f"} io.cilium.network.ipv4-cilium-host:172.20.42.35 io.cilium.network.ipv4-health-ip:172.20.58.176 io.cilium.network.ipv4-pod-cidr:100.96.1.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2022-12-02 23:17:15 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2022-12-02 23:17:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-12-02 23:17:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {cilium-agent Update v1 2022-12-02 23:17:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-12-02 23:17:41 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-12-02 23:30:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-0d507bb204448139f,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-02 23:17:41 +0000 UTC,LastTransitionTime:2022-12-02 23:17:41 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-02 23:40:16 +0000 UTC,LastTransitionTime:2022-12-02 23:17:15 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-02 23:40:16 +0000 UTC,LastTransitionTime:2022-12-02 23:17:15 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-02 23:40:16 +0000 UTC,LastTransitionTime:2022-12-02 23:17:15 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-02 23:40:16 +0000 UTC,LastTransitionTime:2022-12-02 23:17:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.33.254,},NodeAddress{Type:ExternalIP,Address:54.190.128.11,},NodeAddress{Type:Hostname,Address:ip-172-20-33-254.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-33-254.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-190-128-11.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23ec8dd062be253828b6092e22eaab,SystemUUID:ec23ec8d-d062-be25-3828-b6092e22eaab,BootID:6bbf84c7-41f9-4141-912e-7f3bc9a0ef42,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.13,KubeletVersion:v1.22.16,KubeProxyVersion:v1.22.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:160382894,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.22.16],SizeBytes:105446599,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:1f36a24cfb5e0c3f725d7565a867c2384282fcbeccc77b07b423c9da95763a9a k8s.gcr.io/e2e-test-images/nautilus:1.4],SizeBytes:49230179,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:716d2f68314c5c4ddd5ecdb45183fcb4ed8019015982c1321571f863989b70b0 k8s.gcr.io/e2e-test-images/httpd:2.4.39-1],SizeBytes:41902332,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:b913fa234cc3473cfe16e937d106b455a7609f927f59031c81aca791e2689b50 k8s.gcr.io/e2e-test-images/httpd:2.4.38-1],SizeBytes:40765006,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:28956694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonroot@sha256:4051e85640c22f8e00c34dbd273576fc9e1e2829992656588062be9c0f69b04b k8s.gcr.io/e2e-test-images/nonroot:1.1],SizeBytes:17748448,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:aa60f453d64dfb3c3fd9e7306f988c36c6352c4f2d956aa90467f2808091effa registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.5],SizeBytes:15209420,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:1b7c978a792a8fa4e96244e8059bd71bb49b07e2e5a897fb0c867bdc6db20d5d k8s.gcr.io/sig-storage/livenessprobe:v2.3.0],SizeBytes:7933739,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:503b7abb89e57383eba61cc8a9cb0b495ea575c516108f7d972a6ff6e1ab3c9b k8s.gcr.io/e2e-test-images/nginx:1.14-1],SizeBytes:6979365,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:1ff6c18fbef2045af6b9c16bf034cc421a29027b800e4f9b68ae9b1cb3e9ae07 k8s.gcr.io/pause:3.5],SizeBytes:301416,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 2 23:40:48.935: INFO: Logging kubelet events for node ip-172-20-33-254.us-west-2.compute.internal Dec 2 23:40:48.999: INFO: Logging pods the kubelet thinks is on node ip-172-20-33-254.us-west-2.compute.internal Dec 2 23:40:49.070: INFO: coredns-autoscaler-6658b4bf85-4zgd2 started at 2022-12-02 23:17:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:40:49.070: INFO: Container autoscaler ready: true, restart count 0 Dec 2 23:40:49.070: INFO: ebs-csi-node-rfgvb started at 2022-12-02 23:17:16 +0000 UTC (0+3 container statuses recorded) Dec 2 23:40:49.070: INFO: Container ebs-plugin ready: true, restart count 0 Dec 2 23:40:49.070: INFO: Container liveness-probe ready: true, restart count 0 Dec 2 23:40:49.070: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 2 23:40:49.070: INFO: hostpath-symlink-prep-provisioning-387 started at 2022-12-02 23:36:51 +0000 UTC (0+1 container statuses recorded) Dec 2 23:40:49.070: INFO: Container init-volume-provisioning-387 ready: false, restart count 0 Dec 2 23:40:49.070: INFO: cilium-2db9c started at 2022-12-02 23:17:16 +0000 UTC (1+1 container statuses recorded) Dec 2 23:40:49.070: INFO: Init container clean-cilium-state ready: true, restart count 0 Dec 2 23:40:49.070: INFO: Container cilium-agent ready: true, restart count 0 Dec 2 23:40:49.070: INFO: netserver-0 started at 2022-12-02 23:40:18 +0000 UTC (0+1 container statuses recorded) Dec 2 23:40:49.070: INFO: Container webserver ready: false, restart count 0 Dec 2 23:40:49.070: INFO: netserver-0 started at 2022-12-02 23:38:46 +0000 UTC (0+1 container statuses recorded) Dec 2 23:40:49.070: INFO: Container webserver ready: false, restart count 0 Dec 2 23:40:49.070: INFO: coredns-5fcc7b6498-8nvj5 started at 2022-12-02 23:17:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:40:49.070: INFO: Container coredns ready: true, restart count 0 Dec 2 23:40:49.070: INFO: security-context-f9200ea0-242e-401e-968c-5da3b7c09ba5 started at 2022-12-02 23:40:46 +0000 UTC (0+1 container statuses recorded) Dec 2 23:40:49.070: INFO: Container test-container ready: false, restart count 0 Dec 2 23:40:49.070: INFO: execpodnc957 started at 2022-12-02 23:40:46 +0000 UTC (0+1 container statuses recorded) Dec 2 23:40:49.070: INFO: Container agnhost-container ready: false, restart count 0 Dec 2 23:40:49.485: INFO: Latency metrics for node ip-172-20-33-254.us-west-2.compute.internal Dec 2 23:40:49.485: INFO: Logging node info for node ip-172-20-40-67.us-west-2.compute.internal Dec 2 23:40:49.551: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-40-67.us-west-2.compute.internal 0a5fe428-9a11-4bd2-96f1-21d4d188f80f 30470 0 2022-12-02 23:15:37 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-40-67.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/control-plane: node-role.kubernetes.io/master: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:us-west-2a topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0725cfbb3e93e664c"} io.cilium.network.ipv4-cilium-host:172.20.59.109 io.cilium.network.ipv4-health-ip:172.20.51.231 io.cilium.network.ipv4-pod-cidr:100.96.0.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-12-02 23:15:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {protokube Update v1 2022-12-02 23:16:01 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kops-controller Update v1 2022-12-02 23:16:07 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/master":{}}}} } {kube-controller-manager Update v1 2022-12-02 23:16:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {cilium-agent Update v1 2022-12-02 23:17:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-12-02 23:17:36 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-12-02 23:17:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-0725cfbb3e93e664c,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892301824 0} {<nil>} 3801076Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787444224 0} {<nil>} 3698676Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-02 23:17:36 +0000 UTC,LastTransitionTime:2022-12-02 23:17:36 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-02 23:38:28 +0000 UTC,LastTransitionTime:2022-12-02 23:15:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-02 23:38:28 +0000 UTC,LastTransitionTime:2022-12-02 23:15:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-02 23:38:28 +0000 UTC,LastTransitionTime:2022-12-02 23:15:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-02 23:38:28 +0000 UTC,LastTransitionTime:2022-12-02 23:16:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.40.67,},NodeAddress{Type:ExternalIP,Address:34.213.81.56,},NodeAddress{Type:Hostname,Address:ip-172-20-40-67.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-40-67.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-34-213-81-56.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2bdc536f1fb98cbe397162835bf7b5,SystemUUID:ec2bdc53-6f1f-b98c-be39-7162835bf7b5,BootID:80f23ad2-0f99-46af-8080-253547cd7440,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.13,KubeletVersion:v1.22.16,KubeProxyVersion:v1.22.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:a91fdaf9b988943a9c73d422348c2383c08dfc2566d4124a39a1b3d785018720 registry.k8s.io/etcdadm/etcd-manager:v3.0.20220831],SizeBytes:216515768,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:160382894,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.22.16],SizeBytes:129618394,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.22.16],SizeBytes:123306305,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.22.16],SizeBytes:105446599,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.22.16],SizeBytes:53956920,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-alpha.2],SizeBytes:42210956,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-alpha.2],SizeBytes:41463728,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:28956694,},ContainerImage{Names:[quay.io/cilium/operator@sha256:e2b26376a904190c73498e04bd5c1298a4c5239d50feab024074e4516381890f quay.io/cilium/operator:v1.11.11],SizeBytes:24003684,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-alpha.2],SizeBytes:4954596,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 2 23:40:49.552: INFO: Logging kubelet events for node ip-172-20-40-67.us-west-2.compute.internal Dec 2 23:40:49.616: INFO: Logging pods the kubelet thinks is on node ip-172-20-40-67.us-west-2.compute.internal Dec 2 23:40:49.693: INFO: kube-apiserver-ip-172-20-40-67.us-west-2.compute.internal started at 2022-12-02 23:14:53 +0000 UTC (0+2 container statuses recorded) Dec 2 23:40:49.693: INFO: Container healthcheck ready: true, restart count 0 Dec 2 23:40:49.693: INFO: Container kube-apiserver ready: true, restart count 1 Dec 2 23:40:49.693: INFO: cilium-operator-587dd66f87-zmwpl started at 2022-12-02 23:16:04 +0000 UTC (0+1 container statuses recorded) Dec 2 23:40:49.693: INFO: Container cilium-operator ready: true, restart count 1 Dec 2 23:40:49.693: INFO: ebs-csi-controller-764b64d679-rnjp4 started at 2022-12-02 23:16:04 +0000 UTC (0+5 container statuses recorded) Dec 2 23:40:49.693: INFO: Container csi-attacher ready: true, restart count 0 Dec 2 23:40:49.693: INFO: Container csi-provisioner ready: true, restart count 0 Dec 2 23:40:49.693: INFO: Container csi-resizer ready: true, restart count 0 Dec 2 23:40:49.693: INFO: Container ebs-plugin ready: true, restart count 0 Dec 2 23:40:49.693: INFO: Container liveness-probe ready: true, restart count 0 Dec 2 23:40:49.693: INFO: cilium-t57cd started at 2022-12-02 23:16:04 +0000 UTC (1+1 container statuses recorded) Dec 2 23:40:49.693: INFO: Init container clean-cilium-state ready: true, restart count 0 Dec 2 23:40:49.693: INFO: Container cilium-agent ready: true, restart count 1 Dec 2 23:40:49.693: INFO: kops-controller-47skn started at 2022-12-02 23:16:04 +0000 UTC (0+1 container statuses recorded) Dec 2 23:40:49.693: INFO: Container kops-controller ready: true, restart count 0 Dec 2 23:40:49.693: INFO: dns-controller-5fb778d9d5-fln22 started at 2022-12-02 23:16:04 +0000 UTC (0+1 container statuses recorded) Dec 2 23:40:49.693: INFO: Container dns-controller ready: true, restart count 0 Dec 2 23:40:49.693: INFO: etcd-manager-main-ip-172-20-40-67.us-west-2.compute.internal started at 2022-12-02 23:14:53 +0000 UTC (0+1 container statuses recorded) Dec 2 23:40:49.693: INFO: Container etcd-manager ready: true, restart count 0 Dec 2 23:40:49.693: INFO: kube-controller-manager-ip-172-20-40-67.us-west-2.compute.internal started at 2022-12-02 23:14:53 +0000 UTC (0+1 container statuses recorded) Dec 2 23:40:49.693: INFO: Container kube-controller-manager ready: true, restart count 2 Dec 2 23:40:49.693: INFO: kube-scheduler-ip-172-20-40-67.us-west-2.compute.internal started at 2022-12-02 23:14:53 +0000 UTC (0+1 container statuses recorded) Dec 2 23:40:49.693: INFO: Container kube-scheduler ready: true, restart count 0 Dec 2 23:40:49.693: INFO: etcd-manager-events-ip-172-20-40-67.us-west-2.compute.internal started at 2022-12-02 23:14:53 +0000 UTC (0+1 container statuses recorded) Dec 2 23:40:49.693: INFO: Container etcd-manager ready: true, restart count 0 Dec 2 23:40:49.693: INFO: ebs-csi-node-jt6f2 started at 2022-12-02 23:16:04 +0000 UTC (0+3 container statuses recorded) Dec 2 23:40:49.693: INFO: Container ebs-plugin ready: true, restart count 0 Dec 2 23:40:49.693: INFO: Container liveness-probe ready: true, restart count 0 Dec 2 23:40:49.693: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 2 23:40:49.960: INFO: Latency metrics for node ip-172-20-40-67.us-west-2.compute.internal Dec 2 23:40:49.960: INFO: Logging node info for node ip-172-20-41-32.us-west-2.compute.internal Dec 2 23:40:50.023: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-41-32.us-west-2.compute.internal ad6a9fcc-418f-4c1a-a9c7-ac1873b8a1ba 31853 0 2022-12-02 23:17:23 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-41-32.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:node mounted_volume_expand:mounted-volume-expand-6871 node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:ip-172-20-41-32.us-west-2.compute.internal topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-2245":"ip-172-20-41-32.us-west-2.compute.internal","ebs.csi.aws.com":"i-00d261efdd8c07a99"} io.cilium.network.ipv4-cilium-host:172.20.50.121 io.cilium.network.ipv4-health-ip:172.20.47.106 io.cilium.network.ipv4-pod-cidr:100.96.3.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2022-12-02 23:17:23 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-12-02 23:17:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2022-12-02 23:17:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {cilium-agent Update v1 2022-12-02 23:17:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-12-02 23:17:51 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {e2e.test Update v1 2022-12-02 23:29:34 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:mounted_volume_expand":{}}}} } {kubelet Update v1 2022-12-02 23:30:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2022-12-02 23:30:44 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-00d261efdd8c07a99,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-02 23:17:51 +0000 UTC,LastTransitionTime:2022-12-02 23:17:51 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-02 23:40:34 +0000 UTC,LastTransitionTime:2022-12-02 23:17:23 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-02 23:40:34 +0000 UTC,LastTransitionTime:2022-12-02 23:17:23 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-02 23:40:34 +0000 UTC,LastTransitionTime:2022-12-02 23:17:23 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-02 23:40:34 +0000 UTC,LastTransitionTime:2022-12-02 23:17:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.41.32,},NodeAddress{Type:ExternalIP,Address:35.88.26.86,},NodeAddress{Type:Hostname,Address:ip-172-20-41-32.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-41-32.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-88-26-86.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2624f500a45f29b52ed8b5d778f035,SystemUUID:ec2624f5-00a4-5f29-b52e-d8b5d778f035,BootID:b76bd51c-e57a-47b9-86f2-c1093a033e09,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.13,KubeletVersion:v1.22.16,KubeProxyVersion:v1.22.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:160382894,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:702a992280fb7c3303e84a5801acbb4c9c7fcf48cffe0e9c8be3f0c60f74cf89 k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.4],SizeBytes:112029652,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.22.16],SizeBytes:105446599,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:716d2f68314c5c4ddd5ecdb45183fcb4ed8019015982c1321571f863989b70b0 k8s.gcr.io/e2e-test-images/httpd:2.4.39-1],SizeBytes:41902332,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:b913fa234cc3473cfe16e937d106b455a7609f927f59031c81aca791e2689b50 k8s.gcr.io/e2e-test-images/httpd:2.4.38-1],SizeBytes:40765006,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:28956694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:1b7c978a792a8fa4e96244e8059bd71bb49b07e2e5a897fb0c867bdc6db20d5d k8s.gcr.io/sig-storage/livenessprobe:v2.3.0],SizeBytes:7933739,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:503b7abb89e57383eba61cc8a9cb0b495ea575c516108f7d972a6ff6e1ab3c9b k8s.gcr.io/e2e-test-images/nginx:1.14-1],SizeBytes:6979365,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac k8s.gcr.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:1ff6c18fbef2045af6b9c16bf034cc421a29027b800e4f9b68ae9b1cb3e9ae07 k8s.gcr.io/pause:3.5],SizeBytes:301416,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-00e603f65a9c9071b],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-00e603f65a9c9071b,DevicePath:,},},Config:nil,},} Dec 2 23:40:50.024: INFO: Logging kubelet events for node ip-172-20-41-32.us-west-2.compute.internal Dec 2 23:40:50.089: INFO: Logging pods the kubelet thinks is on node ip-172-20-41-32.us-west-2.compute.internal Dec 2 23:40:50.164: INFO: pod-1 started at 2022-12-02 23:31:10 +0000 UTC (0+1 container statuses recorded) Dec 2 23:40:50.164: INFO: Container donothing ready: false, restart count 0 Dec 2 23:40:50.164: INFO: ss-0 started at 2022-12-02 23:36:09 +0000 UTC (0+1 container statuses recorded) Dec 2 23:40:50.164: INFO: Container webserver ready: false, restart count 0 Dec 2 23:40:50.164: INFO: proxy-service-wwzjp-csn2s started at 2022-12-02 23:38:59 +0000 UTC (0+1 container statuses recorded) Dec 2 23:40:50.164: INFO: Container proxy-service-wwzjp ready: true, restart count 0 Dec 2 23:40:50.164: INFO: test-rollover-controller-wxkjb started at 2022-12-02 23:35:19 +0000 UTC (0+1 container statuses recorded) Dec 2 23:40:50.164: INFO: Container httpd ready: true, restart count 0 Dec 2 23:40:50.164: INFO: netserver-1 started at 2022-12-02 23:38:46 +0000 UTC (0+1 container statuses recorded) Dec 2 23:40:50.164: INFO: Container webserver ready: false, restart count 0 Dec 2 23:40:50.164: INFO: cilium-m9r5q started at 2022-12-02 23:17:24 +0000 UTC (1+1 container statuses recorded) Dec 2 23:40:50.164: INFO: Init container clean-cilium-state ready: true, restart count 0 Dec 2 23:40:50.164: INFO: Container cilium-agent ready: true, restart count 0 Dec 2 23:40:50.164: INFO: inline-volume-tester-zc874 started at 2022-12-02 23:38:57 +0000 UTC (0+1 container statuses recorded) Dec 2 23:40:50.164: INFO: Container csi-volume-tester ready: true, restart count 0 Dec 2 23:40:50.164: INFO: pfpod started at 2022-12-02 23:38:29 +0000 UTC (0+2 container statuses recorded) Dec 2 23:40:50.164: INFO: Container portforwardtester ready: true, restart count 0 Dec 2 23:40:50.164: INFO: Container readiness ready: true, restart count 0 Dec 2 23:40:50.164: INFO: send-events-c13dc0ff-64a2-4072-9adb-bb67dd404742 started at 2022-12-02 23:39:16 +0000 UTC (0+1 container statuses recorded) Dec 2 23:40:50.164: INFO: Container p ready: false, restart count 0 Dec 2 23:40:50.164: INFO: ebs-csi-node-c27hl started at 2022-12-02 23:17:24 +0000 UTC (0+3 container statuses recorded) Dec 2 23:40:50.164: INFO: Container ebs-plugin ready: true, restart count 0 Dec 2 23:40:50.164: INFO: Container liveness-probe ready: true, restart count 0 Dec 2 23:40:50.164: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 2 23:40:50.164: INFO: csi-mockplugin-0 started at 2022-12-02 23:36:30 +0000 UTC (0+4 container statuses recorded) Dec 2 23:40:50.164: INFO: Container busybox ready: true, restart count 0 Dec 2 23:40:50.164: INFO: Container csi-provisioner ready: true, restart count 0 Dec 2 23:40:50.164: INFO: Container driver-registrar ready: true, restart count 0 Dec 2 23:40:50.164: INFO: Container mock ready: true, restart count 0 Dec 2 23:40:50.164: INFO: ss2-0 started at 2022-12-02 23:33:41 +0000 UTC (0+1 container statuses recorded) Dec 2 23:40:50.164: INFO: Container webserver ready: false, restart count 0 Dec 2 23:40:50.164: INFO: csi-hostpathplugin-0 started at 2022-12-02 23:38:57 +0000 UTC (0+7 container statuses recorded) Dec 2 23:40:50.164: INFO: Container csi-attacher ready: true, restart count 0 Dec 2 23:40:50.164: INFO: Container csi-provisioner ready: true, restart count 0 Dec 2 23:40:50.164: INFO: Container csi-resizer ready: true, restart count 0 Dec 2 23:40:50.164: INFO: Container csi-snapshotter ready: true, restart count 0 Dec 2 23:40:50.164: INFO: Container hostpath ready: true, restart count 0 Dec 2 23:40:50.164: INFO: Container liveness-probe ready: true, restart count 0 Dec 2 23:40:50.164: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 2 23:40:50.164: INFO: externalname-service-6rb48 started at 2022-12-02 23:35:40 +0000 UTC (0+1 container statuses recorded) Dec 2 23:40:50.164: INFO: Container externalname-service ready: true, restart count 0 Dec 2 23:40:50.164: INFO: netserver-1 started at 2022-12-02 23:40:18 +0000 UTC (0+1 container statuses recorded) Dec 2 23:40:50.164: INFO: Container webserver ready: false, restart count 0 Dec 2 23:40:50.740: INFO: Latency metrics for node ip-172-20-41-32.us-west-2.compute.internal Dec 2 23:40:50.740: INFO: Logging node info for node ip-172-20-43-150.us-west-2.compute.internal Dec 2 23:40:50.833: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-43-150.us-west-2.compute.internal 47bb1581-dcdc-4edf-b2c4-109aedb2f5bd 31856 0 2022-12-02 23:17:23 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-43-150.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:ip-172-20-43-150.us-west-2.compute.internal topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0e2e5350f5754b178"} io.cilium.network.ipv4-cilium-host:172.20.35.108 io.cilium.network.ipv4-health-ip:172.20.34.31 io.cilium.network.ipv4-pod-cidr:100.96.4.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2022-12-02 23:17:23 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-12-02 23:17:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2022-12-02 23:17:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {cilium-agent Update v1 2022-12-02 23:17:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-12-02 23:17:51 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-12-02 23:37:23 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2022-12-02 23:37:24 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-0e2e5350f5754b178,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-02 23:17:51 +0000 UTC,LastTransitionTime:2022-12-02 23:17:51 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-02 23:37:24 +0000 UTC,LastTransitionTime:2022-12-02 23:17:23 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-02 23:37:24 +0000 UTC,LastTransitionTime:2022-12-02 23:17:23 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-02 23:37:24 +0000 UTC,LastTransitionTime:2022-12-02 23:17:23 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-02 23:37:24 +0000 UTC,LastTransitionTime:2022-12-02 23:17:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.43.150,},NodeAddress{Type:ExternalIP,Address:54.184.249.63,},NodeAddress{Type:Hostname,Address:ip-172-20-43-150.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-43-150.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-184-249-63.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23a85d6d7b80ff12e03e51b1effc11,SystemUUID:ec23a85d-6d7b-80ff-12e0-3e51b1effc11,BootID:72904f56-1058-4b24-85d2-c465d1149ad1,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.13,KubeletVersion:v1.22.16,KubeProxyVersion:v1.22.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:160382894,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:702a992280fb7c3303e84a5801acbb4c9c7fcf48cffe0e9c8be3f0c60f74cf89 k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.4],SizeBytes:112029652,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.22.16],SizeBytes:105446599,},ContainerImage{Names:[docker.io/library/nginx@sha256:e209ac2f37c70c1e0e9873a5f7231e91dcd83fdf1178d8ed36c2ec09974210ba docker.io/library/nginx:latest],SizeBytes:56833911,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:1f36a24cfb5e0c3f725d7565a867c2384282fcbeccc77b07b423c9da95763a9a k8s.gcr.io/e2e-test-images/nautilus:1.4],SizeBytes:49230179,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:716d2f68314c5c4ddd5ecdb45183fcb4ed8019015982c1321571f863989b70b0 k8s.gcr.io/e2e-test-images/httpd:2.4.39-1],SizeBytes:41902332,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:b913fa234cc3473cfe16e937d106b455a7609f927f59031c81aca791e2689b50 k8s.gcr.io/e2e-test-images/httpd:2.4.38-1],SizeBytes:40765006,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:28956694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a k8s.gcr.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf k8s.gcr.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:1b7c978a792a8fa4e96244e8059bd71bb49b07e2e5a897fb0c867bdc6db20d5d k8s.gcr.io/sig-storage/livenessprobe:v2.3.0],SizeBytes:7933739,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:503b7abb89e57383eba61cc8a9cb0b495ea575c516108f7d972a6ff6e1ab3c9b k8s.gcr.io/e2e-test-images/nginx:1.14-1],SizeBytes:6979365,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac k8s.gcr.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:1ff6c18fbef2045af6b9c16bf034cc421a29027b800e4f9b68ae9b1cb3e9ae07 k8s.gcr.io/pause:3.5],SizeBytes:301416,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0e3ce9fcd443ccc35],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0e3ce9fcd443ccc35,DevicePath:,},},Config:nil,},} Dec 2 23:40:50.834: INFO: Logging kubelet events for node ip-172-20-43-150.us-west-2.compute.internal Dec 2 23:40:50.915: INFO: Logging pods the kubelet thinks is on node ip-172-20-43-150.us-west-2.compute.internal Dec 2 23:40:50.984: INFO: cilium-7h427 started at 2022-12-02 23:17:24 +0000 UTC (1+1 container statuses recorded) Dec 2 23:40:50.984: INFO: Init container clean-cilium-state ready: true, restart count 0 Dec 2 23:40:50.984: INFO: Container cilium-agent ready: true, restart count 0 Dec 2 23:40:50.984: INFO: externalname-service-vqt5p started at 2022-12-02 23:35:40 +0000 UTC (0+1 container statuses recorded) Dec 2 23:40:50.984: INFO: Container externalname-service ready: true, restart count 0 Dec 2 23:40:50.984: INFO: pod-2 started at 2022-12-02 23:31:10 +0000 UTC (0+1 container statuses recorded) Dec 2 23:40:50.984: INFO: Container donothing ready: true, restart count 0 Dec 2 23:40:50.984: INFO: netserver-2 started at 2022-12-02 23:40:18 +0000 UTC (0+1 container statuses recorded) Dec 2 23:40:50.984: INFO: Container webserver ready: false, restart count 0 Dec 2 23:40:50.984: INFO: ebs-csi-node-8qrwx started at 2022-12-02 23:17:24 +0000 UTC (0+3 container statuses recorded) Dec 2 23:40:50.984: INFO: Container ebs-plugin ready: true, restart count 0 Dec 2 23:40:50.984: INFO: Container liveness-probe ready: true, restart count 0 Dec 2 23:40:50.984: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 2 23:40:50.984: INFO: test-rollover-deployment-67bbb7bc8-sdxv6 started at 2022-12-02 23:36:16 +0000 UTC (0+1 container statuses recorded) Dec 2 23:40:50.984: INFO: Container agnhost ready: true, restart count 0 Dec 2 23:40:50.984: INFO: netserver-2 started at 2022-12-02 23:38:46 +0000 UTC (0+1 container statuses recorded) Dec 2 23:40:50.984: INFO: Container webserver ready: false, restart count 0 Dec 2 23:40:50.984: INFO: pod-0 started at 2022-12-02 23:31:10 +0000 UTC (0+1 container statuses recorded) Dec 2 23:40:50.984: INFO: Container donothing ready: false, restart count 0 Dec 2 23:40:50.984: INFO: sample-webhook-deployment-5d5bc8ffd5-swpl8 started at 2022-12-02 23:40:12 +0000 UTC (0+1 container statuses recorded) Dec 2 23:40:50.984: INFO: Container sample-webhook ready: true, restart count 0 Dec 2 23:40:50.984: INFO: ss2-1 started at <nil> (0+0 container statuses recorded) Dec 2 23:40:51.334: INFO: Latency metrics for node ip-172-20-43-150.us-west-2.compute.internal Dec 2 23:40:51.334: INFO: Logging node info for node ip-172-20-48-5.us-west-2.compute.internal Dec 2 23:40:51.401: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-48-5.us-west-2.compute.internal 6342e9b6-e818-4fbf-aae7-8be176fd4ec1 31863 0 2022-12-02 23:17:21 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-48-5.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:ip-172-20-48-5.us-west-2.compute.internal topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0093900b92d415e84"} io.cilium.network.ipv4-cilium-host:172.20.42.98 io.cilium.network.ipv4-health-ip:172.20.44.82 io.cilium.network.ipv4-pod-cidr:100.96.2.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-12-02 23:17:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2022-12-02 23:17:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2022-12-02 23:17:22 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {cilium-agent Update v1 2022-12-02 23:17:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-12-02 23:17:52 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-12-02 23:36:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-0093900b92d415e84,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-02 23:17:52 +0000 UTC,LastTransitionTime:2022-12-02 23:17:52 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-02 23:36:03 +0000 UTC,LastTransitionTime:2022-12-02 23:17:21 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-02 23:36:03 +0000 UTC,LastTransitionTime:2022-12-02 23:17:21 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-02 23:36:03 +0000 UTC,LastTransitionTime:2022-12-02 23:17:21 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-02 23:36:03 +0000 UTC,LastTransitionTime:2022-12-02 23:17:42 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.48.5,},NodeAddress{Type:ExternalIP,Address:34.213.188.181,},NodeAddress{Type:Hostname,Address:ip-172-20-48-5.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-48-5.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-34-213-188-181.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2ecd9e359fbd979ba14c48724d474b,SystemUUID:ec2ecd9e-359f-bd97-9ba1-4c48724d474b,BootID:3d1b1479-a710-49bb-96b3-2764890e8166,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.13,KubeletVersion:v1.22.16,KubeProxyVersion:v1.22.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:160382894,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.22.16],SizeBytes:105446599,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:716d2f68314c5c4ddd5ecdb45183fcb4ed8019015982c1321571f863989b70b0 k8s.gcr.io/e2e-test-images/httpd:2.4.39-1],SizeBytes:41902332,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:b913fa234cc3473cfe16e937d106b455a7609f927f59031c81aca791e2689b50 k8s.gcr.io/e2e-test-images/httpd:2.4.38-1],SizeBytes:40765006,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:28956694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a k8s.gcr.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:1b7c978a792a8fa4e96244e8059bd71bb49b07e2e5a897fb0c867bdc6db20d5d k8s.gcr.io/sig-storage/livenessprobe:v2.3.0],SizeBytes:7933739,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:503b7abb89e57383eba61cc8a9cb0b495ea575c516108f7d972a6ff6e1ab3c9b k8s.gcr.io/e2e-test-images/nginx:1.14-1],SizeBytes:6979365,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:1ff6c18fbef2045af6b9c16bf034cc421a29027b800e4f9b68ae9b1cb3e9ae07 k8s.gcr.io/pause:3.5],SizeBytes:301416,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 2 23:40:51.401: INFO: Logging kubelet events for node ip-172-20-48-5.us-west-2.compute.internal Dec 2 23:40:51.473: INFO: Logging pods the kubelet thinks is on node ip-172-20-48-5.us-west-2.compute.internal Dec 2 23:40:51.540: INFO: netserver-3 started at 2022-12-02 23:40:18 +0000 UTC (0+1 container statuses recorded) Dec 2 23:40:51.540: INFO: Container webserver ready: true, restart count 0 Dec 2 23:40:51.540: INFO: test-new-deployment-847dcfb7fb-f2rtx started at 2022-12-02 23:40:47 +0000 UTC (0+1 container statuses recorded) Dec 2 23:40:51.540: INFO: Container httpd ready: true, restart count 0 Dec 2 23:40:51.540: INFO: ebs-csi-node-bcx5m started at 2022-12-02 23:17:22 +0000 UTC (0+3 container statuses recorded) Dec 2 23:40:51.540: INFO: Container ebs-plugin ready: true, restart count 0 Dec 2 23:40:51.540: INFO: Container liveness-probe ready: true, restart count 0 Dec 2 23:40:51.540: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 2 23:40:51.540: INFO: coredns-5fcc7b6498-clxp8 started at 2022-12-02 23:17:58 +0000 UTC (0+1 container statuses recorded) Dec 2 23:40:51.540: INFO: Container coredns ready: true, restart count 0 Dec 2 23:40:51.540: INFO: cilium-ftssb started at 2022-12-02 23:17:22 +0000 UTC (1+1 container statuses recorded) Dec 2 23:40:51.540: INFO: Init container clean-cilium-state ready: true, restart count 0 Dec 2 23:40:51.540: INFO: Container cilium-agent ready: true, restart count 0 Dec 2 23:40:51.540: INFO: test-rolling-update-deployment-54955647cf-gcr5r started at 2022-12-02 23:40:45 +0000 UTC (0+1 container statuses recorded) Dec 2 23:40:51.540: INFO: Container agnhost ready: true, restart count 0 Dec 2 23:40:51.540: INFO: pod-af5d7dc8-3fa0-4b7b-af95-8e1e74d35e27 started at 2022-12-02 23:40:31 +0000 UTC (0+1 container statuses recorded) Dec 2 23:40:51.540: INFO: Container test-container ready: false, restart count 0 Dec 2 23:40:51.540: INFO: netserver-3 started at 2022-12-02 23:38:46 +0000 UTC (0+1 container statuses recorded) Dec 2 23:40:51.540: INFO: Container webserver ready: false, restart count 0 Dec 2 23:40:51.540: INFO: terminate-cmd-rpof8fee9993-7a90-4afd-b1c9-a92ca3cec5cc started at 2022-12-02 23:40:46 +0000 UTC (0+1 container statuses recorded) Dec 2 23:40:51.540: INFO: Container terminate-cmd-rpof ready: false, restart count 1 Dec 2 23:40:51.540: INFO: hostexec-ip-172-20-48-5.us-west-2.compute.internal-hcv56 started at 2022-12-02 23:40:51 +0000 UTC (0+1 container statuses recorded) Dec 2 23:40:51.540: INFO: Container agnhost-container ready: false, restart count 0 Dec 2 23:40:52.096: INFO: Latency metrics for node ip-172-20-48-5.us-west-2.compute.internal Dec 2 23:40:52.096: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "volume-expand-3868" for this suite.
Find for mentions in log files
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-apps\]\sCronJob\sshould\sdelete\ssuccessful\sfinished\sjobs\swith\slimit\sof\sone\ssuccessful\sjob$'
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/cronjob.go:278 Dec 2 23:38:56.501: Failed to ensure a finished cronjob exists in namespace cronjob-155 Unexpected error: <*errors.errorString | 0xc000248290>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/cronjob.go:475from junit_23.xml
[BeforeEach] [sig-apps] CronJob /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Dec 2 23:33:55.981: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename cronjob �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [It] should delete successful finished jobs with limit of one successful job /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/cronjob.go:278 �[1mSTEP�[0m: Creating an AllowConcurrent cronjob with custom history limit �[1mSTEP�[0m: Ensuring a finished job exists Dec 2 23:38:56.501: FAIL: Failed to ensure a finished cronjob exists in namespace cronjob-155 Unexpected error: <*errors.errorString | 0xc000248290>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/apps.ensureHistoryLimits(0x7973fe8, 0xc00139ac60, 0xc00323f690, 0xb, 0xc000ff6600) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/cronjob.go:475 +0x271 k8s.io/kubernetes/test/e2e/apps.glob..func1.8() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/cronjob.go:285 +0x145 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc000847200) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x36c k8s.io/kubernetes/test/e2e.TestE2E(0xc000847200) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:136 +0x2b testing.tRunner(0xc000847200, 0x729c8b8) /usr/local/go/src/testing/testing.go:1203 +0xe5 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1248 +0x2b3 [AfterEach] [sig-apps] CronJob /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "cronjob-155". �[1mSTEP�[0m: Found 59 events. Dec 2 23:38:56.568: INFO: At 2022-12-02 23:34:00 +0000 UTC - event for successful-jobs-history-limit: {cronjob-controller } SuccessfulCreate: Created job successful-jobs-history-limit-27833734 Dec 2 23:38:56.568: INFO: At 2022-12-02 23:34:00 +0000 UTC - event for successful-jobs-history-limit-27833734: {job-controller } SuccessfulCreate: Created pod: successful-jobs-history-limit-27833734-6hlrt Dec 2 23:38:56.568: INFO: At 2022-12-02 23:34:00 +0000 UTC - event for successful-jobs-history-limit-27833734-6hlrt: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d4239a43fa83ecf4eb6abe95192efbbd663f7b7462bd3354647af8ea4989cd04": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:56.568: INFO: At 2022-12-02 23:34:00 +0000 UTC - event for successful-jobs-history-limit-27833734-6hlrt: {default-scheduler } Scheduled: Successfully assigned cronjob-155/successful-jobs-history-limit-27833734-6hlrt to ip-172-20-41-32.us-west-2.compute.internal Dec 2 23:38:56.568: INFO: At 2022-12-02 23:34:12 +0000 UTC - event for successful-jobs-history-limit-27833734-6hlrt: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "fe72ae512d739ee7fe9076da70df702dd7f72f909ff4f2d405073f1b2df256d9": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:56.568: INFO: At 2022-12-02 23:34:25 +0000 UTC - event for successful-jobs-history-limit-27833734-6hlrt: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "eb29f6dccdc3e4423cd5183fa1ef5bff5e06adb0dadf0ac39ca0ffc5bc1a02b5": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:56.568: INFO: At 2022-12-02 23:34:38 +0000 UTC - event for successful-jobs-history-limit-27833734-6hlrt: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "cbb3473f986d293a87b830d7fa7fa852611cb1457d30b4483b92951d4df69efc": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:56.568: INFO: At 2022-12-02 23:34:54 +0000 UTC - event for successful-jobs-history-limit-27833734-6hlrt: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "9da1142c1c5d9a5aafd4099842d1ae307c9f5e2c200b619247c42eb333159dec": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:56.568: INFO: At 2022-12-02 23:35:00 +0000 UTC - event for successful-jobs-history-limit: {cronjob-controller } SuccessfulCreate: Created job successful-jobs-history-limit-27833735 Dec 2 23:38:56.568: INFO: At 2022-12-02 23:35:00 +0000 UTC - event for successful-jobs-history-limit-27833735: {job-controller } SuccessfulCreate: Created pod: successful-jobs-history-limit-27833735-zz4t9 Dec 2 23:38:56.568: INFO: At 2022-12-02 23:35:00 +0000 UTC - event for successful-jobs-history-limit-27833735-zz4t9: {default-scheduler } Scheduled: Successfully assigned cronjob-155/successful-jobs-history-limit-27833735-zz4t9 to ip-172-20-41-32.us-west-2.compute.internal Dec 2 23:38:56.568: INFO: At 2022-12-02 23:35:00 +0000 UTC - event for successful-jobs-history-limit-27833735-zz4t9: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "2728848e5a90d650b0e62eab38d611ba9a731cadef525cb8d5f93959d625c1c7": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:56.568: INFO: At 2022-12-02 23:35:09 +0000 UTC - event for successful-jobs-history-limit-27833734-6hlrt: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "000caf2971f6f67de9809587418bff6ec484cc52c9a4412339243aceef33502e": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:56.568: INFO: At 2022-12-02 23:35:12 +0000 UTC - event for successful-jobs-history-limit-27833735-zz4t9: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "faec45b5ec4642f740828fbb46f977b53ce4ea94a2b0a3bd847ed8e17a3e7908": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:56.568: INFO: At 2022-12-02 23:35:21 +0000 UTC - event for successful-jobs-history-limit-27833734-6hlrt: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "1429d0bf0becb3b7e6bf0bbe6388adfe6e815fd9cbab320578267cb6d40cb64e": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:56.568: INFO: At 2022-12-02 23:35:27 +0000 UTC - event for successful-jobs-history-limit-27833735-zz4t9: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "0431dc3d79bbdf86a0dcdc94128d53722cd1601c8719ee0ffa9657518af4fb87": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:56.568: INFO: At 2022-12-02 23:35:32 +0000 UTC - event for successful-jobs-history-limit-27833734-6hlrt: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "bad43b7be81da072e3fcd398a296a82964ea7ea240d28e30e5930e32a6a657a3": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:56.568: INFO: At 2022-12-02 23:35:39 +0000 UTC - event for successful-jobs-history-limit-27833735-zz4t9: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "4ee00f0a8844a4c70a7713e7fd9936638b81401b4b09bc6bf129083171facbd4": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:56.568: INFO: At 2022-12-02 23:35:46 +0000 UTC - event for successful-jobs-history-limit-27833734-6hlrt: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "22efbab60a1eae4ea8be23b4c13507e9b02addbe90ec48d33368af57ce122b07": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:56.568: INFO: At 2022-12-02 23:35:54 +0000 UTC - event for successful-jobs-history-limit-27833735-zz4t9: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d5cccf0959ba1e40c49fb93f7ee41832ef0baa7dfedf85109fcd016934820e01": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:56.568: INFO: At 2022-12-02 23:35:58 +0000 UTC - event for successful-jobs-history-limit-27833734-6hlrt: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "9d1d48f3dd2905040d375b5951b4fba91cdd0457c9ec19e349962052b503ef95": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:56.568: INFO: At 2022-12-02 23:36:00 +0000 UTC - event for successful-jobs-history-limit: {cronjob-controller } SuccessfulCreate: Created job successful-jobs-history-limit-27833736 Dec 2 23:38:56.568: INFO: At 2022-12-02 23:36:00 +0000 UTC - event for successful-jobs-history-limit-27833736: {job-controller } SuccessfulCreate: Created pod: successful-jobs-history-limit-27833736-64b8r Dec 2 23:38:56.568: INFO: At 2022-12-02 23:36:00 +0000 UTC - event for successful-jobs-history-limit-27833736-64b8r: {default-scheduler } Scheduled: Successfully assigned cronjob-155/successful-jobs-history-limit-27833736-64b8r to ip-172-20-41-32.us-west-2.compute.internal Dec 2 23:38:56.568: INFO: At 2022-12-02 23:36:00 +0000 UTC - event for successful-jobs-history-limit-27833736-64b8r: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "fbd43e5ace4b0bee3a9d75ec5fa8374954e72db63ca3363a3f742817ef7dbcf1": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:56.568: INFO: At 2022-12-02 23:36:07 +0000 UTC - event for successful-jobs-history-limit-27833735-zz4t9: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "387e8c367be8115be99b367a6fc8bd4523151d87a2c228d228e1b6975d9048b9": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:56.568: INFO: At 2022-12-02 23:36:15 +0000 UTC - event for successful-jobs-history-limit-27833736-64b8r: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "c44ef7c6caca0be3aae3d1733949cf3608f2a9422211981b13732f40c01ff533": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:56.568: INFO: At 2022-12-02 23:36:21 +0000 UTC - event for successful-jobs-history-limit-27833735-zz4t9: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "0a424c57b9b7bc2eca668194621eb7c383796978960854f8f1b1cefdba549525": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:56.568: INFO: At 2022-12-02 23:36:28 +0000 UTC - event for successful-jobs-history-limit-27833736-64b8r: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "dc21a10b9f8839573f95bca7d23a86f8f5c3b5da61aea7b9fdda526f72c46bd5": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:56.568: INFO: At 2022-12-02 23:36:33 +0000 UTC - event for successful-jobs-history-limit-27833735-zz4t9: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "bb7284bd2f00b3b91304797165e877e8af921c6eccc6647af6f832c2c43c743a": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:56.568: INFO: At 2022-12-02 23:36:40 +0000 UTC - event for successful-jobs-history-limit-27833736-64b8r: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "fbdc40ee78780e16e07af82de922e0ba96ad6cc826dcbf531c71822c94940bda": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:56.568: INFO: At 2022-12-02 23:36:46 +0000 UTC - event for successful-jobs-history-limit-27833735-zz4t9: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "9122aaaf275bfa97d8f87956c884c41ef392b445aa6c82a654ae060ab8b88278": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:56.568: INFO: At 2022-12-02 23:36:52 +0000 UTC - event for successful-jobs-history-limit-27833736-64b8r: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e8d9e5b5576d6ccb8b918e6fd860ba9573490816be4a4a971f4d7e9cad8f9ac1": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:56.568: INFO: At 2022-12-02 23:37:00 +0000 UTC - event for successful-jobs-history-limit: {cronjob-controller } SuccessfulCreate: Created job successful-jobs-history-limit-27833737 Dec 2 23:38:56.568: INFO: At 2022-12-02 23:37:00 +0000 UTC - event for successful-jobs-history-limit-27833735-zz4t9: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "93956ce8af1a1bb1ccfc19a8178014cd639eeaf7814cfb859955b707b9b2f18e": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:56.568: INFO: At 2022-12-02 23:37:00 +0000 UTC - event for successful-jobs-history-limit-27833737: {job-controller } SuccessfulCreate: Created pod: successful-jobs-history-limit-27833737-7g5g4 Dec 2 23:38:56.568: INFO: At 2022-12-02 23:37:00 +0000 UTC - event for successful-jobs-history-limit-27833737-7g5g4: {default-scheduler } Scheduled: Successfully assigned cronjob-155/successful-jobs-history-limit-27833737-7g5g4 to ip-172-20-41-32.us-west-2.compute.internal Dec 2 23:38:56.568: INFO: At 2022-12-02 23:37:00 +0000 UTC - event for successful-jobs-history-limit-27833737-7g5g4: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "1d33a95482d72550b6fffee7a349ae143a1e273b20a561b4128e9e6bc5a61c93": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:56.568: INFO: At 2022-12-02 23:37:03 +0000 UTC - event for successful-jobs-history-limit-27833736-64b8r: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "6b9475e28065d9dd7cf177b0ec089d8b7d866dc8e6b4fca34a8317f587090951": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:56.568: INFO: At 2022-12-02 23:37:13 +0000 UTC - event for successful-jobs-history-limit-27833737-7g5g4: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "af6bd5d4335e9398c9d9120f6f817599ca1bd9684f090a1d72d2f0c4a1753eba": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:56.568: INFO: At 2022-12-02 23:37:16 +0000 UTC - event for successful-jobs-history-limit-27833736-64b8r: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "944e475f86db09f9eb96ef0411fa513744996832d99e911c700749f168383614": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:56.568: INFO: At 2022-12-02 23:37:27 +0000 UTC - event for successful-jobs-history-limit-27833737-7g5g4: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "529ab27a0dbfda292a758348a5be730df1124c2d01f979c8e5f96b0c628f32d2": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:56.568: INFO: At 2022-12-02 23:37:31 +0000 UTC - event for successful-jobs-history-limit-27833736-64b8r: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "2aa7d14029e338341800106182db5d26e803627107fe3039297d50a72acf90f3": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:56.568: INFO: At 2022-12-02 23:37:41 +0000 UTC - event for successful-jobs-history-limit-27833737-7g5g4: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "fb0301bbd4bdc4bedb1a129f3a644bb6091ea63ceed65f0274475eb3c42a7c85": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:56.568: INFO: At 2022-12-02 23:37:44 +0000 UTC - event for successful-jobs-history-limit-27833736-64b8r: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "67f6b4a2b65dce181824a4cae604d41c05b52e7a9797583e8231bf17c4b0136d": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:56.568: INFO: At 2022-12-02 23:37:55 +0000 UTC - event for successful-jobs-history-limit-27833737-7g5g4: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "de9f332531ae36e076e8ee5c6abdb9724cd4dce44df983e6d0c6db9148f74e6c": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:56.568: INFO: At 2022-12-02 23:37:58 +0000 UTC - event for successful-jobs-history-limit-27833736-64b8r: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "7a87541f34ef89546fcd9c0716f518ece14c12c7be0fa92ca1ce91bb561213e2": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:56.568: INFO: At 2022-12-02 23:38:00 +0000 UTC - event for successful-jobs-history-limit: {cronjob-controller } SuccessfulCreate: Created job successful-jobs-history-limit-27833738 Dec 2 23:38:56.568: INFO: At 2022-12-02 23:38:00 +0000 UTC - event for successful-jobs-history-limit-27833738: {job-controller } SuccessfulCreate: Created pod: successful-jobs-history-limit-27833738-bm4dh Dec 2 23:38:56.568: INFO: At 2022-12-02 23:38:00 +0000 UTC - event for successful-jobs-history-limit-27833738-bm4dh: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "34cf8a7aeb351bf1639615912e8c25e0c2bc77ffd5128dad37c153e19d73b2f7": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:56.568: INFO: At 2022-12-02 23:38:00 +0000 UTC - event for successful-jobs-history-limit-27833738-bm4dh: {default-scheduler } Scheduled: Successfully assigned cronjob-155/successful-jobs-history-limit-27833738-bm4dh to ip-172-20-41-32.us-west-2.compute.internal Dec 2 23:38:56.568: INFO: At 2022-12-02 23:38:08 +0000 UTC - event for successful-jobs-history-limit-27833737-7g5g4: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "47977296788f7ba30f001b8990cfe6caf87f548d06ba78c1d04aa2e09988d5ca": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:56.568: INFO: At 2022-12-02 23:38:15 +0000 UTC - event for successful-jobs-history-limit-27833738-bm4dh: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "99d78c04b544e3239abaeffd42a5fd591bccceb7c402c3adecd1b17517200850": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:56.568: INFO: At 2022-12-02 23:38:23 +0000 UTC - event for successful-jobs-history-limit-27833737-7g5g4: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "9a2f5dde500619411e77b48f567bc70e4696026709e42e41f94814576d64a6f7": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:56.568: INFO: At 2022-12-02 23:38:28 +0000 UTC - event for successful-jobs-history-limit-27833738-bm4dh: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "30f219339134d9e9d83cea5a9f86de339b7a244757101a4d2291ac4e5bc9958f": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:56.568: INFO: At 2022-12-02 23:38:34 +0000 UTC - event for successful-jobs-history-limit-27833737-7g5g4: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d5adafe20a6c42264b2d2541ff747e6661f1e6fced90ddf29bf1aadfecec3510": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:56.568: INFO: At 2022-12-02 23:38:40 +0000 UTC - event for successful-jobs-history-limit-27833738-bm4dh: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "1572d4075682a0bdb61e063c8900c99d65b2ed9f628e6a136062886af02350f4": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:56.568: INFO: At 2022-12-02 23:38:46 +0000 UTC - event for successful-jobs-history-limit-27833737-7g5g4: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "3a013102a85a7e3793872f35c386865841552b88deb4c6116ac23b69417a316e": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:56.568: INFO: At 2022-12-02 23:38:53 +0000 UTC - event for successful-jobs-history-limit-27833738-bm4dh: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "8332199909b1361ee56cfd687b4491d24f7070ca0ca3b4cfd1bdb934e26d3ffd": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:56.633: INFO: POD NODE PHASE GRACE CONDITIONS Dec 2 23:38:56.633: INFO: successful-jobs-history-limit-27833734-6hlrt ip-172-20-41-32.us-west-2.compute.internal Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:34:00 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:34:00 +0000 UTC ContainersNotReady containers with unready status: [c]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:34:00 +0000 UTC ContainersNotReady containers with unready status: [c]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:34:00 +0000 UTC }] Dec 2 23:38:56.633: INFO: successful-jobs-history-limit-27833735-zz4t9 ip-172-20-41-32.us-west-2.compute.internal Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:35:00 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:35:00 +0000 UTC ContainersNotReady containers with unready status: [c]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:35:00 +0000 UTC ContainersNotReady containers with unready status: [c]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:35:00 +0000 UTC }] Dec 2 23:38:56.634: INFO: successful-jobs-history-limit-27833736-64b8r ip-172-20-41-32.us-west-2.compute.internal Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:36:00 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:36:00 +0000 UTC ContainersNotReady containers with unready status: [c]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:36:00 +0000 UTC ContainersNotReady containers with unready status: [c]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:36:00 +0000 UTC }] Dec 2 23:38:56.634: INFO: successful-jobs-history-limit-27833737-7g5g4 ip-172-20-41-32.us-west-2.compute.internal Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:37:00 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:37:00 +0000 UTC ContainersNotReady containers with unready status: [c]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:37:00 +0000 UTC ContainersNotReady containers with unready status: [c]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:37:00 +0000 UTC }] Dec 2 23:38:56.634: INFO: successful-jobs-history-limit-27833738-bm4dh ip-172-20-41-32.us-west-2.compute.internal Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:38:00 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:38:00 +0000 UTC ContainersNotReady containers with unready status: [c]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:38:00 +0000 UTC ContainersNotReady containers with unready status: [c]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:38:00 +0000 UTC }] Dec 2 23:38:56.634: INFO: Dec 2 23:38:56.700: INFO: Logging node info for node ip-172-20-33-254.us-west-2.compute.internal Dec 2 23:38:56.765: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-33-254.us-west-2.compute.internal 6236393f-0a33-4aea-a2e2-fedaf7becdd4 29305 0 2022-12-02 23:17:15 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-33-254.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:ip-172-20-33-254.us-west-2.compute.internal topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0d507bb204448139f"} io.cilium.network.ipv4-cilium-host:172.20.42.35 io.cilium.network.ipv4-health-ip:172.20.58.176 io.cilium.network.ipv4-pod-cidr:100.96.1.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2022-12-02 23:17:15 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2022-12-02 23:17:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-12-02 23:17:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {cilium-agent Update v1 2022-12-02 23:17:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-12-02 23:17:41 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {e2e.test Update v1 2022-12-02 23:29:34 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2022-12-02 23:30:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-0d507bb204448139f,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-02 23:17:41 +0000 UTC,LastTransitionTime:2022-12-02 23:17:41 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-02 23:35:16 +0000 UTC,LastTransitionTime:2022-12-02 23:17:15 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-02 23:35:16 +0000 UTC,LastTransitionTime:2022-12-02 23:17:15 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-02 23:35:16 +0000 UTC,LastTransitionTime:2022-12-02 23:17:15 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-02 23:35:16 +0000 UTC,LastTransitionTime:2022-12-02 23:17:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.33.254,},NodeAddress{Type:ExternalIP,Address:54.190.128.11,},NodeAddress{Type:Hostname,Address:ip-172-20-33-254.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-33-254.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-190-128-11.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23ec8dd062be253828b6092e22eaab,SystemUUID:ec23ec8d-d062-be25-3828-b6092e22eaab,BootID:6bbf84c7-41f9-4141-912e-7f3bc9a0ef42,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.13,KubeletVersion:v1.22.16,KubeProxyVersion:v1.22.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:160382894,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.22.16],SizeBytes:105446599,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:1f36a24cfb5e0c3f725d7565a867c2384282fcbeccc77b07b423c9da95763a9a k8s.gcr.io/e2e-test-images/nautilus:1.4],SizeBytes:49230179,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:716d2f68314c5c4ddd5ecdb45183fcb4ed8019015982c1321571f863989b70b0 k8s.gcr.io/e2e-test-images/httpd:2.4.39-1],SizeBytes:41902332,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:b913fa234cc3473cfe16e937d106b455a7609f927f59031c81aca791e2689b50 k8s.gcr.io/e2e-test-images/httpd:2.4.38-1],SizeBytes:40765006,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:28956694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonroot@sha256:4051e85640c22f8e00c34dbd273576fc9e1e2829992656588062be9c0f69b04b k8s.gcr.io/e2e-test-images/nonroot:1.1],SizeBytes:17748448,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:aa60f453d64dfb3c3fd9e7306f988c36c6352c4f2d956aa90467f2808091effa registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.5],SizeBytes:15209420,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:1b7c978a792a8fa4e96244e8059bd71bb49b07e2e5a897fb0c867bdc6db20d5d k8s.gcr.io/sig-storage/livenessprobe:v2.3.0],SizeBytes:7933739,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:503b7abb89e57383eba61cc8a9cb0b495ea575c516108f7d972a6ff6e1ab3c9b k8s.gcr.io/e2e-test-images/nginx:1.14-1],SizeBytes:6979365,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:1ff6c18fbef2045af6b9c16bf034cc421a29027b800e4f9b68ae9b1cb3e9ae07 k8s.gcr.io/pause:3.5],SizeBytes:301416,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 2 23:38:56.766: INFO: Logging kubelet events for node ip-172-20-33-254.us-west-2.compute.internal Dec 2 23:38:56.832: INFO: Logging pods the kubelet thinks is on node ip-172-20-33-254.us-west-2.compute.internal Dec 2 23:38:56.970: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-svqb9 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:56.970: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:56.970: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-pt8v2 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:56.970: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:56.971: INFO: netserver-0 started at 2022-12-02 23:33:50 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:56.971: INFO: Container webserver ready: false, restart count 0 Dec 2 23:38:56.971: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-cf58b started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:56.971: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:56.971: INFO: ebs-csi-node-rfgvb started at 2022-12-02 23:17:16 +0000 UTC (0+3 container statuses recorded) Dec 2 23:38:56.971: INFO: Container ebs-plugin ready: true, restart count 0 Dec 2 23:38:56.971: INFO: Container liveness-probe ready: true, restart count 0 Dec 2 23:38:56.971: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 2 23:38:56.971: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-gfh2n started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:56.971: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:56.971: INFO: hostpath-symlink-prep-provisioning-387 started at 2022-12-02 23:36:51 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:56.971: INFO: Container init-volume-provisioning-387 ready: false, restart count 0 Dec 2 23:38:56.971: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-f2d26 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:56.971: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:56.971: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-jnmvg started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:56.971: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:56.971: INFO: cilium-2db9c started at 2022-12-02 23:17:16 +0000 UTC (1+1 container statuses recorded) Dec 2 23:38:56.971: INFO: Init container clean-cilium-state ready: true, restart count 0 Dec 2 23:38:56.971: INFO: Container cilium-agent ready: true, restart count 0 Dec 2 23:38:56.971: INFO: coredns-5fcc7b6498-8nvj5 started at 2022-12-02 23:17:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:56.971: INFO: Container coredns ready: true, restart count 0 Dec 2 23:38:56.971: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-d4f7q started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:56.971: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:56.971: INFO: netserver-0 started at 2022-12-02 23:35:10 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:56.971: INFO: Container webserver ready: false, restart count 0 Dec 2 23:38:56.971: INFO: netserver-0 started at 2022-12-02 23:38:46 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:56.971: INFO: Container webserver ready: false, restart count 0 Dec 2 23:38:56.971: INFO: coredns-autoscaler-6658b4bf85-4zgd2 started at 2022-12-02 23:17:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:56.971: INFO: Container autoscaler ready: true, restart count 0 Dec 2 23:38:56.971: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-9dq9t started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:56.971: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: false, restart count 0 Dec 2 23:38:56.971: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-t5msn started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:56.971: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:56.971: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-mtms5 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:56.971: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:56.971: INFO: netserver-0 started at 2022-12-02 23:29:40 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:56.971: INFO: Container webserver ready: true, restart count 0 Dec 2 23:38:57.248: INFO: Latency metrics for node ip-172-20-33-254.us-west-2.compute.internal Dec 2 23:38:57.249: INFO: Logging node info for node ip-172-20-40-67.us-west-2.compute.internal Dec 2 23:38:57.314: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-40-67.us-west-2.compute.internal 0a5fe428-9a11-4bd2-96f1-21d4d188f80f 30470 0 2022-12-02 23:15:37 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-40-67.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/control-plane: node-role.kubernetes.io/master: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:us-west-2a topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0725cfbb3e93e664c"} io.cilium.network.ipv4-cilium-host:172.20.59.109 io.cilium.network.ipv4-health-ip:172.20.51.231 io.cilium.network.ipv4-pod-cidr:100.96.0.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-12-02 23:15:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {protokube Update v1 2022-12-02 23:16:01 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kops-controller Update v1 2022-12-02 23:16:07 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/master":{}}}} } {kube-controller-manager Update v1 2022-12-02 23:16:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {cilium-agent Update v1 2022-12-02 23:17:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-12-02 23:17:36 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-12-02 23:17:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-0725cfbb3e93e664c,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892301824 0} {<nil>} 3801076Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787444224 0} {<nil>} 3698676Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-02 23:17:36 +0000 UTC,LastTransitionTime:2022-12-02 23:17:36 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-02 23:38:28 +0000 UTC,LastTransitionTime:2022-12-02 23:15:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-02 23:38:28 +0000 UTC,LastTransitionTime:2022-12-02 23:15:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-02 23:38:28 +0000 UTC,LastTransitionTime:2022-12-02 23:15:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-02 23:38:28 +0000 UTC,LastTransitionTime:2022-12-02 23:16:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.40.67,},NodeAddress{Type:ExternalIP,Address:34.213.81.56,},NodeAddress{Type:Hostname,Address:ip-172-20-40-67.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-40-67.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-34-213-81-56.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2bdc536f1fb98cbe397162835bf7b5,SystemUUID:ec2bdc53-6f1f-b98c-be39-7162835bf7b5,BootID:80f23ad2-0f99-46af-8080-253547cd7440,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.13,KubeletVersion:v1.22.16,KubeProxyVersion:v1.22.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:a91fdaf9b988943a9c73d422348c2383c08dfc2566d4124a39a1b3d785018720 registry.k8s.io/etcdadm/etcd-manager:v3.0.20220831],SizeBytes:216515768,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:160382894,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.22.16],SizeBytes:129618394,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.22.16],SizeBytes:123306305,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.22.16],SizeBytes:105446599,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.22.16],SizeBytes:53956920,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-alpha.2],SizeBytes:42210956,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-alpha.2],SizeBytes:41463728,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:28956694,},ContainerImage{Names:[quay.io/cilium/operator@sha256:e2b26376a904190c73498e04bd5c1298a4c5239d50feab024074e4516381890f quay.io/cilium/operator:v1.11.11],SizeBytes:24003684,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-alpha.2],SizeBytes:4954596,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 2 23:38:57.314: INFO: Logging kubelet events for node ip-172-20-40-67.us-west-2.compute.internal Dec 2 23:38:57.381: INFO: Logging pods the kubelet thinks is on node ip-172-20-40-67.us-west-2.compute.internal Dec 2 23:38:57.451: INFO: etcd-manager-main-ip-172-20-40-67.us-west-2.compute.internal started at 2022-12-02 23:14:53 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:57.452: INFO: Container etcd-manager ready: true, restart count 0 Dec 2 23:38:57.452: INFO: kube-controller-manager-ip-172-20-40-67.us-west-2.compute.internal started at 2022-12-02 23:14:53 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:57.452: INFO: Container kube-controller-manager ready: true, restart count 2 Dec 2 23:38:57.452: INFO: kube-scheduler-ip-172-20-40-67.us-west-2.compute.internal started at 2022-12-02 23:14:53 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:57.452: INFO: Container kube-scheduler ready: true, restart count 0 Dec 2 23:38:57.452: INFO: etcd-manager-events-ip-172-20-40-67.us-west-2.compute.internal started at 2022-12-02 23:14:53 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:57.452: INFO: Container etcd-manager ready: true, restart count 0 Dec 2 23:38:57.452: INFO: ebs-csi-node-jt6f2 started at 2022-12-02 23:16:04 +0000 UTC (0+3 container statuses recorded) Dec 2 23:38:57.452: INFO: Container ebs-plugin ready: true, restart count 0 Dec 2 23:38:57.452: INFO: Container liveness-probe ready: true, restart count 0 Dec 2 23:38:57.452: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 2 23:38:57.452: INFO: cilium-t57cd started at 2022-12-02 23:16:04 +0000 UTC (1+1 container statuses recorded) Dec 2 23:38:57.452: INFO: Init container clean-cilium-state ready: true, restart count 0 Dec 2 23:38:57.452: INFO: Container cilium-agent ready: true, restart count 1 Dec 2 23:38:57.452: INFO: kops-controller-47skn started at 2022-12-02 23:16:04 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:57.452: INFO: Container kops-controller ready: true, restart count 0 Dec 2 23:38:57.452: INFO: dns-controller-5fb778d9d5-fln22 started at 2022-12-02 23:16:04 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:57.452: INFO: Container dns-controller ready: true, restart count 0 Dec 2 23:38:57.452: INFO: kube-apiserver-ip-172-20-40-67.us-west-2.compute.internal started at 2022-12-02 23:14:53 +0000 UTC (0+2 container statuses recorded) Dec 2 23:38:57.452: INFO: Container healthcheck ready: true, restart count 0 Dec 2 23:38:57.452: INFO: Container kube-apiserver ready: true, restart count 1 Dec 2 23:38:57.452: INFO: cilium-operator-587dd66f87-zmwpl started at 2022-12-02 23:16:04 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:57.452: INFO: Container cilium-operator ready: true, restart count 1 Dec 2 23:38:57.452: INFO: ebs-csi-controller-764b64d679-rnjp4 started at 2022-12-02 23:16:04 +0000 UTC (0+5 container statuses recorded) Dec 2 23:38:57.452: INFO: Container csi-attacher ready: true, restart count 0 Dec 2 23:38:57.452: INFO: Container csi-provisioner ready: true, restart count 0 Dec 2 23:38:57.452: INFO: Container csi-resizer ready: true, restart count 0 Dec 2 23:38:57.452: INFO: Container ebs-plugin ready: true, restart count 0 Dec 2 23:38:57.452: INFO: Container liveness-probe ready: true, restart count 0 Dec 2 23:38:57.711: INFO: Latency metrics for node ip-172-20-40-67.us-west-2.compute.internal Dec 2 23:38:57.711: INFO: Logging node info for node ip-172-20-41-32.us-west-2.compute.internal Dec 2 23:38:57.776: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-41-32.us-west-2.compute.internal ad6a9fcc-418f-4c1a-a9c7-ac1873b8a1ba 29702 0 2022-12-02 23:17:23 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-41-32.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:node mounted_volume_expand:mounted-volume-expand-6871 node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:ip-172-20-41-32.us-west-2.compute.internal topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-00d261efdd8c07a99"} io.cilium.network.ipv4-cilium-host:172.20.50.121 io.cilium.network.ipv4-health-ip:172.20.47.106 io.cilium.network.ipv4-pod-cidr:100.96.3.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2022-12-02 23:17:23 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-12-02 23:17:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2022-12-02 23:17:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {cilium-agent Update v1 2022-12-02 23:17:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-12-02 23:17:51 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {e2e.test Update v1 2022-12-02 23:29:34 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{},"f:mounted_volume_expand":{}}}} } {kubelet Update v1 2022-12-02 23:30:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2022-12-02 23:30:44 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-00d261efdd8c07a99,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-02 23:17:51 +0000 UTC,LastTransitionTime:2022-12-02 23:17:51 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-02 23:36:14 +0000 UTC,LastTransitionTime:2022-12-02 23:17:23 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-02 23:36:14 +0000 UTC,LastTransitionTime:2022-12-02 23:17:23 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-02 23:36:14 +0000 UTC,LastTransitionTime:2022-12-02 23:17:23 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-02 23:36:14 +0000 UTC,LastTransitionTime:2022-12-02 23:17:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.41.32,},NodeAddress{Type:ExternalIP,Address:35.88.26.86,},NodeAddress{Type:Hostname,Address:ip-172-20-41-32.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-41-32.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-88-26-86.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2624f500a45f29b52ed8b5d778f035,SystemUUID:ec2624f5-00a4-5f29-b52e-d8b5d778f035,BootID:b76bd51c-e57a-47b9-86f2-c1093a033e09,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.13,KubeletVersion:v1.22.16,KubeProxyVersion:v1.22.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:160382894,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:702a992280fb7c3303e84a5801acbb4c9c7fcf48cffe0e9c8be3f0c60f74cf89 k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.4],SizeBytes:112029652,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.22.16],SizeBytes:105446599,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:716d2f68314c5c4ddd5ecdb45183fcb4ed8019015982c1321571f863989b70b0 k8s.gcr.io/e2e-test-images/httpd:2.4.39-1],SizeBytes:41902332,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:b913fa234cc3473cfe16e937d106b455a7609f927f59031c81aca791e2689b50 k8s.gcr.io/e2e-test-images/httpd:2.4.38-1],SizeBytes:40765006,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:28956694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:1b7c978a792a8fa4e96244e8059bd71bb49b07e2e5a897fb0c867bdc6db20d5d k8s.gcr.io/sig-storage/livenessprobe:v2.3.0],SizeBytes:7933739,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:503b7abb89e57383eba61cc8a9cb0b495ea575c516108f7d972a6ff6e1ab3c9b k8s.gcr.io/e2e-test-images/nginx:1.14-1],SizeBytes:6979365,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac k8s.gcr.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:1ff6c18fbef2045af6b9c16bf034cc421a29027b800e4f9b68ae9b1cb3e9ae07 k8s.gcr.io/pause:3.5],SizeBytes:301416,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-00e603f65a9c9071b kubernetes.io/csi/ebs.csi.aws.com^vol-01091924f688a5969],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-01091924f688a5969,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-00e603f65a9c9071b,DevicePath:,},},Config:nil,},} Dec 2 23:38:57.777: INFO: Logging kubelet events for node ip-172-20-41-32.us-west-2.compute.internal Dec 2 23:38:57.844: INFO: Logging pods the kubelet thinks is on node ip-172-20-41-32.us-west-2.compute.internal Dec 2 23:38:57.919: INFO: csi-hostpathplugin-0 started at 2022-12-02 23:38:57 +0000 UTC (0+7 container statuses recorded) Dec 2 23:38:57.919: INFO: Container csi-attacher ready: false, restart count 0 Dec 2 23:38:57.919: INFO: Container csi-provisioner ready: false, restart count 0 Dec 2 23:38:57.919: INFO: Container csi-resizer ready: false, restart count 0 Dec 2 23:38:57.919: INFO: Container csi-snapshotter ready: false, restart count 0 Dec 2 23:38:57.919: INFO: Container hostpath ready: false, restart count 0 Dec 2 23:38:57.919: INFO: Container liveness-probe ready: false, restart count 0 Dec 2 23:38:57.919: INFO: Container node-driver-registrar ready: false, restart count 0 Dec 2 23:38:57.919: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-dm2vc started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:57.919: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:57.919: INFO: successful-jobs-history-limit-27833736-64b8r started at 2022-12-02 23:36:00 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:57.919: INFO: Container c ready: false, restart count 0 Dec 2 23:38:57.919: INFO: netserver-1 started at 2022-12-02 23:35:10 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:57.919: INFO: Container webserver ready: false, restart count 0 Dec 2 23:38:57.919: INFO: csi-mockplugin-0 started at 2022-12-02 23:36:30 +0000 UTC (0+4 container statuses recorded) Dec 2 23:38:57.919: INFO: Container busybox ready: false, restart count 0 Dec 2 23:38:57.919: INFO: Container csi-provisioner ready: false, restart count 0 Dec 2 23:38:57.919: INFO: Container driver-registrar ready: false, restart count 0 Dec 2 23:38:57.919: INFO: Container mock ready: false, restart count 0 Dec 2 23:38:57.919: INFO: successful-jobs-history-limit-27833737-7g5g4 started at 2022-12-02 23:37:00 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:57.919: INFO: Container c ready: false, restart count 0 Dec 2 23:38:57.919: INFO: ss2-0 started at 2022-12-02 23:33:41 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:57.919: INFO: Container webserver ready: false, restart count 0 Dec 2 23:38:57.919: INFO: host-test-container-pod started at 2022-12-02 23:34:12 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:57.919: INFO: Container agnhost-container ready: true, restart count 0 Dec 2 23:38:57.919: INFO: pod-subpath-test-inlinevolume-84wk started at 2022-12-02 23:35:11 +0000 UTC (2+1 container statuses recorded) Dec 2 23:38:57.919: INFO: Init container init-volume-inlinevolume-84wk ready: false, restart count 0 Dec 2 23:38:57.919: INFO: Init container test-init-volume-inlinevolume-84wk ready: false, restart count 0 Dec 2 23:38:57.919: INFO: Container test-container-subpath-inlinevolume-84wk ready: false, restart count 0 Dec 2 23:38:57.919: INFO: externalname-service-6rb48 started at 2022-12-02 23:35:40 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:57.919: INFO: Container externalname-service ready: false, restart count 0 Dec 2 23:38:57.919: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-rq5lg started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:57.919: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:57.919: INFO: netserver-1 started at 2022-12-02 23:33:50 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:57.919: INFO: Container webserver ready: false, restart count 0 Dec 2 23:38:57.919: INFO: successful-jobs-history-limit-27833735-zz4t9 started at 2022-12-02 23:35:00 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:57.919: INFO: Container c ready: false, restart count 0 Dec 2 23:38:57.919: INFO: successful-jobs-history-limit-27833738-bm4dh started at 2022-12-02 23:38:00 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:57.920: INFO: Container c ready: false, restart count 0 Dec 2 23:38:57.920: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-79x59 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:57.920: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:57.920: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-42p62 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:57.920: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:57.920: INFO: pod-55255ec9-bf45-4208-865d-6ef51afe9599 started at 2022-12-02 23:30:30 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:57.920: INFO: Container write-pod ready: false, restart count 0 Dec 2 23:38:57.920: INFO: pod-1 started at 2022-12-02 23:31:10 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:57.920: INFO: Container donothing ready: false, restart count 0 Dec 2 23:38:57.920: INFO: ss-0 started at 2022-12-02 23:36:09 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:57.920: INFO: Container webserver ready: false, restart count 0 Dec 2 23:38:57.920: INFO: test-rolling-update-controller-5s7b9 started at 2022-12-02 23:36:29 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:57.920: INFO: Container httpd ready: false, restart count 0 Dec 2 23:38:57.920: INFO: cilium-m9r5q started at 2022-12-02 23:17:24 +0000 UTC (1+1 container statuses recorded) Dec 2 23:38:57.920: INFO: Init container clean-cilium-state ready: true, restart count 0 Dec 2 23:38:57.920: INFO: Container cilium-agent ready: true, restart count 0 Dec 2 23:38:57.920: INFO: test-rollover-controller-wxkjb started at 2022-12-02 23:35:19 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:57.920: INFO: Container httpd ready: true, restart count 0 Dec 2 23:38:57.920: INFO: successful-jobs-history-limit-27833734-6hlrt started at 2022-12-02 23:34:00 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:57.920: INFO: Container c ready: false, restart count 0 Dec 2 23:38:57.920: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-qgcxv started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:57.920: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:57.920: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-44b5z started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:57.920: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:57.920: INFO: netserver-1 started at 2022-12-02 23:38:46 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:57.920: INFO: Container webserver ready: false, restart count 0 Dec 2 23:38:57.920: INFO: inline-volume-tester-zc874 started at 2022-12-02 23:38:57 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:57.920: INFO: Container csi-volume-tester ready: false, restart count 0 Dec 2 23:38:57.920: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-wf5z9 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:57.920: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:57.920: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-gjgbh started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:57.920: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:57.920: INFO: netserver-1 started at 2022-12-02 23:29:40 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:57.920: INFO: Container webserver ready: true, restart count 0 Dec 2 23:38:57.920: INFO: ebs-csi-node-c27hl started at 2022-12-02 23:17:24 +0000 UTC (0+3 container statuses recorded) Dec 2 23:38:57.920: INFO: Container ebs-plugin ready: true, restart count 0 Dec 2 23:38:57.920: INFO: Container liveness-probe ready: true, restart count 0 Dec 2 23:38:57.920: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 2 23:38:57.920: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-dlbpk started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:57.920: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:57.920: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-kxvnd started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:57.920: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:57.920: INFO: pfpod started at 2022-12-02 23:38:29 +0000 UTC (0+2 container statuses recorded) Dec 2 23:38:57.920: INFO: Container portforwardtester ready: false, restart count 0 Dec 2 23:38:57.920: INFO: Container readiness ready: false, restart count 0 Dec 2 23:38:57.920: INFO: test-container-pod started at 2022-12-02 23:34:12 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:57.920: INFO: Container webserver ready: false, restart count 0 Dec 2 23:38:58.218: INFO: Latency metrics for node ip-172-20-41-32.us-west-2.compute.internal Dec 2 23:38:58.218: INFO: Logging node info for node ip-172-20-43-150.us-west-2.compute.internal Dec 2 23:38:58.284: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-43-150.us-west-2.compute.internal 47bb1581-dcdc-4edf-b2c4-109aedb2f5bd 30224 0 2022-12-02 23:17:23 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-43-150.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:ip-172-20-43-150.us-west-2.compute.internal topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0e2e5350f5754b178"} io.cilium.network.ipv4-cilium-host:172.20.35.108 io.cilium.network.ipv4-health-ip:172.20.34.31 io.cilium.network.ipv4-pod-cidr:100.96.4.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2022-12-02 23:17:23 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-12-02 23:17:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2022-12-02 23:17:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {cilium-agent Update v1 2022-12-02 23:17:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-12-02 23:17:51 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {e2e.test Update v1 2022-12-02 23:29:34 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2022-12-02 23:37:23 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2022-12-02 23:37:24 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-0e2e5350f5754b178,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-02 23:17:51 +0000 UTC,LastTransitionTime:2022-12-02 23:17:51 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-02 23:37:24 +0000 UTC,LastTransitionTime:2022-12-02 23:17:23 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-02 23:37:24 +0000 UTC,LastTransitionTime:2022-12-02 23:17:23 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-02 23:37:24 +0000 UTC,LastTransitionTime:2022-12-02 23:17:23 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-02 23:37:24 +0000 UTC,LastTransitionTime:2022-12-02 23:17:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.43.150,},NodeAddress{Type:ExternalIP,Address:54.184.249.63,},NodeAddress{Type:Hostname,Address:ip-172-20-43-150.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-43-150.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-184-249-63.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23a85d6d7b80ff12e03e51b1effc11,SystemUUID:ec23a85d-6d7b-80ff-12e0-3e51b1effc11,BootID:72904f56-1058-4b24-85d2-c465d1149ad1,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.13,KubeletVersion:v1.22.16,KubeProxyVersion:v1.22.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:160382894,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:702a992280fb7c3303e84a5801acbb4c9c7fcf48cffe0e9c8be3f0c60f74cf89 k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.4],SizeBytes:112029652,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.22.16],SizeBytes:105446599,},ContainerImage{Names:[docker.io/library/nginx@sha256:e209ac2f37c70c1e0e9873a5f7231e91dcd83fdf1178d8ed36c2ec09974210ba docker.io/library/nginx:latest],SizeBytes:56833911,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:1f36a24cfb5e0c3f725d7565a867c2384282fcbeccc77b07b423c9da95763a9a k8s.gcr.io/e2e-test-images/nautilus:1.4],SizeBytes:49230179,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:716d2f68314c5c4ddd5ecdb45183fcb4ed8019015982c1321571f863989b70b0 k8s.gcr.io/e2e-test-images/httpd:2.4.39-1],SizeBytes:41902332,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:b913fa234cc3473cfe16e937d106b455a7609f927f59031c81aca791e2689b50 k8s.gcr.io/e2e-test-images/httpd:2.4.38-1],SizeBytes:40765006,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:28956694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a k8s.gcr.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf k8s.gcr.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:1b7c978a792a8fa4e96244e8059bd71bb49b07e2e5a897fb0c867bdc6db20d5d k8s.gcr.io/sig-storage/livenessprobe:v2.3.0],SizeBytes:7933739,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:503b7abb89e57383eba61cc8a9cb0b495ea575c516108f7d972a6ff6e1ab3c9b k8s.gcr.io/e2e-test-images/nginx:1.14-1],SizeBytes:6979365,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac k8s.gcr.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:1ff6c18fbef2045af6b9c16bf034cc421a29027b800e4f9b68ae9b1cb3e9ae07 k8s.gcr.io/pause:3.5],SizeBytes:301416,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0e3ce9fcd443ccc35],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0e3ce9fcd443ccc35,DevicePath:,},},Config:nil,},} Dec 2 23:38:58.285: INFO: Logging kubelet events for node ip-172-20-43-150.us-west-2.compute.internal Dec 2 23:38:58.352: INFO: Logging pods the kubelet thinks is on node ip-172-20-43-150.us-west-2.compute.internal Dec 2 23:38:58.436: INFO: netserver-2 started at 2022-12-02 23:33:50 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:58.436: INFO: Container webserver ready: false, restart count 0 Dec 2 23:38:58.436: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-s5867 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:58.436: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:58.436: INFO: netserver-2 started at 2022-12-02 23:38:46 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:58.436: INFO: Container webserver ready: false, restart count 0 Dec 2 23:38:58.436: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-kj74m started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:58.436: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:58.436: INFO: hostexec-ip-172-20-43-150.us-west-2.compute.internal-4sp8t started at 2022-12-02 23:34:34 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:58.436: INFO: Container agnhost-container ready: true, restart count 0 Dec 2 23:38:58.436: INFO: pvc-tester-jjnqm started at 2022-12-02 23:37:21 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:58.436: INFO: Container write-pod ready: false, restart count 0 Dec 2 23:38:58.436: INFO: pod-0 started at 2022-12-02 23:31:10 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:58.436: INFO: Container donothing ready: false, restart count 0 Dec 2 23:38:58.436: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-ksvcz started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:58.436: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:58.436: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-pm84g started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:58.436: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:58.436: INFO: hostexec-ip-172-20-43-150.us-west-2.compute.internal-pzwm8 started at 2022-12-02 23:34:47 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:58.436: INFO: Container agnhost-container ready: true, restart count 0 Dec 2 23:38:58.436: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-wqgdj started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:58.436: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:58.436: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-z5d7v started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:58.436: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:58.436: INFO: pod-subpath-test-preprovisionedpv-8zrh started at 2022-12-02 23:34:49 +0000 UTC (1+1 container statuses recorded) Dec 2 23:38:58.436: INFO: Init container init-volume-preprovisionedpv-8zrh ready: false, restart count 0 Dec 2 23:38:58.436: INFO: Container test-container-subpath-preprovisionedpv-8zrh ready: false, restart count 0 Dec 2 23:38:58.436: INFO: netserver-2 started at 2022-12-02 23:35:10 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:58.436: INFO: Container webserver ready: false, restart count 0 Dec 2 23:38:58.436: INFO: pod-abb1ddf3-cdd4-4291-a144-3f08787c89a0 started at 2022-12-02 23:35:57 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:58.436: INFO: Container test-container ready: false, restart count 0 Dec 2 23:38:58.436: INFO: cilium-7h427 started at 2022-12-02 23:17:24 +0000 UTC (1+1 container statuses recorded) Dec 2 23:38:58.436: INFO: Init container clean-cilium-state ready: true, restart count 0 Dec 2 23:38:58.436: INFO: Container cilium-agent ready: true, restart count 0 Dec 2 23:38:58.436: INFO: externalname-service-vqt5p started at 2022-12-02 23:35:40 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:58.436: INFO: Container externalname-service ready: false, restart count 0 Dec 2 23:38:58.436: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-5jb9p started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:58.436: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:58.436: INFO: pod-2 started at 2022-12-02 23:31:10 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:58.436: INFO: Container donothing ready: true, restart count 0 Dec 2 23:38:58.436: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-g66v4 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:58.436: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:58.436: INFO: ebs-csi-node-8qrwx started at 2022-12-02 23:17:24 +0000 UTC (0+3 container statuses recorded) Dec 2 23:38:58.436: INFO: Container ebs-plugin ready: true, restart count 0 Dec 2 23:38:58.436: INFO: Container liveness-probe ready: true, restart count 0 Dec 2 23:38:58.436: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 2 23:38:58.436: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-8bg6n started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:58.436: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:58.436: INFO: pod-b416a818-b13e-44c7-a3c6-14e94e8ce1c4 started at 2022-12-02 23:35:04 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:58.436: INFO: Container write-pod ready: false, restart count 0 Dec 2 23:38:58.436: INFO: netserver-2 started at 2022-12-02 23:29:40 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:58.436: INFO: Container webserver ready: true, restart count 0 Dec 2 23:38:58.436: INFO: terminate-cmd-rpae9785fa3-cce9-4bd1-8b4e-6f58c41e65dd started at 2022-12-02 23:37:40 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:58.436: INFO: Container terminate-cmd-rpa ready: false, restart count 0 Dec 2 23:38:58.436: INFO: configmap-client started at 2022-12-02 23:34:58 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:58.436: INFO: Container configmap-client ready: false, restart count 0 Dec 2 23:38:58.436: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-qnr57 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:58.436: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:58.436: INFO: test-rollover-deployment-67bbb7bc8-sdxv6 started at 2022-12-02 23:36:16 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:58.436: INFO: Container agnhost ready: false, restart count 0 Dec 2 23:38:58.743: INFO: Latency metrics for node ip-172-20-43-150.us-west-2.compute.internal Dec 2 23:38:58.744: INFO: Logging node info for node ip-172-20-48-5.us-west-2.compute.internal Dec 2 23:38:58.809: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-48-5.us-west-2.compute.internal 6342e9b6-e818-4fbf-aae7-8be176fd4ec1 30001 0 2022-12-02 23:17:21 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a io.kubernetes.storage.mock/node:some-mock-node kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-48-5.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:ip-172-20-48-5.us-west-2.compute.internal topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-9034":"csi-mock-csi-mock-volumes-9034","ebs.csi.aws.com":"i-0093900b92d415e84"} io.cilium.network.ipv4-cilium-host:172.20.42.98 io.cilium.network.ipv4-health-ip:172.20.44.82 io.cilium.network.ipv4-pod-cidr:100.96.2.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-12-02 23:17:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2022-12-02 23:17:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2022-12-02 23:17:22 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {cilium-agent Update v1 2022-12-02 23:17:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-12-02 23:17:52 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {e2e.test Update v1 2022-12-02 23:29:34 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2022-12-02 23:36:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-0093900b92d415e84,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-02 23:17:52 +0000 UTC,LastTransitionTime:2022-12-02 23:17:52 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-02 23:36:03 +0000 UTC,LastTransitionTime:2022-12-02 23:17:21 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-02 23:36:03 +0000 UTC,LastTransitionTime:2022-12-02 23:17:21 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-02 23:36:03 +0000 UTC,LastTransitionTime:2022-12-02 23:17:21 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-02 23:36:03 +0000 UTC,LastTransitionTime:2022-12-02 23:17:42 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.48.5,},NodeAddress{Type:ExternalIP,Address:34.213.188.181,},NodeAddress{Type:Hostname,Address:ip-172-20-48-5.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-48-5.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-34-213-188-181.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2ecd9e359fbd979ba14c48724d474b,SystemUUID:ec2ecd9e-359f-bd97-9ba1-4c48724d474b,BootID:3d1b1479-a710-49bb-96b3-2764890e8166,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.13,KubeletVersion:v1.22.16,KubeProxyVersion:v1.22.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:160382894,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.22.16],SizeBytes:105446599,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:716d2f68314c5c4ddd5ecdb45183fcb4ed8019015982c1321571f863989b70b0 k8s.gcr.io/e2e-test-images/httpd:2.4.39-1],SizeBytes:41902332,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:b913fa234cc3473cfe16e937d106b455a7609f927f59031c81aca791e2689b50 k8s.gcr.io/e2e-test-images/httpd:2.4.38-1],SizeBytes:40765006,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:28956694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a k8s.gcr.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:1b7c978a792a8fa4e96244e8059bd71bb49b07e2e5a897fb0c867bdc6db20d5d k8s.gcr.io/sig-storage/livenessprobe:v2.3.0],SizeBytes:7933739,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:503b7abb89e57383eba61cc8a9cb0b495ea575c516108f7d972a6ff6e1ab3c9b k8s.gcr.io/e2e-test-images/nginx:1.14-1],SizeBytes:6979365,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:1ff6c18fbef2045af6b9c16bf034cc421a29027b800e4f9b68ae9b1cb3e9ae07 k8s.gcr.io/pause:3.5],SizeBytes:301416,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 2 23:38:58.810: INFO: Logging kubelet events for node ip-172-20-48-5.us-west-2.compute.internal Dec 2 23:38:58.877: INFO: Logging pods the kubelet thinks is on node ip-172-20-48-5.us-west-2.compute.internal Dec 2 23:38:58.949: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-9mx44 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:58.949: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:58.949: INFO: webserver-pod started at 2022-12-02 23:35:30 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:58.949: INFO: Container agnhost ready: false, restart count 0 Dec 2 23:38:58.949: INFO: pvc-volume-tester-t9ths started at 2022-12-02 23:36:46 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:58.949: INFO: Container volume-tester ready: false, restart count 0 Dec 2 23:38:58.949: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-qxp67 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:58.949: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:58.949: INFO: csi-mockplugin-0 started at 2022-12-02 23:35:02 +0000 UTC (0+4 container statuses recorded) Dec 2 23:38:58.949: INFO: Container busybox ready: true, restart count 0 Dec 2 23:38:58.949: INFO: Container csi-provisioner ready: true, restart count 0 Dec 2 23:38:58.949: INFO: Container driver-registrar ready: true, restart count 0 Dec 2 23:38:58.949: INFO: Container mock ready: true, restart count 0 Dec 2 23:38:58.949: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-xctkw started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:58.949: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:58.949: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-ttc6s started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:58.949: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: false, restart count 0 Dec 2 23:38:58.949: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-6nvlf started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:58.949: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:58.949: INFO: ebs-csi-node-bcx5m started at 2022-12-02 23:17:22 +0000 UTC (0+3 container statuses recorded) Dec 2 23:38:58.949: INFO: Container ebs-plugin ready: true, restart count 0 Dec 2 23:38:58.949: INFO: Container liveness-probe ready: true, restart count 0 Dec 2 23:38:58.949: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 2 23:38:58.949: INFO: coredns-5fcc7b6498-clxp8 started at 2022-12-02 23:17:58 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:58.949: INFO: Container coredns ready: true, restart count 0 Dec 2 23:38:58.949: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-cdm2p started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:58.949: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:58.949: INFO: netserver-3 started at 2022-12-02 23:33:50 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:58.949: INFO: Container webserver ready: false, restart count 0 Dec 2 23:38:58.949: INFO: netserver-3 started at 2022-12-02 23:35:11 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:58.949: INFO: Container webserver ready: false, restart count 0 Dec 2 23:38:58.949: INFO: cilium-ftssb started at 2022-12-02 23:17:22 +0000 UTC (1+1 container statuses recorded) Dec 2 23:38:58.949: INFO: Init container clean-cilium-state ready: true, restart count 0 Dec 2 23:38:58.949: INFO: Container cilium-agent ready: true, restart count 0 Dec 2 23:38:58.949: INFO: netserver-3 started at 2022-12-02 23:29:40 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:58.949: INFO: Container webserver ready: true, restart count 0 Dec 2 23:38:58.949: INFO: netserver-3 started at 2022-12-02 23:38:46 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:58.949: INFO: Container webserver ready: false, restart count 0 Dec 2 23:38:58.949: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-59flm started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:58.949: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:58.949: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-krv9s started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:58.949: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:58.949: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-7rvfw started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:58.949: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:58.949: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-wqvtr started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:58.949: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:59.295: INFO: Latency metrics for node ip-172-20-48-5.us-west-2.compute.internal Dec 2 23:38:59.295: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "cronjob-155" for this suite.
Filter through log files
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-apps\]\sDeployment\sshould\snot\sdisrupt\sa\scloud\sload\-balancer\'s\sconnectivity\sduring\srollout$'
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/deployment.go:161 Dec 2 23:36:01.990: Unexpected error: <*errors.errorString | 0xc0032b73c0>: { s: "error waiting for deployment \"test-rolling-update-with-lb\" status to match expectation: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:\"Available\", Status:\"True\", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:\"MinimumReplicasAvailable\", Message:\"Deployment has minimum availability.\"}, v1.DeploymentCondition{Type:\"Progressing\", Status:\"True\", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:\"ReplicaSetUpdated\", Message:\"ReplicaSet \\\"test-rolling-update-with-lb-5947fbdf64\\\" is progressing.\"}}, CollisionCount:(*int32)(nil)}", } error waiting for deployment "test-rolling-update-with-lb" status to match expectation: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/deployment.go:1450from junit_11.xml
[BeforeEach] [sig-apps] Deployment /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Dec 2 23:27:40.156: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename deployment �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-apps] Deployment /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/deployment.go:89 [It] should not disrupt a cloud load-balancer's connectivity during rollout /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/deployment.go:161 Dec 2 23:27:40.570: INFO: Creating Deployment "test-rolling-update-with-lb" Dec 2 23:27:40.708: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:0, UpdatedReplicas:0, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"NewReplicaSetCreated", Message:"Created new replica set \"test-rolling-update-with-lb-7db9cf5ff8\""}, v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}}, CollisionCount:(*int32)(nil)} Dec 2 23:27:42.775: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-7db9cf5ff8\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:27:44.777: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-7db9cf5ff8\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:27:46.778: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:2, AvailableReplicas:2, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620466, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-7db9cf5ff8\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:27:48.776: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:2, AvailableReplicas:2, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620466, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-7db9cf5ff8\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:27:50.777: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:2, AvailableReplicas:2, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620466, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-7db9cf5ff8\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:27:52.776: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:2, AvailableReplicas:2, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620466, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-7db9cf5ff8\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:27:54.776: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:2, AvailableReplicas:2, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620466, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-7db9cf5ff8\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:27:56.781: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:2, AvailableReplicas:2, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620466, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-7db9cf5ff8\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:27:58.780: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:2, AvailableReplicas:2, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620466, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-7db9cf5ff8\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:28:00.776: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:2, AvailableReplicas:2, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620466, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-7db9cf5ff8\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:28:02.777: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:2, AvailableReplicas:2, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620466, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-7db9cf5ff8\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:28:04.776: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:2, AvailableReplicas:2, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620466, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-7db9cf5ff8\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:28:06.775: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:2, AvailableReplicas:2, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620466, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-7db9cf5ff8\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:28:08.776: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:2, AvailableReplicas:2, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620466, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-7db9cf5ff8\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:28:10.776: INFO: Creating a service test-rolling-update-with-lb with type=LoadBalancer and externalTrafficPolicy=Local in namespace deployment-400 �[1mSTEP�[0m: creating a service deployment-400/test-rolling-update-with-lb with type=LoadBalancer �[1mSTEP�[0m: waiting for loadbalancer for service deployment-400/test-rolling-update-with-lb Dec 2 23:28:10.923: INFO: Waiting up to 10m0s for service "test-rolling-update-with-lb" to have a LoadBalancer Dec 2 23:30:51.058: INFO: Hitting the replica set's pods through the service's load balancer Dec 2 23:30:51.058: INFO: Poking "http://af35b29d62784448cbb45c9e3a706682-587543623.us-west-2.elb.amazonaws.com:80/echo?msg=hello" Dec 2 23:30:51.239: INFO: Poke("http://af35b29d62784448cbb45c9e3a706682-587543623.us-west-2.elb.amazonaws.com:80/echo?msg=hello"): Get "http://af35b29d62784448cbb45c9e3a706682-587543623.us-west-2.elb.amazonaws.com:80/echo?msg=hello": EOF Dec 2 23:30:53.239: INFO: Poking "http://af35b29d62784448cbb45c9e3a706682-587543623.us-west-2.elb.amazonaws.com:80/echo?msg=hello" Dec 2 23:30:53.398: INFO: Poke("http://af35b29d62784448cbb45c9e3a706682-587543623.us-west-2.elb.amazonaws.com:80/echo?msg=hello"): Get "http://af35b29d62784448cbb45c9e3a706682-587543623.us-west-2.elb.amazonaws.com:80/echo?msg=hello": EOF Dec 2 23:30:55.240: INFO: Poking "http://af35b29d62784448cbb45c9e3a706682-587543623.us-west-2.elb.amazonaws.com:80/echo?msg=hello" Dec 2 23:30:55.412: INFO: Poke("http://af35b29d62784448cbb45c9e3a706682-587543623.us-west-2.elb.amazonaws.com:80/echo?msg=hello"): Get "http://af35b29d62784448cbb45c9e3a706682-587543623.us-west-2.elb.amazonaws.com:80/echo?msg=hello": EOF Dec 2 23:30:57.241: INFO: Poking "http://af35b29d62784448cbb45c9e3a706682-587543623.us-west-2.elb.amazonaws.com:80/echo?msg=hello" Dec 2 23:30:57.393: INFO: Poke("http://af35b29d62784448cbb45c9e3a706682-587543623.us-west-2.elb.amazonaws.com:80/echo?msg=hello"): Get "http://af35b29d62784448cbb45c9e3a706682-587543623.us-west-2.elb.amazonaws.com:80/echo?msg=hello": EOF Dec 2 23:30:59.240: INFO: Poking "http://af35b29d62784448cbb45c9e3a706682-587543623.us-west-2.elb.amazonaws.com:80/echo?msg=hello" Dec 2 23:30:59.398: INFO: Poke("http://af35b29d62784448cbb45c9e3a706682-587543623.us-west-2.elb.amazonaws.com:80/echo?msg=hello"): Get "http://af35b29d62784448cbb45c9e3a706682-587543623.us-west-2.elb.amazonaws.com:80/echo?msg=hello": EOF Dec 2 23:31:01.239: INFO: Poking "http://af35b29d62784448cbb45c9e3a706682-587543623.us-west-2.elb.amazonaws.com:80/echo?msg=hello" Dec 2 23:31:01.377: INFO: Poke("http://af35b29d62784448cbb45c9e3a706682-587543623.us-west-2.elb.amazonaws.com:80/echo?msg=hello"): success Dec 2 23:31:01.377: INFO: Starting a goroutine to watch the service's endpoints in the background Dec 2 23:31:01.377: INFO: Triggering a rolling deployment several times Dec 2 23:31:01.377: INFO: Updating label deployment "test-rolling-update-with-lb" pod spec (iteration #1) Dec 2 23:31:01.513: INFO: Updating deployment test-rolling-update-with-lb Dec 2 23:31:01.513: INFO: Waiting for observed generation 2 Dec 2 23:31:01.580: INFO: Make sure deployment "test-rolling-update-with-lb" is complete Dec 2 23:31:01.715: INFO: Dec 2 23:31:01.715: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:31:03.850: INFO: Dec 2 23:31:03.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:31:05.850: INFO: Dec 2 23:31:05.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:31:07.851: INFO: Dec 2 23:31:07.851: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:31:09.850: INFO: Dec 2 23:31:09.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:31:11.850: INFO: Dec 2 23:31:11.851: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:31:13.850: INFO: Dec 2 23:31:13.851: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:31:15.850: INFO: Dec 2 23:31:15.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:31:17.850: INFO: Dec 2 23:31:17.851: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:31:19.851: INFO: Dec 2 23:31:19.851: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:31:21.850: INFO: Dec 2 23:31:21.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:31:23.850: INFO: Dec 2 23:31:23.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:31:25.850: INFO: Dec 2 23:31:25.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:31:27.857: INFO: Dec 2 23:31:27.857: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:31:29.851: INFO: Dec 2 23:31:29.851: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:31:31.849: INFO: Dec 2 23:31:31.849: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:31:33.850: INFO: Dec 2 23:31:33.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:31:35.852: INFO: Dec 2 23:31:35.852: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:31:37.852: INFO: Dec 2 23:31:37.852: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:31:39.849: INFO: Dec 2 23:31:39.849: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:31:41.850: INFO: Dec 2 23:31:41.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:31:43.850: INFO: Dec 2 23:31:43.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:31:45.850: INFO: Dec 2 23:31:45.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:31:47.850: INFO: Dec 2 23:31:47.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:31:49.850: INFO: Dec 2 23:31:49.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:31:51.850: INFO: Dec 2 23:31:51.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:31:53.851: INFO: Dec 2 23:31:53.851: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:31:55.854: INFO: Dec 2 23:31:55.854: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:31:57.850: INFO: Dec 2 23:31:57.851: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:31:59.850: INFO: Dec 2 23:31:59.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:32:01.850: INFO: Dec 2 23:32:01.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:32:03.850: INFO: Dec 2 23:32:03.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:32:05.850: INFO: Dec 2 23:32:05.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:32:07.851: INFO: Dec 2 23:32:07.851: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:32:09.849: INFO: Dec 2 23:32:09.849: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:32:11.849: INFO: Dec 2 23:32:11.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:32:13.849: INFO: Dec 2 23:32:13.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:32:15.851: INFO: Dec 2 23:32:15.851: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:32:17.849: INFO: Dec 2 23:32:17.849: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:32:19.850: INFO: Dec 2 23:32:19.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:32:21.853: INFO: Dec 2 23:32:21.854: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:32:23.853: INFO: Dec 2 23:32:23.853: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:32:25.850: INFO: Dec 2 23:32:25.851: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:32:27.850: INFO: Dec 2 23:32:27.851: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:32:29.851: INFO: Dec 2 23:32:29.851: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:32:31.850: INFO: Dec 2 23:32:31.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:32:33.850: INFO: Dec 2 23:32:33.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:32:35.850: INFO: Dec 2 23:32:35.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:32:37.850: INFO: Dec 2 23:32:37.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:32:39.850: INFO: Dec 2 23:32:39.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:32:41.851: INFO: Dec 2 23:32:41.851: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:32:43.851: INFO: Dec 2 23:32:43.851: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:32:45.850: INFO: Dec 2 23:32:45.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:32:47.849: INFO: Dec 2 23:32:47.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:32:49.849: INFO: Dec 2 23:32:49.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:32:51.849: INFO: Dec 2 23:32:51.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:32:53.851: INFO: Dec 2 23:32:53.852: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:32:55.850: INFO: Dec 2 23:32:55.851: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:32:57.849: INFO: Dec 2 23:32:57.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:32:59.851: INFO: Dec 2 23:32:59.851: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:33:01.853: INFO: Dec 2 23:33:01.853: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:33:03.850: INFO: Dec 2 23:33:03.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:33:05.851: INFO: Dec 2 23:33:05.851: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:33:07.850: INFO: Dec 2 23:33:07.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:33:09.851: INFO: Dec 2 23:33:09.851: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:33:11.850: INFO: Dec 2 23:33:11.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:33:13.849: INFO: Dec 2 23:33:13.849: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:33:15.850: INFO: Dec 2 23:33:15.851: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:33:17.850: INFO: Dec 2 23:33:17.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:33:19.850: INFO: Dec 2 23:33:19.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:33:21.864: INFO: Dec 2 23:33:21.865: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:33:23.850: INFO: Dec 2 23:33:23.851: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:33:25.849: INFO: Dec 2 23:33:25.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:33:27.855: INFO: Dec 2 23:33:27.855: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:33:29.850: INFO: Dec 2 23:33:29.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:33:31.850: INFO: Dec 2 23:33:31.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:33:33.850: INFO: Dec 2 23:33:33.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:33:35.850: INFO: Dec 2 23:33:35.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:33:37.850: INFO: Dec 2 23:33:37.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:33:39.850: INFO: Dec 2 23:33:39.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:33:41.850: INFO: Dec 2 23:33:41.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:33:43.849: INFO: Dec 2 23:33:43.849: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:33:45.853: INFO: Dec 2 23:33:45.853: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:33:47.850: INFO: Dec 2 23:33:47.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:33:49.851: INFO: Dec 2 23:33:49.851: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:33:51.850: INFO: Dec 2 23:33:51.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:33:53.850: INFO: Dec 2 23:33:53.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:33:55.850: INFO: Dec 2 23:33:55.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:33:57.849: INFO: Dec 2 23:33:57.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:33:59.850: INFO: Dec 2 23:33:59.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:34:01.850: INFO: Dec 2 23:34:01.851: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:34:03.850: INFO: Dec 2 23:34:03.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:34:05.850: INFO: Dec 2 23:34:05.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:34:07.851: INFO: Dec 2 23:34:07.852: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:34:09.851: INFO: Dec 2 23:34:09.851: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:34:11.850: INFO: Dec 2 23:34:11.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:34:13.850: INFO: Dec 2 23:34:13.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:34:15.850: INFO: Dec 2 23:34:15.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:34:17.850: INFO: Dec 2 23:34:17.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:34:19.850: INFO: Dec 2 23:34:19.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:34:21.851: INFO: Dec 2 23:34:21.851: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:34:23.850: INFO: Dec 2 23:34:23.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:34:25.850: INFO: Dec 2 23:34:25.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:34:27.850: INFO: Dec 2 23:34:27.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:34:29.854: INFO: Dec 2 23:34:29.854: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:34:31.850: INFO: Dec 2 23:34:31.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:34:33.850: INFO: Dec 2 23:34:33.851: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:34:35.854: INFO: Dec 2 23:34:35.854: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:34:37.850: INFO: Dec 2 23:34:37.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:34:39.851: INFO: Dec 2 23:34:39.851: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:34:41.850: INFO: Dec 2 23:34:41.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:34:43.853: INFO: Dec 2 23:34:43.853: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:34:45.850: INFO: Dec 2 23:34:45.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:34:47.850: INFO: Dec 2 23:34:47.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:34:49.851: INFO: Dec 2 23:34:49.851: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:34:51.853: INFO: Dec 2 23:34:51.853: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:34:53.850: INFO: Dec 2 23:34:53.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:34:55.850: INFO: Dec 2 23:34:55.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:34:57.851: INFO: Dec 2 23:34:57.851: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:34:59.857: INFO: Dec 2 23:34:59.857: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:35:01.854: INFO: Dec 2 23:35:01.854: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:35:03.850: INFO: Dec 2 23:35:03.851: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:35:05.850: INFO: Dec 2 23:35:05.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:35:07.851: INFO: Dec 2 23:35:07.851: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:35:09.850: INFO: Dec 2 23:35:09.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:35:11.850: INFO: Dec 2 23:35:11.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:35:13.850: INFO: Dec 2 23:35:13.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:35:15.850: INFO: Dec 2 23:35:15.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:35:17.850: INFO: Dec 2 23:35:17.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:35:19.850: INFO: Dec 2 23:35:19.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:35:21.851: INFO: Dec 2 23:35:21.851: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:35:23.850: INFO: Dec 2 23:35:23.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:35:25.850: INFO: Dec 2 23:35:25.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:35:27.851: INFO: Dec 2 23:35:27.851: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:35:29.851: INFO: Dec 2 23:35:29.851: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:35:31.850: INFO: Dec 2 23:35:31.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:35:33.852: INFO: Dec 2 23:35:33.852: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:35:35.851: INFO: Dec 2 23:35:35.851: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:35:37.852: INFO: Dec 2 23:35:37.852: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:35:39.850: INFO: Dec 2 23:35:39.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:35:41.851: INFO: Dec 2 23:35:41.851: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:35:43.851: INFO: Dec 2 23:35:43.851: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:35:45.851: INFO: Dec 2 23:35:45.851: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:35:47.851: INFO: Dec 2 23:35:47.851: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:35:49.851: INFO: Dec 2 23:35:49.851: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:35:51.850: INFO: Dec 2 23:35:51.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:35:53.850: INFO: Dec 2 23:35:53.851: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:35:55.850: INFO: Dec 2 23:35:55.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:35:57.851: INFO: Dec 2 23:35:57.851: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:35:59.850: INFO: Dec 2 23:35:59.850: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:36:01.852: INFO: Dec 2 23:36:01.852: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:36:01.988: INFO: Dec 2 23:36:01.988: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 2 23:36:01.990: FAIL: Unexpected error: <*errors.errorString | 0xc0032b73c0>: { s: "error waiting for deployment \"test-rolling-update-with-lb\" status to match expectation: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:\"Available\", Status:\"True\", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:\"MinimumReplicasAvailable\", Message:\"Deployment has minimum availability.\"}, v1.DeploymentCondition{Type:\"Progressing\", Status:\"True\", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:\"ReplicaSetUpdated\", Message:\"ReplicaSet \\\"test-rolling-update-with-lb-5947fbdf64\\\" is progressing.\"}}, CollisionCount:(*int32)(nil)}", } error waiting for deployment "test-rolling-update-with-lb" status to match expectation: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620490, loc:(*time.Location)(0xa04d060)}}, Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620661, loc:(*time.Location)(0xa04d060)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63805620460, loc:(*time.Location)(0xa04d060)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-5947fbdf64\" is progressing."}}, CollisionCount:(*int32)(nil)} occurred Full Stack Trace k8s.io/kubernetes/test/e2e/apps.testRollingUpdateDeploymentWithLocalTrafficLoadBalancer(0xc00121a160) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/deployment.go:1450 +0xec8 k8s.io/kubernetes/test/e2e/apps.glob..func4.12() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/deployment.go:166 +0x125 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc000c7e480) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x36c k8s.io/kubernetes/test/e2e.TestE2E(0xc000c7e480) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:136 +0x2b testing.tRunner(0xc000c7e480, 0x729c8b8) /usr/local/go/src/testing/testing.go:1203 +0xe5 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1248 +0x2b3 [AfterEach] [sig-apps] Deployment /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/deployment.go:83 Dec 2 23:36:02.058: INFO: Deployment "test-rolling-update-with-lb": &Deployment{ObjectMeta:{test-rolling-update-with-lb deployment-400 138d2de1-15ba-42c0-81c3-1ad3f128cb40 27655 2 2022-12-02 23:27:40 +0000 UTC <nil> <nil> map[name:test-rolling-update-with-lb] map[deployment.kubernetes.io/revision:2] [] [] [{e2e.test Update apps/v1 2022-12-02 23:31:01 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{".":{},"f:name":{}}},"f:spec":{"f:progressDeadlineSeconds":{},"f:replicas":{},"f:revisionHistoryLimit":{},"f:selector":{},"f:strategy":{"f:rollingUpdate":{".":{},"f:maxSurge":{},"f:maxUnavailable":{}},"f:type":{}},"f:template":{"f:metadata":{"f:labels":{".":{},"f:iteration":{},"f:name":{}}},"f:spec":{"f:affinity":{".":{},"f:podAffinity":{".":{},"f:requiredDuringSchedulingIgnoredDuringExecution":{}},"f:podAntiAffinity":{".":{},"f:requiredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k:{\"name\":\"agnhost\"}":{".":{},"f:args":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}}} } {kube-controller-manager Update apps/v1 2022-12-02 23:31:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:deployment.kubernetes.io/revision":{}}},"f:status":{"f:availableReplicas":{},"f:conditions":{".":{},"k:{\"type\":\"Available\"}":{".":{},"f:lastTransitionTime":{},"f:lastUpdateTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Progressing\"}":{".":{},"f:lastTransitionTime":{},"f:lastUpdateTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:observedGeneration":{},"f:readyReplicas":{},"f:replicas":{},"f:unavailableReplicas":{},"f:updatedReplicas":{}}} status}]},Spec:DeploymentSpec{Replicas:*3,Selector:&v1.LabelSelector{MatchLabels:map[string]string{name: test-rolling-update-with-lb,},MatchExpressions:[]LabelSelectorRequirement{},},Template:{{ 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[iteration:1 name:test-rolling-update-with-lb] map[] [] [] []} {[] [] [{agnhost k8s.gcr.io/e2e-test-images/agnhost:2.39 [] [netexec --http-port=80 --udp-port=80] [] [] [] {map[] map[]} [] [] nil nil nil nil /dev/termination-log File IfNotPresent SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,} false false false}] [] Always 0xc002b5fd78 <nil> ClusterFirst map[] <nil> false false false <nil> &PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,} [] &Affinity{NodeAffinity:nil,PodAffinity:&PodAffinity{RequiredDuringSchedulingIgnoredDuringExecution:[]PodAffinityTerm{PodAffinityTerm{LabelSelector:&v1.LabelSelector{MatchLabels:map[string]string{},MatchExpressions:[]LabelSelectorRequirement{LabelSelectorRequirement{Key:name,Operator:In,Values:[test-rolling-update-with-lb],},LabelSelectorRequirement{Key:iteration,Operator:NotIn,Values:[1],},},},Namespaces:[],TopologyKey:kubernetes.io/hostname,NamespaceSelector:nil,},},PreferredDuringSchedulingIgnoredDuringExecution:[]WeightedPodAffinityTerm{},},PodAntiAffinity:&PodAntiAffinity{RequiredDuringSchedulingIgnoredDuringExecution:[]PodAffinityTerm{PodAffinityTerm{LabelSelector:&v1.LabelSelector{MatchLabels:map[string]string{},MatchExpressions:[]LabelSelectorRequirement{LabelSelectorRequirement{Key:name,Operator:In,Values:[test-rolling-update-with-lb],},LabelSelectorRequirement{Key:iteration,Operator:In,Values:[1],},},},Namespaces:[],TopologyKey:kubernetes.io/hostname,NamespaceSelector:nil,},},PreferredDuringSchedulingIgnoredDuringExecution:[]WeightedPodAffinityTerm{},},} default-scheduler [] [] <nil> nil [] <nil> <nil> <nil> map[] [] <nil>}},Strategy:DeploymentStrategy{Type:RollingUpdate,RollingUpdate:&RollingUpdateDeployment{MaxUnavailable:0,MaxSurge:1,},},MinReadySeconds:0,RevisionHistoryLimit:*10,Paused:false,ProgressDeadlineSeconds:*600,},Status:DeploymentStatus{ObservedGeneration:2,Replicas:4,UpdatedReplicas:1,AvailableReplicas:3,UnavailableReplicas:1,Conditions:[]DeploymentCondition{DeploymentCondition{Type:Available,Status:True,Reason:MinimumReplicasAvailable,Message:Deployment has minimum availability.,LastUpdateTime:2022-12-02 23:28:10 +0000 UTC,LastTransitionTime:2022-12-02 23:28:10 +0000 UTC,},DeploymentCondition{Type:Progressing,Status:True,Reason:ReplicaSetUpdated,Message:ReplicaSet "test-rolling-update-with-lb-5947fbdf64" is progressing.,LastUpdateTime:2022-12-02 23:31:01 +0000 UTC,LastTransitionTime:2022-12-02 23:27:40 +0000 UTC,},},ReadyReplicas:3,CollisionCount:nil,},} Dec 2 23:36:02.126: INFO: New ReplicaSet "test-rolling-update-with-lb-5947fbdf64" of Deployment "test-rolling-update-with-lb": &ReplicaSet{ObjectMeta:{test-rolling-update-with-lb-5947fbdf64 deployment-400 2d32d84b-5fa0-4df8-bc19-ec97a46338a4 27654 1 2022-12-02 23:31:01 +0000 UTC <nil> <nil> map[iteration:1 name:test-rolling-update-with-lb pod-template-hash:5947fbdf64] map[deployment.kubernetes.io/desired-replicas:3 deployment.kubernetes.io/max-replicas:4 deployment.kubernetes.io/revision:2] [{apps/v1 Deployment test-rolling-update-with-lb 138d2de1-15ba-42c0-81c3-1ad3f128cb40 0xc00325c227 0xc00325c228}] [] [{kube-controller-manager Update apps/v1 2022-12-02 23:31:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:deployment.kubernetes.io/desired-replicas":{},"f:deployment.kubernetes.io/max-replicas":{},"f:deployment.kubernetes.io/revision":{}},"f:labels":{".":{},"f:iteration":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"138d2de1-15ba-42c0-81c3-1ad3f128cb40\"}":{}}},"f:spec":{"f:replicas":{},"f:selector":{},"f:template":{"f:metadata":{"f:labels":{".":{},"f:iteration":{},"f:name":{},"f:pod-template-hash":{}}},"f:spec":{"f:affinity":{".":{},"f:podAffinity":{".":{},"f:requiredDuringSchedulingIgnoredDuringExecution":{}},"f:podAntiAffinity":{".":{},"f:requiredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k:{\"name\":\"agnhost\"}":{".":{},"f:args":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}}} } {kube-controller-manager Update apps/v1 2022-12-02 23:31:01 +0000 UTC FieldsV1 {"f:status":{"f:fullyLabeledReplicas":{},"f:observedGeneration":{},"f:replicas":{}}} status}]},Spec:ReplicaSetSpec{Replicas:*1,Selector:&v1.LabelSelector{MatchLabels:map[string]string{name: test-rolling-update-with-lb,pod-template-hash: 5947fbdf64,},MatchExpressions:[]LabelSelectorRequirement{},},Template:{{ 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[iteration:1 name:test-rolling-update-with-lb pod-template-hash:5947fbdf64] map[] [] [] []} {[] [] [{agnhost k8s.gcr.io/e2e-test-images/agnhost:2.39 [] [netexec --http-port=80 --udp-port=80] [] [] [] {map[] map[]} [] [] nil nil nil nil /dev/termination-log File IfNotPresent SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,} false false false}] [] Always 0xc00325c2e8 <nil> ClusterFirst map[] <nil> false false false <nil> &PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,} [] &Affinity{NodeAffinity:nil,PodAffinity:&PodAffinity{RequiredDuringSchedulingIgnoredDuringExecution:[]PodAffinityTerm{PodAffinityTerm{LabelSelector:&v1.LabelSelector{MatchLabels:map[string]string{},MatchExpressions:[]LabelSelectorRequirement{LabelSelectorRequirement{Key:name,Operator:In,Values:[test-rolling-update-with-lb],},LabelSelectorRequirement{Key:iteration,Operator:NotIn,Values:[1],},},},Namespaces:[],TopologyKey:kubernetes.io/hostname,NamespaceSelector:nil,},},PreferredDuringSchedulingIgnoredDuringExecution:[]WeightedPodAffinityTerm{},},PodAntiAffinity:&PodAntiAffinity{RequiredDuringSchedulingIgnoredDuringExecution:[]PodAffinityTerm{PodAffinityTerm{LabelSelector:&v1.LabelSelector{MatchLabels:map[string]string{},MatchExpressions:[]LabelSelectorRequirement{LabelSelectorRequirement{Key:name,Operator:In,Values:[test-rolling-update-with-lb],},LabelSelectorRequirement{Key:iteration,Operator:In,Values:[1],},},},Namespaces:[],TopologyKey:kubernetes.io/hostname,NamespaceSelector:nil,},},PreferredDuringSchedulingIgnoredDuringExecution:[]WeightedPodAffinityTerm{},},} default-scheduler [] [] <nil> nil [] <nil> <nil> <nil> map[] [] <nil>}},MinReadySeconds:0,},Status:ReplicaSetStatus{Replicas:1,FullyLabeledReplicas:1,ObservedGeneration:1,ReadyReplicas:0,AvailableReplicas:0,Conditions:[]ReplicaSetCondition{},},} Dec 2 23:36:02.126: INFO: All old ReplicaSets of Deployment "test-rolling-update-with-lb": Dec 2 23:36:02.127: INFO: &ReplicaSet{ObjectMeta:{test-rolling-update-with-lb-7db9cf5ff8 deployment-400 211f9420-cdec-4985-8d62-10183e74c37e 21929 1 2022-12-02 23:27:40 +0000 UTC <nil> <nil> map[iteration:0 name:test-rolling-update-with-lb pod-template-hash:7db9cf5ff8] map[deployment.kubernetes.io/desired-replicas:3 deployment.kubernetes.io/max-replicas:4 deployment.kubernetes.io/revision:1] [{apps/v1 Deployment test-rolling-update-with-lb 138d2de1-15ba-42c0-81c3-1ad3f128cb40 0xc00325c367 0xc00325c368}] [] [{kube-controller-manager Update apps/v1 2022-12-02 23:27:40 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:deployment.kubernetes.io/desired-replicas":{},"f:deployment.kubernetes.io/max-replicas":{},"f:deployment.kubernetes.io/revision":{}},"f:labels":{".":{},"f:iteration":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"138d2de1-15ba-42c0-81c3-1ad3f128cb40\"}":{}}},"f:spec":{"f:replicas":{},"f:selector":{},"f:template":{"f:metadata":{"f:labels":{".":{},"f:iteration":{},"f:name":{},"f:pod-template-hash":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:requiredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k:{\"name\":\"agnhost\"}":{".":{},"f:args":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}}} } {kube-controller-manager Update apps/v1 2022-12-02 23:27:45 +0000 UTC FieldsV1 {"f:status":{"f:availableReplicas":{},"f:fullyLabeledReplicas":{},"f:observedGeneration":{},"f:readyReplicas":{},"f:replicas":{}}} status}]},Spec:ReplicaSetSpec{Replicas:*3,Selector:&v1.LabelSelector{MatchLabels:map[string]string{name: test-rolling-update-with-lb,pod-template-hash: 7db9cf5ff8,},MatchExpressions:[]LabelSelectorRequirement{},},Template:{{ 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[iteration:0 name:test-rolling-update-with-lb pod-template-hash:7db9cf5ff8] map[] [] [] []} {[] [] [{agnhost k8s.gcr.io/e2e-test-images/agnhost:2.39 [] [netexec --http-port=80 --udp-port=80] [] [] [] {map[] map[]} [] [] nil nil nil nil /dev/termination-log File IfNotPresent SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,} false false false}] [] Always 0xc00325c428 <nil> ClusterFirst map[] <nil> false false false <nil> &PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,} [] &Affinity{NodeAffinity:nil,PodAffinity:nil,PodAntiAffinity:&PodAntiAffinity{RequiredDuringSchedulingIgnoredDuringExecution:[]PodAffinityTerm{PodAffinityTerm{LabelSelector:&v1.LabelSelector{MatchLabels:map[string]string{},MatchExpressions:[]LabelSelectorRequirement{LabelSelectorRequirement{Key:name,Operator:In,Values:[test-rolling-update-with-lb],},LabelSelectorRequirement{Key:iteration,Operator:In,Values:[0],},},},Namespaces:[],TopologyKey:kubernetes.io/hostname,NamespaceSelector:nil,},},PreferredDuringSchedulingIgnoredDuringExecution:[]WeightedPodAffinityTerm{},},} default-scheduler [] [] <nil> nil [] <nil> <nil> <nil> map[] [] <nil>}},MinReadySeconds:0,},Status:ReplicaSetStatus{Replicas:3,FullyLabeledReplicas:3,ObservedGeneration:1,ReadyReplicas:3,AvailableReplicas:3,Conditions:[]ReplicaSetCondition{},},} Dec 2 23:36:02.195: INFO: Pod "test-rolling-update-with-lb-5947fbdf64-6nw2f" is not available: &Pod{ObjectMeta:{test-rolling-update-with-lb-5947fbdf64-6nw2f test-rolling-update-with-lb-5947fbdf64- deployment-400 022c5325-d423-47b0-840a-1b305d088e97 27656 0 2022-12-02 23:31:01 +0000 UTC <nil> <nil> map[iteration:1 name:test-rolling-update-with-lb pod-template-hash:5947fbdf64] map[] [{apps/v1 ReplicaSet test-rolling-update-with-lb-5947fbdf64 2d32d84b-5fa0-4df8-bc19-ec97a46338a4 0xc0033d8227 0xc0033d8228}] [] [{kube-controller-manager Update v1 2022-12-02 23:31:01 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:iteration":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"2d32d84b-5fa0-4df8-bc19-ec97a46338a4\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAffinity":{".":{},"f:requiredDuringSchedulingIgnoredDuringExecution":{}},"f:podAntiAffinity":{".":{},"f:requiredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k:{\"name\":\"agnhost\"}":{".":{},"f:args":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}} } {kubelet Update v1 2022-12-02 23:31:01 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:startTime":{}}} status}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-jhpls,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:agnhost,Image:k8s.gcr.io/e2e-test-images/agnhost:2.39,Command:[],Args:[netexec --http-port=80 --udp-port=80],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-jhpls,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:ip-172-20-41-32.us-west-2.compute.internal,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:&Affinity{NodeAffinity:nil,PodAffinity:&PodAffinity{RequiredDuringSchedulingIgnoredDuringExecution:[]PodAffinityTerm{PodAffinityTerm{LabelSelector:&v1.LabelSelector{MatchLabels:map[string]string{},MatchExpressions:[]LabelSelectorRequirement{LabelSelectorRequirement{Key:name,Operator:In,Values:[test-rolling-update-with-lb],},LabelSelectorRequirement{Key:iteration,Operator:NotIn,Values:[1],},},},Namespaces:[],TopologyKey:kubernetes.io/hostname,NamespaceSelector:nil,},},PreferredDuringSchedulingIgnoredDuringExecution:[]WeightedPodAffinityTerm{},},PodAntiAffinity:&PodAntiAffinity{RequiredDuringSchedulingIgnoredDuringExecution:[]PodAffinityTerm{PodAffinityTerm{LabelSelector:&v1.LabelSelector{MatchLabels:map[string]string{},MatchExpressions:[]LabelSelectorRequirement{LabelSelectorRequirement{Key:name,Operator:In,Values:[test-rolling-update-with-lb],},LabelSelectorRequirement{Key:iteration,Operator:In,Values:[1],},},},Namespaces:[],TopologyKey:kubernetes.io/hostname,NamespaceSelector:nil,},},PreferredDuringSchedulingIgnoredDuringExecution:[]WeightedPodAffinityTerm{},},},SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2022-12-02 23:31:01 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2022-12-02 23:31:01 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [agnhost],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2022-12-02 23:31:01 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [agnhost],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2022-12-02 23:31:01 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:172.20.41.32,PodIP:,StartTime:2022-12-02 23:31:01 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:agnhost,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ContainerCreating,Message:,},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:k8s.gcr.io/e2e-test-images/agnhost:2.39,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{},EphemeralContainerStatuses:[]ContainerStatus{},},} Dec 2 23:36:02.195: INFO: Pod "test-rolling-update-with-lb-7db9cf5ff8-grw6v" is available: &Pod{ObjectMeta:{test-rolling-update-with-lb-7db9cf5ff8-grw6v test-rolling-update-with-lb-7db9cf5ff8- deployment-400 18f6ea41-0120-45a8-8e35-6f05b53ec20d 20903 0 2022-12-02 23:27:40 +0000 UTC <nil> <nil> map[iteration:0 name:test-rolling-update-with-lb pod-template-hash:7db9cf5ff8] map[] [{apps/v1 ReplicaSet test-rolling-update-with-lb-7db9cf5ff8 211f9420-cdec-4985-8d62-10183e74c37e 0xc0033d8447 0xc0033d8448}] [] [{kube-controller-manager Update v1 2022-12-02 23:27:40 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:iteration":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"211f9420-cdec-4985-8d62-10183e74c37e\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:requiredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k:{\"name\":\"agnhost\"}":{".":{},"f:args":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}} } {kubelet Update v1 2022-12-02 23:27:45 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:phase":{},"f:podIP":{},"f:podIPs":{".":{},"k:{\"ip\":\"172.20.59.198\"}":{".":{},"f:ip":{}}},"f:startTime":{}}} status}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-79mbv,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:agnhost,Image:k8s.gcr.io/e2e-test-images/agnhost:2.39,Command:[],Args:[netexec --http-port=80 --udp-port=80],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-79mbv,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:ip-172-20-41-32.us-west-2.compute.internal,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:&Affinity{NodeAffinity:nil,PodAffinity:nil,PodAntiAffinity:&PodAntiAffinity{RequiredDuringSchedulingIgnoredDuringExecution:[]PodAffinityTerm{PodAffinityTerm{LabelSelector:&v1.LabelSelector{MatchLabels:map[string]string{},MatchExpressions:[]LabelSelectorRequirement{LabelSelectorRequirement{Key:name,Operator:In,Values:[test-rolling-update-with-lb],},LabelSelectorRequirement{Key:iteration,Operator:In,Values:[0],},},},Namespaces:[],TopologyKey:kubernetes.io/hostname,NamespaceSelector:nil,},},PreferredDuringSchedulingIgnoredDuringExecution:[]WeightedPodAffinityTerm{},},},SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,},Status:PodStatus{Phase:Running,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2022-12-02 23:27:40 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2022-12-02 23:27:43 +0000 UTC,Reason:,Message:,},PodCondition{Type:ContainersReady,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2022-12-02 23:27:43 +0000 UTC,Reason:,Message:,},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2022-12-02 23:27:40 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:172.20.41.32,PodIP:172.20.59.198,StartTime:2022-12-02 23:27:40 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:agnhost,State:ContainerState{Waiting:nil,Running:&ContainerStateRunning{StartedAt:2022-12-02 23:27:43 +0000 UTC,},Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:true,RestartCount:0,Image:k8s.gcr.io/e2e-test-images/agnhost:2.39,ImageID:k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e,ContainerID:containerd://437f948a428a53574cf112b28b86dca1e79adf8c51828cc27363b786e0804e1e,Started:*true,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{PodIP{IP:172.20.59.198,},},EphemeralContainerStatuses:[]ContainerStatus{},},} Dec 2 23:36:02.196: INFO: Pod "test-rolling-update-with-lb-7db9cf5ff8-rqg95" is available: &Pod{ObjectMeta:{test-rolling-update-with-lb-7db9cf5ff8-rqg95 test-rolling-update-with-lb-7db9cf5ff8- deployment-400 c32863a6-32a3-4f06-a2c9-c8b33ef0da4c 21928 0 2022-12-02 23:27:40 +0000 UTC <nil> <nil> map[iteration:0 name:test-rolling-update-with-lb pod-template-hash:7db9cf5ff8] map[] [{apps/v1 ReplicaSet test-rolling-update-with-lb-7db9cf5ff8 211f9420-cdec-4985-8d62-10183e74c37e 0xc0033d8667 0xc0033d8668}] [] [{kube-controller-manager Update v1 2022-12-02 23:27:40 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:iteration":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"211f9420-cdec-4985-8d62-10183e74c37e\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:requiredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k:{\"name\":\"agnhost\"}":{".":{},"f:args":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}} } {kubelet Update v1 2022-12-02 23:28:10 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:phase":{},"f:podIP":{},"f:podIPs":{".":{},"k:{\"ip\":\"172.20.51.30\"}":{".":{},"f:ip":{}}},"f:startTime":{}}} status}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-f5d5q,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:agnhost,Image:k8s.gcr.io/e2e-test-images/agnhost:2.39,Command:[],Args:[netexec --http-port=80 --udp-port=80],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-f5d5q,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:ip-172-20-48-5.us-west-2.compute.internal,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:&Affinity{NodeAffinity:nil,PodAffinity:nil,PodAntiAffinity:&PodAntiAffinity{RequiredDuringSchedulingIgnoredDuringExecution:[]PodAffinityTerm{PodAffinityTerm{LabelSelector:&v1.LabelSelector{MatchLabels:map[string]string{},MatchExpressions:[]LabelSelectorRequirement{LabelSelectorRequirement{Key:name,Operator:In,Values:[test-rolling-update-with-lb],},LabelSelectorRequirement{Key:iteration,Operator:In,Values:[0],},},},Namespaces:[],TopologyKey:kubernetes.io/hostname,NamespaceSelector:nil,},},PreferredDuringSchedulingIgnoredDuringExecution:[]WeightedPodAffinityTerm{},},},SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,},Status:PodStatus{Phase:Running,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2022-12-02 23:27:40 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2022-12-02 23:28:10 +0000 UTC,Reason:,Message:,},PodCondition{Type:ContainersReady,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2022-12-02 23:28:10 +0000 UTC,Reason:,Message:,},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2022-12-02 23:27:40 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:172.20.48.5,PodIP:172.20.51.30,StartTime:2022-12-02 23:27:40 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:agnhost,State:ContainerState{Waiting:nil,Running:&ContainerStateRunning{StartedAt:2022-12-02 23:28:10 +0000 UTC,},Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:true,RestartCount:0,Image:k8s.gcr.io/e2e-test-images/agnhost:2.39,ImageID:k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e,ContainerID:containerd://60dfb0f7cfd700827d1a506edbdf18cb4ec054c23b54c7e70b275d71060db2e5,Started:*true,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{PodIP{IP:172.20.51.30,},},EphemeralContainerStatuses:[]ContainerStatus{},},} Dec 2 23:36:02.196: INFO: Pod "test-rolling-update-with-lb-7db9cf5ff8-ssh9v" is available: &Pod{ObjectMeta:{test-rolling-update-with-lb-7db9cf5ff8-ssh9v test-rolling-update-with-lb-7db9cf5ff8- deployment-400 c00f202d-2e7f-438d-8090-5f89e9703ab7 20938 0 2022-12-02 23:27:40 +0000 UTC <nil> <nil> map[iteration:0 name:test-rolling-update-with-lb pod-template-hash:7db9cf5ff8] map[] [{apps/v1 ReplicaSet test-rolling-update-with-lb-7db9cf5ff8 211f9420-cdec-4985-8d62-10183e74c37e 0xc0033d8887 0xc0033d8888}] [] [{kube-controller-manager Update v1 2022-12-02 23:27:40 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:iteration":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"211f9420-cdec-4985-8d62-10183e74c37e\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:requiredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k:{\"name\":\"agnhost\"}":{".":{},"f:args":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}} } {kubelet Update v1 2022-12-02 23:27:46 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:phase":{},"f:podIP":{},"f:podIPs":{".":{},"k:{\"ip\":\"172.20.53.213\"}":{".":{},"f:ip":{}}},"f:startTime":{}}} status}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-qb2mb,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:agnhost,Image:k8s.gcr.io/e2e-test-images/agnhost:2.39,Command:[],Args:[netexec --http-port=80 --udp-port=80],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-qb2mb,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:ip-172-20-33-254.us-west-2.compute.internal,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:&Affinity{NodeAffinity:nil,PodAffinity:nil,PodAntiAffinity:&PodAntiAffinity{RequiredDuringSchedulingIgnoredDuringExecution:[]PodAffinityTerm{PodAffinityTerm{LabelSelector:&v1.LabelSelector{MatchLabels:map[string]string{},MatchExpressions:[]LabelSelectorRequirement{LabelSelectorRequirement{Key:name,Operator:In,Values:[test-rolling-update-with-lb],},LabelSelectorRequirement{Key:iteration,Operator:In,Values:[0],},},},Namespaces:[],TopologyKey:kubernetes.io/hostname,NamespaceSelector:nil,},},PreferredDuringSchedulingIgnoredDuringExecution:[]WeightedPodAffinityTerm{},},},SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,},Status:PodStatus{Phase:Running,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2022-12-02 23:27:40 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2022-12-02 23:27:44 +0000 UTC,Reason:,Message:,},PodCondition{Type:ContainersReady,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2022-12-02 23:27:44 +0000 UTC,Reason:,Message:,},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2022-12-02 23:27:40 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:172.20.33.254,PodIP:172.20.53.213,StartTime:2022-12-02 23:27:40 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:agnhost,State:ContainerState{Waiting:nil,Running:&ContainerStateRunning{StartedAt:2022-12-02 23:27:43 +0000 UTC,},Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:true,RestartCount:0,Image:k8s.gcr.io/e2e-test-images/agnhost:2.39,ImageID:k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e,ContainerID:containerd://516ced72f78a5289990fd67b1bda5c24da36a79655c474aff13e6233dff27c2e,Started:*true,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{PodIP{IP:172.20.53.213,},},EphemeralContainerStatuses:[]ContainerStatus{},},} [AfterEach] [sig-apps] Deployment /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "deployment-400". �[1mSTEP�[0m: Found 38 events. Dec 2 23:36:02.267: INFO: At 2022-12-02 23:27:40 +0000 UTC - event for test-rolling-update-with-lb: {deployment-controller } ScalingReplicaSet: Scaled up replica set test-rolling-update-with-lb-7db9cf5ff8 to 3 Dec 2 23:36:02.267: INFO: At 2022-12-02 23:27:40 +0000 UTC - event for test-rolling-update-with-lb-7db9cf5ff8: {replicaset-controller } SuccessfulCreate: Created pod: test-rolling-update-with-lb-7db9cf5ff8-rqg95 Dec 2 23:36:02.267: INFO: At 2022-12-02 23:27:40 +0000 UTC - event for test-rolling-update-with-lb-7db9cf5ff8: {replicaset-controller } SuccessfulCreate: Created pod: test-rolling-update-with-lb-7db9cf5ff8-ssh9v Dec 2 23:36:02.267: INFO: At 2022-12-02 23:27:40 +0000 UTC - event for test-rolling-update-with-lb-7db9cf5ff8: {replicaset-controller } SuccessfulCreate: Created pod: test-rolling-update-with-lb-7db9cf5ff8-grw6v Dec 2 23:36:02.267: INFO: At 2022-12-02 23:27:40 +0000 UTC - event for test-rolling-update-with-lb-7db9cf5ff8-grw6v: {default-scheduler } Scheduled: Successfully assigned deployment-400/test-rolling-update-with-lb-7db9cf5ff8-grw6v to ip-172-20-41-32.us-west-2.compute.internal Dec 2 23:36:02.267: INFO: At 2022-12-02 23:27:40 +0000 UTC - event for test-rolling-update-with-lb-7db9cf5ff8-rqg95: {default-scheduler } Scheduled: Successfully assigned deployment-400/test-rolling-update-with-lb-7db9cf5ff8-rqg95 to ip-172-20-48-5.us-west-2.compute.internal Dec 2 23:36:02.267: INFO: At 2022-12-02 23:27:40 +0000 UTC - event for test-rolling-update-with-lb-7db9cf5ff8-ssh9v: {default-scheduler } Scheduled: Successfully assigned deployment-400/test-rolling-update-with-lb-7db9cf5ff8-ssh9v to ip-172-20-33-254.us-west-2.compute.internal Dec 2 23:36:02.267: INFO: At 2022-12-02 23:27:42 +0000 UTC - event for test-rolling-update-with-lb-7db9cf5ff8-rqg95: {kubelet ip-172-20-48-5.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "9477b53fe918b3572f4bdddf9013ffd0a59266b9556a9d333804324e694d2ef0": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:36:02.267: INFO: At 2022-12-02 23:27:42 +0000 UTC - event for test-rolling-update-with-lb-7db9cf5ff8-ssh9v: {kubelet ip-172-20-33-254.us-west-2.compute.internal} Pulled: Container image "k8s.gcr.io/e2e-test-images/agnhost:2.39" already present on machine Dec 2 23:36:02.267: INFO: At 2022-12-02 23:27:43 +0000 UTC - event for test-rolling-update-with-lb-7db9cf5ff8-grw6v: {kubelet ip-172-20-41-32.us-west-2.compute.internal} Created: Created container agnhost Dec 2 23:36:02.267: INFO: At 2022-12-02 23:27:43 +0000 UTC - event for test-rolling-update-with-lb-7db9cf5ff8-grw6v: {kubelet ip-172-20-41-32.us-west-2.compute.internal} Pulled: Container image "k8s.gcr.io/e2e-test-images/agnhost:2.39" already present on machine Dec 2 23:36:02.267: INFO: At 2022-12-02 23:27:43 +0000 UTC - event for test-rolling-update-with-lb-7db9cf5ff8-grw6v: {kubelet ip-172-20-41-32.us-west-2.compute.internal} Started: Started container agnhost Dec 2 23:36:02.267: INFO: At 2022-12-02 23:27:43 +0000 UTC - event for test-rolling-update-with-lb-7db9cf5ff8-ssh9v: {kubelet ip-172-20-33-254.us-west-2.compute.internal} Started: Started container agnhost Dec 2 23:36:02.267: INFO: At 2022-12-02 23:27:43 +0000 UTC - event for test-rolling-update-with-lb-7db9cf5ff8-ssh9v: {kubelet ip-172-20-33-254.us-west-2.compute.internal} Created: Created container agnhost Dec 2 23:36:02.267: INFO: At 2022-12-02 23:27:56 +0000 UTC - event for test-rolling-update-with-lb-7db9cf5ff8-rqg95: {kubelet ip-172-20-48-5.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "76b4060cb54cd0c697bbaddfe7606d86631313dc3f9bbb4fce598dcee9fde1ae": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:36:02.267: INFO: At 2022-12-02 23:28:10 +0000 UTC - event for test-rolling-update-with-lb: {service-controller } EnsuringLoadBalancer: Ensuring load balancer Dec 2 23:36:02.267: INFO: At 2022-12-02 23:28:10 +0000 UTC - event for test-rolling-update-with-lb-7db9cf5ff8-rqg95: {kubelet ip-172-20-48-5.us-west-2.compute.internal} Created: Created container agnhost Dec 2 23:36:02.267: INFO: At 2022-12-02 23:28:10 +0000 UTC - event for test-rolling-update-with-lb-7db9cf5ff8-rqg95: {kubelet ip-172-20-48-5.us-west-2.compute.internal} Started: Started container agnhost Dec 2 23:36:02.267: INFO: At 2022-12-02 23:28:10 +0000 UTC - event for test-rolling-update-with-lb-7db9cf5ff8-rqg95: {kubelet ip-172-20-48-5.us-west-2.compute.internal} Pulled: Container image "k8s.gcr.io/e2e-test-images/agnhost:2.39" already present on machine Dec 2 23:36:02.267: INFO: At 2022-12-02 23:28:12 +0000 UTC - event for test-rolling-update-with-lb: {service-controller } SyncLoadBalancerFailed: Error syncing load balancer: failed to ensure load balancer: Unable to update load balancer attributes during attribute sync: "AccessDenied: User: arn:aws:sts::768319786644:assumed-role/masters.e2e-e2e-kops-grid-cilium-eni-u2004-k22.test-cncf--48p7ga/i-0725cfbb3e93e664c is not authorized to perform: elasticloadbalancing:ModifyLoadBalancerAttributes on resource: arn:aws:elasticloadbalancing:us-west-2:768319786644:loadbalancer/af35b29d62784448cbb45c9e3a706682 because no identity-based policy allows the elasticloadbalancing:ModifyLoadBalancerAttributes action\n\tstatus code: 403, request id: 3586eead-920e-49af-bfa1-0dc9a56daeb8" Dec 2 23:36:02.267: INFO: At 2022-12-02 23:28:18 +0000 UTC - event for test-rolling-update-with-lb: {service-controller } SyncLoadBalancerFailed: Error syncing load balancer: failed to ensure load balancer: Unable to update load balancer attributes during attribute sync: "AccessDenied: User: arn:aws:sts::768319786644:assumed-role/masters.e2e-e2e-kops-grid-cilium-eni-u2004-k22.test-cncf--48p7ga/i-0725cfbb3e93e664c is not authorized to perform: elasticloadbalancing:ModifyLoadBalancerAttributes on resource: arn:aws:elasticloadbalancing:us-west-2:768319786644:loadbalancer/af35b29d62784448cbb45c9e3a706682 because no identity-based policy allows the elasticloadbalancing:ModifyLoadBalancerAttributes action\n\tstatus code: 403, request id: b96d2f67-fa11-4286-970e-9aeac2f98234" Dec 2 23:36:02.267: INFO: At 2022-12-02 23:28:28 +0000 UTC - event for test-rolling-update-with-lb: {service-controller } SyncLoadBalancerFailed: Error syncing load balancer: failed to ensure load balancer: Unable to update load balancer attributes during attribute sync: "AccessDenied: User: arn:aws:sts::768319786644:assumed-role/masters.e2e-e2e-kops-grid-cilium-eni-u2004-k22.test-cncf--48p7ga/i-0725cfbb3e93e664c is not authorized to perform: elasticloadbalancing:ModifyLoadBalancerAttributes on resource: arn:aws:elasticloadbalancing:us-west-2:768319786644:loadbalancer/af35b29d62784448cbb45c9e3a706682 because no identity-based policy allows the elasticloadbalancing:ModifyLoadBalancerAttributes action\n\tstatus code: 403, request id: ba2b84fe-4d93-4938-8a11-a82260eed74f" Dec 2 23:36:02.267: INFO: At 2022-12-02 23:28:48 +0000 UTC - event for test-rolling-update-with-lb: {service-controller } SyncLoadBalancerFailed: Error syncing load balancer: failed to ensure load balancer: Unable to update load balancer attributes during attribute sync: "AccessDenied: User: arn:aws:sts::768319786644:assumed-role/masters.e2e-e2e-kops-grid-cilium-eni-u2004-k22.test-cncf--48p7ga/i-0725cfbb3e93e664c is not authorized to perform: elasticloadbalancing:ModifyLoadBalancerAttributes on resource: arn:aws:elasticloadbalancing:us-west-2:768319786644:loadbalancer/af35b29d62784448cbb45c9e3a706682 because no identity-based policy allows the elasticloadbalancing:ModifyLoadBalancerAttributes action\n\tstatus code: 403, request id: bca44dd9-d7c6-4f88-b3c6-89fe388d0677" Dec 2 23:36:02.267: INFO: At 2022-12-02 23:29:29 +0000 UTC - event for test-rolling-update-with-lb: {service-controller } SyncLoadBalancerFailed: Error syncing load balancer: failed to ensure load balancer: Unable to update load balancer attributes during attribute sync: "AccessDenied: User: arn:aws:sts::768319786644:assumed-role/masters.e2e-e2e-kops-grid-cilium-eni-u2004-k22.test-cncf--48p7ga/i-0725cfbb3e93e664c is not authorized to perform: elasticloadbalancing:ModifyLoadBalancerAttributes on resource: arn:aws:elasticloadbalancing:us-west-2:768319786644:loadbalancer/af35b29d62784448cbb45c9e3a706682 because no identity-based policy allows the elasticloadbalancing:ModifyLoadBalancerAttributes action\n\tstatus code: 403, request id: db8ab2e5-45e0-44d4-82fb-c449bcb12451" Dec 2 23:36:02.267: INFO: At 2022-12-02 23:30:50 +0000 UTC - event for test-rolling-update-with-lb: {service-controller } EnsuredLoadBalancer: Ensured load balancer Dec 2 23:36:02.267: INFO: At 2022-12-02 23:31:01 +0000 UTC - event for test-rolling-update-with-lb: {deployment-controller } ScalingReplicaSet: Scaled up replica set test-rolling-update-with-lb-5947fbdf64 to 1 Dec 2 23:36:02.267: INFO: At 2022-12-02 23:31:01 +0000 UTC - event for test-rolling-update-with-lb-5947fbdf64: {replicaset-controller } SuccessfulCreate: Created pod: test-rolling-update-with-lb-5947fbdf64-6nw2f Dec 2 23:36:02.267: INFO: At 2022-12-02 23:31:01 +0000 UTC - event for test-rolling-update-with-lb-5947fbdf64-6nw2f: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "39d3f70c1122c1462a5d9439605fe0034c5134a2e91dff9c66778e9202da2157": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:36:02.267: INFO: At 2022-12-02 23:31:01 +0000 UTC - event for test-rolling-update-with-lb-5947fbdf64-6nw2f: {default-scheduler } Scheduled: Successfully assigned deployment-400/test-rolling-update-with-lb-5947fbdf64-6nw2f to ip-172-20-41-32.us-west-2.compute.internal Dec 2 23:36:02.267: INFO: At 2022-12-02 23:31:14 +0000 UTC - event for test-rolling-update-with-lb-5947fbdf64-6nw2f: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "dd97893b2b34a7d943d0ac2a32dabf153ad397176f42cd95ece07230deb7e529": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:36:02.267: INFO: At 2022-12-02 23:31:29 +0000 UTC - event for test-rolling-update-with-lb-5947fbdf64-6nw2f: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "34536e67c118d04fb56b6496f550aefcc6399ab657d856ad76c322a3087f1a63": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:36:02.267: INFO: At 2022-12-02 23:31:42 +0000 UTC - event for test-rolling-update-with-lb-5947fbdf64-6nw2f: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a2d5fe9c1ac69e9ca6b552e6874441f46a54d691ad5662ea9724391c79bd6f63": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:36:02.267: INFO: At 2022-12-02 23:31:54 +0000 UTC - event for test-rolling-update-with-lb-5947fbdf64-6nw2f: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ad20ee98b5e3bf0eed21c27faa1ea30f21119ce981539410e6e25d875d0f395f": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:36:02.267: INFO: At 2022-12-02 23:32:07 +0000 UTC - event for test-rolling-update-with-lb-5947fbdf64-6nw2f: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "df175d1d990c0835ec3a3a720a5e2e3b9e41cb68aab3730de763e04d1a2f41e0": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:36:02.267: INFO: At 2022-12-02 23:32:19 +0000 UTC - event for test-rolling-update-with-lb-5947fbdf64-6nw2f: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "62aa3dd5596131cf98c62028b97349e1e227e392eafa27a848eab0e0dc77c71c": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:36:02.267: INFO: At 2022-12-02 23:32:30 +0000 UTC - event for test-rolling-update-with-lb-5947fbdf64-6nw2f: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "671b260ce4a29e3eec59d02c4069e31fe89138b38ce60e93d35da9c522b7dddf": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:36:02.267: INFO: At 2022-12-02 23:32:41 +0000 UTC - event for test-rolling-update-with-lb-5947fbdf64-6nw2f: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a47777ce845225a95715c370bea916fc99e93164d1c32c6a6349ff59baf6a27a": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:36:02.267: INFO: At 2022-12-02 23:32:55 +0000 UTC - event for test-rolling-update-with-lb-5947fbdf64-6nw2f: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "149c31045219d0b64810d252690027520368a398b6b739b1748973f9bed213b4": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:36:02.335: INFO: POD NODE PHASE GRACE CONDITIONS Dec 2 23:36:02.335: INFO: test-rolling-update-with-lb-5947fbdf64-6nw2f ip-172-20-41-32.us-west-2.compute.internal Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:31:01 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:31:01 +0000 UTC ContainersNotReady containers with unready status: [agnhost]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:31:01 +0000 UTC ContainersNotReady containers with unready status: [agnhost]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:31:01 +0000 UTC }] Dec 2 23:36:02.335: INFO: test-rolling-update-with-lb-7db9cf5ff8-grw6v ip-172-20-41-32.us-west-2.compute.internal Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:27:40 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:27:43 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:27:43 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:27:40 +0000 UTC }] Dec 2 23:36:02.335: INFO: test-rolling-update-with-lb-7db9cf5ff8-rqg95 ip-172-20-48-5.us-west-2.compute.internal Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:27:40 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:28:10 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:28:10 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:27:40 +0000 UTC }] Dec 2 23:36:02.335: INFO: test-rolling-update-with-lb-7db9cf5ff8-ssh9v ip-172-20-33-254.us-west-2.compute.internal Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:27:40 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:27:44 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:27:44 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:27:40 +0000 UTC }] Dec 2 23:36:02.335: INFO: Dec 2 23:36:02.404: INFO: Logging node info for node ip-172-20-33-254.us-west-2.compute.internal Dec 2 23:36:02.472: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-33-254.us-west-2.compute.internal 6236393f-0a33-4aea-a2e2-fedaf7becdd4 29305 0 2022-12-02 23:17:15 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-33-254.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:ip-172-20-33-254.us-west-2.compute.internal topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0d507bb204448139f"} io.cilium.network.ipv4-cilium-host:172.20.42.35 io.cilium.network.ipv4-health-ip:172.20.58.176 io.cilium.network.ipv4-pod-cidr:100.96.1.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2022-12-02 23:17:15 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2022-12-02 23:17:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-12-02 23:17:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {cilium-agent Update v1 2022-12-02 23:17:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-12-02 23:17:41 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {e2e.test Update v1 2022-12-02 23:29:34 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2022-12-02 23:30:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-0d507bb204448139f,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-02 23:17:41 +0000 UTC,LastTransitionTime:2022-12-02 23:17:41 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-02 23:35:16 +0000 UTC,LastTransitionTime:2022-12-02 23:17:15 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-02 23:35:16 +0000 UTC,LastTransitionTime:2022-12-02 23:17:15 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-02 23:35:16 +0000 UTC,LastTransitionTime:2022-12-02 23:17:15 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-02 23:35:16 +0000 UTC,LastTransitionTime:2022-12-02 23:17:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.33.254,},NodeAddress{Type:ExternalIP,Address:54.190.128.11,},NodeAddress{Type:Hostname,Address:ip-172-20-33-254.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-33-254.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-190-128-11.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23ec8dd062be253828b6092e22eaab,SystemUUID:ec23ec8d-d062-be25-3828-b6092e22eaab,BootID:6bbf84c7-41f9-4141-912e-7f3bc9a0ef42,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.13,KubeletVersion:v1.22.16,KubeProxyVersion:v1.22.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:160382894,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.22.16],SizeBytes:105446599,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:1f36a24cfb5e0c3f725d7565a867c2384282fcbeccc77b07b423c9da95763a9a k8s.gcr.io/e2e-test-images/nautilus:1.4],SizeBytes:49230179,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:716d2f68314c5c4ddd5ecdb45183fcb4ed8019015982c1321571f863989b70b0 k8s.gcr.io/e2e-test-images/httpd:2.4.39-1],SizeBytes:41902332,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:b913fa234cc3473cfe16e937d106b455a7609f927f59031c81aca791e2689b50 k8s.gcr.io/e2e-test-images/httpd:2.4.38-1],SizeBytes:40765006,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:28956694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonroot@sha256:4051e85640c22f8e00c34dbd273576fc9e1e2829992656588062be9c0f69b04b k8s.gcr.io/e2e-test-images/nonroot:1.1],SizeBytes:17748448,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:aa60f453d64dfb3c3fd9e7306f988c36c6352c4f2d956aa90467f2808091effa registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.5],SizeBytes:15209420,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:1b7c978a792a8fa4e96244e8059bd71bb49b07e2e5a897fb0c867bdc6db20d5d k8s.gcr.io/sig-storage/livenessprobe:v2.3.0],SizeBytes:7933739,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:503b7abb89e57383eba61cc8a9cb0b495ea575c516108f7d972a6ff6e1ab3c9b k8s.gcr.io/e2e-test-images/nginx:1.14-1],SizeBytes:6979365,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:1ff6c18fbef2045af6b9c16bf034cc421a29027b800e4f9b68ae9b1cb3e9ae07 k8s.gcr.io/pause:3.5],SizeBytes:301416,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 2 23:36:02.472: INFO: Logging kubelet events for node ip-172-20-33-254.us-west-2.compute.internal Dec 2 23:36:02.542: INFO: Logging pods the kubelet thinks is on node ip-172-20-33-254.us-west-2.compute.internal Dec 2 23:36:02.622: INFO: coredns-autoscaler-6658b4bf85-4zgd2 started at 2022-12-02 23:17:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:02.622: INFO: Container autoscaler ready: true, restart count 0 Dec 2 23:36:02.622: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-9dq9t started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:02.622: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: false, restart count 0 Dec 2 23:36:02.622: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-t5msn started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:02.622: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:02.622: INFO: pod-6287b838-7e39-4bff-9b2c-7278de9a6392 started at 2022-12-02 23:33:40 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:02.622: INFO: Container write-pod ready: false, restart count 0 Dec 2 23:36:02.622: INFO: test-rolling-update-with-lb-7db9cf5ff8-ssh9v started at 2022-12-02 23:27:40 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:02.622: INFO: Container agnhost ready: true, restart count 0 Dec 2 23:36:02.622: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-mtms5 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:02.622: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:02.622: INFO: netserver-0 started at 2022-12-02 23:29:40 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:02.622: INFO: Container webserver ready: true, restart count 0 Dec 2 23:36:02.622: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-svqb9 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:02.622: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:02.622: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-pt8v2 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:02.622: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: false, restart count 0 Dec 2 23:36:02.622: INFO: netserver-0 started at 2022-12-02 23:33:50 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:02.622: INFO: Container webserver ready: false, restart count 0 Dec 2 23:36:02.622: INFO: ebs-csi-node-rfgvb started at 2022-12-02 23:17:16 +0000 UTC (0+3 container statuses recorded) Dec 2 23:36:02.622: INFO: Container ebs-plugin ready: true, restart count 0 Dec 2 23:36:02.622: INFO: Container liveness-probe ready: true, restart count 0 Dec 2 23:36:02.622: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 2 23:36:02.622: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-gfh2n started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:02.622: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:02.622: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-f2d26 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:02.622: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:02.622: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-jnmvg started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:02.622: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:02.622: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-cf58b started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:02.622: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:02.622: INFO: cilium-2db9c started at 2022-12-02 23:17:16 +0000 UTC (1+1 container statuses recorded) Dec 2 23:36:02.622: INFO: Init container clean-cilium-state ready: true, restart count 0 Dec 2 23:36:02.622: INFO: Container cilium-agent ready: true, restart count 0 Dec 2 23:36:02.622: INFO: coredns-5fcc7b6498-8nvj5 started at 2022-12-02 23:17:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:02.622: INFO: Container coredns ready: true, restart count 0 Dec 2 23:36:02.622: INFO: hostexec-ip-172-20-33-254.us-west-2.compute.internal-w7cc4 started at 2022-12-02 23:29:31 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:02.622: INFO: Container agnhost-container ready: true, restart count 0 Dec 2 23:36:02.622: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-d4f7q started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:02.622: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:02.622: INFO: netserver-0 started at 2022-12-02 23:35:10 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:02.622: INFO: Container webserver ready: false, restart count 0 Dec 2 23:36:02.989: INFO: Latency metrics for node ip-172-20-33-254.us-west-2.compute.internal Dec 2 23:36:02.989: INFO: Logging node info for node ip-172-20-40-67.us-west-2.compute.internal Dec 2 23:36:03.058: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-40-67.us-west-2.compute.internal 0a5fe428-9a11-4bd2-96f1-21d4d188f80f 28496 0 2022-12-02 23:15:37 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-40-67.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/control-plane: node-role.kubernetes.io/master: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:us-west-2a topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0725cfbb3e93e664c"} io.cilium.network.ipv4-cilium-host:172.20.59.109 io.cilium.network.ipv4-health-ip:172.20.51.231 io.cilium.network.ipv4-pod-cidr:100.96.0.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-12-02 23:15:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {protokube Update v1 2022-12-02 23:16:01 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kops-controller Update v1 2022-12-02 23:16:07 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/master":{}}}} } {kube-controller-manager Update v1 2022-12-02 23:16:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {cilium-agent Update v1 2022-12-02 23:17:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-12-02 23:17:36 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-12-02 23:17:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-0725cfbb3e93e664c,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892301824 0} {<nil>} 3801076Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787444224 0} {<nil>} 3698676Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-02 23:17:36 +0000 UTC,LastTransitionTime:2022-12-02 23:17:36 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-02 23:33:27 +0000 UTC,LastTransitionTime:2022-12-02 23:15:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-02 23:33:27 +0000 UTC,LastTransitionTime:2022-12-02 23:15:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-02 23:33:27 +0000 UTC,LastTransitionTime:2022-12-02 23:15:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-02 23:33:27 +0000 UTC,LastTransitionTime:2022-12-02 23:16:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.40.67,},NodeAddress{Type:ExternalIP,Address:34.213.81.56,},NodeAddress{Type:Hostname,Address:ip-172-20-40-67.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-40-67.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-34-213-81-56.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2bdc536f1fb98cbe397162835bf7b5,SystemUUID:ec2bdc53-6f1f-b98c-be39-7162835bf7b5,BootID:80f23ad2-0f99-46af-8080-253547cd7440,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.13,KubeletVersion:v1.22.16,KubeProxyVersion:v1.22.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:a91fdaf9b988943a9c73d422348c2383c08dfc2566d4124a39a1b3d785018720 registry.k8s.io/etcdadm/etcd-manager:v3.0.20220831],SizeBytes:216515768,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:160382894,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.22.16],SizeBytes:129618394,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.22.16],SizeBytes:123306305,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.22.16],SizeBytes:105446599,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.22.16],SizeBytes:53956920,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-alpha.2],SizeBytes:42210956,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-alpha.2],SizeBytes:41463728,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:28956694,},ContainerImage{Names:[quay.io/cilium/operator@sha256:e2b26376a904190c73498e04bd5c1298a4c5239d50feab024074e4516381890f quay.io/cilium/operator:v1.11.11],SizeBytes:24003684,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-alpha.2],SizeBytes:4954596,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 2 23:36:03.058: INFO: Logging kubelet events for node ip-172-20-40-67.us-west-2.compute.internal Dec 2 23:36:03.128: INFO: Logging pods the kubelet thinks is on node ip-172-20-40-67.us-west-2.compute.internal Dec 2 23:36:03.265: INFO: kube-apiserver-ip-172-20-40-67.us-west-2.compute.internal started at 2022-12-02 23:14:53 +0000 UTC (0+2 container statuses recorded) Dec 2 23:36:03.265: INFO: Container healthcheck ready: true, restart count 0 Dec 2 23:36:03.265: INFO: Container kube-apiserver ready: true, restart count 1 Dec 2 23:36:03.265: INFO: cilium-operator-587dd66f87-zmwpl started at 2022-12-02 23:16:04 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:03.265: INFO: Container cilium-operator ready: true, restart count 1 Dec 2 23:36:03.265: INFO: ebs-csi-controller-764b64d679-rnjp4 started at 2022-12-02 23:16:04 +0000 UTC (0+5 container statuses recorded) Dec 2 23:36:03.265: INFO: Container csi-attacher ready: true, restart count 0 Dec 2 23:36:03.265: INFO: Container csi-provisioner ready: true, restart count 0 Dec 2 23:36:03.265: INFO: Container csi-resizer ready: true, restart count 0 Dec 2 23:36:03.265: INFO: Container ebs-plugin ready: true, restart count 0 Dec 2 23:36:03.265: INFO: Container liveness-probe ready: true, restart count 0 Dec 2 23:36:03.265: INFO: ebs-csi-node-jt6f2 started at 2022-12-02 23:16:04 +0000 UTC (0+3 container statuses recorded) Dec 2 23:36:03.265: INFO: Container ebs-plugin ready: true, restart count 0 Dec 2 23:36:03.265: INFO: Container liveness-probe ready: true, restart count 0 Dec 2 23:36:03.265: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 2 23:36:03.265: INFO: cilium-t57cd started at 2022-12-02 23:16:04 +0000 UTC (1+1 container statuses recorded) Dec 2 23:36:03.265: INFO: Init container clean-cilium-state ready: true, restart count 0 Dec 2 23:36:03.265: INFO: Container cilium-agent ready: true, restart count 1 Dec 2 23:36:03.265: INFO: kops-controller-47skn started at 2022-12-02 23:16:04 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:03.265: INFO: Container kops-controller ready: true, restart count 0 Dec 2 23:36:03.265: INFO: dns-controller-5fb778d9d5-fln22 started at 2022-12-02 23:16:04 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:03.265: INFO: Container dns-controller ready: true, restart count 0 Dec 2 23:36:03.265: INFO: etcd-manager-main-ip-172-20-40-67.us-west-2.compute.internal started at 2022-12-02 23:14:53 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:03.265: INFO: Container etcd-manager ready: true, restart count 0 Dec 2 23:36:03.265: INFO: kube-controller-manager-ip-172-20-40-67.us-west-2.compute.internal started at 2022-12-02 23:14:53 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:03.265: INFO: Container kube-controller-manager ready: true, restart count 2 Dec 2 23:36:03.265: INFO: kube-scheduler-ip-172-20-40-67.us-west-2.compute.internal started at 2022-12-02 23:14:53 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:03.265: INFO: Container kube-scheduler ready: true, restart count 0 Dec 2 23:36:03.265: INFO: etcd-manager-events-ip-172-20-40-67.us-west-2.compute.internal started at 2022-12-02 23:14:53 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:03.265: INFO: Container etcd-manager ready: true, restart count 0 Dec 2 23:36:03.538: INFO: Latency metrics for node ip-172-20-40-67.us-west-2.compute.internal Dec 2 23:36:03.539: INFO: Logging node info for node ip-172-20-41-32.us-west-2.compute.internal Dec 2 23:36:03.606: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-41-32.us-west-2.compute.internal ad6a9fcc-418f-4c1a-a9c7-ac1873b8a1ba 29405 0 2022-12-02 23:17:23 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-41-32.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:node mounted_volume_expand:mounted-volume-expand-6871 node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:ip-172-20-41-32.us-west-2.compute.internal topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-00d261efdd8c07a99"} io.cilium.network.ipv4-cilium-host:172.20.50.121 io.cilium.network.ipv4-health-ip:172.20.47.106 io.cilium.network.ipv4-pod-cidr:100.96.3.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2022-12-02 23:17:23 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-12-02 23:17:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2022-12-02 23:17:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {cilium-agent Update v1 2022-12-02 23:17:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-12-02 23:17:51 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {e2e.test Update v1 2022-12-02 23:29:34 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{},"f:mounted_volume_expand":{}}}} } {kubelet Update v1 2022-12-02 23:30:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2022-12-02 23:30:44 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-00d261efdd8c07a99,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-02 23:17:51 +0000 UTC,LastTransitionTime:2022-12-02 23:17:51 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-02 23:35:34 +0000 UTC,LastTransitionTime:2022-12-02 23:17:23 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-02 23:35:34 +0000 UTC,LastTransitionTime:2022-12-02 23:17:23 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-02 23:35:34 +0000 UTC,LastTransitionTime:2022-12-02 23:17:23 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-02 23:35:34 +0000 UTC,LastTransitionTime:2022-12-02 23:17:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.41.32,},NodeAddress{Type:ExternalIP,Address:35.88.26.86,},NodeAddress{Type:Hostname,Address:ip-172-20-41-32.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-41-32.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-88-26-86.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2624f500a45f29b52ed8b5d778f035,SystemUUID:ec2624f5-00a4-5f29-b52e-d8b5d778f035,BootID:b76bd51c-e57a-47b9-86f2-c1093a033e09,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.13,KubeletVersion:v1.22.16,KubeProxyVersion:v1.22.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:160382894,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:702a992280fb7c3303e84a5801acbb4c9c7fcf48cffe0e9c8be3f0c60f74cf89 k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.4],SizeBytes:112029652,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.22.16],SizeBytes:105446599,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:716d2f68314c5c4ddd5ecdb45183fcb4ed8019015982c1321571f863989b70b0 k8s.gcr.io/e2e-test-images/httpd:2.4.39-1],SizeBytes:41902332,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:b913fa234cc3473cfe16e937d106b455a7609f927f59031c81aca791e2689b50 k8s.gcr.io/e2e-test-images/httpd:2.4.38-1],SizeBytes:40765006,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:28956694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:1b7c978a792a8fa4e96244e8059bd71bb49b07e2e5a897fb0c867bdc6db20d5d k8s.gcr.io/sig-storage/livenessprobe:v2.3.0],SizeBytes:7933739,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:503b7abb89e57383eba61cc8a9cb0b495ea575c516108f7d972a6ff6e1ab3c9b k8s.gcr.io/e2e-test-images/nginx:1.14-1],SizeBytes:6979365,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac k8s.gcr.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:1ff6c18fbef2045af6b9c16bf034cc421a29027b800e4f9b68ae9b1cb3e9ae07 k8s.gcr.io/pause:3.5],SizeBytes:301416,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-01091924f688a5969],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-01091924f688a5969,DevicePath:,},},Config:nil,},} Dec 2 23:36:03.606: INFO: Logging kubelet events for node ip-172-20-41-32.us-west-2.compute.internal Dec 2 23:36:03.677: INFO: Logging pods the kubelet thinks is on node ip-172-20-41-32.us-west-2.compute.internal Dec 2 23:36:03.758: INFO: rc-test-4h8d6 started at 2022-12-02 23:33:21 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:03.759: INFO: Container rc-test ready: false, restart count 0 Dec 2 23:36:03.759: INFO: test-rolling-update-with-lb-7db9cf5ff8-grw6v started at 2022-12-02 23:27:40 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:03.759: INFO: Container agnhost ready: true, restart count 0 Dec 2 23:36:03.759: INFO: cilium-m9r5q started at 2022-12-02 23:17:24 +0000 UTC (1+1 container statuses recorded) Dec 2 23:36:03.759: INFO: Init container clean-cilium-state ready: true, restart count 0 Dec 2 23:36:03.759: INFO: Container cilium-agent ready: true, restart count 0 Dec 2 23:36:03.759: INFO: test-rollover-controller-wxkjb started at 2022-12-02 23:35:19 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:03.759: INFO: Container httpd ready: false, restart count 0 Dec 2 23:36:03.759: INFO: successful-jobs-history-limit-27833734-6hlrt started at 2022-12-02 23:34:00 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:03.759: INFO: Container c ready: false, restart count 0 Dec 2 23:36:03.759: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-qgcxv started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:03.759: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:03.759: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-44b5z started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:03.759: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:03.759: INFO: netserver-1 started at 2022-12-02 23:29:40 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:03.759: INFO: Container webserver ready: true, restart count 0 Dec 2 23:36:03.759: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-wf5z9 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:03.759: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:03.759: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-gjgbh started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:03.759: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:03.759: INFO: success started at 2022-12-02 23:34:47 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:03.759: INFO: Container success ready: false, restart count 0 Dec 2 23:36:03.759: INFO: ebs-csi-node-c27hl started at 2022-12-02 23:17:24 +0000 UTC (0+3 container statuses recorded) Dec 2 23:36:03.759: INFO: Container ebs-plugin ready: true, restart count 0 Dec 2 23:36:03.759: INFO: Container liveness-probe ready: true, restart count 0 Dec 2 23:36:03.759: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 2 23:36:03.759: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-dlbpk started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:03.759: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:03.759: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-kxvnd started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:03.759: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:03.759: INFO: test-container-pod started at 2022-12-02 23:34:12 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:03.759: INFO: Container webserver ready: false, restart count 0 Dec 2 23:36:03.759: INFO: ss2-0 started at 2022-12-02 23:33:41 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:03.759: INFO: Container webserver ready: false, restart count 0 Dec 2 23:36:03.759: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-dm2vc started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:03.759: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:03.759: INFO: successful-jobs-history-limit-27833736-64b8r started at 2022-12-02 23:36:00 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:03.759: INFO: Container c ready: false, restart count 0 Dec 2 23:36:03.759: INFO: netserver-1 started at 2022-12-02 23:35:10 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:03.759: INFO: Container webserver ready: false, restart count 0 Dec 2 23:36:03.759: INFO: test-rolling-update-with-lb-5947fbdf64-6nw2f started at 2022-12-02 23:31:01 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:03.759: INFO: Container agnhost ready: false, restart count 0 Dec 2 23:36:03.759: INFO: host-test-container-pod started at 2022-12-02 23:34:12 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:03.759: INFO: Container agnhost-container ready: true, restart count 0 Dec 2 23:36:03.759: INFO: pod-subpath-test-inlinevolume-84wk started at 2022-12-02 23:35:11 +0000 UTC (2+1 container statuses recorded) Dec 2 23:36:03.759: INFO: Init container init-volume-inlinevolume-84wk ready: false, restart count 0 Dec 2 23:36:03.759: INFO: Init container test-init-volume-inlinevolume-84wk ready: false, restart count 0 Dec 2 23:36:03.759: INFO: Container test-container-subpath-inlinevolume-84wk ready: false, restart count 0 Dec 2 23:36:03.759: INFO: externalname-service-6rb48 started at 2022-12-02 23:35:40 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:03.759: INFO: Container externalname-service ready: false, restart count 0 Dec 2 23:36:03.759: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-42p62 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:03.759: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:03.759: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-rq5lg started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:03.759: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:03.759: INFO: netserver-1 started at 2022-12-02 23:33:50 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:03.759: INFO: Container webserver ready: false, restart count 0 Dec 2 23:36:03.759: INFO: successful-jobs-history-limit-27833735-zz4t9 started at 2022-12-02 23:35:00 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:03.759: INFO: Container c ready: false, restart count 0 Dec 2 23:36:03.759: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-79x59 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:03.759: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:03.759: INFO: pod-55255ec9-bf45-4208-865d-6ef51afe9599 started at 2022-12-02 23:30:30 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:03.759: INFO: Container write-pod ready: false, restart count 0 Dec 2 23:36:03.759: INFO: pod-1 started at 2022-12-02 23:31:10 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:03.759: INFO: Container donothing ready: false, restart count 0 Dec 2 23:36:04.080: INFO: Latency metrics for node ip-172-20-41-32.us-west-2.compute.internal Dec 2 23:36:04.080: INFO: Logging node info for node ip-172-20-43-150.us-west-2.compute.internal Dec 2 23:36:04.148: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-43-150.us-west-2.compute.internal 47bb1581-dcdc-4edf-b2c4-109aedb2f5bd 29544 0 2022-12-02 23:17:23 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-43-150.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:ip-172-20-43-150.us-west-2.compute.internal topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0e2e5350f5754b178"} io.cilium.network.ipv4-cilium-host:172.20.35.108 io.cilium.network.ipv4-health-ip:172.20.34.31 io.cilium.network.ipv4-pod-cidr:100.96.4.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2022-12-02 23:17:23 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-12-02 23:17:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2022-12-02 23:17:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {cilium-agent Update v1 2022-12-02 23:17:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-12-02 23:17:51 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {e2e.test Update v1 2022-12-02 23:29:34 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2022-12-02 23:30:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-0e2e5350f5754b178,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-02 23:17:51 +0000 UTC,LastTransitionTime:2022-12-02 23:17:51 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-02 23:35:54 +0000 UTC,LastTransitionTime:2022-12-02 23:17:23 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-02 23:35:54 +0000 UTC,LastTransitionTime:2022-12-02 23:17:23 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-02 23:35:54 +0000 UTC,LastTransitionTime:2022-12-02 23:17:23 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-02 23:35:54 +0000 UTC,LastTransitionTime:2022-12-02 23:17:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.43.150,},NodeAddress{Type:ExternalIP,Address:54.184.249.63,},NodeAddress{Type:Hostname,Address:ip-172-20-43-150.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-43-150.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-184-249-63.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23a85d6d7b80ff12e03e51b1effc11,SystemUUID:ec23a85d-6d7b-80ff-12e0-3e51b1effc11,BootID:72904f56-1058-4b24-85d2-c465d1149ad1,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.13,KubeletVersion:v1.22.16,KubeProxyVersion:v1.22.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:160382894,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:702a992280fb7c3303e84a5801acbb4c9c7fcf48cffe0e9c8be3f0c60f74cf89 k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.4],SizeBytes:112029652,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.22.16],SizeBytes:105446599,},ContainerImage{Names:[docker.io/library/nginx@sha256:e209ac2f37c70c1e0e9873a5f7231e91dcd83fdf1178d8ed36c2ec09974210ba docker.io/library/nginx:latest],SizeBytes:56833911,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:1f36a24cfb5e0c3f725d7565a867c2384282fcbeccc77b07b423c9da95763a9a k8s.gcr.io/e2e-test-images/nautilus:1.4],SizeBytes:49230179,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:716d2f68314c5c4ddd5ecdb45183fcb4ed8019015982c1321571f863989b70b0 k8s.gcr.io/e2e-test-images/httpd:2.4.39-1],SizeBytes:41902332,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:b913fa234cc3473cfe16e937d106b455a7609f927f59031c81aca791e2689b50 k8s.gcr.io/e2e-test-images/httpd:2.4.38-1],SizeBytes:40765006,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:28956694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a k8s.gcr.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf k8s.gcr.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:1b7c978a792a8fa4e96244e8059bd71bb49b07e2e5a897fb0c867bdc6db20d5d k8s.gcr.io/sig-storage/livenessprobe:v2.3.0],SizeBytes:7933739,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:503b7abb89e57383eba61cc8a9cb0b495ea575c516108f7d972a6ff6e1ab3c9b k8s.gcr.io/e2e-test-images/nginx:1.14-1],SizeBytes:6979365,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac k8s.gcr.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:1ff6c18fbef2045af6b9c16bf034cc421a29027b800e4f9b68ae9b1cb3e9ae07 k8s.gcr.io/pause:3.5],SizeBytes:301416,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 2 23:36:04.149: INFO: Logging kubelet events for node ip-172-20-43-150.us-west-2.compute.internal Dec 2 23:36:04.219: INFO: Logging pods the kubelet thinks is on node ip-172-20-43-150.us-west-2.compute.internal Dec 2 23:36:04.293: INFO: pod-0 started at 2022-12-02 23:31:10 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:04.293: INFO: Container donothing ready: false, restart count 0 Dec 2 23:36:04.293: INFO: hostexec-ip-172-20-43-150.us-west-2.compute.internal-lmqmb started at 2022-12-02 23:31:33 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:04.293: INFO: Container agnhost-container ready: true, restart count 0 Dec 2 23:36:04.293: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-ksvcz started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:04.293: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:04.293: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-pm84g started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:04.293: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: false, restart count 0 Dec 2 23:36:04.293: INFO: hostexec-ip-172-20-43-150.us-west-2.compute.internal-pzwm8 started at 2022-12-02 23:34:47 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:04.293: INFO: Container agnhost-container ready: true, restart count 0 Dec 2 23:36:04.293: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-wqgdj started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:04.293: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:04.293: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-z5d7v started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:04.293: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:04.293: INFO: pod-should-be-evictedb0d46de6-8dde-4fe1-bf6b-d5cbeab91511 started at 2022-12-02 23:35:42 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:04.293: INFO: Container bar ready: false, restart count 0 Dec 2 23:36:04.293: INFO: pod-subpath-test-preprovisionedpv-8zrh started at 2022-12-02 23:34:49 +0000 UTC (1+1 container statuses recorded) Dec 2 23:36:04.293: INFO: Init container init-volume-preprovisionedpv-8zrh ready: false, restart count 0 Dec 2 23:36:04.293: INFO: Container test-container-subpath-preprovisionedpv-8zrh ready: false, restart count 0 Dec 2 23:36:04.293: INFO: netserver-2 started at 2022-12-02 23:35:10 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:04.293: INFO: Container webserver ready: false, restart count 0 Dec 2 23:36:04.293: INFO: pod-abb1ddf3-cdd4-4291-a144-3f08787c89a0 started at 2022-12-02 23:35:57 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:04.293: INFO: Container test-container ready: false, restart count 0 Dec 2 23:36:04.293: INFO: cilium-7h427 started at 2022-12-02 23:17:24 +0000 UTC (1+1 container statuses recorded) Dec 2 23:36:04.293: INFO: Init container clean-cilium-state ready: true, restart count 0 Dec 2 23:36:04.293: INFO: Container cilium-agent ready: true, restart count 0 Dec 2 23:36:04.293: INFO: externalname-service-vqt5p started at 2022-12-02 23:35:40 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:04.293: INFO: Container externalname-service ready: false, restart count 0 Dec 2 23:36:04.293: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-5jb9p started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:04.293: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:04.293: INFO: pod-2 started at 2022-12-02 23:31:10 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:04.293: INFO: Container donothing ready: true, restart count 0 Dec 2 23:36:04.293: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-g66v4 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:04.293: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:04.293: INFO: ebs-csi-node-8qrwx started at 2022-12-02 23:17:24 +0000 UTC (0+3 container statuses recorded) Dec 2 23:36:04.293: INFO: Container ebs-plugin ready: true, restart count 0 Dec 2 23:36:04.293: INFO: Container liveness-probe ready: true, restart count 0 Dec 2 23:36:04.293: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 2 23:36:04.293: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-8bg6n started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:04.293: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:04.293: INFO: pod-b416a818-b13e-44c7-a3c6-14e94e8ce1c4 started at 2022-12-02 23:35:04 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:04.293: INFO: Container write-pod ready: false, restart count 0 Dec 2 23:36:04.293: INFO: netserver-2 started at 2022-12-02 23:29:40 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:04.293: INFO: Container webserver ready: true, restart count 0 Dec 2 23:36:04.293: INFO: httpd started at 2022-12-02 23:34:37 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:04.293: INFO: Container httpd ready: true, restart count 0 Dec 2 23:36:04.293: INFO: configmap-client started at 2022-12-02 23:34:58 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:04.293: INFO: Container configmap-client ready: false, restart count 0 Dec 2 23:36:04.293: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-qnr57 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:04.293: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:04.293: INFO: netserver-2 started at 2022-12-02 23:33:50 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:04.293: INFO: Container webserver ready: false, restart count 0 Dec 2 23:36:04.293: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-s5867 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:04.293: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:04.293: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-kj74m started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:04.293: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:04.293: INFO: pod-a490ced8-ce1a-4203-a10b-1b9143f1e598 started at 2022-12-02 23:32:12 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:04.293: INFO: Container write-pod ready: false, restart count 0 Dec 2 23:36:04.293: INFO: hostexec-ip-172-20-43-150.us-west-2.compute.internal-4sp8t started at 2022-12-02 23:34:34 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:04.293: INFO: Container agnhost-container ready: true, restart count 0 Dec 2 23:36:04.607: INFO: Latency metrics for node ip-172-20-43-150.us-west-2.compute.internal Dec 2 23:36:04.607: INFO: Logging node info for node ip-172-20-48-5.us-west-2.compute.internal Dec 2 23:36:04.674: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-48-5.us-west-2.compute.internal 6342e9b6-e818-4fbf-aae7-8be176fd4ec1 29590 0 2022-12-02 23:17:21 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-48-5.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:ip-172-20-48-5.us-west-2.compute.internal topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-volumemode-2041":"ip-172-20-48-5.us-west-2.compute.internal","ebs.csi.aws.com":"i-0093900b92d415e84"} io.cilium.network.ipv4-cilium-host:172.20.42.98 io.cilium.network.ipv4-health-ip:172.20.44.82 io.cilium.network.ipv4-pod-cidr:100.96.2.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-12-02 23:17:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2022-12-02 23:17:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2022-12-02 23:17:22 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {cilium-agent Update v1 2022-12-02 23:17:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-12-02 23:17:52 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {e2e.test Update v1 2022-12-02 23:29:34 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2022-12-02 23:31:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {kube-controller-manager Update v1 2022-12-02 23:31:10 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-0093900b92d415e84,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-02 23:17:52 +0000 UTC,LastTransitionTime:2022-12-02 23:17:52 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-02 23:36:03 +0000 UTC,LastTransitionTime:2022-12-02 23:17:21 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-02 23:36:03 +0000 UTC,LastTransitionTime:2022-12-02 23:17:21 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-02 23:36:03 +0000 UTC,LastTransitionTime:2022-12-02 23:17:21 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-02 23:36:03 +0000 UTC,LastTransitionTime:2022-12-02 23:17:42 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.48.5,},NodeAddress{Type:ExternalIP,Address:34.213.188.181,},NodeAddress{Type:Hostname,Address:ip-172-20-48-5.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-48-5.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-34-213-188-181.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2ecd9e359fbd979ba14c48724d474b,SystemUUID:ec2ecd9e-359f-bd97-9ba1-4c48724d474b,BootID:3d1b1479-a710-49bb-96b3-2764890e8166,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.13,KubeletVersion:v1.22.16,KubeProxyVersion:v1.22.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:160382894,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.22.16],SizeBytes:105446599,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:716d2f68314c5c4ddd5ecdb45183fcb4ed8019015982c1321571f863989b70b0 k8s.gcr.io/e2e-test-images/httpd:2.4.39-1],SizeBytes:41902332,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:b913fa234cc3473cfe16e937d106b455a7609f927f59031c81aca791e2689b50 k8s.gcr.io/e2e-test-images/httpd:2.4.38-1],SizeBytes:40765006,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:28956694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a k8s.gcr.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:1b7c978a792a8fa4e96244e8059bd71bb49b07e2e5a897fb0c867bdc6db20d5d k8s.gcr.io/sig-storage/livenessprobe:v2.3.0],SizeBytes:7933739,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:503b7abb89e57383eba61cc8a9cb0b495ea575c516108f7d972a6ff6e1ab3c9b k8s.gcr.io/e2e-test-images/nginx:1.14-1],SizeBytes:6979365,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:1ff6c18fbef2045af6b9c16bf034cc421a29027b800e4f9b68ae9b1cb3e9ae07 k8s.gcr.io/pause:3.5],SizeBytes:301416,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-volumemode-2041^654737c8-7299-11ed-af0e-124cde60a1d6,DevicePath:,},},Config:nil,},} Dec 2 23:36:04.674: INFO: Logging kubelet events for node ip-172-20-48-5.us-west-2.compute.internal Dec 2 23:36:04.743: INFO: Logging pods the kubelet thinks is on node ip-172-20-48-5.us-west-2.compute.internal Dec 2 23:36:04.817: INFO: pod-075435ca-217c-4ec4-a982-6a7a5eb325f4 started at 2022-12-02 23:31:09 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:04.817: INFO: Container write-pod ready: false, restart count 0 Dec 2 23:36:04.817: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-qxp67 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:04.817: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:04.817: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-9mx44 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:04.817: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:04.817: INFO: pod-8c4bd487-8f0f-44e5-9833-0c353d46bea8 started at 2022-12-02 23:31:22 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:04.817: INFO: Container write-pod ready: false, restart count 0 Dec 2 23:36:04.817: INFO: webserver-pod started at 2022-12-02 23:35:30 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:04.817: INFO: Container agnhost ready: false, restart count 0 Dec 2 23:36:04.817: INFO: ebs-csi-node-bcx5m started at 2022-12-02 23:17:22 +0000 UTC (0+3 container statuses recorded) Dec 2 23:36:04.817: INFO: Container ebs-plugin ready: true, restart count 0 Dec 2 23:36:04.817: INFO: Container liveness-probe ready: true, restart count 0 Dec 2 23:36:04.817: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 2 23:36:04.817: INFO: coredns-5fcc7b6498-clxp8 started at 2022-12-02 23:17:58 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:04.817: INFO: Container coredns ready: true, restart count 0 Dec 2 23:36:04.817: INFO: csi-mockplugin-0 started at 2022-12-02 23:35:02 +0000 UTC (0+4 container statuses recorded) Dec 2 23:36:04.817: INFO: Container busybox ready: false, restart count 0 Dec 2 23:36:04.817: INFO: Container csi-provisioner ready: false, restart count 0 Dec 2 23:36:04.817: INFO: Container driver-registrar ready: false, restart count 0 Dec 2 23:36:04.817: INFO: Container mock ready: false, restart count 0 Dec 2 23:36:04.817: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-xctkw started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:04.817: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:04.817: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-ttc6s started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:04.817: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: false, restart count 0 Dec 2 23:36:04.817: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-6nvlf started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:04.817: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:04.817: INFO: cilium-ftssb started at 2022-12-02 23:17:22 +0000 UTC (1+1 container statuses recorded) Dec 2 23:36:04.817: INFO: Init container clean-cilium-state ready: true, restart count 0 Dec 2 23:36:04.817: INFO: Container cilium-agent ready: true, restart count 0 Dec 2 23:36:04.817: INFO: test-rolling-update-with-lb-7db9cf5ff8-rqg95 started at 2022-12-02 23:27:40 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:04.817: INFO: Container agnhost ready: true, restart count 0 Dec 2 23:36:04.817: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-cdm2p started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:04.817: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: false, restart count 0 Dec 2 23:36:04.817: INFO: netserver-3 started at 2022-12-02 23:33:50 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:04.817: INFO: Container webserver ready: false, restart count 0 Dec 2 23:36:04.817: INFO: netserver-3 started at 2022-12-02 23:35:11 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:04.817: INFO: Container webserver ready: false, restart count 0 Dec 2 23:36:04.817: INFO: netserver-3 started at 2022-12-02 23:29:40 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:04.817: INFO: Container webserver ready: true, restart count 0 Dec 2 23:36:04.817: INFO: csi-hostpathplugin-0 started at 2022-12-02 23:30:42 +0000 UTC (0+7 container statuses recorded) Dec 2 23:36:04.817: INFO: Container csi-attacher ready: true, restart count 0 Dec 2 23:36:04.817: INFO: Container csi-provisioner ready: true, restart count 0 Dec 2 23:36:04.817: INFO: Container csi-resizer ready: true, restart count 0 Dec 2 23:36:04.817: INFO: Container csi-snapshotter ready: true, restart count 0 Dec 2 23:36:04.817: INFO: Container hostpath ready: true, restart count 0 Dec 2 23:36:04.817: INFO: Container liveness-probe ready: true, restart count 0 Dec 2 23:36:04.817: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 2 23:36:04.817: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-59flm started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:04.817: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:04.817: INFO: pod-6caddea1-9036-4c6c-99f5-902dff5394fb started at 2022-12-02 23:29:34 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:04.817: INFO: Container write-pod ready: true, restart count 0 Dec 2 23:36:04.817: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-krv9s started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:04.817: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:04.817: INFO: hostexec-ip-172-20-48-5.us-west-2.compute.internal-9lt2d started at 2022-12-02 23:29:31 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:04.817: INFO: Container agnhost-container ready: true, restart count 0 Dec 2 23:36:04.817: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-7rvfw started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:04.817: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:04.817: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-wqvtr started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:04.817: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: false, restart count 0 Dec 2 23:36:05.134: INFO: Latency metrics for node ip-172-20-48-5.us-west-2.compute.internal Dec 2 23:36:05.134: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "deployment-400" for this suite.
Filter through log files
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-apps\]\sDisruptionController\sshould\sobserve\sthat\sthe\sPodDisruptionBudget\sstatus\sis\snot\supdated\sfor\sunmanaged\spods$'
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/disruption.go:191 Dec 2 23:41:10.690: Waiting for pods in namespace "disruption-4373" to be ready Unexpected error: <*errors.errorString | 0xc0002b8280>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/disruption.go:576from junit_18.xml
[BeforeEach] [sig-apps] DisruptionController /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Dec 2 23:31:09.860: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename disruption �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-apps] DisruptionController /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/disruption.go:69 [It] should observe that the PodDisruptionBudget status is not updated for unmanaged pods /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/disruption.go:191 �[1mSTEP�[0m: Waiting for the pdb to be processed �[1mSTEP�[0m: Waiting for all pods to be running Dec 2 23:31:10.562: INFO: running pods: 0 < 3 Dec 2 23:31:12.626: INFO: running pods: 0 < 3 Dec 2 23:31:14.625: INFO: running pods: 0 < 3 Dec 2 23:31:16.625: INFO: running pods: 0 < 3 Dec 2 23:31:18.633: INFO: running pods: 0 < 3 Dec 2 23:31:20.627: INFO: running pods: 0 < 3 Dec 2 23:31:22.626: INFO: running pods: 0 < 3 Dec 2 23:31:24.626: INFO: running pods: 0 < 3 Dec 2 23:31:26.626: INFO: running pods: 0 < 3 Dec 2 23:31:28.625: INFO: running pods: 0 < 3 Dec 2 23:31:30.627: INFO: running pods: 0 < 3 Dec 2 23:31:32.626: INFO: running pods: 0 < 3 Dec 2 23:31:34.627: INFO: running pods: 0 < 3 Dec 2 23:31:36.625: INFO: running pods: 0 < 3 Dec 2 23:31:38.627: INFO: running pods: 0 < 3 Dec 2 23:31:40.627: INFO: running pods: 0 < 3 Dec 2 23:31:42.626: INFO: running pods: 0 < 3 Dec 2 23:31:44.626: INFO: running pods: 0 < 3 Dec 2 23:31:46.627: INFO: running pods: 0 < 3 Dec 2 23:31:48.626: INFO: running pods: 0 < 3 Dec 2 23:31:50.627: INFO: running pods: 0 < 3 Dec 2 23:31:52.626: INFO: running pods: 0 < 3 Dec 2 23:31:54.627: INFO: running pods: 0 < 3 Dec 2 23:31:56.626: INFO: running pods: 0 < 3 Dec 2 23:31:58.626: INFO: running pods: 0 < 3 Dec 2 23:32:00.625: INFO: running pods: 0 < 3 Dec 2 23:32:02.626: INFO: running pods: 0 < 3 Dec 2 23:32:04.627: INFO: running pods: 0 < 3 Dec 2 23:32:06.626: INFO: running pods: 0 < 3 Dec 2 23:32:08.625: INFO: running pods: 0 < 3 Dec 2 23:32:10.627: INFO: running pods: 0 < 3 Dec 2 23:32:12.626: INFO: running pods: 0 < 3 Dec 2 23:32:14.627: INFO: running pods: 0 < 3 Dec 2 23:32:16.627: INFO: running pods: 0 < 3 Dec 2 23:32:18.625: INFO: running pods: 0 < 3 Dec 2 23:32:20.626: INFO: running pods: 0 < 3 Dec 2 23:32:22.626: INFO: running pods: 0 < 3 Dec 2 23:32:24.626: INFO: running pods: 0 < 3 Dec 2 23:32:26.627: INFO: running pods: 0 < 3 Dec 2 23:32:28.626: INFO: running pods: 0 < 3 Dec 2 23:32:30.626: INFO: running pods: 0 < 3 Dec 2 23:32:32.626: INFO: running pods: 0 < 3 Dec 2 23:32:34.626: INFO: running pods: 0 < 3 Dec 2 23:32:36.626: INFO: running pods: 0 < 3 Dec 2 23:32:38.626: INFO: running pods: 0 < 3 Dec 2 23:32:40.626: INFO: running pods: 0 < 3 Dec 2 23:32:42.626: INFO: running pods: 0 < 3 Dec 2 23:32:44.625: INFO: running pods: 0 < 3 Dec 2 23:32:46.627: INFO: running pods: 0 < 3 Dec 2 23:32:48.626: INFO: running pods: 0 < 3 Dec 2 23:32:50.627: INFO: running pods: 0 < 3 Dec 2 23:32:52.626: INFO: running pods: 0 < 3 Dec 2 23:32:54.626: INFO: running pods: 0 < 3 Dec 2 23:32:56.625: INFO: running pods: 0 < 3 Dec 2 23:32:58.626: INFO: running pods: 0 < 3 Dec 2 23:33:00.625: INFO: running pods: 0 < 3 Dec 2 23:33:02.626: INFO: running pods: 0 < 3 Dec 2 23:33:04.627: INFO: running pods: 0 < 3 Dec 2 23:33:06.627: INFO: running pods: 0 < 3 Dec 2 23:33:08.628: INFO: running pods: 0 < 3 Dec 2 23:33:10.626: INFO: running pods: 0 < 3 Dec 2 23:33:12.626: INFO: running pods: 0 < 3 Dec 2 23:33:14.626: INFO: running pods: 0 < 3 Dec 2 23:33:16.627: INFO: running pods: 0 < 3 Dec 2 23:33:18.626: INFO: running pods: 0 < 3 Dec 2 23:33:20.627: INFO: running pods: 0 < 3 Dec 2 23:33:22.626: INFO: running pods: 0 < 3 Dec 2 23:33:24.625: INFO: running pods: 0 < 3 Dec 2 23:33:26.627: INFO: running pods: 0 < 3 Dec 2 23:33:28.626: INFO: running pods: 0 < 3 Dec 2 23:33:30.626: INFO: running pods: 0 < 3 Dec 2 23:33:32.626: INFO: running pods: 0 < 3 Dec 2 23:33:34.626: INFO: running pods: 0 < 3 Dec 2 23:33:36.627: INFO: running pods: 0 < 3 Dec 2 23:33:38.626: INFO: running pods: 0 < 3 Dec 2 23:33:40.625: INFO: running pods: 0 < 3 Dec 2 23:33:42.626: INFO: running pods: 0 < 3 Dec 2 23:33:44.627: INFO: running pods: 0 < 3 Dec 2 23:33:46.625: INFO: running pods: 0 < 3 Dec 2 23:33:48.626: INFO: running pods: 0 < 3 Dec 2 23:33:50.626: INFO: running pods: 0 < 3 Dec 2 23:33:52.625: INFO: running pods: 0 < 3 Dec 2 23:33:54.626: INFO: running pods: 0 < 3 Dec 2 23:33:56.625: INFO: running pods: 0 < 3 Dec 2 23:33:58.626: INFO: running pods: 0 < 3 Dec 2 23:34:00.627: INFO: running pods: 0 < 3 Dec 2 23:34:02.626: INFO: running pods: 0 < 3 Dec 2 23:34:04.625: INFO: running pods: 0 < 3 Dec 2 23:34:06.625: INFO: running pods: 0 < 3 Dec 2 23:34:08.625: INFO: running pods: 0 < 3 Dec 2 23:34:10.625: INFO: running pods: 0 < 3 Dec 2 23:34:12.625: INFO: running pods: 0 < 3 Dec 2 23:34:14.626: INFO: running pods: 0 < 3 Dec 2 23:34:16.627: INFO: running pods: 0 < 3 Dec 2 23:34:18.626: INFO: running pods: 0 < 3 Dec 2 23:34:20.627: INFO: running pods: 0 < 3 Dec 2 23:34:22.626: INFO: running pods: 0 < 3 Dec 2 23:34:24.625: INFO: running pods: 0 < 3 Dec 2 23:34:26.625: INFO: running pods: 0 < 3 Dec 2 23:34:28.625: INFO: running pods: 0 < 3 Dec 2 23:34:30.626: INFO: running pods: 0 < 3 Dec 2 23:34:32.626: INFO: running pods: 0 < 3 Dec 2 23:34:34.625: INFO: running pods: 0 < 3 Dec 2 23:34:36.628: INFO: running pods: 0 < 3 Dec 2 23:34:38.625: INFO: running pods: 0 < 3 Dec 2 23:34:40.626: INFO: running pods: 0 < 3 Dec 2 23:34:42.626: INFO: running pods: 0 < 3 Dec 2 23:34:44.627: INFO: running pods: 0 < 3 Dec 2 23:34:46.625: INFO: running pods: 0 < 3 Dec 2 23:34:48.625: INFO: running pods: 0 < 3 Dec 2 23:34:50.627: INFO: running pods: 0 < 3 Dec 2 23:34:52.626: INFO: running pods: 0 < 3 Dec 2 23:34:54.625: INFO: running pods: 0 < 3 Dec 2 23:34:56.625: INFO: running pods: 1 < 3 Dec 2 23:34:58.625: INFO: running pods: 1 < 3 Dec 2 23:35:00.627: INFO: running pods: 1 < 3 Dec 2 23:35:02.626: INFO: running pods: 1 < 3 Dec 2 23:35:04.626: INFO: running pods: 1 < 3 Dec 2 23:35:06.626: INFO: running pods: 1 < 3 Dec 2 23:35:08.628: INFO: running pods: 1 < 3 Dec 2 23:35:10.626: INFO: running pods: 1 < 3 Dec 2 23:35:12.626: INFO: running pods: 1 < 3 Dec 2 23:35:14.626: INFO: running pods: 1 < 3 Dec 2 23:35:16.627: INFO: running pods: 1 < 3 Dec 2 23:35:18.626: INFO: running pods: 1 < 3 Dec 2 23:35:20.625: INFO: running pods: 1 < 3 Dec 2 23:35:22.626: INFO: running pods: 1 < 3 Dec 2 23:35:24.625: INFO: running pods: 1 < 3 Dec 2 23:35:26.625: INFO: running pods: 1 < 3 Dec 2 23:35:28.626: INFO: running pods: 1 < 3 Dec 2 23:35:30.627: INFO: running pods: 1 < 3 Dec 2 23:35:32.626: INFO: running pods: 1 < 3 Dec 2 23:35:34.625: INFO: running pods: 1 < 3 Dec 2 23:35:36.627: INFO: running pods: 1 < 3 Dec 2 23:35:38.626: INFO: running pods: 1 < 3 Dec 2 23:35:40.627: INFO: running pods: 1 < 3 Dec 2 23:35:42.627: INFO: running pods: 1 < 3 Dec 2 23:35:44.626: INFO: running pods: 1 < 3 Dec 2 23:35:46.626: INFO: running pods: 1 < 3 Dec 2 23:35:48.625: INFO: running pods: 1 < 3 Dec 2 23:35:50.627: INFO: running pods: 1 < 3 Dec 2 23:35:52.626: INFO: running pods: 1 < 3 Dec 2 23:35:54.624: INFO: running pods: 1 < 3 Dec 2 23:35:56.625: INFO: running pods: 1 < 3 Dec 2 23:35:58.624: INFO: running pods: 1 < 3 Dec 2 23:36:00.624: INFO: running pods: 1 < 3 Dec 2 23:36:02.624: INFO: running pods: 1 < 3 Dec 2 23:36:04.624: INFO: running pods: 1 < 3 Dec 2 23:36:06.626: INFO: running pods: 1 < 3 Dec 2 23:36:08.625: INFO: running pods: 1 < 3 Dec 2 23:36:10.624: INFO: running pods: 1 < 3 Dec 2 23:36:12.625: INFO: running pods: 1 < 3 Dec 2 23:36:14.625: INFO: running pods: 1 < 3 Dec 2 23:36:16.625: INFO: running pods: 1 < 3 Dec 2 23:36:18.624: INFO: running pods: 1 < 3 Dec 2 23:36:20.625: INFO: running pods: 1 < 3 Dec 2 23:36:22.625: INFO: running pods: 1 < 3 Dec 2 23:36:24.625: INFO: running pods: 1 < 3 Dec 2 23:36:26.624: INFO: running pods: 1 < 3 Dec 2 23:36:28.625: INFO: running pods: 1 < 3 Dec 2 23:36:30.626: INFO: running pods: 1 < 3 Dec 2 23:36:32.625: INFO: running pods: 1 < 3 Dec 2 23:36:34.624: INFO: running pods: 1 < 3 Dec 2 23:36:36.626: INFO: running pods: 1 < 3 Dec 2 23:36:38.625: INFO: running pods: 1 < 3 Dec 2 23:36:40.626: INFO: running pods: 1 < 3 Dec 2 23:36:42.625: INFO: running pods: 1 < 3 Dec 2 23:36:44.626: INFO: running pods: 1 < 3 Dec 2 23:36:46.625: INFO: running pods: 1 < 3 Dec 2 23:36:48.625: INFO: running pods: 1 < 3 Dec 2 23:36:50.627: INFO: running pods: 1 < 3 Dec 2 23:36:52.627: INFO: running pods: 1 < 3 Dec 2 23:36:54.627: INFO: running pods: 1 < 3 Dec 2 23:36:56.625: INFO: running pods: 1 < 3 Dec 2 23:36:58.626: INFO: running pods: 1 < 3 Dec 2 23:37:00.626: INFO: running pods: 1 < 3 Dec 2 23:37:02.627: INFO: running pods: 1 < 3 Dec 2 23:37:04.626: INFO: running pods: 1 < 3 Dec 2 23:37:06.628: INFO: running pods: 1 < 3 Dec 2 23:37:08.626: INFO: running pods: 1 < 3 Dec 2 23:37:10.627: INFO: running pods: 1 < 3 Dec 2 23:37:12.626: INFO: running pods: 1 < 3 Dec 2 23:37:14.626: INFO: running pods: 1 < 3 Dec 2 23:37:16.632: INFO: running pods: 1 < 3 Dec 2 23:37:18.625: INFO: running pods: 1 < 3 Dec 2 23:37:20.626: INFO: running pods: 1 < 3 Dec 2 23:37:22.626: INFO: running pods: 1 < 3 Dec 2 23:37:24.626: INFO: running pods: 1 < 3 Dec 2 23:37:26.625: INFO: running pods: 1 < 3 Dec 2 23:37:28.625: INFO: running pods: 1 < 3 Dec 2 23:37:30.626: INFO: running pods: 1 < 3 Dec 2 23:37:32.626: INFO: running pods: 1 < 3 Dec 2 23:37:34.626: INFO: running pods: 1 < 3 Dec 2 23:37:36.627: INFO: running pods: 1 < 3 Dec 2 23:37:38.625: INFO: running pods: 1 < 3 Dec 2 23:37:40.625: INFO: running pods: 1 < 3 Dec 2 23:37:42.628: INFO: running pods: 1 < 3 Dec 2 23:37:44.625: INFO: running pods: 1 < 3 Dec 2 23:37:46.627: INFO: running pods: 1 < 3 Dec 2 23:37:48.626: INFO: running pods: 1 < 3 Dec 2 23:37:50.626: INFO: running pods: 1 < 3 Dec 2 23:37:52.626: INFO: running pods: 1 < 3 Dec 2 23:37:54.625: INFO: running pods: 1 < 3 Dec 2 23:37:56.628: INFO: running pods: 1 < 3 Dec 2 23:37:58.625: INFO: running pods: 1 < 3 Dec 2 23:38:00.626: INFO: running pods: 1 < 3 Dec 2 23:38:02.627: INFO: running pods: 1 < 3 Dec 2 23:38:04.625: INFO: running pods: 1 < 3 Dec 2 23:38:06.626: INFO: running pods: 1 < 3 Dec 2 23:38:08.625: INFO: running pods: 1 < 3 Dec 2 23:38:10.625: INFO: running pods: 1 < 3 Dec 2 23:38:12.626: INFO: running pods: 1 < 3 Dec 2 23:38:14.627: INFO: running pods: 1 < 3 Dec 2 23:38:16.625: INFO: running pods: 1 < 3 Dec 2 23:38:18.625: INFO: running pods: 1 < 3 Dec 2 23:38:20.625: INFO: running pods: 1 < 3 Dec 2 23:38:22.627: INFO: running pods: 1 < 3 Dec 2 23:38:24.626: INFO: running pods: 1 < 3 Dec 2 23:38:26.625: INFO: running pods: 1 < 3 Dec 2 23:38:28.625: INFO: running pods: 1 < 3 Dec 2 23:38:30.625: INFO: running pods: 1 < 3 Dec 2 23:38:32.626: INFO: running pods: 1 < 3 Dec 2 23:38:34.626: INFO: running pods: 1 < 3 Dec 2 23:38:36.627: INFO: running pods: 1 < 3 Dec 2 23:38:38.626: INFO: running pods: 1 < 3 Dec 2 23:38:40.627: INFO: running pods: 1 < 3 Dec 2 23:38:42.626: INFO: running pods: 1 < 3 Dec 2 23:38:44.626: INFO: running pods: 1 < 3 Dec 2 23:38:46.625: INFO: running pods: 1 < 3 Dec 2 23:38:48.625: INFO: running pods: 1 < 3 Dec 2 23:38:50.627: INFO: running pods: 1 < 3 Dec 2 23:38:52.625: INFO: running pods: 1 < 3 Dec 2 23:38:54.627: INFO: running pods: 1 < 3 Dec 2 23:38:56.625: INFO: running pods: 1 < 3 Dec 2 23:38:58.626: INFO: running pods: 1 < 3 Dec 2 23:39:00.627: INFO: running pods: 1 < 3 Dec 2 23:39:02.625: INFO: running pods: 1 < 3 Dec 2 23:39:04.630: INFO: running pods: 1 < 3 Dec 2 23:39:06.627: INFO: running pods: 1 < 3 Dec 2 23:39:08.626: INFO: running pods: 1 < 3 Dec 2 23:39:10.627: INFO: running pods: 1 < 3 Dec 2 23:39:12.626: INFO: running pods: 1 < 3 Dec 2 23:39:14.626: INFO: running pods: 1 < 3 Dec 2 23:39:16.626: INFO: running pods: 1 < 3 Dec 2 23:39:18.626: INFO: running pods: 1 < 3 Dec 2 23:39:20.627: INFO: running pods: 1 < 3 Dec 2 23:39:22.626: INFO: running pods: 1 < 3 Dec 2 23:39:24.626: INFO: running pods: 1 < 3 Dec 2 23:39:26.627: INFO: running pods: 1 < 3 Dec 2 23:39:28.626: INFO: running pods: 1 < 3 Dec 2 23:39:30.625: INFO: running pods: 1 < 3 Dec 2 23:39:32.629: INFO: running pods: 1 < 3 Dec 2 23:39:34.625: INFO: running pods: 1 < 3 Dec 2 23:39:36.626: INFO: running pods: 1 < 3 Dec 2 23:39:38.625: INFO: running pods: 1 < 3 Dec 2 23:39:40.627: INFO: running pods: 1 < 3 Dec 2 23:39:42.626: INFO: running pods: 1 < 3 Dec 2 23:39:44.625: INFO: running pods: 1 < 3 Dec 2 23:39:46.625: INFO: running pods: 1 < 3 Dec 2 23:39:48.625: INFO: running pods: 1 < 3 Dec 2 23:39:50.625: INFO: running pods: 1 < 3 Dec 2 23:39:52.626: INFO: running pods: 1 < 3 Dec 2 23:39:54.625: INFO: running pods: 1 < 3 Dec 2 23:39:56.627: INFO: running pods: 1 < 3 Dec 2 23:39:58.626: INFO: running pods: 1 < 3 Dec 2 23:40:00.626: INFO: running pods: 1 < 3 Dec 2 23:40:02.626: INFO: running pods: 1 < 3 Dec 2 23:40:04.626: INFO: running pods: 1 < 3 Dec 2 23:40:06.627: INFO: running pods: 1 < 3 Dec 2 23:40:08.627: INFO: running pods: 1 < 3 Dec 2 23:40:10.627: INFO: running pods: 1 < 3 Dec 2 23:40:12.626: INFO: running pods: 1 < 3 Dec 2 23:40:14.625: INFO: running pods: 1 < 3 Dec 2 23:40:16.625: INFO: running pods: 1 < 3 Dec 2 23:40:18.628: INFO: running pods: 1 < 3 Dec 2 23:40:20.625: INFO: running pods: 1 < 3 Dec 2 23:40:22.626: INFO: running pods: 1 < 3 Dec 2 23:40:24.626: INFO: running pods: 1 < 3 Dec 2 23:40:26.627: INFO: running pods: 1 < 3 Dec 2 23:40:28.626: INFO: running pods: 1 < 3 Dec 2 23:40:30.626: INFO: running pods: 1 < 3 Dec 2 23:40:32.626: INFO: running pods: 1 < 3 Dec 2 23:40:34.626: INFO: running pods: 1 < 3 Dec 2 23:40:36.626: INFO: running pods: 1 < 3 Dec 2 23:40:38.628: INFO: running pods: 1 < 3 Dec 2 23:40:40.626: INFO: running pods: 1 < 3 Dec 2 23:40:42.626: INFO: running pods: 1 < 3 Dec 2 23:40:44.627: INFO: running pods: 1 < 3 Dec 2 23:40:46.655: INFO: running pods: 1 < 3 Dec 2 23:40:48.625: INFO: running pods: 1 < 3 Dec 2 23:40:50.672: INFO: running pods: 1 < 3 Dec 2 23:40:52.629: INFO: running pods: 2 < 3 Dec 2 23:40:54.626: INFO: running pods: 2 < 3 Dec 2 23:40:56.627: INFO: running pods: 2 < 3 Dec 2 23:40:58.628: INFO: running pods: 2 < 3 Dec 2 23:41:00.628: INFO: running pods: 2 < 3 Dec 2 23:41:02.626: INFO: running pods: 2 < 3 Dec 2 23:41:04.627: INFO: running pods: 2 < 3 Dec 2 23:41:06.625: INFO: running pods: 2 < 3 Dec 2 23:41:08.626: INFO: running pods: 2 < 3 Dec 2 23:41:10.627: INFO: running pods: 2 < 3 Dec 2 23:41:10.690: INFO: running pods: 2 < 3 Dec 2 23:41:10.690: FAIL: Waiting for pods in namespace "disruption-4373" to be ready Unexpected error: <*errors.errorString | 0xc0002b8280>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/apps.waitForPodsOrDie(0x7973fe8, 0xc001a81a20, 0xc003f55030, 0xf, 0x3) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/disruption.go:576 +0x188 k8s.io/kubernetes/test/e2e/apps.glob..func5.6() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/disruption.go:196 +0x13e k8s.io/kubernetes/test/e2e.RunE2ETests(0xc000c54000) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x36c k8s.io/kubernetes/test/e2e.TestE2E(0xc000c54000) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:136 +0x2b testing.tRunner(0xc000c54000, 0x729c8b8) /usr/local/go/src/testing/testing.go:1203 +0xe5 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1248 +0x2b3 [AfterEach] [sig-apps] DisruptionController /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "disruption-4373". �[1mSTEP�[0m: Found 37 events. Dec 2 23:41:10.758: INFO: At 2022-12-02 23:31:10 +0000 UTC - event for foo: {controllermanager } NoPods: No matching pods found Dec 2 23:41:10.758: INFO: At 2022-12-02 23:31:10 +0000 UTC - event for pod-0: {default-scheduler } Scheduled: Successfully assigned disruption-4373/pod-0 to ip-172-20-43-150.us-west-2.compute.internal Dec 2 23:41:10.758: INFO: At 2022-12-02 23:31:10 +0000 UTC - event for pod-0: {kubelet ip-172-20-43-150.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "0e6129c55f0e24e0515cd8494f7612be66d6e116a15adf9d7c256abc49b9d43b": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:41:10.758: INFO: At 2022-12-02 23:31:10 +0000 UTC - event for pod-1: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "c96f5dcd08065be21e5a29a7fa30933650f261651d669ee0ef52ee3bb4f76272": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:41:10.758: INFO: At 2022-12-02 23:31:10 +0000 UTC - event for pod-1: {default-scheduler } Scheduled: Successfully assigned disruption-4373/pod-1 to ip-172-20-41-32.us-west-2.compute.internal Dec 2 23:41:10.758: INFO: At 2022-12-02 23:31:10 +0000 UTC - event for pod-2: {default-scheduler } Scheduled: Successfully assigned disruption-4373/pod-2 to ip-172-20-43-150.us-west-2.compute.internal Dec 2 23:41:10.758: INFO: At 2022-12-02 23:31:10 +0000 UTC - event for pod-2: {kubelet ip-172-20-43-150.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b443d46d21d76794e587c3db565790e92c0d4142d90a159d2e25f63d016104b7": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:41:10.758: INFO: At 2022-12-02 23:31:21 +0000 UTC - event for pod-0: {kubelet ip-172-20-43-150.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "9f9dd60ced4d3cb25e3728c8d701b7f46404f75a585e6b77174d4cdaaa658b97": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:41:10.758: INFO: At 2022-12-02 23:31:25 +0000 UTC - event for pod-1: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "5a2995fe11aceaca08c1f14b4136e2c3b8aa4b1bbd38a387c17591949ac262fe": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:41:10.758: INFO: At 2022-12-02 23:31:25 +0000 UTC - event for pod-2: {kubelet ip-172-20-43-150.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "89d7f43d92519c4670224ac422b75ec76084f2eb2020c0a2e414dbd707f33931": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:41:10.758: INFO: At 2022-12-02 23:31:36 +0000 UTC - event for pod-0: {kubelet ip-172-20-43-150.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a7f93f9f93a4661bb7d31d133b4a4df70ff9da738cecdb3726e4d20fa2fd9193": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:41:10.758: INFO: At 2022-12-02 23:31:36 +0000 UTC - event for pod-2: {kubelet ip-172-20-43-150.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "908b2cf8fbf8c4a1c5197069e5fab2aa032e4d373f04b642eb6065aebda51fa3": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:41:10.758: INFO: At 2022-12-02 23:31:39 +0000 UTC - event for pod-1: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "2347dc8b2ac3601e32aa4ae6c61385028139804fa69d06ce8f7571ed5bd1dfa3": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:41:10.758: INFO: At 2022-12-02 23:31:47 +0000 UTC - event for pod-0: {kubelet ip-172-20-43-150.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "90668123ccdbc4a26d8673f46d92e2aee3d52d3b0be9e5b03eeccd3055838517": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:41:10.758: INFO: At 2022-12-02 23:31:48 +0000 UTC - event for pod-2: {kubelet ip-172-20-43-150.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "bf827ecbbaadb0fc3c7808d18415cffa88e14462c7fd646dd82412e929b68b5d": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:41:10.758: INFO: At 2022-12-02 23:31:52 +0000 UTC - event for pod-1: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "097702abe0d45251a62380ad0af5ead616364bd32ec5e024cbb9ac6aa45f40e3": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:41:10.758: INFO: At 2022-12-02 23:31:59 +0000 UTC - event for pod-0: {kubelet ip-172-20-43-150.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "1346c55171e873c0cc1a5ed60dec59cf87bcbb4a4bfd16bba9792ef2730cfc78": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:41:10.758: INFO: At 2022-12-02 23:32:00 +0000 UTC - event for pod-2: {kubelet ip-172-20-43-150.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "dd5a10aee75fbab23d4292966ced2f5f27b81a6f2936e84b91ef34cf7300d2c8": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:41:10.758: INFO: At 2022-12-02 23:32:07 +0000 UTC - event for pod-1: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a91b741006ae866a3a835aadf9650c0f7d95efb82d0dd31dc863881d40bcdd35": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:41:10.758: INFO: At 2022-12-02 23:32:11 +0000 UTC - event for pod-2: {kubelet ip-172-20-43-150.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "4d7abf976a8072d6c9e605c6437d528f49003910567d569c431657753894ddb9": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:41:10.758: INFO: At 2022-12-02 23:32:12 +0000 UTC - event for pod-0: {kubelet ip-172-20-43-150.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b51a8bcdb43ca0b04092959c1b304500bf131f6df7584a3fe9ed86671b3b7071": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:41:10.758: INFO: At 2022-12-02 23:32:22 +0000 UTC - event for pod-2: {kubelet ip-172-20-43-150.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "00ba2e1802527bb664afdb849ecb4215859aad53695184f787e6e80df68f90ea": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:41:10.758: INFO: At 2022-12-02 23:32:23 +0000 UTC - event for pod-1: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "66b25332d09456d4cc0a94db930f842ba4a11aeaf17b2beea55530ebb8486800": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:41:10.758: INFO: At 2022-12-02 23:32:26 +0000 UTC - event for pod-0: {kubelet ip-172-20-43-150.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "32b6ec9726053b8f5b0f4efa9ba01ee594a36720e8abed8ad140b7535cb74e20": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:41:10.758: INFO: At 2022-12-02 23:32:34 +0000 UTC - event for pod-1: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "42108e509df42569f7a19511a129abf3bba84d11f4073c4e7c9b63c05ab169b1": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:41:10.758: INFO: At 2022-12-02 23:32:34 +0000 UTC - event for pod-2: {kubelet ip-172-20-43-150.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "7f6f709c6c82342e391d9640f13bfb37600dce5a186cac63b9afba1792d4a0bd": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:41:10.758: INFO: At 2022-12-02 23:32:38 +0000 UTC - event for pod-0: {kubelet ip-172-20-43-150.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e73bc86760b7115d610d76cbbee2016eb8ab44845d5ebe73240da7c6355ff924": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:41:10.758: INFO: At 2022-12-02 23:32:45 +0000 UTC - event for pod-2: {kubelet ip-172-20-43-150.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b9a47128d5cfcbcef6b743eb28afd45b8426e076ec7a96397a84826d255b2099": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:41:10.758: INFO: At 2022-12-02 23:32:48 +0000 UTC - event for pod-1: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "50cd08117e6db659bb61d4bcc8f4ff7fab4104d9bf710591fdbbd6b1ee40f21d": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:41:10.758: INFO: At 2022-12-02 23:32:51 +0000 UTC - event for pod-0: {kubelet ip-172-20-43-150.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a1099c2f6e3e959724e720760f36b8c1150d849c48e6a73184d8a26353854fff": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:41:10.758: INFO: At 2022-12-02 23:32:59 +0000 UTC - event for pod-1: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "36861eba67a689a342cedf77013b1139ca98f295ea1df13579df94bd64af8de5": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:41:10.758: INFO: At 2022-12-02 23:32:59 +0000 UTC - event for pod-2: {kubelet ip-172-20-43-150.us-west-2.compute.internal} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a85ec026f66f61068155d6363e969e750cc0e0448866fd3b088b6926db40b5f1": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:41:10.758: INFO: At 2022-12-02 23:33:03 +0000 UTC - event for pod-0: {kubelet ip-172-20-43-150.us-west-2.compute.internal} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "93210d62992323c459e2a56bbdcebb4ca5ad9525edc51cbd48c2e1e4b5de0b2e": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:41:10.758: INFO: At 2022-12-02 23:33:10 +0000 UTC - event for pod-1: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "0dac042372d30a4875e6dd301323b9a3e83d9f07c5abfe2f79e0fdb63c195639": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:41:10.758: INFO: At 2022-12-02 23:34:55 +0000 UTC - event for pod-2: {kubelet ip-172-20-43-150.us-west-2.compute.internal} Pulled: Container image "k8s.gcr.io/pause:3.5" already present on machine Dec 2 23:41:10.759: INFO: At 2022-12-02 23:34:55 +0000 UTC - event for pod-2: {kubelet ip-172-20-43-150.us-west-2.compute.internal} Created: Created container donothing Dec 2 23:41:10.759: INFO: At 2022-12-02 23:34:55 +0000 UTC - event for pod-2: {kubelet ip-172-20-43-150.us-west-2.compute.internal} Started: Started container donothing Dec 2 23:41:10.822: INFO: POD NODE PHASE GRACE CONDITIONS Dec 2 23:41:10.822: INFO: pod-0 ip-172-20-43-150.us-west-2.compute.internal Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:31:10 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:40:50 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:40:50 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:31:10 +0000 UTC }] Dec 2 23:41:10.822: INFO: pod-1 ip-172-20-41-32.us-west-2.compute.internal Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:31:10 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:31:10 +0000 UTC ContainersNotReady containers with unready status: [donothing]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:31:10 +0000 UTC ContainersNotReady containers with unready status: [donothing]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:31:10 +0000 UTC }] Dec 2 23:41:10.822: INFO: pod-2 ip-172-20-43-150.us-west-2.compute.internal Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:31:10 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:34:55 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:34:55 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:31:10 +0000 UTC }] Dec 2 23:41:10.822: INFO: Dec 2 23:41:10.886: INFO: Logging node info for node ip-172-20-33-254.us-west-2.compute.internal Dec 2 23:41:10.949: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-33-254.us-west-2.compute.internal 6236393f-0a33-4aea-a2e2-fedaf7becdd4 32850 0 2022-12-02 23:17:15 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-33-254.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:ip-172-20-33-254.us-west-2.compute.internal topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0d507bb204448139f"} io.cilium.network.ipv4-cilium-host:172.20.42.35 io.cilium.network.ipv4-health-ip:172.20.58.176 io.cilium.network.ipv4-pod-cidr:100.96.1.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2022-12-02 23:17:15 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2022-12-02 23:17:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-12-02 23:17:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {cilium-agent Update v1 2022-12-02 23:17:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-12-02 23:17:41 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-12-02 23:41:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-0d507bb204448139f,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-02 23:17:41 +0000 UTC,LastTransitionTime:2022-12-02 23:17:41 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-02 23:41:06 +0000 UTC,LastTransitionTime:2022-12-02 23:17:15 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-02 23:41:06 +0000 UTC,LastTransitionTime:2022-12-02 23:17:15 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-02 23:41:06 +0000 UTC,LastTransitionTime:2022-12-02 23:17:15 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-02 23:41:06 +0000 UTC,LastTransitionTime:2022-12-02 23:17:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.33.254,},NodeAddress{Type:ExternalIP,Address:54.190.128.11,},NodeAddress{Type:Hostname,Address:ip-172-20-33-254.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-33-254.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-190-128-11.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23ec8dd062be253828b6092e22eaab,SystemUUID:ec23ec8d-d062-be25-3828-b6092e22eaab,BootID:6bbf84c7-41f9-4141-912e-7f3bc9a0ef42,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.13,KubeletVersion:v1.22.16,KubeProxyVersion:v1.22.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:160382894,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.22.16],SizeBytes:105446599,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:1f36a24cfb5e0c3f725d7565a867c2384282fcbeccc77b07b423c9da95763a9a k8s.gcr.io/e2e-test-images/nautilus:1.4],SizeBytes:49230179,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:716d2f68314c5c4ddd5ecdb45183fcb4ed8019015982c1321571f863989b70b0 k8s.gcr.io/e2e-test-images/httpd:2.4.39-1],SizeBytes:41902332,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:b913fa234cc3473cfe16e937d106b455a7609f927f59031c81aca791e2689b50 k8s.gcr.io/e2e-test-images/httpd:2.4.38-1],SizeBytes:40765006,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:28956694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonroot@sha256:4051e85640c22f8e00c34dbd273576fc9e1e2829992656588062be9c0f69b04b k8s.gcr.io/e2e-test-images/nonroot:1.1],SizeBytes:17748448,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:aa60f453d64dfb3c3fd9e7306f988c36c6352c4f2d956aa90467f2808091effa registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.5],SizeBytes:15209420,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:1b7c978a792a8fa4e96244e8059bd71bb49b07e2e5a897fb0c867bdc6db20d5d k8s.gcr.io/sig-storage/livenessprobe:v2.3.0],SizeBytes:7933739,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:503b7abb89e57383eba61cc8a9cb0b495ea575c516108f7d972a6ff6e1ab3c9b k8s.gcr.io/e2e-test-images/nginx:1.14-1],SizeBytes:6979365,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:1ff6c18fbef2045af6b9c16bf034cc421a29027b800e4f9b68ae9b1cb3e9ae07 k8s.gcr.io/pause:3.5],SizeBytes:301416,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 2 23:41:10.950: INFO: Logging kubelet events for node ip-172-20-33-254.us-west-2.compute.internal Dec 2 23:41:11.016: INFO: Logging pods the kubelet thinks is on node ip-172-20-33-254.us-west-2.compute.internal Dec 2 23:41:11.155: INFO: cilium-2db9c started at 2022-12-02 23:17:16 +0000 UTC (1+1 container statuses recorded) Dec 2 23:41:11.156: INFO: Init container clean-cilium-state ready: true, restart count 0 Dec 2 23:41:11.156: INFO: Container cilium-agent ready: true, restart count 0 Dec 2 23:41:11.156: INFO: netserver-0 started at 2022-12-02 23:40:18 +0000 UTC (0+1 container statuses recorded) Dec 2 23:41:11.156: INFO: Container webserver ready: true, restart count 0 Dec 2 23:41:11.156: INFO: liveness-635d1415-eaae-4adf-9d23-2b99e0faf01c started at 2022-12-02 23:41:02 +0000 UTC (0+1 container statuses recorded) Dec 2 23:41:11.156: INFO: Container agnhost-container ready: false, restart count 0 Dec 2 23:41:11.156: INFO: coredns-5fcc7b6498-8nvj5 started at 2022-12-02 23:17:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:41:11.156: INFO: Container coredns ready: true, restart count 0 Dec 2 23:41:11.156: INFO: pod-configmaps-12386ed8-00c1-48d4-a98e-1a0dc26d4470 started at 2022-12-02 23:41:07 +0000 UTC (0+1 container statuses recorded) Dec 2 23:41:11.156: INFO: Container agnhost-container ready: false, restart count 0 Dec 2 23:41:11.156: INFO: netserver-0 started at 2022-12-02 23:38:46 +0000 UTC (0+1 container statuses recorded) Dec 2 23:41:11.156: INFO: Container webserver ready: true, restart count 0 Dec 2 23:41:11.156: INFO: coredns-autoscaler-6658b4bf85-4zgd2 started at 2022-12-02 23:17:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:41:11.156: INFO: Container autoscaler ready: true, restart count 0 Dec 2 23:41:11.156: INFO: ss2-2 started at 2022-12-02 23:40:53 +0000 UTC (0+1 container statuses recorded) Dec 2 23:41:11.156: INFO: Container webserver ready: true, restart count 0 Dec 2 23:41:11.156: INFO: netserver-0 started at 2022-12-02 23:40:54 +0000 UTC (0+1 container statuses recorded) Dec 2 23:41:11.156: INFO: Container webserver ready: false, restart count 0 Dec 2 23:41:11.156: INFO: hostexec-ip-172-20-33-254.us-west-2.compute.internal-pm8xv started at 2022-12-02 23:41:02 +0000 UTC (0+1 container statuses recorded) Dec 2 23:41:11.156: INFO: Container agnhost-container ready: true, restart count 0 Dec 2 23:41:11.156: INFO: pod-client started at 2022-12-02 23:40:54 +0000 UTC (0+1 container statuses recorded) Dec 2 23:41:11.156: INFO: Container pod-client ready: true, restart count 0 Dec 2 23:41:11.156: INFO: ss2-1 started at 2022-12-02 23:40:58 +0000 UTC (0+1 container statuses recorded) Dec 2 23:41:11.156: INFO: Container webserver ready: true, restart count 0 Dec 2 23:41:11.156: INFO: test-container-pod started at 2022-12-02 23:41:01 +0000 UTC (0+1 container statuses recorded) Dec 2 23:41:11.156: INFO: Container webserver ready: true, restart count 0 Dec 2 23:41:11.156: INFO: pod-projected-secrets-d8cd68a2-5e4a-40e5-acab-6100df95116b started at <nil> (0+0 container statuses recorded) Dec 2 23:41:11.156: INFO: ebs-csi-node-rfgvb started at 2022-12-02 23:17:16 +0000 UTC (0+3 container statuses recorded) Dec 2 23:41:11.156: INFO: Container ebs-plugin ready: true, restart count 0 Dec 2 23:41:11.156: INFO: Container liveness-probe ready: true, restart count 0 Dec 2 23:41:11.156: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 2 23:41:11.488: INFO: Latency metrics for node ip-172-20-33-254.us-west-2.compute.internal Dec 2 23:41:11.488: INFO: Logging node info for node ip-172-20-40-67.us-west-2.compute.internal Dec 2 23:41:11.554: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-40-67.us-west-2.compute.internal 0a5fe428-9a11-4bd2-96f1-21d4d188f80f 30470 0 2022-12-02 23:15:37 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-40-67.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/control-plane: node-role.kubernetes.io/master: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:us-west-2a topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0725cfbb3e93e664c"} io.cilium.network.ipv4-cilium-host:172.20.59.109 io.cilium.network.ipv4-health-ip:172.20.51.231 io.cilium.network.ipv4-pod-cidr:100.96.0.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-12-02 23:15:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {protokube Update v1 2022-12-02 23:16:01 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kops-controller Update v1 2022-12-02 23:16:07 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/master":{}}}} } {kube-controller-manager Update v1 2022-12-02 23:16:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {cilium-agent Update v1 2022-12-02 23:17:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-12-02 23:17:36 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-12-02 23:17:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-0725cfbb3e93e664c,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892301824 0} {<nil>} 3801076Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787444224 0} {<nil>} 3698676Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-02 23:17:36 +0000 UTC,LastTransitionTime:2022-12-02 23:17:36 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-02 23:38:28 +0000 UTC,LastTransitionTime:2022-12-02 23:15:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-02 23:38:28 +0000 UTC,LastTransitionTime:2022-12-02 23:15:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-02 23:38:28 +0000 UTC,LastTransitionTime:2022-12-02 23:15:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-02 23:38:28 +0000 UTC,LastTransitionTime:2022-12-02 23:16:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.40.67,},NodeAddress{Type:ExternalIP,Address:34.213.81.56,},NodeAddress{Type:Hostname,Address:ip-172-20-40-67.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-40-67.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-34-213-81-56.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2bdc536f1fb98cbe397162835bf7b5,SystemUUID:ec2bdc53-6f1f-b98c-be39-7162835bf7b5,BootID:80f23ad2-0f99-46af-8080-253547cd7440,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.13,KubeletVersion:v1.22.16,KubeProxyVersion:v1.22.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:a91fdaf9b988943a9c73d422348c2383c08dfc2566d4124a39a1b3d785018720 registry.k8s.io/etcdadm/etcd-manager:v3.0.20220831],SizeBytes:216515768,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:160382894,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.22.16],SizeBytes:129618394,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.22.16],SizeBytes:123306305,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.22.16],SizeBytes:105446599,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.22.16],SizeBytes:53956920,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-alpha.2],SizeBytes:42210956,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-alpha.2],SizeBytes:41463728,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:28956694,},ContainerImage{Names:[quay.io/cilium/operator@sha256:e2b26376a904190c73498e04bd5c1298a4c5239d50feab024074e4516381890f quay.io/cilium/operator:v1.11.11],SizeBytes:24003684,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-alpha.2],SizeBytes:4954596,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 2 23:41:11.554: INFO: Logging kubelet events for node ip-172-20-40-67.us-west-2.compute.internal Dec 2 23:41:11.620: INFO: Logging pods the kubelet thinks is on node ip-172-20-40-67.us-west-2.compute.internal Dec 2 23:41:11.728: INFO: kube-apiserver-ip-172-20-40-67.us-west-2.compute.internal started at 2022-12-02 23:14:53 +0000 UTC (0+2 container statuses recorded) Dec 2 23:41:11.728: INFO: Container healthcheck ready: true, restart count 0 Dec 2 23:41:11.728: INFO: Container kube-apiserver ready: true, restart count 1 Dec 2 23:41:11.728: INFO: cilium-operator-587dd66f87-zmwpl started at 2022-12-02 23:16:04 +0000 UTC (0+1 container statuses recorded) Dec 2 23:41:11.728: INFO: Container cilium-operator ready: true, restart count 1 Dec 2 23:41:11.728: INFO: ebs-csi-controller-764b64d679-rnjp4 started at 2022-12-02 23:16:04 +0000 UTC (0+5 container statuses recorded) Dec 2 23:41:11.728: INFO: Container csi-attacher ready: true, restart count 0 Dec 2 23:41:11.728: INFO: Container csi-provisioner ready: true, restart count 0 Dec 2 23:41:11.728: INFO: Container csi-resizer ready: true, restart count 0 Dec 2 23:41:11.728: INFO: Container ebs-plugin ready: true, restart count 0 Dec 2 23:41:11.728: INFO: Container liveness-probe ready: true, restart count 0 Dec 2 23:41:11.728: INFO: ebs-csi-node-jt6f2 started at 2022-12-02 23:16:04 +0000 UTC (0+3 container statuses recorded) Dec 2 23:41:11.728: INFO: Container ebs-plugin ready: true, restart count 0 Dec 2 23:41:11.728: INFO: Container liveness-probe ready: true, restart count 0 Dec 2 23:41:11.728: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 2 23:41:11.728: INFO: cilium-t57cd started at 2022-12-02 23:16:04 +0000 UTC (1+1 container statuses recorded) Dec 2 23:41:11.728: INFO: Init container clean-cilium-state ready: true, restart count 0 Dec 2 23:41:11.728: INFO: Container cilium-agent ready: true, restart count 1 Dec 2 23:41:11.728: INFO: kops-controller-47skn started at 2022-12-02 23:16:04 +0000 UTC (0+1 container statuses recorded) Dec 2 23:41:11.728: INFO: Container kops-controller ready: true, restart count 0 Dec 2 23:41:11.728: INFO: dns-controller-5fb778d9d5-fln22 started at 2022-12-02 23:16:04 +0000 UTC (0+1 container statuses recorded) Dec 2 23:41:11.728: INFO: Container dns-controller ready: true, restart count 0 Dec 2 23:41:11.728: INFO: etcd-manager-main-ip-172-20-40-67.us-west-2.compute.internal started at 2022-12-02 23:14:53 +0000 UTC (0+1 container statuses recorded) Dec 2 23:41:11.728: INFO: Container etcd-manager ready: true, restart count 0 Dec 2 23:41:11.728: INFO: kube-controller-manager-ip-172-20-40-67.us-west-2.compute.internal started at 2022-12-02 23:14:53 +0000 UTC (0+1 container statuses recorded) Dec 2 23:41:11.728: INFO: Container kube-controller-manager ready: true, restart count 2 Dec 2 23:41:11.728: INFO: kube-scheduler-ip-172-20-40-67.us-west-2.compute.internal started at 2022-12-02 23:14:53 +0000 UTC (0+1 container statuses recorded) Dec 2 23:41:11.728: INFO: Container kube-scheduler ready: true, restart count 0 Dec 2 23:41:11.728: INFO: etcd-manager-events-ip-172-20-40-67.us-west-2.compute.internal started at 2022-12-02 23:14:53 +0000 UTC (0+1 container statuses recorded) Dec 2 23:41:11.728: INFO: Container etcd-manager ready: true, restart count 0 Dec 2 23:41:12.111: INFO: Latency metrics for node ip-172-20-40-67.us-west-2.compute.internal Dec 2 23:41:12.111: INFO: Logging node info for node ip-172-20-41-32.us-west-2.compute.internal Dec 2 23:41:12.181: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-41-32.us-west-2.compute.internal ad6a9fcc-418f-4c1a-a9c7-ac1873b8a1ba 32473 0 2022-12-02 23:17:23 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-41-32.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:node mounted_volume_expand:mounted-volume-expand-6871 node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:ip-172-20-41-32.us-west-2.compute.internal topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-2245":"ip-172-20-41-32.us-west-2.compute.internal","csi-mock-csi-mock-volumes-2404":"csi-mock-csi-mock-volumes-2404","csi-mock-csi-mock-volumes-4518":"csi-mock-csi-mock-volumes-4518","ebs.csi.aws.com":"i-00d261efdd8c07a99"} io.cilium.network.ipv4-cilium-host:172.20.50.121 io.cilium.network.ipv4-health-ip:172.20.47.106 io.cilium.network.ipv4-pod-cidr:100.96.3.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2022-12-02 23:17:23 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-12-02 23:17:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2022-12-02 23:17:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {cilium-agent Update v1 2022-12-02 23:17:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-12-02 23:17:51 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {e2e.test Update v1 2022-12-02 23:29:34 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:mounted_volume_expand":{}}}} } {kubelet Update v1 2022-12-02 23:30:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2022-12-02 23:30:44 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-00d261efdd8c07a99,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-02 23:17:51 +0000 UTC,LastTransitionTime:2022-12-02 23:17:51 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-02 23:40:34 +0000 UTC,LastTransitionTime:2022-12-02 23:17:23 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-02 23:40:34 +0000 UTC,LastTransitionTime:2022-12-02 23:17:23 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-02 23:40:34 +0000 UTC,LastTransitionTime:2022-12-02 23:17:23 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-02 23:40:34 +0000 UTC,LastTransitionTime:2022-12-02 23:17:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.41.32,},NodeAddress{Type:ExternalIP,Address:35.88.26.86,},NodeAddress{Type:Hostname,Address:ip-172-20-41-32.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-41-32.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-88-26-86.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2624f500a45f29b52ed8b5d778f035,SystemUUID:ec2624f5-00a4-5f29-b52e-d8b5d778f035,BootID:b76bd51c-e57a-47b9-86f2-c1093a033e09,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.13,KubeletVersion:v1.22.16,KubeProxyVersion:v1.22.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:160382894,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:702a992280fb7c3303e84a5801acbb4c9c7fcf48cffe0e9c8be3f0c60f74cf89 k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.4],SizeBytes:112029652,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.22.16],SizeBytes:105446599,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:716d2f68314c5c4ddd5ecdb45183fcb4ed8019015982c1321571f863989b70b0 k8s.gcr.io/e2e-test-images/httpd:2.4.39-1],SizeBytes:41902332,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:b913fa234cc3473cfe16e937d106b455a7609f927f59031c81aca791e2689b50 k8s.gcr.io/e2e-test-images/httpd:2.4.38-1],SizeBytes:40765006,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:28956694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:1b7c978a792a8fa4e96244e8059bd71bb49b07e2e5a897fb0c867bdc6db20d5d k8s.gcr.io/sig-storage/livenessprobe:v2.3.0],SizeBytes:7933739,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:503b7abb89e57383eba61cc8a9cb0b495ea575c516108f7d972a6ff6e1ab3c9b k8s.gcr.io/e2e-test-images/nginx:1.14-1],SizeBytes:6979365,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac k8s.gcr.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:1ff6c18fbef2045af6b9c16bf034cc421a29027b800e4f9b68ae9b1cb3e9ae07 k8s.gcr.io/pause:3.5],SizeBytes:301416,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-00e603f65a9c9071b],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-00e603f65a9c9071b,DevicePath:,},},Config:nil,},} Dec 2 23:41:12.182: INFO: Logging kubelet events for node ip-172-20-41-32.us-west-2.compute.internal Dec 2 23:41:12.250: INFO: Logging pods the kubelet thinks is on node ip-172-20-41-32.us-west-2.compute.internal Dec 2 23:41:12.331: INFO: csi-mockplugin-0 started at 2022-12-02 23:36:30 +0000 UTC (0+4 container statuses recorded) Dec 2 23:41:12.331: INFO: Container busybox ready: true, restart count 0 Dec 2 23:41:12.331: INFO: Container csi-provisioner ready: true, restart count 0 Dec 2 23:41:12.331: INFO: Container driver-registrar ready: true, restart count 0 Dec 2 23:41:12.331: INFO: Container mock ready: true, restart count 0 Dec 2 23:41:12.331: INFO: ss2-0 started at 2022-12-02 23:33:41 +0000 UTC (0+1 container statuses recorded) Dec 2 23:41:12.331: INFO: Container webserver ready: true, restart count 0 Dec 2 23:41:12.331: INFO: csi-hostpathplugin-0 started at 2022-12-02 23:38:57 +0000 UTC (0+7 container statuses recorded) Dec 2 23:41:12.331: INFO: Container csi-attacher ready: true, restart count 0 Dec 2 23:41:12.331: INFO: Container csi-provisioner ready: true, restart count 0 Dec 2 23:41:12.331: INFO: Container csi-resizer ready: true, restart count 0 Dec 2 23:41:12.331: INFO: Container csi-snapshotter ready: true, restart count 0 Dec 2 23:41:12.331: INFO: Container hostpath ready: true, restart count 0 Dec 2 23:41:12.331: INFO: Container liveness-probe ready: true, restart count 0 Dec 2 23:41:12.331: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 2 23:41:12.331: INFO: pod-server-1 started at 2022-12-02 23:41:04 +0000 UTC (1+1 container statuses recorded) Dec 2 23:41:12.331: INFO: Init container init ready: false, restart count 0 Dec 2 23:41:12.331: INFO: Container agnhost-container ready: false, restart count 0 Dec 2 23:41:12.331: INFO: hostexec-ip-172-20-41-32.us-west-2.compute.internal-x5rbg started at 2022-12-02 23:41:10 +0000 UTC (0+1 container statuses recorded) Dec 2 23:41:12.331: INFO: Container agnhost-container ready: true, restart count 0 Dec 2 23:41:12.331: INFO: csi-mockplugin-0 started at 2022-12-02 23:40:55 +0000 UTC (0+3 container statuses recorded) Dec 2 23:41:12.331: INFO: Container csi-provisioner ready: true, restart count 0 Dec 2 23:41:12.331: INFO: Container driver-registrar ready: true, restart count 0 Dec 2 23:41:12.331: INFO: Container mock ready: true, restart count 0 Dec 2 23:41:12.331: INFO: netserver-1 started at 2022-12-02 23:40:18 +0000 UTC (0+1 container statuses recorded) Dec 2 23:41:12.331: INFO: Container webserver ready: true, restart count 0 Dec 2 23:41:12.331: INFO: netserver-1 started at 2022-12-02 23:40:54 +0000 UTC (0+1 container statuses recorded) Dec 2 23:41:12.331: INFO: Container webserver ready: false, restart count 0 Dec 2 23:41:12.331: INFO: ss-0 started at 2022-12-02 23:36:09 +0000 UTC (0+1 container statuses recorded) Dec 2 23:41:12.331: INFO: Container webserver ready: true, restart count 0 Dec 2 23:41:12.331: INFO: pod-1 started at 2022-12-02 23:31:10 +0000 UTC (0+1 container statuses recorded) Dec 2 23:41:12.331: INFO: Container donothing ready: false, restart count 0 Dec 2 23:41:12.331: INFO: netserver-1 started at 2022-12-02 23:38:46 +0000 UTC (0+1 container statuses recorded) Dec 2 23:41:12.331: INFO: Container webserver ready: true, restart count 0 Dec 2 23:41:12.331: INFO: cilium-m9r5q started at 2022-12-02 23:17:24 +0000 UTC (1+1 container statuses recorded) Dec 2 23:41:12.331: INFO: Init container clean-cilium-state ready: true, restart count 0 Dec 2 23:41:12.331: INFO: Container cilium-agent ready: true, restart count 0 Dec 2 23:41:12.332: INFO: inline-volume-tester-zc874 started at 2022-12-02 23:38:57 +0000 UTC (0+1 container statuses recorded) Dec 2 23:41:12.332: INFO: Container csi-volume-tester ready: true, restart count 0 Dec 2 23:41:12.332: INFO: send-events-c13dc0ff-64a2-4072-9adb-bb67dd404742 started at 2022-12-02 23:39:16 +0000 UTC (0+1 container statuses recorded) Dec 2 23:41:12.332: INFO: Container p ready: true, restart count 0 Dec 2 23:41:12.332: INFO: ebs-csi-node-c27hl started at 2022-12-02 23:17:24 +0000 UTC (0+3 container statuses recorded) Dec 2 23:41:12.332: INFO: Container ebs-plugin ready: true, restart count 0 Dec 2 23:41:12.332: INFO: Container liveness-probe ready: true, restart count 0 Dec 2 23:41:12.332: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 2 23:41:12.644: INFO: Latency metrics for node ip-172-20-41-32.us-west-2.compute.internal Dec 2 23:41:12.644: INFO: Logging node info for node ip-172-20-43-150.us-west-2.compute.internal Dec 2 23:41:12.708: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-43-150.us-west-2.compute.internal 47bb1581-dcdc-4edf-b2c4-109aedb2f5bd 32852 0 2022-12-02 23:17:23 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-43-150.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:ip-172-20-43-150.us-west-2.compute.internal topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0e2e5350f5754b178"} io.cilium.network.ipv4-cilium-host:172.20.35.108 io.cilium.network.ipv4-health-ip:172.20.34.31 io.cilium.network.ipv4-pod-cidr:100.96.4.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2022-12-02 23:17:23 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-12-02 23:17:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2022-12-02 23:17:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {cilium-agent Update v1 2022-12-02 23:17:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-12-02 23:17:51 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-12-02 23:41:04 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2022-12-02 23:41:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-0e2e5350f5754b178,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-02 23:17:51 +0000 UTC,LastTransitionTime:2022-12-02 23:17:51 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-02 23:41:04 +0000 UTC,LastTransitionTime:2022-12-02 23:17:23 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-02 23:41:04 +0000 UTC,LastTransitionTime:2022-12-02 23:17:23 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-02 23:41:04 +0000 UTC,LastTransitionTime:2022-12-02 23:17:23 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-02 23:41:04 +0000 UTC,LastTransitionTime:2022-12-02 23:17:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.43.150,},NodeAddress{Type:ExternalIP,Address:54.184.249.63,},NodeAddress{Type:Hostname,Address:ip-172-20-43-150.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-43-150.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-184-249-63.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23a85d6d7b80ff12e03e51b1effc11,SystemUUID:ec23a85d-6d7b-80ff-12e0-3e51b1effc11,BootID:72904f56-1058-4b24-85d2-c465d1149ad1,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.13,KubeletVersion:v1.22.16,KubeProxyVersion:v1.22.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:160382894,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:702a992280fb7c3303e84a5801acbb4c9c7fcf48cffe0e9c8be3f0c60f74cf89 k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.4],SizeBytes:112029652,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.22.16],SizeBytes:105446599,},ContainerImage{Names:[docker.io/library/nginx@sha256:e209ac2f37c70c1e0e9873a5f7231e91dcd83fdf1178d8ed36c2ec09974210ba docker.io/library/nginx:latest],SizeBytes:56833911,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:1f36a24cfb5e0c3f725d7565a867c2384282fcbeccc77b07b423c9da95763a9a k8s.gcr.io/e2e-test-images/nautilus:1.4],SizeBytes:49230179,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:716d2f68314c5c4ddd5ecdb45183fcb4ed8019015982c1321571f863989b70b0 k8s.gcr.io/e2e-test-images/httpd:2.4.39-1],SizeBytes:41902332,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:b913fa234cc3473cfe16e937d106b455a7609f927f59031c81aca791e2689b50 k8s.gcr.io/e2e-test-images/httpd:2.4.38-1],SizeBytes:40765006,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:28956694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a k8s.gcr.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf k8s.gcr.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:1b7c978a792a8fa4e96244e8059bd71bb49b07e2e5a897fb0c867bdc6db20d5d k8s.gcr.io/sig-storage/livenessprobe:v2.3.0],SizeBytes:7933739,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:503b7abb89e57383eba61cc8a9cb0b495ea575c516108f7d972a6ff6e1ab3c9b k8s.gcr.io/e2e-test-images/nginx:1.14-1],SizeBytes:6979365,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac k8s.gcr.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:1ff6c18fbef2045af6b9c16bf034cc421a29027b800e4f9b68ae9b1cb3e9ae07 k8s.gcr.io/pause:3.5],SizeBytes:301416,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-05cb6db45923d72ca kubernetes.io/csi/ebs.csi.aws.com^vol-0bc1290577d5fef97],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0bc1290577d5fef97,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-05cb6db45923d72ca,DevicePath:,},},Config:nil,},} Dec 2 23:41:12.709: INFO: Logging kubelet events for node ip-172-20-43-150.us-west-2.compute.internal Dec 2 23:41:12.776: INFO: Logging pods the kubelet thinks is on node ip-172-20-43-150.us-west-2.compute.internal Dec 2 23:41:12.846: INFO: pod-2 started at 2022-12-02 23:31:10 +0000 UTC (0+1 container statuses recorded) Dec 2 23:41:12.846: INFO: Container donothing ready: true, restart count 0 Dec 2 23:41:12.846: INFO: netserver-2 started at 2022-12-02 23:40:18 +0000 UTC (0+1 container statuses recorded) Dec 2 23:41:12.846: INFO: Container webserver ready: true, restart count 0 Dec 2 23:41:12.846: INFO: cilium-7h427 started at 2022-12-02 23:17:24 +0000 UTC (1+1 container statuses recorded) Dec 2 23:41:12.846: INFO: Init container clean-cilium-state ready: true, restart count 0 Dec 2 23:41:12.846: INFO: Container cilium-agent ready: true, restart count 0 Dec 2 23:41:12.846: INFO: ebs-csi-node-8qrwx started at 2022-12-02 23:17:24 +0000 UTC (0+3 container statuses recorded) Dec 2 23:41:12.846: INFO: Container ebs-plugin ready: true, restart count 0 Dec 2 23:41:12.846: INFO: Container liveness-probe ready: true, restart count 0 Dec 2 23:41:12.846: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 2 23:41:12.846: INFO: ss-1 started at 2022-12-02 23:41:02 +0000 UTC (0+1 container statuses recorded) Dec 2 23:41:12.846: INFO: Container webserver ready: false, restart count 0 Dec 2 23:41:12.846: INFO: pod-b615e9b7-8b3a-4963-9c98-ce5228b54246 started at 2022-12-02 23:41:04 +0000 UTC (0+1 container statuses recorded) Dec 2 23:41:12.846: INFO: Container write-pod ready: false, restart count 0 Dec 2 23:41:12.846: INFO: test-container-pod started at <nil> (0+0 container statuses recorded) Dec 2 23:41:12.846: INFO: ss2-0 started at 2022-12-02 23:40:54 +0000 UTC (0+1 container statuses recorded) Dec 2 23:41:12.846: INFO: Container webserver ready: true, restart count 0 Dec 2 23:41:12.846: INFO: pfpod started at 2022-12-02 23:40:59 +0000 UTC (0+2 container statuses recorded) Dec 2 23:41:12.846: INFO: Container portforwardtester ready: false, restart count 0 Dec 2 23:41:12.846: INFO: Container readiness ready: true, restart count 0 Dec 2 23:41:12.846: INFO: netserver-2 started at 2022-12-02 23:38:46 +0000 UTC (0+1 container statuses recorded) Dec 2 23:41:12.846: INFO: Container webserver ready: true, restart count 0 Dec 2 23:41:12.846: INFO: netserver-2 started at 2022-12-02 23:40:54 +0000 UTC (0+1 container statuses recorded) Dec 2 23:41:12.846: INFO: Container webserver ready: false, restart count 0 Dec 2 23:41:12.846: INFO: pod-0 started at 2022-12-02 23:31:10 +0000 UTC (0+1 container statuses recorded) Dec 2 23:41:12.846: INFO: Container donothing ready: true, restart count 0 Dec 2 23:41:12.846: INFO: ss2-1 started at 2022-12-02 23:40:50 +0000 UTC (0+1 container statuses recorded) Dec 2 23:41:12.846: INFO: Container webserver ready: true, restart count 0 Dec 2 23:41:12.846: INFO: inline-volume-tester-h7kpt started at 2022-12-02 23:41:09 +0000 UTC (0+1 container statuses recorded) Dec 2 23:41:12.847: INFO: Container csi-volume-tester ready: false, restart count 0 Dec 2 23:41:13.149: INFO: Latency metrics for node ip-172-20-43-150.us-west-2.compute.internal Dec 2 23:41:13.149: INFO: Logging node info for node ip-172-20-48-5.us-west-2.compute.internal Dec 2 23:41:13.212: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-48-5.us-west-2.compute.internal 6342e9b6-e818-4fbf-aae7-8be176fd4ec1 32947 0 2022-12-02 23:17:21 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-48-5.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:ip-172-20-48-5.us-west-2.compute.internal topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-5295":"csi-mock-csi-mock-volumes-5295","csi-mock-csi-mock-volumes-9063":"csi-mock-csi-mock-volumes-9063","ebs.csi.aws.com":"i-0093900b92d415e84"} io.cilium.network.ipv4-cilium-host:172.20.42.98 io.cilium.network.ipv4-health-ip:172.20.44.82 io.cilium.network.ipv4-pod-cidr:100.96.2.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-12-02 23:17:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2022-12-02 23:17:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2022-12-02 23:17:22 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {cilium-agent Update v1 2022-12-02 23:17:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-12-02 23:17:52 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-12-02 23:36:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {kube-controller-manager Update v1 2022-12-02 23:41:08 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-0093900b92d415e84,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-02 23:17:52 +0000 UTC,LastTransitionTime:2022-12-02 23:17:52 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-02 23:41:03 +0000 UTC,LastTransitionTime:2022-12-02 23:17:21 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-02 23:41:03 +0000 UTC,LastTransitionTime:2022-12-02 23:17:21 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-02 23:41:03 +0000 UTC,LastTransitionTime:2022-12-02 23:17:21 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-02 23:41:03 +0000 UTC,LastTransitionTime:2022-12-02 23:17:42 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.48.5,},NodeAddress{Type:ExternalIP,Address:34.213.188.181,},NodeAddress{Type:Hostname,Address:ip-172-20-48-5.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-48-5.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-34-213-188-181.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2ecd9e359fbd979ba14c48724d474b,SystemUUID:ec2ecd9e-359f-bd97-9ba1-4c48724d474b,BootID:3d1b1479-a710-49bb-96b3-2764890e8166,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.13,KubeletVersion:v1.22.16,KubeProxyVersion:v1.22.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:160382894,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.22.16],SizeBytes:105446599,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:716d2f68314c5c4ddd5ecdb45183fcb4ed8019015982c1321571f863989b70b0 k8s.gcr.io/e2e-test-images/httpd:2.4.39-1],SizeBytes:41902332,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:b913fa234cc3473cfe16e937d106b455a7609f927f59031c81aca791e2689b50 k8s.gcr.io/e2e-test-images/httpd:2.4.38-1],SizeBytes:40765006,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:28956694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a k8s.gcr.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:1b7c978a792a8fa4e96244e8059bd71bb49b07e2e5a897fb0c867bdc6db20d5d k8s.gcr.io/sig-storage/livenessprobe:v2.3.0],SizeBytes:7933739,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:503b7abb89e57383eba61cc8a9cb0b495ea575c516108f7d972a6ff6e1ab3c9b k8s.gcr.io/e2e-test-images/nginx:1.14-1],SizeBytes:6979365,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:1ff6c18fbef2045af6b9c16bf034cc421a29027b800e4f9b68ae9b1cb3e9ae07 k8s.gcr.io/pause:3.5],SizeBytes:301416,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-5295^4,DevicePath:,},},Config:nil,},} Dec 2 23:41:13.213: INFO: Logging kubelet events for node ip-172-20-48-5.us-west-2.compute.internal Dec 2 23:41:13.282: INFO: Logging pods the kubelet thinks is on node ip-172-20-48-5.us-west-2.compute.internal Dec 2 23:41:13.356: INFO: pvc-volume-tester-tmhtx started at 2022-12-02 23:41:08 +0000 UTC (0+1 container statuses recorded) Dec 2 23:41:13.356: INFO: Container volume-tester ready: false, restart count 0 Dec 2 23:41:13.356: INFO: csi-mockplugin-attacher-0 started at 2022-12-02 23:40:55 +0000 UTC (0+1 container statuses recorded) Dec 2 23:41:13.356: INFO: Container csi-attacher ready: true, restart count 0 Dec 2 23:41:13.356: INFO: csi-mockplugin-resizer-0 started at 2022-12-02 23:40:55 +0000 UTC (0+1 container statuses recorded) Dec 2 23:41:13.356: INFO: Container csi-resizer ready: true, restart count 0 Dec 2 23:41:13.356: INFO: csi-mockplugin-0 started at 2022-12-02 23:40:55 +0000 UTC (0+3 container statuses recorded) Dec 2 23:41:13.356: INFO: Container csi-provisioner ready: true, restart count 0 Dec 2 23:41:13.356: INFO: Container driver-registrar ready: true, restart count 0 Dec 2 23:41:13.356: INFO: Container mock ready: true, restart count 0 Dec 2 23:41:13.356: INFO: netserver-3 started at 2022-12-02 23:40:18 +0000 UTC (0+1 container statuses recorded) Dec 2 23:41:13.356: INFO: Container webserver ready: true, restart count 0 Dec 2 23:41:13.356: INFO: ebs-csi-node-bcx5m started at 2022-12-02 23:17:22 +0000 UTC (0+3 container statuses recorded) Dec 2 23:41:13.356: INFO: Container ebs-plugin ready: true, restart count 0 Dec 2 23:41:13.356: INFO: Container liveness-probe ready: true, restart count 0 Dec 2 23:41:13.356: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 2 23:41:13.356: INFO: coredns-5fcc7b6498-clxp8 started at 2022-12-02 23:17:58 +0000 UTC (0+1 container statuses recorded) Dec 2 23:41:13.356: INFO: Container coredns ready: true, restart count 0 Dec 2 23:41:13.356: INFO: cilium-ftssb started at 2022-12-02 23:17:22 +0000 UTC (1+1 container statuses recorded) Dec 2 23:41:13.356: INFO: Init container clean-cilium-state ready: true, restart count 0 Dec 2 23:41:13.356: INFO: Container cilium-agent ready: true, restart count 0 Dec 2 23:41:13.356: INFO: netserver-3 started at 2022-12-02 23:40:54 +0000 UTC (0+1 container statuses recorded) Dec 2 23:41:13.356: INFO: Container webserver ready: false, restart count 0 Dec 2 23:41:13.356: INFO: ss2-2 started at 2022-12-02 23:41:05 +0000 UTC (0+1 container statuses recorded) Dec 2 23:41:13.356: INFO: Container webserver ready: true, restart count 0 Dec 2 23:41:13.356: INFO: pvc-volume-tester-zv2mw started at 2022-12-02 23:41:10 +0000 UTC (0+1 container statuses recorded) Dec 2 23:41:13.356: INFO: Container volume-tester ready: true, restart count 0 Dec 2 23:41:13.356: INFO: netserver-3 started at 2022-12-02 23:38:46 +0000 UTC (0+1 container statuses recorded) Dec 2 23:41:13.356: INFO: Container webserver ready: true, restart count 0 Dec 2 23:41:13.356: INFO: csi-mockplugin-0 started at 2022-12-02 23:40:52 +0000 UTC (0+3 container statuses recorded) Dec 2 23:41:13.356: INFO: Container csi-provisioner ready: true, restart count 0 Dec 2 23:41:13.356: INFO: Container driver-registrar ready: true, restart count 0 Dec 2 23:41:13.356: INFO: Container mock ready: true, restart count 0 Dec 2 23:41:13.777: INFO: Latency metrics for node ip-172-20-48-5.us-west-2.compute.internal Dec 2 23:41:13.777: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "disruption-4373" for this suite.
Filter through log files
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-apps\]\sReplicationController\sshould\stest\sthe\slifecycle\sof\sa\sReplicationController\s\[Conformance\]$'
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630 Dec 2 23:38:21.836: Wait for condition with watch events should not return an error Unexpected error: <*errors.errorString | 0xc000240290>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/rc.go:186from junit_24.xml
{"msg":"PASSED [sig-node] Probing container should *not* be restarted with a non-local redirect http liveness probe","total":-1,"completed":24,"skipped":132,"failed":0} [BeforeEach] [sig-apps] ReplicationController /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Dec 2 23:33:21.374: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename replication-controller �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-apps] ReplicationController /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/rc.go:54 [It] should test the lifecycle of a ReplicationController [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630 �[1mSTEP�[0m: creating a ReplicationController �[1mSTEP�[0m: waiting for RC to be added �[1mSTEP�[0m: waiting for available Replicas Dec 2 23:38:21.836: FAIL: Wait for condition with watch events should not return an error Unexpected error: <*errors.errorString | 0xc000240290>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/apps.glob..func7.7.1(0xc004fd0240, 0xc0033c7040, 0x1, 0x1) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/rc.go:186 +0x5ee k8s.io/kubernetes/test/e2e/framework.WatchEventSequenceVerifier(0x78e0d48, 0xc000124018, 0x786a7e0, 0xc0031d2108, 0x0, 0x0, 0x7029b26, 0x2, 0x7076f9c, 0x16, ...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:1377 +0x662 k8s.io/kubernetes/test/e2e/apps.glob..func7.7() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/rc.go:145 +0x7c5 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc000d1f380) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x36c k8s.io/kubernetes/test/e2e.TestE2E(0xc000d1f380) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:136 +0x2b testing.tRunner(0xc000d1f380, 0x729c8b8) /usr/local/go/src/testing/testing.go:1203 +0xe5 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1248 +0x2b3 [AfterEach] [sig-apps] ReplicationController /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "replication-controller-9702". �[1mSTEP�[0m: Found 12 events. Dec 2 23:38:21.902: INFO: At 2022-12-02 23:33:21 +0000 UTC - event for rc-test: {replication-controller } SuccessfulCreate: Created pod: rc-test-4h8d6 Dec 2 23:38:21.902: INFO: At 2022-12-02 23:33:21 +0000 UTC - event for rc-test-4h8d6: {default-scheduler } Scheduled: Successfully assigned replication-controller-9702/rc-test-4h8d6 to ip-172-20-41-32.us-west-2.compute.internal Dec 2 23:38:21.902: INFO: At 2022-12-02 23:33:22 +0000 UTC - event for rc-test-4h8d6: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "6768cb088f29c5179f9b7a80958f36464cee6ab3a02891213a72e6a6595925e2": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:21.902: INFO: At 2022-12-02 23:33:33 +0000 UTC - event for rc-test-4h8d6: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b3bf7ac0735945d2774b733de478ce98305458f45cbd02aafd8952023ddf9a02": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:21.902: INFO: At 2022-12-02 23:33:46 +0000 UTC - event for rc-test-4h8d6: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "46b074a321a163c45f22a19d1051fe2b660c95e8132f8dc87fc7a0225f072f5c": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:21.902: INFO: At 2022-12-02 23:34:01 +0000 UTC - event for rc-test-4h8d6: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "53a2d55fd10b8a04d0272b2cefbf06e2658997f2a569fb0baf1bb158e4ceb06d": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:21.902: INFO: At 2022-12-02 23:34:16 +0000 UTC - event for rc-test-4h8d6: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b2d889c2ee7f26a3f8496a8931a769e91facf55bb1b86828be8113cff6c6be07": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:21.902: INFO: At 2022-12-02 23:34:29 +0000 UTC - event for rc-test-4h8d6: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "8a990304c916446dcf49edca07a76d80f1d535cddb859bafda0bbc0200d24cf4": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:21.902: INFO: At 2022-12-02 23:34:43 +0000 UTC - event for rc-test-4h8d6: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ec2ba83ebd48ef1d71d2c56ad7c9d2d54008d28deee8ed9c5b990b8908e2fdfa": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:21.902: INFO: At 2022-12-02 23:34:58 +0000 UTC - event for rc-test-4h8d6: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "75082dc94af8c82c0a79c9a357105303d49bbf6d2f9fb0935d3dd66af1b444d9": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:21.902: INFO: At 2022-12-02 23:35:12 +0000 UTC - event for rc-test-4h8d6: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "0ce50167832bf442f8f3b8a5de8f0c4854560e8a83e87526a2b0c471472e2c54": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:21.902: INFO: At 2022-12-02 23:35:24 +0000 UTC - event for rc-test-4h8d6: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d12c4899faea3a627fded2d1014e177097d43f23a953f957a3fe648bbb6a4247": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:21.968: INFO: POD NODE PHASE GRACE CONDITIONS Dec 2 23:38:21.968: INFO: rc-test-4h8d6 ip-172-20-41-32.us-west-2.compute.internal Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:33:21 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:33:21 +0000 UTC ContainersNotReady containers with unready status: [rc-test]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:33:21 +0000 UTC ContainersNotReady containers with unready status: [rc-test]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:33:21 +0000 UTC }] Dec 2 23:38:21.968: INFO: Dec 2 23:38:22.035: INFO: Logging node info for node ip-172-20-33-254.us-west-2.compute.internal Dec 2 23:38:22.101: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-33-254.us-west-2.compute.internal 6236393f-0a33-4aea-a2e2-fedaf7becdd4 29305 0 2022-12-02 23:17:15 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-33-254.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:ip-172-20-33-254.us-west-2.compute.internal topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0d507bb204448139f"} io.cilium.network.ipv4-cilium-host:172.20.42.35 io.cilium.network.ipv4-health-ip:172.20.58.176 io.cilium.network.ipv4-pod-cidr:100.96.1.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2022-12-02 23:17:15 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2022-12-02 23:17:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-12-02 23:17:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {cilium-agent Update v1 2022-12-02 23:17:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-12-02 23:17:41 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {e2e.test Update v1 2022-12-02 23:29:34 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2022-12-02 23:30:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-0d507bb204448139f,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-02 23:17:41 +0000 UTC,LastTransitionTime:2022-12-02 23:17:41 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-02 23:35:16 +0000 UTC,LastTransitionTime:2022-12-02 23:17:15 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-02 23:35:16 +0000 UTC,LastTransitionTime:2022-12-02 23:17:15 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-02 23:35:16 +0000 UTC,LastTransitionTime:2022-12-02 23:17:15 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-02 23:35:16 +0000 UTC,LastTransitionTime:2022-12-02 23:17:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.33.254,},NodeAddress{Type:ExternalIP,Address:54.190.128.11,},NodeAddress{Type:Hostname,Address:ip-172-20-33-254.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-33-254.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-190-128-11.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23ec8dd062be253828b6092e22eaab,SystemUUID:ec23ec8d-d062-be25-3828-b6092e22eaab,BootID:6bbf84c7-41f9-4141-912e-7f3bc9a0ef42,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.13,KubeletVersion:v1.22.16,KubeProxyVersion:v1.22.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:160382894,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.22.16],SizeBytes:105446599,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:1f36a24cfb5e0c3f725d7565a867c2384282fcbeccc77b07b423c9da95763a9a k8s.gcr.io/e2e-test-images/nautilus:1.4],SizeBytes:49230179,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:716d2f68314c5c4ddd5ecdb45183fcb4ed8019015982c1321571f863989b70b0 k8s.gcr.io/e2e-test-images/httpd:2.4.39-1],SizeBytes:41902332,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:b913fa234cc3473cfe16e937d106b455a7609f927f59031c81aca791e2689b50 k8s.gcr.io/e2e-test-images/httpd:2.4.38-1],SizeBytes:40765006,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:28956694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonroot@sha256:4051e85640c22f8e00c34dbd273576fc9e1e2829992656588062be9c0f69b04b k8s.gcr.io/e2e-test-images/nonroot:1.1],SizeBytes:17748448,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:aa60f453d64dfb3c3fd9e7306f988c36c6352c4f2d956aa90467f2808091effa registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.5],SizeBytes:15209420,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:1b7c978a792a8fa4e96244e8059bd71bb49b07e2e5a897fb0c867bdc6db20d5d k8s.gcr.io/sig-storage/livenessprobe:v2.3.0],SizeBytes:7933739,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:503b7abb89e57383eba61cc8a9cb0b495ea575c516108f7d972a6ff6e1ab3c9b k8s.gcr.io/e2e-test-images/nginx:1.14-1],SizeBytes:6979365,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:1ff6c18fbef2045af6b9c16bf034cc421a29027b800e4f9b68ae9b1cb3e9ae07 k8s.gcr.io/pause:3.5],SizeBytes:301416,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 2 23:38:22.101: INFO: Logging kubelet events for node ip-172-20-33-254.us-west-2.compute.internal Dec 2 23:38:22.169: INFO: Logging pods the kubelet thinks is on node ip-172-20-33-254.us-west-2.compute.internal Dec 2 23:38:22.245: INFO: coredns-5fcc7b6498-8nvj5 started at 2022-12-02 23:17:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:22.245: INFO: Container coredns ready: true, restart count 0 Dec 2 23:38:22.245: INFO: hostexec-ip-172-20-33-254.us-west-2.compute.internal-w7cc4 started at 2022-12-02 23:29:31 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:22.245: INFO: Container agnhost-container ready: true, restart count 0 Dec 2 23:38:22.245: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-d4f7q started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:22.245: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:22.245: INFO: netserver-0 started at 2022-12-02 23:35:10 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:22.245: INFO: Container webserver ready: false, restart count 0 Dec 2 23:38:22.245: INFO: coredns-autoscaler-6658b4bf85-4zgd2 started at 2022-12-02 23:17:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:22.245: INFO: Container autoscaler ready: true, restart count 0 Dec 2 23:38:22.245: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-9dq9t started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:22.245: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: false, restart count 0 Dec 2 23:38:22.245: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-t5msn started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:22.245: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:22.245: INFO: pod-6287b838-7e39-4bff-9b2c-7278de9a6392 started at 2022-12-02 23:33:40 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:22.245: INFO: Container write-pod ready: false, restart count 0 Dec 2 23:38:22.245: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-mtms5 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:22.245: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:22.245: INFO: netserver-0 started at 2022-12-02 23:29:40 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:22.245: INFO: Container webserver ready: true, restart count 0 Dec 2 23:38:22.245: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-svqb9 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:22.245: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:22.245: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-pt8v2 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:22.245: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:22.245: INFO: netserver-0 started at 2022-12-02 23:33:50 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:22.245: INFO: Container webserver ready: false, restart count 0 Dec 2 23:38:22.245: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-cf58b started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:22.245: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:22.245: INFO: ebs-csi-node-rfgvb started at 2022-12-02 23:17:16 +0000 UTC (0+3 container statuses recorded) Dec 2 23:38:22.245: INFO: Container ebs-plugin ready: true, restart count 0 Dec 2 23:38:22.245: INFO: Container liveness-probe ready: true, restart count 0 Dec 2 23:38:22.245: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 2 23:38:22.245: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-gfh2n started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:22.245: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:22.245: INFO: hostpath-symlink-prep-provisioning-387 started at 2022-12-02 23:36:51 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:22.245: INFO: Container init-volume-provisioning-387 ready: false, restart count 0 Dec 2 23:38:22.245: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-f2d26 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:22.245: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:22.245: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-jnmvg started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:22.245: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:22.245: INFO: cilium-2db9c started at 2022-12-02 23:17:16 +0000 UTC (1+1 container statuses recorded) Dec 2 23:38:22.245: INFO: Init container clean-cilium-state ready: true, restart count 0 Dec 2 23:38:22.245: INFO: Container cilium-agent ready: true, restart count 0 Dec 2 23:38:22.534: INFO: Latency metrics for node ip-172-20-33-254.us-west-2.compute.internal Dec 2 23:38:22.535: INFO: Logging node info for node ip-172-20-40-67.us-west-2.compute.internal Dec 2 23:38:22.600: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-40-67.us-west-2.compute.internal 0a5fe428-9a11-4bd2-96f1-21d4d188f80f 28496 0 2022-12-02 23:15:37 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-40-67.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/control-plane: node-role.kubernetes.io/master: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:us-west-2a topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0725cfbb3e93e664c"} io.cilium.network.ipv4-cilium-host:172.20.59.109 io.cilium.network.ipv4-health-ip:172.20.51.231 io.cilium.network.ipv4-pod-cidr:100.96.0.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-12-02 23:15:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {protokube Update v1 2022-12-02 23:16:01 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kops-controller Update v1 2022-12-02 23:16:07 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/master":{}}}} } {kube-controller-manager Update v1 2022-12-02 23:16:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {cilium-agent Update v1 2022-12-02 23:17:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-12-02 23:17:36 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-12-02 23:17:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-0725cfbb3e93e664c,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892301824 0} {<nil>} 3801076Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787444224 0} {<nil>} 3698676Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-02 23:17:36 +0000 UTC,LastTransitionTime:2022-12-02 23:17:36 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-02 23:33:27 +0000 UTC,LastTransitionTime:2022-12-02 23:15:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-02 23:33:27 +0000 UTC,LastTransitionTime:2022-12-02 23:15:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-02 23:33:27 +0000 UTC,LastTransitionTime:2022-12-02 23:15:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-02 23:33:27 +0000 UTC,LastTransitionTime:2022-12-02 23:16:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.40.67,},NodeAddress{Type:ExternalIP,Address:34.213.81.56,},NodeAddress{Type:Hostname,Address:ip-172-20-40-67.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-40-67.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-34-213-81-56.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2bdc536f1fb98cbe397162835bf7b5,SystemUUID:ec2bdc53-6f1f-b98c-be39-7162835bf7b5,BootID:80f23ad2-0f99-46af-8080-253547cd7440,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.13,KubeletVersion:v1.22.16,KubeProxyVersion:v1.22.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:a91fdaf9b988943a9c73d422348c2383c08dfc2566d4124a39a1b3d785018720 registry.k8s.io/etcdadm/etcd-manager:v3.0.20220831],SizeBytes:216515768,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:160382894,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.22.16],SizeBytes:129618394,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.22.16],SizeBytes:123306305,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.22.16],SizeBytes:105446599,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.22.16],SizeBytes:53956920,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-alpha.2],SizeBytes:42210956,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-alpha.2],SizeBytes:41463728,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:28956694,},ContainerImage{Names:[quay.io/cilium/operator@sha256:e2b26376a904190c73498e04bd5c1298a4c5239d50feab024074e4516381890f quay.io/cilium/operator:v1.11.11],SizeBytes:24003684,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-alpha.2],SizeBytes:4954596,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 2 23:38:22.600: INFO: Logging kubelet events for node ip-172-20-40-67.us-west-2.compute.internal Dec 2 23:38:22.672: INFO: Logging pods the kubelet thinks is on node ip-172-20-40-67.us-west-2.compute.internal Dec 2 23:38:22.743: INFO: ebs-csi-node-jt6f2 started at 2022-12-02 23:16:04 +0000 UTC (0+3 container statuses recorded) Dec 2 23:38:22.743: INFO: Container ebs-plugin ready: true, restart count 0 Dec 2 23:38:22.743: INFO: Container liveness-probe ready: true, restart count 0 Dec 2 23:38:22.743: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 2 23:38:22.743: INFO: cilium-t57cd started at 2022-12-02 23:16:04 +0000 UTC (1+1 container statuses recorded) Dec 2 23:38:22.743: INFO: Init container clean-cilium-state ready: true, restart count 0 Dec 2 23:38:22.743: INFO: Container cilium-agent ready: true, restart count 1 Dec 2 23:38:22.743: INFO: kops-controller-47skn started at 2022-12-02 23:16:04 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:22.743: INFO: Container kops-controller ready: true, restart count 0 Dec 2 23:38:22.743: INFO: dns-controller-5fb778d9d5-fln22 started at 2022-12-02 23:16:04 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:22.743: INFO: Container dns-controller ready: true, restart count 0 Dec 2 23:38:22.743: INFO: etcd-manager-main-ip-172-20-40-67.us-west-2.compute.internal started at 2022-12-02 23:14:53 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:22.743: INFO: Container etcd-manager ready: true, restart count 0 Dec 2 23:38:22.743: INFO: kube-controller-manager-ip-172-20-40-67.us-west-2.compute.internal started at 2022-12-02 23:14:53 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:22.743: INFO: Container kube-controller-manager ready: true, restart count 2 Dec 2 23:38:22.743: INFO: kube-scheduler-ip-172-20-40-67.us-west-2.compute.internal started at 2022-12-02 23:14:53 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:22.743: INFO: Container kube-scheduler ready: true, restart count 0 Dec 2 23:38:22.743: INFO: etcd-manager-events-ip-172-20-40-67.us-west-2.compute.internal started at 2022-12-02 23:14:53 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:22.743: INFO: Container etcd-manager ready: true, restart count 0 Dec 2 23:38:22.743: INFO: kube-apiserver-ip-172-20-40-67.us-west-2.compute.internal started at 2022-12-02 23:14:53 +0000 UTC (0+2 container statuses recorded) Dec 2 23:38:22.743: INFO: Container healthcheck ready: true, restart count 0 Dec 2 23:38:22.743: INFO: Container kube-apiserver ready: true, restart count 1 Dec 2 23:38:22.743: INFO: cilium-operator-587dd66f87-zmwpl started at 2022-12-02 23:16:04 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:22.743: INFO: Container cilium-operator ready: true, restart count 1 Dec 2 23:38:22.743: INFO: ebs-csi-controller-764b64d679-rnjp4 started at 2022-12-02 23:16:04 +0000 UTC (0+5 container statuses recorded) Dec 2 23:38:22.743: INFO: Container csi-attacher ready: true, restart count 0 Dec 2 23:38:22.743: INFO: Container csi-provisioner ready: true, restart count 0 Dec 2 23:38:22.743: INFO: Container csi-resizer ready: true, restart count 0 Dec 2 23:38:22.743: INFO: Container ebs-plugin ready: true, restart count 0 Dec 2 23:38:22.743: INFO: Container liveness-probe ready: true, restart count 0 Dec 2 23:38:22.997: INFO: Latency metrics for node ip-172-20-40-67.us-west-2.compute.internal Dec 2 23:38:22.997: INFO: Logging node info for node ip-172-20-41-32.us-west-2.compute.internal Dec 2 23:38:23.063: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-41-32.us-west-2.compute.internal ad6a9fcc-418f-4c1a-a9c7-ac1873b8a1ba 29702 0 2022-12-02 23:17:23 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-41-32.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:node mounted_volume_expand:mounted-volume-expand-6871 node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:ip-172-20-41-32.us-west-2.compute.internal topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-00d261efdd8c07a99"} io.cilium.network.ipv4-cilium-host:172.20.50.121 io.cilium.network.ipv4-health-ip:172.20.47.106 io.cilium.network.ipv4-pod-cidr:100.96.3.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2022-12-02 23:17:23 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-12-02 23:17:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2022-12-02 23:17:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {cilium-agent Update v1 2022-12-02 23:17:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-12-02 23:17:51 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {e2e.test Update v1 2022-12-02 23:29:34 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{},"f:mounted_volume_expand":{}}}} } {kubelet Update v1 2022-12-02 23:30:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2022-12-02 23:30:44 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-00d261efdd8c07a99,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-02 23:17:51 +0000 UTC,LastTransitionTime:2022-12-02 23:17:51 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-02 23:36:14 +0000 UTC,LastTransitionTime:2022-12-02 23:17:23 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-02 23:36:14 +0000 UTC,LastTransitionTime:2022-12-02 23:17:23 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-02 23:36:14 +0000 UTC,LastTransitionTime:2022-12-02 23:17:23 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-02 23:36:14 +0000 UTC,LastTransitionTime:2022-12-02 23:17:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.41.32,},NodeAddress{Type:ExternalIP,Address:35.88.26.86,},NodeAddress{Type:Hostname,Address:ip-172-20-41-32.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-41-32.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-88-26-86.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2624f500a45f29b52ed8b5d778f035,SystemUUID:ec2624f5-00a4-5f29-b52e-d8b5d778f035,BootID:b76bd51c-e57a-47b9-86f2-c1093a033e09,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.13,KubeletVersion:v1.22.16,KubeProxyVersion:v1.22.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:160382894,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:702a992280fb7c3303e84a5801acbb4c9c7fcf48cffe0e9c8be3f0c60f74cf89 k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.4],SizeBytes:112029652,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.22.16],SizeBytes:105446599,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:716d2f68314c5c4ddd5ecdb45183fcb4ed8019015982c1321571f863989b70b0 k8s.gcr.io/e2e-test-images/httpd:2.4.39-1],SizeBytes:41902332,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:b913fa234cc3473cfe16e937d106b455a7609f927f59031c81aca791e2689b50 k8s.gcr.io/e2e-test-images/httpd:2.4.38-1],SizeBytes:40765006,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:28956694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:1b7c978a792a8fa4e96244e8059bd71bb49b07e2e5a897fb0c867bdc6db20d5d k8s.gcr.io/sig-storage/livenessprobe:v2.3.0],SizeBytes:7933739,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:503b7abb89e57383eba61cc8a9cb0b495ea575c516108f7d972a6ff6e1ab3c9b k8s.gcr.io/e2e-test-images/nginx:1.14-1],SizeBytes:6979365,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac k8s.gcr.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:1ff6c18fbef2045af6b9c16bf034cc421a29027b800e4f9b68ae9b1cb3e9ae07 k8s.gcr.io/pause:3.5],SizeBytes:301416,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-00e603f65a9c9071b kubernetes.io/csi/ebs.csi.aws.com^vol-01091924f688a5969],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-01091924f688a5969,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-00e603f65a9c9071b,DevicePath:,},},Config:nil,},} Dec 2 23:38:23.064: INFO: Logging kubelet events for node ip-172-20-41-32.us-west-2.compute.internal Dec 2 23:38:23.131: INFO: Logging pods the kubelet thinks is on node ip-172-20-41-32.us-west-2.compute.internal Dec 2 23:38:23.204: INFO: host-test-container-pod started at 2022-12-02 23:34:12 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:23.204: INFO: Container agnhost-container ready: true, restart count 0 Dec 2 23:38:23.204: INFO: pod-subpath-test-inlinevolume-84wk started at 2022-12-02 23:35:11 +0000 UTC (2+1 container statuses recorded) Dec 2 23:38:23.205: INFO: Init container init-volume-inlinevolume-84wk ready: false, restart count 0 Dec 2 23:38:23.205: INFO: Init container test-init-volume-inlinevolume-84wk ready: false, restart count 0 Dec 2 23:38:23.205: INFO: Container test-container-subpath-inlinevolume-84wk ready: false, restart count 0 Dec 2 23:38:23.205: INFO: externalname-service-6rb48 started at 2022-12-02 23:35:40 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:23.205: INFO: Container externalname-service ready: false, restart count 0 Dec 2 23:38:23.205: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-rq5lg started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:23.205: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:23.205: INFO: netserver-1 started at 2022-12-02 23:33:50 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:23.205: INFO: Container webserver ready: false, restart count 0 Dec 2 23:38:23.205: INFO: successful-jobs-history-limit-27833735-zz4t9 started at 2022-12-02 23:35:00 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:23.205: INFO: Container c ready: false, restart count 0 Dec 2 23:38:23.205: INFO: successful-jobs-history-limit-27833738-bm4dh started at 2022-12-02 23:38:00 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:23.205: INFO: Container c ready: false, restart count 0 Dec 2 23:38:23.205: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-79x59 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:23.205: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:23.205: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-42p62 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:23.205: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:23.205: INFO: pod-55255ec9-bf45-4208-865d-6ef51afe9599 started at 2022-12-02 23:30:30 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:23.205: INFO: Container write-pod ready: false, restart count 0 Dec 2 23:38:23.205: INFO: pod-1 started at 2022-12-02 23:31:10 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:23.205: INFO: Container donothing ready: false, restart count 0 Dec 2 23:38:23.205: INFO: ss-0 started at 2022-12-02 23:36:09 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:23.205: INFO: Container webserver ready: false, restart count 0 Dec 2 23:38:23.205: INFO: test-rolling-update-controller-5s7b9 started at 2022-12-02 23:36:29 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:23.205: INFO: Container httpd ready: false, restart count 0 Dec 2 23:38:23.205: INFO: rc-test-4h8d6 started at 2022-12-02 23:33:21 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:23.205: INFO: Container rc-test ready: false, restart count 0 Dec 2 23:38:23.205: INFO: cilium-m9r5q started at 2022-12-02 23:17:24 +0000 UTC (1+1 container statuses recorded) Dec 2 23:38:23.205: INFO: Init container clean-cilium-state ready: true, restart count 0 Dec 2 23:38:23.205: INFO: Container cilium-agent ready: true, restart count 0 Dec 2 23:38:23.205: INFO: test-rollover-controller-wxkjb started at 2022-12-02 23:35:19 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:23.205: INFO: Container httpd ready: true, restart count 0 Dec 2 23:38:23.205: INFO: successful-jobs-history-limit-27833734-6hlrt started at 2022-12-02 23:34:00 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:23.205: INFO: Container c ready: false, restart count 0 Dec 2 23:38:23.205: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-qgcxv started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:23.205: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:23.205: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-44b5z started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:23.205: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:23.205: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-wf5z9 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:23.205: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:23.205: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-gjgbh started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:23.205: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:23.205: INFO: netserver-1 started at 2022-12-02 23:29:40 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:23.205: INFO: Container webserver ready: true, restart count 0 Dec 2 23:38:23.205: INFO: ebs-csi-node-c27hl started at 2022-12-02 23:17:24 +0000 UTC (0+3 container statuses recorded) Dec 2 23:38:23.205: INFO: Container ebs-plugin ready: true, restart count 0 Dec 2 23:38:23.205: INFO: Container liveness-probe ready: true, restart count 0 Dec 2 23:38:23.205: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 2 23:38:23.205: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-dlbpk started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:23.205: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:23.205: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-kxvnd started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:23.205: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:23.205: INFO: test-container-pod started at 2022-12-02 23:34:12 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:23.205: INFO: Container webserver ready: false, restart count 0 Dec 2 23:38:23.205: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-dm2vc started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:23.205: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:23.205: INFO: successful-jobs-history-limit-27833736-64b8r started at 2022-12-02 23:36:00 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:23.205: INFO: Container c ready: false, restart count 0 Dec 2 23:38:23.205: INFO: netserver-1 started at 2022-12-02 23:35:10 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:23.205: INFO: Container webserver ready: false, restart count 0 Dec 2 23:38:23.205: INFO: csi-mockplugin-0 started at 2022-12-02 23:36:30 +0000 UTC (0+4 container statuses recorded) Dec 2 23:38:23.205: INFO: Container busybox ready: false, restart count 0 Dec 2 23:38:23.205: INFO: Container csi-provisioner ready: false, restart count 0 Dec 2 23:38:23.205: INFO: Container driver-registrar ready: false, restart count 0 Dec 2 23:38:23.205: INFO: Container mock ready: false, restart count 0 Dec 2 23:38:23.205: INFO: successful-jobs-history-limit-27833737-7g5g4 started at 2022-12-02 23:37:00 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:23.205: INFO: Container c ready: false, restart count 0 Dec 2 23:38:23.205: INFO: ss2-0 started at 2022-12-02 23:33:41 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:23.205: INFO: Container webserver ready: false, restart count 0 Dec 2 23:38:23.495: INFO: Latency metrics for node ip-172-20-41-32.us-west-2.compute.internal Dec 2 23:38:23.495: INFO: Logging node info for node ip-172-20-43-150.us-west-2.compute.internal Dec 2 23:38:23.561: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-43-150.us-west-2.compute.internal 47bb1581-dcdc-4edf-b2c4-109aedb2f5bd 30224 0 2022-12-02 23:17:23 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-43-150.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:ip-172-20-43-150.us-west-2.compute.internal topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0e2e5350f5754b178"} io.cilium.network.ipv4-cilium-host:172.20.35.108 io.cilium.network.ipv4-health-ip:172.20.34.31 io.cilium.network.ipv4-pod-cidr:100.96.4.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2022-12-02 23:17:23 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-12-02 23:17:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2022-12-02 23:17:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {cilium-agent Update v1 2022-12-02 23:17:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-12-02 23:17:51 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {e2e.test Update v1 2022-12-02 23:29:34 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2022-12-02 23:37:23 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2022-12-02 23:37:24 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-0e2e5350f5754b178,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-02 23:17:51 +0000 UTC,LastTransitionTime:2022-12-02 23:17:51 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-02 23:37:24 +0000 UTC,LastTransitionTime:2022-12-02 23:17:23 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-02 23:37:24 +0000 UTC,LastTransitionTime:2022-12-02 23:17:23 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-02 23:37:24 +0000 UTC,LastTransitionTime:2022-12-02 23:17:23 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-02 23:37:24 +0000 UTC,LastTransitionTime:2022-12-02 23:17:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.43.150,},NodeAddress{Type:ExternalIP,Address:54.184.249.63,},NodeAddress{Type:Hostname,Address:ip-172-20-43-150.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-43-150.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-184-249-63.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23a85d6d7b80ff12e03e51b1effc11,SystemUUID:ec23a85d-6d7b-80ff-12e0-3e51b1effc11,BootID:72904f56-1058-4b24-85d2-c465d1149ad1,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.13,KubeletVersion:v1.22.16,KubeProxyVersion:v1.22.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:160382894,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:702a992280fb7c3303e84a5801acbb4c9c7fcf48cffe0e9c8be3f0c60f74cf89 k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.4],SizeBytes:112029652,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.22.16],SizeBytes:105446599,},ContainerImage{Names:[docker.io/library/nginx@sha256:e209ac2f37c70c1e0e9873a5f7231e91dcd83fdf1178d8ed36c2ec09974210ba docker.io/library/nginx:latest],SizeBytes:56833911,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:1f36a24cfb5e0c3f725d7565a867c2384282fcbeccc77b07b423c9da95763a9a k8s.gcr.io/e2e-test-images/nautilus:1.4],SizeBytes:49230179,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:716d2f68314c5c4ddd5ecdb45183fcb4ed8019015982c1321571f863989b70b0 k8s.gcr.io/e2e-test-images/httpd:2.4.39-1],SizeBytes:41902332,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:b913fa234cc3473cfe16e937d106b455a7609f927f59031c81aca791e2689b50 k8s.gcr.io/e2e-test-images/httpd:2.4.38-1],SizeBytes:40765006,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:28956694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a k8s.gcr.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf k8s.gcr.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:1b7c978a792a8fa4e96244e8059bd71bb49b07e2e5a897fb0c867bdc6db20d5d k8s.gcr.io/sig-storage/livenessprobe:v2.3.0],SizeBytes:7933739,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:503b7abb89e57383eba61cc8a9cb0b495ea575c516108f7d972a6ff6e1ab3c9b k8s.gcr.io/e2e-test-images/nginx:1.14-1],SizeBytes:6979365,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac k8s.gcr.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:1ff6c18fbef2045af6b9c16bf034cc421a29027b800e4f9b68ae9b1cb3e9ae07 k8s.gcr.io/pause:3.5],SizeBytes:301416,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0e3ce9fcd443ccc35],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0e3ce9fcd443ccc35,DevicePath:,},},Config:nil,},} Dec 2 23:38:23.561: INFO: Logging kubelet events for node ip-172-20-43-150.us-west-2.compute.internal Dec 2 23:38:23.629: INFO: Logging pods the kubelet thinks is on node ip-172-20-43-150.us-west-2.compute.internal Dec 2 23:38:23.700: INFO: terminate-cmd-rpae9785fa3-cce9-4bd1-8b4e-6f58c41e65dd started at 2022-12-02 23:37:40 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:23.701: INFO: Container terminate-cmd-rpa ready: false, restart count 0 Dec 2 23:38:23.701: INFO: ebs-csi-node-8qrwx started at 2022-12-02 23:17:24 +0000 UTC (0+3 container statuses recorded) Dec 2 23:38:23.701: INFO: Container ebs-plugin ready: true, restart count 0 Dec 2 23:38:23.701: INFO: Container liveness-probe ready: true, restart count 0 Dec 2 23:38:23.701: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 2 23:38:23.701: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-8bg6n started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:23.701: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:23.701: INFO: pod-b416a818-b13e-44c7-a3c6-14e94e8ce1c4 started at 2022-12-02 23:35:04 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:23.701: INFO: Container write-pod ready: false, restart count 0 Dec 2 23:38:23.701: INFO: netserver-2 started at 2022-12-02 23:29:40 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:23.701: INFO: Container webserver ready: true, restart count 0 Dec 2 23:38:23.701: INFO: configmap-client started at 2022-12-02 23:34:58 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:23.701: INFO: Container configmap-client ready: false, restart count 0 Dec 2 23:38:23.701: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-qnr57 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:23.701: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:23.701: INFO: test-rollover-deployment-67bbb7bc8-sdxv6 started at 2022-12-02 23:36:16 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:23.701: INFO: Container agnhost ready: false, restart count 0 Dec 2 23:38:23.701: INFO: netserver-2 started at 2022-12-02 23:33:50 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:23.701: INFO: Container webserver ready: false, restart count 0 Dec 2 23:38:23.701: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-s5867 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:23.701: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:23.701: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-kj74m started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:23.701: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:23.701: INFO: hostexec-ip-172-20-43-150.us-west-2.compute.internal-4sp8t started at 2022-12-02 23:34:34 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:23.701: INFO: Container agnhost-container ready: true, restart count 0 Dec 2 23:38:23.701: INFO: pvc-tester-jjnqm started at 2022-12-02 23:37:21 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:23.701: INFO: Container write-pod ready: false, restart count 0 Dec 2 23:38:23.701: INFO: pod-0 started at 2022-12-02 23:31:10 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:23.701: INFO: Container donothing ready: false, restart count 0 Dec 2 23:38:23.701: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-ksvcz started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:23.701: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:23.701: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-pm84g started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:23.701: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:23.701: INFO: hostexec-ip-172-20-43-150.us-west-2.compute.internal-pzwm8 started at 2022-12-02 23:34:47 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:23.701: INFO: Container agnhost-container ready: true, restart count 0 Dec 2 23:38:23.701: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-wqgdj started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:23.701: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:23.701: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-z5d7v started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:23.701: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:23.701: INFO: pod-subpath-test-preprovisionedpv-8zrh started at 2022-12-02 23:34:49 +0000 UTC (1+1 container statuses recorded) Dec 2 23:38:23.701: INFO: Init container init-volume-preprovisionedpv-8zrh ready: false, restart count 0 Dec 2 23:38:23.701: INFO: Container test-container-subpath-preprovisionedpv-8zrh ready: false, restart count 0 Dec 2 23:38:23.701: INFO: netserver-2 started at 2022-12-02 23:35:10 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:23.701: INFO: Container webserver ready: false, restart count 0 Dec 2 23:38:23.701: INFO: pod-abb1ddf3-cdd4-4291-a144-3f08787c89a0 started at 2022-12-02 23:35:57 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:23.701: INFO: Container test-container ready: false, restart count 0 Dec 2 23:38:23.701: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-g66v4 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:23.701: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:23.701: INFO: cilium-7h427 started at 2022-12-02 23:17:24 +0000 UTC (1+1 container statuses recorded) Dec 2 23:38:23.701: INFO: Init container clean-cilium-state ready: true, restart count 0 Dec 2 23:38:23.701: INFO: Container cilium-agent ready: true, restart count 0 Dec 2 23:38:23.701: INFO: externalname-service-vqt5p started at 2022-12-02 23:35:40 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:23.701: INFO: Container externalname-service ready: false, restart count 0 Dec 2 23:38:23.701: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-5jb9p started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:23.701: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:23.701: INFO: pod-2 started at 2022-12-02 23:31:10 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:23.701: INFO: Container donothing ready: true, restart count 0 Dec 2 23:38:24.006: INFO: Latency metrics for node ip-172-20-43-150.us-west-2.compute.internal Dec 2 23:38:24.006: INFO: Logging node info for node ip-172-20-48-5.us-west-2.compute.internal Dec 2 23:38:24.072: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-48-5.us-west-2.compute.internal 6342e9b6-e818-4fbf-aae7-8be176fd4ec1 30001 0 2022-12-02 23:17:21 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a io.kubernetes.storage.mock/node:some-mock-node kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-48-5.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:ip-172-20-48-5.us-west-2.compute.internal topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-9034":"csi-mock-csi-mock-volumes-9034","ebs.csi.aws.com":"i-0093900b92d415e84"} io.cilium.network.ipv4-cilium-host:172.20.42.98 io.cilium.network.ipv4-health-ip:172.20.44.82 io.cilium.network.ipv4-pod-cidr:100.96.2.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-12-02 23:17:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2022-12-02 23:17:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2022-12-02 23:17:22 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {cilium-agent Update v1 2022-12-02 23:17:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-12-02 23:17:52 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {e2e.test Update v1 2022-12-02 23:29:34 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2022-12-02 23:36:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-0093900b92d415e84,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-02 23:17:52 +0000 UTC,LastTransitionTime:2022-12-02 23:17:52 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-02 23:36:03 +0000 UTC,LastTransitionTime:2022-12-02 23:17:21 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-02 23:36:03 +0000 UTC,LastTransitionTime:2022-12-02 23:17:21 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-02 23:36:03 +0000 UTC,LastTransitionTime:2022-12-02 23:17:21 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-02 23:36:03 +0000 UTC,LastTransitionTime:2022-12-02 23:17:42 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.48.5,},NodeAddress{Type:ExternalIP,Address:34.213.188.181,},NodeAddress{Type:Hostname,Address:ip-172-20-48-5.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-48-5.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-34-213-188-181.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2ecd9e359fbd979ba14c48724d474b,SystemUUID:ec2ecd9e-359f-bd97-9ba1-4c48724d474b,BootID:3d1b1479-a710-49bb-96b3-2764890e8166,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.13,KubeletVersion:v1.22.16,KubeProxyVersion:v1.22.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:160382894,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.22.16],SizeBytes:105446599,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:716d2f68314c5c4ddd5ecdb45183fcb4ed8019015982c1321571f863989b70b0 k8s.gcr.io/e2e-test-images/httpd:2.4.39-1],SizeBytes:41902332,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:b913fa234cc3473cfe16e937d106b455a7609f927f59031c81aca791e2689b50 k8s.gcr.io/e2e-test-images/httpd:2.4.38-1],SizeBytes:40765006,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:28956694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a k8s.gcr.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:1b7c978a792a8fa4e96244e8059bd71bb49b07e2e5a897fb0c867bdc6db20d5d k8s.gcr.io/sig-storage/livenessprobe:v2.3.0],SizeBytes:7933739,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:503b7abb89e57383eba61cc8a9cb0b495ea575c516108f7d972a6ff6e1ab3c9b k8s.gcr.io/e2e-test-images/nginx:1.14-1],SizeBytes:6979365,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:1ff6c18fbef2045af6b9c16bf034cc421a29027b800e4f9b68ae9b1cb3e9ae07 k8s.gcr.io/pause:3.5],SizeBytes:301416,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 2 23:38:24.072: INFO: Logging kubelet events for node ip-172-20-48-5.us-west-2.compute.internal Dec 2 23:38:24.141: INFO: Logging pods the kubelet thinks is on node ip-172-20-48-5.us-west-2.compute.internal Dec 2 23:38:24.212: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-7rvfw started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:24.212: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:24.212: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-wqvtr started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:24.212: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:24.212: INFO: pvc-volume-tester-t9ths started at 2022-12-02 23:36:46 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:24.212: INFO: Container volume-tester ready: false, restart count 0 Dec 2 23:38:24.212: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-qxp67 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:24.212: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:24.212: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-9mx44 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:24.212: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:24.212: INFO: webserver-pod started at 2022-12-02 23:35:30 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:24.212: INFO: Container agnhost ready: false, restart count 0 Dec 2 23:38:24.212: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-ttc6s started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:24.212: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: false, restart count 0 Dec 2 23:38:24.212: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-6nvlf started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:24.212: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:24.212: INFO: ebs-csi-node-bcx5m started at 2022-12-02 23:17:22 +0000 UTC (0+3 container statuses recorded) Dec 2 23:38:24.212: INFO: Container ebs-plugin ready: true, restart count 0 Dec 2 23:38:24.212: INFO: Container liveness-probe ready: true, restart count 0 Dec 2 23:38:24.212: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 2 23:38:24.212: INFO: coredns-5fcc7b6498-clxp8 started at 2022-12-02 23:17:58 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:24.212: INFO: Container coredns ready: true, restart count 0 Dec 2 23:38:24.212: INFO: csi-mockplugin-0 started at 2022-12-02 23:35:02 +0000 UTC (0+4 container statuses recorded) Dec 2 23:38:24.212: INFO: Container busybox ready: true, restart count 0 Dec 2 23:38:24.212: INFO: Container csi-provisioner ready: true, restart count 0 Dec 2 23:38:24.212: INFO: Container driver-registrar ready: true, restart count 0 Dec 2 23:38:24.212: INFO: Container mock ready: true, restart count 0 Dec 2 23:38:24.212: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-xctkw started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:24.212: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:24.212: INFO: cilium-ftssb started at 2022-12-02 23:17:22 +0000 UTC (1+1 container statuses recorded) Dec 2 23:38:24.212: INFO: Init container clean-cilium-state ready: true, restart count 0 Dec 2 23:38:24.212: INFO: Container cilium-agent ready: true, restart count 0 Dec 2 23:38:24.212: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-cdm2p started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:24.212: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:24.212: INFO: netserver-3 started at 2022-12-02 23:33:50 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:24.212: INFO: Container webserver ready: false, restart count 0 Dec 2 23:38:24.212: INFO: netserver-3 started at 2022-12-02 23:35:11 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:24.212: INFO: Container webserver ready: false, restart count 0 Dec 2 23:38:24.212: INFO: netserver-3 started at 2022-12-02 23:29:40 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:24.212: INFO: Container webserver ready: true, restart count 0 Dec 2 23:38:24.212: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-59flm started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:24.213: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:24.213: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-krv9s started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:38:24.213: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:38:24.555: INFO: Latency metrics for node ip-172-20-48-5.us-west-2.compute.internal Dec 2 23:38:24.555: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "replication-controller-9702" for this suite.
Filter through log files
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-cli\]\sKubectl\sclient\sSimple\spod\sshould\sreturn\scommand\sexit\scodes\srunning\sa\ssuccessful\scommand$'
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:512 Dec 2 23:36:47.734: Unexpected error: <exec.CodeExitError>: { Err: { s: "error running /home/prow/go/src/k8s.io/kops/_rundir/951491a9-7296-11ed-88e2-f6fea4ddc280/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k22.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-4169 run -i --image=k8s.gcr.io/e2e-test-images/busybox:1.29-1 --restart=Never --pod-running-timeout=2m0s success -- /bin/sh -c exit 0:\nCommand stdout:\n\nstderr:\nerror: timed out waiting for the condition\n\nerror:\nexit status 1", }, Code: 1, } error running /home/prow/go/src/k8s.io/kops/_rundir/951491a9-7296-11ed-88e2-f6fea4ddc280/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k22.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-4169 run -i --image=k8s.gcr.io/e2e-test-images/busybox:1.29-1 --restart=Never --pod-running-timeout=2m0s success -- /bin/sh -c exit 0: Command stdout: stderr: error: timed out waiting for the condition error: exit status 1 occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:514from junit_19.xml
[BeforeEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Dec 2 23:34:35.669: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename kubectl �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:244 [BeforeEach] Simple pod /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:381 �[1mSTEP�[0m: creating the pod from apiVersion: v1 kind: Pod metadata: name: httpd labels: name: httpd spec: containers: - name: httpd image: k8s.gcr.io/e2e-test-images/httpd:2.4.38-1 ports: - containerPort: 80 readinessProbe: httpGet: path: / port: 80 initialDelaySeconds: 5 timeoutSeconds: 5 Dec 2 23:34:36.003: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/951491a9-7296-11ed-88e2-f6fea4ddc280/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k22.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-4169 create -f -' Dec 2 23:34:37.049: INFO: stderr: "" Dec 2 23:34:37.049: INFO: stdout: "pod/httpd created\n" Dec 2 23:34:37.049: INFO: Waiting up to 5m0s for 1 pods to be running and ready: [httpd] Dec 2 23:34:37.049: INFO: Waiting up to 5m0s for pod "httpd" in namespace "kubectl-4169" to be "running and ready" Dec 2 23:34:37.112: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 62.213906ms Dec 2 23:34:39.174: INFO: Pod "httpd": Phase="Running", Reason="", readiness=false. Elapsed: 2.124447142s Dec 2 23:34:41.238: INFO: Pod "httpd": Phase="Running", Reason="", readiness=false. Elapsed: 4.188991235s Dec 2 23:34:43.302: INFO: Pod "httpd": Phase="Running", Reason="", readiness=false. Elapsed: 6.253098708s Dec 2 23:34:45.367: INFO: Pod "httpd": Phase="Running", Reason="", readiness=false. Elapsed: 8.317211114s Dec 2 23:34:47.430: INFO: Pod "httpd": Phase="Running", Reason="", readiness=true. Elapsed: 10.38030495s Dec 2 23:34:47.430: INFO: Pod "httpd" satisfied condition "running and ready" Dec 2 23:34:47.430: INFO: Wanted all 1 pods to be running and ready. Result: true. Pods: [httpd] [It] running a successful command /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:512 Dec 2 23:34:47.430: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/951491a9-7296-11ed-88e2-f6fea4ddc280/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k22.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-4169 run -i --image=k8s.gcr.io/e2e-test-images/busybox:1.29-1 --restart=Never --pod-running-timeout=2m0s success -- /bin/sh -c exit 0' Dec 2 23:36:47.734: INFO: rc: 1 Dec 2 23:36:47.734: FAIL: Unexpected error: <exec.CodeExitError>: { Err: { s: "error running /home/prow/go/src/k8s.io/kops/_rundir/951491a9-7296-11ed-88e2-f6fea4ddc280/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k22.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-4169 run -i --image=k8s.gcr.io/e2e-test-images/busybox:1.29-1 --restart=Never --pod-running-timeout=2m0s success -- /bin/sh -c exit 0:\nCommand stdout:\n\nstderr:\nerror: timed out waiting for the condition\n\nerror:\nexit status 1", }, Code: 1, } error running /home/prow/go/src/k8s.io/kops/_rundir/951491a9-7296-11ed-88e2-f6fea4ddc280/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k22.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-4169 run -i --image=k8s.gcr.io/e2e-test-images/busybox:1.29-1 --restart=Never --pod-running-timeout=2m0s success -- /bin/sh -c exit 0: Command stdout: stderr: error: timed out waiting for the condition error: exit status 1 occurred Full Stack Trace k8s.io/kubernetes/test/e2e/kubectl.glob..func1.8.7.3() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:514 +0x211 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc000226300) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x36c k8s.io/kubernetes/test/e2e.TestE2E(0xc000226300) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:136 +0x2b testing.tRunner(0xc000226300, 0x729c8b8) /usr/local/go/src/testing/testing.go:1203 +0xe5 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1248 +0x2b3 [AfterEach] Simple pod /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:387 �[1mSTEP�[0m: using delete to clean up resources Dec 2 23:36:47.735: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/951491a9-7296-11ed-88e2-f6fea4ddc280/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k22.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-4169 delete --grace-period=0 --force -f -' Dec 2 23:36:48.098: INFO: stderr: "warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely.\n" Dec 2 23:36:48.098: INFO: stdout: "pod \"httpd\" force deleted\n" Dec 2 23:36:48.098: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/951491a9-7296-11ed-88e2-f6fea4ddc280/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k22.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-4169 get rc,svc -l name=httpd --no-headers' Dec 2 23:36:48.437: INFO: stderr: "No resources found in kubectl-4169 namespace.\n" Dec 2 23:36:48.437: INFO: stdout: "" Dec 2 23:36:48.437: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/951491a9-7296-11ed-88e2-f6fea4ddc280/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k22.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-4169 get pods -l name=httpd -o go-template={{ range .items }}{{ if not .metadata.deletionTimestamp }}{{ .metadata.name }}{{ "\n" }}{{ end }}{{ end }}' Dec 2 23:36:48.702: INFO: stderr: "" Dec 2 23:36:48.702: INFO: stdout: "" [AfterEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "kubectl-4169". �[1mSTEP�[0m: Found 16 events. Dec 2 23:36:48.767: INFO: At 2022-12-02 23:34:37 +0000 UTC - event for httpd: {default-scheduler } Scheduled: Successfully assigned kubectl-4169/httpd to ip-172-20-43-150.us-west-2.compute.internal Dec 2 23:36:48.767: INFO: At 2022-12-02 23:34:38 +0000 UTC - event for httpd: {kubelet ip-172-20-43-150.us-west-2.compute.internal} Pulled: Container image "k8s.gcr.io/e2e-test-images/httpd:2.4.38-1" already present on machine Dec 2 23:36:48.767: INFO: At 2022-12-02 23:34:38 +0000 UTC - event for httpd: {kubelet ip-172-20-43-150.us-west-2.compute.internal} Created: Created container httpd Dec 2 23:36:48.767: INFO: At 2022-12-02 23:34:38 +0000 UTC - event for httpd: {kubelet ip-172-20-43-150.us-west-2.compute.internal} Started: Started container httpd Dec 2 23:36:48.767: INFO: At 2022-12-02 23:34:47 +0000 UTC - event for success: {default-scheduler } Scheduled: Successfully assigned kubectl-4169/success to ip-172-20-41-32.us-west-2.compute.internal Dec 2 23:36:48.767: INFO: At 2022-12-02 23:34:48 +0000 UTC - event for success: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "71c2b7c924e1a9fbe3f40187d055812401337529a89fc691c9dc8b52828c3977": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:36:48.767: INFO: At 2022-12-02 23:35:02 +0000 UTC - event for success: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "f0b50424ea1d136f1588068ea2dc841ed32432e61c7deabda11d8ed3640683a5": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:36:48.767: INFO: At 2022-12-02 23:35:13 +0000 UTC - event for success: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ce5525e6967cfe5f547c595ec32bad8978acafd7a9bb28c91e5b736e0f76d755": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:36:48.767: INFO: At 2022-12-02 23:35:25 +0000 UTC - event for success: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e13efa0b2ed9ef03a62ce6705fd1c701be8bf14a52767fccb1d6df63069ced58": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:36:48.767: INFO: At 2022-12-02 23:35:37 +0000 UTC - event for success: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b85d761f59a1bcac5df537480b99815d12d7011a7cc8744765a03d1870477566": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:36:48.767: INFO: At 2022-12-02 23:35:48 +0000 UTC - event for success: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e066caa586096f611a06da3573376a859e69a558549cdf9a4a38a85eb7247445": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:36:48.767: INFO: At 2022-12-02 23:35:59 +0000 UTC - event for success: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "4e716fcf48367ea2e763d102ab36c79748243df3c3d2efd6d0054e6d7698db9d": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:36:48.767: INFO: At 2022-12-02 23:36:12 +0000 UTC - event for success: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "0494549dde9009bc0e85470ec6bdbd11771eb9b7cc26dc6d7791f4d7f706bbe8": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:36:48.767: INFO: At 2022-12-02 23:36:23 +0000 UTC - event for success: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a604ececd97a8d2fe7e3a06e249b64be14f6fcdb0efb1b52fd9283d1722f4fdb": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:36:48.767: INFO: At 2022-12-02 23:36:38 +0000 UTC - event for success: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "14a1af58fcf1b3dfa545db7086eaee59eec8c94535d5046aafa360266c53ae5a": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:36:48.767: INFO: At 2022-12-02 23:36:47 +0000 UTC - event for httpd: {kubelet ip-172-20-43-150.us-west-2.compute.internal} Killing: Stopping container httpd Dec 2 23:36:48.829: INFO: POD NODE PHASE GRACE CONDITIONS Dec 2 23:36:48.829: INFO: success ip-172-20-41-32.us-west-2.compute.internal Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:34:47 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:34:47 +0000 UTC ContainersNotReady containers with unready status: [success]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:34:47 +0000 UTC ContainersNotReady containers with unready status: [success]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:34:47 +0000 UTC }] Dec 2 23:36:48.829: INFO: Dec 2 23:36:48.893: INFO: Logging node info for node ip-172-20-33-254.us-west-2.compute.internal Dec 2 23:36:48.955: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-33-254.us-west-2.compute.internal 6236393f-0a33-4aea-a2e2-fedaf7becdd4 29305 0 2022-12-02 23:17:15 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-33-254.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:ip-172-20-33-254.us-west-2.compute.internal topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0d507bb204448139f"} io.cilium.network.ipv4-cilium-host:172.20.42.35 io.cilium.network.ipv4-health-ip:172.20.58.176 io.cilium.network.ipv4-pod-cidr:100.96.1.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2022-12-02 23:17:15 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2022-12-02 23:17:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-12-02 23:17:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {cilium-agent Update v1 2022-12-02 23:17:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-12-02 23:17:41 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {e2e.test Update v1 2022-12-02 23:29:34 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2022-12-02 23:30:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-0d507bb204448139f,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-02 23:17:41 +0000 UTC,LastTransitionTime:2022-12-02 23:17:41 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-02 23:35:16 +0000 UTC,LastTransitionTime:2022-12-02 23:17:15 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-02 23:35:16 +0000 UTC,LastTransitionTime:2022-12-02 23:17:15 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-02 23:35:16 +0000 UTC,LastTransitionTime:2022-12-02 23:17:15 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-02 23:35:16 +0000 UTC,LastTransitionTime:2022-12-02 23:17:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.33.254,},NodeAddress{Type:ExternalIP,Address:54.190.128.11,},NodeAddress{Type:Hostname,Address:ip-172-20-33-254.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-33-254.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-190-128-11.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23ec8dd062be253828b6092e22eaab,SystemUUID:ec23ec8d-d062-be25-3828-b6092e22eaab,BootID:6bbf84c7-41f9-4141-912e-7f3bc9a0ef42,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.13,KubeletVersion:v1.22.16,KubeProxyVersion:v1.22.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:160382894,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.22.16],SizeBytes:105446599,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:1f36a24cfb5e0c3f725d7565a867c2384282fcbeccc77b07b423c9da95763a9a k8s.gcr.io/e2e-test-images/nautilus:1.4],SizeBytes:49230179,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:716d2f68314c5c4ddd5ecdb45183fcb4ed8019015982c1321571f863989b70b0 k8s.gcr.io/e2e-test-images/httpd:2.4.39-1],SizeBytes:41902332,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:b913fa234cc3473cfe16e937d106b455a7609f927f59031c81aca791e2689b50 k8s.gcr.io/e2e-test-images/httpd:2.4.38-1],SizeBytes:40765006,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:28956694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonroot@sha256:4051e85640c22f8e00c34dbd273576fc9e1e2829992656588062be9c0f69b04b k8s.gcr.io/e2e-test-images/nonroot:1.1],SizeBytes:17748448,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:aa60f453d64dfb3c3fd9e7306f988c36c6352c4f2d956aa90467f2808091effa registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.5],SizeBytes:15209420,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:1b7c978a792a8fa4e96244e8059bd71bb49b07e2e5a897fb0c867bdc6db20d5d k8s.gcr.io/sig-storage/livenessprobe:v2.3.0],SizeBytes:7933739,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:503b7abb89e57383eba61cc8a9cb0b495ea575c516108f7d972a6ff6e1ab3c9b k8s.gcr.io/e2e-test-images/nginx:1.14-1],SizeBytes:6979365,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:1ff6c18fbef2045af6b9c16bf034cc421a29027b800e4f9b68ae9b1cb3e9ae07 k8s.gcr.io/pause:3.5],SizeBytes:301416,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 2 23:36:48.956: INFO: Logging kubelet events for node ip-172-20-33-254.us-west-2.compute.internal Dec 2 23:36:49.021: INFO: Logging pods the kubelet thinks is on node ip-172-20-33-254.us-west-2.compute.internal Dec 2 23:36:49.097: INFO: ebs-csi-node-rfgvb started at 2022-12-02 23:17:16 +0000 UTC (0+3 container statuses recorded) Dec 2 23:36:49.097: INFO: Container ebs-plugin ready: true, restart count 0 Dec 2 23:36:49.097: INFO: Container liveness-probe ready: true, restart count 0 Dec 2 23:36:49.097: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 2 23:36:49.097: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-gfh2n started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:49.097: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:49.097: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-f2d26 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:49.097: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:49.097: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-jnmvg started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:49.097: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:49.097: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-cf58b started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:49.097: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:49.097: INFO: cilium-2db9c started at 2022-12-02 23:17:16 +0000 UTC (1+1 container statuses recorded) Dec 2 23:36:49.097: INFO: Init container clean-cilium-state ready: true, restart count 0 Dec 2 23:36:49.097: INFO: Container cilium-agent ready: true, restart count 0 Dec 2 23:36:49.097: INFO: coredns-5fcc7b6498-8nvj5 started at 2022-12-02 23:17:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:49.097: INFO: Container coredns ready: true, restart count 0 Dec 2 23:36:49.097: INFO: hostexec-ip-172-20-33-254.us-west-2.compute.internal-w7cc4 started at 2022-12-02 23:29:31 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:49.097: INFO: Container agnhost-container ready: true, restart count 0 Dec 2 23:36:49.097: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-d4f7q started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:49.097: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:49.097: INFO: netserver-0 started at 2022-12-02 23:35:10 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:49.097: INFO: Container webserver ready: false, restart count 0 Dec 2 23:36:49.097: INFO: coredns-autoscaler-6658b4bf85-4zgd2 started at 2022-12-02 23:17:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:49.097: INFO: Container autoscaler ready: true, restart count 0 Dec 2 23:36:49.097: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-9dq9t started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:49.097: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: false, restart count 0 Dec 2 23:36:49.097: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-t5msn started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:49.097: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:49.097: INFO: pod-6287b838-7e39-4bff-9b2c-7278de9a6392 started at 2022-12-02 23:33:40 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:49.097: INFO: Container write-pod ready: false, restart count 0 Dec 2 23:36:49.097: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-mtms5 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:49.097: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:49.097: INFO: netserver-0 started at 2022-12-02 23:29:40 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:49.097: INFO: Container webserver ready: true, restart count 0 Dec 2 23:36:49.097: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-svqb9 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:49.097: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:49.097: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-pt8v2 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:49.097: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:49.097: INFO: netserver-0 started at 2022-12-02 23:33:50 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:49.097: INFO: Container webserver ready: false, restart count 0 Dec 2 23:36:49.374: INFO: Latency metrics for node ip-172-20-33-254.us-west-2.compute.internal Dec 2 23:36:49.374: INFO: Logging node info for node ip-172-20-40-67.us-west-2.compute.internal Dec 2 23:36:49.437: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-40-67.us-west-2.compute.internal 0a5fe428-9a11-4bd2-96f1-21d4d188f80f 28496 0 2022-12-02 23:15:37 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-40-67.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/control-plane: node-role.kubernetes.io/master: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:us-west-2a topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0725cfbb3e93e664c"} io.cilium.network.ipv4-cilium-host:172.20.59.109 io.cilium.network.ipv4-health-ip:172.20.51.231 io.cilium.network.ipv4-pod-cidr:100.96.0.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-12-02 23:15:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {protokube Update v1 2022-12-02 23:16:01 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kops-controller Update v1 2022-12-02 23:16:07 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/master":{}}}} } {kube-controller-manager Update v1 2022-12-02 23:16:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {cilium-agent Update v1 2022-12-02 23:17:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-12-02 23:17:36 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-12-02 23:17:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-0725cfbb3e93e664c,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892301824 0} {<nil>} 3801076Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787444224 0} {<nil>} 3698676Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-02 23:17:36 +0000 UTC,LastTransitionTime:2022-12-02 23:17:36 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-02 23:33:27 +0000 UTC,LastTransitionTime:2022-12-02 23:15:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-02 23:33:27 +0000 UTC,LastTransitionTime:2022-12-02 23:15:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-02 23:33:27 +0000 UTC,LastTransitionTime:2022-12-02 23:15:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-02 23:33:27 +0000 UTC,LastTransitionTime:2022-12-02 23:16:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.40.67,},NodeAddress{Type:ExternalIP,Address:34.213.81.56,},NodeAddress{Type:Hostname,Address:ip-172-20-40-67.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-40-67.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-34-213-81-56.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2bdc536f1fb98cbe397162835bf7b5,SystemUUID:ec2bdc53-6f1f-b98c-be39-7162835bf7b5,BootID:80f23ad2-0f99-46af-8080-253547cd7440,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.13,KubeletVersion:v1.22.16,KubeProxyVersion:v1.22.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:a91fdaf9b988943a9c73d422348c2383c08dfc2566d4124a39a1b3d785018720 registry.k8s.io/etcdadm/etcd-manager:v3.0.20220831],SizeBytes:216515768,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:160382894,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.22.16],SizeBytes:129618394,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.22.16],SizeBytes:123306305,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.22.16],SizeBytes:105446599,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.22.16],SizeBytes:53956920,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-alpha.2],SizeBytes:42210956,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-alpha.2],SizeBytes:41463728,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:28956694,},ContainerImage{Names:[quay.io/cilium/operator@sha256:e2b26376a904190c73498e04bd5c1298a4c5239d50feab024074e4516381890f quay.io/cilium/operator:v1.11.11],SizeBytes:24003684,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-alpha.2],SizeBytes:4954596,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 2 23:36:49.437: INFO: Logging kubelet events for node ip-172-20-40-67.us-west-2.compute.internal Dec 2 23:36:49.502: INFO: Logging pods the kubelet thinks is on node ip-172-20-40-67.us-west-2.compute.internal Dec 2 23:36:49.569: INFO: kube-scheduler-ip-172-20-40-67.us-west-2.compute.internal started at 2022-12-02 23:14:53 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:49.569: INFO: Container kube-scheduler ready: true, restart count 0 Dec 2 23:36:49.569: INFO: etcd-manager-events-ip-172-20-40-67.us-west-2.compute.internal started at 2022-12-02 23:14:53 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:49.569: INFO: Container etcd-manager ready: true, restart count 0 Dec 2 23:36:49.569: INFO: ebs-csi-node-jt6f2 started at 2022-12-02 23:16:04 +0000 UTC (0+3 container statuses recorded) Dec 2 23:36:49.569: INFO: Container ebs-plugin ready: true, restart count 0 Dec 2 23:36:49.569: INFO: Container liveness-probe ready: true, restart count 0 Dec 2 23:36:49.569: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 2 23:36:49.569: INFO: cilium-t57cd started at 2022-12-02 23:16:04 +0000 UTC (1+1 container statuses recorded) Dec 2 23:36:49.569: INFO: Init container clean-cilium-state ready: true, restart count 0 Dec 2 23:36:49.569: INFO: Container cilium-agent ready: true, restart count 1 Dec 2 23:36:49.569: INFO: kops-controller-47skn started at 2022-12-02 23:16:04 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:49.569: INFO: Container kops-controller ready: true, restart count 0 Dec 2 23:36:49.569: INFO: dns-controller-5fb778d9d5-fln22 started at 2022-12-02 23:16:04 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:49.569: INFO: Container dns-controller ready: true, restart count 0 Dec 2 23:36:49.569: INFO: etcd-manager-main-ip-172-20-40-67.us-west-2.compute.internal started at 2022-12-02 23:14:53 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:49.569: INFO: Container etcd-manager ready: true, restart count 0 Dec 2 23:36:49.569: INFO: kube-controller-manager-ip-172-20-40-67.us-west-2.compute.internal started at 2022-12-02 23:14:53 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:49.569: INFO: Container kube-controller-manager ready: true, restart count 2 Dec 2 23:36:49.569: INFO: ebs-csi-controller-764b64d679-rnjp4 started at 2022-12-02 23:16:04 +0000 UTC (0+5 container statuses recorded) Dec 2 23:36:49.569: INFO: Container csi-attacher ready: true, restart count 0 Dec 2 23:36:49.569: INFO: Container csi-provisioner ready: true, restart count 0 Dec 2 23:36:49.569: INFO: Container csi-resizer ready: true, restart count 0 Dec 2 23:36:49.569: INFO: Container ebs-plugin ready: true, restart count 0 Dec 2 23:36:49.569: INFO: Container liveness-probe ready: true, restart count 0 Dec 2 23:36:49.569: INFO: kube-apiserver-ip-172-20-40-67.us-west-2.compute.internal started at 2022-12-02 23:14:53 +0000 UTC (0+2 container statuses recorded) Dec 2 23:36:49.569: INFO: Container healthcheck ready: true, restart count 0 Dec 2 23:36:49.569: INFO: Container kube-apiserver ready: true, restart count 1 Dec 2 23:36:49.569: INFO: cilium-operator-587dd66f87-zmwpl started at 2022-12-02 23:16:04 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:49.569: INFO: Container cilium-operator ready: true, restart count 1 Dec 2 23:36:49.826: INFO: Latency metrics for node ip-172-20-40-67.us-west-2.compute.internal Dec 2 23:36:49.827: INFO: Logging node info for node ip-172-20-41-32.us-west-2.compute.internal Dec 2 23:36:49.889: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-41-32.us-west-2.compute.internal ad6a9fcc-418f-4c1a-a9c7-ac1873b8a1ba 29702 0 2022-12-02 23:17:23 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-41-32.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:node mounted_volume_expand:mounted-volume-expand-6871 node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:ip-172-20-41-32.us-west-2.compute.internal topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-00d261efdd8c07a99"} io.cilium.network.ipv4-cilium-host:172.20.50.121 io.cilium.network.ipv4-health-ip:172.20.47.106 io.cilium.network.ipv4-pod-cidr:100.96.3.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2022-12-02 23:17:23 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-12-02 23:17:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2022-12-02 23:17:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {cilium-agent Update v1 2022-12-02 23:17:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-12-02 23:17:51 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {e2e.test Update v1 2022-12-02 23:29:34 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{},"f:mounted_volume_expand":{}}}} } {kubelet Update v1 2022-12-02 23:30:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2022-12-02 23:30:44 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-00d261efdd8c07a99,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-02 23:17:51 +0000 UTC,LastTransitionTime:2022-12-02 23:17:51 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-02 23:36:14 +0000 UTC,LastTransitionTime:2022-12-02 23:17:23 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-02 23:36:14 +0000 UTC,LastTransitionTime:2022-12-02 23:17:23 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-02 23:36:14 +0000 UTC,LastTransitionTime:2022-12-02 23:17:23 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-02 23:36:14 +0000 UTC,LastTransitionTime:2022-12-02 23:17:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.41.32,},NodeAddress{Type:ExternalIP,Address:35.88.26.86,},NodeAddress{Type:Hostname,Address:ip-172-20-41-32.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-41-32.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-88-26-86.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2624f500a45f29b52ed8b5d778f035,SystemUUID:ec2624f5-00a4-5f29-b52e-d8b5d778f035,BootID:b76bd51c-e57a-47b9-86f2-c1093a033e09,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.13,KubeletVersion:v1.22.16,KubeProxyVersion:v1.22.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:160382894,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:702a992280fb7c3303e84a5801acbb4c9c7fcf48cffe0e9c8be3f0c60f74cf89 k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.4],SizeBytes:112029652,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.22.16],SizeBytes:105446599,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:716d2f68314c5c4ddd5ecdb45183fcb4ed8019015982c1321571f863989b70b0 k8s.gcr.io/e2e-test-images/httpd:2.4.39-1],SizeBytes:41902332,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:b913fa234cc3473cfe16e937d106b455a7609f927f59031c81aca791e2689b50 k8s.gcr.io/e2e-test-images/httpd:2.4.38-1],SizeBytes:40765006,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:28956694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:1b7c978a792a8fa4e96244e8059bd71bb49b07e2e5a897fb0c867bdc6db20d5d k8s.gcr.io/sig-storage/livenessprobe:v2.3.0],SizeBytes:7933739,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:503b7abb89e57383eba61cc8a9cb0b495ea575c516108f7d972a6ff6e1ab3c9b k8s.gcr.io/e2e-test-images/nginx:1.14-1],SizeBytes:6979365,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac k8s.gcr.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:1ff6c18fbef2045af6b9c16bf034cc421a29027b800e4f9b68ae9b1cb3e9ae07 k8s.gcr.io/pause:3.5],SizeBytes:301416,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-00e603f65a9c9071b kubernetes.io/csi/ebs.csi.aws.com^vol-01091924f688a5969],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-01091924f688a5969,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-00e603f65a9c9071b,DevicePath:,},},Config:nil,},} Dec 2 23:36:49.890: INFO: Logging kubelet events for node ip-172-20-41-32.us-west-2.compute.internal Dec 2 23:36:49.954: INFO: Logging pods the kubelet thinks is on node ip-172-20-41-32.us-west-2.compute.internal Dec 2 23:36:50.025: INFO: cilium-m9r5q started at 2022-12-02 23:17:24 +0000 UTC (1+1 container statuses recorded) Dec 2 23:36:50.025: INFO: Init container clean-cilium-state ready: true, restart count 0 Dec 2 23:36:50.025: INFO: Container cilium-agent ready: true, restart count 0 Dec 2 23:36:50.025: INFO: test-rollover-controller-wxkjb started at 2022-12-02 23:35:19 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.025: INFO: Container httpd ready: true, restart count 0 Dec 2 23:36:50.025: INFO: successful-jobs-history-limit-27833734-6hlrt started at 2022-12-02 23:34:00 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.025: INFO: Container c ready: false, restart count 0 Dec 2 23:36:50.025: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-qgcxv started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.025: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:50.025: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-44b5z started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.025: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:50.025: INFO: netserver-1 started at 2022-12-02 23:29:40 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.025: INFO: Container webserver ready: true, restart count 0 Dec 2 23:36:50.025: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-wf5z9 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.025: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:50.025: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-gjgbh started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.025: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:50.025: INFO: success started at 2022-12-02 23:34:47 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.025: INFO: Container success ready: false, restart count 0 Dec 2 23:36:50.025: INFO: ebs-csi-node-c27hl started at 2022-12-02 23:17:24 +0000 UTC (0+3 container statuses recorded) Dec 2 23:36:50.025: INFO: Container ebs-plugin ready: true, restart count 0 Dec 2 23:36:50.025: INFO: Container liveness-probe ready: true, restart count 0 Dec 2 23:36:50.025: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 2 23:36:50.025: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-dlbpk started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.025: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:50.026: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-kxvnd started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.026: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:50.026: INFO: test-container-pod started at 2022-12-02 23:34:12 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.026: INFO: Container webserver ready: false, restart count 0 Dec 2 23:36:50.026: INFO: ss2-0 started at 2022-12-02 23:33:41 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.026: INFO: Container webserver ready: false, restart count 0 Dec 2 23:36:50.026: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-dm2vc started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.026: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:50.026: INFO: successful-jobs-history-limit-27833736-64b8r started at 2022-12-02 23:36:00 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.026: INFO: Container c ready: false, restart count 0 Dec 2 23:36:50.026: INFO: netserver-1 started at 2022-12-02 23:35:10 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.026: INFO: Container webserver ready: false, restart count 0 Dec 2 23:36:50.026: INFO: csi-mockplugin-0 started at 2022-12-02 23:36:30 +0000 UTC (0+4 container statuses recorded) Dec 2 23:36:50.026: INFO: Container busybox ready: false, restart count 0 Dec 2 23:36:50.026: INFO: Container csi-provisioner ready: false, restart count 0 Dec 2 23:36:50.026: INFO: Container driver-registrar ready: false, restart count 0 Dec 2 23:36:50.026: INFO: Container mock ready: false, restart count 0 Dec 2 23:36:50.026: INFO: host-test-container-pod started at 2022-12-02 23:34:12 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.026: INFO: Container agnhost-container ready: true, restart count 0 Dec 2 23:36:50.026: INFO: pod-subpath-test-inlinevolume-84wk started at 2022-12-02 23:35:11 +0000 UTC (2+1 container statuses recorded) Dec 2 23:36:50.026: INFO: Init container init-volume-inlinevolume-84wk ready: false, restart count 0 Dec 2 23:36:50.026: INFO: Init container test-init-volume-inlinevolume-84wk ready: false, restart count 0 Dec 2 23:36:50.026: INFO: Container test-container-subpath-inlinevolume-84wk ready: false, restart count 0 Dec 2 23:36:50.026: INFO: externalname-service-6rb48 started at 2022-12-02 23:35:40 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.026: INFO: Container externalname-service ready: false, restart count 0 Dec 2 23:36:50.026: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-42p62 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.026: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:50.026: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-rq5lg started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.026: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:50.026: INFO: netserver-1 started at 2022-12-02 23:33:50 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.026: INFO: Container webserver ready: false, restart count 0 Dec 2 23:36:50.026: INFO: successful-jobs-history-limit-27833735-zz4t9 started at 2022-12-02 23:35:00 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.026: INFO: Container c ready: false, restart count 0 Dec 2 23:36:50.026: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-79x59 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.026: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:50.026: INFO: pod-55255ec9-bf45-4208-865d-6ef51afe9599 started at 2022-12-02 23:30:30 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.026: INFO: Container write-pod ready: false, restart count 0 Dec 2 23:36:50.026: INFO: pod-1 started at 2022-12-02 23:31:10 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.026: INFO: Container donothing ready: false, restart count 0 Dec 2 23:36:50.026: INFO: ss-0 started at 2022-12-02 23:36:09 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.026: INFO: Container webserver ready: false, restart count 0 Dec 2 23:36:50.026: INFO: test-rolling-update-controller-5s7b9 started at 2022-12-02 23:36:29 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.026: INFO: Container httpd ready: false, restart count 0 Dec 2 23:36:50.026: INFO: rc-test-4h8d6 started at 2022-12-02 23:33:21 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.026: INFO: Container rc-test ready: false, restart count 0 Dec 2 23:36:50.312: INFO: Latency metrics for node ip-172-20-41-32.us-west-2.compute.internal Dec 2 23:36:50.312: INFO: Logging node info for node ip-172-20-43-150.us-west-2.compute.internal Dec 2 23:36:50.374: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-43-150.us-west-2.compute.internal 47bb1581-dcdc-4edf-b2c4-109aedb2f5bd 29544 0 2022-12-02 23:17:23 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-43-150.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:ip-172-20-43-150.us-west-2.compute.internal topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0e2e5350f5754b178"} io.cilium.network.ipv4-cilium-host:172.20.35.108 io.cilium.network.ipv4-health-ip:172.20.34.31 io.cilium.network.ipv4-pod-cidr:100.96.4.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2022-12-02 23:17:23 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-12-02 23:17:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2022-12-02 23:17:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {cilium-agent Update v1 2022-12-02 23:17:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-12-02 23:17:51 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {e2e.test Update v1 2022-12-02 23:29:34 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2022-12-02 23:30:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-0e2e5350f5754b178,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-02 23:17:51 +0000 UTC,LastTransitionTime:2022-12-02 23:17:51 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-02 23:35:54 +0000 UTC,LastTransitionTime:2022-12-02 23:17:23 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-02 23:35:54 +0000 UTC,LastTransitionTime:2022-12-02 23:17:23 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-02 23:35:54 +0000 UTC,LastTransitionTime:2022-12-02 23:17:23 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-02 23:35:54 +0000 UTC,LastTransitionTime:2022-12-02 23:17:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.43.150,},NodeAddress{Type:ExternalIP,Address:54.184.249.63,},NodeAddress{Type:Hostname,Address:ip-172-20-43-150.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-43-150.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-184-249-63.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23a85d6d7b80ff12e03e51b1effc11,SystemUUID:ec23a85d-6d7b-80ff-12e0-3e51b1effc11,BootID:72904f56-1058-4b24-85d2-c465d1149ad1,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.13,KubeletVersion:v1.22.16,KubeProxyVersion:v1.22.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:160382894,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:702a992280fb7c3303e84a5801acbb4c9c7fcf48cffe0e9c8be3f0c60f74cf89 k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.4],SizeBytes:112029652,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.22.16],SizeBytes:105446599,},ContainerImage{Names:[docker.io/library/nginx@sha256:e209ac2f37c70c1e0e9873a5f7231e91dcd83fdf1178d8ed36c2ec09974210ba docker.io/library/nginx:latest],SizeBytes:56833911,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:1f36a24cfb5e0c3f725d7565a867c2384282fcbeccc77b07b423c9da95763a9a k8s.gcr.io/e2e-test-images/nautilus:1.4],SizeBytes:49230179,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:716d2f68314c5c4ddd5ecdb45183fcb4ed8019015982c1321571f863989b70b0 k8s.gcr.io/e2e-test-images/httpd:2.4.39-1],SizeBytes:41902332,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:b913fa234cc3473cfe16e937d106b455a7609f927f59031c81aca791e2689b50 k8s.gcr.io/e2e-test-images/httpd:2.4.38-1],SizeBytes:40765006,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:28956694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a k8s.gcr.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf k8s.gcr.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:1b7c978a792a8fa4e96244e8059bd71bb49b07e2e5a897fb0c867bdc6db20d5d k8s.gcr.io/sig-storage/livenessprobe:v2.3.0],SizeBytes:7933739,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:503b7abb89e57383eba61cc8a9cb0b495ea575c516108f7d972a6ff6e1ab3c9b k8s.gcr.io/e2e-test-images/nginx:1.14-1],SizeBytes:6979365,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac k8s.gcr.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:1ff6c18fbef2045af6b9c16bf034cc421a29027b800e4f9b68ae9b1cb3e9ae07 k8s.gcr.io/pause:3.5],SizeBytes:301416,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 2 23:36:50.375: INFO: Logging kubelet events for node ip-172-20-43-150.us-west-2.compute.internal Dec 2 23:36:50.439: INFO: Logging pods the kubelet thinks is on node ip-172-20-43-150.us-west-2.compute.internal Dec 2 23:36:50.508: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-s5867 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.508: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:50.508: INFO: netserver-2 started at 2022-12-02 23:33:50 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.508: INFO: Container webserver ready: false, restart count 0 Dec 2 23:36:50.508: INFO: pod-a490ced8-ce1a-4203-a10b-1b9143f1e598 started at 2022-12-02 23:32:12 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.508: INFO: Container write-pod ready: false, restart count 0 Dec 2 23:36:50.508: INFO: hostexec-ip-172-20-43-150.us-west-2.compute.internal-4sp8t started at 2022-12-02 23:34:34 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.508: INFO: Container agnhost-container ready: true, restart count 0 Dec 2 23:36:50.508: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-kj74m started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.508: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:50.508: INFO: hostexec-ip-172-20-43-150.us-west-2.compute.internal-lmqmb started at 2022-12-02 23:31:33 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.508: INFO: Container agnhost-container ready: true, restart count 0 Dec 2 23:36:50.508: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-ksvcz started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.508: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:50.508: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-pm84g started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.508: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: false, restart count 0 Dec 2 23:36:50.508: INFO: pod-0 started at 2022-12-02 23:31:10 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.508: INFO: Container donothing ready: false, restart count 0 Dec 2 23:36:50.508: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-wqgdj started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.508: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:50.508: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-z5d7v started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.508: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:50.508: INFO: pod-should-be-evictedb0d46de6-8dde-4fe1-bf6b-d5cbeab91511 started at 2022-12-02 23:35:42 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.508: INFO: Container bar ready: true, restart count 0 Dec 2 23:36:50.508: INFO: hostexec-ip-172-20-43-150.us-west-2.compute.internal-pzwm8 started at 2022-12-02 23:34:47 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.508: INFO: Container agnhost-container ready: true, restart count 0 Dec 2 23:36:50.508: INFO: netserver-2 started at 2022-12-02 23:35:10 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.508: INFO: Container webserver ready: false, restart count 0 Dec 2 23:36:50.508: INFO: pod-abb1ddf3-cdd4-4291-a144-3f08787c89a0 started at 2022-12-02 23:35:57 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.508: INFO: Container test-container ready: false, restart count 0 Dec 2 23:36:50.508: INFO: pod-subpath-test-preprovisionedpv-8zrh started at 2022-12-02 23:34:49 +0000 UTC (1+1 container statuses recorded) Dec 2 23:36:50.508: INFO: Init container init-volume-preprovisionedpv-8zrh ready: false, restart count 0 Dec 2 23:36:50.508: INFO: Container test-container-subpath-preprovisionedpv-8zrh ready: false, restart count 0 Dec 2 23:36:50.508: INFO: externalname-service-vqt5p started at 2022-12-02 23:35:40 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.508: INFO: Container externalname-service ready: false, restart count 0 Dec 2 23:36:50.508: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-5jb9p started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.508: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:50.508: INFO: pod-2 started at 2022-12-02 23:31:10 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.508: INFO: Container donothing ready: true, restart count 0 Dec 2 23:36:50.508: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-g66v4 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.508: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:50.508: INFO: cilium-7h427 started at 2022-12-02 23:17:24 +0000 UTC (1+1 container statuses recorded) Dec 2 23:36:50.508: INFO: Init container clean-cilium-state ready: true, restart count 0 Dec 2 23:36:50.508: INFO: Container cilium-agent ready: true, restart count 0 Dec 2 23:36:50.508: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-8bg6n started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.508: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:50.508: INFO: pod-b416a818-b13e-44c7-a3c6-14e94e8ce1c4 started at 2022-12-02 23:35:04 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.508: INFO: Container write-pod ready: false, restart count 0 Dec 2 23:36:50.508: INFO: netserver-2 started at 2022-12-02 23:29:40 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.508: INFO: Container webserver ready: true, restart count 0 Dec 2 23:36:50.508: INFO: ebs-csi-node-8qrwx started at 2022-12-02 23:17:24 +0000 UTC (0+3 container statuses recorded) Dec 2 23:36:50.508: INFO: Container ebs-plugin ready: true, restart count 0 Dec 2 23:36:50.508: INFO: Container liveness-probe ready: true, restart count 0 Dec 2 23:36:50.508: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 2 23:36:50.508: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-qnr57 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.508: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:50.508: INFO: test-rollover-deployment-67bbb7bc8-sdxv6 started at 2022-12-02 23:36:16 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.508: INFO: Container agnhost ready: false, restart count 0 Dec 2 23:36:50.508: INFO: configmap-client started at 2022-12-02 23:34:58 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.508: INFO: Container configmap-client ready: false, restart count 0 Dec 2 23:36:50.800: INFO: Latency metrics for node ip-172-20-43-150.us-west-2.compute.internal Dec 2 23:36:50.800: INFO: Logging node info for node ip-172-20-48-5.us-west-2.compute.internal Dec 2 23:36:50.863: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-48-5.us-west-2.compute.internal 6342e9b6-e818-4fbf-aae7-8be176fd4ec1 30001 0 2022-12-02 23:17:21 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a io.kubernetes.storage.mock/node:some-mock-node kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-48-5.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:ip-172-20-48-5.us-west-2.compute.internal topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-9034":"csi-mock-csi-mock-volumes-9034","ebs.csi.aws.com":"i-0093900b92d415e84"} io.cilium.network.ipv4-cilium-host:172.20.42.98 io.cilium.network.ipv4-health-ip:172.20.44.82 io.cilium.network.ipv4-pod-cidr:100.96.2.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-12-02 23:17:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2022-12-02 23:17:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2022-12-02 23:17:22 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {cilium-agent Update v1 2022-12-02 23:17:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-12-02 23:17:52 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {e2e.test Update v1 2022-12-02 23:29:34 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2022-12-02 23:36:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-0093900b92d415e84,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-02 23:17:52 +0000 UTC,LastTransitionTime:2022-12-02 23:17:52 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-02 23:36:03 +0000 UTC,LastTransitionTime:2022-12-02 23:17:21 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-02 23:36:03 +0000 UTC,LastTransitionTime:2022-12-02 23:17:21 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-02 23:36:03 +0000 UTC,LastTransitionTime:2022-12-02 23:17:21 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-02 23:36:03 +0000 UTC,LastTransitionTime:2022-12-02 23:17:42 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.48.5,},NodeAddress{Type:ExternalIP,Address:34.213.188.181,},NodeAddress{Type:Hostname,Address:ip-172-20-48-5.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-48-5.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-34-213-188-181.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2ecd9e359fbd979ba14c48724d474b,SystemUUID:ec2ecd9e-359f-bd97-9ba1-4c48724d474b,BootID:3d1b1479-a710-49bb-96b3-2764890e8166,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.13,KubeletVersion:v1.22.16,KubeProxyVersion:v1.22.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:160382894,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.22.16],SizeBytes:105446599,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:716d2f68314c5c4ddd5ecdb45183fcb4ed8019015982c1321571f863989b70b0 k8s.gcr.io/e2e-test-images/httpd:2.4.39-1],SizeBytes:41902332,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:b913fa234cc3473cfe16e937d106b455a7609f927f59031c81aca791e2689b50 k8s.gcr.io/e2e-test-images/httpd:2.4.38-1],SizeBytes:40765006,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:28956694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a k8s.gcr.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:1b7c978a792a8fa4e96244e8059bd71bb49b07e2e5a897fb0c867bdc6db20d5d k8s.gcr.io/sig-storage/livenessprobe:v2.3.0],SizeBytes:7933739,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:503b7abb89e57383eba61cc8a9cb0b495ea575c516108f7d972a6ff6e1ab3c9b k8s.gcr.io/e2e-test-images/nginx:1.14-1],SizeBytes:6979365,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:1ff6c18fbef2045af6b9c16bf034cc421a29027b800e4f9b68ae9b1cb3e9ae07 k8s.gcr.io/pause:3.5],SizeBytes:301416,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 2 23:36:50.863: INFO: Logging kubelet events for node ip-172-20-48-5.us-west-2.compute.internal Dec 2 23:36:50.928: INFO: Logging pods the kubelet thinks is on node ip-172-20-48-5.us-west-2.compute.internal Dec 2 23:36:50.995: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-7rvfw started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.995: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:50.995: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-wqvtr started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.995: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:50.995: INFO: pvc-volume-tester-t9ths started at 2022-12-02 23:36:46 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.995: INFO: Container volume-tester ready: false, restart count 0 Dec 2 23:36:50.995: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-qxp67 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.995: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:50.995: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-9mx44 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.995: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:50.995: INFO: webserver-pod started at 2022-12-02 23:35:30 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.995: INFO: Container agnhost ready: false, restart count 0 Dec 2 23:36:50.995: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-ttc6s started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.995: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: false, restart count 0 Dec 2 23:36:50.995: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-6nvlf started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.995: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:50.995: INFO: ebs-csi-node-bcx5m started at 2022-12-02 23:17:22 +0000 UTC (0+3 container statuses recorded) Dec 2 23:36:50.995: INFO: Container ebs-plugin ready: true, restart count 0 Dec 2 23:36:50.995: INFO: Container liveness-probe ready: true, restart count 0 Dec 2 23:36:50.995: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 2 23:36:50.995: INFO: coredns-5fcc7b6498-clxp8 started at 2022-12-02 23:17:58 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.995: INFO: Container coredns ready: true, restart count 0 Dec 2 23:36:50.995: INFO: csi-mockplugin-0 started at 2022-12-02 23:35:02 +0000 UTC (0+4 container statuses recorded) Dec 2 23:36:50.995: INFO: Container busybox ready: true, restart count 0 Dec 2 23:36:50.995: INFO: Container csi-provisioner ready: true, restart count 0 Dec 2 23:36:50.995: INFO: Container driver-registrar ready: true, restart count 0 Dec 2 23:36:50.995: INFO: Container mock ready: true, restart count 0 Dec 2 23:36:50.995: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-xctkw started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.995: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:50.995: INFO: cilium-ftssb started at 2022-12-02 23:17:22 +0000 UTC (1+1 container statuses recorded) Dec 2 23:36:50.995: INFO: Init container clean-cilium-state ready: true, restart count 0 Dec 2 23:36:50.995: INFO: Container cilium-agent ready: true, restart count 0 Dec 2 23:36:50.995: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-cdm2p started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.995: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:50.995: INFO: netserver-3 started at 2022-12-02 23:33:50 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.995: INFO: Container webserver ready: false, restart count 0 Dec 2 23:36:50.995: INFO: netserver-3 started at 2022-12-02 23:35:11 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.995: INFO: Container webserver ready: false, restart count 0 Dec 2 23:36:50.995: INFO: netserver-3 started at 2022-12-02 23:29:40 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.995: INFO: Container webserver ready: true, restart count 0 Dec 2 23:36:50.995: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-59flm started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.995: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:50.995: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-krv9s started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:36:50.995: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:36:51.316: INFO: Latency metrics for node ip-172-20-48-5.us-west-2.compute.internal Dec 2 23:36:51.316: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "kubectl-4169" for this suite.
Filter through log files
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-cli\]\sKubectl\sclient\sSimple\spod\sshould\ssupport\sinline\sexecution\sand\sattach$'
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:555 Dec 2 23:34:29.219: Unexpected error: <exec.CodeExitError>: { Err: { s: "error running /home/prow/go/src/k8s.io/kops/_rundir/951491a9-7296-11ed-88e2-f6fea4ddc280/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k22.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-5907 run run-test --image=k8s.gcr.io/e2e-test-images/busybox:1.29-1 --restart=OnFailure --pod-running-timeout=2m0s --attach=true --stdin -- sh -c echo -n read: && cat && echo 'stdin closed':\nCommand stdout:\n\nstderr:\nerror: timed out waiting for the condition\n\nerror:\nexit status 1", }, Code: 1, } error running /home/prow/go/src/k8s.io/kops/_rundir/951491a9-7296-11ed-88e2-f6fea4ddc280/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k22.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-5907 run run-test --image=k8s.gcr.io/e2e-test-images/busybox:1.29-1 --restart=OnFailure --pod-running-timeout=2m0s --attach=true --stdin -- sh -c echo -n read: && cat && echo 'stdin closed': Command stdout: stderr: error: timed out waiting for the condition error: exit status 1 occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:602from junit_02.xml
[BeforeEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Dec 2 23:30:46.816: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename kubectl �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:244 [BeforeEach] Simple pod /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:381 �[1mSTEP�[0m: creating the pod from Dec 2 23:30:47.141: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/951491a9-7296-11ed-88e2-f6fea4ddc280/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k22.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-5907 create -f -' Dec 2 23:30:47.635: INFO: stderr: "" Dec 2 23:30:47.635: INFO: stdout: "pod/httpd created\n" Dec 2 23:30:47.635: INFO: Waiting up to 5m0s for 1 pods to be running and ready: [httpd] Dec 2 23:30:47.635: INFO: Waiting up to 5m0s for pod "httpd" in namespace "kubectl-5907" to be "running and ready" Dec 2 23:30:47.699: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 64.71962ms Dec 2 23:30:49.765: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2.130133798s Dec 2 23:30:51.830: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4.195286696s Dec 2 23:30:53.896: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 6.261405747s Dec 2 23:30:55.962: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 8.326998954s Dec 2 23:30:58.027: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 10.392291353s Dec 2 23:31:00.093: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 12.458796662s Dec 2 23:31:02.160: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 14.52538981s Dec 2 23:31:04.226: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 16.591065096s Dec 2 23:31:06.291: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 18.656369573s Dec 2 23:31:08.356: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 20.721724638s Dec 2 23:31:10.422: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 22.787733065s Dec 2 23:31:12.489: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 24.854221227s Dec 2 23:31:14.554: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 26.919641817s Dec 2 23:31:16.620: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 28.985391032s Dec 2 23:31:18.685: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 31.05076045s Dec 2 23:31:20.754: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 33.119089113s Dec 2 23:31:22.819: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 35.184739487s Dec 2 23:31:24.885: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 37.25016859s Dec 2 23:31:26.951: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 39.316039642s Dec 2 23:31:29.016: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 41.381096992s Dec 2 23:31:31.082: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 43.447346359s Dec 2 23:31:33.148: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 45.513203496s Dec 2 23:31:35.214: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 47.579313064s Dec 2 23:31:37.280: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 49.645000368s Dec 2 23:31:39.346: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 51.711589085s Dec 2 23:31:41.413: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 53.777977287s Dec 2 23:31:43.478: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 55.843461057s Dec 2 23:31:45.543: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 57.908041004s Dec 2 23:31:47.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 59.97348334s Dec 2 23:31:49.674: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.039644404s Dec 2 23:31:51.739: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.104336986s Dec 2 23:31:53.804: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.169521787s Dec 2 23:31:55.870: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.235310484s Dec 2 23:31:57.935: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.300787171s Dec 2 23:32:00.001: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.366717677s Dec 2 23:32:02.067: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.432052084s Dec 2 23:32:04.133: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.49856668s Dec 2 23:32:06.200: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.564849341s Dec 2 23:32:08.265: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.63043022s Dec 2 23:32:10.331: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.696096062s Dec 2 23:32:12.396: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.761683415s Dec 2 23:32:14.462: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.827277843s Dec 2 23:32:16.528: INFO: Pod "httpd": Phase="Running", Reason="", readiness=false. Elapsed: 1m28.893795374s Dec 2 23:32:18.595: INFO: Pod "httpd": Phase="Running", Reason="", readiness=false. Elapsed: 1m30.959962207s Dec 2 23:32:20.660: INFO: Pod "httpd": Phase="Running", Reason="", readiness=false. Elapsed: 1m33.025131415s Dec 2 23:32:22.726: INFO: Pod "httpd": Phase="Running", Reason="", readiness=false. Elapsed: 1m35.091241956s Dec 2 23:32:24.791: INFO: Pod "httpd": Phase="Running", Reason="", readiness=false. Elapsed: 1m37.156739881s Dec 2 23:32:26.858: INFO: Pod "httpd": Phase="Running", Reason="", readiness=false. Elapsed: 1m39.223059553s Dec 2 23:32:28.925: INFO: Pod "httpd": Phase="Running", Reason="", readiness=true. Elapsed: 1m41.289828984s Dec 2 23:32:28.925: INFO: Pod "httpd" satisfied condition "running and ready" Dec 2 23:32:28.925: INFO: Wanted all 1 pods to be running and ready. Result: true. Pods: [httpd] [It] should support inline execution and attach /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:555 �[1mSTEP�[0m: executing a command with run and attach with stdin Dec 2 23:32:28.925: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/951491a9-7296-11ed-88e2-f6fea4ddc280/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k22.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-5907 run run-test --image=k8s.gcr.io/e2e-test-images/busybox:1.29-1 --restart=OnFailure --pod-running-timeout=2m0s --attach=true --stdin -- sh -c echo -n read: && cat && echo 'stdin closed'' Dec 2 23:34:29.219: INFO: rc: 1 Dec 2 23:34:29.219: FAIL: Unexpected error: <exec.CodeExitError>: { Err: { s: "error running /home/prow/go/src/k8s.io/kops/_rundir/951491a9-7296-11ed-88e2-f6fea4ddc280/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k22.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-5907 run run-test --image=k8s.gcr.io/e2e-test-images/busybox:1.29-1 --restart=OnFailure --pod-running-timeout=2m0s --attach=true --stdin -- sh -c echo -n read: && cat && echo 'stdin closed':\nCommand stdout:\n\nstderr:\nerror: timed out waiting for the condition\n\nerror:\nexit status 1", }, Code: 1, } error running /home/prow/go/src/k8s.io/kops/_rundir/951491a9-7296-11ed-88e2-f6fea4ddc280/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k22.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-5907 run run-test --image=k8s.gcr.io/e2e-test-images/busybox:1.29-1 --restart=OnFailure --pod-running-timeout=2m0s --attach=true --stdin -- sh -c echo -n read: && cat && echo 'stdin closed': Command stdout: stderr: error: timed out waiting for the condition error: exit status 1 occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.KubectlBuilder.ExecOrDie(0xc001066dc0, 0x0, 0xc003ccafd0, 0xc, 0xb, 0xc003b40b90) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:602 +0xbf k8s.io/kubernetes/test/e2e/kubectl.glob..func1.8.8() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:571 +0x327 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc000c5b980) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x36c k8s.io/kubernetes/test/e2e.TestE2E(0xc000c5b980) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:136 +0x2b testing.tRunner(0xc000c5b980, 0x729c8b8) /usr/local/go/src/testing/testing.go:1203 +0xe5 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1248 +0x2b3 [AfterEach] Simple pod /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:387 �[1mSTEP�[0m: using delete to clean up resources Dec 2 23:34:29.220: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/951491a9-7296-11ed-88e2-f6fea4ddc280/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k22.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-5907 delete --grace-period=0 --force -f -' Dec 2 23:34:29.591: INFO: stderr: "warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely.\n" Dec 2 23:34:29.592: INFO: stdout: "pod \"httpd\" force deleted\n" Dec 2 23:34:29.592: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/951491a9-7296-11ed-88e2-f6fea4ddc280/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k22.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-5907 get rc,svc -l name=httpd --no-headers' Dec 2 23:34:29.960: INFO: stderr: "No resources found in kubectl-5907 namespace.\n" Dec 2 23:34:29.960: INFO: stdout: "" Dec 2 23:34:29.960: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/951491a9-7296-11ed-88e2-f6fea4ddc280/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k22.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-5907 get pods -l name=httpd -o go-template={{ range .items }}{{ if not .metadata.deletionTimestamp }}{{ .metadata.name }}{{ "\n" }}{{ end }}{{ end }}' Dec 2 23:34:30.223: INFO: stderr: "" Dec 2 23:34:30.223: INFO: stdout: "" [AfterEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "kubectl-5907". �[1mSTEP�[0m: Found 22 events. Dec 2 23:34:30.289: INFO: At 2022-12-02 23:30:47 +0000 UTC - event for httpd: {default-scheduler } Scheduled: Successfully assigned kubectl-5907/httpd to ip-172-20-43-150.us-west-2.compute.internal Dec 2 23:34:30.289: INFO: At 2022-12-02 23:30:47 +0000 UTC - event for httpd: {kubelet ip-172-20-43-150.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e3359bf0f2dd8d76b3b4105b056ef0bc24ff6da26d9700a4f0ea36d15b6cce2e": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:34:30.289: INFO: At 2022-12-02 23:31:03 +0000 UTC - event for httpd: {kubelet ip-172-20-43-150.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "07459a003cce383f2227cd5d3e636dd87a1d96903604919d6fbde201e517a7a4": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:34:30.289: INFO: At 2022-12-02 23:31:19 +0000 UTC - event for httpd: {kubelet ip-172-20-43-150.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b64f52f870fdf21d0676cc1c0cf26b96c4a81a19d28c67ee3309fd784d882b4b": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:34:30.289: INFO: At 2022-12-02 23:31:33 +0000 UTC - event for httpd: {kubelet ip-172-20-43-150.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e239bb122822780fe7f23eb059f5a80dc67a0673f7fd2b3e001064d17ef5e55a": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:34:30.289: INFO: At 2022-12-02 23:31:46 +0000 UTC - event for httpd: {kubelet ip-172-20-43-150.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "5709d80754093809cd19a8e117e396279224be427926bbc513f35aa6ac2dd64e": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:34:30.289: INFO: At 2022-12-02 23:31:59 +0000 UTC - event for httpd: {kubelet ip-172-20-43-150.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ce79616322b41b57d28b9ce83b56169a32ef15541de628c2d60442e41c1df95b": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:34:30.289: INFO: At 2022-12-02 23:32:15 +0000 UTC - event for httpd: {kubelet ip-172-20-43-150.us-west-2.compute.internal} Pulled: Container image "k8s.gcr.io/e2e-test-images/httpd:2.4.38-1" already present on machine Dec 2 23:34:30.289: INFO: At 2022-12-02 23:32:15 +0000 UTC - event for httpd: {kubelet ip-172-20-43-150.us-west-2.compute.internal} Created: Created container httpd Dec 2 23:34:30.289: INFO: At 2022-12-02 23:32:15 +0000 UTC - event for httpd: {kubelet ip-172-20-43-150.us-west-2.compute.internal} Started: Started container httpd Dec 2 23:34:30.289: INFO: At 2022-12-02 23:32:29 +0000 UTC - event for run-test: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "1ca80c427983af4ca7b1bdf93b2a00d131afddf33b432db98d9c48c866610a0a": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:34:30.289: INFO: At 2022-12-02 23:32:29 +0000 UTC - event for run-test: {default-scheduler } Scheduled: Successfully assigned kubectl-5907/run-test to ip-172-20-41-32.us-west-2.compute.internal Dec 2 23:34:30.289: INFO: At 2022-12-02 23:32:44 +0000 UTC - event for run-test: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "733b0ac8e9e06b60e41731558dff19099821453a37392cc08fc68d7bd67efeb0": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:34:30.289: INFO: At 2022-12-02 23:32:57 +0000 UTC - event for run-test: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "6c4151080ee0dc7bb563df1e847ead2747ed1b881e3e80fa6fa3d041856bb68a": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:34:30.289: INFO: At 2022-12-02 23:33:11 +0000 UTC - event for run-test: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "6d4f9535f73dbb2920aaa29d9db8d3407c6371eb906d970f2fa50bc7c70dd362": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:34:30.289: INFO: At 2022-12-02 23:33:23 +0000 UTC - event for run-test: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "0d775a828454c27a2be13864f0c7f96439b30005a1847588bb14bd275be2b041": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:34:30.289: INFO: At 2022-12-02 23:33:37 +0000 UTC - event for run-test: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "98becf44978a2aef22fcd033fffdfde131f4aa888746dcff5a219e9b8f2cbb1e": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:34:30.289: INFO: At 2022-12-02 23:33:48 +0000 UTC - event for run-test: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d5467512689172a0c86249bc1c0ed7924542576e0355891f00669194293f4b5e": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:34:30.289: INFO: At 2022-12-02 23:34:02 +0000 UTC - event for run-test: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "339036f28117e2bfd12510dcb1263abf944fc52e7f4772bf14fe2b769585b7fc": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:34:30.289: INFO: At 2022-12-02 23:34:13 +0000 UTC - event for run-test: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d9ab794cb21befaffce45bda61142625e9021703d20f0ecd2db73843c9d2f018": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:34:30.289: INFO: At 2022-12-02 23:34:26 +0000 UTC - event for run-test: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a3bc3bf5d2ff825c447b6389417da0016e373abba0b6fe0c60f2f4bd66710179": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:34:30.289: INFO: At 2022-12-02 23:34:29 +0000 UTC - event for httpd: {kubelet ip-172-20-43-150.us-west-2.compute.internal} Killing: Stopping container httpd Dec 2 23:34:30.354: INFO: POD NODE PHASE GRACE CONDITIONS Dec 2 23:34:30.354: INFO: run-test ip-172-20-41-32.us-west-2.compute.internal Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:32:29 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:32:29 +0000 UTC ContainersNotReady containers with unready status: [run-test]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:32:29 +0000 UTC ContainersNotReady containers with unready status: [run-test]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:32:29 +0000 UTC }] Dec 2 23:34:30.354: INFO: Dec 2 23:34:30.419: INFO: Logging node info for node ip-172-20-33-254.us-west-2.compute.internal Dec 2 23:34:30.484: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-33-254.us-west-2.compute.internal 6236393f-0a33-4aea-a2e2-fedaf7becdd4 27169 0 2022-12-02 23:17:15 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-33-254.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:ip-172-20-33-254.us-west-2.compute.internal topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0d507bb204448139f"} io.cilium.network.ipv4-cilium-host:172.20.42.35 io.cilium.network.ipv4-health-ip:172.20.58.176 io.cilium.network.ipv4-pod-cidr:100.96.1.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2022-12-02 23:17:15 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2022-12-02 23:17:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-12-02 23:17:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {cilium-agent Update v1 2022-12-02 23:17:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-12-02 23:17:41 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {e2e.test Update v1 2022-12-02 23:29:34 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2022-12-02 23:30:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-0d507bb204448139f,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-02 23:17:41 +0000 UTC,LastTransitionTime:2022-12-02 23:17:41 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-02 23:30:16 +0000 UTC,LastTransitionTime:2022-12-02 23:17:15 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-02 23:30:16 +0000 UTC,LastTransitionTime:2022-12-02 23:17:15 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-02 23:30:16 +0000 UTC,LastTransitionTime:2022-12-02 23:17:15 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-02 23:30:16 +0000 UTC,LastTransitionTime:2022-12-02 23:17:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.33.254,},NodeAddress{Type:ExternalIP,Address:54.190.128.11,},NodeAddress{Type:Hostname,Address:ip-172-20-33-254.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-33-254.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-190-128-11.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23ec8dd062be253828b6092e22eaab,SystemUUID:ec23ec8d-d062-be25-3828-b6092e22eaab,BootID:6bbf84c7-41f9-4141-912e-7f3bc9a0ef42,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.13,KubeletVersion:v1.22.16,KubeProxyVersion:v1.22.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:160382894,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.22.16],SizeBytes:105446599,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:1f36a24cfb5e0c3f725d7565a867c2384282fcbeccc77b07b423c9da95763a9a k8s.gcr.io/e2e-test-images/nautilus:1.4],SizeBytes:49230179,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:716d2f68314c5c4ddd5ecdb45183fcb4ed8019015982c1321571f863989b70b0 k8s.gcr.io/e2e-test-images/httpd:2.4.39-1],SizeBytes:41902332,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:b913fa234cc3473cfe16e937d106b455a7609f927f59031c81aca791e2689b50 k8s.gcr.io/e2e-test-images/httpd:2.4.38-1],SizeBytes:40765006,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:28956694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonroot@sha256:4051e85640c22f8e00c34dbd273576fc9e1e2829992656588062be9c0f69b04b k8s.gcr.io/e2e-test-images/nonroot:1.1],SizeBytes:17748448,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:aa60f453d64dfb3c3fd9e7306f988c36c6352c4f2d956aa90467f2808091effa registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.5],SizeBytes:15209420,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:1b7c978a792a8fa4e96244e8059bd71bb49b07e2e5a897fb0c867bdc6db20d5d k8s.gcr.io/sig-storage/livenessprobe:v2.3.0],SizeBytes:7933739,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:503b7abb89e57383eba61cc8a9cb0b495ea575c516108f7d972a6ff6e1ab3c9b k8s.gcr.io/e2e-test-images/nginx:1.14-1],SizeBytes:6979365,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:1ff6c18fbef2045af6b9c16bf034cc421a29027b800e4f9b68ae9b1cb3e9ae07 k8s.gcr.io/pause:3.5],SizeBytes:301416,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 2 23:34:30.484: INFO: Logging kubelet events for node ip-172-20-33-254.us-west-2.compute.internal Dec 2 23:34:30.553: INFO: Logging pods the kubelet thinks is on node ip-172-20-33-254.us-west-2.compute.internal Dec 2 23:34:30.641: INFO: ebs-csi-node-rfgvb started at 2022-12-02 23:17:16 +0000 UTC (0+3 container statuses recorded) Dec 2 23:34:30.641: INFO: Container ebs-plugin ready: true, restart count 0 Dec 2 23:34:30.641: INFO: Container liveness-probe ready: true, restart count 0 Dec 2 23:34:30.641: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 2 23:34:30.641: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-gfh2n started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:30.641: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:34:30.641: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-f2d26 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:30.641: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:34:30.641: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-jnmvg started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:30.641: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:34:30.641: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-cf58b started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:30.641: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:34:30.641: INFO: cilium-2db9c started at 2022-12-02 23:17:16 +0000 UTC (1+1 container statuses recorded) Dec 2 23:34:30.641: INFO: Init container clean-cilium-state ready: true, restart count 0 Dec 2 23:34:30.641: INFO: Container cilium-agent ready: true, restart count 0 Dec 2 23:34:30.641: INFO: hostexec-ip-172-20-33-254.us-west-2.compute.internal-89cst started at 2022-12-02 23:29:51 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:30.641: INFO: Container agnhost-container ready: true, restart count 0 Dec 2 23:34:30.641: INFO: pod-subpath-test-preprovisionedpv-dx4c started at 2022-12-02 23:30:04 +0000 UTC (0+2 container statuses recorded) Dec 2 23:34:30.641: INFO: Container test-container-subpath-preprovisionedpv-dx4c ready: false, restart count 0 Dec 2 23:34:30.641: INFO: Container test-container-volume-preprovisionedpv-dx4c ready: false, restart count 0 Dec 2 23:34:30.641: INFO: coredns-5fcc7b6498-8nvj5 started at 2022-12-02 23:17:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:30.641: INFO: Container coredns ready: true, restart count 0 Dec 2 23:34:30.641: INFO: hostexec-ip-172-20-33-254.us-west-2.compute.internal-w7cc4 started at 2022-12-02 23:29:31 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:30.641: INFO: Container agnhost-container ready: true, restart count 0 Dec 2 23:34:30.641: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-d4f7q started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:30.641: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:34:30.641: INFO: pod-de0df811-917e-4382-a988-00a4d3f60636 started at 2022-12-02 23:29:55 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:30.641: INFO: Container write-pod ready: false, restart count 0 Dec 2 23:34:30.641: INFO: hostexec-ip-172-20-33-254.us-west-2.compute.internal-c75lz started at 2022-12-02 23:30:36 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:30.641: INFO: Container agnhost-container ready: true, restart count 0 Dec 2 23:34:30.641: INFO: coredns-autoscaler-6658b4bf85-4zgd2 started at 2022-12-02 23:17:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:30.641: INFO: Container autoscaler ready: true, restart count 0 Dec 2 23:34:30.641: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-9dq9t started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:30.641: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: false, restart count 0 Dec 2 23:34:30.641: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-t5msn started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:30.641: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:34:30.641: INFO: hostexec-ip-172-20-33-254.us-west-2.compute.internal-9lgp6 started at 2022-12-02 23:29:55 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:30.641: INFO: Container agnhost-container ready: true, restart count 0 Dec 2 23:34:30.641: INFO: pod-6287b838-7e39-4bff-9b2c-7278de9a6392 started at 2022-12-02 23:33:40 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:30.641: INFO: Container write-pod ready: false, restart count 0 Dec 2 23:34:30.641: INFO: test-rolling-update-with-lb-7db9cf5ff8-ssh9v started at 2022-12-02 23:27:40 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:30.641: INFO: Container agnhost ready: true, restart count 0 Dec 2 23:34:30.641: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-mtms5 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:30.641: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:34:30.641: INFO: netserver-0 started at 2022-12-02 23:29:40 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:30.641: INFO: Container webserver ready: true, restart count 0 Dec 2 23:34:30.641: INFO: pod-subpath-test-preprovisionedpv-h2jt started at 2022-12-02 23:30:49 +0000 UTC (1+2 container statuses recorded) Dec 2 23:34:30.641: INFO: Init container test-init-subpath-preprovisionedpv-h2jt ready: false, restart count 0 Dec 2 23:34:30.641: INFO: Container test-container-subpath-preprovisionedpv-h2jt ready: false, restart count 0 Dec 2 23:34:30.641: INFO: Container test-container-volume-preprovisionedpv-h2jt ready: false, restart count 0 Dec 2 23:34:30.642: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-svqb9 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:30.642: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:34:30.642: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-pt8v2 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:30.642: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: false, restart count 0 Dec 2 23:34:30.642: INFO: netserver-0 started at 2022-12-02 23:33:50 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:30.642: INFO: Container webserver ready: false, restart count 0 Dec 2 23:34:31.042: INFO: Latency metrics for node ip-172-20-33-254.us-west-2.compute.internal Dec 2 23:34:31.043: INFO: Logging node info for node ip-172-20-40-67.us-west-2.compute.internal Dec 2 23:34:31.108: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-40-67.us-west-2.compute.internal 0a5fe428-9a11-4bd2-96f1-21d4d188f80f 28496 0 2022-12-02 23:15:37 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-40-67.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/control-plane: node-role.kubernetes.io/master: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:us-west-2a topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0725cfbb3e93e664c"} io.cilium.network.ipv4-cilium-host:172.20.59.109 io.cilium.network.ipv4-health-ip:172.20.51.231 io.cilium.network.ipv4-pod-cidr:100.96.0.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-12-02 23:15:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {protokube Update v1 2022-12-02 23:16:01 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kops-controller Update v1 2022-12-02 23:16:07 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/master":{}}}} } {kube-controller-manager Update v1 2022-12-02 23:16:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {cilium-agent Update v1 2022-12-02 23:17:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-12-02 23:17:36 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-12-02 23:17:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-0725cfbb3e93e664c,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892301824 0} {<nil>} 3801076Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787444224 0} {<nil>} 3698676Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-02 23:17:36 +0000 UTC,LastTransitionTime:2022-12-02 23:17:36 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-02 23:33:27 +0000 UTC,LastTransitionTime:2022-12-02 23:15:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-02 23:33:27 +0000 UTC,LastTransitionTime:2022-12-02 23:15:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-02 23:33:27 +0000 UTC,LastTransitionTime:2022-12-02 23:15:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-02 23:33:27 +0000 UTC,LastTransitionTime:2022-12-02 23:16:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.40.67,},NodeAddress{Type:ExternalIP,Address:34.213.81.56,},NodeAddress{Type:Hostname,Address:ip-172-20-40-67.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-40-67.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-34-213-81-56.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2bdc536f1fb98cbe397162835bf7b5,SystemUUID:ec2bdc53-6f1f-b98c-be39-7162835bf7b5,BootID:80f23ad2-0f99-46af-8080-253547cd7440,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.13,KubeletVersion:v1.22.16,KubeProxyVersion:v1.22.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:a91fdaf9b988943a9c73d422348c2383c08dfc2566d4124a39a1b3d785018720 registry.k8s.io/etcdadm/etcd-manager:v3.0.20220831],SizeBytes:216515768,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:160382894,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.22.16],SizeBytes:129618394,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.22.16],SizeBytes:123306305,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.22.16],SizeBytes:105446599,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.22.16],SizeBytes:53956920,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-alpha.2],SizeBytes:42210956,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-alpha.2],SizeBytes:41463728,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:28956694,},ContainerImage{Names:[quay.io/cilium/operator@sha256:e2b26376a904190c73498e04bd5c1298a4c5239d50feab024074e4516381890f quay.io/cilium/operator:v1.11.11],SizeBytes:24003684,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-alpha.2],SizeBytes:4954596,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 2 23:34:31.108: INFO: Logging kubelet events for node ip-172-20-40-67.us-west-2.compute.internal Dec 2 23:34:31.175: INFO: Logging pods the kubelet thinks is on node ip-172-20-40-67.us-west-2.compute.internal Dec 2 23:34:31.254: INFO: ebs-csi-node-jt6f2 started at 2022-12-02 23:16:04 +0000 UTC (0+3 container statuses recorded) Dec 2 23:34:31.254: INFO: Container ebs-plugin ready: true, restart count 0 Dec 2 23:34:31.254: INFO: Container liveness-probe ready: true, restart count 0 Dec 2 23:34:31.254: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 2 23:34:31.254: INFO: cilium-t57cd started at 2022-12-02 23:16:04 +0000 UTC (1+1 container statuses recorded) Dec 2 23:34:31.254: INFO: Init container clean-cilium-state ready: true, restart count 0 Dec 2 23:34:31.254: INFO: Container cilium-agent ready: true, restart count 1 Dec 2 23:34:31.254: INFO: kops-controller-47skn started at 2022-12-02 23:16:04 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:31.254: INFO: Container kops-controller ready: true, restart count 0 Dec 2 23:34:31.254: INFO: dns-controller-5fb778d9d5-fln22 started at 2022-12-02 23:16:04 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:31.254: INFO: Container dns-controller ready: true, restart count 0 Dec 2 23:34:31.254: INFO: etcd-manager-main-ip-172-20-40-67.us-west-2.compute.internal started at 2022-12-02 23:14:53 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:31.254: INFO: Container etcd-manager ready: true, restart count 0 Dec 2 23:34:31.254: INFO: kube-controller-manager-ip-172-20-40-67.us-west-2.compute.internal started at 2022-12-02 23:14:53 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:31.254: INFO: Container kube-controller-manager ready: true, restart count 2 Dec 2 23:34:31.254: INFO: kube-scheduler-ip-172-20-40-67.us-west-2.compute.internal started at 2022-12-02 23:14:53 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:31.254: INFO: Container kube-scheduler ready: true, restart count 0 Dec 2 23:34:31.254: INFO: etcd-manager-events-ip-172-20-40-67.us-west-2.compute.internal started at 2022-12-02 23:14:53 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:31.254: INFO: Container etcd-manager ready: true, restart count 0 Dec 2 23:34:31.254: INFO: kube-apiserver-ip-172-20-40-67.us-west-2.compute.internal started at 2022-12-02 23:14:53 +0000 UTC (0+2 container statuses recorded) Dec 2 23:34:31.254: INFO: Container healthcheck ready: true, restart count 0 Dec 2 23:34:31.254: INFO: Container kube-apiserver ready: true, restart count 1 Dec 2 23:34:31.254: INFO: cilium-operator-587dd66f87-zmwpl started at 2022-12-02 23:16:04 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:31.254: INFO: Container cilium-operator ready: true, restart count 1 Dec 2 23:34:31.254: INFO: ebs-csi-controller-764b64d679-rnjp4 started at 2022-12-02 23:16:04 +0000 UTC (0+5 container statuses recorded) Dec 2 23:34:31.254: INFO: Container csi-attacher ready: true, restart count 0 Dec 2 23:34:31.254: INFO: Container csi-provisioner ready: true, restart count 0 Dec 2 23:34:31.254: INFO: Container csi-resizer ready: true, restart count 0 Dec 2 23:34:31.254: INFO: Container ebs-plugin ready: true, restart count 0 Dec 2 23:34:31.254: INFO: Container liveness-probe ready: true, restart count 0 Dec 2 23:34:31.529: INFO: Latency metrics for node ip-172-20-40-67.us-west-2.compute.internal Dec 2 23:34:31.529: INFO: Logging node info for node ip-172-20-41-32.us-west-2.compute.internal Dec 2 23:34:31.594: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-41-32.us-west-2.compute.internal ad6a9fcc-418f-4c1a-a9c7-ac1873b8a1ba 27549 0 2022-12-02 23:17:23 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-41-32.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:node mounted_volume_expand:mounted-volume-expand-6871 node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:ip-172-20-41-32.us-west-2.compute.internal topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-00d261efdd8c07a99"} io.cilium.network.ipv4-cilium-host:172.20.50.121 io.cilium.network.ipv4-health-ip:172.20.47.106 io.cilium.network.ipv4-pod-cidr:100.96.3.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2022-12-02 23:17:23 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-12-02 23:17:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2022-12-02 23:17:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {cilium-agent Update v1 2022-12-02 23:17:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-12-02 23:17:51 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {e2e.test Update v1 2022-12-02 23:29:34 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{},"f:mounted_volume_expand":{}}}} } {kubelet Update v1 2022-12-02 23:30:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2022-12-02 23:30:44 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-00d261efdd8c07a99,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-02 23:17:51 +0000 UTC,LastTransitionTime:2022-12-02 23:17:51 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-02 23:30:34 +0000 UTC,LastTransitionTime:2022-12-02 23:17:23 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-02 23:30:34 +0000 UTC,LastTransitionTime:2022-12-02 23:17:23 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-02 23:30:34 +0000 UTC,LastTransitionTime:2022-12-02 23:17:23 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-02 23:30:34 +0000 UTC,LastTransitionTime:2022-12-02 23:17:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.41.32,},NodeAddress{Type:ExternalIP,Address:35.88.26.86,},NodeAddress{Type:Hostname,Address:ip-172-20-41-32.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-41-32.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-88-26-86.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2624f500a45f29b52ed8b5d778f035,SystemUUID:ec2624f5-00a4-5f29-b52e-d8b5d778f035,BootID:b76bd51c-e57a-47b9-86f2-c1093a033e09,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.13,KubeletVersion:v1.22.16,KubeProxyVersion:v1.22.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:160382894,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:702a992280fb7c3303e84a5801acbb4c9c7fcf48cffe0e9c8be3f0c60f74cf89 k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.4],SizeBytes:112029652,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.22.16],SizeBytes:105446599,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:716d2f68314c5c4ddd5ecdb45183fcb4ed8019015982c1321571f863989b70b0 k8s.gcr.io/e2e-test-images/httpd:2.4.39-1],SizeBytes:41902332,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:b913fa234cc3473cfe16e937d106b455a7609f927f59031c81aca791e2689b50 k8s.gcr.io/e2e-test-images/httpd:2.4.38-1],SizeBytes:40765006,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:28956694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:1b7c978a792a8fa4e96244e8059bd71bb49b07e2e5a897fb0c867bdc6db20d5d k8s.gcr.io/sig-storage/livenessprobe:v2.3.0],SizeBytes:7933739,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:503b7abb89e57383eba61cc8a9cb0b495ea575c516108f7d972a6ff6e1ab3c9b k8s.gcr.io/e2e-test-images/nginx:1.14-1],SizeBytes:6979365,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac k8s.gcr.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:1ff6c18fbef2045af6b9c16bf034cc421a29027b800e4f9b68ae9b1cb3e9ae07 k8s.gcr.io/pause:3.5],SizeBytes:301416,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-01091924f688a5969],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-01091924f688a5969,DevicePath:,},},Config:nil,},} Dec 2 23:34:31.595: INFO: Logging kubelet events for node ip-172-20-41-32.us-west-2.compute.internal Dec 2 23:34:31.662: INFO: Logging pods the kubelet thinks is on node ip-172-20-41-32.us-west-2.compute.internal Dec 2 23:34:31.758: INFO: netserver-1 started at 2022-12-02 23:29:40 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:31.758: INFO: Container webserver ready: true, restart count 0 Dec 2 23:34:31.758: INFO: hostexec-ip-172-20-41-32.us-west-2.compute.internal-2zgq5 started at 2022-12-02 23:30:10 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:31.759: INFO: Container agnhost-container ready: true, restart count 0 Dec 2 23:34:31.759: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-wf5z9 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:31.759: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:34:31.759: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-gjgbh started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:31.759: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:34:31.759: INFO: ebs-csi-node-c27hl started at 2022-12-02 23:17:24 +0000 UTC (0+3 container statuses recorded) Dec 2 23:34:31.759: INFO: Container ebs-plugin ready: true, restart count 0 Dec 2 23:34:31.759: INFO: Container liveness-probe ready: true, restart count 0 Dec 2 23:34:31.759: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 2 23:34:31.759: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-dlbpk started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:31.759: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:34:31.759: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-kxvnd started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:31.759: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:34:31.759: INFO: pod-subpath-test-preprovisionedpv-7rdm started at 2022-12-02 23:30:21 +0000 UTC (2+2 container statuses recorded) Dec 2 23:34:31.759: INFO: Init container init-volume-preprovisionedpv-7rdm ready: false, restart count 0 Dec 2 23:34:31.759: INFO: Init container test-init-subpath-preprovisionedpv-7rdm ready: false, restart count 0 Dec 2 23:34:31.759: INFO: Container test-container-subpath-preprovisionedpv-7rdm ready: false, restart count 0 Dec 2 23:34:31.759: INFO: Container test-container-volume-preprovisionedpv-7rdm ready: false, restart count 0 Dec 2 23:34:31.759: INFO: test-container-pod started at 2022-12-02 23:34:12 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:31.759: INFO: Container webserver ready: false, restart count 0 Dec 2 23:34:31.759: INFO: ss2-0 started at 2022-12-02 23:33:41 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:31.759: INFO: Container webserver ready: false, restart count 0 Dec 2 23:34:31.759: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-dm2vc started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:31.759: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:34:31.759: INFO: hostexec-ip-172-20-41-32.us-west-2.compute.internal-rxl6t started at 2022-12-02 23:30:18 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:31.759: INFO: Container agnhost-container ready: true, restart count 0 Dec 2 23:34:31.759: INFO: pod-update-activedeadlineseconds-eb9d0032-e952-442d-a798-b657c80dcd03 started at 2022-12-02 23:29:43 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:31.759: INFO: Container nginx ready: false, restart count 0 Dec 2 23:34:31.759: INFO: pod-subpath-test-inlinevolume-z84n started at 2022-12-02 23:30:03 +0000 UTC (1+1 container statuses recorded) Dec 2 23:34:31.759: INFO: Init container init-volume-inlinevolume-z84n ready: false, restart count 0 Dec 2 23:34:31.759: INFO: Container test-container-subpath-inlinevolume-z84n ready: false, restart count 0 Dec 2 23:34:31.759: INFO: metadata-volume-da8bacd0-4c6b-4311-99e3-30df53b37d48 started at 2022-12-02 23:30:33 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:31.759: INFO: Container client-container ready: false, restart count 0 Dec 2 23:34:31.759: INFO: test-rolling-update-with-lb-5947fbdf64-6nw2f started at 2022-12-02 23:31:01 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:31.759: INFO: Container agnhost ready: false, restart count 0 Dec 2 23:34:31.759: INFO: host-test-container-pod started at 2022-12-02 23:34:12 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:31.759: INFO: Container agnhost-container ready: true, restart count 0 Dec 2 23:34:31.759: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-42p62 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:31.759: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:34:31.759: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-rq5lg started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:31.759: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:34:31.759: INFO: netserver-1 started at 2022-12-02 23:33:50 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:31.759: INFO: Container webserver ready: false, restart count 0 Dec 2 23:34:31.759: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-79x59 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:31.759: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:34:31.759: INFO: pod-55255ec9-bf45-4208-865d-6ef51afe9599 started at 2022-12-02 23:30:30 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:31.759: INFO: Container write-pod ready: false, restart count 0 Dec 2 23:34:31.759: INFO: pod-1 started at 2022-12-02 23:31:10 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:31.759: INFO: Container donothing ready: false, restart count 0 Dec 2 23:34:31.759: INFO: rc-test-4h8d6 started at 2022-12-02 23:33:21 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:31.759: INFO: Container rc-test ready: false, restart count 0 Dec 2 23:34:31.759: INFO: test-rolling-update-with-lb-7db9cf5ff8-grw6v started at 2022-12-02 23:27:40 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:31.759: INFO: Container agnhost ready: true, restart count 0 Dec 2 23:34:31.759: INFO: local-injector started at 2022-12-02 23:30:36 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:31.759: INFO: Container local-injector ready: false, restart count 0 Dec 2 23:34:31.759: INFO: cilium-m9r5q started at 2022-12-02 23:17:24 +0000 UTC (1+1 container statuses recorded) Dec 2 23:34:31.759: INFO: Init container clean-cilium-state ready: true, restart count 0 Dec 2 23:34:31.759: INFO: Container cilium-agent ready: true, restart count 0 Dec 2 23:34:31.759: INFO: run-test started at 2022-12-02 23:32:29 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:31.759: INFO: Container run-test ready: false, restart count 0 Dec 2 23:34:31.759: INFO: successful-jobs-history-limit-27833734-6hlrt started at 2022-12-02 23:34:00 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:31.759: INFO: Container c ready: false, restart count 0 Dec 2 23:34:31.759: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-qgcxv started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:31.759: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:34:31.759: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-44b5z started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:31.759: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:34:32.073: INFO: Latency metrics for node ip-172-20-41-32.us-west-2.compute.internal Dec 2 23:34:32.075: INFO: Logging node info for node ip-172-20-43-150.us-west-2.compute.internal Dec 2 23:34:32.140: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-43-150.us-west-2.compute.internal 47bb1581-dcdc-4edf-b2c4-109aedb2f5bd 28179 0 2022-12-02 23:17:23 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-43-150.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:ip-172-20-43-150.us-west-2.compute.internal topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-1597":"csi-mock-csi-mock-volumes-1597","ebs.csi.aws.com":"i-0e2e5350f5754b178"} io.cilium.network.ipv4-cilium-host:172.20.35.108 io.cilium.network.ipv4-health-ip:172.20.34.31 io.cilium.network.ipv4-pod-cidr:100.96.4.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2022-12-02 23:17:23 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-12-02 23:17:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2022-12-02 23:17:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {cilium-agent Update v1 2022-12-02 23:17:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-12-02 23:17:51 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {e2e.test Update v1 2022-12-02 23:29:34 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2022-12-02 23:30:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-0e2e5350f5754b178,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-02 23:17:51 +0000 UTC,LastTransitionTime:2022-12-02 23:17:51 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-02 23:30:54 +0000 UTC,LastTransitionTime:2022-12-02 23:17:23 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-02 23:30:54 +0000 UTC,LastTransitionTime:2022-12-02 23:17:23 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-02 23:30:54 +0000 UTC,LastTransitionTime:2022-12-02 23:17:23 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-02 23:30:54 +0000 UTC,LastTransitionTime:2022-12-02 23:17:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.43.150,},NodeAddress{Type:ExternalIP,Address:54.184.249.63,},NodeAddress{Type:Hostname,Address:ip-172-20-43-150.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-43-150.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-184-249-63.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23a85d6d7b80ff12e03e51b1effc11,SystemUUID:ec23a85d-6d7b-80ff-12e0-3e51b1effc11,BootID:72904f56-1058-4b24-85d2-c465d1149ad1,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.13,KubeletVersion:v1.22.16,KubeProxyVersion:v1.22.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:160382894,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:702a992280fb7c3303e84a5801acbb4c9c7fcf48cffe0e9c8be3f0c60f74cf89 k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.4],SizeBytes:112029652,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.22.16],SizeBytes:105446599,},ContainerImage{Names:[docker.io/library/nginx@sha256:e209ac2f37c70c1e0e9873a5f7231e91dcd83fdf1178d8ed36c2ec09974210ba docker.io/library/nginx:latest],SizeBytes:56833911,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:1f36a24cfb5e0c3f725d7565a867c2384282fcbeccc77b07b423c9da95763a9a k8s.gcr.io/e2e-test-images/nautilus:1.4],SizeBytes:49230179,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:716d2f68314c5c4ddd5ecdb45183fcb4ed8019015982c1321571f863989b70b0 k8s.gcr.io/e2e-test-images/httpd:2.4.39-1],SizeBytes:41902332,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:b913fa234cc3473cfe16e937d106b455a7609f927f59031c81aca791e2689b50 k8s.gcr.io/e2e-test-images/httpd:2.4.38-1],SizeBytes:40765006,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:28956694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a k8s.gcr.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf k8s.gcr.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:1b7c978a792a8fa4e96244e8059bd71bb49b07e2e5a897fb0c867bdc6db20d5d k8s.gcr.io/sig-storage/livenessprobe:v2.3.0],SizeBytes:7933739,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:503b7abb89e57383eba61cc8a9cb0b495ea575c516108f7d972a6ff6e1ab3c9b k8s.gcr.io/e2e-test-images/nginx:1.14-1],SizeBytes:6979365,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac k8s.gcr.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:1ff6c18fbef2045af6b9c16bf034cc421a29027b800e4f9b68ae9b1cb3e9ae07 k8s.gcr.io/pause:3.5],SizeBytes:301416,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 2 23:34:32.141: INFO: Logging kubelet events for node ip-172-20-43-150.us-west-2.compute.internal Dec 2 23:34:32.208: INFO: Logging pods the kubelet thinks is on node ip-172-20-43-150.us-west-2.compute.internal Dec 2 23:34:32.279: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-wqgdj started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:32.280: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:34:32.280: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-z5d7v started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:32.280: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:34:32.280: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-qnr57 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:32.280: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:34:32.280: INFO: netserver-2 started at 2022-12-02 23:33:50 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:32.280: INFO: Container webserver ready: false, restart count 0 Dec 2 23:34:32.280: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-s5867 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:32.280: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:34:32.280: INFO: downward-api-c7938691-34b6-4f97-ac86-c3ed7165bc89 started at 2022-12-02 23:32:02 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:32.280: INFO: Container dapi-container ready: false, restart count 0 Dec 2 23:34:32.280: INFO: csi-mockplugin-resizer-0 started at 2022-12-02 23:30:13 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:32.280: INFO: Container csi-resizer ready: true, restart count 0 Dec 2 23:34:32.280: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-5jb9p started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:32.280: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:34:32.280: INFO: pod-2 started at 2022-12-02 23:31:10 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:32.280: INFO: Container donothing ready: false, restart count 0 Dec 2 23:34:32.280: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-kj74m started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:32.280: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: false, restart count 0 Dec 2 23:34:32.280: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-g66v4 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:32.280: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:34:32.280: INFO: pod-a490ced8-ce1a-4203-a10b-1b9143f1e598 started at 2022-12-02 23:32:12 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:32.280: INFO: Container write-pod ready: false, restart count 0 Dec 2 23:34:32.280: INFO: pvc-volume-tester-thkpc started at 2022-12-02 23:32:44 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:32.280: INFO: Container volume-tester ready: false, restart count 0 Dec 2 23:34:32.280: INFO: cilium-7h427 started at 2022-12-02 23:17:24 +0000 UTC (1+1 container statuses recorded) Dec 2 23:34:32.280: INFO: Init container clean-cilium-state ready: true, restart count 0 Dec 2 23:34:32.280: INFO: Container cilium-agent ready: true, restart count 0 Dec 2 23:34:32.280: INFO: pod-0 started at 2022-12-02 23:31:10 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:32.280: INFO: Container donothing ready: false, restart count 0 Dec 2 23:34:32.280: INFO: hostexec-ip-172-20-43-150.us-west-2.compute.internal-lmqmb started at 2022-12-02 23:31:33 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:32.280: INFO: Container agnhost-container ready: true, restart count 0 Dec 2 23:34:32.280: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-8bg6n started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:32.280: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:34:32.280: INFO: csi-mockplugin-0 started at 2022-12-02 23:30:13 +0000 UTC (0+3 container statuses recorded) Dec 2 23:34:32.280: INFO: Container csi-provisioner ready: true, restart count 0 Dec 2 23:34:32.280: INFO: Container driver-registrar ready: true, restart count 0 Dec 2 23:34:32.280: INFO: Container mock ready: true, restart count 0 Dec 2 23:34:32.280: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-ksvcz started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:32.280: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:34:32.280: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-pm84g started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:32.280: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: false, restart count 0 Dec 2 23:34:32.280: INFO: netserver-2 started at 2022-12-02 23:29:40 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:32.280: INFO: Container webserver ready: true, restart count 0 Dec 2 23:34:32.280: INFO: ebs-csi-node-8qrwx started at 2022-12-02 23:17:24 +0000 UTC (0+3 container statuses recorded) Dec 2 23:34:32.280: INFO: Container ebs-plugin ready: true, restart count 0 Dec 2 23:34:32.280: INFO: Container liveness-probe ready: true, restart count 0 Dec 2 23:34:32.280: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 2 23:34:32.594: INFO: Latency metrics for node ip-172-20-43-150.us-west-2.compute.internal Dec 2 23:34:32.595: INFO: Logging node info for node ip-172-20-48-5.us-west-2.compute.internal Dec 2 23:34:32.660: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-48-5.us-west-2.compute.internal 6342e9b6-e818-4fbf-aae7-8be176fd4ec1 27793 0 2022-12-02 23:17:21 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-48-5.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:ip-172-20-48-5.us-west-2.compute.internal topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-volumemode-2041":"ip-172-20-48-5.us-west-2.compute.internal","ebs.csi.aws.com":"i-0093900b92d415e84"} io.cilium.network.ipv4-cilium-host:172.20.42.98 io.cilium.network.ipv4-health-ip:172.20.44.82 io.cilium.network.ipv4-pod-cidr:100.96.2.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-12-02 23:17:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2022-12-02 23:17:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2022-12-02 23:17:22 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {cilium-agent Update v1 2022-12-02 23:17:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-12-02 23:17:52 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {e2e.test Update v1 2022-12-02 23:29:34 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2022-12-02 23:31:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {kube-controller-manager Update v1 2022-12-02 23:31:10 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-0093900b92d415e84,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-02 23:17:52 +0000 UTC,LastTransitionTime:2022-12-02 23:17:52 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-02 23:31:03 +0000 UTC,LastTransitionTime:2022-12-02 23:17:21 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-02 23:31:03 +0000 UTC,LastTransitionTime:2022-12-02 23:17:21 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-02 23:31:03 +0000 UTC,LastTransitionTime:2022-12-02 23:17:21 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-02 23:31:03 +0000 UTC,LastTransitionTime:2022-12-02 23:17:42 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.48.5,},NodeAddress{Type:ExternalIP,Address:34.213.188.181,},NodeAddress{Type:Hostname,Address:ip-172-20-48-5.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-48-5.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-34-213-188-181.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2ecd9e359fbd979ba14c48724d474b,SystemUUID:ec2ecd9e-359f-bd97-9ba1-4c48724d474b,BootID:3d1b1479-a710-49bb-96b3-2764890e8166,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.13,KubeletVersion:v1.22.16,KubeProxyVersion:v1.22.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:160382894,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.22.16],SizeBytes:105446599,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:716d2f68314c5c4ddd5ecdb45183fcb4ed8019015982c1321571f863989b70b0 k8s.gcr.io/e2e-test-images/httpd:2.4.39-1],SizeBytes:41902332,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:b913fa234cc3473cfe16e937d106b455a7609f927f59031c81aca791e2689b50 k8s.gcr.io/e2e-test-images/httpd:2.4.38-1],SizeBytes:40765006,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:28956694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a k8s.gcr.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:1b7c978a792a8fa4e96244e8059bd71bb49b07e2e5a897fb0c867bdc6db20d5d k8s.gcr.io/sig-storage/livenessprobe:v2.3.0],SizeBytes:7933739,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:503b7abb89e57383eba61cc8a9cb0b495ea575c516108f7d972a6ff6e1ab3c9b k8s.gcr.io/e2e-test-images/nginx:1.14-1],SizeBytes:6979365,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:1ff6c18fbef2045af6b9c16bf034cc421a29027b800e4f9b68ae9b1cb3e9ae07 k8s.gcr.io/pause:3.5],SizeBytes:301416,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-volumemode-2041^654737c8-7299-11ed-af0e-124cde60a1d6,DevicePath:,},},Config:nil,},} Dec 2 23:34:32.660: INFO: Logging kubelet events for node ip-172-20-48-5.us-west-2.compute.internal Dec 2 23:34:32.727: INFO: Logging pods the kubelet thinks is on node ip-172-20-48-5.us-west-2.compute.internal Dec 2 23:34:32.798: INFO: netserver-3 started at 2022-12-02 23:29:40 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:32.798: INFO: Container webserver ready: true, restart count 0 Dec 2 23:34:32.798: INFO: csi-hostpathplugin-0 started at 2022-12-02 23:30:42 +0000 UTC (0+7 container statuses recorded) Dec 2 23:34:32.798: INFO: Container csi-attacher ready: true, restart count 0 Dec 2 23:34:32.798: INFO: Container csi-provisioner ready: true, restart count 0 Dec 2 23:34:32.798: INFO: Container csi-resizer ready: true, restart count 0 Dec 2 23:34:32.798: INFO: Container csi-snapshotter ready: true, restart count 0 Dec 2 23:34:32.798: INFO: Container hostpath ready: true, restart count 0 Dec 2 23:34:32.798: INFO: Container liveness-probe ready: true, restart count 0 Dec 2 23:34:32.798: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 2 23:34:32.798: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-59flm started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:32.798: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:34:32.798: INFO: pod-6caddea1-9036-4c6c-99f5-902dff5394fb started at 2022-12-02 23:29:34 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:32.798: INFO: Container write-pod ready: true, restart count 0 Dec 2 23:34:32.798: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-krv9s started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:32.798: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:34:32.798: INFO: hostexec-ip-172-20-48-5.us-west-2.compute.internal-9lt2d started at 2022-12-02 23:29:31 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:32.798: INFO: Container agnhost-container ready: true, restart count 0 Dec 2 23:34:32.798: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-7rvfw started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:32.798: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:34:32.798: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-wqvtr started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:32.798: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: false, restart count 0 Dec 2 23:34:32.798: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-9mx44 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:32.798: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:34:32.798: INFO: pod-8c4bd487-8f0f-44e5-9833-0c353d46bea8 started at 2022-12-02 23:31:22 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:32.798: INFO: Container write-pod ready: false, restart count 0 Dec 2 23:34:32.798: INFO: pod-075435ca-217c-4ec4-a982-6a7a5eb325f4 started at 2022-12-02 23:31:09 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:32.798: INFO: Container write-pod ready: false, restart count 0 Dec 2 23:34:32.798: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-qxp67 started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:32.798: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:34:32.798: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-xctkw started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:32.798: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:34:32.798: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-ttc6s started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:32.798: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: false, restart count 0 Dec 2 23:34:32.798: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-6nvlf started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:32.798: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: true, restart count 0 Dec 2 23:34:32.798: INFO: ebs-csi-node-bcx5m started at 2022-12-02 23:17:22 +0000 UTC (0+3 container statuses recorded) Dec 2 23:34:32.798: INFO: Container ebs-plugin ready: true, restart count 0 Dec 2 23:34:32.798: INFO: Container liveness-probe ready: true, restart count 0 Dec 2 23:34:32.798: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 2 23:34:32.798: INFO: coredns-5fcc7b6498-clxp8 started at 2022-12-02 23:17:58 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:32.798: INFO: Container coredns ready: true, restart count 0 Dec 2 23:34:32.798: INFO: cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6-cdm2p started at 2022-12-02 23:29:35 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:32.798: INFO: Container cleanup40-4073f798-48fc-4f5c-b92e-0059fa2c5db6 ready: false, restart count 0 Dec 2 23:34:32.798: INFO: netserver-3 started at 2022-12-02 23:33:50 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:32.798: INFO: Container webserver ready: false, restart count 0 Dec 2 23:34:32.798: INFO: cilium-ftssb started at 2022-12-02 23:17:22 +0000 UTC (1+1 container statuses recorded) Dec 2 23:34:32.798: INFO: Init container clean-cilium-state ready: true, restart count 0 Dec 2 23:34:32.798: INFO: Container cilium-agent ready: true, restart count 0 Dec 2 23:34:32.798: INFO: test-rolling-update-with-lb-7db9cf5ff8-rqg95 started at 2022-12-02 23:27:40 +0000 UTC (0+1 container statuses recorded) Dec 2 23:34:32.798: INFO: Container agnhost ready: true, restart count 0 Dec 2 23:34:33.117: INFO: Latency metrics for node ip-172-20-48-5.us-west-2.compute.internal Dec 2 23:34:33.117: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "kubectl-5907" for this suite.
Filter through log files
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-network\]\sNetworking\sGranular\sChecks\:\sPods\sshould\sfunction\sfor\snode\-pod\scommunication\:\shttp\s\[LinuxOnly\]\s\[NodeConformance\]\s\[Conformance\]$'
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630 Dec 2 23:38:50.751: Unexpected error: <*errors.errorString | 0xc000340280>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/network/utils.go:858
[BeforeEach] [sig-network] Networking /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Dec 2 23:33:49.858: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename pod-network-test �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [It] should function for node-pod communication: http [LinuxOnly] [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630 �[1mSTEP�[0m: Performing setup for networking test in namespace pod-network-test-6577 �[1mSTEP�[0m: creating a selector �[1mSTEP�[0m: Creating the service pods in kubernetes Dec 2 23:33:50.180: INFO: Waiting up to 10m0s for all (but 0) nodes to be schedulable Dec 2 23:33:50.621: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:33:52.684: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:33:54.684: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:33:56.683: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:33:58.684: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:34:00.684: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:34:02.684: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:34:04.684: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:34:06.683: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:34:08.684: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:34:10.683: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:34:12.684: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:34:14.684: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:34:16.684: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:34:18.684: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:34:20.685: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:34:22.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:34:24.685: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:34:26.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:34:28.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:34:30.687: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:34:32.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:34:34.685: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:34:36.687: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:34:38.685: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:34:40.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:34:42.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:34:44.685: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:34:46.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:34:48.685: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:34:50.685: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:34:52.687: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:34:54.685: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:34:56.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:34:58.685: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:35:00.685: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:35:02.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:35:04.685: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:35:06.685: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:35:08.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:35:10.687: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:35:12.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:35:14.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:35:16.687: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:35:18.685: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:35:20.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:35:22.685: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:35:24.685: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:35:26.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:35:28.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:35:30.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:35:32.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:35:34.687: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:35:36.687: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:35:38.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:35:40.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:35:42.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:35:44.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:35:46.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:35:48.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:35:50.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:35:52.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:35:54.685: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:35:56.685: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:35:58.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:36:00.685: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:36:02.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:36:04.685: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:36:06.687: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:36:08.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:36:10.687: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:36:12.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:36:14.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:36:16.687: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:36:18.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:36:20.685: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:36:22.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:36:24.689: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:36:26.687: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:36:28.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:36:30.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:36:32.688: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:36:34.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:36:36.685: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:36:38.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:36:40.687: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:36:42.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:36:44.685: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:36:46.685: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:36:48.685: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:36:50.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:36:52.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:36:54.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:36:56.687: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:36:58.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:37:00.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:37:02.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:37:04.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:37:06.687: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:37:08.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:37:10.687: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:37:12.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:37:14.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:37:16.685: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:37:18.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:37:20.687: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:37:22.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:37:24.685: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:37:26.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:37:28.687: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:37:30.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:37:32.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:37:34.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:37:36.687: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:37:38.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:37:40.685: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:37:42.685: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:37:44.685: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:37:46.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:37:48.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:37:50.685: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:37:52.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:37:54.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:37:56.685: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:37:58.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:38:00.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:38:02.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:38:04.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:38:06.687: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:38:08.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:38:10.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:38:12.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:38:14.687: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:38:16.685: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:38:18.687: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:38:20.687: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:38:22.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:38:24.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:38:26.689: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:38:28.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:38:30.687: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:38:32.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:38:34.685: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:38:36.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:38:38.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:38:40.687: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:38:42.687: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:38:44.685: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:38:46.686: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:38:48.685: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:38:50.685: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:38:50.750: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Dec 2 23:38:50.750: FAIL: Unexpected error: <*errors.errorString | 0xc000340280>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework/network.(*NetworkingTestConfig).createNetProxyPods(0xc000c080e0, 0x70379bc, 0x9, 0xc0039d0360, 0x0, 0xc003bbe8d0, 0x2d) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/network/utils.go:858 +0x4cd k8s.io/kubernetes/test/e2e/framework/network.(*NetworkingTestConfig).setupCore(0xc000c080e0, 0xc0039d0360) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/network/utils.go:760 +0x7b k8s.io/kubernetes/test/e2e/framework/network.NewCoreNetworkingTestConfig(0xc0008ca000, 0x1, 0xb9) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/network/utils.go:142 +0x13c k8s.io/kubernetes/test/e2e/common/network.glob..func1.1.4() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/network/networking.go:104 +0x45 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc000a86180) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x36c k8s.io/kubernetes/test/e2e.TestE2E(0xc000a86180) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:136 +0x2b testing.tRunner(0xc000a86180, 0x729c8b8) /usr/local/go/src/testing/testing.go:1203 +0xe5 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1248 +0x2b3 [AfterEach] [sig-network] Networking /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "pod-network-test-6577". �[1mSTEP�[0m: Found 44 events. Dec 2 23:38:50.818: INFO: At 2022-12-02 23:33:50 +0000 UTC - event for netserver-0: {kubelet ip-172-20-33-254.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "2681535fe4c62dd1f0dd686e0d729b029019a78ab296338da3c6c5e9d177c494": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:50.818: INFO: At 2022-12-02 23:33:50 +0000 UTC - event for netserver-0: {default-scheduler } Scheduled: Successfully assigned pod-network-test-6577/netserver-0 to ip-172-20-33-254.us-west-2.compute.internal Dec 2 23:38:50.818: INFO: At 2022-12-02 23:33:50 +0000 UTC - event for netserver-1: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "cd11937011662cf1e8e63d8493277d5f73706a751937191ed1040aa209b21cea": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:50.818: INFO: At 2022-12-02 23:33:50 +0000 UTC - event for netserver-1: {default-scheduler } Scheduled: Successfully assigned pod-network-test-6577/netserver-1 to ip-172-20-41-32.us-west-2.compute.internal Dec 2 23:38:50.818: INFO: At 2022-12-02 23:33:50 +0000 UTC - event for netserver-2: {kubelet ip-172-20-43-150.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ae8d21a46637efe794e8a0f85cf1d37b671790dc911a2ef55dd753bbc30418de": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:50.818: INFO: At 2022-12-02 23:33:50 +0000 UTC - event for netserver-2: {default-scheduler } Scheduled: Successfully assigned pod-network-test-6577/netserver-2 to ip-172-20-43-150.us-west-2.compute.internal Dec 2 23:38:50.818: INFO: At 2022-12-02 23:33:50 +0000 UTC - event for netserver-3: {default-scheduler } Scheduled: Successfully assigned pod-network-test-6577/netserver-3 to ip-172-20-48-5.us-west-2.compute.internal Dec 2 23:38:50.818: INFO: At 2022-12-02 23:33:50 +0000 UTC - event for netserver-3: {kubelet ip-172-20-48-5.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "eac3bc4296b01039c9bbb4ea9b43b3633e2f53adf072b4703c595db4e96f0c7c": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:50.818: INFO: At 2022-12-02 23:34:01 +0000 UTC - event for netserver-2: {kubelet ip-172-20-43-150.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "f4fa33b2c1f8f9a38e85ccd15eebfa9da60382f884cd48ac48b79796f35f54fe": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:50.818: INFO: At 2022-12-02 23:34:03 +0000 UTC - event for netserver-0: {kubelet ip-172-20-33-254.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "796d9a0cd76d4fcd5d2d0490b03a0865764cdfa257901d9fa66f04161b05ee3c": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:50.818: INFO: At 2022-12-02 23:34:03 +0000 UTC - event for netserver-1: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "691246d42c50d4325bfb6d7c559487037eceaa5ec9a1f1950e8aa89e6eeaab8c": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:50.818: INFO: At 2022-12-02 23:34:04 +0000 UTC - event for netserver-3: {kubelet ip-172-20-48-5.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ba5b17d69acfff263302623b060675f2ee4e356305fa9c8ca60d7e1fcf781bcc": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:50.818: INFO: At 2022-12-02 23:34:15 +0000 UTC - event for netserver-3: {kubelet ip-172-20-48-5.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "fbc2925df66b7344c6bc6b08d42530b3c885dddf833cf68b663f2c2fcb385486": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:50.818: INFO: At 2022-12-02 23:34:16 +0000 UTC - event for netserver-0: {kubelet ip-172-20-33-254.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "8f08e848fb7d801168d01c931211ac333337708dfd887dd3809019791f41859b": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:50.818: INFO: At 2022-12-02 23:34:16 +0000 UTC - event for netserver-2: {kubelet ip-172-20-43-150.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "6fd85b5036c2ac46241527ba08f84583c9b4fd6358c81bb4d84cec8119e2dd57": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:50.818: INFO: At 2022-12-02 23:34:17 +0000 UTC - event for netserver-1: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a40d87b6c2f9c3e33af0cf10e7213668616ed2d4dccbc8ad76801ce8462e20c3": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:50.818: INFO: At 2022-12-02 23:34:27 +0000 UTC - event for netserver-2: {kubelet ip-172-20-43-150.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "0477009cce4e92a3be070d480c7332c1df9a7ce3ddeaad470f47538bc226fc7d": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:50.818: INFO: At 2022-12-02 23:34:28 +0000 UTC - event for netserver-0: {kubelet ip-172-20-33-254.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "c1185900b103207952e317fa3e4a88f32cbb11b296e64f7b9ae4d951cc8c2a51": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:50.818: INFO: At 2022-12-02 23:34:28 +0000 UTC - event for netserver-3: {kubelet ip-172-20-48-5.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "106c25205df7b5e348e32c45a9adf0f9517332917982bff1db824930bebb2fb5": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:50.818: INFO: At 2022-12-02 23:34:31 +0000 UTC - event for netserver-1: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "66b4f55361dbf9c5f507bc30bdc2fd1487bf4b24d84bc729ca8808dbed2cb823": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:50.818: INFO: At 2022-12-02 23:34:38 +0000 UTC - event for netserver-2: {kubelet ip-172-20-43-150.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "40286fbec4c366cacfe245c0ca11c041a6a2c6caa7eee7b515359cbb426c9dc1": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:50.818: INFO: At 2022-12-02 23:34:42 +0000 UTC - event for netserver-3: {kubelet ip-172-20-48-5.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "31bbf02f7319e9912de7adee05aba116c4b08aae190deec6f9ee53aa12e9e1ec": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:50.818: INFO: At 2022-12-02 23:34:43 +0000 UTC - event for netserver-0: {kubelet ip-172-20-33-254.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "efd509263e733916187e16757d208e23e7736c515461692c42d676d77a5d41d2": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:50.818: INFO: At 2022-12-02 23:34:46 +0000 UTC - event for netserver-1: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "f0737df5afcebd33d3737378f8098d658d0ef2ce7abc7bdd116350a54521b793": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:50.818: INFO: At 2022-12-02 23:34:50 +0000 UTC - event for netserver-2: {kubelet ip-172-20-43-150.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a251d77503790313f890e3fae48ccde89245a391d5ff3159ac826fa9119ea2aa": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:50.818: INFO: At 2022-12-02 23:34:54 +0000 UTC - event for netserver-0: {kubelet ip-172-20-33-254.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "49c0ede67e8bd574845bb3cc92995fa0bb4bdcaa96126e227b3f1f1d610eb01d": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:50.818: INFO: At 2022-12-02 23:34:57 +0000 UTC - event for netserver-3: {kubelet ip-172-20-48-5.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d7965c34e53a6a09715848b0733ed8c46a2a1f1d6509246e36f09a5f5bff595d": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:50.818: INFO: At 2022-12-02 23:34:58 +0000 UTC - event for netserver-1: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "c14df5e650756e1ac2a651c4e71dae01dce23204fdeff66d33161d630a3eb56c": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:50.818: INFO: At 2022-12-02 23:35:03 +0000 UTC - event for netserver-2: {kubelet ip-172-20-43-150.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "203401896a5fe68bbc97e2612fbfdf4a58ca7310d65d97622a61b129d67edc41": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:50.818: INFO: At 2022-12-02 23:35:07 +0000 UTC - event for netserver-0: {kubelet ip-172-20-33-254.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "1582608682aa106a737684b3180e1c4099178f78db03f0bc19059fef68ec1091": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:50.818: INFO: At 2022-12-02 23:35:09 +0000 UTC - event for netserver-1: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "393f4a0cc582cf73d1478d2406862d78f5d03d723cb30dde13829ce295d30302": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:50.818: INFO: At 2022-12-02 23:35:09 +0000 UTC - event for netserver-3: {kubelet ip-172-20-48-5.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "41d3c1aafd8b837a305324538c1dd8197ffe0ca2b9672efcd4381df91676f0b7": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:50.818: INFO: At 2022-12-02 23:35:17 +0000 UTC - event for netserver-2: {kubelet ip-172-20-43-150.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "747bd37222bda4b86116714c4b67dd6613dd4631ab597ccfe18b4621313339fa": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:50.818: INFO: At 2022-12-02 23:35:18 +0000 UTC - event for netserver-0: {kubelet ip-172-20-33-254.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "89114b0845983a69568bc28a8e48f70c0f67c0a6853d720f97071c201362feb8": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:50.818: INFO: At 2022-12-02 23:35:22 +0000 UTC - event for netserver-3: {kubelet ip-172-20-48-5.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "c0902835a872498d69bff292a86121ec79ea742797e7504549a6951782dad795": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:50.818: INFO: At 2022-12-02 23:35:23 +0000 UTC - event for netserver-1: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ca39eeb229814de143652e12c9964c72d063179064effe0180f553d4752f4e6e": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:50.818: INFO: At 2022-12-02 23:35:29 +0000 UTC - event for netserver-0: {kubelet ip-172-20-33-254.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "49ad3e64cb3d3b78d1750d90c31ee90ca3ff371eb24210e320d0b658ea6da43d": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:50.818: INFO: At 2022-12-02 23:35:31 +0000 UTC - event for netserver-2: {kubelet ip-172-20-43-150.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "2c1530908dcd17426eaf91c17de4e03327dab8bb1757aefa6c6c8425ff48924e": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:50.818: INFO: At 2022-12-02 23:35:35 +0000 UTC - event for netserver-3: {kubelet ip-172-20-48-5.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "0ee8ed28353910eb83ec800da5ad9b9a01af2c81c9d2de7da208b53656ab0a37": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:50.818: INFO: At 2022-12-02 23:35:37 +0000 UTC - event for netserver-1: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "77c1be4e46d53fb7f9e50a1655ab9951f40c35b3c392fdaa28f9fe7aae42a284": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:50.818: INFO: At 2022-12-02 23:35:42 +0000 UTC - event for netserver-0: {kubelet ip-172-20-33-254.us-west-2.compute.internal} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a153e59ae477a6025a2bf48b346ae35c45f339588a11f64c26a971fbfaadc86d": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:50.818: INFO: At 2022-12-02 23:35:42 +0000 UTC - event for netserver-2: {kubelet ip-172-20-43-150.us-west-2.compute.internal} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "75704f6c3a731cca94edf5cd54adc9ee16615b98bc6acb91a4f9d4af6928a8c5": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:50.818: INFO: At 2022-12-02 23:35:49 +0000 UTC - event for netserver-3: {kubelet ip-172-20-48-5.us-west-2.compute.internal} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "016331069f1b1da4bfe3dec5da8733c23f8738eb2616df7c462ccdf2d7610317": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:50.818: INFO: At 2022-12-02 23:35:51 +0000 UTC - event for netserver-1: {kubelet ip-172-20-41-32.us-west-2.compute.internal} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d5aa390acdac531e665be3baa4aa1ba6d45f93bda4b36dbbd97f034d32280985": unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 2 23:38:50.883: INFO: POD NODE PHASE GRACE CONDITIONS Dec 2 23:38:50.883: INFO: netserver-0 ip-172-20-33-254.us-west-2.compute.internal Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:33:50 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:33:50 +0000 UTC ContainersNotReady containers with unready status: [webserver]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:33:50 +0000 UTC ContainersNotReady containers with unready status: [webserver]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:33:50 +0000 UTC }] Dec 2 23:38:50.883: INFO: netserver-1 ip-172-20-41-32.us-west-2.compute.internal Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:33:50 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:33:50 +0000 UTC ContainersNotReady containers with unready status: [webserver]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:33:50 +0000 UTC ContainersNotReady containers with unready status: [webserver]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:33:50 +0000 UTC }] Dec 2 23:38:50.883: INFO: netserver-2 ip-172-20-43-150.us-west-2.compute.internal Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:33:50 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:33:50 +0000 UTC ContainersNotReady containers with unready status: [webserver]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:33:50 +0000 UTC ContainersNotReady containers with unready status: [webserver]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:33:50 +0000 UTC }] Dec 2 23:38:50.883: INFO: netserver-3 ip-172-20-48-5.us-west-2.compute.internal Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:33:50 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:33:50 +0000 UTC ContainersNotReady containers with unready status: [webserver]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:33:50 +0000 UTC ContainersNotReady containers with unready status: [webserver]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-02 23:33:50 +0000 UTC }] Dec 2 23:38:50.884: INFO: Dec 2 23:38:50.948: INFO: Logging node info for node ip-172-20-33-254.us-west-2.compute.internal Dec 2 23:38:51.012: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-33-254.us-west-2.compute.internal 6236393f-0a33-4aea-a2e2-fedaf7becdd4 29305 0 2022-12-02 23:17:15 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-33-254.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:ip-172-20-33-254.us-west-2.compute.internal topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0d507bb204448139f"} io.cilium.network.ipv4-cilium-host:172.20.42.35 io.cilium.network.ipv4-health-ip:172.20.58.176 io.cilium.network.ipv4-pod-cidr:100.96.1.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2022-12-02 23:17:15 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2022-12-02 23:17:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-12-02 23:17:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {cilium-agent Update v1 2022-12-02 23:17:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-12-02 23:17:41 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {e2e.test Update v1 2022-12-02 23:29:34 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2022-12-02 23:30:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-0d507bb204448139f,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-02 23:17:41 +0000 UTC,LastTransitionTime:2022-12-02 23:17:41 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-02 23:35:16 +0000 UTC,LastTransitionTime:2022-12-02 23:17:15 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-02 23:35:16 +0000 UTC,LastTransitionTime:2022-12-02 23:17:15 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-02 23:35:16 +0000 UTC,LastTransitionTime:2022-12-02 23:17:15 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-02 23:35:16 +0000 UTC,LastTransitionTime:2022-12-02 23:17:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.33.254,},NodeAddress{Type:ExternalIP,Address:54.190.128.11,},NodeAddress{Type:Hostname,Address:ip-172-20-33-254.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-33-254.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-190-128-11.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23ec8dd062be253828b6092e22eaab,SystemUUID:ec23ec8d-d062-be25-3828-b6092e22eaab,BootID:6bbf84c7-41f9-4141-912e-7f3bc9a0ef42,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.13,KubeletVersion:v1.22.16,KubeProxyVersion:v1.22.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:160382894,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.22.16],SizeBytes:105446599,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:1f36a24cfb5e0c3f725d7565a867c2384282fcbeccc77b07b423c9da95763a9a k8s.gcr.io/e2e-test-images/nautilus:1.4],SizeBytes:49230179,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:716d2f68314c5c4ddd5ecdb45183fcb4ed8019015982c1321571f863989b70b0 k8s.gcr.io/e2e-test-images/httpd:2.4.39-1],SizeBytes:41902332,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:b913fa234cc3473cfe16e937d106b455a7609f927f59031c81aca791e2689b50 k8s.gcr.io/e2e-test-images/httpd:2.4.38-1],SizeBytes:40765006,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:28956694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonroot@sha256:4051e85640c22f8e00c34dbd273576fc9e1e2829992656588062be9c0f69b04b k8s.gcr.io/e2e-test-images/nonroot:1.1],SizeBytes:17748448,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:aa60f453d64dfb3c3fd9e7306f988c36c6352c4f2d956aa90467f2808091effa registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.5],SizeBytes:15209420,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:1b7c978a792a8fa4e96244e8059bd71bb49b07e2e5a897fb0c867bdc6db20d5d k8s.gcr.io/sig-storage/livenessprobe:v2.3.0],SizeBytes:7933739,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:503b7abb89e57383eba61cc8a9cb0b495ea575c516108f7d972a6ff6e1ab3c9b k8s.gcr.io/e2e-test-images/nginx:1.14-1],SizeBytes:6979365,},ContainerImage{Names:[k8s.