Result | FAILURE |
Tests | 43 failed / 743 succeeded |
Started | |
Elapsed | 43m34s |
Revision | master |
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\sExternal\sStorage\s\[Driver\:\sebs\.csi\.aws\.com\]\s\[Testpattern\:\sDynamic\sPV\s\(block\svolmode\)\(allowExpansion\)\]\svolume\-expand\sVerify\sif\soffline\sPVC\sexpansion\sworks$'
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volume_expand.go:174 Jan 24 12:32:11.314: While creating pods for resizing Unexpected error: <*errors.errorString | 0xc00480af40>: { s: "pod \"pod-618aaf08-0a27-46db-982a-1b26fb9fffa7\" is not Running: timed out waiting for the condition", } pod "pod-618aaf08-0a27-46db-982a-1b26fb9fffa7" is not Running: timed out waiting for the condition occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volume_expand.go:192from junit_04.xml
[BeforeEach] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51 [BeforeEach] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Jan 24 12:27:10.480: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename volume-expand �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace [It] Verify if offline PVC expansion works /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volume_expand.go:174 Jan 24 12:27:10.892: INFO: Creating resource for dynamic PV Jan 24 12:27:10.892: INFO: Using claimSize:1Gi, test suite supported size:{ 1Gi}, driver(ebs.csi.aws.com) supported size:{ 1Gi} �[1mSTEP�[0m: creating a StorageClass volume-expand-1313-e2e-scjxl2l �[1mSTEP�[0m: creating a claim �[1mSTEP�[0m: Creating a pod with dynamically provisioned volume Jan 24 12:32:11.314: FAIL: While creating pods for resizing Unexpected error: <*errors.errorString | 0xc00480af40>: { s: "pod \"pod-618aaf08-0a27-46db-982a-1b26fb9fffa7\" is not Running: timed out waiting for the condition", } pod "pod-618aaf08-0a27-46db-982a-1b26fb9fffa7" is not Running: timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/storage/testsuites.(*volumeExpandTestSuite).DefineTests.func4() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volume_expand.go:192 +0x365 k8s.io/kubernetes/test/e2e.RunE2ETests(0x24eec17?) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:133 +0x6b7 k8s.io/kubernetes/test/e2e.TestE2E(0x200010000?) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc00071f380, 0x72ecb90) /usr/local/go/src/testing/testing.go:1446 +0x10b created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1493 +0x35f Jan 24 12:32:11.314: INFO: Deleting pod "pod-618aaf08-0a27-46db-982a-1b26fb9fffa7" in namespace "volume-expand-1313" Jan 24 12:32:11.375: INFO: Wait up to 5m0s for pod "pod-618aaf08-0a27-46db-982a-1b26fb9fffa7" to be fully deleted �[1mSTEP�[0m: Deleting pod Jan 24 12:32:13.493: INFO: Deleting pod "pod-618aaf08-0a27-46db-982a-1b26fb9fffa7" in namespace "volume-expand-1313" �[1mSTEP�[0m: Deleting pvc Jan 24 12:32:13.669: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.comxvfsv" Jan 24 12:32:13.734: INFO: Waiting up to 3m0s for PersistentVolume pvc-990b54ad-be20-4ab8-bbe8-127ea0645c8d to get deleted Jan 24 12:32:13.793: INFO: PersistentVolume pvc-990b54ad-be20-4ab8-bbe8-127ea0645c8d found and phase=Released (58.754664ms) Jan 24 12:32:18.852: INFO: PersistentVolume pvc-990b54ad-be20-4ab8-bbe8-127ea0645c8d found and phase=Released (5.11793667s) Jan 24 12:32:23.914: INFO: PersistentVolume pvc-990b54ad-be20-4ab8-bbe8-127ea0645c8d found and phase=Released (10.179498351s) Jan 24 12:32:28.975: INFO: PersistentVolume pvc-990b54ad-be20-4ab8-bbe8-127ea0645c8d was removed �[1mSTEP�[0m: Deleting sc [AfterEach] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "volume-expand-1313". �[1mSTEP�[0m: Found 18 events. Jan 24 12:32:29.095: INFO: At 2023-01-24 12:27:10 +0000 UTC - event for ebs.csi.aws.comxvfsv: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding Jan 24 12:32:29.095: INFO: At 2023-01-24 12:27:11 +0000 UTC - event for ebs.csi.aws.comxvfsv: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "ebs.csi.aws.com" or manually created by system administrator Jan 24 12:32:29.095: INFO: At 2023-01-24 12:27:11 +0000 UTC - event for ebs.csi.aws.comxvfsv: {ebs.csi.aws.com_ip-172-20-42-201_746df1a9-d9c8-443b-9c11-e00bf4e14a5c } Provisioning: External provisioner is provisioning volume for claim "volume-expand-1313/ebs.csi.aws.comxvfsv" Jan 24 12:32:29.095: INFO: At 2023-01-24 12:27:14 +0000 UTC - event for ebs.csi.aws.comxvfsv: {ebs.csi.aws.com_ip-172-20-42-201_746df1a9-d9c8-443b-9c11-e00bf4e14a5c } ProvisioningSucceeded: Successfully provisioned volume pvc-990b54ad-be20-4ab8-bbe8-127ea0645c8d Jan 24 12:32:29.095: INFO: At 2023-01-24 12:27:15 +0000 UTC - event for pod-618aaf08-0a27-46db-982a-1b26fb9fffa7: {default-scheduler } Scheduled: Successfully assigned volume-expand-1313/pod-618aaf08-0a27-46db-982a-1b26fb9fffa7 to ip-172-20-62-42.us-west-1.compute.internal Jan 24 12:32:29.095: INFO: At 2023-01-24 12:27:17 +0000 UTC - event for pod-618aaf08-0a27-46db-982a-1b26fb9fffa7: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-990b54ad-be20-4ab8-bbe8-127ea0645c8d" Jan 24 12:32:29.095: INFO: At 2023-01-24 12:27:24 +0000 UTC - event for pod-618aaf08-0a27-46db-982a-1b26fb9fffa7: {kubelet ip-172-20-62-42.us-west-1.compute.internal} SuccessfulMountVolume: MapVolume.MapPodDevice succeeded for volume "pvc-990b54ad-be20-4ab8-bbe8-127ea0645c8d" globalMapPath "/var/lib/kubelet/plugins/kubernetes.io/csi/volumeDevices/pvc-990b54ad-be20-4ab8-bbe8-127ea0645c8d/dev" Jan 24 12:32:29.095: INFO: At 2023-01-24 12:27:24 +0000 UTC - event for pod-618aaf08-0a27-46db-982a-1b26fb9fffa7: {kubelet ip-172-20-62-42.us-west-1.compute.internal} SuccessfulMountVolume: MapVolume.MapPodDevice succeeded for volume "pvc-990b54ad-be20-4ab8-bbe8-127ea0645c8d" volumeMapPath "/var/lib/kubelet/pods/9a273a05-1d6a-45da-a58e-f5e0a5a07539/volumeDevices/kubernetes.io~csi" Jan 24 12:32:29.095: INFO: At 2023-01-24 12:27:24 +0000 UTC - event for pod-618aaf08-0a27-46db-982a-1b26fb9fffa7: {kubelet ip-172-20-62-42.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "78acf69a7f5504c9eb5a67a98287c4ae95228f92d1b49b3254f57c8d1e58948e": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:32:29.095: INFO: At 2023-01-24 12:27:36 +0000 UTC - event for pod-618aaf08-0a27-46db-982a-1b26fb9fffa7: {kubelet ip-172-20-62-42.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a4b94f64a2a8db1be0ddfbc490f6999140231a0db29850cfe67471876f7bc241": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:32:29.095: INFO: At 2023-01-24 12:27:48 +0000 UTC - event for pod-618aaf08-0a27-46db-982a-1b26fb9fffa7: {kubelet ip-172-20-62-42.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a8f969bfed194658de7206a03e9e4ff6fcf90b8ffbf1ff2271bd26d722a620aa": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:32:29.095: INFO: At 2023-01-24 12:28:00 +0000 UTC - event for pod-618aaf08-0a27-46db-982a-1b26fb9fffa7: {kubelet ip-172-20-62-42.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "1f7761aa5b59db11864457eba59a12895f12a88ad467c3ce59c1dbf81ce143f9": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:32:29.095: INFO: At 2023-01-24 12:28:14 +0000 UTC - event for pod-618aaf08-0a27-46db-982a-1b26fb9fffa7: {kubelet ip-172-20-62-42.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "0f9f88538017cf98d592aaf900b3143b9e5d6e6147ac77bec27f44f7ac60218c": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:32:29.095: INFO: At 2023-01-24 12:28:29 +0000 UTC - event for pod-618aaf08-0a27-46db-982a-1b26fb9fffa7: {kubelet ip-172-20-62-42.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "5911f4d309eab7719bcfd3b53a877ae735ebdaf943a6ddef621e2fd30eb39fee": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:32:29.095: INFO: At 2023-01-24 12:28:43 +0000 UTC - event for pod-618aaf08-0a27-46db-982a-1b26fb9fffa7: {kubelet ip-172-20-62-42.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "16e30916ca236c6ceb7e93607bdddfb7afc9cc273a47efd72cb1ee67919ed806": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:32:29.095: INFO: At 2023-01-24 12:28:54 +0000 UTC - event for pod-618aaf08-0a27-46db-982a-1b26fb9fffa7: {kubelet ip-172-20-62-42.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "65b6d370d23e5d4a3cb4b2d9bf4ee98a86628d6dd913e3b6d6aa7fcb0ccf3976": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:32:29.095: INFO: At 2023-01-24 12:29:05 +0000 UTC - event for pod-618aaf08-0a27-46db-982a-1b26fb9fffa7: {kubelet ip-172-20-62-42.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "c51f0725af9e56c13b46933fbf0eead3e046a75b2bfd33f3448372df41a1f228": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:32:29.095: INFO: At 2023-01-24 12:29:16 +0000 UTC - event for pod-618aaf08-0a27-46db-982a-1b26fb9fffa7: {kubelet ip-172-20-62-42.us-west-1.compute.internal} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "458a0a3e0755f4bd8db3b1626bf8c44b8be6a61240d9859b0f420e6cd3d34429": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:32:29.154: INFO: POD NODE PHASE GRACE CONDITIONS Jan 24 12:32:29.154: INFO: Jan 24 12:32:29.214: INFO: Logging node info for node ip-172-20-42-201.us-west-1.compute.internal Jan 24 12:32:29.273: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-42-201.us-west-1.compute.internal cc6006a6-61fd-4f4c-b296-ba72367bb0f8 27566 0 2023-01-24 12:07:14 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-1 failure-domain.beta.kubernetes.io/zone:us-west-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-42-201.us-west-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/control-plane: node-role.kubernetes.io/master: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:us-west-1a topology.kubernetes.io/region:us-west-1 topology.kubernetes.io/zone:us-west-1a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-08c27beef2082266b"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-24 12:07:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {protokube Update v1 2023-01-24 12:07:41 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kops-controller Update v1 2023-01-24 12:07:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/master":{}}}} } {kube-controller-manager Update v1 2023-01-24 12:07:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-24 12:09:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-1a/i-08c27beef2082266b,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892264960 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787407360 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-24 12:30:14 +0000 UTC,LastTransitionTime:2023-01-24 12:07:14 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-24 12:30:14 +0000 UTC,LastTransitionTime:2023-01-24 12:07:14 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-24 12:30:14 +0000 UTC,LastTransitionTime:2023-01-24 12:07:14 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-24 12:30:14 +0000 UTC,LastTransitionTime:2023-01-24 12:07:55 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.201,},NodeAddress{Type:ExternalIP,Address:54.215.124.25,},NodeAddress{Type:Hostname,Address:ip-172-20-42-201.us-west-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-42-201.us-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-215-124-25.us-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2be20fd28580af17ed5c32106be540,SystemUUID:ec2be20f-d285-80af-17ed-5c32106be540,BootID:cb576848-3e1b-4407-b81d-d34a637f2afd,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.23.16,KubeProxyVersion:v1.23.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.23.16 registry.k8s.io/kube-apiserver-amd64:v1.23.16],SizeBytes:131340755,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.23.16 registry.k8s.io/kube-controller-manager-amd64:v1.23.16],SizeBytes:121280825,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.16 registry.k8s.io/kube-proxy-amd64:v1.23.16],SizeBytes:112743991,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.23.16 registry.k8s.io/kube-scheduler-amd64:v1.23.16],SizeBytes:53193016,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-beta.2],SizeBytes:43191763,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-beta.2],SizeBytes:42821714,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-beta.2],SizeBytes:4965793,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 24 12:32:29.274: INFO: Logging kubelet events for node ip-172-20-42-201.us-west-1.compute.internal Jan 24 12:32:29.335: INFO: Logging pods the kubelet thinks is on node ip-172-20-42-201.us-west-1.compute.internal Jan 24 12:32:29.399: INFO: ebs-csi-node-4lwrc started at 2023-01-24 12:07:40 +0000 UTC (0+3 container statuses recorded) Jan 24 12:32:29.399: INFO: Container ebs-plugin ready: true, restart count 0 Jan 24 12:32:29.399: INFO: Container liveness-probe ready: true, restart count 0 Jan 24 12:32:29.399: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 24 12:32:29.399: INFO: kops-controller-8k2c2 started at 2023-01-24 12:07:41 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:29.399: INFO: Container kops-controller ready: true, restart count 0 Jan 24 12:32:29.399: INFO: ebs-csi-controller-7bd4fbc786-nm7v4 started at 2023-01-24 12:07:42 +0000 UTC (0+5 container statuses recorded) Jan 24 12:32:29.399: INFO: Container csi-attacher ready: true, restart count 0 Jan 24 12:32:29.399: INFO: Container csi-provisioner ready: true, restart count 0 Jan 24 12:32:29.399: INFO: Container csi-resizer ready: true, restart count 0 Jan 24 12:32:29.399: INFO: Container ebs-plugin ready: true, restart count 0 Jan 24 12:32:29.399: INFO: Container liveness-probe ready: true, restart count 0 Jan 24 12:32:29.399: INFO: etcd-manager-events-ip-172-20-42-201.us-west-1.compute.internal started at 2023-01-24 12:06:45 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:29.399: INFO: Container etcd-manager ready: true, restart count 0 Jan 24 12:32:29.399: INFO: etcd-manager-main-ip-172-20-42-201.us-west-1.compute.internal started at 2023-01-24 12:06:45 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:29.399: INFO: Container etcd-manager ready: true, restart count 0 Jan 24 12:32:29.399: INFO: kube-apiserver-ip-172-20-42-201.us-west-1.compute.internal started at 2023-01-24 12:06:45 +0000 UTC (0+2 container statuses recorded) Jan 24 12:32:29.399: INFO: Container healthcheck ready: true, restart count 0 Jan 24 12:32:29.399: INFO: Container kube-apiserver ready: true, restart count 1 Jan 24 12:32:29.399: INFO: cilium-operator-d84d55876-rfmxk started at 2023-01-24 12:07:41 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:29.399: INFO: Container cilium-operator ready: true, restart count 1 Jan 24 12:32:29.399: INFO: dns-controller-58d7bbb845-c475n started at 2023-01-24 12:07:41 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:29.399: INFO: Container dns-controller ready: true, restart count 0 Jan 24 12:32:29.399: INFO: kube-controller-manager-ip-172-20-42-201.us-west-1.compute.internal started at 2023-01-24 12:06:45 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:29.399: INFO: Container kube-controller-manager ready: true, restart count 2 Jan 24 12:32:29.399: INFO: kube-scheduler-ip-172-20-42-201.us-west-1.compute.internal started at 2023-01-24 12:06:45 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:29.399: INFO: Container kube-scheduler ready: true, restart count 0 Jan 24 12:32:29.399: INFO: cilium-5dpkw started at 2023-01-24 12:07:38 +0000 UTC (1+1 container statuses recorded) Jan 24 12:32:29.399: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 24 12:32:29.399: INFO: Container cilium-agent ready: true, restart count 1 Jan 24 12:32:29.629: INFO: Latency metrics for node ip-172-20-42-201.us-west-1.compute.internal Jan 24 12:32:29.629: INFO: Logging node info for node ip-172-20-58-8.us-west-1.compute.internal Jan 24 12:32:29.688: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-58-8.us-west-1.compute.internal 4a97117d-69ce-4a16-9e93-9e41b32a9a62 28265 0 2023-01-24 12:09:13 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-1 failure-domain.beta.kubernetes.io/zone:us-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-58-8.us-west-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-1a topology.hostpath.csi/node:ip-172-20-58-8.us-west-1.compute.internal topology.kubernetes.io/region:us-west-1 topology.kubernetes.io/zone:us-west-1a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0cf7a751b954f0403"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2023-01-24 12:09:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-24 12:09:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-24 12:09:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-01-24 12:17:56 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-24 12:18:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {e2e.test Update v1 2023-01-24 12:19:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-1a/i-0cf7a751b954f0403,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051644416 0} {<nil>} 3956684Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946786816 0} {<nil>} 3854284Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-24 12:31:17 +0000 UTC,LastTransitionTime:2023-01-24 12:09:13 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-24 12:31:17 +0000 UTC,LastTransitionTime:2023-01-24 12:09:13 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-24 12:31:17 +0000 UTC,LastTransitionTime:2023-01-24 12:09:13 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-24 12:31:17 +0000 UTC,LastTransitionTime:2023-01-24 12:09:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.58.8,},NodeAddress{Type:ExternalIP,Address:52.53.154.168,},NodeAddress{Type:Hostname,Address:ip-172-20-58-8.us-west-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-58-8.us-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-52-53-154-168.us-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec21f66ef1338663d7ef9e17ce7835a7,SystemUUID:ec21f66e-f133-8663-d7ef-9e17ce7835a7,BootID:e76a2ed0-0929-4d54-b334-e1f0ad9eacd2,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.23.16,KubeProxyVersion:v1.23.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.16 registry.k8s.io/kube-proxy-amd64:v1.23.16],SizeBytes:112743991,},ContainerImage{Names:[docker.io/library/nginx@sha256:b8f2383a95879e1ae064940d9a200f67a6c79e710ed82ac42263397367e7cc4e docker.io/library/nginx:latest],SizeBytes:56882371,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a k8s.gcr.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 k8s.gcr.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-00a8f7338bd3c4426],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-00a8f7338bd3c4426,DevicePath:,},},Config:nil,},} Jan 24 12:32:29.689: INFO: Logging kubelet events for node ip-172-20-58-8.us-west-1.compute.internal Jan 24 12:32:29.754: INFO: Logging pods the kubelet thinks is on node ip-172-20-58-8.us-west-1.compute.internal Jan 24 12:32:29.821: INFO: deployment-shared-map-item-removal-7c658794b9-58xl7 started at 2023-01-24 12:31:01 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:29.821: INFO: Container nginx ready: false, restart count 0 Jan 24 12:32:29.821: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-fhs4l started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:29.821: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:32:29.821: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-26vrc started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:29.821: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:32:29.821: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-c7hrk started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:29.821: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:32:29.821: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-58gdd started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:29.821: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: false, restart count 0 Jan 24 12:32:29.821: INFO: cilium-nchqx started at 2023-01-24 12:09:14 +0000 UTC (1+1 container statuses recorded) Jan 24 12:32:29.821: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 24 12:32:29.821: INFO: Container cilium-agent ready: true, restart count 0 Jan 24 12:32:29.821: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-5q458 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:29.821: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:32:29.821: INFO: netserver-0 started at 2023-01-24 12:30:26 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:29.821: INFO: Container webserver ready: false, restart count 0 Jan 24 12:32:29.821: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-qdqt9 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:29.821: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:32:29.821: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-vj22z started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:29.821: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:32:29.821: INFO: coredns-867df8f45c-8jvsj started at 2023-01-24 12:09:41 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:29.821: INFO: Container coredns ready: true, restart count 0 Jan 24 12:32:29.821: INFO: csi-mockplugin-0 started at 2023-01-24 12:32:17 +0000 UTC (0+3 container statuses recorded) Jan 24 12:32:29.821: INFO: Container csi-provisioner ready: false, restart count 0 Jan 24 12:32:29.821: INFO: Container driver-registrar ready: false, restart count 0 Jan 24 12:32:29.821: INFO: Container mock ready: false, restart count 0 Jan 24 12:32:29.821: INFO: hostexec-ip-172-20-58-8.us-west-1.compute.internal-zdb9f started at 2023-01-24 12:31:11 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:29.821: INFO: Container agnhost-container ready: true, restart count 0 Jan 24 12:32:29.821: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-5znh6 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:29.821: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:32:29.821: INFO: pod-subpath-test-preprovisionedpv-6vzh started at 2023-01-24 12:31:24 +0000 UTC (1+2 container statuses recorded) Jan 24 12:32:29.821: INFO: Init container test-init-subpath-preprovisionedpv-6vzh ready: false, restart count 0 Jan 24 12:32:29.821: INFO: Container test-container-subpath-preprovisionedpv-6vzh ready: false, restart count 0 Jan 24 12:32:29.821: INFO: Container test-container-volume-preprovisionedpv-6vzh ready: false, restart count 0 Jan 24 12:32:29.821: INFO: pod-subpath-test-preprovisionedpv-bzx9 started at 2023-01-24 12:30:54 +0000 UTC (2+2 container statuses recorded) Jan 24 12:32:29.821: INFO: Init container init-volume-preprovisionedpv-bzx9 ready: false, restart count 0 Jan 24 12:32:29.821: INFO: Init container test-init-subpath-preprovisionedpv-bzx9 ready: false, restart count 0 Jan 24 12:32:29.821: INFO: Container test-container-subpath-preprovisionedpv-bzx9 ready: false, restart count 0 Jan 24 12:32:29.821: INFO: Container test-container-volume-preprovisionedpv-bzx9 ready: false, restart count 0 Jan 24 12:32:29.821: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-qbrts started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:29.821: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:32:29.821: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-qccgl started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:29.821: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:32:29.821: INFO: netserver-0 started at 2023-01-24 12:29:55 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:29.821: INFO: Container webserver ready: false, restart count 0 Jan 24 12:32:29.821: INFO: hostexec-ip-172-20-58-8.us-west-1.compute.internal-r8bf5 started at 2023-01-24 12:30:36 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:29.821: INFO: Container agnhost-container ready: true, restart count 0 Jan 24 12:32:29.821: INFO: netserver-0 started at 2023-01-24 12:24:45 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:29.821: INFO: Container webserver ready: true, restart count 0 Jan 24 12:32:29.821: INFO: csi-mockplugin-attacher-0 started at 2023-01-24 12:32:17 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:29.821: INFO: Container csi-attacher ready: false, restart count 0 Jan 24 12:32:29.821: INFO: ebs-csi-node-4bbqn started at 2023-01-24 12:09:14 +0000 UTC (0+3 container statuses recorded) Jan 24 12:32:29.821: INFO: Container ebs-plugin ready: true, restart count 0 Jan 24 12:32:29.821: INFO: Container liveness-probe ready: true, restart count 0 Jan 24 12:32:29.821: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 24 12:32:29.821: INFO: ss-1 started at 2023-01-24 12:19:34 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:29.821: INFO: Container webserver ready: true, restart count 0 Jan 24 12:32:30.233: INFO: Latency metrics for node ip-172-20-58-8.us-west-1.compute.internal Jan 24 12:32:30.233: INFO: Logging node info for node ip-172-20-62-42.us-west-1.compute.internal Jan 24 12:32:30.292: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-62-42.us-west-1.compute.internal 2f9a48a1-cd3d-4169-9d63-d46bd4e4c90b 28684 0 2023-01-24 12:09:10 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-1 failure-domain.beta.kubernetes.io/zone:us-west-1a io.kubernetes.storage.mock/node:some-mock-node kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-62-42.us-west-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-1a topology.hostpath.csi/node:ip-172-20-62-42.us-west-1.compute.internal topology.kubernetes.io/region:us-west-1 topology.kubernetes.io/zone:us-west-1a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0d97debf14f45ab50"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-24 12:09:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-24 12:09:11 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-24 12:09:11 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kube-controller-manager Update v1 2023-01-24 12:17:35 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-24 12:17:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {e2e.test Update v1 2023-01-24 12:19:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-1a/i-0d97debf14f45ab50,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051644416 0} {<nil>} 3956684Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946786816 0} {<nil>} 3854284Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-24 12:32:19 +0000 UTC,LastTransitionTime:2023-01-24 12:09:10 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-24 12:32:19 +0000 UTC,LastTransitionTime:2023-01-24 12:09:10 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-24 12:32:19 +0000 UTC,LastTransitionTime:2023-01-24 12:09:10 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-24 12:32:19 +0000 UTC,LastTransitionTime:2023-01-24 12:09:31 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.62.42,},NodeAddress{Type:ExternalIP,Address:18.144.79.13,},NodeAddress{Type:Hostname,Address:ip-172-20-62-42.us-west-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-62-42.us-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-144-79-13.us-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2f0698917764d226ec108df5fcfc56,SystemUUID:ec2f0698-9177-64d2-26ec-108df5fcfc56,BootID:c6c940f9-7462-43d1-92da-e4a2c837556e,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.23.16,KubeProxyVersion:v1.23.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.16 registry.k8s.io/kube-proxy-amd64:v1.23.16],SizeBytes:112743991,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-08b09c9a68b8e7c77],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-08b09c9a68b8e7c77,DevicePath:,},},Config:nil,},} Jan 24 12:32:30.293: INFO: Logging kubelet events for node ip-172-20-62-42.us-west-1.compute.internal Jan 24 12:32:30.354: INFO: Logging pods the kubelet thinks is on node ip-172-20-62-42.us-west-1.compute.internal Jan 24 12:32:30.420: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-m869g started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:30.420: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:32:30.420: INFO: ebs-csi-node-9pt8t started at 2023-01-24 12:09:11 +0000 UTC (0+3 container statuses recorded) Jan 24 12:32:30.420: INFO: Container ebs-plugin ready: true, restart count 0 Jan 24 12:32:30.420: INFO: Container liveness-probe ready: true, restart count 0 Jan 24 12:32:30.420: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 24 12:32:30.420: INFO: cilium-45k6r started at 2023-01-24 12:09:11 +0000 UTC (1+1 container statuses recorded) Jan 24 12:32:30.420: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 24 12:32:30.420: INFO: Container cilium-agent ready: true, restart count 0 Jan 24 12:32:30.420: INFO: externalname-service-mn5hg started at 2023-01-24 12:31:38 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:30.420: INFO: Container externalname-service ready: false, restart count 0 Jan 24 12:32:30.420: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-w4rqg started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:30.420: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:32:30.420: INFO: ss-0 started at 2023-01-24 12:21:08 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:30.420: INFO: Container webserver ready: true, restart count 0 Jan 24 12:32:30.420: INFO: netserver-1 started at 2023-01-24 12:30:26 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:30.420: INFO: Container webserver ready: false, restart count 0 Jan 24 12:32:30.420: INFO: netserver-1 started at 2023-01-24 12:29:55 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:30.420: INFO: Container webserver ready: false, restart count 0 Jan 24 12:32:30.420: INFO: indexed-job-1-4twdx started at 2023-01-24 12:21:23 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:30.420: INFO: Container c ready: false, restart count 0 Jan 24 12:32:30.420: INFO: netserver-1 started at 2023-01-24 12:24:45 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:30.420: INFO: Container webserver ready: true, restart count 0 Jan 24 12:32:30.420: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-l77fq started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:30.420: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:32:30.420: INFO: busybox-user-0-60317cbc-275c-4a31-b4a9-ea0a6554cb59 started at 2023-01-24 12:31:46 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:30.420: INFO: Container busybox-user-0-60317cbc-275c-4a31-b4a9-ea0a6554cb59 ready: false, restart count 0 Jan 24 12:32:30.420: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-ls58g started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:30.420: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:32:30.420: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-pq8gm started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:30.420: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:32:30.420: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-ct4xp started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:30.420: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:32:30.420: INFO: pod-hostip-6762942d-694d-47d3-8c18-8bedf12d2344 started at 2023-01-24 12:30:58 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:30.420: INFO: Container test ready: false, restart count 0 Jan 24 12:32:30.420: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-cdkxl started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:30.420: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:32:30.420: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-jmg66 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:30.420: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:32:30.420: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-g4s7s started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:30.420: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:32:30.420: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-cc5vr started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:30.420: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:32:30.682: INFO: Latency metrics for node ip-172-20-62-42.us-west-1.compute.internal Jan 24 12:32:30.682: INFO: Logging node info for node ip-172-20-63-134.us-west-1.compute.internal Jan 24 12:32:30.741: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-63-134.us-west-1.compute.internal 30ac81c2-1bcf-49af-aa05-528c41f9d04a 28078 0 2023-01-24 12:09:05 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-1 failure-domain.beta.kubernetes.io/zone:us-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-63-134.us-west-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-1a topology.hostpath.csi/node:ip-172-20-63-134.us-west-1.compute.internal topology.kubernetes.io/region:us-west-1 topology.kubernetes.io/zone:us-west-1a] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-1287":"csi-mock-csi-mock-volumes-1287","ebs.csi.aws.com":"i-0f4c0c89e622dd2cb"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2023-01-24 12:09:05 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-24 12:09:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-01-24 12:09:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-24 12:16:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-01-24 12:16:21 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {e2e.test Update v1 2023-01-24 12:19:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-1a/i-0f4c0c89e622dd2cb,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051644416 0} {<nil>} 3956684Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946786816 0} {<nil>} 3854284Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-24 12:30:59 +0000 UTC,LastTransitionTime:2023-01-24 12:09:05 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-24 12:30:59 +0000 UTC,LastTransitionTime:2023-01-24 12:09:05 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-24 12:30:59 +0000 UTC,LastTransitionTime:2023-01-24 12:09:05 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-24 12:30:59 +0000 UTC,LastTransitionTime:2023-01-24 12:09:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.63.134,},NodeAddress{Type:ExternalIP,Address:13.52.252.72,},NodeAddress{Type:Hostname,Address:ip-172-20-63-134.us-west-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-63-134.us-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-52-252-72.us-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec216b16315774b9b69907761ee0f87b,SystemUUID:ec216b16-3157-74b9-b699-07761ee0f87b,BootID:a0b9767c-5621-442f-8ded-9126e82e52b2,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.23.16,KubeProxyVersion:v1.23.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.16 registry.k8s.io/kube-proxy-amd64:v1.23.16],SizeBytes:112743991,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[docker.io/library/nginx@sha256:b8f2383a95879e1ae064940d9a200f67a6c79e710ed82ac42263397367e7cc4e docker.io/library/nginx:latest],SizeBytes:56882371,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a k8s.gcr.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 k8s.gcr.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac k8s.gcr.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-1287^4 kubernetes.io/csi/ebs.csi.aws.com^vol-0ff989d77482eddbb],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0ff989d77482eddbb,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-1287^4,DevicePath:,},},Config:nil,},} Jan 24 12:32:30.742: INFO: Logging kubelet events for node ip-172-20-63-134.us-west-1.compute.internal Jan 24 12:32:30.803: INFO: Logging pods the kubelet thinks is on node ip-172-20-63-134.us-west-1.compute.internal Jan 24 12:32:30.870: INFO: netserver-2 started at 2023-01-24 12:24:45 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:30.871: INFO: Container webserver ready: false, restart count 0 Jan 24 12:32:30.871: INFO: ebs-csi-node-v75jm started at 2023-01-24 12:09:06 +0000 UTC (0+3 container statuses recorded) Jan 24 12:32:30.871: INFO: Container ebs-plugin ready: true, restart count 0 Jan 24 12:32:30.871: INFO: Container liveness-probe ready: true, restart count 0 Jan 24 12:32:30.871: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 24 12:32:30.871: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-g7hv8 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:30.871: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:32:30.871: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-dwht5 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:30.871: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:32:30.871: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-gp5cx started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:30.871: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:32:30.871: INFO: csi-hostpathplugin-0 started at 2023-01-24 12:20:09 +0000 UTC (0+7 container statuses recorded) Jan 24 12:32:30.871: INFO: Container csi-attacher ready: false, restart count 0 Jan 24 12:32:30.871: INFO: Container csi-provisioner ready: false, restart count 0 Jan 24 12:32:30.871: INFO: Container csi-resizer ready: false, restart count 0 Jan 24 12:32:30.871: INFO: Container csi-snapshotter ready: false, restart count 0 Jan 24 12:32:30.871: INFO: Container hostpath ready: false, restart count 0 Jan 24 12:32:30.871: INFO: Container liveness-probe ready: false, restart count 0 Jan 24 12:32:30.871: INFO: Container node-driver-registrar ready: false, restart count 0 Jan 24 12:32:30.871: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-vnplb started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:30.871: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:32:30.871: INFO: coredns-autoscaler-557ccb4c66-gl766 started at 2023-01-24 12:09:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:30.871: INFO: Container autoscaler ready: true, restart count 0 Jan 24 12:32:30.871: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-8wf5k started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:30.871: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:32:30.871: INFO: netserver-2 started at 2023-01-24 12:29:55 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:30.871: INFO: Container webserver ready: false, restart count 0 Jan 24 12:32:30.871: INFO: coredns-867df8f45c-wcswf started at 2023-01-24 12:09:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:30.871: INFO: Container coredns ready: true, restart count 0 Jan 24 12:32:30.871: INFO: csi-mockplugin-attacher-0 started at 2023-01-24 12:27:08 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:30.871: INFO: Container csi-attacher ready: true, restart count 0 Jan 24 12:32:30.871: INFO: ss-0 started at 2023-01-24 12:19:42 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:30.871: INFO: Container webserver ready: false, restart count 0 Jan 24 12:32:30.871: INFO: pvc-volume-tester-ctp62 started at 2023-01-24 12:30:56 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:30.871: INFO: Container volume-tester ready: false, restart count 0 Jan 24 12:32:30.871: INFO: cilium-mkm5g started at 2023-01-24 12:09:06 +0000 UTC (1+1 container statuses recorded) Jan 24 12:32:30.871: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 24 12:32:30.871: INFO: Container cilium-agent ready: true, restart count 0 Jan 24 12:32:30.871: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-gh2rw started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:30.871: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:32:30.871: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-bqvzk started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:30.871: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: false, restart count 0 Jan 24 12:32:30.871: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-9kzn4 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:30.871: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: false, restart count 0 Jan 24 12:32:30.871: INFO: csi-mockplugin-0 started at 2023-01-24 12:27:08 +0000 UTC (0+3 container statuses recorded) Jan 24 12:32:30.871: INFO: Container csi-provisioner ready: true, restart count 0 Jan 24 12:32:30.871: INFO: Container driver-registrar ready: true, restart count 0 Jan 24 12:32:30.871: INFO: Container mock ready: true, restart count 0 Jan 24 12:32:30.871: INFO: netserver-2 started at 2023-01-24 12:30:26 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:30.871: INFO: Container webserver ready: false, restart count 0 Jan 24 12:32:30.871: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-x2c2b started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:30.871: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:32:30.871: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-b74rw started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:30.871: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:32:31.132: INFO: Latency metrics for node ip-172-20-63-134.us-west-1.compute.internal Jan 24 12:32:31.132: INFO: Logging node info for node ip-172-20-63-190.us-west-1.compute.internal Jan 24 12:32:31.191: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-63-190.us-west-1.compute.internal d80c92f0-6fa8-4333-b1ea-6b0b4cdbea2d 26542 0 2023-01-24 12:09:12 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-1 failure-domain.beta.kubernetes.io/zone:us-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-63-190.us-west-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-1a topology.hostpath.csi/node:ip-172-20-63-190.us-west-1.compute.internal topology.kubernetes.io/region:us-west-1 topology.kubernetes.io/zone:us-west-1a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0fd113285a9315bba"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2023-01-24 12:09:12 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-24 12:09:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-24 12:09:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-01-24 12:19:02 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-24 12:19:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {e2e.test Update v1 2023-01-24 12:19:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-1a/i-0fd113285a9315bba,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051652608 0} {<nil>} 3956692Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946795008 0} {<nil>} 3854292Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-24 12:28:57 +0000 UTC,LastTransitionTime:2023-01-24 12:09:12 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-24 12:28:57 +0000 UTC,LastTransitionTime:2023-01-24 12:09:12 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-24 12:28:57 +0000 UTC,LastTransitionTime:2023-01-24 12:09:12 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-24 12:28:57 +0000 UTC,LastTransitionTime:2023-01-24 12:09:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.63.190,},NodeAddress{Type:ExternalIP,Address:54.215.249.154,},NodeAddress{Type:Hostname,Address:ip-172-20-63-190.us-west-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-63-190.us-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-215-249-154.us-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec255708dba66ed160033f1fab58ba92,SystemUUID:ec255708-dba6-6ed1-6003-3f1fab58ba92,BootID:4e4cb7aa-a82e-4abd-a66d-5fb285cb6c0b,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.23.16,KubeProxyVersion:v1.23.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.16 registry.k8s.io/kube-proxy-amd64:v1.23.16],SizeBytes:112743991,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-057a1367ebd667fa7 kubernetes.io/csi/ebs.csi.aws.com^vol-0d966a9348a99e832],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0d966a9348a99e832,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-057a1367ebd667fa7,DevicePath:,},},Config:nil,},} Jan 24 12:32:31.192: INFO: Logging kubelet events for node ip-172-20-63-190.us-west-1.compute.internal Jan 24 12:32:31.253: INFO: Logging pods the kubelet thinks is on node ip-172-20-63-190.us-west-1.compute.internal Jan 24 12:32:31.322: INFO: ss-2 started at 2023-01-24 12:25:59 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:31.322: INFO: Container webserver ready: false, restart count 0 Jan 24 12:32:31.322: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-9pdvd started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:31.322: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:32:31.322: INFO: all-succeed-gmhmc started at 2023-01-24 12:26:10 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:31.322: INFO: Container c ready: false, restart count 0 Jan 24 12:32:31.322: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-bcqr7 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:31.322: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:32:31.322: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-vqntn started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:31.322: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:32:31.322: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-4jptx started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:31.322: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:32:31.322: INFO: test-ss-0 started at 2023-01-24 12:32:18 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:31.322: INFO: Container webserver ready: false, restart count 0 Jan 24 12:32:31.322: INFO: indexed-job-0-q2xds started at 2023-01-24 12:21:23 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:31.322: INFO: Container c ready: false, restart count 0 Jan 24 12:32:31.322: INFO: ss-1 started at 2023-01-24 12:19:17 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:31.322: INFO: Container webserver ready: false, restart count 0 Jan 24 12:32:31.322: INFO: sample-webhook-deployment-6c69dbd86b-blpbb started at 2023-01-24 12:31:39 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:31.322: INFO: Container sample-webhook ready: false, restart count 0 Jan 24 12:32:31.322: INFO: netserver-3 started at 2023-01-24 12:29:55 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:31.322: INFO: Container webserver ready: false, restart count 0 Jan 24 12:32:31.322: INFO: indexed-job-2-rhrn5 started at 2023-01-24 12:25:46 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:31.322: INFO: Container c ready: false, restart count 0 Jan 24 12:32:31.322: INFO: ss-0 started at 2023-01-24 12:31:15 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:31.322: INFO: Container webserver ready: false, restart count 0 Jan 24 12:32:31.322: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-kzfz9 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:31.322: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:32:31.322: INFO: all-succeed-thg2m started at 2023-01-24 12:26:10 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:31.322: INFO: Container c ready: false, restart count 0 Jan 24 12:32:31.322: INFO: ebs-csi-node-ld8b2 started at 2023-01-24 12:09:13 +0000 UTC (0+3 container statuses recorded) Jan 24 12:32:31.322: INFO: Container ebs-plugin ready: true, restart count 0 Jan 24 12:32:31.322: INFO: Container liveness-probe ready: true, restart count 0 Jan 24 12:32:31.322: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 24 12:32:31.322: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-dhzcl started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:31.322: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:32:31.322: INFO: fail-once-local-nkjmd started at 2023-01-24 12:20:23 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:31.322: INFO: Container c ready: false, restart count 0 Jan 24 12:32:31.322: INFO: netserver-3 started at 2023-01-24 12:30:26 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:31.322: INFO: Container webserver ready: true, restart count 0 Jan 24 12:32:31.322: INFO: fail-once-local-4kxtz started at 2023-01-24 12:20:23 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:31.322: INFO: Container c ready: false, restart count 1 Jan 24 12:32:31.322: INFO: externalname-service-ww7rd started at 2023-01-24 12:31:38 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:31.322: INFO: Container externalname-service ready: false, restart count 0 Jan 24 12:32:31.322: INFO: netserver-3 started at 2023-01-24 12:24:46 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:31.322: INFO: Container webserver ready: false, restart count 0 Jan 24 12:32:31.322: INFO: pod-0 started at 2023-01-24 12:31:02 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:31.322: INFO: Container donothing ready: false, restart count 0 Jan 24 12:32:31.322: INFO: pfpod started at 2023-01-24 12:30:48 +0000 UTC (0+2 container statuses recorded) Jan 24 12:32:31.322: INFO: Container portforwardtester ready: false, restart count 0 Jan 24 12:32:31.322: INFO: Container readiness ready: false, restart count 0 Jan 24 12:32:31.322: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-5rrg5 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:31.322: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:32:31.322: INFO: hostexec-ip-172-20-63-190.us-west-1.compute.internal-v8vmk started at 2023-01-24 12:30:00 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:31.322: INFO: Container agnhost-container ready: true, restart count 0 Jan 24 12:32:31.322: INFO: cilium-54xb4 started at 2023-01-24 12:09:13 +0000 UTC (1+1 container statuses recorded) Jan 24 12:32:31.322: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 24 12:32:31.322: INFO: Container cilium-agent ready: true, restart count 0 Jan 24 12:32:31.322: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-s27h5 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:31.322: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:32:31.322: INFO: csi-hostpathplugin-0 started at 2023-01-24 12:30:49 +0000 UTC (0+7 container statuses recorded) Jan 24 12:32:31.322: INFO: Container csi-attacher ready: false, restart count 0 Jan 24 12:32:31.322: INFO: Container csi-provisioner ready: false, restart count 0 Jan 24 12:32:31.322: INFO: Container csi-resizer ready: false, restart count 0 Jan 24 12:32:31.322: INFO: Container csi-snapshotter ready: false, restart count 0 Jan 24 12:32:31.322: INFO: Container hostpath ready: false, restart count 0 Jan 24 12:32:31.322: INFO: Container liveness-probe ready: false, restart count 0 Jan 24 12:32:31.322: INFO: Container node-driver-registrar ready: false, restart count 0 Jan 24 12:32:31.322: INFO: pod-subpath-test-preprovisionedpv-pj5s started at 2023-01-24 12:30:23 +0000 UTC (0+2 container statuses recorded) Jan 24 12:32:31.322: INFO: Container test-container-subpath-preprovisionedpv-pj5s ready: false, restart count 0 Jan 24 12:32:31.322: INFO: Container test-container-volume-preprovisionedpv-pj5s ready: false, restart count 0 Jan 24 12:32:31.322: INFO: fail-once-local-t84jj started at 2023-01-24 12:20:44 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:31.322: INFO: Container c ready: false, restart count 0 Jan 24 12:32:31.322: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-8ztk4 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:31.322: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:32:31.322: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-tzgzx started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:32:31.322: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:32:31.569: INFO: Latency metrics for node ip-172-20-63-190.us-west-1.compute.internal Jan 24 12:32:31.569: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "volume-expand-1313" for this suite.
Find pod-618aaf08-0a27-46db-982a-1b26fb9fffa7 mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\sExternal\sStorage\s\[Driver\:\sebs\.csi\.aws\.com\]\s\[Testpattern\:\sDynamic\sPV\s\(default\sfs\)\]\sprovisioning\sshould\sprovision\sstorage\swith\smount\soptions$'
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/provisioning.go:180 Jan 24 12:25:29.698: Unexpected error: <*errors.errorString | 0xc004844740>: { s: "pod \"pod-ea0a4a16-77cf-4d6c-8028-d52d846083e3\" is not Running: timed out waiting for the condition", } pod "pod-ea0a4a16-77cf-4d6c-8028-d52d846083e3" is not Running: timed out waiting for the condition occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/provisioning.go:418from junit_14.xml
[BeforeEach] [Testpattern: Dynamic PV (default fs)] provisioning /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51 [BeforeEach] [Testpattern: Dynamic PV (default fs)] provisioning /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Jan 24 12:20:28.749: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename provisioning �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace [It] should provision storage with mount options /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/provisioning.go:180 Jan 24 12:20:29.163: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil Jan 24 12:20:29.163: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil Jan 24 12:20:29.163: INFO: In creating storage class object and pvc objects for driver - sc: &StorageClass{ObjectMeta:{provisioning-454-e2e-scsx7gg 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},Provisioner:ebs.csi.aws.com,Parameters:map[string]string{encrypted: true,type: gp3,},ReclaimPolicy:nil,MountOptions:[],AllowVolumeExpansion:*true,VolumeBindingMode:*WaitForFirstConsumer,AllowedTopologies:[]TopologySelectorTerm{},}, pvc: &PersistentVolumeClaim{ObjectMeta:{ pvc- provisioning-454 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{1073741824 0} {<nil>} 1Gi BinarySI},},},VolumeName:,Selector:nil,StorageClassName:*provisioning-454-e2e-scsx7gg,VolumeMode:nil,DataSource:nil,DataSourceRef:nil,},Status:PersistentVolumeClaimStatus{Phase:,AccessModes:[],Capacity:ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},AllocatedResources:ResourceList{},ResizeStatus:nil,},}, src-pvc: &PersistentVolumeClaim{ObjectMeta:{ pvc- provisioning-454 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{1073741824 0} {<nil>} 1Gi BinarySI},},},VolumeName:,Selector:nil,StorageClassName:*provisioning-454-e2e-scsx7gg,VolumeMode:nil,DataSource:nil,DataSourceRef:nil,},Status:PersistentVolumeClaimStatus{Phase:,AccessModes:[],Capacity:ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},AllocatedResources:ResourceList{},ResizeStatus:nil,},} �[1mSTEP�[0m: Creating a StorageClass �[1mSTEP�[0m: creating claim=&PersistentVolumeClaim{ObjectMeta:{ pvc- provisioning-454 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{1073741824 0} {<nil>} 1Gi BinarySI},},},VolumeName:,Selector:nil,StorageClassName:*provisioning-454-e2e-scsx7gg,VolumeMode:nil,DataSource:nil,DataSourceRef:nil,},Status:PersistentVolumeClaimStatus{Phase:,AccessModes:[],Capacity:ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},AllocatedResources:ResourceList{},ResizeStatus:nil,},} �[1mSTEP�[0m: creating a pod referring to the class=&StorageClass{ObjectMeta:{provisioning-454-e2e-scsx7gg a13bd5dd-f4e0-4002-b7a4-1e1cd11ed453 23295 0 2023-01-24 12:20:29 +0000 UTC <nil> <nil> map[] map[] [] [] [{e2e.test Update storage.k8s.io/v1 2023-01-24 12:20:29 +0000 UTC FieldsV1 {"f:allowVolumeExpansion":{},"f:mountOptions":{},"f:parameters":{".":{},"f:encrypted":{},"f:type":{}},"f:provisioner":{},"f:reclaimPolicy":{},"f:volumeBindingMode":{}} }]},Provisioner:ebs.csi.aws.com,Parameters:map[string]string{encrypted: true,type: gp3,},ReclaimPolicy:*Delete,MountOptions:[dirsync],AllowVolumeExpansion:*true,VolumeBindingMode:*WaitForFirstConsumer,AllowedTopologies:[]TopologySelectorTerm{},} claim=&PersistentVolumeClaim{ObjectMeta:{pvc-jkjf6 pvc- provisioning-454 684158a9-1b38-4bbf-9fae-6cb4da55c1c4 23296 0 2023-01-24 12:20:29 +0000 UTC <nil> <nil> map[] map[] [] [kubernetes.io/pvc-protection] [{e2e.test Update v1 2023-01-24 12:20:29 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{}},"f:spec":{"f:accessModes":{},"f:resources":{"f:requests":{".":{},"f:storage":{}}},"f:storageClassName":{},"f:volumeMode":{}}} }]},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{1073741824 0} {<nil>} 1Gi BinarySI},},},VolumeName:,Selector:nil,StorageClassName:*provisioning-454-e2e-scsx7gg,VolumeMode:*Filesystem,DataSource:nil,DataSourceRef:nil,},Status:PersistentVolumeClaimStatus{Phase:Pending,AccessModes:[],Capacity:ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},AllocatedResources:ResourceList{},ResizeStatus:nil,},} Jan 24 12:25:29.698: FAIL: Unexpected error: <*errors.errorString | 0xc004844740>: { s: "pod \"pod-ea0a4a16-77cf-4d6c-8028-d52d846083e3\" is not Running: timed out waiting for the condition", } pod "pod-ea0a4a16-77cf-4d6c-8028-d52d846083e3" is not Running: timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/storage/testsuites.StorageClassTest.TestDynamicProvisioning({{0x7938928, 0xc001e5b080}, 0xc0038f1a80, 0xc005494000, 0xc0054941e0, 0xc001e5b980, {0x0, 0x0}, {0x0, 0x0, ...}, ...}) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/provisioning.go:418 +0x807 k8s.io/kubernetes/test/e2e/storage/testsuites.(*provisioningTestSuite).DefineTests.func3() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/provisioning.go:198 +0x3c5 k8s.io/kubernetes/test/e2e.RunE2ETests(0x24eec17?) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:133 +0x6b7 k8s.io/kubernetes/test/e2e.TestE2E(0x24602d9?) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc000c46000, 0x72ecb90) /usr/local/go/src/testing/testing.go:1446 +0x10b created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1493 +0x35f Jan 24 12:25:29.699: INFO: deleting claim "provisioning-454"/"pvc-jkjf6" Jan 24 12:25:29.762: INFO: deleting storage class provisioning-454-e2e-scsx7gg [AfterEach] [Testpattern: Dynamic PV (default fs)] provisioning /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "provisioning-454". �[1mSTEP�[0m: Found 16 events. Jan 24 12:25:29.883: INFO: At 2023-01-24 12:20:29 +0000 UTC - event for pvc-jkjf6: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding Jan 24 12:25:29.883: INFO: At 2023-01-24 12:20:29 +0000 UTC - event for pvc-jkjf6: {ebs.csi.aws.com_ip-172-20-42-201_746df1a9-d9c8-443b-9c11-e00bf4e14a5c } Provisioning: External provisioner is provisioning volume for claim "provisioning-454/pvc-jkjf6" Jan 24 12:25:29.883: INFO: At 2023-01-24 12:20:29 +0000 UTC - event for pvc-jkjf6: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "ebs.csi.aws.com" or manually created by system administrator Jan 24 12:25:29.883: INFO: At 2023-01-24 12:20:32 +0000 UTC - event for pvc-jkjf6: {ebs.csi.aws.com_ip-172-20-42-201_746df1a9-d9c8-443b-9c11-e00bf4e14a5c } ProvisioningSucceeded: Successfully provisioned volume pvc-684158a9-1b38-4bbf-9fae-6cb4da55c1c4 Jan 24 12:25:29.883: INFO: At 2023-01-24 12:20:33 +0000 UTC - event for pod-ea0a4a16-77cf-4d6c-8028-d52d846083e3: {default-scheduler } Scheduled: Successfully assigned provisioning-454/pod-ea0a4a16-77cf-4d6c-8028-d52d846083e3 to ip-172-20-63-190.us-west-1.compute.internal Jan 24 12:25:29.883: INFO: At 2023-01-24 12:20:35 +0000 UTC - event for pod-ea0a4a16-77cf-4d6c-8028-d52d846083e3: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-684158a9-1b38-4bbf-9fae-6cb4da55c1c4" Jan 24 12:25:29.883: INFO: At 2023-01-24 12:20:38 +0000 UTC - event for pod-ea0a4a16-77cf-4d6c-8028-d52d846083e3: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "4e3ea7d9316bb4a8963f2bbe0ee6b7a373728931f970b78583935b4ab8a4336c": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:29.883: INFO: At 2023-01-24 12:20:53 +0000 UTC - event for pod-ea0a4a16-77cf-4d6c-8028-d52d846083e3: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "efd9efec941a6c3470b38371fe4be3bbfc719bb19bf45003fbd8dafa23e536fe": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:29.883: INFO: At 2023-01-24 12:21:07 +0000 UTC - event for pod-ea0a4a16-77cf-4d6c-8028-d52d846083e3: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "dd73d6ef45547fb4ea00d350b2c3933ff89744050871b6572bcce7e1ec4b93d3": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:29.883: INFO: At 2023-01-24 12:21:22 +0000 UTC - event for pod-ea0a4a16-77cf-4d6c-8028-d52d846083e3: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "76e71a32120a91fbb5919aee179fa5bfb0d9fd71a56a0f9389e4ce08e07635f3": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:29.883: INFO: At 2023-01-24 12:21:36 +0000 UTC - event for pod-ea0a4a16-77cf-4d6c-8028-d52d846083e3: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "fe3a877d08ead6b97d15602c9f106bfde3ce2c7709fdbfa67f1bb213d277894f": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:29.883: INFO: At 2023-01-24 12:21:48 +0000 UTC - event for pod-ea0a4a16-77cf-4d6c-8028-d52d846083e3: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "cd9d74c64d6fbd577088c92ab90eed7360ee8a6c537a624b1c456e53199dc3e1": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:29.883: INFO: At 2023-01-24 12:22:02 +0000 UTC - event for pod-ea0a4a16-77cf-4d6c-8028-d52d846083e3: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "3cadbd6e1761a75816daacc184639d57896a1fdace208cd9400649fc137c59af": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:29.883: INFO: At 2023-01-24 12:22:14 +0000 UTC - event for pod-ea0a4a16-77cf-4d6c-8028-d52d846083e3: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "81c09fef519f7a58075c2bf95b99f878f40848d53070640a27e45a927f92d96b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:29.883: INFO: At 2023-01-24 12:22:29 +0000 UTC - event for pod-ea0a4a16-77cf-4d6c-8028-d52d846083e3: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "2626056354155173bae2110751e9f4d49eec0fee9fce6466ed034dfdd06ed062": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:29.883: INFO: At 2023-01-24 12:22:43 +0000 UTC - event for pod-ea0a4a16-77cf-4d6c-8028-d52d846083e3: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "142d0d35f3223ef647c499f9293e7e650d8946ae4bde6d00745dcc8f4666124a": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:29.942: INFO: POD NODE PHASE GRACE CONDITIONS Jan 24 12:25:29.942: INFO: pod-ea0a4a16-77cf-4d6c-8028-d52d846083e3 ip-172-20-63-190.us-west-1.compute.internal Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:20:33 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:20:33 +0000 UTC ContainersNotReady containers with unready status: [write-pod]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:20:33 +0000 UTC ContainersNotReady containers with unready status: [write-pod]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:20:33 +0000 UTC }] Jan 24 12:25:29.942: INFO: Jan 24 12:25:30.003: INFO: Unable to fetch provisioning-454/pod-ea0a4a16-77cf-4d6c-8028-d52d846083e3/write-pod logs: the server rejected our request for an unknown reason (get pods pod-ea0a4a16-77cf-4d6c-8028-d52d846083e3) Jan 24 12:25:30.063: INFO: Logging node info for node ip-172-20-42-201.us-west-1.compute.internal Jan 24 12:25:30.122: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-42-201.us-west-1.compute.internal cc6006a6-61fd-4f4c-b296-ba72367bb0f8 25014 0 2023-01-24 12:07:14 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-1 failure-domain.beta.kubernetes.io/zone:us-west-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-42-201.us-west-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/control-plane: node-role.kubernetes.io/master: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:us-west-1a topology.kubernetes.io/region:us-west-1 topology.kubernetes.io/zone:us-west-1a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-08c27beef2082266b"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-24 12:07:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {protokube Update v1 2023-01-24 12:07:41 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kops-controller Update v1 2023-01-24 12:07:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/master":{}}}} } {kube-controller-manager Update v1 2023-01-24 12:07:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-24 12:09:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-1a/i-08c27beef2082266b,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892264960 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787407360 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-24 12:25:07 +0000 UTC,LastTransitionTime:2023-01-24 12:07:14 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-24 12:25:07 +0000 UTC,LastTransitionTime:2023-01-24 12:07:14 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-24 12:25:07 +0000 UTC,LastTransitionTime:2023-01-24 12:07:14 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-24 12:25:07 +0000 UTC,LastTransitionTime:2023-01-24 12:07:55 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.201,},NodeAddress{Type:ExternalIP,Address:54.215.124.25,},NodeAddress{Type:Hostname,Address:ip-172-20-42-201.us-west-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-42-201.us-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-215-124-25.us-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2be20fd28580af17ed5c32106be540,SystemUUID:ec2be20f-d285-80af-17ed-5c32106be540,BootID:cb576848-3e1b-4407-b81d-d34a637f2afd,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.23.16,KubeProxyVersion:v1.23.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.23.16 registry.k8s.io/kube-apiserver-amd64:v1.23.16],SizeBytes:131340755,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.23.16 registry.k8s.io/kube-controller-manager-amd64:v1.23.16],SizeBytes:121280825,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.16 registry.k8s.io/kube-proxy-amd64:v1.23.16],SizeBytes:112743991,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.23.16 registry.k8s.io/kube-scheduler-amd64:v1.23.16],SizeBytes:53193016,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-beta.2],SizeBytes:43191763,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-beta.2],SizeBytes:42821714,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-beta.2],SizeBytes:4965793,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 24 12:25:30.123: INFO: Logging kubelet events for node ip-172-20-42-201.us-west-1.compute.internal Jan 24 12:25:30.184: INFO: Logging pods the kubelet thinks is on node ip-172-20-42-201.us-west-1.compute.internal Jan 24 12:25:30.307: INFO: etcd-manager-events-ip-172-20-42-201.us-west-1.compute.internal started at 2023-01-24 12:06:45 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:30.307: INFO: Container etcd-manager ready: true, restart count 0 Jan 24 12:25:30.307: INFO: etcd-manager-main-ip-172-20-42-201.us-west-1.compute.internal started at 2023-01-24 12:06:45 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:30.307: INFO: Container etcd-manager ready: true, restart count 0 Jan 24 12:25:30.307: INFO: kube-apiserver-ip-172-20-42-201.us-west-1.compute.internal started at 2023-01-24 12:06:45 +0000 UTC (0+2 container statuses recorded) Jan 24 12:25:30.307: INFO: Container healthcheck ready: true, restart count 0 Jan 24 12:25:30.307: INFO: Container kube-apiserver ready: true, restart count 1 Jan 24 12:25:30.307: INFO: ebs-csi-node-4lwrc started at 2023-01-24 12:07:40 +0000 UTC (0+3 container statuses recorded) Jan 24 12:25:30.307: INFO: Container ebs-plugin ready: true, restart count 0 Jan 24 12:25:30.307: INFO: Container liveness-probe ready: true, restart count 0 Jan 24 12:25:30.307: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 24 12:25:30.307: INFO: kops-controller-8k2c2 started at 2023-01-24 12:07:41 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:30.307: INFO: Container kops-controller ready: true, restart count 0 Jan 24 12:25:30.307: INFO: ebs-csi-controller-7bd4fbc786-nm7v4 started at 2023-01-24 12:07:42 +0000 UTC (0+5 container statuses recorded) Jan 24 12:25:30.307: INFO: Container csi-attacher ready: true, restart count 0 Jan 24 12:25:30.307: INFO: Container csi-provisioner ready: true, restart count 0 Jan 24 12:25:30.307: INFO: Container csi-resizer ready: true, restart count 0 Jan 24 12:25:30.307: INFO: Container ebs-plugin ready: true, restart count 0 Jan 24 12:25:30.307: INFO: Container liveness-probe ready: true, restart count 0 Jan 24 12:25:30.307: INFO: kube-controller-manager-ip-172-20-42-201.us-west-1.compute.internal started at 2023-01-24 12:06:45 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:30.307: INFO: Container kube-controller-manager ready: true, restart count 2 Jan 24 12:25:30.307: INFO: kube-scheduler-ip-172-20-42-201.us-west-1.compute.internal started at 2023-01-24 12:06:45 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:30.307: INFO: Container kube-scheduler ready: true, restart count 0 Jan 24 12:25:30.307: INFO: cilium-5dpkw started at 2023-01-24 12:07:38 +0000 UTC (1+1 container statuses recorded) Jan 24 12:25:30.307: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 24 12:25:30.307: INFO: Container cilium-agent ready: true, restart count 1 Jan 24 12:25:30.307: INFO: cilium-operator-d84d55876-rfmxk started at 2023-01-24 12:07:41 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:30.307: INFO: Container cilium-operator ready: true, restart count 1 Jan 24 12:25:30.307: INFO: dns-controller-58d7bbb845-c475n started at 2023-01-24 12:07:41 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:30.307: INFO: Container dns-controller ready: true, restart count 0 Jan 24 12:25:30.551: INFO: Latency metrics for node ip-172-20-42-201.us-west-1.compute.internal Jan 24 12:25:30.551: INFO: Logging node info for node ip-172-20-58-8.us-west-1.compute.internal Jan 24 12:25:30.611: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-58-8.us-west-1.compute.internal 4a97117d-69ce-4a16-9e93-9e41b32a9a62 24073 0 2023-01-24 12:09:13 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-1 failure-domain.beta.kubernetes.io/zone:us-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-58-8.us-west-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-1a topology.hostpath.csi/node:ip-172-20-58-8.us-west-1.compute.internal topology.kubernetes.io/region:us-west-1 topology.kubernetes.io/zone:us-west-1a] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-5577":"csi-mock-csi-mock-volumes-5577","ebs.csi.aws.com":"i-0cf7a751b954f0403"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2023-01-24 12:09:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-24 12:09:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-24 12:09:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-01-24 12:17:56 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-24 12:18:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {e2e.test Update v1 2023-01-24 12:19:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-1a/i-0cf7a751b954f0403,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051644416 0} {<nil>} 3956684Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946786816 0} {<nil>} 3854284Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-24 12:21:05 +0000 UTC,LastTransitionTime:2023-01-24 12:09:13 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-24 12:21:05 +0000 UTC,LastTransitionTime:2023-01-24 12:09:13 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-24 12:21:05 +0000 UTC,LastTransitionTime:2023-01-24 12:09:13 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-24 12:21:05 +0000 UTC,LastTransitionTime:2023-01-24 12:09:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.58.8,},NodeAddress{Type:ExternalIP,Address:52.53.154.168,},NodeAddress{Type:Hostname,Address:ip-172-20-58-8.us-west-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-58-8.us-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-52-53-154-168.us-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec21f66ef1338663d7ef9e17ce7835a7,SystemUUID:ec21f66e-f133-8663-d7ef-9e17ce7835a7,BootID:e76a2ed0-0929-4d54-b334-e1f0ad9eacd2,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.23.16,KubeProxyVersion:v1.23.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.16 registry.k8s.io/kube-proxy-amd64:v1.23.16],SizeBytes:112743991,},ContainerImage{Names:[docker.io/library/nginx@sha256:b8f2383a95879e1ae064940d9a200f67a6c79e710ed82ac42263397367e7cc4e docker.io/library/nginx:latest],SizeBytes:56882371,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a k8s.gcr.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 k8s.gcr.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-00a8f7338bd3c4426],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-00a8f7338bd3c4426,DevicePath:,},},Config:nil,},} Jan 24 12:25:30.612: INFO: Logging kubelet events for node ip-172-20-58-8.us-west-1.compute.internal Jan 24 12:25:30.673: INFO: Logging pods the kubelet thinks is on node ip-172-20-58-8.us-west-1.compute.internal Jan 24 12:25:30.798: INFO: coredns-867df8f45c-8jvsj started at 2023-01-24 12:09:41 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:30.798: INFO: Container coredns ready: true, restart count 0 Jan 24 12:25:30.798: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-qdqt9 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:30.798: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:30.798: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-vj22z started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:30.798: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:30.798: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-5znh6 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:30.798: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:30.798: INFO: webserver-deployment-5d9fdcc779-xz6r8 started at 2023-01-24 12:20:33 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:30.798: INFO: Container httpd ready: true, restart count 0 Jan 24 12:25:30.798: INFO: csi-mockplugin-0 started at 2023-01-24 12:20:09 +0000 UTC (0+3 container statuses recorded) Jan 24 12:25:30.798: INFO: Container csi-provisioner ready: true, restart count 0 Jan 24 12:25:30.798: INFO: Container driver-registrar ready: true, restart count 0 Jan 24 12:25:30.798: INFO: Container mock ready: true, restart count 0 Jan 24 12:25:30.798: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-qbrts started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:30.798: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: false, restart count 0 Jan 24 12:25:30.798: INFO: hostexec-ip-172-20-58-8.us-west-1.compute.internal-c2xpk started at 2023-01-24 12:25:03 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:30.798: INFO: Container agnhost-container ready: true, restart count 0 Jan 24 12:25:30.798: INFO: hostpathsymlink-injector started at 2023-01-24 12:21:09 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:30.798: INFO: Container hostpathsymlink-injector ready: false, restart count 0 Jan 24 12:25:30.798: INFO: hostexec-ip-172-20-58-8.us-west-1.compute.internal-zp8t6 started at 2023-01-24 12:21:11 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:30.798: INFO: Container agnhost-container ready: true, restart count 0 Jan 24 12:25:30.798: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-qccgl started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:30.798: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:30.798: INFO: pod-subpath-test-preprovisionedpv-mmwc started at 2023-01-24 12:21:25 +0000 UTC (2+2 container statuses recorded) Jan 24 12:25:30.798: INFO: Init container init-volume-preprovisionedpv-mmwc ready: false, restart count 0 Jan 24 12:25:30.798: INFO: Init container test-init-subpath-preprovisionedpv-mmwc ready: false, restart count 0 Jan 24 12:25:30.798: INFO: Container test-container-subpath-preprovisionedpv-mmwc ready: false, restart count 0 Jan 24 12:25:30.798: INFO: Container test-container-volume-preprovisionedpv-mmwc ready: false, restart count 0 Jan 24 12:25:30.798: INFO: webserver-deployment-5d9fdcc779-qmwf2 started at 2023-01-24 12:20:33 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:30.798: INFO: Container httpd ready: false, restart count 0 Jan 24 12:25:30.798: INFO: hostpath-symlink-prep-provisioning-3666 started at 2023-01-24 12:21:28 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:30.798: INFO: Container init-volume-provisioning-3666 ready: false, restart count 0 Jan 24 12:25:30.798: INFO: netserver-0 started at 2023-01-24 12:24:45 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:30.798: INFO: Container webserver ready: false, restart count 0 Jan 24 12:25:30.798: INFO: ebs-csi-node-4bbqn started at 2023-01-24 12:09:14 +0000 UTC (0+3 container statuses recorded) Jan 24 12:25:30.798: INFO: Container ebs-plugin ready: true, restart count 0 Jan 24 12:25:30.798: INFO: Container liveness-probe ready: true, restart count 0 Jan 24 12:25:30.798: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 24 12:25:30.798: INFO: ss-1 started at 2023-01-24 12:19:34 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:30.798: INFO: Container webserver ready: true, restart count 0 Jan 24 12:25:30.798: INFO: pvc-volume-tester-gnxjv started at 2023-01-24 12:21:49 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:30.798: INFO: Container volume-tester ready: false, restart count 0 Jan 24 12:25:30.798: INFO: ss2-2 started at 2023-01-24 12:19:40 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:30.798: INFO: Container webserver ready: false, restart count 0 Jan 24 12:25:30.798: INFO: pod-c333283a-a7fd-4c9e-9b2c-ec103bf12056 started at 2023-01-24 12:25:06 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:30.798: INFO: Container write-pod ready: false, restart count 0 Jan 24 12:25:30.798: INFO: cilium-nchqx started at 2023-01-24 12:09:14 +0000 UTC (1+1 container statuses recorded) Jan 24 12:25:30.798: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 24 12:25:30.798: INFO: Container cilium-agent ready: true, restart count 0 Jan 24 12:25:30.798: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-5q458 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:30.798: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:30.798: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-fhs4l started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:30.798: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:30.798: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-26vrc started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:30.798: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:30.798: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-c7hrk started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:30.798: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:30.798: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-58gdd started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:30.798: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: false, restart count 0 Jan 24 12:25:31.072: INFO: Latency metrics for node ip-172-20-58-8.us-west-1.compute.internal Jan 24 12:25:31.072: INFO: Logging node info for node ip-172-20-62-42.us-west-1.compute.internal Jan 24 12:25:31.131: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-62-42.us-west-1.compute.internal 2f9a48a1-cd3d-4169-9d63-d46bd4e4c90b 23246 0 2023-01-24 12:09:10 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-1 failure-domain.beta.kubernetes.io/zone:us-west-1a io.kubernetes.storage.mock/node:some-mock-node kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-62-42.us-west-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-1a topology.hostpath.csi/node:ip-172-20-62-42.us-west-1.compute.internal topology.kubernetes.io/region:us-west-1 topology.kubernetes.io/zone:us-west-1a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0d97debf14f45ab50"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-24 12:09:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-24 12:09:11 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-24 12:09:11 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kube-controller-manager Update v1 2023-01-24 12:17:35 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-24 12:17:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {e2e.test Update v1 2023-01-24 12:19:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-1a/i-0d97debf14f45ab50,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051644416 0} {<nil>} 3956684Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946786816 0} {<nil>} 3854284Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-24 12:20:26 +0000 UTC,LastTransitionTime:2023-01-24 12:09:10 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-24 12:20:26 +0000 UTC,LastTransitionTime:2023-01-24 12:09:10 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-24 12:20:26 +0000 UTC,LastTransitionTime:2023-01-24 12:09:10 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-24 12:20:26 +0000 UTC,LastTransitionTime:2023-01-24 12:09:31 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.62.42,},NodeAddress{Type:ExternalIP,Address:18.144.79.13,},NodeAddress{Type:Hostname,Address:ip-172-20-62-42.us-west-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-62-42.us-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-144-79-13.us-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2f0698917764d226ec108df5fcfc56,SystemUUID:ec2f0698-9177-64d2-26ec-108df5fcfc56,BootID:c6c940f9-7462-43d1-92da-e4a2c837556e,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.23.16,KubeProxyVersion:v1.23.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.16 registry.k8s.io/kube-proxy-amd64:v1.23.16],SizeBytes:112743991,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0719cd6c97522c42b kubernetes.io/csi/ebs.csi.aws.com^vol-08b09c9a68b8e7c77],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-08b09c9a68b8e7c77,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0719cd6c97522c42b,DevicePath:,},},Config:nil,},} Jan 24 12:25:31.132: INFO: Logging kubelet events for node ip-172-20-62-42.us-west-1.compute.internal Jan 24 12:25:31.204: INFO: Logging pods the kubelet thinks is on node ip-172-20-62-42.us-west-1.compute.internal Jan 24 12:25:31.331: INFO: indexed-job-1-4twdx started at 2023-01-24 12:21:23 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:31.331: INFO: Container c ready: false, restart count 0 Jan 24 12:25:31.331: INFO: netserver-1 started at 2023-01-24 12:24:45 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:31.331: INFO: Container webserver ready: false, restart count 0 Jan 24 12:25:31.331: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-l77fq started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:31.331: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:31.331: INFO: webserver-deployment-5d9fdcc779-9vj6f started at 2023-01-24 12:20:33 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:31.331: INFO: Container httpd ready: true, restart count 0 Jan 24 12:25:31.331: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-ls58g started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:31.331: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:31.331: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-pq8gm started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:31.331: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:31.331: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-ct4xp started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:31.331: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: false, restart count 0 Jan 24 12:25:31.331: INFO: webserver-deployment-5d9fdcc779-fv2mx started at 2023-01-24 12:20:33 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:31.331: INFO: Container httpd ready: false, restart count 0 Jan 24 12:25:31.331: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-cdkxl started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:31.331: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:31.331: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-jmg66 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:31.331: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:31.331: INFO: netserver-1 started at 2023-01-24 12:25:31 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:31.331: INFO: Container webserver ready: false, restart count 0 Jan 24 12:25:31.331: INFO: ss-0 started at 2023-01-24 12:18:53 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:31.331: INFO: Container webserver ready: true, restart count 0 Jan 24 12:25:31.331: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-g4s7s started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:31.331: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:31.331: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-cc5vr started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:31.331: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:31.331: INFO: pod-client started at 2023-01-24 12:20:15 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:31.331: INFO: Container pod-client ready: true, restart count 0 Jan 24 12:25:31.331: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-m869g started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:31.331: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:31.331: INFO: ebs-csi-node-9pt8t started at 2023-01-24 12:09:11 +0000 UTC (0+3 container statuses recorded) Jan 24 12:25:31.331: INFO: Container ebs-plugin ready: true, restart count 0 Jan 24 12:25:31.331: INFO: Container liveness-probe ready: true, restart count 0 Jan 24 12:25:31.331: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 24 12:25:31.331: INFO: cilium-45k6r started at 2023-01-24 12:09:11 +0000 UTC (1+1 container statuses recorded) Jan 24 12:25:31.331: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 24 12:25:31.331: INFO: Container cilium-agent ready: true, restart count 0 Jan 24 12:25:31.331: INFO: var-expansion-07acec39-86b9-4e15-805b-2b0a172a9495 started at 2023-01-24 12:24:48 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:31.331: INFO: Container dapi-container ready: false, restart count 0 Jan 24 12:25:31.331: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-w4rqg started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:31.331: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:31.331: INFO: ss-0 started at 2023-01-24 12:21:08 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:31.331: INFO: Container webserver ready: false, restart count 0 Jan 24 12:25:31.716: INFO: Latency metrics for node ip-172-20-62-42.us-west-1.compute.internal Jan 24 12:25:31.716: INFO: Logging node info for node ip-172-20-63-134.us-west-1.compute.internal Jan 24 12:25:31.776: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-63-134.us-west-1.compute.internal 30ac81c2-1bcf-49af-aa05-528c41f9d04a 25045 0 2023-01-24 12:09:05 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-1 failure-domain.beta.kubernetes.io/zone:us-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-63-134.us-west-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-1a topology.hostpath.csi/node:ip-172-20-63-134.us-west-1.compute.internal topology.kubernetes.io/region:us-west-1 topology.kubernetes.io/zone:us-west-1a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0f4c0c89e622dd2cb"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2023-01-24 12:09:05 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-24 12:09:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-01-24 12:09:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-24 12:16:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-01-24 12:16:21 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {e2e.test Update v1 2023-01-24 12:19:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-1a/i-0f4c0c89e622dd2cb,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051644416 0} {<nil>} 3956684Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946786816 0} {<nil>} 3854284Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-24 12:25:14 +0000 UTC,LastTransitionTime:2023-01-24 12:09:05 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-24 12:25:14 +0000 UTC,LastTransitionTime:2023-01-24 12:09:05 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-24 12:25:14 +0000 UTC,LastTransitionTime:2023-01-24 12:09:05 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-24 12:25:14 +0000 UTC,LastTransitionTime:2023-01-24 12:09:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.63.134,},NodeAddress{Type:ExternalIP,Address:13.52.252.72,},NodeAddress{Type:Hostname,Address:ip-172-20-63-134.us-west-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-63-134.us-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-52-252-72.us-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec216b16315774b9b69907761ee0f87b,SystemUUID:ec216b16-3157-74b9-b699-07761ee0f87b,BootID:a0b9767c-5621-442f-8ded-9126e82e52b2,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.23.16,KubeProxyVersion:v1.23.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.16 registry.k8s.io/kube-proxy-amd64:v1.23.16],SizeBytes:112743991,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[docker.io/library/nginx@sha256:b8f2383a95879e1ae064940d9a200f67a6c79e710ed82ac42263397367e7cc4e docker.io/library/nginx:latest],SizeBytes:56882371,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a k8s.gcr.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 k8s.gcr.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac k8s.gcr.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0ff989d77482eddbb],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0ff989d77482eddbb,DevicePath:,},},Config:nil,},} Jan 24 12:25:31.776: INFO: Logging kubelet events for node ip-172-20-63-134.us-west-1.compute.internal Jan 24 12:25:31.838: INFO: Logging pods the kubelet thinks is on node ip-172-20-63-134.us-west-1.compute.internal Jan 24 12:25:31.962: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-g7hv8 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:31.962: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:31.962: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-dwht5 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:31.962: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:31.962: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-gp5cx started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:31.962: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:31.962: INFO: csi-hostpathplugin-0 started at 2023-01-24 12:20:09 +0000 UTC (0+7 container statuses recorded) Jan 24 12:25:31.962: INFO: Container csi-attacher ready: false, restart count 0 Jan 24 12:25:31.962: INFO: Container csi-provisioner ready: false, restart count 0 Jan 24 12:25:31.962: INFO: Container csi-resizer ready: false, restart count 0 Jan 24 12:25:31.962: INFO: Container csi-snapshotter ready: false, restart count 0 Jan 24 12:25:31.962: INFO: Container hostpath ready: false, restart count 0 Jan 24 12:25:31.962: INFO: Container liveness-probe ready: false, restart count 0 Jan 24 12:25:31.962: INFO: Container node-driver-registrar ready: false, restart count 0 Jan 24 12:25:31.962: INFO: pod-handle-http-request started at 2023-01-24 12:20:51 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:31.962: INFO: Container agnhost-container ready: false, restart count 0 Jan 24 12:25:31.962: INFO: netserver-2 started at 2023-01-24 12:24:45 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:31.962: INFO: Container webserver ready: false, restart count 0 Jan 24 12:25:31.962: INFO: netserver-2 started at 2023-01-24 12:25:31 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:31.962: INFO: Container webserver ready: false, restart count 0 Jan 24 12:25:31.962: INFO: ebs-csi-node-v75jm started at 2023-01-24 12:09:06 +0000 UTC (0+3 container statuses recorded) Jan 24 12:25:31.962: INFO: Container ebs-plugin ready: true, restart count 0 Jan 24 12:25:31.962: INFO: Container liveness-probe ready: true, restart count 0 Jan 24 12:25:31.962: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 24 12:25:31.962: INFO: csi-hostpathplugin-0 started at 2023-01-24 12:25:18 +0000 UTC (0+7 container statuses recorded) Jan 24 12:25:31.962: INFO: Container csi-attacher ready: false, restart count 0 Jan 24 12:25:31.962: INFO: Container csi-provisioner ready: false, restart count 0 Jan 24 12:25:31.962: INFO: Container csi-resizer ready: false, restart count 0 Jan 24 12:25:31.962: INFO: Container csi-snapshotter ready: false, restart count 0 Jan 24 12:25:31.962: INFO: Container hostpath ready: false, restart count 0 Jan 24 12:25:31.962: INFO: Container liveness-probe ready: false, restart count 0 Jan 24 12:25:31.962: INFO: Container node-driver-registrar ready: false, restart count 0 Jan 24 12:25:31.962: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-vnplb started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:31.962: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:31.962: INFO: ss2-1 started at 2023-01-24 12:19:02 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:31.962: INFO: Container webserver ready: true, restart count 0 Jan 24 12:25:31.962: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-8wf5k started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:31.962: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:31.962: INFO: webserver-deployment-5d9fdcc779-kcxmz started at 2023-01-24 12:20:33 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:31.962: INFO: Container httpd ready: true, restart count 0 Jan 24 12:25:31.962: INFO: webserver-deployment-5d9fdcc779-f4lt5 started at 2023-01-24 12:20:33 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:31.962: INFO: Container httpd ready: false, restart count 0 Jan 24 12:25:31.962: INFO: coredns-autoscaler-557ccb4c66-gl766 started at 2023-01-24 12:09:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:31.962: INFO: Container autoscaler ready: true, restart count 0 Jan 24 12:25:31.962: INFO: coredns-867df8f45c-wcswf started at 2023-01-24 12:09:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:31.962: INFO: Container coredns ready: true, restart count 0 Jan 24 12:25:31.962: INFO: ss-0 started at 2023-01-24 12:19:42 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:31.962: INFO: Container webserver ready: false, restart count 0 Jan 24 12:25:31.962: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-gh2rw started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:31.962: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:31.962: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-bqvzk started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:31.962: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: false, restart count 0 Jan 24 12:25:31.962: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-9kzn4 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:31.962: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: false, restart count 0 Jan 24 12:25:31.963: INFO: cilium-mkm5g started at 2023-01-24 12:09:06 +0000 UTC (1+1 container statuses recorded) Jan 24 12:25:31.963: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 24 12:25:31.963: INFO: Container cilium-agent ready: true, restart count 0 Jan 24 12:25:31.963: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-x2c2b started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:31.963: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:31.963: INFO: webserver-deployment-5d9fdcc779-xwhl2 started at 2023-01-24 12:20:33 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:31.963: INFO: Container httpd ready: false, restart count 0 Jan 24 12:25:31.963: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-b74rw started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:31.963: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:32.203: INFO: Latency metrics for node ip-172-20-63-134.us-west-1.compute.internal Jan 24 12:25:32.204: INFO: Logging node info for node ip-172-20-63-190.us-west-1.compute.internal Jan 24 12:25:32.263: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-63-190.us-west-1.compute.internal d80c92f0-6fa8-4333-b1ea-6b0b4cdbea2d 23714 0 2023-01-24 12:09:12 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-1 failure-domain.beta.kubernetes.io/zone:us-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-63-190.us-west-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-1a topology.hostpath.csi/node:ip-172-20-63-190.us-west-1.compute.internal topology.kubernetes.io/region:us-west-1 topology.kubernetes.io/zone:us-west-1a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0fd113285a9315bba"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2023-01-24 12:09:12 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-24 12:09:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-24 12:09:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-01-24 12:19:02 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-24 12:19:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {e2e.test Update v1 2023-01-24 12:19:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-1a/i-0fd113285a9315bba,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051652608 0} {<nil>} 3956692Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946795008 0} {<nil>} 3854292Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-24 12:20:58 +0000 UTC,LastTransitionTime:2023-01-24 12:09:12 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-24 12:20:58 +0000 UTC,LastTransitionTime:2023-01-24 12:09:12 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-24 12:20:58 +0000 UTC,LastTransitionTime:2023-01-24 12:09:12 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-24 12:20:58 +0000 UTC,LastTransitionTime:2023-01-24 12:09:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.63.190,},NodeAddress{Type:ExternalIP,Address:54.215.249.154,},NodeAddress{Type:Hostname,Address:ip-172-20-63-190.us-west-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-63-190.us-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-215-249-154.us-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec255708dba66ed160033f1fab58ba92,SystemUUID:ec255708-dba6-6ed1-6003-3f1fab58ba92,BootID:4e4cb7aa-a82e-4abd-a66d-5fb285cb6c0b,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.23.16,KubeProxyVersion:v1.23.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.16 registry.k8s.io/kube-proxy-amd64:v1.23.16],SizeBytes:112743991,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-00dc1f3b8024ef2d2 kubernetes.io/csi/ebs.csi.aws.com^vol-057a1367ebd667fa7 kubernetes.io/csi/ebs.csi.aws.com^vol-077d776e5480a39f5 kubernetes.io/csi/ebs.csi.aws.com^vol-08a0be3744dd7cd6f kubernetes.io/csi/ebs.csi.aws.com^vol-0d966a9348a99e832],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-057a1367ebd667fa7,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-08a0be3744dd7cd6f,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0d966a9348a99e832,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-077d776e5480a39f5,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-00dc1f3b8024ef2d2,DevicePath:,},},Config:nil,},} Jan 24 12:25:32.263: INFO: Logging kubelet events for node ip-172-20-63-190.us-west-1.compute.internal Jan 24 12:25:32.325: INFO: Logging pods the kubelet thinks is on node ip-172-20-63-190.us-west-1.compute.internal Jan 24 12:25:32.450: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-s27h5 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:32.450: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:32.450: INFO: cilium-54xb4 started at 2023-01-24 12:09:13 +0000 UTC (1+1 container statuses recorded) Jan 24 12:25:32.450: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 24 12:25:32.450: INFO: Container cilium-agent ready: true, restart count 0 Jan 24 12:25:32.450: INFO: ss-2 started at 2023-01-24 12:19:04 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:32.450: INFO: Container webserver ready: true, restart count 0 Jan 24 12:25:32.450: INFO: fail-once-local-t84jj started at 2023-01-24 12:20:44 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:32.450: INFO: Container c ready: false, restart count 0 Jan 24 12:25:32.450: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-8ztk4 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:32.450: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:32.450: INFO: ss2-0 started at 2023-01-24 12:19:01 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:32.450: INFO: Container webserver ready: true, restart count 0 Jan 24 12:25:32.450: INFO: pod-prestop-hook-56510143-6a4e-4e26-8ba3-e13327e62e97 started at 2023-01-24 12:21:07 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:32.450: INFO: Container nginx ready: false, restart count 0 Jan 24 12:25:32.450: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-tzgzx started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:32.450: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:32.450: INFO: pod-server-1 started at 2023-01-24 12:20:33 +0000 UTC (1+1 container statuses recorded) Jan 24 12:25:32.450: INFO: Init container init ready: false, restart count 0 Jan 24 12:25:32.450: INFO: Container agnhost-container ready: false, restart count 0 Jan 24 12:25:32.450: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-kzfz9 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:32.450: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:32.450: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-9pdvd started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:32.450: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: false, restart count 0 Jan 24 12:25:32.450: INFO: pod-ea0a4a16-77cf-4d6c-8028-d52d846083e3 started at 2023-01-24 12:20:33 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:32.450: INFO: Container write-pod ready: false, restart count 0 Jan 24 12:25:32.450: INFO: ss-1 started at 2023-01-24 12:19:16 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:32.450: INFO: Container webserver ready: false, restart count 0 Jan 24 12:25:32.450: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-dhzcl started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:32.450: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:32.450: INFO: fail-once-local-nkjmd started at 2023-01-24 12:20:23 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:32.450: INFO: Container c ready: false, restart count 0 Jan 24 12:25:32.450: INFO: ebs-csi-node-ld8b2 started at 2023-01-24 12:09:13 +0000 UTC (0+3 container statuses recorded) Jan 24 12:25:32.450: INFO: Container ebs-plugin ready: true, restart count 0 Jan 24 12:25:32.450: INFO: Container liveness-probe ready: true, restart count 0 Jan 24 12:25:32.450: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 24 12:25:32.450: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-vqntn started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:32.450: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:32.451: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-4jptx started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:32.451: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: false, restart count 0 Jan 24 12:25:32.451: INFO: fail-once-local-4kxtz started at 2023-01-24 12:20:23 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:32.451: INFO: Container c ready: false, restart count 1 Jan 24 12:25:32.451: INFO: webserver-deployment-5d9fdcc779-pdnwl started at 2023-01-24 12:20:33 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:32.451: INFO: Container httpd ready: false, restart count 0 Jan 24 12:25:32.451: INFO: webserver-deployment-5d9fdcc779-hqvdm started at 2023-01-24 12:20:33 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:32.451: INFO: Container httpd ready: false, restart count 0 Jan 24 12:25:32.451: INFO: pod-secrets-284a736c-e668-4401-a5da-1059a9ed9b95 started at 2023-01-24 12:20:45 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:32.451: INFO: Container secret-volume-test ready: false, restart count 0 Jan 24 12:25:32.451: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-bcqr7 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:32.451: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:32.451: INFO: indexed-job-0-q2xds started at 2023-01-24 12:21:23 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:32.451: INFO: Container c ready: false, restart count 0 Jan 24 12:25:32.451: INFO: netserver-3 started at 2023-01-24 12:24:46 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:32.451: INFO: Container webserver ready: false, restart count 0 Jan 24 12:25:32.451: INFO: pod-subpath-test-dynamicpv-swqs started at 2023-01-24 12:20:52 +0000 UTC (1+1 container statuses recorded) Jan 24 12:25:32.451: INFO: Init container init-volume-dynamicpv-swqs ready: false, restart count 0 Jan 24 12:25:32.451: INFO: Container test-container-subpath-dynamicpv-swqs ready: false, restart count 0 Jan 24 12:25:32.451: INFO: ss-1 started at 2023-01-24 12:19:17 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:32.451: INFO: Container webserver ready: false, restart count 0 Jan 24 12:25:32.451: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-5rrg5 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:32.451: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:32.451: INFO: webserver-deployment-5d9fdcc779-xtrv9 started at 2023-01-24 12:20:33 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:32.451: INFO: Container httpd ready: true, restart count 0 Jan 24 12:25:32.451: INFO: sample-webhook-deployment-6c69dbd86b-2nv64 started at 2023-01-24 12:21:04 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:32.451: INFO: Container sample-webhook ready: false, restart count 0 Jan 24 12:25:32.451: INFO: netserver-3 started at 2023-01-24 12:25:31 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:32.451: INFO: Container webserver ready: false, restart count 0 Jan 24 12:25:32.705: INFO: Latency metrics for node ip-172-20-63-190.us-west-1.compute.internal Jan 24 12:25:32.705: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "provisioning-454" for this suite.
Find pod-ea0a4a16-77cf-4d6c-8028-d52d846083e3 mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\sExternal\sStorage\s\[Driver\:\sebs\.csi\.aws\.com\]\s\[Testpattern\:\sDynamic\sPV\s\(default\sfs\)\]\ssubPath\sshould\ssupport\sexisting\ssingle\sfile\s\[LinuxOnly\]$'
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:219 Jan 24 12:25:51.436: Unexpected error: <*errors.errorString | 0xc002ae7290>: { s: "expected pod \"pod-subpath-test-dynamicpv-swqs\" success: Gave up after waiting 5m0s for pod \"pod-subpath-test-dynamicpv-swqs\" to be \"Succeeded or Failed\"", } expected pod "pod-subpath-test-dynamicpv-swqs" success: Gave up after waiting 5m0s for pod "pod-subpath-test-dynamicpv-swqs" to be "Succeeded or Failed" occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:770from junit_12.xml
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51 [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Jan 24 12:20:47.664: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename provisioning �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace [It] should support existing single file [LinuxOnly] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:219 Jan 24 12:20:48.075: INFO: Creating resource for dynamic PV Jan 24 12:20:48.075: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} �[1mSTEP�[0m: creating a StorageClass provisioning-465-e2e-scs5rjh �[1mSTEP�[0m: creating a claim Jan 24 12:20:48.136: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil �[1mSTEP�[0m: Creating pod pod-subpath-test-dynamicpv-swqs �[1mSTEP�[0m: Creating a pod to test subpath Jan 24 12:20:48.317: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-swqs" in namespace "provisioning-465" to be "Succeeded or Failed" Jan 24 12:20:48.376: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 58.930417ms Jan 24 12:20:50.435: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 2.118125683s Jan 24 12:20:52.496: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 4.178395512s Jan 24 12:20:54.556: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 6.238936444s Jan 24 12:20:56.615: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 8.298234201s Jan 24 12:20:58.676: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 10.358653003s Jan 24 12:21:00.736: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 12.419295688s Jan 24 12:21:02.798: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 14.480465893s Jan 24 12:21:04.858: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 16.540696261s Jan 24 12:21:06.917: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 18.599827656s Jan 24 12:21:08.977: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 20.660058372s Jan 24 12:21:11.037: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 22.719495336s Jan 24 12:21:13.096: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 24.77907357s Jan 24 12:21:15.156: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 26.838601314s Jan 24 12:21:17.216: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 28.89889883s Jan 24 12:21:19.276: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 30.9591601s Jan 24 12:21:21.337: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 33.019636687s Jan 24 12:21:23.397: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 35.079892643s Jan 24 12:21:25.457: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 37.139661457s Jan 24 12:21:27.517: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 39.200001805s Jan 24 12:21:29.577: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 41.259379639s Jan 24 12:21:31.636: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 43.318816146s Jan 24 12:21:33.696: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 45.379317275s Jan 24 12:21:35.756: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 47.438968552s Jan 24 12:21:37.816: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 49.498355995s Jan 24 12:21:39.876: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 51.558804899s Jan 24 12:21:41.935: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 53.617925685s Jan 24 12:21:43.995: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 55.677685717s Jan 24 12:21:46.055: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 57.737387221s Jan 24 12:21:48.117: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 59.799378016s Jan 24 12:21:50.177: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 1m1.859734565s Jan 24 12:21:52.237: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 1m3.920186087s Jan 24 12:21:54.297: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 1m5.980270991s Jan 24 12:21:56.357: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.03975778s Jan 24 12:21:58.416: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.098900068s Jan 24 12:22:00.476: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.158944098s Jan 24 12:22:02.536: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.218933348s Jan 24 12:22:04.596: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.278883522s Jan 24 12:22:06.656: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.338464497s Jan 24 12:22:08.716: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.398409695s Jan 24 12:22:10.776: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.458784679s Jan 24 12:22:12.836: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.518415259s Jan 24 12:22:14.895: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.577702155s Jan 24 12:22:16.956: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.639136558s Jan 24 12:22:19.016: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.699266139s Jan 24 12:22:21.076: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.758642711s Jan 24 12:22:23.135: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.817893421s Jan 24 12:22:25.195: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.878108174s Jan 24 12:22:27.255: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.937948345s Jan 24 12:22:29.316: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.998539065s Jan 24 12:22:31.375: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 1m43.058181544s Jan 24 12:22:33.435: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 1m45.117902774s Jan 24 12:22:35.495: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 1m47.17804777s Jan 24 12:22:37.555: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 1m49.23791985s Jan 24 12:22:39.616: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 1m51.29844826s Jan 24 12:22:41.675: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 1m53.357543588s Jan 24 12:22:43.734: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 1m55.416696831s Jan 24 12:22:45.793: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 1m57.475959115s Jan 24 12:22:47.854: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 1m59.536448136s Jan 24 12:22:49.914: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 2m1.596982584s Jan 24 12:22:51.974: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 2m3.656548931s Jan 24 12:22:54.034: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 2m5.716370592s Jan 24 12:22:56.094: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 2m7.777169909s Jan 24 12:22:58.154: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 2m9.836842445s Jan 24 12:23:00.215: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 2m11.897628253s Jan 24 12:23:02.275: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 2m13.958165658s Jan 24 12:23:04.336: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.018849307s Jan 24 12:23:06.396: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.078804603s Jan 24 12:23:08.456: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.139305486s Jan 24 12:23:10.517: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.199912308s Jan 24 12:23:12.578: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.261173916s Jan 24 12:23:14.639: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.321831649s Jan 24 12:23:16.699: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.381511608s Jan 24 12:23:18.759: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.44199786s Jan 24 12:23:20.820: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.502404155s Jan 24 12:23:22.880: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.563080802s Jan 24 12:23:24.940: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.622704615s Jan 24 12:23:26.999: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.682292212s Jan 24 12:23:29.060: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.743051528s Jan 24 12:23:31.120: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.802598624s Jan 24 12:23:33.179: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.862005393s Jan 24 12:23:35.239: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.921390286s Jan 24 12:23:37.298: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.980885038s Jan 24 12:23:39.359: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 2m51.041423562s Jan 24 12:23:41.418: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 2m53.100414785s Jan 24 12:23:43.477: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 2m55.159543776s Jan 24 12:23:45.536: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 2m57.218549864s Jan 24 12:23:47.595: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 2m59.277780108s Jan 24 12:23:49.655: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 3m1.337914407s Jan 24 12:23:51.715: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 3m3.397743856s Jan 24 12:23:53.775: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 3m5.457907123s Jan 24 12:23:55.835: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 3m7.517426146s Jan 24 12:23:57.895: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 3m9.578048255s Jan 24 12:23:59.956: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 3m11.638741543s Jan 24 12:24:02.016: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 3m13.698349371s Jan 24 12:24:04.076: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 3m15.758917091s Jan 24 12:24:06.136: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 3m17.818586032s Jan 24 12:24:08.196: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 3m19.87839187s Jan 24 12:24:10.256: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 3m21.938963557s Jan 24 12:24:12.315: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 3m23.998085206s Jan 24 12:24:14.375: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.057557434s Jan 24 12:24:16.434: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.117056551s Jan 24 12:24:18.495: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.177779024s Jan 24 12:24:20.555: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.238058953s Jan 24 12:24:22.615: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.29737083s Jan 24 12:24:24.675: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.357918618s Jan 24 12:24:26.735: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.417835021s Jan 24 12:24:28.795: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.478198149s Jan 24 12:24:30.855: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.537584703s Jan 24 12:24:32.915: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.597770059s Jan 24 12:24:34.975: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.658275769s Jan 24 12:24:37.035: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.717774249s Jan 24 12:24:39.094: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.777193921s Jan 24 12:24:41.154: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.83643072s Jan 24 12:24:43.214: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.896523846s Jan 24 12:24:45.273: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.956181194s Jan 24 12:24:47.334: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 3m59.016723311s Jan 24 12:24:49.393: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 4m1.075888343s Jan 24 12:24:51.453: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 4m3.13563998s Jan 24 12:24:53.513: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 4m5.195854451s Jan 24 12:24:55.572: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 4m7.255106143s Jan 24 12:24:57.633: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 4m9.316197126s Jan 24 12:24:59.692: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 4m11.375172326s Jan 24 12:25:01.752: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 4m13.434903707s Jan 24 12:25:03.812: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 4m15.495022676s Jan 24 12:25:05.872: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 4m17.55480758s Jan 24 12:25:07.932: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 4m19.615247937s Jan 24 12:25:09.992: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 4m21.674939539s Jan 24 12:25:12.051: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 4m23.73427047s Jan 24 12:25:14.111: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 4m25.793911199s Jan 24 12:25:16.170: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 4m27.853222252s Jan 24 12:25:18.231: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 4m29.913464109s Jan 24 12:25:20.290: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 4m31.97287642s Jan 24 12:25:22.349: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.032060779s Jan 24 12:25:24.408: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.091237173s Jan 24 12:25:26.468: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.150822733s Jan 24 12:25:28.527: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.210010887s Jan 24 12:25:30.588: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.270475276s Jan 24 12:25:32.649: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.331518404s Jan 24 12:25:34.709: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.391888048s Jan 24 12:25:36.768: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.451103609s Jan 24 12:25:38.828: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.510589797s Jan 24 12:25:40.888: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.570537762s Jan 24 12:25:42.948: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.630734614s Jan 24 12:25:45.008: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.691269046s Jan 24 12:25:47.069: INFO: Pod "pod-subpath-test-dynamicpv-swqs": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.751392815s Jan 24 12:25:49.189: INFO: Failed to get logs from node "ip-172-20-63-190.us-west-1.compute.internal" pod "pod-subpath-test-dynamicpv-swqs" container "init-volume-dynamicpv-swqs": the server rejected our request for an unknown reason (get pods pod-subpath-test-dynamicpv-swqs) Jan 24 12:25:49.255: INFO: Failed to get logs from node "ip-172-20-63-190.us-west-1.compute.internal" pod "pod-subpath-test-dynamicpv-swqs" container "test-container-subpath-dynamicpv-swqs": the server rejected our request for an unknown reason (get pods pod-subpath-test-dynamicpv-swqs) �[1mSTEP�[0m: delete the pod Jan 24 12:25:49.317: INFO: Waiting for pod pod-subpath-test-dynamicpv-swqs to disappear Jan 24 12:25:49.376: INFO: Pod pod-subpath-test-dynamicpv-swqs still exists Jan 24 12:25:51.377: INFO: Waiting for pod pod-subpath-test-dynamicpv-swqs to disappear Jan 24 12:25:51.436: INFO: Pod pod-subpath-test-dynamicpv-swqs no longer exists Jan 24 12:25:51.436: FAIL: Unexpected error: <*errors.errorString | 0xc002ae7290>: { s: "expected pod \"pod-subpath-test-dynamicpv-swqs\" success: Gave up after waiting 5m0s for pod \"pod-subpath-test-dynamicpv-swqs\" to be \"Succeeded or Failed\"", } expected pod "pod-subpath-test-dynamicpv-swqs" success: Gave up after waiting 5m0s for pod "pod-subpath-test-dynamicpv-swqs" to be "Succeeded or Failed" occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).testContainerOutputMatcher(0xc0034e7800?, {0x705074c?, 0x0?}, 0xc0034e7800, 0x0, {0xc003ae5108, 0x1, 0x1}, 0x0?) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:770 +0x176 k8s.io/kubernetes/test/e2e/framework.(*Framework).TestContainerOutput(...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:567 k8s.io/kubernetes/test/e2e/storage/testsuites.testReadFile(0xc0045af080, {0xc00352e4b0, 0x16}, 0xc0034e7800, 0x0) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:691 +0x15c k8s.io/kubernetes/test/e2e/storage/testsuites.(*subPathTestSuite).DefineTests.func5() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:227 +0x1b8 k8s.io/kubernetes/test/e2e.RunE2ETests(0x24eec17?) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:133 +0x6b7 k8s.io/kubernetes/test/e2e.TestE2E(0x24602d9?) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc000b24680, 0x72ecb90) /usr/local/go/src/testing/testing.go:1446 +0x10b created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1493 +0x35f �[1mSTEP�[0m: Deleting pod Jan 24 12:25:51.437: INFO: Deleting pod "pod-subpath-test-dynamicpv-swqs" in namespace "provisioning-465" �[1mSTEP�[0m: Deleting pvc Jan 24 12:25:51.613: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.comj24mb" Jan 24 12:25:51.675: INFO: Waiting up to 3m0s for PersistentVolume pvc-262b7e77-e83f-4966-871c-ffc5157ee860 to get deleted Jan 24 12:25:51.734: INFO: PersistentVolume pvc-262b7e77-e83f-4966-871c-ffc5157ee860 found and phase=Released (58.725859ms) Jan 24 12:25:56.793: INFO: PersistentVolume pvc-262b7e77-e83f-4966-871c-ffc5157ee860 found and phase=Released (5.11814159s) Jan 24 12:26:01.853: INFO: PersistentVolume pvc-262b7e77-e83f-4966-871c-ffc5157ee860 found and phase=Released (10.177415495s) Jan 24 12:26:06.912: INFO: PersistentVolume pvc-262b7e77-e83f-4966-871c-ffc5157ee860 was removed �[1mSTEP�[0m: Deleting sc [AfterEach] [Testpattern: Dynamic PV (default fs)] subPath /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "provisioning-465". �[1mSTEP�[0m: Found 16 events. Jan 24 12:26:07.031: INFO: At 2023-01-24 12:20:48 +0000 UTC - event for ebs.csi.aws.comj24mb: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding Jan 24 12:26:07.031: INFO: At 2023-01-24 12:20:48 +0000 UTC - event for ebs.csi.aws.comj24mb: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "ebs.csi.aws.com" or manually created by system administrator Jan 24 12:26:07.031: INFO: At 2023-01-24 12:20:48 +0000 UTC - event for ebs.csi.aws.comj24mb: {ebs.csi.aws.com_ip-172-20-42-201_746df1a9-d9c8-443b-9c11-e00bf4e14a5c } Provisioning: External provisioner is provisioning volume for claim "provisioning-465/ebs.csi.aws.comj24mb" Jan 24 12:26:07.031: INFO: At 2023-01-24 12:20:51 +0000 UTC - event for ebs.csi.aws.comj24mb: {ebs.csi.aws.com_ip-172-20-42-201_746df1a9-d9c8-443b-9c11-e00bf4e14a5c } ProvisioningSucceeded: Successfully provisioned volume pvc-262b7e77-e83f-4966-871c-ffc5157ee860 Jan 24 12:26:07.031: INFO: At 2023-01-24 12:20:52 +0000 UTC - event for pod-subpath-test-dynamicpv-swqs: {default-scheduler } Scheduled: Successfully assigned provisioning-465/pod-subpath-test-dynamicpv-swqs to ip-172-20-63-190.us-west-1.compute.internal Jan 24 12:26:07.031: INFO: At 2023-01-24 12:20:54 +0000 UTC - event for pod-subpath-test-dynamicpv-swqs: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-262b7e77-e83f-4966-871c-ffc5157ee860" Jan 24 12:26:07.032: INFO: At 2023-01-24 12:20:58 +0000 UTC - event for pod-subpath-test-dynamicpv-swqs: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "fdd0482f4d34116e79dee14859c4a7b4cfd236944d11f3377522b175de8272df": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:26:07.032: INFO: At 2023-01-24 12:21:10 +0000 UTC - event for pod-subpath-test-dynamicpv-swqs: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "8432135e7473367c3c45546c19cb60d0431be71c2eb318fde65c0a97df6318e6": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:26:07.032: INFO: At 2023-01-24 12:21:24 +0000 UTC - event for pod-subpath-test-dynamicpv-swqs: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "0e099bf2008cf3a36e97d4ca4be0a6f6a6984584b2a12bc1aa1fff16eb60a061": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:26:07.032: INFO: At 2023-01-24 12:21:38 +0000 UTC - event for pod-subpath-test-dynamicpv-swqs: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "c648d4c624d2ec32a43cee2fc5486c50dff0a485420f56ebf48ea62d7b4c334a": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:26:07.032: INFO: At 2023-01-24 12:21:51 +0000 UTC - event for pod-subpath-test-dynamicpv-swqs: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "08bfb7a9752d13ea20dcb4cf64b0287f4b46154925717f1f8b76c44a73e58ad7": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:26:07.032: INFO: At 2023-01-24 12:22:07 +0000 UTC - event for pod-subpath-test-dynamicpv-swqs: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "12cbed4bb95fb8f853f43c92fb0c29c3b9ceb37d3604c1722c349c922ec5b0d9": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:26:07.032: INFO: At 2023-01-24 12:22:20 +0000 UTC - event for pod-subpath-test-dynamicpv-swqs: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "fced569bedde65b4d30b08d35cb81786a60f4fbc5cc750842c6eb3f27d484c7f": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:26:07.032: INFO: At 2023-01-24 12:22:32 +0000 UTC - event for pod-subpath-test-dynamicpv-swqs: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "5cfe48311c4c88aab738def002f1f85c595d00fcc47f51202e074943caa10a6a": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:26:07.032: INFO: At 2023-01-24 12:22:47 +0000 UTC - event for pod-subpath-test-dynamicpv-swqs: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "187cb03cccb4522a314118d1963cb6cdada4d4160361c595c6eee7054109f915": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:26:07.032: INFO: At 2023-01-24 12:23:01 +0000 UTC - event for pod-subpath-test-dynamicpv-swqs: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "6572a58e7924cd0d44e2a0cffd9e946b1d91e427591b13157ad5f81f88069f59": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:26:07.090: INFO: POD NODE PHASE GRACE CONDITIONS Jan 24 12:26:07.090: INFO: Jan 24 12:26:07.150: INFO: Logging node info for node ip-172-20-42-201.us-west-1.compute.internal Jan 24 12:26:07.209: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-42-201.us-west-1.compute.internal cc6006a6-61fd-4f4c-b296-ba72367bb0f8 25014 0 2023-01-24 12:07:14 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-1 failure-domain.beta.kubernetes.io/zone:us-west-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-42-201.us-west-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/control-plane: node-role.kubernetes.io/master: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:us-west-1a topology.kubernetes.io/region:us-west-1 topology.kubernetes.io/zone:us-west-1a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-08c27beef2082266b"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-24 12:07:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {protokube Update v1 2023-01-24 12:07:41 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kops-controller Update v1 2023-01-24 12:07:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/master":{}}}} } {kube-controller-manager Update v1 2023-01-24 12:07:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-24 12:09:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-1a/i-08c27beef2082266b,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892264960 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787407360 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-24 12:25:07 +0000 UTC,LastTransitionTime:2023-01-24 12:07:14 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-24 12:25:07 +0000 UTC,LastTransitionTime:2023-01-24 12:07:14 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-24 12:25:07 +0000 UTC,LastTransitionTime:2023-01-24 12:07:14 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-24 12:25:07 +0000 UTC,LastTransitionTime:2023-01-24 12:07:55 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.201,},NodeAddress{Type:ExternalIP,Address:54.215.124.25,},NodeAddress{Type:Hostname,Address:ip-172-20-42-201.us-west-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-42-201.us-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-215-124-25.us-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2be20fd28580af17ed5c32106be540,SystemUUID:ec2be20f-d285-80af-17ed-5c32106be540,BootID:cb576848-3e1b-4407-b81d-d34a637f2afd,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.23.16,KubeProxyVersion:v1.23.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.23.16 registry.k8s.io/kube-apiserver-amd64:v1.23.16],SizeBytes:131340755,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.23.16 registry.k8s.io/kube-controller-manager-amd64:v1.23.16],SizeBytes:121280825,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.16 registry.k8s.io/kube-proxy-amd64:v1.23.16],SizeBytes:112743991,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.23.16 registry.k8s.io/kube-scheduler-amd64:v1.23.16],SizeBytes:53193016,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-beta.2],SizeBytes:43191763,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-beta.2],SizeBytes:42821714,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-beta.2],SizeBytes:4965793,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 24 12:26:07.209: INFO: Logging kubelet events for node ip-172-20-42-201.us-west-1.compute.internal Jan 24 12:26:07.270: INFO: Logging pods the kubelet thinks is on node ip-172-20-42-201.us-west-1.compute.internal Jan 24 12:26:07.335: INFO: kube-apiserver-ip-172-20-42-201.us-west-1.compute.internal started at 2023-01-24 12:06:45 +0000 UTC (0+2 container statuses recorded) Jan 24 12:26:07.335: INFO: Container healthcheck ready: true, restart count 0 Jan 24 12:26:07.335: INFO: Container kube-apiserver ready: true, restart count 1 Jan 24 12:26:07.335: INFO: ebs-csi-node-4lwrc started at 2023-01-24 12:07:40 +0000 UTC (0+3 container statuses recorded) Jan 24 12:26:07.335: INFO: Container ebs-plugin ready: true, restart count 0 Jan 24 12:26:07.335: INFO: Container liveness-probe ready: true, restart count 0 Jan 24 12:26:07.335: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 24 12:26:07.335: INFO: kops-controller-8k2c2 started at 2023-01-24 12:07:41 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:07.335: INFO: Container kops-controller ready: true, restart count 0 Jan 24 12:26:07.335: INFO: ebs-csi-controller-7bd4fbc786-nm7v4 started at 2023-01-24 12:07:42 +0000 UTC (0+5 container statuses recorded) Jan 24 12:26:07.335: INFO: Container csi-attacher ready: true, restart count 0 Jan 24 12:26:07.335: INFO: Container csi-provisioner ready: true, restart count 0 Jan 24 12:26:07.335: INFO: Container csi-resizer ready: true, restart count 0 Jan 24 12:26:07.335: INFO: Container ebs-plugin ready: true, restart count 0 Jan 24 12:26:07.335: INFO: Container liveness-probe ready: true, restart count 0 Jan 24 12:26:07.335: INFO: etcd-manager-events-ip-172-20-42-201.us-west-1.compute.internal started at 2023-01-24 12:06:45 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:07.335: INFO: Container etcd-manager ready: true, restart count 0 Jan 24 12:26:07.335: INFO: etcd-manager-main-ip-172-20-42-201.us-west-1.compute.internal started at 2023-01-24 12:06:45 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:07.335: INFO: Container etcd-manager ready: true, restart count 0 Jan 24 12:26:07.335: INFO: cilium-5dpkw started at 2023-01-24 12:07:38 +0000 UTC (1+1 container statuses recorded) Jan 24 12:26:07.335: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 24 12:26:07.336: INFO: Container cilium-agent ready: true, restart count 1 Jan 24 12:26:07.336: INFO: cilium-operator-d84d55876-rfmxk started at 2023-01-24 12:07:41 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:07.336: INFO: Container cilium-operator ready: true, restart count 1 Jan 24 12:26:07.336: INFO: dns-controller-58d7bbb845-c475n started at 2023-01-24 12:07:41 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:07.336: INFO: Container dns-controller ready: true, restart count 0 Jan 24 12:26:07.336: INFO: kube-controller-manager-ip-172-20-42-201.us-west-1.compute.internal started at 2023-01-24 12:06:45 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:07.336: INFO: Container kube-controller-manager ready: true, restart count 2 Jan 24 12:26:07.336: INFO: kube-scheduler-ip-172-20-42-201.us-west-1.compute.internal started at 2023-01-24 12:06:45 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:07.336: INFO: Container kube-scheduler ready: true, restart count 0 Jan 24 12:26:07.567: INFO: Latency metrics for node ip-172-20-42-201.us-west-1.compute.internal Jan 24 12:26:07.567: INFO: Logging node info for node ip-172-20-58-8.us-west-1.compute.internal Jan 24 12:26:07.626: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-58-8.us-west-1.compute.internal 4a97117d-69ce-4a16-9e93-9e41b32a9a62 24073 0 2023-01-24 12:09:13 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-1 failure-domain.beta.kubernetes.io/zone:us-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-58-8.us-west-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-1a topology.hostpath.csi/node:ip-172-20-58-8.us-west-1.compute.internal topology.kubernetes.io/region:us-west-1 topology.kubernetes.io/zone:us-west-1a] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-5577":"csi-mock-csi-mock-volumes-5577","ebs.csi.aws.com":"i-0cf7a751b954f0403"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2023-01-24 12:09:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-24 12:09:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-24 12:09:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-01-24 12:17:56 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-24 12:18:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {e2e.test Update v1 2023-01-24 12:19:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-1a/i-0cf7a751b954f0403,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051644416 0} {<nil>} 3956684Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946786816 0} {<nil>} 3854284Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-24 12:21:05 +0000 UTC,LastTransitionTime:2023-01-24 12:09:13 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-24 12:21:05 +0000 UTC,LastTransitionTime:2023-01-24 12:09:13 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-24 12:21:05 +0000 UTC,LastTransitionTime:2023-01-24 12:09:13 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-24 12:21:05 +0000 UTC,LastTransitionTime:2023-01-24 12:09:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.58.8,},NodeAddress{Type:ExternalIP,Address:52.53.154.168,},NodeAddress{Type:Hostname,Address:ip-172-20-58-8.us-west-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-58-8.us-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-52-53-154-168.us-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec21f66ef1338663d7ef9e17ce7835a7,SystemUUID:ec21f66e-f133-8663-d7ef-9e17ce7835a7,BootID:e76a2ed0-0929-4d54-b334-e1f0ad9eacd2,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.23.16,KubeProxyVersion:v1.23.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.16 registry.k8s.io/kube-proxy-amd64:v1.23.16],SizeBytes:112743991,},ContainerImage{Names:[docker.io/library/nginx@sha256:b8f2383a95879e1ae064940d9a200f67a6c79e710ed82ac42263397367e7cc4e docker.io/library/nginx:latest],SizeBytes:56882371,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a k8s.gcr.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 k8s.gcr.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-00a8f7338bd3c4426],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-00a8f7338bd3c4426,DevicePath:,},},Config:nil,},} Jan 24 12:26:07.626: INFO: Logging kubelet events for node ip-172-20-58-8.us-west-1.compute.internal Jan 24 12:26:07.687: INFO: Logging pods the kubelet thinks is on node ip-172-20-58-8.us-west-1.compute.internal Jan 24 12:26:07.760: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-qccgl started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:07.760: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:07.760: INFO: pod-subpath-test-preprovisionedpv-mmwc started at 2023-01-24 12:21:25 +0000 UTC (2+2 container statuses recorded) Jan 24 12:26:07.760: INFO: Init container init-volume-preprovisionedpv-mmwc ready: false, restart count 0 Jan 24 12:26:07.760: INFO: Init container test-init-subpath-preprovisionedpv-mmwc ready: false, restart count 0 Jan 24 12:26:07.760: INFO: Container test-container-subpath-preprovisionedpv-mmwc ready: false, restart count 0 Jan 24 12:26:07.760: INFO: Container test-container-volume-preprovisionedpv-mmwc ready: false, restart count 0 Jan 24 12:26:07.760: INFO: hostpath-symlink-prep-provisioning-3666 started at 2023-01-24 12:21:28 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:07.760: INFO: Container init-volume-provisioning-3666 ready: false, restart count 0 Jan 24 12:26:07.760: INFO: netserver-0 started at 2023-01-24 12:24:45 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:07.760: INFO: Container webserver ready: false, restart count 0 Jan 24 12:26:07.760: INFO: ss2-2 started at 2023-01-24 12:19:40 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:07.760: INFO: Container webserver ready: false, restart count 0 Jan 24 12:26:07.760: INFO: pod-c333283a-a7fd-4c9e-9b2c-ec103bf12056 started at 2023-01-24 12:25:06 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:07.760: INFO: Container write-pod ready: false, restart count 0 Jan 24 12:26:07.760: INFO: ebs-csi-node-4bbqn started at 2023-01-24 12:09:14 +0000 UTC (0+3 container statuses recorded) Jan 24 12:26:07.760: INFO: Container ebs-plugin ready: true, restart count 0 Jan 24 12:26:07.760: INFO: Container liveness-probe ready: true, restart count 0 Jan 24 12:26:07.760: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 24 12:26:07.760: INFO: ss-1 started at 2023-01-24 12:19:34 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:07.760: INFO: Container webserver ready: true, restart count 0 Jan 24 12:26:07.760: INFO: pvc-volume-tester-gnxjv started at 2023-01-24 12:21:49 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:07.760: INFO: Container volume-tester ready: false, restart count 0 Jan 24 12:26:07.760: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-fhs4l started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:07.760: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:07.760: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-26vrc started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:07.760: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:07.760: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-c7hrk started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:07.760: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:07.760: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-58gdd started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:07.760: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: false, restart count 0 Jan 24 12:26:07.760: INFO: cilium-nchqx started at 2023-01-24 12:09:14 +0000 UTC (1+1 container statuses recorded) Jan 24 12:26:07.760: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 24 12:26:07.760: INFO: Container cilium-agent ready: true, restart count 0 Jan 24 12:26:07.760: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-5q458 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:07.760: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:07.760: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-qdqt9 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:07.760: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:07.760: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-vj22z started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:07.760: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:07.760: INFO: coredns-867df8f45c-8jvsj started at 2023-01-24 12:09:41 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:07.760: INFO: Container coredns ready: true, restart count 0 Jan 24 12:26:07.760: INFO: netserver-0 started at 2023-01-24 12:25:31 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:07.760: INFO: Container webserver ready: false, restart count 0 Jan 24 12:26:07.760: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-5znh6 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:07.760: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:07.760: INFO: hostexec-ip-172-20-58-8.us-west-1.compute.internal-c2xpk started at 2023-01-24 12:25:03 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:07.760: INFO: Container agnhost-container ready: true, restart count 0 Jan 24 12:26:07.760: INFO: hostpathsymlink-injector started at 2023-01-24 12:21:09 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:07.760: INFO: Container hostpathsymlink-injector ready: false, restart count 0 Jan 24 12:26:07.760: INFO: hostexec-ip-172-20-58-8.us-west-1.compute.internal-zp8t6 started at 2023-01-24 12:21:11 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:07.760: INFO: Container agnhost-container ready: true, restart count 0 Jan 24 12:26:07.760: INFO: netserver-0 started at 2023-01-24 12:25:55 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:07.760: INFO: Container webserver ready: false, restart count 0 Jan 24 12:26:07.760: INFO: csi-mockplugin-0 started at 2023-01-24 12:20:09 +0000 UTC (0+3 container statuses recorded) Jan 24 12:26:07.760: INFO: Container csi-provisioner ready: true, restart count 0 Jan 24 12:26:07.760: INFO: Container driver-registrar ready: true, restart count 0 Jan 24 12:26:07.760: INFO: Container mock ready: true, restart count 0 Jan 24 12:26:07.760: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-qbrts started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:07.760: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:08.096: INFO: Latency metrics for node ip-172-20-58-8.us-west-1.compute.internal Jan 24 12:26:08.096: INFO: Logging node info for node ip-172-20-62-42.us-west-1.compute.internal Jan 24 12:26:08.155: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-62-42.us-west-1.compute.internal 2f9a48a1-cd3d-4169-9d63-d46bd4e4c90b 25209 0 2023-01-24 12:09:10 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-1 failure-domain.beta.kubernetes.io/zone:us-west-1a io.kubernetes.storage.mock/node:some-mock-node kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-62-42.us-west-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-1a topology.hostpath.csi/node:ip-172-20-62-42.us-west-1.compute.internal topology.kubernetes.io/region:us-west-1 topology.kubernetes.io/zone:us-west-1a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0d97debf14f45ab50"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-24 12:09:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-24 12:09:11 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-24 12:09:11 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kube-controller-manager Update v1 2023-01-24 12:17:35 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-24 12:17:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {e2e.test Update v1 2023-01-24 12:19:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-1a/i-0d97debf14f45ab50,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051644416 0} {<nil>} 3956684Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946786816 0} {<nil>} 3854284Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-24 12:25:32 +0000 UTC,LastTransitionTime:2023-01-24 12:09:10 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-24 12:25:32 +0000 UTC,LastTransitionTime:2023-01-24 12:09:10 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-24 12:25:32 +0000 UTC,LastTransitionTime:2023-01-24 12:09:10 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-24 12:25:32 +0000 UTC,LastTransitionTime:2023-01-24 12:09:31 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.62.42,},NodeAddress{Type:ExternalIP,Address:18.144.79.13,},NodeAddress{Type:Hostname,Address:ip-172-20-62-42.us-west-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-62-42.us-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-144-79-13.us-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2f0698917764d226ec108df5fcfc56,SystemUUID:ec2f0698-9177-64d2-26ec-108df5fcfc56,BootID:c6c940f9-7462-43d1-92da-e4a2c837556e,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.23.16,KubeProxyVersion:v1.23.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.16 registry.k8s.io/kube-proxy-amd64:v1.23.16],SizeBytes:112743991,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0719cd6c97522c42b kubernetes.io/csi/ebs.csi.aws.com^vol-08b09c9a68b8e7c77],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-08b09c9a68b8e7c77,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0719cd6c97522c42b,DevicePath:,},},Config:nil,},} Jan 24 12:26:08.156: INFO: Logging kubelet events for node ip-172-20-62-42.us-west-1.compute.internal Jan 24 12:26:08.219: INFO: Logging pods the kubelet thinks is on node ip-172-20-62-42.us-west-1.compute.internal Jan 24 12:26:08.285: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-m869g started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.285: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:08.285: INFO: var-expansion-07acec39-86b9-4e15-805b-2b0a172a9495 started at 2023-01-24 12:24:48 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.285: INFO: Container dapi-container ready: false, restart count 0 Jan 24 12:26:08.285: INFO: ebs-csi-node-9pt8t started at 2023-01-24 12:09:11 +0000 UTC (0+3 container statuses recorded) Jan 24 12:26:08.285: INFO: Container ebs-plugin ready: true, restart count 0 Jan 24 12:26:08.285: INFO: Container liveness-probe ready: true, restart count 0 Jan 24 12:26:08.285: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 24 12:26:08.285: INFO: cilium-45k6r started at 2023-01-24 12:09:11 +0000 UTC (1+1 container statuses recorded) Jan 24 12:26:08.285: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 24 12:26:08.285: INFO: Container cilium-agent ready: true, restart count 0 Jan 24 12:26:08.285: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-w4rqg started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.285: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:08.285: INFO: ss-0 started at 2023-01-24 12:21:08 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.285: INFO: Container webserver ready: true, restart count 0 Jan 24 12:26:08.285: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-l77fq started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.285: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:08.285: INFO: indexed-job-1-4twdx started at 2023-01-24 12:21:23 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.285: INFO: Container c ready: false, restart count 0 Jan 24 12:26:08.285: INFO: netserver-1 started at 2023-01-24 12:24:45 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.285: INFO: Container webserver ready: false, restart count 0 Jan 24 12:26:08.285: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-ls58g started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.285: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:08.285: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-pq8gm started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.285: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:08.285: INFO: pod-subpath-test-projected-2w4x started at 2023-01-24 12:25:51 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.285: INFO: Container test-container-subpath-projected-2w4x ready: false, restart count 0 Jan 24 12:26:08.285: INFO: netserver-1 started at 2023-01-24 12:25:55 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.285: INFO: Container webserver ready: false, restart count 0 Jan 24 12:26:08.285: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-ct4xp started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.285: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: false, restart count 0 Jan 24 12:26:08.285: INFO: client-containers-cc126433-bc6e-4f00-a8b3-033caf4235b9 started at 2023-01-24 12:25:38 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.285: INFO: Container agnhost-container ready: false, restart count 0 Jan 24 12:26:08.285: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-cdkxl started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.285: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:08.285: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-jmg66 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.285: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:08.285: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-g4s7s started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.285: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:08.285: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-cc5vr started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.285: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:08.285: INFO: netserver-1 started at 2023-01-24 12:25:31 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.285: INFO: Container webserver ready: true, restart count 0 Jan 24 12:26:08.285: INFO: ss-0 started at 2023-01-24 12:18:53 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.285: INFO: Container webserver ready: true, restart count 0 Jan 24 12:26:08.579: INFO: Latency metrics for node ip-172-20-62-42.us-west-1.compute.internal Jan 24 12:26:08.579: INFO: Logging node info for node ip-172-20-63-134.us-west-1.compute.internal Jan 24 12:26:08.638: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-63-134.us-west-1.compute.internal 30ac81c2-1bcf-49af-aa05-528c41f9d04a 25045 0 2023-01-24 12:09:05 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-1 failure-domain.beta.kubernetes.io/zone:us-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-63-134.us-west-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-1a topology.hostpath.csi/node:ip-172-20-63-134.us-west-1.compute.internal topology.kubernetes.io/region:us-west-1 topology.kubernetes.io/zone:us-west-1a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0f4c0c89e622dd2cb"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2023-01-24 12:09:05 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-24 12:09:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-01-24 12:09:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-24 12:16:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-01-24 12:16:21 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {e2e.test Update v1 2023-01-24 12:19:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-1a/i-0f4c0c89e622dd2cb,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051644416 0} {<nil>} 3956684Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946786816 0} {<nil>} 3854284Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-24 12:25:14 +0000 UTC,LastTransitionTime:2023-01-24 12:09:05 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-24 12:25:14 +0000 UTC,LastTransitionTime:2023-01-24 12:09:05 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-24 12:25:14 +0000 UTC,LastTransitionTime:2023-01-24 12:09:05 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-24 12:25:14 +0000 UTC,LastTransitionTime:2023-01-24 12:09:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.63.134,},NodeAddress{Type:ExternalIP,Address:13.52.252.72,},NodeAddress{Type:Hostname,Address:ip-172-20-63-134.us-west-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-63-134.us-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-52-252-72.us-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec216b16315774b9b69907761ee0f87b,SystemUUID:ec216b16-3157-74b9-b699-07761ee0f87b,BootID:a0b9767c-5621-442f-8ded-9126e82e52b2,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.23.16,KubeProxyVersion:v1.23.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.16 registry.k8s.io/kube-proxy-amd64:v1.23.16],SizeBytes:112743991,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[docker.io/library/nginx@sha256:b8f2383a95879e1ae064940d9a200f67a6c79e710ed82ac42263397367e7cc4e docker.io/library/nginx:latest],SizeBytes:56882371,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a k8s.gcr.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 k8s.gcr.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac k8s.gcr.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0ff989d77482eddbb],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0ff989d77482eddbb,DevicePath:,},},Config:nil,},} Jan 24 12:26:08.639: INFO: Logging kubelet events for node ip-172-20-63-134.us-west-1.compute.internal Jan 24 12:26:08.700: INFO: Logging pods the kubelet thinks is on node ip-172-20-63-134.us-west-1.compute.internal Jan 24 12:26:08.767: INFO: coredns-867df8f45c-wcswf started at 2023-01-24 12:09:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.768: INFO: Container coredns ready: true, restart count 0 Jan 24 12:26:08.768: INFO: ss-0 started at 2023-01-24 12:19:42 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.768: INFO: Container webserver ready: false, restart count 0 Jan 24 12:26:08.768: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-9kzn4 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.768: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: false, restart count 0 Jan 24 12:26:08.768: INFO: cilium-mkm5g started at 2023-01-24 12:09:06 +0000 UTC (1+1 container statuses recorded) Jan 24 12:26:08.768: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 24 12:26:08.768: INFO: Container cilium-agent ready: true, restart count 0 Jan 24 12:26:08.768: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-gh2rw started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.768: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:08.768: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-bqvzk started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.768: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: false, restart count 0 Jan 24 12:26:08.768: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-x2c2b started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.768: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:08.768: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-b74rw started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.768: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:08.768: INFO: csi-hostpathplugin-0 started at 2023-01-24 12:20:09 +0000 UTC (0+7 container statuses recorded) Jan 24 12:26:08.768: INFO: Container csi-attacher ready: false, restart count 0 Jan 24 12:26:08.768: INFO: Container csi-provisioner ready: false, restart count 0 Jan 24 12:26:08.768: INFO: Container csi-resizer ready: false, restart count 0 Jan 24 12:26:08.768: INFO: Container csi-snapshotter ready: false, restart count 0 Jan 24 12:26:08.768: INFO: Container hostpath ready: false, restart count 0 Jan 24 12:26:08.768: INFO: Container liveness-probe ready: false, restart count 0 Jan 24 12:26:08.768: INFO: Container node-driver-registrar ready: false, restart count 0 Jan 24 12:26:08.768: INFO: netserver-2 started at 2023-01-24 12:24:45 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.768: INFO: Container webserver ready: false, restart count 0 Jan 24 12:26:08.768: INFO: netserver-2 started at 2023-01-24 12:25:31 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.768: INFO: Container webserver ready: true, restart count 0 Jan 24 12:26:08.768: INFO: ebs-csi-node-v75jm started at 2023-01-24 12:09:06 +0000 UTC (0+3 container statuses recorded) Jan 24 12:26:08.768: INFO: Container ebs-plugin ready: true, restart count 0 Jan 24 12:26:08.768: INFO: Container liveness-probe ready: true, restart count 0 Jan 24 12:26:08.768: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 24 12:26:08.768: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-g7hv8 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.768: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:08.768: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-dwht5 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.768: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:08.768: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-gp5cx started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.768: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:08.768: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-vnplb started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.768: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:08.768: INFO: ss2-1 started at 2023-01-24 12:19:02 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.768: INFO: Container webserver ready: true, restart count 0 Jan 24 12:26:08.768: INFO: csi-hostpathplugin-0 started at 2023-01-24 12:25:18 +0000 UTC (0+7 container statuses recorded) Jan 24 12:26:08.768: INFO: Container csi-attacher ready: false, restart count 0 Jan 24 12:26:08.768: INFO: Container csi-provisioner ready: false, restart count 0 Jan 24 12:26:08.768: INFO: Container csi-resizer ready: false, restart count 0 Jan 24 12:26:08.768: INFO: Container csi-snapshotter ready: false, restart count 0 Jan 24 12:26:08.768: INFO: Container hostpath ready: false, restart count 0 Jan 24 12:26:08.768: INFO: Container liveness-probe ready: false, restart count 0 Jan 24 12:26:08.768: INFO: Container node-driver-registrar ready: false, restart count 0 Jan 24 12:26:08.768: INFO: netserver-2 started at 2023-01-24 12:25:55 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.768: INFO: Container webserver ready: false, restart count 0 Jan 24 12:26:08.768: INFO: coredns-autoscaler-557ccb4c66-gl766 started at 2023-01-24 12:09:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.768: INFO: Container autoscaler ready: true, restart count 0 Jan 24 12:26:08.768: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-8wf5k started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.768: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:09.026: INFO: Latency metrics for node ip-172-20-63-134.us-west-1.compute.internal Jan 24 12:26:09.026: INFO: Logging node info for node ip-172-20-63-190.us-west-1.compute.internal Jan 24 12:26:09.086: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-63-190.us-west-1.compute.internal d80c92f0-6fa8-4333-b1ea-6b0b4cdbea2d 25475 0 2023-01-24 12:09:12 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-1 failure-domain.beta.kubernetes.io/zone:us-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-63-190.us-west-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-1a topology.hostpath.csi/node:ip-172-20-63-190.us-west-1.compute.internal topology.kubernetes.io/region:us-west-1 topology.kubernetes.io/zone:us-west-1a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0fd113285a9315bba"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2023-01-24 12:09:12 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-24 12:09:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-24 12:09:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-01-24 12:19:02 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-24 12:19:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {e2e.test Update v1 2023-01-24 12:19:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-1a/i-0fd113285a9315bba,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051652608 0} {<nil>} 3956692Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946795008 0} {<nil>} 3854292Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-24 12:25:53 +0000 UTC,LastTransitionTime:2023-01-24 12:09:12 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-24 12:25:53 +0000 UTC,LastTransitionTime:2023-01-24 12:09:12 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-24 12:25:53 +0000 UTC,LastTransitionTime:2023-01-24 12:09:12 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-24 12:25:53 +0000 UTC,LastTransitionTime:2023-01-24 12:09:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.63.190,},NodeAddress{Type:ExternalIP,Address:54.215.249.154,},NodeAddress{Type:Hostname,Address:ip-172-20-63-190.us-west-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-63-190.us-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-215-249-154.us-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec255708dba66ed160033f1fab58ba92,SystemUUID:ec255708-dba6-6ed1-6003-3f1fab58ba92,BootID:4e4cb7aa-a82e-4abd-a66d-5fb285cb6c0b,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.23.16,KubeProxyVersion:v1.23.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.16 registry.k8s.io/kube-proxy-amd64:v1.23.16],SizeBytes:112743991,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-057a1367ebd667fa7 kubernetes.io/csi/ebs.csi.aws.com^vol-08a0be3744dd7cd6f kubernetes.io/csi/ebs.csi.aws.com^vol-0d966a9348a99e832],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-057a1367ebd667fa7,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-08a0be3744dd7cd6f,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0d966a9348a99e832,DevicePath:,},},Config:nil,},} Jan 24 12:26:09.086: INFO: Logging kubelet events for node ip-172-20-63-190.us-west-1.compute.internal Jan 24 12:26:09.147: INFO: Logging pods the kubelet thinks is on node ip-172-20-63-190.us-west-1.compute.internal Jan 24 12:26:09.216: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-4jptx started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.216: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:09.216: INFO: fail-once-local-4kxtz started at 2023-01-24 12:20:23 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.216: INFO: Container c ready: false, restart count 1 Jan 24 12:26:09.216: INFO: netserver-3 started at 2023-01-24 12:25:55 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.216: INFO: Container webserver ready: false, restart count 0 Jan 24 12:26:09.216: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-bcqr7 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.216: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:09.216: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-vqntn started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.216: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:09.216: INFO: indexed-job-0-q2xds started at 2023-01-24 12:21:23 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.216: INFO: Container c ready: false, restart count 0 Jan 24 12:26:09.216: INFO: netserver-3 started at 2023-01-24 12:24:46 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.216: INFO: Container webserver ready: false, restart count 0 Jan 24 12:26:09.216: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-5rrg5 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.216: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:09.216: INFO: pod-subpath-test-preprovisionedpv-67dn started at 2023-01-24 12:25:38 +0000 UTC (2+1 container statuses recorded) Jan 24 12:26:09.216: INFO: Init container init-volume-preprovisionedpv-67dn ready: false, restart count 0 Jan 24 12:26:09.216: INFO: Init container test-init-volume-preprovisionedpv-67dn ready: false, restart count 0 Jan 24 12:26:09.216: INFO: Container test-container-subpath-preprovisionedpv-67dn ready: false, restart count 0 Jan 24 12:26:09.216: INFO: sample-webhook-deployment-6c69dbd86b-2nv64 started at 2023-01-24 12:21:04 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.216: INFO: Container sample-webhook ready: false, restart count 0 Jan 24 12:26:09.216: INFO: netserver-3 started at 2023-01-24 12:25:31 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.216: INFO: Container webserver ready: true, restart count 0 Jan 24 12:26:09.216: INFO: ss-1 started at 2023-01-24 12:19:17 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.216: INFO: Container webserver ready: false, restart count 0 Jan 24 12:26:09.216: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-s27h5 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.216: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:09.216: INFO: cilium-54xb4 started at 2023-01-24 12:09:13 +0000 UTC (1+1 container statuses recorded) Jan 24 12:26:09.216: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 24 12:26:09.216: INFO: Container cilium-agent ready: true, restart count 0 Jan 24 12:26:09.216: INFO: pod-configmaps-a5500270-4a4d-4e46-88af-e3fe1d585df0 started at 2023-01-24 12:25:37 +0000 UTC (0+2 container statuses recorded) Jan 24 12:26:09.216: INFO: Container agnhost-container ready: false, restart count 0 Jan 24 12:26:09.216: INFO: Container configmap-volume-binary-test ready: false, restart count 0 Jan 24 12:26:09.216: INFO: fail-once-local-t84jj started at 2023-01-24 12:20:44 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.216: INFO: Container c ready: false, restart count 0 Jan 24 12:26:09.216: INFO: ss2-0 started at 2023-01-24 12:19:01 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.216: INFO: Container webserver ready: true, restart count 0 Jan 24 12:26:09.216: INFO: pod-prestop-hook-56510143-6a4e-4e26-8ba3-e13327e62e97 started at 2023-01-24 12:21:07 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.216: INFO: Container nginx ready: false, restart count 0 Jan 24 12:26:09.216: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-tzgzx started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.216: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:09.216: INFO: hostexec-ip-172-20-63-190.us-west-1.compute.internal-zn54q started at 2023-01-24 12:25:33 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.216: INFO: Container agnhost-container ready: true, restart count 0 Jan 24 12:26:09.216: INFO: indexed-job-2-rhrn5 started at 2023-01-24 12:25:46 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.216: INFO: Container c ready: false, restart count 0 Jan 24 12:26:09.216: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-8ztk4 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.216: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:09.216: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-kzfz9 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.216: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:09.216: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-9pdvd started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.216: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: false, restart count 0 Jan 24 12:26:09.216: INFO: ss-1 started at 2023-01-24 12:19:16 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.217: INFO: Container webserver ready: false, restart count 0 Jan 24 12:26:09.217: INFO: ss-2 started at 2023-01-24 12:25:59 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.217: INFO: Container webserver ready: false, restart count 0 Jan 24 12:26:09.217: INFO: fail-once-local-nkjmd started at 2023-01-24 12:20:23 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.217: INFO: Container c ready: false, restart count 0 Jan 24 12:26:09.217: INFO: ebs-csi-node-ld8b2 started at 2023-01-24 12:09:13 +0000 UTC (0+3 container statuses recorded) Jan 24 12:26:09.217: INFO: Container ebs-plugin ready: true, restart count 0 Jan 24 12:26:09.217: INFO: Container liveness-probe ready: true, restart count 0 Jan 24 12:26:09.217: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 24 12:26:09.217: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-dhzcl started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.217: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:09.474: INFO: Latency metrics for node ip-172-20-63-190.us-west-1.compute.internal Jan 24 12:26:09.474: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "provisioning-465" for this suite.
Find pod-subpath-test-dynamicpv-swqs mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\sshould\sbe\sable\sto\sdeny\spod\sand\sconfigmap\screation\s\[Conformance\]$'
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:87 Jan 24 12:26:04.748: waiting for the deployment status valid%!(EXTRA string=k8s.gcr.io/e2e-test-images/agnhost:2.39, string=sample-webhook-deployment, string=webhook-9915) Unexpected error: <*errors.errorString | 0xc0031acb50>: { s: "error waiting for deployment \"sample-webhook-deployment\" status to match expectation: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:\"Available\", Status:\"False\", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:\"MinimumReplicasUnavailable\", Message:\"Deployment does not have minimum availability.\"}, v1.DeploymentCondition{Type:\"Progressing\", Status:\"True\", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:\"ReplicaSetUpdated\", Message:\"ReplicaSet \\\"sample-webhook-deployment-6c69dbd86b\\\" is progressing.\"}}, CollisionCount:(*int32)(nil)}", } error waiting for deployment "sample-webhook-deployment" status to match expectation: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:824from junit_18.xml
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Jan 24 12:21:03.203: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename webhook �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:87 �[1mSTEP�[0m: Setting up server cert �[1mSTEP�[0m: Create role binding to let webhook read extension-apiserver-authentication �[1mSTEP�[0m: Deploying the webhook pod �[1mSTEP�[0m: Wait for the deployment to be ready Jan 24 12:21:04.626: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:21:06.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:21:08.686: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:21:10.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:21:12.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:21:14.688: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:21:16.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:21:18.686: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:21:20.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:21:22.686: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:21:24.686: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:21:26.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:21:28.688: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:21:30.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:21:32.686: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:21:34.686: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:21:36.686: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:21:38.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:21:40.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:21:42.688: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:21:44.688: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:21:46.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:21:48.688: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:21:50.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:21:52.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:21:54.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:21:56.686: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:21:58.688: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:22:00.686: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:22:02.686: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:22:04.686: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:22:06.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:22:08.689: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:22:10.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:22:12.688: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:22:14.693: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:22:16.688: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:22:18.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:22:20.688: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:22:22.689: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:22:24.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:22:26.686: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:22:28.688: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:22:30.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:22:32.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:22:34.686: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:22:36.688: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:22:38.688: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:22:40.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:22:42.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:22:44.686: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:22:46.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:22:48.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:22:50.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:22:52.688: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:22:54.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:22:56.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:22:58.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:23:00.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:23:02.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:23:04.688: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:23:06.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:23:08.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:23:10.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:23:12.686: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:23:14.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:23:16.688: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:23:18.686: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:23:20.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:23:22.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:23:24.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:23:26.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:23:28.688: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:23:30.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:23:32.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:23:34.688: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:23:36.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:23:38.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:23:40.686: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:23:42.688: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:23:44.686: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:23:46.688: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:23:48.688: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:23:50.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:23:52.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:23:54.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:23:56.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:23:58.688: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:24:00.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:24:02.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:24:04.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:24:06.688: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:24:08.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:24:10.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:24:12.688: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:24:14.688: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:24:16.688: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:24:18.686: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:24:20.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:24:22.688: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:24:24.688: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:24:26.686: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:24:28.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:24:30.688: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:24:32.688: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:24:34.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:24:36.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:24:38.688: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:24:40.686: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:24:42.686: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:24:44.686: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:24:46.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:24:48.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:24:50.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:24:52.688: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:24:54.686: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:24:56.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:24:58.688: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:25:00.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:25:02.686: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:25:04.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:25:06.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:25:08.688: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:25:10.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:25:12.688: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:25:14.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:25:16.686: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:25:18.688: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:25:20.686: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:25:22.688: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:25:24.686: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:25:26.686: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:25:28.686: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:25:30.686: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:25:32.688: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:25:34.688: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:25:36.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:25:38.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:25:40.686: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:25:42.686: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:25:44.688: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:25:46.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:25:48.688: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:25:50.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:25:52.686: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:25:54.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:25:56.686: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:25:58.688: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:26:00.686: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:26:02.686: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:26:04.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:26:04.748: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 24 12:26:04.748: FAIL: waiting for the deployment status valid%!(EXTRA string=k8s.gcr.io/e2e-test-images/agnhost:2.39, string=sample-webhook-deployment, string=webhook-9915) Unexpected error: <*errors.errorString | 0xc0031acb50>: { s: "error waiting for deployment \"sample-webhook-deployment\" status to match expectation: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:\"Available\", Status:\"False\", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:\"MinimumReplicasUnavailable\", Message:\"Deployment does not have minimum availability.\"}, v1.DeploymentCondition{Type:\"Progressing\", Status:\"True\", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:\"ReplicaSetUpdated\", Message:\"ReplicaSet \\\"sample-webhook-deployment-6c69dbd86b\\\" is progressing.\"}}, CollisionCount:(*int32)(nil)}", } error waiting for deployment "sample-webhook-deployment" status to match expectation: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 24, 12, 21, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} occurred Full Stack Trace k8s.io/kubernetes/test/e2e/apimachinery.deployWebhookAndService(0xc000e46840, {0xc0040b7860, 0x27}, 0xc00376cb90, 0x20fb, 0x20fc) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:824 +0xeb0 k8s.io/kubernetes/test/e2e/apimachinery.glob..func27.1() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:99 +0x226 k8s.io/kubernetes/test/e2e.RunE2ETests(0x24eec17?) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:133 +0x6b7 k8s.io/kubernetes/test/e2e.TestE2E(0x0?) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc0004beea0, 0x72ecb90) /usr/local/go/src/testing/testing.go:1446 +0x10b created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1493 +0x35f [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "webhook-9915". �[1mSTEP�[0m: Found 13 events. Jan 24 12:26:04.809: INFO: At 2023-01-24 12:21:04 +0000 UTC - event for sample-webhook-deployment: {deployment-controller } ScalingReplicaSet: Scaled up replica set sample-webhook-deployment-6c69dbd86b to 1 Jan 24 12:26:04.809: INFO: At 2023-01-24 12:21:04 +0000 UTC - event for sample-webhook-deployment-6c69dbd86b: {replicaset-controller } SuccessfulCreate: Created pod: sample-webhook-deployment-6c69dbd86b-2nv64 Jan 24 12:26:04.809: INFO: At 2023-01-24 12:21:04 +0000 UTC - event for sample-webhook-deployment-6c69dbd86b-2nv64: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "8c6bb9e89cfd46c2a1bffac3042775174a5b7ee44650e43572b39110ec7c9c2d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:26:04.809: INFO: At 2023-01-24 12:21:04 +0000 UTC - event for sample-webhook-deployment-6c69dbd86b-2nv64: {default-scheduler } Scheduled: Successfully assigned webhook-9915/sample-webhook-deployment-6c69dbd86b-2nv64 to ip-172-20-63-190.us-west-1.compute.internal Jan 24 12:26:04.809: INFO: At 2023-01-24 12:21:17 +0000 UTC - event for sample-webhook-deployment-6c69dbd86b-2nv64: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "194ad49160cbbc1fd071c209d55104a374b0f2ce9e0ed14ae9ad1f68f8e4c3fb": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:26:04.809: INFO: At 2023-01-24 12:21:31 +0000 UTC - event for sample-webhook-deployment-6c69dbd86b-2nv64: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "63583e2c7753e90c842b9f8058174c696bcf4933feef9d8f79a914975de2d232": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:26:04.809: INFO: At 2023-01-24 12:21:42 +0000 UTC - event for sample-webhook-deployment-6c69dbd86b-2nv64: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "3dd0e8ff64f6afcdbeef6fdd7daf50584c19a77a4bdb66350f8260863c5c3356": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:26:04.809: INFO: At 2023-01-24 12:21:55 +0000 UTC - event for sample-webhook-deployment-6c69dbd86b-2nv64: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "484211b513a863e4f9e20e4827863663c00f6b9f3195f5641df2b8dd821d2e96": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:26:04.809: INFO: At 2023-01-24 12:22:09 +0000 UTC - event for sample-webhook-deployment-6c69dbd86b-2nv64: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e3fb1957154bb29508bac65d0e2073a1448afdee8a70a1a3c1ba8ccee9ae95b0": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:26:04.809: INFO: At 2023-01-24 12:22:23 +0000 UTC - event for sample-webhook-deployment-6c69dbd86b-2nv64: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "85b6c8c14cf84354ecbf75ea3dcb2f6b8eef5e62e1e1ecac8d432bd561fef995": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:26:04.809: INFO: At 2023-01-24 12:22:39 +0000 UTC - event for sample-webhook-deployment-6c69dbd86b-2nv64: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a22a72bc3c15caec4085a1f5139227906516ec05786e929b9af505da7a47e69f": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:26:04.809: INFO: At 2023-01-24 12:22:54 +0000 UTC - event for sample-webhook-deployment-6c69dbd86b-2nv64: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "70a23a436751ca15005977819f8dbe1f34c7b9b5d366c9eda39b7727c33cb02d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:26:04.809: INFO: At 2023-01-24 12:23:05 +0000 UTC - event for sample-webhook-deployment-6c69dbd86b-2nv64: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "46fb72321eacab5650fd7b48d33a7dd25c65389f167b6103547981d221e62487": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:26:04.869: INFO: POD NODE PHASE GRACE CONDITIONS Jan 24 12:26:04.869: INFO: sample-webhook-deployment-6c69dbd86b-2nv64 ip-172-20-63-190.us-west-1.compute.internal Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:21:04 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:21:04 +0000 UTC ContainersNotReady containers with unready status: [sample-webhook]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:21:04 +0000 UTC ContainersNotReady containers with unready status: [sample-webhook]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:21:04 +0000 UTC }] Jan 24 12:26:04.869: INFO: Jan 24 12:26:04.931: INFO: Unable to fetch webhook-9915/sample-webhook-deployment-6c69dbd86b-2nv64/sample-webhook logs: the server rejected our request for an unknown reason (get pods sample-webhook-deployment-6c69dbd86b-2nv64) Jan 24 12:26:04.992: INFO: Logging node info for node ip-172-20-42-201.us-west-1.compute.internal Jan 24 12:26:05.052: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-42-201.us-west-1.compute.internal cc6006a6-61fd-4f4c-b296-ba72367bb0f8 25014 0 2023-01-24 12:07:14 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-1 failure-domain.beta.kubernetes.io/zone:us-west-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-42-201.us-west-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/control-plane: node-role.kubernetes.io/master: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:us-west-1a topology.kubernetes.io/region:us-west-1 topology.kubernetes.io/zone:us-west-1a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-08c27beef2082266b"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-24 12:07:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {protokube Update v1 2023-01-24 12:07:41 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kops-controller Update v1 2023-01-24 12:07:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/master":{}}}} } {kube-controller-manager Update v1 2023-01-24 12:07:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-24 12:09:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-1a/i-08c27beef2082266b,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892264960 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787407360 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-24 12:25:07 +0000 UTC,LastTransitionTime:2023-01-24 12:07:14 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-24 12:25:07 +0000 UTC,LastTransitionTime:2023-01-24 12:07:14 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-24 12:25:07 +0000 UTC,LastTransitionTime:2023-01-24 12:07:14 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-24 12:25:07 +0000 UTC,LastTransitionTime:2023-01-24 12:07:55 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.201,},NodeAddress{Type:ExternalIP,Address:54.215.124.25,},NodeAddress{Type:Hostname,Address:ip-172-20-42-201.us-west-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-42-201.us-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-215-124-25.us-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2be20fd28580af17ed5c32106be540,SystemUUID:ec2be20f-d285-80af-17ed-5c32106be540,BootID:cb576848-3e1b-4407-b81d-d34a637f2afd,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.23.16,KubeProxyVersion:v1.23.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.23.16 registry.k8s.io/kube-apiserver-amd64:v1.23.16],SizeBytes:131340755,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.23.16 registry.k8s.io/kube-controller-manager-amd64:v1.23.16],SizeBytes:121280825,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.16 registry.k8s.io/kube-proxy-amd64:v1.23.16],SizeBytes:112743991,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.23.16 registry.k8s.io/kube-scheduler-amd64:v1.23.16],SizeBytes:53193016,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-beta.2],SizeBytes:43191763,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-beta.2],SizeBytes:42821714,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-beta.2],SizeBytes:4965793,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 24 12:26:05.053: INFO: Logging kubelet events for node ip-172-20-42-201.us-west-1.compute.internal Jan 24 12:26:05.115: INFO: Logging pods the kubelet thinks is on node ip-172-20-42-201.us-west-1.compute.internal Jan 24 12:26:05.181: INFO: etcd-manager-events-ip-172-20-42-201.us-west-1.compute.internal started at 2023-01-24 12:06:45 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:05.181: INFO: Container etcd-manager ready: true, restart count 0 Jan 24 12:26:05.181: INFO: etcd-manager-main-ip-172-20-42-201.us-west-1.compute.internal started at 2023-01-24 12:06:45 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:05.181: INFO: Container etcd-manager ready: true, restart count 0 Jan 24 12:26:05.181: INFO: kube-apiserver-ip-172-20-42-201.us-west-1.compute.internal started at 2023-01-24 12:06:45 +0000 UTC (0+2 container statuses recorded) Jan 24 12:26:05.181: INFO: Container healthcheck ready: true, restart count 0 Jan 24 12:26:05.181: INFO: Container kube-apiserver ready: true, restart count 1 Jan 24 12:26:05.181: INFO: ebs-csi-node-4lwrc started at 2023-01-24 12:07:40 +0000 UTC (0+3 container statuses recorded) Jan 24 12:26:05.181: INFO: Container ebs-plugin ready: true, restart count 0 Jan 24 12:26:05.181: INFO: Container liveness-probe ready: true, restart count 0 Jan 24 12:26:05.181: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 24 12:26:05.181: INFO: kops-controller-8k2c2 started at 2023-01-24 12:07:41 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:05.181: INFO: Container kops-controller ready: true, restart count 0 Jan 24 12:26:05.181: INFO: ebs-csi-controller-7bd4fbc786-nm7v4 started at 2023-01-24 12:07:42 +0000 UTC (0+5 container statuses recorded) Jan 24 12:26:05.181: INFO: Container csi-attacher ready: true, restart count 0 Jan 24 12:26:05.181: INFO: Container csi-provisioner ready: true, restart count 0 Jan 24 12:26:05.181: INFO: Container csi-resizer ready: true, restart count 0 Jan 24 12:26:05.181: INFO: Container ebs-plugin ready: true, restart count 0 Jan 24 12:26:05.181: INFO: Container liveness-probe ready: true, restart count 0 Jan 24 12:26:05.181: INFO: kube-controller-manager-ip-172-20-42-201.us-west-1.compute.internal started at 2023-01-24 12:06:45 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:05.181: INFO: Container kube-controller-manager ready: true, restart count 2 Jan 24 12:26:05.181: INFO: kube-scheduler-ip-172-20-42-201.us-west-1.compute.internal started at 2023-01-24 12:06:45 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:05.181: INFO: Container kube-scheduler ready: true, restart count 0 Jan 24 12:26:05.181: INFO: cilium-5dpkw started at 2023-01-24 12:07:38 +0000 UTC (1+1 container statuses recorded) Jan 24 12:26:05.181: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 24 12:26:05.181: INFO: Container cilium-agent ready: true, restart count 1 Jan 24 12:26:05.181: INFO: cilium-operator-d84d55876-rfmxk started at 2023-01-24 12:07:41 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:05.181: INFO: Container cilium-operator ready: true, restart count 1 Jan 24 12:26:05.181: INFO: dns-controller-58d7bbb845-c475n started at 2023-01-24 12:07:41 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:05.181: INFO: Container dns-controller ready: true, restart count 0 Jan 24 12:26:05.410: INFO: Latency metrics for node ip-172-20-42-201.us-west-1.compute.internal Jan 24 12:26:05.410: INFO: Logging node info for node ip-172-20-58-8.us-west-1.compute.internal Jan 24 12:26:05.470: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-58-8.us-west-1.compute.internal 4a97117d-69ce-4a16-9e93-9e41b32a9a62 24073 0 2023-01-24 12:09:13 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-1 failure-domain.beta.kubernetes.io/zone:us-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-58-8.us-west-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-1a topology.hostpath.csi/node:ip-172-20-58-8.us-west-1.compute.internal topology.kubernetes.io/region:us-west-1 topology.kubernetes.io/zone:us-west-1a] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-5577":"csi-mock-csi-mock-volumes-5577","ebs.csi.aws.com":"i-0cf7a751b954f0403"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2023-01-24 12:09:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-24 12:09:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-24 12:09:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-01-24 12:17:56 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-24 12:18:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {e2e.test Update v1 2023-01-24 12:19:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-1a/i-0cf7a751b954f0403,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051644416 0} {<nil>} 3956684Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946786816 0} {<nil>} 3854284Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-24 12:21:05 +0000 UTC,LastTransitionTime:2023-01-24 12:09:13 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-24 12:21:05 +0000 UTC,LastTransitionTime:2023-01-24 12:09:13 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-24 12:21:05 +0000 UTC,LastTransitionTime:2023-01-24 12:09:13 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-24 12:21:05 +0000 UTC,LastTransitionTime:2023-01-24 12:09:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.58.8,},NodeAddress{Type:ExternalIP,Address:52.53.154.168,},NodeAddress{Type:Hostname,Address:ip-172-20-58-8.us-west-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-58-8.us-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-52-53-154-168.us-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec21f66ef1338663d7ef9e17ce7835a7,SystemUUID:ec21f66e-f133-8663-d7ef-9e17ce7835a7,BootID:e76a2ed0-0929-4d54-b334-e1f0ad9eacd2,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.23.16,KubeProxyVersion:v1.23.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.16 registry.k8s.io/kube-proxy-amd64:v1.23.16],SizeBytes:112743991,},ContainerImage{Names:[docker.io/library/nginx@sha256:b8f2383a95879e1ae064940d9a200f67a6c79e710ed82ac42263397367e7cc4e docker.io/library/nginx:latest],SizeBytes:56882371,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a k8s.gcr.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 k8s.gcr.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-00a8f7338bd3c4426],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-00a8f7338bd3c4426,DevicePath:,},},Config:nil,},} Jan 24 12:26:05.471: INFO: Logging kubelet events for node ip-172-20-58-8.us-west-1.compute.internal Jan 24 12:26:05.534: INFO: Logging pods the kubelet thinks is on node ip-172-20-58-8.us-west-1.compute.internal Jan 24 12:26:05.603: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-5znh6 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:05.603: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:05.603: INFO: netserver-0 started at 2023-01-24 12:25:55 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:05.603: INFO: Container webserver ready: false, restart count 0 Jan 24 12:26:05.603: INFO: csi-mockplugin-0 started at 2023-01-24 12:20:09 +0000 UTC (0+3 container statuses recorded) Jan 24 12:26:05.603: INFO: Container csi-provisioner ready: true, restart count 0 Jan 24 12:26:05.603: INFO: Container driver-registrar ready: true, restart count 0 Jan 24 12:26:05.603: INFO: Container mock ready: true, restart count 0 Jan 24 12:26:05.603: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-qbrts started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:05.603: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:05.603: INFO: hostexec-ip-172-20-58-8.us-west-1.compute.internal-c2xpk started at 2023-01-24 12:25:03 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:05.603: INFO: Container agnhost-container ready: true, restart count 0 Jan 24 12:26:05.603: INFO: hostpathsymlink-injector started at 2023-01-24 12:21:09 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:05.603: INFO: Container hostpathsymlink-injector ready: false, restart count 0 Jan 24 12:26:05.603: INFO: hostexec-ip-172-20-58-8.us-west-1.compute.internal-zp8t6 started at 2023-01-24 12:21:11 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:05.603: INFO: Container agnhost-container ready: true, restart count 0 Jan 24 12:26:05.603: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-qccgl started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:05.603: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:05.603: INFO: pod-subpath-test-preprovisionedpv-mmwc started at 2023-01-24 12:21:25 +0000 UTC (2+2 container statuses recorded) Jan 24 12:26:05.603: INFO: Init container init-volume-preprovisionedpv-mmwc ready: false, restart count 0 Jan 24 12:26:05.603: INFO: Init container test-init-subpath-preprovisionedpv-mmwc ready: false, restart count 0 Jan 24 12:26:05.603: INFO: Container test-container-subpath-preprovisionedpv-mmwc ready: false, restart count 0 Jan 24 12:26:05.603: INFO: Container test-container-volume-preprovisionedpv-mmwc ready: false, restart count 0 Jan 24 12:26:05.603: INFO: hostpath-symlink-prep-provisioning-3666 started at 2023-01-24 12:21:28 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:05.603: INFO: Container init-volume-provisioning-3666 ready: false, restart count 0 Jan 24 12:26:05.603: INFO: netserver-0 started at 2023-01-24 12:24:45 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:05.603: INFO: Container webserver ready: false, restart count 0 Jan 24 12:26:05.603: INFO: ebs-csi-node-4bbqn started at 2023-01-24 12:09:14 +0000 UTC (0+3 container statuses recorded) Jan 24 12:26:05.603: INFO: Container ebs-plugin ready: true, restart count 0 Jan 24 12:26:05.603: INFO: Container liveness-probe ready: true, restart count 0 Jan 24 12:26:05.603: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 24 12:26:05.603: INFO: ss-1 started at 2023-01-24 12:19:34 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:05.603: INFO: Container webserver ready: true, restart count 0 Jan 24 12:26:05.603: INFO: pvc-volume-tester-gnxjv started at 2023-01-24 12:21:49 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:05.603: INFO: Container volume-tester ready: false, restart count 0 Jan 24 12:26:05.603: INFO: ss2-2 started at 2023-01-24 12:19:40 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:05.603: INFO: Container webserver ready: false, restart count 0 Jan 24 12:26:05.603: INFO: pod-c333283a-a7fd-4c9e-9b2c-ec103bf12056 started at 2023-01-24 12:25:06 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:05.603: INFO: Container write-pod ready: false, restart count 0 Jan 24 12:26:05.603: INFO: cilium-nchqx started at 2023-01-24 12:09:14 +0000 UTC (1+1 container statuses recorded) Jan 24 12:26:05.603: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 24 12:26:05.603: INFO: Container cilium-agent ready: true, restart count 0 Jan 24 12:26:05.603: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-5q458 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:05.603: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:05.603: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-fhs4l started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:05.603: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:05.603: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-26vrc started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:05.603: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:05.603: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-c7hrk started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:05.603: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:05.603: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-58gdd started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:05.603: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: false, restart count 0 Jan 24 12:26:05.603: INFO: coredns-867df8f45c-8jvsj started at 2023-01-24 12:09:41 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:05.603: INFO: Container coredns ready: true, restart count 0 Jan 24 12:26:05.603: INFO: netserver-0 started at 2023-01-24 12:25:31 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:05.603: INFO: Container webserver ready: false, restart count 0 Jan 24 12:26:05.603: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-qdqt9 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:05.603: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:05.603: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-vj22z started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:05.603: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:05.893: INFO: Latency metrics for node ip-172-20-58-8.us-west-1.compute.internal Jan 24 12:26:05.894: INFO: Logging node info for node ip-172-20-62-42.us-west-1.compute.internal Jan 24 12:26:05.954: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-62-42.us-west-1.compute.internal 2f9a48a1-cd3d-4169-9d63-d46bd4e4c90b 25209 0 2023-01-24 12:09:10 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-1 failure-domain.beta.kubernetes.io/zone:us-west-1a io.kubernetes.storage.mock/node:some-mock-node kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-62-42.us-west-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-1a topology.hostpath.csi/node:ip-172-20-62-42.us-west-1.compute.internal topology.kubernetes.io/region:us-west-1 topology.kubernetes.io/zone:us-west-1a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0d97debf14f45ab50"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-24 12:09:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-24 12:09:11 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-24 12:09:11 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kube-controller-manager Update v1 2023-01-24 12:17:35 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-24 12:17:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {e2e.test Update v1 2023-01-24 12:19:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-1a/i-0d97debf14f45ab50,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051644416 0} {<nil>} 3956684Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946786816 0} {<nil>} 3854284Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-24 12:25:32 +0000 UTC,LastTransitionTime:2023-01-24 12:09:10 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-24 12:25:32 +0000 UTC,LastTransitionTime:2023-01-24 12:09:10 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-24 12:25:32 +0000 UTC,LastTransitionTime:2023-01-24 12:09:10 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-24 12:25:32 +0000 UTC,LastTransitionTime:2023-01-24 12:09:31 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.62.42,},NodeAddress{Type:ExternalIP,Address:18.144.79.13,},NodeAddress{Type:Hostname,Address:ip-172-20-62-42.us-west-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-62-42.us-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-144-79-13.us-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2f0698917764d226ec108df5fcfc56,SystemUUID:ec2f0698-9177-64d2-26ec-108df5fcfc56,BootID:c6c940f9-7462-43d1-92da-e4a2c837556e,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.23.16,KubeProxyVersion:v1.23.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.16 registry.k8s.io/kube-proxy-amd64:v1.23.16],SizeBytes:112743991,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0719cd6c97522c42b kubernetes.io/csi/ebs.csi.aws.com^vol-08b09c9a68b8e7c77],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-08b09c9a68b8e7c77,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0719cd6c97522c42b,DevicePath:,},},Config:nil,},} Jan 24 12:26:05.955: INFO: Logging kubelet events for node ip-172-20-62-42.us-west-1.compute.internal Jan 24 12:26:06.017: INFO: Logging pods the kubelet thinks is on node ip-172-20-62-42.us-west-1.compute.internal Jan 24 12:26:06.084: INFO: netserver-1 started at 2023-01-24 12:25:31 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.084: INFO: Container webserver ready: true, restart count 0 Jan 24 12:26:06.084: INFO: ss-0 started at 2023-01-24 12:18:53 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.084: INFO: Container webserver ready: true, restart count 0 Jan 24 12:26:06.084: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-g4s7s started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.084: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:06.084: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-cc5vr started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.084: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:06.084: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-m869g started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.084: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:06.084: INFO: ebs-csi-node-9pt8t started at 2023-01-24 12:09:11 +0000 UTC (0+3 container statuses recorded) Jan 24 12:26:06.084: INFO: Container ebs-plugin ready: true, restart count 0 Jan 24 12:26:06.084: INFO: Container liveness-probe ready: true, restart count 0 Jan 24 12:26:06.084: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 24 12:26:06.084: INFO: cilium-45k6r started at 2023-01-24 12:09:11 +0000 UTC (1+1 container statuses recorded) Jan 24 12:26:06.084: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 24 12:26:06.084: INFO: Container cilium-agent ready: true, restart count 0 Jan 24 12:26:06.084: INFO: var-expansion-07acec39-86b9-4e15-805b-2b0a172a9495 started at 2023-01-24 12:24:48 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.084: INFO: Container dapi-container ready: false, restart count 0 Jan 24 12:26:06.084: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-w4rqg started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.084: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:06.084: INFO: ss-0 started at 2023-01-24 12:21:08 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.084: INFO: Container webserver ready: true, restart count 0 Jan 24 12:26:06.084: INFO: indexed-job-1-4twdx started at 2023-01-24 12:21:23 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.084: INFO: Container c ready: false, restart count 0 Jan 24 12:26:06.084: INFO: netserver-1 started at 2023-01-24 12:24:45 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.084: INFO: Container webserver ready: false, restart count 0 Jan 24 12:26:06.084: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-l77fq started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.084: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:06.084: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-ls58g started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.084: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:06.084: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-pq8gm started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.084: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:06.084: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-ct4xp started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.084: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: false, restart count 0 Jan 24 12:26:06.084: INFO: client-containers-cc126433-bc6e-4f00-a8b3-033caf4235b9 started at 2023-01-24 12:25:38 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.084: INFO: Container agnhost-container ready: false, restart count 0 Jan 24 12:26:06.084: INFO: pod-subpath-test-projected-2w4x started at 2023-01-24 12:25:51 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.084: INFO: Container test-container-subpath-projected-2w4x ready: false, restart count 0 Jan 24 12:26:06.084: INFO: netserver-1 started at 2023-01-24 12:25:55 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.084: INFO: Container webserver ready: false, restart count 0 Jan 24 12:26:06.084: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-cdkxl started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.084: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:06.084: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-jmg66 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.084: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:06.347: INFO: Latency metrics for node ip-172-20-62-42.us-west-1.compute.internal Jan 24 12:26:06.347: INFO: Logging node info for node ip-172-20-63-134.us-west-1.compute.internal Jan 24 12:26:06.407: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-63-134.us-west-1.compute.internal 30ac81c2-1bcf-49af-aa05-528c41f9d04a 25045 0 2023-01-24 12:09:05 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-1 failure-domain.beta.kubernetes.io/zone:us-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-63-134.us-west-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-1a topology.hostpath.csi/node:ip-172-20-63-134.us-west-1.compute.internal topology.kubernetes.io/region:us-west-1 topology.kubernetes.io/zone:us-west-1a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0f4c0c89e622dd2cb"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2023-01-24 12:09:05 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-24 12:09:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-01-24 12:09:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-24 12:16:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-01-24 12:16:21 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {e2e.test Update v1 2023-01-24 12:19:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-1a/i-0f4c0c89e622dd2cb,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051644416 0} {<nil>} 3956684Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946786816 0} {<nil>} 3854284Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-24 12:25:14 +0000 UTC,LastTransitionTime:2023-01-24 12:09:05 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-24 12:25:14 +0000 UTC,LastTransitionTime:2023-01-24 12:09:05 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-24 12:25:14 +0000 UTC,LastTransitionTime:2023-01-24 12:09:05 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-24 12:25:14 +0000 UTC,LastTransitionTime:2023-01-24 12:09:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.63.134,},NodeAddress{Type:ExternalIP,Address:13.52.252.72,},NodeAddress{Type:Hostname,Address:ip-172-20-63-134.us-west-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-63-134.us-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-52-252-72.us-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec216b16315774b9b69907761ee0f87b,SystemUUID:ec216b16-3157-74b9-b699-07761ee0f87b,BootID:a0b9767c-5621-442f-8ded-9126e82e52b2,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.23.16,KubeProxyVersion:v1.23.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.16 registry.k8s.io/kube-proxy-amd64:v1.23.16],SizeBytes:112743991,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[docker.io/library/nginx@sha256:b8f2383a95879e1ae064940d9a200f67a6c79e710ed82ac42263397367e7cc4e docker.io/library/nginx:latest],SizeBytes:56882371,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a k8s.gcr.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 k8s.gcr.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac k8s.gcr.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0ff989d77482eddbb],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0ff989d77482eddbb,DevicePath:,},},Config:nil,},} Jan 24 12:26:06.408: INFO: Logging kubelet events for node ip-172-20-63-134.us-west-1.compute.internal Jan 24 12:26:06.470: INFO: Logging pods the kubelet thinks is on node ip-172-20-63-134.us-west-1.compute.internal Jan 24 12:26:06.537: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-gh2rw started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.537: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:06.537: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-bqvzk started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.537: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: false, restart count 0 Jan 24 12:26:06.537: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-9kzn4 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.537: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: false, restart count 0 Jan 24 12:26:06.537: INFO: cilium-mkm5g started at 2023-01-24 12:09:06 +0000 UTC (1+1 container statuses recorded) Jan 24 12:26:06.537: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 24 12:26:06.537: INFO: Container cilium-agent ready: true, restart count 0 Jan 24 12:26:06.537: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-x2c2b started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.537: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:06.537: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-b74rw started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.537: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:06.537: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-dwht5 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.537: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:06.537: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-gp5cx started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.537: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:06.537: INFO: csi-hostpathplugin-0 started at 2023-01-24 12:20:09 +0000 UTC (0+7 container statuses recorded) Jan 24 12:26:06.537: INFO: Container csi-attacher ready: false, restart count 0 Jan 24 12:26:06.537: INFO: Container csi-provisioner ready: false, restart count 0 Jan 24 12:26:06.537: INFO: Container csi-resizer ready: false, restart count 0 Jan 24 12:26:06.537: INFO: Container csi-snapshotter ready: false, restart count 0 Jan 24 12:26:06.537: INFO: Container hostpath ready: false, restart count 0 Jan 24 12:26:06.537: INFO: Container liveness-probe ready: false, restart count 0 Jan 24 12:26:06.537: INFO: Container node-driver-registrar ready: false, restart count 0 Jan 24 12:26:06.537: INFO: netserver-2 started at 2023-01-24 12:24:45 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.537: INFO: Container webserver ready: false, restart count 0 Jan 24 12:26:06.537: INFO: netserver-2 started at 2023-01-24 12:25:31 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.537: INFO: Container webserver ready: true, restart count 0 Jan 24 12:26:06.537: INFO: ebs-csi-node-v75jm started at 2023-01-24 12:09:06 +0000 UTC (0+3 container statuses recorded) Jan 24 12:26:06.537: INFO: Container ebs-plugin ready: true, restart count 0 Jan 24 12:26:06.537: INFO: Container liveness-probe ready: true, restart count 0 Jan 24 12:26:06.537: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 24 12:26:06.537: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-g7hv8 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.537: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:06.537: INFO: netserver-2 started at 2023-01-24 12:25:55 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.537: INFO: Container webserver ready: false, restart count 0 Jan 24 12:26:06.537: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-vnplb started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.537: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:06.537: INFO: ss2-1 started at 2023-01-24 12:19:02 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.537: INFO: Container webserver ready: true, restart count 0 Jan 24 12:26:06.537: INFO: csi-hostpathplugin-0 started at 2023-01-24 12:25:18 +0000 UTC (0+7 container statuses recorded) Jan 24 12:26:06.537: INFO: Container csi-attacher ready: false, restart count 0 Jan 24 12:26:06.537: INFO: Container csi-provisioner ready: false, restart count 0 Jan 24 12:26:06.537: INFO: Container csi-resizer ready: false, restart count 0 Jan 24 12:26:06.537: INFO: Container csi-snapshotter ready: false, restart count 0 Jan 24 12:26:06.537: INFO: Container hostpath ready: false, restart count 0 Jan 24 12:26:06.537: INFO: Container liveness-probe ready: false, restart count 0 Jan 24 12:26:06.537: INFO: Container node-driver-registrar ready: false, restart count 0 Jan 24 12:26:06.537: INFO: coredns-autoscaler-557ccb4c66-gl766 started at 2023-01-24 12:09:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.537: INFO: Container autoscaler ready: true, restart count 0 Jan 24 12:26:06.538: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-8wf5k started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.538: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:06.538: INFO: coredns-867df8f45c-wcswf started at 2023-01-24 12:09:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.538: INFO: Container coredns ready: true, restart count 0 Jan 24 12:26:06.538: INFO: ss-0 started at 2023-01-24 12:19:42 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.538: INFO: Container webserver ready: false, restart count 0 Jan 24 12:26:06.778: INFO: Latency metrics for node ip-172-20-63-134.us-west-1.compute.internal Jan 24 12:26:06.778: INFO: Logging node info for node ip-172-20-63-190.us-west-1.compute.internal Jan 24 12:26:06.841: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-63-190.us-west-1.compute.internal d80c92f0-6fa8-4333-b1ea-6b0b4cdbea2d 25475 0 2023-01-24 12:09:12 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-1 failure-domain.beta.kubernetes.io/zone:us-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-63-190.us-west-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-1a topology.hostpath.csi/node:ip-172-20-63-190.us-west-1.compute.internal topology.kubernetes.io/region:us-west-1 topology.kubernetes.io/zone:us-west-1a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0fd113285a9315bba"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2023-01-24 12:09:12 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-24 12:09:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-24 12:09:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-01-24 12:19:02 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-24 12:19:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {e2e.test Update v1 2023-01-24 12:19:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-1a/i-0fd113285a9315bba,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051652608 0} {<nil>} 3956692Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946795008 0} {<nil>} 3854292Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-24 12:25:53 +0000 UTC,LastTransitionTime:2023-01-24 12:09:12 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-24 12:25:53 +0000 UTC,LastTransitionTime:2023-01-24 12:09:12 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-24 12:25:53 +0000 UTC,LastTransitionTime:2023-01-24 12:09:12 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-24 12:25:53 +0000 UTC,LastTransitionTime:2023-01-24 12:09:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.63.190,},NodeAddress{Type:ExternalIP,Address:54.215.249.154,},NodeAddress{Type:Hostname,Address:ip-172-20-63-190.us-west-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-63-190.us-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-215-249-154.us-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec255708dba66ed160033f1fab58ba92,SystemUUID:ec255708-dba6-6ed1-6003-3f1fab58ba92,BootID:4e4cb7aa-a82e-4abd-a66d-5fb285cb6c0b,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.23.16,KubeProxyVersion:v1.23.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.16 registry.k8s.io/kube-proxy-amd64:v1.23.16],SizeBytes:112743991,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-057a1367ebd667fa7 kubernetes.io/csi/ebs.csi.aws.com^vol-08a0be3744dd7cd6f kubernetes.io/csi/ebs.csi.aws.com^vol-0d966a9348a99e832],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-057a1367ebd667fa7,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-08a0be3744dd7cd6f,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0d966a9348a99e832,DevicePath:,},},Config:nil,},} Jan 24 12:26:06.841: INFO: Logging kubelet events for node ip-172-20-63-190.us-west-1.compute.internal Jan 24 12:26:06.904: INFO: Logging pods the kubelet thinks is on node ip-172-20-63-190.us-west-1.compute.internal Jan 24 12:26:06.974: INFO: netserver-3 started at 2023-01-24 12:24:46 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.974: INFO: Container webserver ready: false, restart count 0 Jan 24 12:26:06.974: INFO: sample-webhook-deployment-6c69dbd86b-2nv64 started at 2023-01-24 12:21:04 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.974: INFO: Container sample-webhook ready: false, restart count 0 Jan 24 12:26:06.974: INFO: netserver-3 started at 2023-01-24 12:25:31 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.974: INFO: Container webserver ready: true, restart count 0 Jan 24 12:26:06.974: INFO: ss-1 started at 2023-01-24 12:19:17 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.974: INFO: Container webserver ready: false, restart count 0 Jan 24 12:26:06.974: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-5rrg5 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.974: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:06.974: INFO: pod-subpath-test-preprovisionedpv-67dn started at 2023-01-24 12:25:38 +0000 UTC (2+1 container statuses recorded) Jan 24 12:26:06.974: INFO: Init container init-volume-preprovisionedpv-67dn ready: false, restart count 0 Jan 24 12:26:06.974: INFO: Init container test-init-volume-preprovisionedpv-67dn ready: false, restart count 0 Jan 24 12:26:06.974: INFO: Container test-container-subpath-preprovisionedpv-67dn ready: false, restart count 0 Jan 24 12:26:06.974: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-s27h5 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.974: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:06.974: INFO: cilium-54xb4 started at 2023-01-24 12:09:13 +0000 UTC (1+1 container statuses recorded) Jan 24 12:26:06.974: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 24 12:26:06.974: INFO: Container cilium-agent ready: true, restart count 0 Jan 24 12:26:06.974: INFO: pod-configmaps-a5500270-4a4d-4e46-88af-e3fe1d585df0 started at 2023-01-24 12:25:37 +0000 UTC (0+2 container statuses recorded) Jan 24 12:26:06.974: INFO: Container agnhost-container ready: false, restart count 0 Jan 24 12:26:06.974: INFO: Container configmap-volume-binary-test ready: false, restart count 0 Jan 24 12:26:06.974: INFO: fail-once-local-t84jj started at 2023-01-24 12:20:44 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.974: INFO: Container c ready: false, restart count 0 Jan 24 12:26:06.974: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-tzgzx started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.974: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:06.974: INFO: hostexec-ip-172-20-63-190.us-west-1.compute.internal-zn54q started at 2023-01-24 12:25:33 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.974: INFO: Container agnhost-container ready: true, restart count 0 Jan 24 12:26:06.974: INFO: indexed-job-2-rhrn5 started at 2023-01-24 12:25:46 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.974: INFO: Container c ready: false, restart count 0 Jan 24 12:26:06.974: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-8ztk4 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.974: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:06.974: INFO: ss2-0 started at 2023-01-24 12:19:01 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.974: INFO: Container webserver ready: true, restart count 0 Jan 24 12:26:06.974: INFO: pod-prestop-hook-56510143-6a4e-4e26-8ba3-e13327e62e97 started at 2023-01-24 12:21:07 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.974: INFO: Container nginx ready: false, restart count 0 Jan 24 12:26:06.974: INFO: ss-1 started at 2023-01-24 12:19:16 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.974: INFO: Container webserver ready: false, restart count 0 Jan 24 12:26:06.974: INFO: ss-2 started at 2023-01-24 12:25:59 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.974: INFO: Container webserver ready: false, restart count 0 Jan 24 12:26:06.974: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-kzfz9 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.974: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:06.974: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-9pdvd started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.974: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: false, restart count 0 Jan 24 12:26:06.974: INFO: ebs-csi-node-ld8b2 started at 2023-01-24 12:09:13 +0000 UTC (0+3 container statuses recorded) Jan 24 12:26:06.974: INFO: Container ebs-plugin ready: true, restart count 0 Jan 24 12:26:06.974: INFO: Container liveness-probe ready: true, restart count 0 Jan 24 12:26:06.974: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 24 12:26:06.974: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-dhzcl started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.974: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:06.974: INFO: fail-once-local-nkjmd started at 2023-01-24 12:20:23 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.974: INFO: Container c ready: false, restart count 0 Jan 24 12:26:06.974: INFO: netserver-3 started at 2023-01-24 12:25:55 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.974: INFO: Container webserver ready: false, restart count 0 Jan 24 12:26:06.974: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-bcqr7 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.974: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:06.974: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-vqntn started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.974: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:06.974: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-4jptx started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.974: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:06.974: INFO: fail-once-local-4kxtz started at 2023-01-24 12:20:23 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.974: INFO: Container c ready: false, restart count 1 Jan 24 12:26:06.974: INFO: indexed-job-0-q2xds started at 2023-01-24 12:21:23 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:06.974: INFO: Container c ready: false, restart count 0 Jan 24 12:26:07.244: INFO: Latency metrics for node ip-172-20-63-190.us-west-1.compute.internal �[1mSTEP�[0m: Collecting events from namespace "webhook-9915-markers". �[1mSTEP�[0m: Found 0 events. Jan 24 12:26:07.364: INFO: POD NODE PHASE GRACE CONDITIONS Jan 24 12:26:07.364: INFO: Jan 24 12:26:07.425: INFO: Logging node info for node ip-172-20-42-201.us-west-1.compute.internal Jan 24 12:26:07.485: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-42-201.us-west-1.compute.internal cc6006a6-61fd-4f4c-b296-ba72367bb0f8 25014 0 2023-01-24 12:07:14 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-1 failure-domain.beta.kubernetes.io/zone:us-west-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-42-201.us-west-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/control-plane: node-role.kubernetes.io/master: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:us-west-1a topology.kubernetes.io/region:us-west-1 topology.kubernetes.io/zone:us-west-1a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-08c27beef2082266b"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-24 12:07:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {protokube Update v1 2023-01-24 12:07:41 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kops-controller Update v1 2023-01-24 12:07:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/master":{}}}} } {kube-controller-manager Update v1 2023-01-24 12:07:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-24 12:09:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-1a/i-08c27beef2082266b,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892264960 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787407360 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-24 12:25:07 +0000 UTC,LastTransitionTime:2023-01-24 12:07:14 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-24 12:25:07 +0000 UTC,LastTransitionTime:2023-01-24 12:07:14 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-24 12:25:07 +0000 UTC,LastTransitionTime:2023-01-24 12:07:14 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-24 12:25:07 +0000 UTC,LastTransitionTime:2023-01-24 12:07:55 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.201,},NodeAddress{Type:ExternalIP,Address:54.215.124.25,},NodeAddress{Type:Hostname,Address:ip-172-20-42-201.us-west-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-42-201.us-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-215-124-25.us-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2be20fd28580af17ed5c32106be540,SystemUUID:ec2be20f-d285-80af-17ed-5c32106be540,BootID:cb576848-3e1b-4407-b81d-d34a637f2afd,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.23.16,KubeProxyVersion:v1.23.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.23.16 registry.k8s.io/kube-apiserver-amd64:v1.23.16],SizeBytes:131340755,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.23.16 registry.k8s.io/kube-controller-manager-amd64:v1.23.16],SizeBytes:121280825,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.16 registry.k8s.io/kube-proxy-amd64:v1.23.16],SizeBytes:112743991,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.23.16 registry.k8s.io/kube-scheduler-amd64:v1.23.16],SizeBytes:53193016,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-beta.2],SizeBytes:43191763,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-beta.2],SizeBytes:42821714,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-beta.2],SizeBytes:4965793,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 24 12:26:07.486: INFO: Logging kubelet events for node ip-172-20-42-201.us-west-1.compute.internal Jan 24 12:26:07.549: INFO: Logging pods the kubelet thinks is on node ip-172-20-42-201.us-west-1.compute.internal Jan 24 12:26:07.614: INFO: kube-apiserver-ip-172-20-42-201.us-west-1.compute.internal started at 2023-01-24 12:06:45 +0000 UTC (0+2 container statuses recorded) Jan 24 12:26:07.614: INFO: Container healthcheck ready: true, restart count 0 Jan 24 12:26:07.614: INFO: Container kube-apiserver ready: true, restart count 1 Jan 24 12:26:07.614: INFO: ebs-csi-node-4lwrc started at 2023-01-24 12:07:40 +0000 UTC (0+3 container statuses recorded) Jan 24 12:26:07.614: INFO: Container ebs-plugin ready: true, restart count 0 Jan 24 12:26:07.614: INFO: Container liveness-probe ready: true, restart count 0 Jan 24 12:26:07.614: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 24 12:26:07.614: INFO: kops-controller-8k2c2 started at 2023-01-24 12:07:41 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:07.614: INFO: Container kops-controller ready: true, restart count 0 Jan 24 12:26:07.614: INFO: ebs-csi-controller-7bd4fbc786-nm7v4 started at 2023-01-24 12:07:42 +0000 UTC (0+5 container statuses recorded) Jan 24 12:26:07.614: INFO: Container csi-attacher ready: true, restart count 0 Jan 24 12:26:07.614: INFO: Container csi-provisioner ready: true, restart count 0 Jan 24 12:26:07.614: INFO: Container csi-resizer ready: true, restart count 0 Jan 24 12:26:07.614: INFO: Container ebs-plugin ready: true, restart count 0 Jan 24 12:26:07.614: INFO: Container liveness-probe ready: true, restart count 0 Jan 24 12:26:07.614: INFO: etcd-manager-events-ip-172-20-42-201.us-west-1.compute.internal started at 2023-01-24 12:06:45 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:07.614: INFO: Container etcd-manager ready: true, restart count 0 Jan 24 12:26:07.614: INFO: etcd-manager-main-ip-172-20-42-201.us-west-1.compute.internal started at 2023-01-24 12:06:45 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:07.614: INFO: Container etcd-manager ready: true, restart count 0 Jan 24 12:26:07.614: INFO: cilium-5dpkw started at 2023-01-24 12:07:38 +0000 UTC (1+1 container statuses recorded) Jan 24 12:26:07.614: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 24 12:26:07.614: INFO: Container cilium-agent ready: true, restart count 1 Jan 24 12:26:07.614: INFO: cilium-operator-d84d55876-rfmxk started at 2023-01-24 12:07:41 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:07.614: INFO: Container cilium-operator ready: true, restart count 1 Jan 24 12:26:07.614: INFO: dns-controller-58d7bbb845-c475n started at 2023-01-24 12:07:41 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:07.614: INFO: Container dns-controller ready: true, restart count 0 Jan 24 12:26:07.614: INFO: kube-controller-manager-ip-172-20-42-201.us-west-1.compute.internal started at 2023-01-24 12:06:45 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:07.614: INFO: Container kube-controller-manager ready: true, restart count 2 Jan 24 12:26:07.614: INFO: kube-scheduler-ip-172-20-42-201.us-west-1.compute.internal started at 2023-01-24 12:06:45 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:07.614: INFO: Container kube-scheduler ready: true, restart count 0 Jan 24 12:26:07.845: INFO: Latency metrics for node ip-172-20-42-201.us-west-1.compute.internal Jan 24 12:26:07.846: INFO: Logging node info for node ip-172-20-58-8.us-west-1.compute.internal Jan 24 12:26:07.906: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-58-8.us-west-1.compute.internal 4a97117d-69ce-4a16-9e93-9e41b32a9a62 24073 0 2023-01-24 12:09:13 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-1 failure-domain.beta.kubernetes.io/zone:us-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-58-8.us-west-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-1a topology.hostpath.csi/node:ip-172-20-58-8.us-west-1.compute.internal topology.kubernetes.io/region:us-west-1 topology.kubernetes.io/zone:us-west-1a] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-5577":"csi-mock-csi-mock-volumes-5577","ebs.csi.aws.com":"i-0cf7a751b954f0403"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2023-01-24 12:09:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-24 12:09:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-24 12:09:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-01-24 12:17:56 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-24 12:18:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {e2e.test Update v1 2023-01-24 12:19:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-1a/i-0cf7a751b954f0403,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051644416 0} {<nil>} 3956684Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946786816 0} {<nil>} 3854284Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-24 12:21:05 +0000 UTC,LastTransitionTime:2023-01-24 12:09:13 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-24 12:21:05 +0000 UTC,LastTransitionTime:2023-01-24 12:09:13 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-24 12:21:05 +0000 UTC,LastTransitionTime:2023-01-24 12:09:13 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-24 12:21:05 +0000 UTC,LastTransitionTime:2023-01-24 12:09:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.58.8,},NodeAddress{Type:ExternalIP,Address:52.53.154.168,},NodeAddress{Type:Hostname,Address:ip-172-20-58-8.us-west-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-58-8.us-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-52-53-154-168.us-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec21f66ef1338663d7ef9e17ce7835a7,SystemUUID:ec21f66e-f133-8663-d7ef-9e17ce7835a7,BootID:e76a2ed0-0929-4d54-b334-e1f0ad9eacd2,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.23.16,KubeProxyVersion:v1.23.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.16 registry.k8s.io/kube-proxy-amd64:v1.23.16],SizeBytes:112743991,},ContainerImage{Names:[docker.io/library/nginx@sha256:b8f2383a95879e1ae064940d9a200f67a6c79e710ed82ac42263397367e7cc4e docker.io/library/nginx:latest],SizeBytes:56882371,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a k8s.gcr.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 k8s.gcr.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-00a8f7338bd3c4426],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-00a8f7338bd3c4426,DevicePath:,},},Config:nil,},} Jan 24 12:26:07.906: INFO: Logging kubelet events for node ip-172-20-58-8.us-west-1.compute.internal Jan 24 12:26:07.968: INFO: Logging pods the kubelet thinks is on node ip-172-20-58-8.us-west-1.compute.internal Jan 24 12:26:08.042: INFO: ss-1 started at 2023-01-24 12:19:34 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.043: INFO: Container webserver ready: true, restart count 0 Jan 24 12:26:08.043: INFO: pvc-volume-tester-gnxjv started at 2023-01-24 12:21:49 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.043: INFO: Container volume-tester ready: false, restart count 0 Jan 24 12:26:08.043: INFO: ss2-2 started at 2023-01-24 12:19:40 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.043: INFO: Container webserver ready: false, restart count 0 Jan 24 12:26:08.043: INFO: pod-c333283a-a7fd-4c9e-9b2c-ec103bf12056 started at 2023-01-24 12:25:06 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.043: INFO: Container write-pod ready: false, restart count 0 Jan 24 12:26:08.043: INFO: ebs-csi-node-4bbqn started at 2023-01-24 12:09:14 +0000 UTC (0+3 container statuses recorded) Jan 24 12:26:08.043: INFO: Container ebs-plugin ready: true, restart count 0 Jan 24 12:26:08.043: INFO: Container liveness-probe ready: true, restart count 0 Jan 24 12:26:08.043: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 24 12:26:08.043: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-5q458 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.043: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:08.043: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-fhs4l started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.043: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:08.043: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-26vrc started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.043: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:08.043: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-c7hrk started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.043: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:08.043: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-58gdd started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.043: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: false, restart count 0 Jan 24 12:26:08.043: INFO: cilium-nchqx started at 2023-01-24 12:09:14 +0000 UTC (1+1 container statuses recorded) Jan 24 12:26:08.043: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 24 12:26:08.043: INFO: Container cilium-agent ready: true, restart count 0 Jan 24 12:26:08.043: INFO: netserver-0 started at 2023-01-24 12:25:31 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.043: INFO: Container webserver ready: false, restart count 0 Jan 24 12:26:08.043: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-qdqt9 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.043: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:08.043: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-vj22z started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.043: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:08.043: INFO: coredns-867df8f45c-8jvsj started at 2023-01-24 12:09:41 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.043: INFO: Container coredns ready: true, restart count 0 Jan 24 12:26:08.043: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-5znh6 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.043: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:08.043: INFO: csi-mockplugin-0 started at 2023-01-24 12:20:09 +0000 UTC (0+3 container statuses recorded) Jan 24 12:26:08.043: INFO: Container csi-provisioner ready: true, restart count 0 Jan 24 12:26:08.043: INFO: Container driver-registrar ready: true, restart count 0 Jan 24 12:26:08.043: INFO: Container mock ready: true, restart count 0 Jan 24 12:26:08.043: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-qbrts started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.043: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:08.043: INFO: hostexec-ip-172-20-58-8.us-west-1.compute.internal-c2xpk started at 2023-01-24 12:25:03 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.043: INFO: Container agnhost-container ready: true, restart count 0 Jan 24 12:26:08.043: INFO: hostpathsymlink-injector started at 2023-01-24 12:21:09 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.043: INFO: Container hostpathsymlink-injector ready: false, restart count 0 Jan 24 12:26:08.043: INFO: hostexec-ip-172-20-58-8.us-west-1.compute.internal-zp8t6 started at 2023-01-24 12:21:11 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.043: INFO: Container agnhost-container ready: true, restart count 0 Jan 24 12:26:08.043: INFO: netserver-0 started at 2023-01-24 12:25:55 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.043: INFO: Container webserver ready: false, restart count 0 Jan 24 12:26:08.043: INFO: pod-subpath-test-preprovisionedpv-mmwc started at 2023-01-24 12:21:25 +0000 UTC (2+2 container statuses recorded) Jan 24 12:26:08.043: INFO: Init container init-volume-preprovisionedpv-mmwc ready: false, restart count 0 Jan 24 12:26:08.043: INFO: Init container test-init-subpath-preprovisionedpv-mmwc ready: false, restart count 0 Jan 24 12:26:08.043: INFO: Container test-container-subpath-preprovisionedpv-mmwc ready: false, restart count 0 Jan 24 12:26:08.043: INFO: Container test-container-volume-preprovisionedpv-mmwc ready: false, restart count 0 Jan 24 12:26:08.043: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-qccgl started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.043: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:08.043: INFO: netserver-0 started at 2023-01-24 12:24:45 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.043: INFO: Container webserver ready: false, restart count 0 Jan 24 12:26:08.043: INFO: hostpath-symlink-prep-provisioning-3666 started at 2023-01-24 12:21:28 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.043: INFO: Container init-volume-provisioning-3666 ready: false, restart count 0 Jan 24 12:26:08.340: INFO: Latency metrics for node ip-172-20-58-8.us-west-1.compute.internal Jan 24 12:26:08.341: INFO: Logging node info for node ip-172-20-62-42.us-west-1.compute.internal Jan 24 12:26:08.401: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-62-42.us-west-1.compute.internal 2f9a48a1-cd3d-4169-9d63-d46bd4e4c90b 25209 0 2023-01-24 12:09:10 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-1 failure-domain.beta.kubernetes.io/zone:us-west-1a io.kubernetes.storage.mock/node:some-mock-node kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-62-42.us-west-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-1a topology.hostpath.csi/node:ip-172-20-62-42.us-west-1.compute.internal topology.kubernetes.io/region:us-west-1 topology.kubernetes.io/zone:us-west-1a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0d97debf14f45ab50"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-24 12:09:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-24 12:09:11 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-24 12:09:11 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kube-controller-manager Update v1 2023-01-24 12:17:35 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-24 12:17:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {e2e.test Update v1 2023-01-24 12:19:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-1a/i-0d97debf14f45ab50,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051644416 0} {<nil>} 3956684Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946786816 0} {<nil>} 3854284Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-24 12:25:32 +0000 UTC,LastTransitionTime:2023-01-24 12:09:10 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-24 12:25:32 +0000 UTC,LastTransitionTime:2023-01-24 12:09:10 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-24 12:25:32 +0000 UTC,LastTransitionTime:2023-01-24 12:09:10 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-24 12:25:32 +0000 UTC,LastTransitionTime:2023-01-24 12:09:31 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.62.42,},NodeAddress{Type:ExternalIP,Address:18.144.79.13,},NodeAddress{Type:Hostname,Address:ip-172-20-62-42.us-west-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-62-42.us-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-144-79-13.us-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2f0698917764d226ec108df5fcfc56,SystemUUID:ec2f0698-9177-64d2-26ec-108df5fcfc56,BootID:c6c940f9-7462-43d1-92da-e4a2c837556e,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.23.16,KubeProxyVersion:v1.23.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.16 registry.k8s.io/kube-proxy-amd64:v1.23.16],SizeBytes:112743991,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0719cd6c97522c42b kubernetes.io/csi/ebs.csi.aws.com^vol-08b09c9a68b8e7c77],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-08b09c9a68b8e7c77,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0719cd6c97522c42b,DevicePath:,},},Config:nil,},} Jan 24 12:26:08.402: INFO: Logging kubelet events for node ip-172-20-62-42.us-west-1.compute.internal Jan 24 12:26:08.464: INFO: Logging pods the kubelet thinks is on node ip-172-20-62-42.us-west-1.compute.internal Jan 24 12:26:08.532: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-ls58g started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.532: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:08.532: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-pq8gm started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.532: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:08.532: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-ct4xp started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.532: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: false, restart count 0 Jan 24 12:26:08.532: INFO: client-containers-cc126433-bc6e-4f00-a8b3-033caf4235b9 started at 2023-01-24 12:25:38 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.532: INFO: Container agnhost-container ready: false, restart count 0 Jan 24 12:26:08.532: INFO: pod-subpath-test-projected-2w4x started at 2023-01-24 12:25:51 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.532: INFO: Container test-container-subpath-projected-2w4x ready: false, restart count 0 Jan 24 12:26:08.532: INFO: netserver-1 started at 2023-01-24 12:25:55 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.532: INFO: Container webserver ready: false, restart count 0 Jan 24 12:26:08.532: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-cdkxl started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.532: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:08.532: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-jmg66 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.532: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:08.532: INFO: netserver-1 started at 2023-01-24 12:25:31 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.532: INFO: Container webserver ready: true, restart count 0 Jan 24 12:26:08.532: INFO: ss-0 started at 2023-01-24 12:18:53 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.532: INFO: Container webserver ready: true, restart count 0 Jan 24 12:26:08.532: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-g4s7s started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.532: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:08.532: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-cc5vr started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.532: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:08.532: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-m869g started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.532: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:08.532: INFO: ebs-csi-node-9pt8t started at 2023-01-24 12:09:11 +0000 UTC (0+3 container statuses recorded) Jan 24 12:26:08.532: INFO: Container ebs-plugin ready: true, restart count 0 Jan 24 12:26:08.532: INFO: Container liveness-probe ready: true, restart count 0 Jan 24 12:26:08.532: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 24 12:26:08.532: INFO: cilium-45k6r started at 2023-01-24 12:09:11 +0000 UTC (1+1 container statuses recorded) Jan 24 12:26:08.532: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 24 12:26:08.532: INFO: Container cilium-agent ready: true, restart count 0 Jan 24 12:26:08.532: INFO: var-expansion-07acec39-86b9-4e15-805b-2b0a172a9495 started at 2023-01-24 12:24:48 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.532: INFO: Container dapi-container ready: false, restart count 0 Jan 24 12:26:08.532: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-w4rqg started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.532: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:08.532: INFO: ss-0 started at 2023-01-24 12:21:08 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.532: INFO: Container webserver ready: true, restart count 0 Jan 24 12:26:08.532: INFO: indexed-job-1-4twdx started at 2023-01-24 12:21:23 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.532: INFO: Container c ready: false, restart count 0 Jan 24 12:26:08.532: INFO: netserver-1 started at 2023-01-24 12:24:45 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.532: INFO: Container webserver ready: false, restart count 0 Jan 24 12:26:08.532: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-l77fq started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:08.532: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:08.827: INFO: Latency metrics for node ip-172-20-62-42.us-west-1.compute.internal Jan 24 12:26:08.827: INFO: Logging node info for node ip-172-20-63-134.us-west-1.compute.internal Jan 24 12:26:08.888: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-63-134.us-west-1.compute.internal 30ac81c2-1bcf-49af-aa05-528c41f9d04a 25045 0 2023-01-24 12:09:05 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-1 failure-domain.beta.kubernetes.io/zone:us-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-63-134.us-west-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-1a topology.hostpath.csi/node:ip-172-20-63-134.us-west-1.compute.internal topology.kubernetes.io/region:us-west-1 topology.kubernetes.io/zone:us-west-1a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0f4c0c89e622dd2cb"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2023-01-24 12:09:05 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-24 12:09:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-01-24 12:09:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-24 12:16:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-01-24 12:16:21 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {e2e.test Update v1 2023-01-24 12:19:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-1a/i-0f4c0c89e622dd2cb,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051644416 0} {<nil>} 3956684Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946786816 0} {<nil>} 3854284Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-24 12:25:14 +0000 UTC,LastTransitionTime:2023-01-24 12:09:05 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-24 12:25:14 +0000 UTC,LastTransitionTime:2023-01-24 12:09:05 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-24 12:25:14 +0000 UTC,LastTransitionTime:2023-01-24 12:09:05 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-24 12:25:14 +0000 UTC,LastTransitionTime:2023-01-24 12:09:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.63.134,},NodeAddress{Type:ExternalIP,Address:13.52.252.72,},NodeAddress{Type:Hostname,Address:ip-172-20-63-134.us-west-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-63-134.us-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-52-252-72.us-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec216b16315774b9b69907761ee0f87b,SystemUUID:ec216b16-3157-74b9-b699-07761ee0f87b,BootID:a0b9767c-5621-442f-8ded-9126e82e52b2,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.23.16,KubeProxyVersion:v1.23.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.16 registry.k8s.io/kube-proxy-amd64:v1.23.16],SizeBytes:112743991,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[docker.io/library/nginx@sha256:b8f2383a95879e1ae064940d9a200f67a6c79e710ed82ac42263397367e7cc4e docker.io/library/nginx:latest],SizeBytes:56882371,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a k8s.gcr.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 k8s.gcr.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac k8s.gcr.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0ff989d77482eddbb],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0ff989d77482eddbb,DevicePath:,},},Config:nil,},} Jan 24 12:26:08.888: INFO: Logging kubelet events for node ip-172-20-63-134.us-west-1.compute.internal Jan 24 12:26:08.971: INFO: Logging pods the kubelet thinks is on node ip-172-20-63-134.us-west-1.compute.internal Jan 24 12:26:09.047: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-x2c2b started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.047: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:09.047: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-b74rw started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.047: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:09.047: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-dwht5 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.047: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:09.047: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-gp5cx started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.047: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:09.047: INFO: csi-hostpathplugin-0 started at 2023-01-24 12:20:09 +0000 UTC (0+7 container statuses recorded) Jan 24 12:26:09.047: INFO: Container csi-attacher ready: false, restart count 0 Jan 24 12:26:09.047: INFO: Container csi-provisioner ready: false, restart count 0 Jan 24 12:26:09.047: INFO: Container csi-resizer ready: false, restart count 0 Jan 24 12:26:09.047: INFO: Container csi-snapshotter ready: false, restart count 0 Jan 24 12:26:09.047: INFO: Container hostpath ready: false, restart count 0 Jan 24 12:26:09.047: INFO: Container liveness-probe ready: false, restart count 0 Jan 24 12:26:09.047: INFO: Container node-driver-registrar ready: false, restart count 0 Jan 24 12:26:09.047: INFO: netserver-2 started at 2023-01-24 12:24:45 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.047: INFO: Container webserver ready: false, restart count 0 Jan 24 12:26:09.047: INFO: netserver-2 started at 2023-01-24 12:25:31 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.047: INFO: Container webserver ready: true, restart count 0 Jan 24 12:26:09.047: INFO: ebs-csi-node-v75jm started at 2023-01-24 12:09:06 +0000 UTC (0+3 container statuses recorded) Jan 24 12:26:09.047: INFO: Container ebs-plugin ready: true, restart count 0 Jan 24 12:26:09.047: INFO: Container liveness-probe ready: true, restart count 0 Jan 24 12:26:09.047: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 24 12:26:09.047: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-g7hv8 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.047: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:09.047: INFO: netserver-2 started at 2023-01-24 12:25:55 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.047: INFO: Container webserver ready: false, restart count 0 Jan 24 12:26:09.047: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-vnplb started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.047: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:09.047: INFO: ss2-1 started at 2023-01-24 12:19:02 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.047: INFO: Container webserver ready: true, restart count 0 Jan 24 12:26:09.047: INFO: csi-hostpathplugin-0 started at 2023-01-24 12:25:18 +0000 UTC (0+7 container statuses recorded) Jan 24 12:26:09.047: INFO: Container csi-attacher ready: false, restart count 0 Jan 24 12:26:09.047: INFO: Container csi-provisioner ready: false, restart count 0 Jan 24 12:26:09.047: INFO: Container csi-resizer ready: false, restart count 0 Jan 24 12:26:09.047: INFO: Container csi-snapshotter ready: false, restart count 0 Jan 24 12:26:09.047: INFO: Container hostpath ready: false, restart count 0 Jan 24 12:26:09.047: INFO: Container liveness-probe ready: false, restart count 0 Jan 24 12:26:09.047: INFO: Container node-driver-registrar ready: false, restart count 0 Jan 24 12:26:09.047: INFO: coredns-autoscaler-557ccb4c66-gl766 started at 2023-01-24 12:09:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.047: INFO: Container autoscaler ready: true, restart count 0 Jan 24 12:26:09.047: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-8wf5k started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.047: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:09.047: INFO: coredns-867df8f45c-wcswf started at 2023-01-24 12:09:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.047: INFO: Container coredns ready: true, restart count 0 Jan 24 12:26:09.047: INFO: ss-0 started at 2023-01-24 12:19:42 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.047: INFO: Container webserver ready: false, restart count 0 Jan 24 12:26:09.047: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-gh2rw started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.047: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:09.047: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-bqvzk started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.047: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: false, restart count 0 Jan 24 12:26:09.047: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-9kzn4 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.047: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: false, restart count 0 Jan 24 12:26:09.047: INFO: cilium-mkm5g started at 2023-01-24 12:09:06 +0000 UTC (1+1 container statuses recorded) Jan 24 12:26:09.047: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 24 12:26:09.047: INFO: Container cilium-agent ready: true, restart count 0 Jan 24 12:26:09.289: INFO: Latency metrics for node ip-172-20-63-134.us-west-1.compute.internal Jan 24 12:26:09.289: INFO: Logging node info for node ip-172-20-63-190.us-west-1.compute.internal Jan 24 12:26:09.349: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-63-190.us-west-1.compute.internal d80c92f0-6fa8-4333-b1ea-6b0b4cdbea2d 25475 0 2023-01-24 12:09:12 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-1 failure-domain.beta.kubernetes.io/zone:us-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-63-190.us-west-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-1a topology.hostpath.csi/node:ip-172-20-63-190.us-west-1.compute.internal topology.kubernetes.io/region:us-west-1 topology.kubernetes.io/zone:us-west-1a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0fd113285a9315bba"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2023-01-24 12:09:12 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-24 12:09:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-24 12:09:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-01-24 12:19:02 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-24 12:19:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {e2e.test Update v1 2023-01-24 12:19:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-1a/i-0fd113285a9315bba,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051652608 0} {<nil>} 3956692Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946795008 0} {<nil>} 3854292Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-24 12:25:53 +0000 UTC,LastTransitionTime:2023-01-24 12:09:12 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-24 12:25:53 +0000 UTC,LastTransitionTime:2023-01-24 12:09:12 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-24 12:25:53 +0000 UTC,LastTransitionTime:2023-01-24 12:09:12 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-24 12:25:53 +0000 UTC,LastTransitionTime:2023-01-24 12:09:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.63.190,},NodeAddress{Type:ExternalIP,Address:54.215.249.154,},NodeAddress{Type:Hostname,Address:ip-172-20-63-190.us-west-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-63-190.us-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-215-249-154.us-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec255708dba66ed160033f1fab58ba92,SystemUUID:ec255708-dba6-6ed1-6003-3f1fab58ba92,BootID:4e4cb7aa-a82e-4abd-a66d-5fb285cb6c0b,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.23.16,KubeProxyVersion:v1.23.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.16 registry.k8s.io/kube-proxy-amd64:v1.23.16],SizeBytes:112743991,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-057a1367ebd667fa7 kubernetes.io/csi/ebs.csi.aws.com^vol-08a0be3744dd7cd6f kubernetes.io/csi/ebs.csi.aws.com^vol-0d966a9348a99e832],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-057a1367ebd667fa7,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-08a0be3744dd7cd6f,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0d966a9348a99e832,DevicePath:,},},Config:nil,},} Jan 24 12:26:09.349: INFO: Logging kubelet events for node ip-172-20-63-190.us-west-1.compute.internal Jan 24 12:26:09.411: INFO: Logging pods the kubelet thinks is on node ip-172-20-63-190.us-west-1.compute.internal Jan 24 12:26:09.479: INFO: netserver-3 started at 2023-01-24 12:24:46 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.479: INFO: Container webserver ready: false, restart count 0 Jan 24 12:26:09.479: INFO: pod-subpath-test-preprovisionedpv-67dn started at 2023-01-24 12:25:38 +0000 UTC (2+1 container statuses recorded) Jan 24 12:26:09.479: INFO: Init container init-volume-preprovisionedpv-67dn ready: false, restart count 0 Jan 24 12:26:09.479: INFO: Init container test-init-volume-preprovisionedpv-67dn ready: false, restart count 0 Jan 24 12:26:09.479: INFO: Container test-container-subpath-preprovisionedpv-67dn ready: false, restart count 0 Jan 24 12:26:09.479: INFO: sample-webhook-deployment-6c69dbd86b-2nv64 started at 2023-01-24 12:21:04 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.479: INFO: Container sample-webhook ready: false, restart count 0 Jan 24 12:26:09.479: INFO: netserver-3 started at 2023-01-24 12:25:31 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.479: INFO: Container webserver ready: true, restart count 0 Jan 24 12:26:09.479: INFO: ss-1 started at 2023-01-24 12:19:17 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.479: INFO: Container webserver ready: false, restart count 0 Jan 24 12:26:09.479: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-5rrg5 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.479: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:09.479: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-s27h5 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.479: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:09.479: INFO: cilium-54xb4 started at 2023-01-24 12:09:13 +0000 UTC (1+1 container statuses recorded) Jan 24 12:26:09.479: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 24 12:26:09.479: INFO: Container cilium-agent ready: true, restart count 0 Jan 24 12:26:09.479: INFO: pod-configmaps-a5500270-4a4d-4e46-88af-e3fe1d585df0 started at 2023-01-24 12:25:37 +0000 UTC (0+2 container statuses recorded) Jan 24 12:26:09.479: INFO: Container agnhost-container ready: false, restart count 0 Jan 24 12:26:09.479: INFO: Container configmap-volume-binary-test ready: false, restart count 0 Jan 24 12:26:09.479: INFO: fail-once-local-t84jj started at 2023-01-24 12:20:44 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.479: INFO: Container c ready: false, restart count 0 Jan 24 12:26:09.479: INFO: pod-prestop-hook-56510143-6a4e-4e26-8ba3-e13327e62e97 started at 2023-01-24 12:21:07 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.479: INFO: Container nginx ready: false, restart count 0 Jan 24 12:26:09.479: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-tzgzx started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.479: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:09.479: INFO: hostexec-ip-172-20-63-190.us-west-1.compute.internal-zn54q started at 2023-01-24 12:25:33 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.479: INFO: Container agnhost-container ready: true, restart count 0 Jan 24 12:26:09.479: INFO: indexed-job-2-rhrn5 started at 2023-01-24 12:25:46 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.479: INFO: Container c ready: false, restart count 0 Jan 24 12:26:09.479: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-8ztk4 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.479: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:09.479: INFO: ss2-0 started at 2023-01-24 12:19:01 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.479: INFO: Container webserver ready: true, restart count 0 Jan 24 12:26:09.479: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-9pdvd started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.479: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: false, restart count 0 Jan 24 12:26:09.479: INFO: ss-1 started at 2023-01-24 12:19:16 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.479: INFO: Container webserver ready: false, restart count 0 Jan 24 12:26:09.479: INFO: ss-2 started at 2023-01-24 12:25:59 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.479: INFO: Container webserver ready: false, restart count 0 Jan 24 12:26:09.479: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-kzfz9 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.479: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:09.479: INFO: ebs-csi-node-ld8b2 started at 2023-01-24 12:09:13 +0000 UTC (0+3 container statuses recorded) Jan 24 12:26:09.479: INFO: Container ebs-plugin ready: true, restart count 0 Jan 24 12:26:09.479: INFO: Container liveness-probe ready: true, restart count 0 Jan 24 12:26:09.479: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 24 12:26:09.479: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-dhzcl started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.479: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:09.479: INFO: fail-once-local-nkjmd started at 2023-01-24 12:20:23 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.479: INFO: Container c ready: false, restart count 0 Jan 24 12:26:09.479: INFO: fail-once-local-4kxtz started at 2023-01-24 12:20:23 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.479: INFO: Container c ready: false, restart count 1 Jan 24 12:26:09.479: INFO: netserver-3 started at 2023-01-24 12:25:55 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.479: INFO: Container webserver ready: false, restart count 0 Jan 24 12:26:09.479: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-bcqr7 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.479: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:09.479: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-vqntn started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.479: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:09.479: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-4jptx started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.479: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:26:09.479: INFO: indexed-job-0-q2xds started at 2023-01-24 12:21:23 +0000 UTC (0+1 container statuses recorded) Jan 24 12:26:09.479: INFO: Container c ready: false, restart count 0 Jan 24 12:26:09.740: INFO: Latency metrics for node ip-172-20-63-190.us-west-1.compute.internal Jan 24 12:26:09.740: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "webhook-9915" for this suite. �[1mSTEP�[0m: Destroying namespace "webhook-9915-markers" for this suite. [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:102
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-apps\]\sDeployment\sdeployment\sshould\ssupport\sproportional\sscaling\s\[Conformance\]$'
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:633 Jan 24 12:25:33.741: error in waiting for pods to come up: failed to wait for pods running: [timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition] Unexpected error: <*errors.errorString | 0xc004fe00b0>: { s: "failed to wait for pods running: [timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition]", } failed to wait for pods running: [timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition] occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/deployment.go:1200from junit_23.xml
[BeforeEach] [sig-apps] Deployment /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Jan 24 12:20:32.941: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename deployment �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace [BeforeEach] [sig-apps] Deployment /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/deployment.go:89 [It] deployment should support proportional scaling [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:633 Jan 24 12:20:33.354: INFO: Creating deployment "webserver-deployment" Jan 24 12:20:33.415: INFO: Waiting for observed generation 1 Jan 24 12:20:33.490: INFO: Waiting for all required pods to come up Jan 24 12:20:33.556: INFO: Pod name httpd: Found 10 pods out of 10 �[1mSTEP�[0m: ensuring each pod is running Jan 24 12:25:33.741: FAIL: error in waiting for pods to come up: failed to wait for pods running: [timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition] Unexpected error: <*errors.errorString | 0xc004fe00b0>: { s: "failed to wait for pods running: [timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition]", } failed to wait for pods running: [timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition] occurred Full Stack Trace k8s.io/kubernetes/test/e2e/apps.testProportionalScalingDeployment(0x0?) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/deployment.go:1200 +0x6e5 k8s.io/kubernetes/test/e2e/apps.glob..func4.11() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/deployment.go:159 +0x1d k8s.io/kubernetes/test/e2e.RunE2ETests(0x24eec17?) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:133 +0x6b7 k8s.io/kubernetes/test/e2e.TestE2E(0x24602d9?) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc000d82680, 0x72ecb90) /usr/local/go/src/testing/testing.go:1446 +0x10b created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1493 +0x35f [AfterEach] [sig-apps] Deployment /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/deployment.go:83 Jan 24 12:25:33.801: INFO: Deployment "webserver-deployment": &Deployment{ObjectMeta:{webserver-deployment deployment-6871 2d90de2f-8407-4f56-9d0a-5d3542490ced 24134 1 2023-01-24 12:20:33 +0000 UTC <nil> <nil> map[name:httpd] map[deployment.kubernetes.io/revision:1] [] [] [{e2e.test Update apps/v1 2023-01-24 12:20:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{".":{},"f:name":{}}},"f:spec":{"f:progressDeadlineSeconds":{},"f:replicas":{},"f:revisionHistoryLimit":{},"f:selector":{},"f:strategy":{"f:rollingUpdate":{".":{},"f:maxSurge":{},"f:maxUnavailable":{}},"f:type":{}},"f:template":{"f:metadata":{"f:labels":{".":{},"f:name":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}}} } {kube-controller-manager Update apps/v1 2023-01-24 12:20:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:deployment.kubernetes.io/revision":{}}},"f:status":{"f:availableReplicas":{},"f:conditions":{".":{},"k:{\"type\":\"Available\"}":{".":{},"f:lastTransitionTime":{},"f:lastUpdateTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Progressing\"}":{".":{},"f:lastTransitionTime":{},"f:lastUpdateTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:observedGeneration":{},"f:readyReplicas":{},"f:replicas":{},"f:unavailableReplicas":{},"f:updatedReplicas":{}}} status}]},Spec:DeploymentSpec{Replicas:*10,Selector:&v1.LabelSelector{MatchLabels:map[string]string{name: httpd,},MatchExpressions:[]LabelSelectorRequirement{},},Template:{{ 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[name:httpd] map[] [] [] []} {[] [] [{httpd k8s.gcr.io/e2e-test-images/httpd:2.4.38-2 [] [] [] [] [] {map[] map[]} [] [] nil nil nil nil /dev/termination-log File IfNotPresent SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,} false false false}] [] Always 0xc001b04398 <nil> ClusterFirst map[] <nil> false false false <nil> &PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,} [] nil default-scheduler [] [] <nil> nil [] <nil> <nil> <nil> map[] [] <nil> nil}},Strategy:DeploymentStrategy{Type:RollingUpdate,RollingUpdate:&RollingUpdateDeployment{MaxUnavailable:2,MaxSurge:3,},},MinReadySeconds:0,RevisionHistoryLimit:*10,Paused:false,ProgressDeadlineSeconds:*600,},Status:DeploymentStatus{ObservedGeneration:1,Replicas:10,UpdatedReplicas:10,AvailableReplicas:4,UnavailableReplicas:6,Conditions:[]DeploymentCondition{DeploymentCondition{Type:Available,Status:False,Reason:MinimumReplicasUnavailable,Message:Deployment does not have minimum availability.,LastUpdateTime:2023-01-24 12:20:33 +0000 UTC,LastTransitionTime:2023-01-24 12:20:33 +0000 UTC,},DeploymentCondition{Type:Progressing,Status:True,Reason:ReplicaSetUpdated,Message:ReplicaSet "webserver-deployment-5d9fdcc779" is progressing.,LastUpdateTime:2023-01-24 12:21:26 +0000 UTC,LastTransitionTime:2023-01-24 12:20:33 +0000 UTC,},},ReadyReplicas:4,CollisionCount:nil,},} Jan 24 12:25:33.860: INFO: New ReplicaSet "webserver-deployment-5d9fdcc779" of Deployment "webserver-deployment": &ReplicaSet{ObjectMeta:{webserver-deployment-5d9fdcc779 deployment-6871 7adeae79-dbcd-40a6-9be0-703016df5e6e 24132 1 2023-01-24 12:20:33 +0000 UTC <nil> <nil> map[name:httpd pod-template-hash:5d9fdcc779] map[deployment.kubernetes.io/desired-replicas:10 deployment.kubernetes.io/max-replicas:13 deployment.kubernetes.io/revision:1] [{apps/v1 Deployment webserver-deployment 2d90de2f-8407-4f56-9d0a-5d3542490ced 0xc00508a007 0xc00508a008}] [] [{kube-controller-manager Update apps/v1 2023-01-24 12:20:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:deployment.kubernetes.io/desired-replicas":{},"f:deployment.kubernetes.io/max-replicas":{},"f:deployment.kubernetes.io/revision":{}},"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"2d90de2f-8407-4f56-9d0a-5d3542490ced\"}":{}}},"f:spec":{"f:replicas":{},"f:selector":{},"f:template":{"f:metadata":{"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}}} } {kube-controller-manager Update apps/v1 2023-01-24 12:20:47 +0000 UTC FieldsV1 {"f:status":{"f:availableReplicas":{},"f:fullyLabeledReplicas":{},"f:observedGeneration":{},"f:readyReplicas":{},"f:replicas":{}}} status}]},Spec:ReplicaSetSpec{Replicas:*10,Selector:&v1.LabelSelector{MatchLabels:map[string]string{name: httpd,pod-template-hash: 5d9fdcc779,},MatchExpressions:[]LabelSelectorRequirement{},},Template:{{ 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[name:httpd pod-template-hash:5d9fdcc779] map[] [] [] []} {[] [] [{httpd k8s.gcr.io/e2e-test-images/httpd:2.4.38-2 [] [] [] [] [] {map[] map[]} [] [] nil nil nil nil /dev/termination-log File IfNotPresent SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,} false false false}] [] Always 0xc00508a098 <nil> ClusterFirst map[] <nil> false false false <nil> &PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,} [] nil default-scheduler [] [] <nil> nil [] <nil> <nil> <nil> map[] [] <nil> nil}},MinReadySeconds:0,},Status:ReplicaSetStatus{Replicas:10,FullyLabeledReplicas:10,ObservedGeneration:1,ReadyReplicas:4,AvailableReplicas:4,Conditions:[]ReplicaSetCondition{},},} Jan 24 12:25:33.922: INFO: Pod "webserver-deployment-5d9fdcc779-9vj6f" is available: &Pod{ObjectMeta:{webserver-deployment-5d9fdcc779-9vj6f webserver-deployment-5d9fdcc779- deployment-6871 58be9499-003b-4840-b527-26b4c08aa0c1 23786 0 2023-01-24 12:20:33 +0000 UTC <nil> <nil> map[name:httpd pod-template-hash:5d9fdcc779] map[] [{apps/v1 ReplicaSet webserver-deployment-5d9fdcc779 7adeae79-dbcd-40a6-9be0-703016df5e6e 0xc0031d2c77 0xc0031d2c78}] [] [{kube-controller-manager Update v1 2023-01-24 12:20:33 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"7adeae79-dbcd-40a6-9be0-703016df5e6e\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}} } {kubelet Update v1 2023-01-24 12:21:02 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:phase":{},"f:podIP":{},"f:podIPs":{".":{},"k:{\"ip\":\"172.20.37.72\"}":{".":{},"f:ip":{}}},"f:startTime":{}}} status}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-826cz,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:httpd,Image:k8s.gcr.io/e2e-test-images/httpd:2.4.38-2,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-826cz,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:ip-172-20-62-42.us-west-1.compute.internal,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,OS:nil,},Status:PodStatus{Phase:Running,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-24 12:20:33 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-24 12:21:02 +0000 UTC,Reason:,Message:,},PodCondition{Type:ContainersReady,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-24 12:21:02 +0000 UTC,Reason:,Message:,},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-24 12:20:33 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:172.20.62.42,PodIP:172.20.37.72,StartTime:2023-01-24 12:20:33 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:httpd,State:ContainerState{Waiting:nil,Running:&ContainerStateRunning{StartedAt:2023-01-24 12:21:01 +0000 UTC,},Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:true,RestartCount:0,Image:k8s.gcr.io/e2e-test-images/httpd:2.4.38-2,ImageID:k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3,ContainerID:containerd://6782822b92e422190c1c8589a176161235672f29054ed9c089b25db49bd64b2a,Started:*true,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{PodIP{IP:172.20.37.72,},},EphemeralContainerStatuses:[]ContainerStatus{},},} Jan 24 12:25:33.922: INFO: Pod "webserver-deployment-5d9fdcc779-f4lt5" is not available: &Pod{ObjectMeta:{webserver-deployment-5d9fdcc779-f4lt5 webserver-deployment-5d9fdcc779- deployment-6871 7de293fa-d4d6-411c-8b08-730b26aad970 23371 0 2023-01-24 12:20:33 +0000 UTC <nil> <nil> map[name:httpd pod-template-hash:5d9fdcc779] map[] [{apps/v1 ReplicaSet webserver-deployment-5d9fdcc779 7adeae79-dbcd-40a6-9be0-703016df5e6e 0xc0031d2e57 0xc0031d2e58}] [] [{kube-controller-manager Update v1 2023-01-24 12:20:33 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"7adeae79-dbcd-40a6-9be0-703016df5e6e\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}} } {kubelet Update v1 2023-01-24 12:20:33 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:startTime":{}}} status}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-xgjpn,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:httpd,Image:k8s.gcr.io/e2e-test-images/httpd:2.4.38-2,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-xgjpn,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:ip-172-20-63-134.us-west-1.compute.internal,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,OS:nil,},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-24 12:20:33 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-24 12:20:33 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-24 12:20:33 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-24 12:20:33 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:172.20.63.134,PodIP:,StartTime:2023-01-24 12:20:33 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:httpd,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ContainerCreating,Message:,},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:k8s.gcr.io/e2e-test-images/httpd:2.4.38-2,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{},EphemeralContainerStatuses:[]ContainerStatus{},},} Jan 24 12:25:33.922: INFO: Pod "webserver-deployment-5d9fdcc779-fv2mx" is not available: &Pod{ObjectMeta:{webserver-deployment-5d9fdcc779-fv2mx webserver-deployment-5d9fdcc779- deployment-6871 173bf4a0-2b1d-4ef4-9a62-e9208119b909 23354 0 2023-01-24 12:20:33 +0000 UTC <nil> <nil> map[name:httpd pod-template-hash:5d9fdcc779] map[] [{apps/v1 ReplicaSet webserver-deployment-5d9fdcc779 7adeae79-dbcd-40a6-9be0-703016df5e6e 0xc0031d3017 0xc0031d3018}] [] [{kube-controller-manager Update v1 2023-01-24 12:20:33 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"7adeae79-dbcd-40a6-9be0-703016df5e6e\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}} } {kubelet Update v1 2023-01-24 12:20:33 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:startTime":{}}} status}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-jx42s,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:httpd,Image:k8s.gcr.io/e2e-test-images/httpd:2.4.38-2,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-jx42s,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:ip-172-20-62-42.us-west-1.compute.internal,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,OS:nil,},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-24 12:20:33 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-24 12:20:33 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-24 12:20:33 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-24 12:20:33 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:172.20.62.42,PodIP:,StartTime:2023-01-24 12:20:33 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:httpd,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ContainerCreating,Message:,},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:k8s.gcr.io/e2e-test-images/httpd:2.4.38-2,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{},EphemeralContainerStatuses:[]ContainerStatus{},},} Jan 24 12:25:33.922: INFO: Pod "webserver-deployment-5d9fdcc779-hqvdm" is not available: &Pod{ObjectMeta:{webserver-deployment-5d9fdcc779-hqvdm webserver-deployment-5d9fdcc779- deployment-6871 2e4f7a60-a6c3-46ff-9e9e-04a7ce0281fc 23360 0 2023-01-24 12:20:33 +0000 UTC <nil> <nil> map[name:httpd pod-template-hash:5d9fdcc779] map[] [{apps/v1 ReplicaSet webserver-deployment-5d9fdcc779 7adeae79-dbcd-40a6-9be0-703016df5e6e 0xc0031d31d7 0xc0031d31d8}] [] [{kube-controller-manager Update v1 2023-01-24 12:20:33 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"7adeae79-dbcd-40a6-9be0-703016df5e6e\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}} } {kubelet Update v1 2023-01-24 12:20:33 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:startTime":{}}} status}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-wpd84,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:httpd,Image:k8s.gcr.io/e2e-test-images/httpd:2.4.38-2,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-wpd84,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:ip-172-20-63-190.us-west-1.compute.internal,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,OS:nil,},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-24 12:20:33 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-24 12:20:33 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-24 12:20:33 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-24 12:20:33 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:172.20.63.190,PodIP:,StartTime:2023-01-24 12:20:33 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:httpd,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ContainerCreating,Message:,},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:k8s.gcr.io/e2e-test-images/httpd:2.4.38-2,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{},EphemeralContainerStatuses:[]ContainerStatus{},},} Jan 24 12:25:33.923: INFO: Pod "webserver-deployment-5d9fdcc779-kcxmz" is available: &Pod{ObjectMeta:{webserver-deployment-5d9fdcc779-kcxmz webserver-deployment-5d9fdcc779- deployment-6871 3c62fb1d-8164-40e4-89ac-6c06f81f490f 23569 0 2023-01-24 12:20:33 +0000 UTC <nil> <nil> map[name:httpd pod-template-hash:5d9fdcc779] map[] [{apps/v1 ReplicaSet webserver-deployment-5d9fdcc779 7adeae79-dbcd-40a6-9be0-703016df5e6e 0xc0031d3397 0xc0031d3398}] [] [{kube-controller-manager Update v1 2023-01-24 12:20:33 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"7adeae79-dbcd-40a6-9be0-703016df5e6e\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}} } {kubelet Update v1 2023-01-24 12:20:47 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:phase":{},"f:podIP":{},"f:podIPs":{".":{},"k:{\"ip\":\"172.20.38.132\"}":{".":{},"f:ip":{}}},"f:startTime":{}}} status}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-rx2mn,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:httpd,Image:k8s.gcr.io/e2e-test-images/httpd:2.4.38-2,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-rx2mn,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:ip-172-20-63-134.us-west-1.compute.internal,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,OS:nil,},Status:PodStatus{Phase:Running,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-24 12:20:33 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-24 12:20:47 +0000 UTC,Reason:,Message:,},PodCondition{Type:ContainersReady,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-24 12:20:47 +0000 UTC,Reason:,Message:,},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-24 12:20:33 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:172.20.63.134,PodIP:172.20.38.132,StartTime:2023-01-24 12:20:33 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:httpd,State:ContainerState{Waiting:nil,Running:&ContainerStateRunning{StartedAt:2023-01-24 12:20:46 +0000 UTC,},Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:true,RestartCount:0,Image:k8s.gcr.io/e2e-test-images/httpd:2.4.38-2,ImageID:k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3,ContainerID:containerd://0a2cd2d410e2a4287ab1bc3cc1c9ac46ac342e6097662e22a890baaf12a4903e,Started:*true,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{PodIP{IP:172.20.38.132,},},EphemeralContainerStatuses:[]ContainerStatus{},},} Jan 24 12:25:33.923: INFO: Pod "webserver-deployment-5d9fdcc779-pdnwl" is not available: &Pod{ObjectMeta:{webserver-deployment-5d9fdcc779-pdnwl webserver-deployment-5d9fdcc779- deployment-6871 f844b3e1-8b69-4efd-9e15-d73a684cee93 23343 0 2023-01-24 12:20:33 +0000 UTC <nil> <nil> map[name:httpd pod-template-hash:5d9fdcc779] map[] [{apps/v1 ReplicaSet webserver-deployment-5d9fdcc779 7adeae79-dbcd-40a6-9be0-703016df5e6e 0xc0031d3577 0xc0031d3578}] [] [{kube-controller-manager Update v1 2023-01-24 12:20:33 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"7adeae79-dbcd-40a6-9be0-703016df5e6e\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}} } {kubelet Update v1 2023-01-24 12:20:33 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:startTime":{}}} status}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-br8fd,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:httpd,Image:k8s.gcr.io/e2e-test-images/httpd:2.4.38-2,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-br8fd,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:ip-172-20-63-190.us-west-1.compute.internal,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,OS:nil,},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-24 12:20:33 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-24 12:20:33 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-24 12:20:33 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-24 12:20:33 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:172.20.63.190,PodIP:,StartTime:2023-01-24 12:20:33 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:httpd,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ContainerCreating,Message:,},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:k8s.gcr.io/e2e-test-images/httpd:2.4.38-2,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{},EphemeralContainerStatuses:[]ContainerStatus{},},} Jan 24 12:25:33.923: INFO: Pod "webserver-deployment-5d9fdcc779-qmwf2" is not available: &Pod{ObjectMeta:{webserver-deployment-5d9fdcc779-qmwf2 webserver-deployment-5d9fdcc779- deployment-6871 7248ce9f-38f1-4064-9848-9611bead2947 23367 0 2023-01-24 12:20:33 +0000 UTC <nil> <nil> map[name:httpd pod-template-hash:5d9fdcc779] map[] [{apps/v1 ReplicaSet webserver-deployment-5d9fdcc779 7adeae79-dbcd-40a6-9be0-703016df5e6e 0xc0031d3747 0xc0031d3748}] [] [{kube-controller-manager Update v1 2023-01-24 12:20:33 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"7adeae79-dbcd-40a6-9be0-703016df5e6e\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}} } {kubelet Update v1 2023-01-24 12:20:33 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:startTime":{}}} status}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-ddz26,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:httpd,Image:k8s.gcr.io/e2e-test-images/httpd:2.4.38-2,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-ddz26,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:ip-172-20-58-8.us-west-1.compute.internal,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,OS:nil,},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-24 12:20:33 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-24 12:20:33 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-24 12:20:33 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-24 12:20:33 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:172.20.58.8,PodIP:,StartTime:2023-01-24 12:20:33 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:httpd,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ContainerCreating,Message:,},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:k8s.gcr.io/e2e-test-images/httpd:2.4.38-2,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{},EphemeralContainerStatuses:[]ContainerStatus{},},} Jan 24 12:25:33.923: INFO: Pod "webserver-deployment-5d9fdcc779-xtrv9" is available: &Pod{ObjectMeta:{webserver-deployment-5d9fdcc779-xtrv9 webserver-deployment-5d9fdcc779- deployment-6871 8d59c346-2471-4a99-a59b-5df0af790429 23966 0 2023-01-24 12:20:33 +0000 UTC <nil> <nil> map[name:httpd pod-template-hash:5d9fdcc779] map[] [{apps/v1 ReplicaSet webserver-deployment-5d9fdcc779 7adeae79-dbcd-40a6-9be0-703016df5e6e 0xc0031d3927 0xc0031d3928}] [] [{kube-controller-manager Update v1 2023-01-24 12:20:33 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"7adeae79-dbcd-40a6-9be0-703016df5e6e\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}} } {kubelet Update v1 2023-01-24 12:21:13 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:phase":{},"f:podIP":{},"f:podIPs":{".":{},"k:{\"ip\":\"172.20.46.176\"}":{".":{},"f:ip":{}}},"f:startTime":{}}} status}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-czjrx,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:httpd,Image:k8s.gcr.io/e2e-test-images/httpd:2.4.38-2,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-czjrx,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:ip-172-20-63-190.us-west-1.compute.internal,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,OS:nil,},Status:PodStatus{Phase:Running,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-24 12:20:33 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-24 12:21:13 +0000 UTC,Reason:,Message:,},PodCondition{Type:ContainersReady,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-24 12:21:13 +0000 UTC,Reason:,Message:,},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-24 12:20:33 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:172.20.63.190,PodIP:172.20.46.176,StartTime:2023-01-24 12:20:33 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:httpd,State:ContainerState{Waiting:nil,Running:&ContainerStateRunning{StartedAt:2023-01-24 12:21:12 +0000 UTC,},Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:true,RestartCount:0,Image:k8s.gcr.io/e2e-test-images/httpd:2.4.38-2,ImageID:k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3,ContainerID:containerd://e75b6248e2108c7f0cfb0079ce1fec5d9558fee4e9a3c9a8161d9cda728cf29e,Started:*true,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{PodIP{IP:172.20.46.176,},},EphemeralContainerStatuses:[]ContainerStatus{},},} Jan 24 12:25:33.923: INFO: Pod "webserver-deployment-5d9fdcc779-xwhl2" is not available: &Pod{ObjectMeta:{webserver-deployment-5d9fdcc779-xwhl2 webserver-deployment-5d9fdcc779- deployment-6871 d9d9de47-2399-4251-aacd-189cfec91a18 23351 0 2023-01-24 12:20:33 +0000 UTC <nil> <nil> map[name:httpd pod-template-hash:5d9fdcc779] map[] [{apps/v1 ReplicaSet webserver-deployment-5d9fdcc779 7adeae79-dbcd-40a6-9be0-703016df5e6e 0xc0031d3b17 0xc0031d3b18}] [] [{kube-controller-manager Update v1 2023-01-24 12:20:33 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"7adeae79-dbcd-40a6-9be0-703016df5e6e\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}} } {kubelet Update v1 2023-01-24 12:20:33 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:startTime":{}}} status}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-gp2l7,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:httpd,Image:k8s.gcr.io/e2e-test-images/httpd:2.4.38-2,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-gp2l7,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:ip-172-20-63-134.us-west-1.compute.internal,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,OS:nil,},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-24 12:20:33 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-24 12:20:33 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-24 12:20:33 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-24 12:20:33 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:172.20.63.134,PodIP:,StartTime:2023-01-24 12:20:33 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:httpd,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ContainerCreating,Message:,},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:k8s.gcr.io/e2e-test-images/httpd:2.4.38-2,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{},EphemeralContainerStatuses:[]ContainerStatus{},},} Jan 24 12:25:33.924: INFO: Pod "webserver-deployment-5d9fdcc779-xz6r8" is available: &Pod{ObjectMeta:{webserver-deployment-5d9fdcc779-xz6r8 webserver-deployment-5d9fdcc779- deployment-6871 2d733aed-6fc5-4b3d-9f1b-16209a5091dc 24131 0 2023-01-24 12:20:33 +0000 UTC <nil> <nil> map[name:httpd pod-template-hash:5d9fdcc779] map[] [{apps/v1 ReplicaSet webserver-deployment-5d9fdcc779 7adeae79-dbcd-40a6-9be0-703016df5e6e 0xc0031d3cf7 0xc0031d3cf8}] [] [{kube-controller-manager Update v1 2023-01-24 12:20:33 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"7adeae79-dbcd-40a6-9be0-703016df5e6e\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}} } {kubelet Update v1 2023-01-24 12:21:26 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:phase":{},"f:podIP":{},"f:podIPs":{".":{},"k:{\"ip\":\"172.20.54.161\"}":{".":{},"f:ip":{}}},"f:startTime":{}}} status}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-r8v9c,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:httpd,Image:k8s.gcr.io/e2e-test-images/httpd:2.4.38-2,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-r8v9c,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:ip-172-20-58-8.us-west-1.compute.internal,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,OS:nil,},Status:PodStatus{Phase:Running,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-24 12:20:33 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-24 12:21:26 +0000 UTC,Reason:,Message:,},PodCondition{Type:ContainersReady,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-24 12:21:26 +0000 UTC,Reason:,Message:,},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-24 12:20:33 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:172.20.58.8,PodIP:172.20.54.161,StartTime:2023-01-24 12:20:33 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:httpd,State:ContainerState{Waiting:nil,Running:&ContainerStateRunning{StartedAt:2023-01-24 12:21:26 +0000 UTC,},Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:true,RestartCount:0,Image:k8s.gcr.io/e2e-test-images/httpd:2.4.38-2,ImageID:k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3,ContainerID:containerd://321001fa2cf6e004d372bba84ae327dd43a42a826c61ae54eabfec3df2b70260,Started:*true,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{PodIP{IP:172.20.54.161,},},EphemeralContainerStatuses:[]ContainerStatus{},},} [AfterEach] [sig-apps] Deployment /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "deployment-6871". �[1mSTEP�[0m: Found 105 events. Jan 24 12:25:33.985: INFO: At 2023-01-24 12:20:33 +0000 UTC - event for webserver-deployment: {deployment-controller } ScalingReplicaSet: Scaled up replica set webserver-deployment-5d9fdcc779 to 10 Jan 24 12:25:33.985: INFO: At 2023-01-24 12:20:33 +0000 UTC - event for webserver-deployment-5d9fdcc779: {replicaset-controller } SuccessfulCreate: Created pod: webserver-deployment-5d9fdcc779-pdnwl Jan 24 12:25:33.985: INFO: At 2023-01-24 12:20:33 +0000 UTC - event for webserver-deployment-5d9fdcc779: {replicaset-controller } SuccessfulCreate: (combined from similar events): Created pod: webserver-deployment-5d9fdcc779-xtrv9 Jan 24 12:25:33.985: INFO: At 2023-01-24 12:20:33 +0000 UTC - event for webserver-deployment-5d9fdcc779: {replicaset-controller } SuccessfulCreate: Created pod: webserver-deployment-5d9fdcc779-xwhl2 Jan 24 12:25:33.985: INFO: At 2023-01-24 12:20:33 +0000 UTC - event for webserver-deployment-5d9fdcc779: {replicaset-controller } SuccessfulCreate: Created pod: webserver-deployment-5d9fdcc779-f4lt5 Jan 24 12:25:33.985: INFO: At 2023-01-24 12:20:33 +0000 UTC - event for webserver-deployment-5d9fdcc779: {replicaset-controller } SuccessfulCreate: Created pod: webserver-deployment-5d9fdcc779-qmwf2 Jan 24 12:25:33.985: INFO: At 2023-01-24 12:20:33 +0000 UTC - event for webserver-deployment-5d9fdcc779: {replicaset-controller } SuccessfulCreate: Created pod: webserver-deployment-5d9fdcc779-xz6r8 Jan 24 12:25:33.985: INFO: At 2023-01-24 12:20:33 +0000 UTC - event for webserver-deployment-5d9fdcc779: {replicaset-controller } SuccessfulCreate: Created pod: webserver-deployment-5d9fdcc779-kcxmz Jan 24 12:25:33.985: INFO: At 2023-01-24 12:20:33 +0000 UTC - event for webserver-deployment-5d9fdcc779: {replicaset-controller } SuccessfulCreate: Created pod: webserver-deployment-5d9fdcc779-9vj6f Jan 24 12:25:33.985: INFO: At 2023-01-24 12:20:33 +0000 UTC - event for webserver-deployment-5d9fdcc779: {replicaset-controller } SuccessfulCreate: Created pod: webserver-deployment-5d9fdcc779-hqvdm Jan 24 12:25:33.985: INFO: At 2023-01-24 12:20:33 +0000 UTC - event for webserver-deployment-5d9fdcc779: {replicaset-controller } SuccessfulCreate: Created pod: webserver-deployment-5d9fdcc779-fv2mx Jan 24 12:25:33.985: INFO: At 2023-01-24 12:20:33 +0000 UTC - event for webserver-deployment-5d9fdcc779-9vj6f: {default-scheduler } Scheduled: Successfully assigned deployment-6871/webserver-deployment-5d9fdcc779-9vj6f to ip-172-20-62-42.us-west-1.compute.internal Jan 24 12:25:33.985: INFO: At 2023-01-24 12:20:33 +0000 UTC - event for webserver-deployment-5d9fdcc779-f4lt5: {default-scheduler } Scheduled: Successfully assigned deployment-6871/webserver-deployment-5d9fdcc779-f4lt5 to ip-172-20-63-134.us-west-1.compute.internal Jan 24 12:25:33.986: INFO: At 2023-01-24 12:20:33 +0000 UTC - event for webserver-deployment-5d9fdcc779-f4lt5: {kubelet ip-172-20-63-134.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "059ca5496bfe3083bee73f0da01c7219e8f4434c0748d9ba8d967b1cd08a6215": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:20:33 +0000 UTC - event for webserver-deployment-5d9fdcc779-fv2mx: {default-scheduler } Scheduled: Successfully assigned deployment-6871/webserver-deployment-5d9fdcc779-fv2mx to ip-172-20-62-42.us-west-1.compute.internal Jan 24 12:25:33.986: INFO: At 2023-01-24 12:20:33 +0000 UTC - event for webserver-deployment-5d9fdcc779-hqvdm: {default-scheduler } Scheduled: Successfully assigned deployment-6871/webserver-deployment-5d9fdcc779-hqvdm to ip-172-20-63-190.us-west-1.compute.internal Jan 24 12:25:33.986: INFO: At 2023-01-24 12:20:33 +0000 UTC - event for webserver-deployment-5d9fdcc779-kcxmz: {kubelet ip-172-20-63-134.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "89c07adb79e8aec5c3de72ac900099f490d7dc39ebdddefd24ccf05a7ce3ac4c": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:20:33 +0000 UTC - event for webserver-deployment-5d9fdcc779-kcxmz: {default-scheduler } Scheduled: Successfully assigned deployment-6871/webserver-deployment-5d9fdcc779-kcxmz to ip-172-20-63-134.us-west-1.compute.internal Jan 24 12:25:33.986: INFO: At 2023-01-24 12:20:33 +0000 UTC - event for webserver-deployment-5d9fdcc779-pdnwl: {default-scheduler } Scheduled: Successfully assigned deployment-6871/webserver-deployment-5d9fdcc779-pdnwl to ip-172-20-63-190.us-west-1.compute.internal Jan 24 12:25:33.986: INFO: At 2023-01-24 12:20:33 +0000 UTC - event for webserver-deployment-5d9fdcc779-qmwf2: {default-scheduler } Scheduled: Successfully assigned deployment-6871/webserver-deployment-5d9fdcc779-qmwf2 to ip-172-20-58-8.us-west-1.compute.internal Jan 24 12:25:33.986: INFO: At 2023-01-24 12:20:33 +0000 UTC - event for webserver-deployment-5d9fdcc779-qmwf2: {kubelet ip-172-20-58-8.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "c7ddaeef482172ce412bc834e160cef1b0b799e813aa0c8949f52dd9d4485a80": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:20:33 +0000 UTC - event for webserver-deployment-5d9fdcc779-xtrv9: {default-scheduler } Scheduled: Successfully assigned deployment-6871/webserver-deployment-5d9fdcc779-xtrv9 to ip-172-20-63-190.us-west-1.compute.internal Jan 24 12:25:33.986: INFO: At 2023-01-24 12:20:33 +0000 UTC - event for webserver-deployment-5d9fdcc779-xwhl2: {kubelet ip-172-20-63-134.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "14ba4b65145844838185a79e3b2fbdf61ed5f79ce88abe01beb2220a650942c3": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:20:33 +0000 UTC - event for webserver-deployment-5d9fdcc779-xwhl2: {default-scheduler } Scheduled: Successfully assigned deployment-6871/webserver-deployment-5d9fdcc779-xwhl2 to ip-172-20-63-134.us-west-1.compute.internal Jan 24 12:25:33.986: INFO: At 2023-01-24 12:20:33 +0000 UTC - event for webserver-deployment-5d9fdcc779-xz6r8: {default-scheduler } Scheduled: Successfully assigned deployment-6871/webserver-deployment-5d9fdcc779-xz6r8 to ip-172-20-58-8.us-west-1.compute.internal Jan 24 12:25:33.986: INFO: At 2023-01-24 12:20:33 +0000 UTC - event for webserver-deployment-5d9fdcc779-xz6r8: {kubelet ip-172-20-58-8.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "9dd1a7e28939762b25afadfc2cf34a146493168b4672035f8aeb8b1a93a31d33": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:20:34 +0000 UTC - event for webserver-deployment-5d9fdcc779-9vj6f: {kubelet ip-172-20-62-42.us-west-1.compute.internal} FailedMount: MountVolume.SetUp failed for volume "kube-api-access-826cz" : failed to sync configmap cache: timed out waiting for the condition Jan 24 12:25:33.986: INFO: At 2023-01-24 12:20:34 +0000 UTC - event for webserver-deployment-5d9fdcc779-fv2mx: {kubelet ip-172-20-62-42.us-west-1.compute.internal} FailedMount: MountVolume.SetUp failed for volume "kube-api-access-jx42s" : failed to sync configmap cache: timed out waiting for the condition Jan 24 12:25:33.986: INFO: At 2023-01-24 12:20:34 +0000 UTC - event for webserver-deployment-5d9fdcc779-hqvdm: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "3f89285ccfc6ec1a0496b7a319c958fe37fd083cbce4685b4e8f0fd04c7e4bc8": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:20:34 +0000 UTC - event for webserver-deployment-5d9fdcc779-pdnwl: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e06683b457d80b9f90ac7c5aee0f43b1b8d64edc92fe368d6fdaeb5acb83d4f4": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:20:34 +0000 UTC - event for webserver-deployment-5d9fdcc779-xtrv9: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "bc5a51582dec4a5c95be09d998216a497722b93a18b7af6bf0a8277f1209a195": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:20:35 +0000 UTC - event for webserver-deployment-5d9fdcc779-9vj6f: {kubelet ip-172-20-62-42.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "c39ab4b0c7c496ed6d53644b8eaa852594009cbcea98d8633e9227cba7828f11": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:20:35 +0000 UTC - event for webserver-deployment-5d9fdcc779-fv2mx: {kubelet ip-172-20-62-42.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ff40ca99559ee89aa170e9dae1e7db56bb3c16165a275df7289b68c37726a73d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:20:44 +0000 UTC - event for webserver-deployment-5d9fdcc779-f4lt5: {kubelet ip-172-20-63-134.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "c3b8ddf095fac917bc7480ad1b67cd1b59d4b4954dfaf0bff7a7427885a1da2d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:20:44 +0000 UTC - event for webserver-deployment-5d9fdcc779-xz6r8: {kubelet ip-172-20-58-8.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d6aa0c9feda07915ebe83ce866dcb9088dbcac2e68777d7063612cd28d66d9c2": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:20:45 +0000 UTC - event for webserver-deployment-5d9fdcc779-qmwf2: {kubelet ip-172-20-58-8.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "9bad07a522e03e37ea01573cd985817f5d6af0855df3b612924a228c4a658ed1": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:20:46 +0000 UTC - event for webserver-deployment-5d9fdcc779-kcxmz: {kubelet ip-172-20-63-134.us-west-1.compute.internal} Created: Created container httpd Jan 24 12:25:33.986: INFO: At 2023-01-24 12:20:46 +0000 UTC - event for webserver-deployment-5d9fdcc779-kcxmz: {kubelet ip-172-20-63-134.us-west-1.compute.internal} Pulled: Container image "k8s.gcr.io/e2e-test-images/httpd:2.4.38-2" already present on machine Jan 24 12:25:33.986: INFO: At 2023-01-24 12:20:46 +0000 UTC - event for webserver-deployment-5d9fdcc779-kcxmz: {kubelet ip-172-20-63-134.us-west-1.compute.internal} Started: Started container httpd Jan 24 12:25:33.986: INFO: At 2023-01-24 12:20:46 +0000 UTC - event for webserver-deployment-5d9fdcc779-xtrv9: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b7df2a47bdfd07d1feb22e313b3f3653bfd7951bf0d764c8fcc9172a46827aef": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:20:47 +0000 UTC - event for webserver-deployment-5d9fdcc779-hqvdm: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "602d2ba479819703627663f87529358b02585f8e3bfa0a75bfaa89cecda48f38": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:20:48 +0000 UTC - event for webserver-deployment-5d9fdcc779-fv2mx: {kubelet ip-172-20-62-42.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "928858e31f2524cec527a811cfe5d5eec6079a798741ae50db71b4c4a3983af9": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:20:48 +0000 UTC - event for webserver-deployment-5d9fdcc779-pdnwl: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a6d9af05a0fdc20296f161c9c4a5c2747dd53362d396b6fa5a4ba72d7a8210f6": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:20:48 +0000 UTC - event for webserver-deployment-5d9fdcc779-xwhl2: {kubelet ip-172-20-63-134.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ea48593d00a3933bf85779a158ab0ba8020347463ea89f536b14c25c1d840475": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:20:50 +0000 UTC - event for webserver-deployment-5d9fdcc779-9vj6f: {kubelet ip-172-20-62-42.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ad39120b2317345e203dd39eeaff31a03f08c7cde34ecf3f2d1287645d3fef0f": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:20:58 +0000 UTC - event for webserver-deployment-5d9fdcc779-f4lt5: {kubelet ip-172-20-63-134.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "9405c58a4486d6ff166fa89b7e5f89956cc86f943f78138afccb2d18273f168a": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:20:58 +0000 UTC - event for webserver-deployment-5d9fdcc779-xtrv9: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b6121b7476bc7e2098eed7f9c2dd66aba2e65a9ca201282f9cf730590ac5f604": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:20:59 +0000 UTC - event for webserver-deployment-5d9fdcc779-xz6r8: {kubelet ip-172-20-58-8.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "dffdb10be0a902cea01a042e1a45f80cc7684b6a8b281f71f6326f001aca4a71": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:21:00 +0000 UTC - event for webserver-deployment-5d9fdcc779-qmwf2: {kubelet ip-172-20-58-8.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ad94dd4e1539bf8b63273b1686bde7d43190a2a1cb318662ebc389264fa8a411": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:21:01 +0000 UTC - event for webserver-deployment-5d9fdcc779-9vj6f: {kubelet ip-172-20-62-42.us-west-1.compute.internal} Started: Started container httpd Jan 24 12:25:33.986: INFO: At 2023-01-24 12:21:01 +0000 UTC - event for webserver-deployment-5d9fdcc779-9vj6f: {kubelet ip-172-20-62-42.us-west-1.compute.internal} Pulled: Container image "k8s.gcr.io/e2e-test-images/httpd:2.4.38-2" already present on machine Jan 24 12:25:33.986: INFO: At 2023-01-24 12:21:01 +0000 UTC - event for webserver-deployment-5d9fdcc779-9vj6f: {kubelet ip-172-20-62-42.us-west-1.compute.internal} Created: Created container httpd Jan 24 12:25:33.986: INFO: At 2023-01-24 12:21:01 +0000 UTC - event for webserver-deployment-5d9fdcc779-hqvdm: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "4d56dae3a1754760af8d812109931aebf3e3f61b4b1b81ae456876762227f007": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:21:01 +0000 UTC - event for webserver-deployment-5d9fdcc779-pdnwl: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "7ff1b949f78162c9d3f45866602f1f79c1b849524914f96c03e286010eada7f1": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:21:01 +0000 UTC - event for webserver-deployment-5d9fdcc779-xwhl2: {kubelet ip-172-20-63-134.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ed62a13a93b5c65988ccaa85e39ecbcc46868e3b25ee3ef6da012aa1d2b19275": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:21:03 +0000 UTC - event for webserver-deployment-5d9fdcc779-fv2mx: {kubelet ip-172-20-62-42.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "6c92ab560fedecca4703a1d8ac1f713a26732f5f1d5fad63af087d35520bab61": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:21:11 +0000 UTC - event for webserver-deployment-5d9fdcc779-xz6r8: {kubelet ip-172-20-58-8.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "96f84f4c0cdd3bb423723aeee4229992d3f1d22b793b84a2f370bcb8f1ef3789": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:21:12 +0000 UTC - event for webserver-deployment-5d9fdcc779-f4lt5: {kubelet ip-172-20-63-134.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a7213be21b077dd53f3df418b5b29ebaedef5b5d865e38b50418e5703bdd7ec6": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:21:12 +0000 UTC - event for webserver-deployment-5d9fdcc779-xtrv9: {kubelet ip-172-20-63-190.us-west-1.compute.internal} Started: Started container httpd Jan 24 12:25:33.986: INFO: At 2023-01-24 12:21:12 +0000 UTC - event for webserver-deployment-5d9fdcc779-xtrv9: {kubelet ip-172-20-63-190.us-west-1.compute.internal} Created: Created container httpd Jan 24 12:25:33.986: INFO: At 2023-01-24 12:21:12 +0000 UTC - event for webserver-deployment-5d9fdcc779-xtrv9: {kubelet ip-172-20-63-190.us-west-1.compute.internal} Pulled: Container image "k8s.gcr.io/e2e-test-images/httpd:2.4.38-2" already present on machine Jan 24 12:25:33.986: INFO: At 2023-01-24 12:21:14 +0000 UTC - event for webserver-deployment-5d9fdcc779-qmwf2: {kubelet ip-172-20-58-8.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d0571a993ff97310d2ed3c060e9890c982eb8e21ce1f4315c068e987a424b2e3": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:21:15 +0000 UTC - event for webserver-deployment-5d9fdcc779-hqvdm: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "7658b571f98a31f5175abab2730afb2eddee400905e8c7897aff4aa22ceb29a0": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:21:16 +0000 UTC - event for webserver-deployment-5d9fdcc779-pdnwl: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "6f3b1a824ae18a02b5de489b896f65d07f9cac82bf91a3ca9d995dfb7ef25462": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:21:16 +0000 UTC - event for webserver-deployment-5d9fdcc779-xwhl2: {kubelet ip-172-20-63-134.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "fc9fefe3ee4d661ace5bb9105c4c77bd30a840b3181a7b4c09890ede6a42efad": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:21:17 +0000 UTC - event for webserver-deployment-5d9fdcc779-fv2mx: {kubelet ip-172-20-62-42.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "7248153ee07fd4c74a1efa9a1da584f877df049daf217b0a707349634be908fa": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:21:26 +0000 UTC - event for webserver-deployment-5d9fdcc779-hqvdm: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "17ac6acc7c19ab03d287774ee0359a29b6c67e1ab9ea07a6c1d200fb430102dc": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:21:26 +0000 UTC - event for webserver-deployment-5d9fdcc779-xz6r8: {kubelet ip-172-20-58-8.us-west-1.compute.internal} Started: Started container httpd Jan 24 12:25:33.986: INFO: At 2023-01-24 12:21:26 +0000 UTC - event for webserver-deployment-5d9fdcc779-xz6r8: {kubelet ip-172-20-58-8.us-west-1.compute.internal} Created: Created container httpd Jan 24 12:25:33.986: INFO: At 2023-01-24 12:21:26 +0000 UTC - event for webserver-deployment-5d9fdcc779-xz6r8: {kubelet ip-172-20-58-8.us-west-1.compute.internal} Pulled: Container image "k8s.gcr.io/e2e-test-images/httpd:2.4.38-2" already present on machine Jan 24 12:25:33.986: INFO: At 2023-01-24 12:21:27 +0000 UTC - event for webserver-deployment-5d9fdcc779-f4lt5: {kubelet ip-172-20-63-134.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a80c38baaf3f75b3ee88f675ac05e7dd52c67dbaeee0ca0bb844830786928a48": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:21:28 +0000 UTC - event for webserver-deployment-5d9fdcc779-qmwf2: {kubelet ip-172-20-58-8.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ec4b262acd2f9b1ce00cfc495c3ff6ac6aba2b3d6f07b2585f429fb3d975ab71": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:21:29 +0000 UTC - event for webserver-deployment-5d9fdcc779-fv2mx: {kubelet ip-172-20-62-42.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "2e5cb05c7e8ddbd51915d0d8cf4d9595e8558738bd5e501f443ab7abf73163e9": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:21:31 +0000 UTC - event for webserver-deployment-5d9fdcc779-pdnwl: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "797f5265d47c0ee9d0e36760fe4efadb5dd16216fb53234420692fbf81397c21": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:21:31 +0000 UTC - event for webserver-deployment-5d9fdcc779-xwhl2: {kubelet ip-172-20-63-134.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "6c4428ac7e58f6b05f63cbeeb63b1d26895287f257b310644a458cebd95a9aaf": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:21:39 +0000 UTC - event for webserver-deployment-5d9fdcc779-hqvdm: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "905fbd2335714e6c9ef009efc0a2aecf4915e98171235dba1075d7e502928f84": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:21:41 +0000 UTC - event for webserver-deployment-5d9fdcc779-f4lt5: {kubelet ip-172-20-63-134.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d8c0691c6f0859cd42047a436b91d91b7685cbefd9b402b27e5f226979c74dd8": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:21:41 +0000 UTC - event for webserver-deployment-5d9fdcc779-qmwf2: {kubelet ip-172-20-58-8.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "7d334e60c9ea8af535ba95dab396aa9ed731403c241bfe3bf0144c7a2ee77a5f": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:21:42 +0000 UTC - event for webserver-deployment-5d9fdcc779-xwhl2: {kubelet ip-172-20-63-134.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "949ecbb37502b2f7867750aaf08e426a0ece613da7396a87e145d5923372fd53": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:21:44 +0000 UTC - event for webserver-deployment-5d9fdcc779-fv2mx: {kubelet ip-172-20-62-42.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "beb5cb606a1f4d436df93c89f2a96e871a50fb888a0f47d05e712cd8c9369390": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:21:46 +0000 UTC - event for webserver-deployment-5d9fdcc779-pdnwl: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e56e18504019759b55f1d680f5928f117064df4d98be1c239eca5fcef9eb0766": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:21:52 +0000 UTC - event for webserver-deployment-5d9fdcc779-qmwf2: {kubelet ip-172-20-58-8.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "55b2e7f8fb46c6a88eb222bfbd6ca32874a33a5a036d3f70f709028a68367416": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:21:54 +0000 UTC - event for webserver-deployment-5d9fdcc779-f4lt5: {kubelet ip-172-20-63-134.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "447b52c683b224562256c18e2b5590f660453c895176a85c73b3624d60f65157": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:21:54 +0000 UTC - event for webserver-deployment-5d9fdcc779-hqvdm: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "af6ededaf5b030404c754db94530b1b6af0fffbf84fc16242107595bc1b1f36b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:21:56 +0000 UTC - event for webserver-deployment-5d9fdcc779-xwhl2: {kubelet ip-172-20-63-134.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "bd6b58376aafd8810c1119b4bbe31895c9fdfff704577469665cd0e4ed2acc7e": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:21:57 +0000 UTC - event for webserver-deployment-5d9fdcc779-fv2mx: {kubelet ip-172-20-62-42.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "6855208e4f3a0b97ac6a646ce2aec912f1b37b5631a437c3e054c68f761cdb2b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:21:58 +0000 UTC - event for webserver-deployment-5d9fdcc779-pdnwl: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "42fefe0cccc9174098f20e162bbf813002f6aeacd77ad9f675856e949a497f77": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:22:07 +0000 UTC - event for webserver-deployment-5d9fdcc779-f4lt5: {kubelet ip-172-20-63-134.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b446478577cbd8add6b52444cbcef6975f56dc9b09de9228d9b5f261869f88a0": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:22:07 +0000 UTC - event for webserver-deployment-5d9fdcc779-qmwf2: {kubelet ip-172-20-58-8.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "fdea1cc3d8cdd5843290e82c4b0cda757b239b50d0998d540ec1ce4000d4bee5": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:22:09 +0000 UTC - event for webserver-deployment-5d9fdcc779-hqvdm: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ba5fa18c35c8a39caf2566ac1329c1d5e2b2e17a2dd80dbcb23a4ffddb885bfd": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:22:10 +0000 UTC - event for webserver-deployment-5d9fdcc779-xwhl2: {kubelet ip-172-20-63-134.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "3bbaf086dbca56ff800b11291536ee3243430bf86badde4ce382fea6b802ae60": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:22:11 +0000 UTC - event for webserver-deployment-5d9fdcc779-fv2mx: {kubelet ip-172-20-62-42.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "0b70c56016b38ef50ce2cb1e97da94177c58a01bb677cf5a2d58ffb6696da92b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:22:13 +0000 UTC - event for webserver-deployment-5d9fdcc779-pdnwl: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "0a50bcfc64d6675d14e6d9b65456cdb37596d3a96e9dd7d3361fc3860d7cd9fd": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:22:19 +0000 UTC - event for webserver-deployment-5d9fdcc779-qmwf2: {kubelet ip-172-20-58-8.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "35598e94a94aff03d76f681a5d579cd89d59474f231609609e66661dd3ebf7c9": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:22:21 +0000 UTC - event for webserver-deployment-5d9fdcc779-hqvdm: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "11de5b747c95d1473c9b76cb1d21837b6740e2191ae69cad67d85cb7e814728b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:22:22 +0000 UTC - event for webserver-deployment-5d9fdcc779-f4lt5: {kubelet ip-172-20-63-134.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "0330f4cada3d0c33ef7123b92769e99609611b9d32665716a7881df424ac1c7c": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:22:23 +0000 UTC - event for webserver-deployment-5d9fdcc779-fv2mx: {kubelet ip-172-20-62-42.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "4f13f7fe039c2dcc6d957dedade4c002b357819b7a6751d030f1dc8f65660715": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:22:23 +0000 UTC - event for webserver-deployment-5d9fdcc779-xwhl2: {kubelet ip-172-20-63-134.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b218c5aa60b8fef2d24301752d285b5195167d6e2388df4b3c7963190f4fe14e": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:22:26 +0000 UTC - event for webserver-deployment-5d9fdcc779-pdnwl: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "cf69930feab0b22219e853dafe9275639a529eee1db38b14f190dd726d350c4b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:22:33 +0000 UTC - event for webserver-deployment-5d9fdcc779-f4lt5: {kubelet ip-172-20-63-134.us-west-1.compute.internal} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b052c9bfcaa7911bc4a1db12ec99502848ed699316cc226d0b93bdfa51bd2c88": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:22:34 +0000 UTC - event for webserver-deployment-5d9fdcc779-qmwf2: {kubelet ip-172-20-58-8.us-west-1.compute.internal} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "cc9661b22e255b252998bd1cab6db083cd9e7780d7a1b1e6ea1fa72a66f2411e": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:22:35 +0000 UTC - event for webserver-deployment-5d9fdcc779-hqvdm: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d465afabfd885d884df56d98012589305fdf2d64715df22932ff4373fddb7841": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:22:36 +0000 UTC - event for webserver-deployment-5d9fdcc779-xwhl2: {kubelet ip-172-20-63-134.us-west-1.compute.internal} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "4375ff7c5e1adc1ecffe88b2e65a9ad988336a1c308001af08afaac4bf21ca57": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:22:37 +0000 UTC - event for webserver-deployment-5d9fdcc779-fv2mx: {kubelet ip-172-20-62-42.us-west-1.compute.internal} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b4d6620022855b8da4022e3ed03929c33ce2f35d061c55fc7851cdfe11d76f35": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:33.986: INFO: At 2023-01-24 12:22:41 +0000 UTC - event for webserver-deployment-5d9fdcc779-pdnwl: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a2ac55901ffa59f56ef4499ab638a666b989cd7dd814f80601703c136d1433d3": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:25:34.046: INFO: POD NODE PHASE GRACE CONDITIONS Jan 24 12:25:34.046: INFO: webserver-deployment-5d9fdcc779-9vj6f ip-172-20-62-42.us-west-1.compute.internal Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:20:33 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:21:02 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:21:02 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:20:33 +0000 UTC }] Jan 24 12:25:34.046: INFO: webserver-deployment-5d9fdcc779-f4lt5 ip-172-20-63-134.us-west-1.compute.internal Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:20:33 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:20:33 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:20:33 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:20:33 +0000 UTC }] Jan 24 12:25:34.046: INFO: webserver-deployment-5d9fdcc779-fv2mx ip-172-20-62-42.us-west-1.compute.internal Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:20:33 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:20:33 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:20:33 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:20:33 +0000 UTC }] Jan 24 12:25:34.046: INFO: webserver-deployment-5d9fdcc779-hqvdm ip-172-20-63-190.us-west-1.compute.internal Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:20:33 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:20:33 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:20:33 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:20:33 +0000 UTC }] Jan 24 12:25:34.046: INFO: webserver-deployment-5d9fdcc779-kcxmz ip-172-20-63-134.us-west-1.compute.internal Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:20:33 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:20:47 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:20:47 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:20:33 +0000 UTC }] Jan 24 12:25:34.046: INFO: webserver-deployment-5d9fdcc779-pdnwl ip-172-20-63-190.us-west-1.compute.internal Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:20:33 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:20:33 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:20:33 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:20:33 +0000 UTC }] Jan 24 12:25:34.046: INFO: webserver-deployment-5d9fdcc779-qmwf2 ip-172-20-58-8.us-west-1.compute.internal Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:20:33 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:20:33 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:20:33 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:20:33 +0000 UTC }] Jan 24 12:25:34.046: INFO: webserver-deployment-5d9fdcc779-xtrv9 ip-172-20-63-190.us-west-1.compute.internal Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:20:33 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:21:13 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:21:13 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:20:33 +0000 UTC }] Jan 24 12:25:34.046: INFO: webserver-deployment-5d9fdcc779-xwhl2 ip-172-20-63-134.us-west-1.compute.internal Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:20:33 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:20:33 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:20:33 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:20:33 +0000 UTC }] Jan 24 12:25:34.046: INFO: webserver-deployment-5d9fdcc779-xz6r8 ip-172-20-58-8.us-west-1.compute.internal Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:20:33 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:21:26 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:21:26 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:20:33 +0000 UTC }] Jan 24 12:25:34.046: INFO: Jan 24 12:25:34.167: INFO: Unable to fetch deployment-6871/webserver-deployment-5d9fdcc779-f4lt5/httpd logs: the server rejected our request for an unknown reason (get pods webserver-deployment-5d9fdcc779-f4lt5) Jan 24 12:25:34.227: INFO: Unable to fetch deployment-6871/webserver-deployment-5d9fdcc779-fv2mx/httpd logs: the server rejected our request for an unknown reason (get pods webserver-deployment-5d9fdcc779-fv2mx) Jan 24 12:25:34.287: INFO: Unable to fetch deployment-6871/webserver-deployment-5d9fdcc779-hqvdm/httpd logs: the server rejected our request for an unknown reason (get pods webserver-deployment-5d9fdcc779-hqvdm) Jan 24 12:25:34.408: INFO: Logging node info for node ip-172-20-42-201.us-west-1.compute.internal Jan 24 12:25:34.469: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-42-201.us-west-1.compute.internal cc6006a6-61fd-4f4c-b296-ba72367bb0f8 25014 0 2023-01-24 12:07:14 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-1 failure-domain.beta.kubernetes.io/zone:us-west-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-42-201.us-west-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/control-plane: node-role.kubernetes.io/master: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:us-west-1a topology.kubernetes.io/region:us-west-1 topology.kubernetes.io/zone:us-west-1a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-08c27beef2082266b"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-24 12:07:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {protokube Update v1 2023-01-24 12:07:41 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kops-controller Update v1 2023-01-24 12:07:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/master":{}}}} } {kube-controller-manager Update v1 2023-01-24 12:07:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-24 12:09:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-1a/i-08c27beef2082266b,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892264960 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787407360 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-24 12:25:07 +0000 UTC,LastTransitionTime:2023-01-24 12:07:14 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-24 12:25:07 +0000 UTC,LastTransitionTime:2023-01-24 12:07:14 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-24 12:25:07 +0000 UTC,LastTransitionTime:2023-01-24 12:07:14 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-24 12:25:07 +0000 UTC,LastTransitionTime:2023-01-24 12:07:55 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.201,},NodeAddress{Type:ExternalIP,Address:54.215.124.25,},NodeAddress{Type:Hostname,Address:ip-172-20-42-201.us-west-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-42-201.us-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-215-124-25.us-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2be20fd28580af17ed5c32106be540,SystemUUID:ec2be20f-d285-80af-17ed-5c32106be540,BootID:cb576848-3e1b-4407-b81d-d34a637f2afd,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.23.16,KubeProxyVersion:v1.23.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.23.16 registry.k8s.io/kube-apiserver-amd64:v1.23.16],SizeBytes:131340755,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.23.16 registry.k8s.io/kube-controller-manager-amd64:v1.23.16],SizeBytes:121280825,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.16 registry.k8s.io/kube-proxy-amd64:v1.23.16],SizeBytes:112743991,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.23.16 registry.k8s.io/kube-scheduler-amd64:v1.23.16],SizeBytes:53193016,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-beta.2],SizeBytes:43191763,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-beta.2],SizeBytes:42821714,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-beta.2],SizeBytes:4965793,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 24 12:25:34.469: INFO: Logging kubelet events for node ip-172-20-42-201.us-west-1.compute.internal Jan 24 12:25:34.530: INFO: Logging pods the kubelet thinks is on node ip-172-20-42-201.us-west-1.compute.internal Jan 24 12:25:34.600: INFO: kube-scheduler-ip-172-20-42-201.us-west-1.compute.internal started at 2023-01-24 12:06:45 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:34.600: INFO: Container kube-scheduler ready: true, restart count 0 Jan 24 12:25:34.600: INFO: cilium-5dpkw started at 2023-01-24 12:07:38 +0000 UTC (1+1 container statuses recorded) Jan 24 12:25:34.600: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 24 12:25:34.600: INFO: Container cilium-agent ready: true, restart count 1 Jan 24 12:25:34.600: INFO: cilium-operator-d84d55876-rfmxk started at 2023-01-24 12:07:41 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:34.600: INFO: Container cilium-operator ready: true, restart count 1 Jan 24 12:25:34.600: INFO: dns-controller-58d7bbb845-c475n started at 2023-01-24 12:07:41 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:34.600: INFO: Container dns-controller ready: true, restart count 0 Jan 24 12:25:34.600: INFO: kube-controller-manager-ip-172-20-42-201.us-west-1.compute.internal started at 2023-01-24 12:06:45 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:34.600: INFO: Container kube-controller-manager ready: true, restart count 2 Jan 24 12:25:34.600: INFO: etcd-manager-main-ip-172-20-42-201.us-west-1.compute.internal started at 2023-01-24 12:06:45 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:34.600: INFO: Container etcd-manager ready: true, restart count 0 Jan 24 12:25:34.600: INFO: kube-apiserver-ip-172-20-42-201.us-west-1.compute.internal started at 2023-01-24 12:06:45 +0000 UTC (0+2 container statuses recorded) Jan 24 12:25:34.600: INFO: Container healthcheck ready: true, restart count 0 Jan 24 12:25:34.600: INFO: Container kube-apiserver ready: true, restart count 1 Jan 24 12:25:34.600: INFO: ebs-csi-node-4lwrc started at 2023-01-24 12:07:40 +0000 UTC (0+3 container statuses recorded) Jan 24 12:25:34.600: INFO: Container ebs-plugin ready: true, restart count 0 Jan 24 12:25:34.600: INFO: Container liveness-probe ready: true, restart count 0 Jan 24 12:25:34.600: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 24 12:25:34.600: INFO: kops-controller-8k2c2 started at 2023-01-24 12:07:41 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:34.600: INFO: Container kops-controller ready: true, restart count 0 Jan 24 12:25:34.600: INFO: ebs-csi-controller-7bd4fbc786-nm7v4 started at 2023-01-24 12:07:42 +0000 UTC (0+5 container statuses recorded) Jan 24 12:25:34.600: INFO: Container csi-attacher ready: true, restart count 0 Jan 24 12:25:34.600: INFO: Container csi-provisioner ready: true, restart count 0 Jan 24 12:25:34.600: INFO: Container csi-resizer ready: true, restart count 0 Jan 24 12:25:34.600: INFO: Container ebs-plugin ready: true, restart count 0 Jan 24 12:25:34.600: INFO: Container liveness-probe ready: true, restart count 0 Jan 24 12:25:34.600: INFO: etcd-manager-events-ip-172-20-42-201.us-west-1.compute.internal started at 2023-01-24 12:06:45 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:34.600: INFO: Container etcd-manager ready: true, restart count 0 Jan 24 12:25:34.847: INFO: Latency metrics for node ip-172-20-42-201.us-west-1.compute.internal Jan 24 12:25:34.847: INFO: Logging node info for node ip-172-20-58-8.us-west-1.compute.internal Jan 24 12:25:34.906: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-58-8.us-west-1.compute.internal 4a97117d-69ce-4a16-9e93-9e41b32a9a62 24073 0 2023-01-24 12:09:13 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-1 failure-domain.beta.kubernetes.io/zone:us-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-58-8.us-west-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-1a topology.hostpath.csi/node:ip-172-20-58-8.us-west-1.compute.internal topology.kubernetes.io/region:us-west-1 topology.kubernetes.io/zone:us-west-1a] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-5577":"csi-mock-csi-mock-volumes-5577","ebs.csi.aws.com":"i-0cf7a751b954f0403"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2023-01-24 12:09:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-24 12:09:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-24 12:09:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-01-24 12:17:56 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-24 12:18:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {e2e.test Update v1 2023-01-24 12:19:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-1a/i-0cf7a751b954f0403,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051644416 0} {<nil>} 3956684Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946786816 0} {<nil>} 3854284Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-24 12:21:05 +0000 UTC,LastTransitionTime:2023-01-24 12:09:13 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-24 12:21:05 +0000 UTC,LastTransitionTime:2023-01-24 12:09:13 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-24 12:21:05 +0000 UTC,LastTransitionTime:2023-01-24 12:09:13 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-24 12:21:05 +0000 UTC,LastTransitionTime:2023-01-24 12:09:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.58.8,},NodeAddress{Type:ExternalIP,Address:52.53.154.168,},NodeAddress{Type:Hostname,Address:ip-172-20-58-8.us-west-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-58-8.us-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-52-53-154-168.us-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec21f66ef1338663d7ef9e17ce7835a7,SystemUUID:ec21f66e-f133-8663-d7ef-9e17ce7835a7,BootID:e76a2ed0-0929-4d54-b334-e1f0ad9eacd2,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.23.16,KubeProxyVersion:v1.23.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.16 registry.k8s.io/kube-proxy-amd64:v1.23.16],SizeBytes:112743991,},ContainerImage{Names:[docker.io/library/nginx@sha256:b8f2383a95879e1ae064940d9a200f67a6c79e710ed82ac42263397367e7cc4e docker.io/library/nginx:latest],SizeBytes:56882371,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a k8s.gcr.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 k8s.gcr.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-00a8f7338bd3c4426],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-00a8f7338bd3c4426,DevicePath:,},},Config:nil,},} Jan 24 12:25:34.906: INFO: Logging kubelet events for node ip-172-20-58-8.us-west-1.compute.internal Jan 24 12:25:34.968: INFO: Logging pods the kubelet thinks is on node ip-172-20-58-8.us-west-1.compute.internal Jan 24 12:25:35.036: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-5q458 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:35.036: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:35.036: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-fhs4l started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:35.036: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:35.036: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-26vrc started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:35.036: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:35.036: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-c7hrk started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:35.036: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:35.036: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-58gdd started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:35.036: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: false, restart count 0 Jan 24 12:25:35.036: INFO: cilium-nchqx started at 2023-01-24 12:09:14 +0000 UTC (1+1 container statuses recorded) Jan 24 12:25:35.037: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 24 12:25:35.037: INFO: Container cilium-agent ready: true, restart count 0 Jan 24 12:25:35.037: INFO: netserver-0 started at 2023-01-24 12:25:31 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:35.037: INFO: Container webserver ready: false, restart count 0 Jan 24 12:25:35.037: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-qdqt9 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:35.037: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:35.037: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-vj22z started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:35.037: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:35.037: INFO: coredns-867df8f45c-8jvsj started at 2023-01-24 12:09:41 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:35.037: INFO: Container coredns ready: true, restart count 0 Jan 24 12:25:35.037: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-5znh6 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:35.037: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:35.037: INFO: webserver-deployment-5d9fdcc779-xz6r8 started at 2023-01-24 12:20:33 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:35.037: INFO: Container httpd ready: true, restart count 0 Jan 24 12:25:35.037: INFO: csi-mockplugin-0 started at 2023-01-24 12:20:09 +0000 UTC (0+3 container statuses recorded) Jan 24 12:25:35.037: INFO: Container csi-provisioner ready: true, restart count 0 Jan 24 12:25:35.037: INFO: Container driver-registrar ready: true, restart count 0 Jan 24 12:25:35.037: INFO: Container mock ready: true, restart count 0 Jan 24 12:25:35.037: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-qbrts started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:35.037: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: false, restart count 0 Jan 24 12:25:35.037: INFO: hostexec-ip-172-20-58-8.us-west-1.compute.internal-c2xpk started at 2023-01-24 12:25:03 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:35.037: INFO: Container agnhost-container ready: true, restart count 0 Jan 24 12:25:35.037: INFO: hostpathsymlink-injector started at 2023-01-24 12:21:09 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:35.037: INFO: Container hostpathsymlink-injector ready: false, restart count 0 Jan 24 12:25:35.037: INFO: hostexec-ip-172-20-58-8.us-west-1.compute.internal-zp8t6 started at 2023-01-24 12:21:11 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:35.037: INFO: Container agnhost-container ready: true, restart count 0 Jan 24 12:25:35.037: INFO: pod-subpath-test-preprovisionedpv-mmwc started at 2023-01-24 12:21:25 +0000 UTC (2+2 container statuses recorded) Jan 24 12:25:35.037: INFO: Init container init-volume-preprovisionedpv-mmwc ready: false, restart count 0 Jan 24 12:25:35.037: INFO: Init container test-init-subpath-preprovisionedpv-mmwc ready: false, restart count 0 Jan 24 12:25:35.037: INFO: Container test-container-subpath-preprovisionedpv-mmwc ready: false, restart count 0 Jan 24 12:25:35.037: INFO: Container test-container-volume-preprovisionedpv-mmwc ready: false, restart count 0 Jan 24 12:25:35.037: INFO: webserver-deployment-5d9fdcc779-qmwf2 started at 2023-01-24 12:20:33 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:35.037: INFO: Container httpd ready: false, restart count 0 Jan 24 12:25:35.037: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-qccgl started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:35.037: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:35.037: INFO: netserver-0 started at 2023-01-24 12:24:45 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:35.037: INFO: Container webserver ready: false, restart count 0 Jan 24 12:25:35.037: INFO: hostpath-symlink-prep-provisioning-3666 started at 2023-01-24 12:21:28 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:35.037: INFO: Container init-volume-provisioning-3666 ready: false, restart count 0 Jan 24 12:25:35.037: INFO: ss-1 started at 2023-01-24 12:19:34 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:35.037: INFO: Container webserver ready: true, restart count 0 Jan 24 12:25:35.037: INFO: pvc-volume-tester-gnxjv started at 2023-01-24 12:21:49 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:35.037: INFO: Container volume-tester ready: false, restart count 0 Jan 24 12:25:35.037: INFO: ss2-2 started at 2023-01-24 12:19:40 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:35.037: INFO: Container webserver ready: false, restart count 0 Jan 24 12:25:35.037: INFO: pod-c333283a-a7fd-4c9e-9b2c-ec103bf12056 started at 2023-01-24 12:25:06 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:35.037: INFO: Container write-pod ready: false, restart count 0 Jan 24 12:25:35.037: INFO: ebs-csi-node-4bbqn started at 2023-01-24 12:09:14 +0000 UTC (0+3 container statuses recorded) Jan 24 12:25:35.037: INFO: Container ebs-plugin ready: true, restart count 0 Jan 24 12:25:35.037: INFO: Container liveness-probe ready: true, restart count 0 Jan 24 12:25:35.037: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 24 12:25:35.365: INFO: Latency metrics for node ip-172-20-58-8.us-west-1.compute.internal Jan 24 12:25:35.365: INFO: Logging node info for node ip-172-20-62-42.us-west-1.compute.internal Jan 24 12:25:35.424: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-62-42.us-west-1.compute.internal 2f9a48a1-cd3d-4169-9d63-d46bd4e4c90b 25209 0 2023-01-24 12:09:10 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-1 failure-domain.beta.kubernetes.io/zone:us-west-1a io.kubernetes.storage.mock/node:some-mock-node kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-62-42.us-west-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-1a topology.hostpath.csi/node:ip-172-20-62-42.us-west-1.compute.internal topology.kubernetes.io/region:us-west-1 topology.kubernetes.io/zone:us-west-1a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0d97debf14f45ab50"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-24 12:09:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-24 12:09:11 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-24 12:09:11 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kube-controller-manager Update v1 2023-01-24 12:17:35 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-24 12:17:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {e2e.test Update v1 2023-01-24 12:19:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-1a/i-0d97debf14f45ab50,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051644416 0} {<nil>} 3956684Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946786816 0} {<nil>} 3854284Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-24 12:25:32 +0000 UTC,LastTransitionTime:2023-01-24 12:09:10 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-24 12:25:32 +0000 UTC,LastTransitionTime:2023-01-24 12:09:10 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-24 12:25:32 +0000 UTC,LastTransitionTime:2023-01-24 12:09:10 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-24 12:25:32 +0000 UTC,LastTransitionTime:2023-01-24 12:09:31 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.62.42,},NodeAddress{Type:ExternalIP,Address:18.144.79.13,},NodeAddress{Type:Hostname,Address:ip-172-20-62-42.us-west-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-62-42.us-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-144-79-13.us-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2f0698917764d226ec108df5fcfc56,SystemUUID:ec2f0698-9177-64d2-26ec-108df5fcfc56,BootID:c6c940f9-7462-43d1-92da-e4a2c837556e,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.23.16,KubeProxyVersion:v1.23.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.16 registry.k8s.io/kube-proxy-amd64:v1.23.16],SizeBytes:112743991,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0719cd6c97522c42b kubernetes.io/csi/ebs.csi.aws.com^vol-08b09c9a68b8e7c77],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-08b09c9a68b8e7c77,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0719cd6c97522c42b,DevicePath:,},},Config:nil,},} Jan 24 12:25:35.425: INFO: Logging kubelet events for node ip-172-20-62-42.us-west-1.compute.internal Jan 24 12:25:35.487: INFO: Logging pods the kubelet thinks is on node ip-172-20-62-42.us-west-1.compute.internal Jan 24 12:25:35.553: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-ls58g started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:35.553: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:35.553: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-pq8gm started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:35.553: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:35.553: INFO: webserver-deployment-5d9fdcc779-9vj6f started at 2023-01-24 12:20:33 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:35.553: INFO: Container httpd ready: true, restart count 0 Jan 24 12:25:35.553: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-ct4xp started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:35.553: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: false, restart count 0 Jan 24 12:25:35.553: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-cdkxl started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:35.553: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:35.553: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-jmg66 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:35.553: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:35.553: INFO: webserver-deployment-5d9fdcc779-fv2mx started at 2023-01-24 12:20:33 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:35.553: INFO: Container httpd ready: false, restart count 0 Jan 24 12:25:35.553: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-g4s7s started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:35.554: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:35.554: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-cc5vr started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:35.554: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:35.554: INFO: netserver-1 started at 2023-01-24 12:25:31 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:35.554: INFO: Container webserver ready: false, restart count 0 Jan 24 12:25:35.554: INFO: ss-0 started at 2023-01-24 12:18:53 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:35.554: INFO: Container webserver ready: true, restart count 0 Jan 24 12:25:35.554: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-m869g started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:35.554: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:35.554: INFO: pod-client started at 2023-01-24 12:20:15 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:35.554: INFO: Container pod-client ready: true, restart count 0 Jan 24 12:25:35.554: INFO: var-expansion-07acec39-86b9-4e15-805b-2b0a172a9495 started at 2023-01-24 12:24:48 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:35.554: INFO: Container dapi-container ready: false, restart count 0 Jan 24 12:25:35.554: INFO: ebs-csi-node-9pt8t started at 2023-01-24 12:09:11 +0000 UTC (0+3 container statuses recorded) Jan 24 12:25:35.554: INFO: Container ebs-plugin ready: true, restart count 0 Jan 24 12:25:35.554: INFO: Container liveness-probe ready: true, restart count 0 Jan 24 12:25:35.554: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 24 12:25:35.554: INFO: cilium-45k6r started at 2023-01-24 12:09:11 +0000 UTC (1+1 container statuses recorded) Jan 24 12:25:35.554: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 24 12:25:35.554: INFO: Container cilium-agent ready: true, restart count 0 Jan 24 12:25:35.554: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-w4rqg started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:35.554: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:35.554: INFO: ss-0 started at 2023-01-24 12:21:08 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:35.554: INFO: Container webserver ready: false, restart count 0 Jan 24 12:25:35.554: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-l77fq started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:35.554: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:35.554: INFO: indexed-job-1-4twdx started at 2023-01-24 12:21:23 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:35.554: INFO: Container c ready: false, restart count 0 Jan 24 12:25:35.554: INFO: netserver-1 started at 2023-01-24 12:24:45 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:35.554: INFO: Container webserver ready: false, restart count 0 Jan 24 12:25:35.856: INFO: Latency metrics for node ip-172-20-62-42.us-west-1.compute.internal Jan 24 12:25:35.856: INFO: Logging node info for node ip-172-20-63-134.us-west-1.compute.internal Jan 24 12:25:35.915: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-63-134.us-west-1.compute.internal 30ac81c2-1bcf-49af-aa05-528c41f9d04a 25045 0 2023-01-24 12:09:05 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-1 failure-domain.beta.kubernetes.io/zone:us-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-63-134.us-west-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-1a topology.hostpath.csi/node:ip-172-20-63-134.us-west-1.compute.internal topology.kubernetes.io/region:us-west-1 topology.kubernetes.io/zone:us-west-1a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0f4c0c89e622dd2cb"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2023-01-24 12:09:05 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-24 12:09:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-01-24 12:09:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-24 12:16:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-01-24 12:16:21 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {e2e.test Update v1 2023-01-24 12:19:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-1a/i-0f4c0c89e622dd2cb,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051644416 0} {<nil>} 3956684Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946786816 0} {<nil>} 3854284Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-24 12:25:14 +0000 UTC,LastTransitionTime:2023-01-24 12:09:05 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-24 12:25:14 +0000 UTC,LastTransitionTime:2023-01-24 12:09:05 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-24 12:25:14 +0000 UTC,LastTransitionTime:2023-01-24 12:09:05 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-24 12:25:14 +0000 UTC,LastTransitionTime:2023-01-24 12:09:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.63.134,},NodeAddress{Type:ExternalIP,Address:13.52.252.72,},NodeAddress{Type:Hostname,Address:ip-172-20-63-134.us-west-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-63-134.us-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-52-252-72.us-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec216b16315774b9b69907761ee0f87b,SystemUUID:ec216b16-3157-74b9-b699-07761ee0f87b,BootID:a0b9767c-5621-442f-8ded-9126e82e52b2,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.23.16,KubeProxyVersion:v1.23.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.16 registry.k8s.io/kube-proxy-amd64:v1.23.16],SizeBytes:112743991,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[docker.io/library/nginx@sha256:b8f2383a95879e1ae064940d9a200f67a6c79e710ed82ac42263397367e7cc4e docker.io/library/nginx:latest],SizeBytes:56882371,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a k8s.gcr.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 k8s.gcr.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac k8s.gcr.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0ff989d77482eddbb],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0ff989d77482eddbb,DevicePath:,},},Config:nil,},} Jan 24 12:25:35.916: INFO: Logging kubelet events for node ip-172-20-63-134.us-west-1.compute.internal Jan 24 12:25:35.977: INFO: Logging pods the kubelet thinks is on node ip-172-20-63-134.us-west-1.compute.internal Jan 24 12:25:36.052: INFO: ss-0 started at 2023-01-24 12:19:42 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:36.052: INFO: Container webserver ready: false, restart count 0 Jan 24 12:25:36.052: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-9kzn4 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:36.052: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: false, restart count 0 Jan 24 12:25:36.052: INFO: cilium-mkm5g started at 2023-01-24 12:09:06 +0000 UTC (1+1 container statuses recorded) Jan 24 12:25:36.052: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 24 12:25:36.052: INFO: Container cilium-agent ready: true, restart count 0 Jan 24 12:25:36.052: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-gh2rw started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:36.052: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:36.052: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-bqvzk started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:36.052: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: false, restart count 0 Jan 24 12:25:36.052: INFO: webserver-deployment-5d9fdcc779-xwhl2 started at 2023-01-24 12:20:33 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:36.052: INFO: Container httpd ready: false, restart count 0 Jan 24 12:25:36.052: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-x2c2b started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:36.052: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:36.052: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-b74rw started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:36.052: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:36.052: INFO: csi-hostpathplugin-0 started at 2023-01-24 12:20:09 +0000 UTC (0+7 container statuses recorded) Jan 24 12:25:36.052: INFO: Container csi-attacher ready: false, restart count 0 Jan 24 12:25:36.052: INFO: Container csi-provisioner ready: false, restart count 0 Jan 24 12:25:36.052: INFO: Container csi-resizer ready: false, restart count 0 Jan 24 12:25:36.052: INFO: Container csi-snapshotter ready: false, restart count 0 Jan 24 12:25:36.052: INFO: Container hostpath ready: false, restart count 0 Jan 24 12:25:36.052: INFO: Container liveness-probe ready: false, restart count 0 Jan 24 12:25:36.052: INFO: Container node-driver-registrar ready: false, restart count 0 Jan 24 12:25:36.052: INFO: pod-handle-http-request started at 2023-01-24 12:20:51 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:36.052: INFO: Container agnhost-container ready: false, restart count 0 Jan 24 12:25:36.052: INFO: netserver-2 started at 2023-01-24 12:24:45 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:36.052: INFO: Container webserver ready: false, restart count 0 Jan 24 12:25:36.052: INFO: netserver-2 started at 2023-01-24 12:25:31 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:36.052: INFO: Container webserver ready: false, restart count 0 Jan 24 12:25:36.052: INFO: ebs-csi-node-v75jm started at 2023-01-24 12:09:06 +0000 UTC (0+3 container statuses recorded) Jan 24 12:25:36.052: INFO: Container ebs-plugin ready: true, restart count 0 Jan 24 12:25:36.052: INFO: Container liveness-probe ready: true, restart count 0 Jan 24 12:25:36.052: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 24 12:25:36.052: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-g7hv8 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:36.052: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:36.052: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-dwht5 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:36.052: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:36.052: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-gp5cx started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:36.052: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:36.052: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-vnplb started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:36.052: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:36.052: INFO: ss2-1 started at 2023-01-24 12:19:02 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:36.052: INFO: Container webserver ready: true, restart count 0 Jan 24 12:25:36.052: INFO: csi-hostpathplugin-0 started at 2023-01-24 12:25:18 +0000 UTC (0+7 container statuses recorded) Jan 24 12:25:36.052: INFO: Container csi-attacher ready: false, restart count 0 Jan 24 12:25:36.052: INFO: Container csi-provisioner ready: false, restart count 0 Jan 24 12:25:36.052: INFO: Container csi-resizer ready: false, restart count 0 Jan 24 12:25:36.052: INFO: Container csi-snapshotter ready: false, restart count 0 Jan 24 12:25:36.052: INFO: Container hostpath ready: false, restart count 0 Jan 24 12:25:36.052: INFO: Container liveness-probe ready: false, restart count 0 Jan 24 12:25:36.052: INFO: Container node-driver-registrar ready: false, restart count 0 Jan 24 12:25:36.052: INFO: webserver-deployment-5d9fdcc779-f4lt5 started at 2023-01-24 12:20:33 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:36.052: INFO: Container httpd ready: false, restart count 0 Jan 24 12:25:36.052: INFO: coredns-autoscaler-557ccb4c66-gl766 started at 2023-01-24 12:09:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:36.052: INFO: Container autoscaler ready: true, restart count 0 Jan 24 12:25:36.052: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-8wf5k started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:36.053: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:36.053: INFO: webserver-deployment-5d9fdcc779-kcxmz started at 2023-01-24 12:20:33 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:36.053: INFO: Container httpd ready: true, restart count 0 Jan 24 12:25:36.053: INFO: coredns-867df8f45c-wcswf started at 2023-01-24 12:09:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:36.053: INFO: Container coredns ready: true, restart count 0 Jan 24 12:25:36.289: INFO: Latency metrics for node ip-172-20-63-134.us-west-1.compute.internal Jan 24 12:25:36.289: INFO: Logging node info for node ip-172-20-63-190.us-west-1.compute.internal Jan 24 12:25:36.348: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-63-190.us-west-1.compute.internal d80c92f0-6fa8-4333-b1ea-6b0b4cdbea2d 23714 0 2023-01-24 12:09:12 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-1 failure-domain.beta.kubernetes.io/zone:us-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-63-190.us-west-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-1a topology.hostpath.csi/node:ip-172-20-63-190.us-west-1.compute.internal topology.kubernetes.io/region:us-west-1 topology.kubernetes.io/zone:us-west-1a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0fd113285a9315bba"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2023-01-24 12:09:12 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-24 12:09:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-24 12:09:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-01-24 12:19:02 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-24 12:19:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {e2e.test Update v1 2023-01-24 12:19:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-1a/i-0fd113285a9315bba,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051652608 0} {<nil>} 3956692Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946795008 0} {<nil>} 3854292Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-24 12:20:58 +0000 UTC,LastTransitionTime:2023-01-24 12:09:12 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-24 12:20:58 +0000 UTC,LastTransitionTime:2023-01-24 12:09:12 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-24 12:20:58 +0000 UTC,LastTransitionTime:2023-01-24 12:09:12 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-24 12:20:58 +0000 UTC,LastTransitionTime:2023-01-24 12:09:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.63.190,},NodeAddress{Type:ExternalIP,Address:54.215.249.154,},NodeAddress{Type:Hostname,Address:ip-172-20-63-190.us-west-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-63-190.us-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-215-249-154.us-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec255708dba66ed160033f1fab58ba92,SystemUUID:ec255708-dba6-6ed1-6003-3f1fab58ba92,BootID:4e4cb7aa-a82e-4abd-a66d-5fb285cb6c0b,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.23.16,KubeProxyVersion:v1.23.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.16 registry.k8s.io/kube-proxy-amd64:v1.23.16],SizeBytes:112743991,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-00dc1f3b8024ef2d2 kubernetes.io/csi/ebs.csi.aws.com^vol-057a1367ebd667fa7 kubernetes.io/csi/ebs.csi.aws.com^vol-077d776e5480a39f5 kubernetes.io/csi/ebs.csi.aws.com^vol-08a0be3744dd7cd6f kubernetes.io/csi/ebs.csi.aws.com^vol-0d966a9348a99e832],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-057a1367ebd667fa7,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-08a0be3744dd7cd6f,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0d966a9348a99e832,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-077d776e5480a39f5,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-00dc1f3b8024ef2d2,DevicePath:,},},Config:nil,},} Jan 24 12:25:36.349: INFO: Logging kubelet events for node ip-172-20-63-190.us-west-1.compute.internal Jan 24 12:25:36.410: INFO: Logging pods the kubelet thinks is on node ip-172-20-63-190.us-west-1.compute.internal Jan 24 12:25:36.479: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-kzfz9 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:36.479: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:36.479: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-9pdvd started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:36.479: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: false, restart count 0 Jan 24 12:25:36.479: INFO: pod-ea0a4a16-77cf-4d6c-8028-d52d846083e3 started at 2023-01-24 12:20:33 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:36.479: INFO: Container write-pod ready: false, restart count 0 Jan 24 12:25:36.479: INFO: ss-1 started at 2023-01-24 12:19:16 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:36.479: INFO: Container webserver ready: false, restart count 0 Jan 24 12:25:36.479: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-dhzcl started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:36.479: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:36.479: INFO: fail-once-local-nkjmd started at 2023-01-24 12:20:23 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:36.479: INFO: Container c ready: false, restart count 0 Jan 24 12:25:36.479: INFO: ebs-csi-node-ld8b2 started at 2023-01-24 12:09:13 +0000 UTC (0+3 container statuses recorded) Jan 24 12:25:36.479: INFO: Container ebs-plugin ready: true, restart count 0 Jan 24 12:25:36.479: INFO: Container liveness-probe ready: true, restart count 0 Jan 24 12:25:36.479: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 24 12:25:36.479: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-vqntn started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:36.479: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:36.479: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-4jptx started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:36.479: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: false, restart count 0 Jan 24 12:25:36.479: INFO: fail-once-local-4kxtz started at 2023-01-24 12:20:23 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:36.479: INFO: Container c ready: false, restart count 1 Jan 24 12:25:36.479: INFO: webserver-deployment-5d9fdcc779-pdnwl started at 2023-01-24 12:20:33 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:36.479: INFO: Container httpd ready: false, restart count 0 Jan 24 12:25:36.479: INFO: webserver-deployment-5d9fdcc779-hqvdm started at 2023-01-24 12:20:33 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:36.479: INFO: Container httpd ready: false, restart count 0 Jan 24 12:25:36.479: INFO: pod-secrets-284a736c-e668-4401-a5da-1059a9ed9b95 started at 2023-01-24 12:20:45 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:36.479: INFO: Container secret-volume-test ready: false, restart count 0 Jan 24 12:25:36.479: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-bcqr7 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:36.479: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:36.479: INFO: indexed-job-0-q2xds started at 2023-01-24 12:21:23 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:36.479: INFO: Container c ready: false, restart count 0 Jan 24 12:25:36.479: INFO: netserver-3 started at 2023-01-24 12:24:46 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:36.479: INFO: Container webserver ready: false, restart count 0 Jan 24 12:25:36.479: INFO: pod-subpath-test-dynamicpv-swqs started at 2023-01-24 12:20:52 +0000 UTC (1+1 container statuses recorded) Jan 24 12:25:36.479: INFO: Init container init-volume-dynamicpv-swqs ready: false, restart count 0 Jan 24 12:25:36.479: INFO: Container test-container-subpath-dynamicpv-swqs ready: false, restart count 0 Jan 24 12:25:36.479: INFO: ss-1 started at 2023-01-24 12:19:17 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:36.479: INFO: Container webserver ready: false, restart count 0 Jan 24 12:25:36.479: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-5rrg5 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:36.479: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:36.479: INFO: webserver-deployment-5d9fdcc779-xtrv9 started at 2023-01-24 12:20:33 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:36.479: INFO: Container httpd ready: true, restart count 0 Jan 24 12:25:36.479: INFO: sample-webhook-deployment-6c69dbd86b-2nv64 started at 2023-01-24 12:21:04 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:36.479: INFO: Container sample-webhook ready: false, restart count 0 Jan 24 12:25:36.479: INFO: netserver-3 started at 2023-01-24 12:25:31 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:36.479: INFO: Container webserver ready: false, restart count 0 Jan 24 12:25:36.479: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-s27h5 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:36.479: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:36.479: INFO: cilium-54xb4 started at 2023-01-24 12:09:13 +0000 UTC (1+1 container statuses recorded) Jan 24 12:25:36.479: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 24 12:25:36.479: INFO: Container cilium-agent ready: true, restart count 0 Jan 24 12:25:36.479: INFO: ss-2 started at 2023-01-24 12:19:04 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:36.479: INFO: Container webserver ready: true, restart count 0 Jan 24 12:25:36.479: INFO: fail-once-local-t84jj started at 2023-01-24 12:20:44 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:36.479: INFO: Container c ready: false, restart count 0 Jan 24 12:25:36.479: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-8ztk4 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:36.479: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:36.479: INFO: ss2-0 started at 2023-01-24 12:19:01 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:36.479: INFO: Container webserver ready: true, restart count 0 Jan 24 12:25:36.479: INFO: pod-prestop-hook-56510143-6a4e-4e26-8ba3-e13327e62e97 started at 2023-01-24 12:21:07 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:36.479: INFO: Container nginx ready: false, restart count 0 Jan 24 12:25:36.479: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-tzgzx started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:36.479: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:25:36.479: INFO: hostexec-ip-172-20-63-190.us-west-1.compute.internal-zn54q started at 2023-01-24 12:25:33 +0000 UTC (0+1 container statuses recorded) Jan 24 12:25:36.479: INFO: Container agnhost-container ready: true, restart count 0 Jan 24 12:25:36.479: INFO: pod-server-1 started at 2023-01-24 12:20:33 +0000 UTC (1+1 container statuses recorded) Jan 24 12:25:36.479: INFO: Init container init ready: false, restart count 0 Jan 24 12:25:36.479: INFO: Container agnhost-container ready: false, restart count 0 Jan 24 12:25:36.747: INFO: Latency metrics for node ip-172-20-63-190.us-west-1.compute.internal Jan 24 12:25:36.747: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "deployment-6871" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-apps\]\sJob\sshould\srun\sa\sjob\sto\scompletion\swhen\stasks\ssometimes\sfail\sand\sare\slocally\srestarted\s\[Conformance\]$'
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:633 Jan 24 12:35:23.323: failed to ensure job completion in namespace: job-3599 Unexpected error: <*errors.errorString | 0xc0001dc240>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/job.go:229from junit_13.xml
[BeforeEach] [sig-apps] Job /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Jan 24 12:20:22.709: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename job �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace [It] should run a job to completion when tasks sometimes fail and are locally restarted [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:633 �[1mSTEP�[0m: Creating a job �[1mSTEP�[0m: Ensuring job reaches completions Jan 24 12:35:23.323: FAIL: failed to ensure job completion in namespace: job-3599 Unexpected error: <*errors.errorString | 0xc0001dc240>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/apps.glob..func6.6() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/job.go:229 +0x24c k8s.io/kubernetes/test/e2e.RunE2ETests(0x24eec17?) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:133 +0x6b7 k8s.io/kubernetes/test/e2e.TestE2E(0x24602d9?) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc0006836c0, 0x72ecb90) /usr/local/go/src/testing/testing.go:1446 +0x10b created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1493 +0x35f [AfterEach] [sig-apps] Job /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "job-3599". �[1mSTEP�[0m: Found 30 events. Jan 24 12:35:23.384: INFO: At 2023-01-24 12:20:23 +0000 UTC - event for fail-once-local: {job-controller } SuccessfulCreate: Created pod: fail-once-local-4kxtz Jan 24 12:35:23.384: INFO: At 2023-01-24 12:20:23 +0000 UTC - event for fail-once-local: {job-controller } SuccessfulCreate: Created pod: fail-once-local-nkjmd Jan 24 12:35:23.384: INFO: At 2023-01-24 12:20:23 +0000 UTC - event for fail-once-local-4kxtz: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "27c1d0eeb839e1d234ddbaa43b1f5414ff669ceb3db13a0f50171c582d51ada5": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:35:23.384: INFO: At 2023-01-24 12:20:23 +0000 UTC - event for fail-once-local-4kxtz: {default-scheduler } Scheduled: Successfully assigned job-3599/fail-once-local-4kxtz to ip-172-20-63-190.us-west-1.compute.internal Jan 24 12:35:23.384: INFO: At 2023-01-24 12:20:23 +0000 UTC - event for fail-once-local-nkjmd: {default-scheduler } Scheduled: Successfully assigned job-3599/fail-once-local-nkjmd to ip-172-20-63-190.us-west-1.compute.internal Jan 24 12:35:23.384: INFO: At 2023-01-24 12:20:23 +0000 UTC - event for fail-once-local-nkjmd: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "3cef2a0c69493a34161f9a1eeb643d84386e62d87ef08822f3c39b552cb9671b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:35:23.384: INFO: At 2023-01-24 12:20:35 +0000 UTC - event for fail-once-local-nkjmd: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a263fdf8fd883de46749a0ce14ca241586aec96f523c46fa58d3d1cd3e9e369d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:35:23.384: INFO: At 2023-01-24 12:20:39 +0000 UTC - event for fail-once-local-4kxtz: {kubelet ip-172-20-63-190.us-west-1.compute.internal} Started: Started container c Jan 24 12:35:23.384: INFO: At 2023-01-24 12:20:39 +0000 UTC - event for fail-once-local-4kxtz: {kubelet ip-172-20-63-190.us-west-1.compute.internal} Pulled: Container image "k8s.gcr.io/e2e-test-images/busybox:1.29-2" already present on machine Jan 24 12:35:23.384: INFO: At 2023-01-24 12:20:39 +0000 UTC - event for fail-once-local-4kxtz: {kubelet ip-172-20-63-190.us-west-1.compute.internal} Created: Created container c Jan 24 12:35:23.384: INFO: At 2023-01-24 12:20:44 +0000 UTC - event for fail-once-local: {job-controller } SuccessfulCreate: Created pod: fail-once-local-t84jj Jan 24 12:35:23.384: INFO: At 2023-01-24 12:20:44 +0000 UTC - event for fail-once-local-t84jj: {default-scheduler } Scheduled: Successfully assigned job-3599/fail-once-local-t84jj to ip-172-20-63-190.us-west-1.compute.internal Jan 24 12:35:23.384: INFO: At 2023-01-24 12:20:45 +0000 UTC - event for fail-once-local-t84jj: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "922a03ce6fe5724beca718d5f40a7f77c1c01e794d0507fd666d61a39dd110fe": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:35:23.384: INFO: At 2023-01-24 12:20:51 +0000 UTC - event for fail-once-local-nkjmd: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "19368c109943d91faa7001eba9ae9ab24cc1dec095aa39fbcdbdfc2cf7f864a5": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:35:23.384: INFO: At 2023-01-24 12:20:58 +0000 UTC - event for fail-once-local-t84jj: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "bc4ab546c3b62daf31872de2fc6257115f26cff135cf9fd02420107281c236b1": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:35:23.384: INFO: At 2023-01-24 12:21:05 +0000 UTC - event for fail-once-local-nkjmd: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "8b407a637695fca84bd01e6d61ec96f181161a37e3a80d4cd8fb73632f04a27f": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:35:23.384: INFO: At 2023-01-24 12:21:11 +0000 UTC - event for fail-once-local-t84jj: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "f6012ce0f993ecb23aebedecadf969d6abbe545eef0c382927688c4cdfe3d500": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:35:23.384: INFO: At 2023-01-24 12:21:19 +0000 UTC - event for fail-once-local-nkjmd: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "031891483f0b2272d896080104b31026646671ec116abc60c8180a1b0ae8a796": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:35:23.384: INFO: At 2023-01-24 12:21:23 +0000 UTC - event for fail-once-local-t84jj: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b58f9858337b8d8f20cf0a735c5e95cd6bdb6d5df6485b6a0262a2a7b05609c7": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:35:23.384: INFO: At 2023-01-24 12:21:31 +0000 UTC - event for fail-once-local-nkjmd: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "4faa60f62afdb0860694dcedd51a5bf1ca9f52fffff2ed0143b8ab937347dc7e": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:35:23.384: INFO: At 2023-01-24 12:21:36 +0000 UTC - event for fail-once-local-t84jj: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "00ac142c9c9901c971558a0b0a2dacce36b4df1a541073004172738e96e1831a": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:35:23.384: INFO: At 2023-01-24 12:21:45 +0000 UTC - event for fail-once-local-nkjmd: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "f428c04fb2395c70d3de304db26ed0d38cbab563c7a1ebbefe45ddf8d94d53a4": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:35:23.384: INFO: At 2023-01-24 12:21:48 +0000 UTC - event for fail-once-local-t84jj: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "8bd7b55d6ab92b02964f04b5d6cd1b36ae2a00e046aa8729cc1a7d4d354cc425": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:35:23.384: INFO: At 2023-01-24 12:21:58 +0000 UTC - event for fail-once-local-nkjmd: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "032106007f274ee3f92379edb29a44dcd053604c7dabd648acccaee4a6b811d4": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:35:23.384: INFO: At 2023-01-24 12:22:01 +0000 UTC - event for fail-once-local-t84jj: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "95349d4cfd23d2f24e0244d2a0d36e875daf01e2ee5c0676b01903589a49513e": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:35:23.384: INFO: At 2023-01-24 12:22:13 +0000 UTC - event for fail-once-local-nkjmd: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "bf687183c4a362fcfd59a832018429463d0d86bbf39a9a979599fd78fe6a2a38": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:35:23.384: INFO: At 2023-01-24 12:22:13 +0000 UTC - event for fail-once-local-t84jj: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "29b4ad4fc8548db7f828140f14c7fd94560a7fc934be3cb7e6b1380786ddee55": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:35:23.384: INFO: At 2023-01-24 12:22:24 +0000 UTC - event for fail-once-local-t84jj: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "09254730d5f11e1a42c7e1a21e5d0323c95e94bca5ec88e48c214fb0d633dc7a": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:35:23.384: INFO: At 2023-01-24 12:22:28 +0000 UTC - event for fail-once-local-nkjmd: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "3025634dcd583064c507d133a2983e8c5f62ac6fd2d5930099884bed692083c3": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:35:23.384: INFO: At 2023-01-24 12:22:40 +0000 UTC - event for fail-once-local-t84jj: {kubelet ip-172-20-63-190.us-west-1.compute.internal} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "eef5a110fb1ce47375b8bc6a739ad874ba2be3b62dca7e6ee62c8f5f2684dbf1": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:35:23.444: INFO: POD NODE PHASE GRACE CONDITIONS Jan 24 12:35:23.444: INFO: fail-once-local-4kxtz ip-172-20-63-190.us-west-1.compute.internal Succeeded [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:20:23 +0000 UTC PodCompleted } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:20:23 +0000 UTC PodCompleted } {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:20:23 +0000 UTC PodCompleted } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:20:23 +0000 UTC }] Jan 24 12:35:23.444: INFO: fail-once-local-nkjmd ip-172-20-63-190.us-west-1.compute.internal Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:20:23 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:20:23 +0000 UTC ContainersNotReady containers with unready status: [c]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:20:23 +0000 UTC ContainersNotReady containers with unready status: [c]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:20:23 +0000 UTC }] Jan 24 12:35:23.444: INFO: fail-once-local-t84jj ip-172-20-63-190.us-west-1.compute.internal Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:20:44 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:20:44 +0000 UTC ContainersNotReady containers with unready status: [c]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:20:44 +0000 UTC ContainersNotReady containers with unready status: [c]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-24 12:20:44 +0000 UTC }] Jan 24 12:35:23.444: INFO: Jan 24 12:35:23.568: INFO: Unable to fetch job-3599/fail-once-local-nkjmd/c logs: the server rejected our request for an unknown reason (get pods fail-once-local-nkjmd) Jan 24 12:35:23.629: INFO: Unable to fetch job-3599/fail-once-local-t84jj/c logs: the server rejected our request for an unknown reason (get pods fail-once-local-t84jj) Jan 24 12:35:23.691: INFO: Logging node info for node ip-172-20-42-201.us-west-1.compute.internal Jan 24 12:35:23.751: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-42-201.us-west-1.compute.internal cc6006a6-61fd-4f4c-b296-ba72367bb0f8 29735 0 2023-01-24 12:07:14 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-1 failure-domain.beta.kubernetes.io/zone:us-west-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-42-201.us-west-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/control-plane: node-role.kubernetes.io/master: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:us-west-1a topology.kubernetes.io/region:us-west-1 topology.kubernetes.io/zone:us-west-1a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-08c27beef2082266b"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-24 12:07:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {protokube Update v1 2023-01-24 12:07:41 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kops-controller Update v1 2023-01-24 12:07:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/master":{}}}} } {kube-controller-manager Update v1 2023-01-24 12:07:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-24 12:09:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-1a/i-08c27beef2082266b,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892264960 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787407360 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-24 12:35:21 +0000 UTC,LastTransitionTime:2023-01-24 12:07:14 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-24 12:35:21 +0000 UTC,LastTransitionTime:2023-01-24 12:07:14 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-24 12:35:21 +0000 UTC,LastTransitionTime:2023-01-24 12:07:14 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-24 12:35:21 +0000 UTC,LastTransitionTime:2023-01-24 12:07:55 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.201,},NodeAddress{Type:ExternalIP,Address:54.215.124.25,},NodeAddress{Type:Hostname,Address:ip-172-20-42-201.us-west-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-42-201.us-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-215-124-25.us-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2be20fd28580af17ed5c32106be540,SystemUUID:ec2be20f-d285-80af-17ed-5c32106be540,BootID:cb576848-3e1b-4407-b81d-d34a637f2afd,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.23.16,KubeProxyVersion:v1.23.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.23.16 registry.k8s.io/kube-apiserver-amd64:v1.23.16],SizeBytes:131340755,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.23.16 registry.k8s.io/kube-controller-manager-amd64:v1.23.16],SizeBytes:121280825,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.16 registry.k8s.io/kube-proxy-amd64:v1.23.16],SizeBytes:112743991,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.23.16 registry.k8s.io/kube-scheduler-amd64:v1.23.16],SizeBytes:53193016,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-beta.2],SizeBytes:43191763,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-beta.2],SizeBytes:42821714,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-beta.2],SizeBytes:4965793,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 24 12:35:23.751: INFO: Logging kubelet events for node ip-172-20-42-201.us-west-1.compute.internal Jan 24 12:35:23.828: INFO: Logging pods the kubelet thinks is on node ip-172-20-42-201.us-west-1.compute.internal Jan 24 12:35:23.906: INFO: kops-controller-8k2c2 started at 2023-01-24 12:07:41 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:23.906: INFO: Container kops-controller ready: true, restart count 0 Jan 24 12:35:23.906: INFO: ebs-csi-controller-7bd4fbc786-nm7v4 started at 2023-01-24 12:07:42 +0000 UTC (0+5 container statuses recorded) Jan 24 12:35:23.906: INFO: Container csi-attacher ready: true, restart count 0 Jan 24 12:35:23.906: INFO: Container csi-provisioner ready: true, restart count 0 Jan 24 12:35:23.906: INFO: Container csi-resizer ready: true, restart count 0 Jan 24 12:35:23.906: INFO: Container ebs-plugin ready: true, restart count 0 Jan 24 12:35:23.906: INFO: Container liveness-probe ready: true, restart count 0 Jan 24 12:35:23.906: INFO: etcd-manager-events-ip-172-20-42-201.us-west-1.compute.internal started at 2023-01-24 12:06:45 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:23.906: INFO: Container etcd-manager ready: true, restart count 0 Jan 24 12:35:23.906: INFO: etcd-manager-main-ip-172-20-42-201.us-west-1.compute.internal started at 2023-01-24 12:06:45 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:23.906: INFO: Container etcd-manager ready: true, restart count 0 Jan 24 12:35:23.906: INFO: kube-apiserver-ip-172-20-42-201.us-west-1.compute.internal started at 2023-01-24 12:06:45 +0000 UTC (0+2 container statuses recorded) Jan 24 12:35:23.906: INFO: Container healthcheck ready: true, restart count 0 Jan 24 12:35:23.906: INFO: Container kube-apiserver ready: true, restart count 1 Jan 24 12:35:23.906: INFO: ebs-csi-node-4lwrc started at 2023-01-24 12:07:40 +0000 UTC (0+3 container statuses recorded) Jan 24 12:35:23.906: INFO: Container ebs-plugin ready: true, restart count 0 Jan 24 12:35:23.906: INFO: Container liveness-probe ready: true, restart count 0 Jan 24 12:35:23.906: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 24 12:35:23.906: INFO: dns-controller-58d7bbb845-c475n started at 2023-01-24 12:07:41 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:23.906: INFO: Container dns-controller ready: true, restart count 0 Jan 24 12:35:23.906: INFO: kube-controller-manager-ip-172-20-42-201.us-west-1.compute.internal started at 2023-01-24 12:06:45 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:23.906: INFO: Container kube-controller-manager ready: true, restart count 2 Jan 24 12:35:23.906: INFO: kube-scheduler-ip-172-20-42-201.us-west-1.compute.internal started at 2023-01-24 12:06:45 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:23.906: INFO: Container kube-scheduler ready: true, restart count 0 Jan 24 12:35:23.906: INFO: cilium-5dpkw started at 2023-01-24 12:07:38 +0000 UTC (1+1 container statuses recorded) Jan 24 12:35:23.906: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 24 12:35:23.906: INFO: Container cilium-agent ready: true, restart count 1 Jan 24 12:35:23.906: INFO: cilium-operator-d84d55876-rfmxk started at 2023-01-24 12:07:41 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:23.906: INFO: Container cilium-operator ready: true, restart count 1 Jan 24 12:35:24.134: INFO: Latency metrics for node ip-172-20-42-201.us-west-1.compute.internal Jan 24 12:35:24.134: INFO: Logging node info for node ip-172-20-58-8.us-west-1.compute.internal Jan 24 12:35:24.194: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-58-8.us-west-1.compute.internal 4a97117d-69ce-4a16-9e93-9e41b32a9a62 29589 0 2023-01-24 12:09:13 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-1 failure-domain.beta.kubernetes.io/zone:us-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-58-8.us-west-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-1a topology.hostpath.csi/node:ip-172-20-58-8.us-west-1.compute.internal topology.kubernetes.io/region:us-west-1 topology.kubernetes.io/zone:us-west-1a] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-1477":"csi-mock-csi-mock-volumes-1477","ebs.csi.aws.com":"i-0cf7a751b954f0403"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2023-01-24 12:09:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-24 12:09:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-24 12:09:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-01-24 12:17:56 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-24 12:18:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {e2e.test Update v1 2023-01-24 12:19:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-1a/i-0cf7a751b954f0403,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051644416 0} {<nil>} 3956684Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946786816 0} {<nil>} 3854284Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-24 12:35:02 +0000 UTC,LastTransitionTime:2023-01-24 12:09:13 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-24 12:35:02 +0000 UTC,LastTransitionTime:2023-01-24 12:09:13 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-24 12:35:02 +0000 UTC,LastTransitionTime:2023-01-24 12:09:13 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-24 12:35:02 +0000 UTC,LastTransitionTime:2023-01-24 12:09:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.58.8,},NodeAddress{Type:ExternalIP,Address:52.53.154.168,},NodeAddress{Type:Hostname,Address:ip-172-20-58-8.us-west-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-58-8.us-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-52-53-154-168.us-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec21f66ef1338663d7ef9e17ce7835a7,SystemUUID:ec21f66e-f133-8663-d7ef-9e17ce7835a7,BootID:e76a2ed0-0929-4d54-b334-e1f0ad9eacd2,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.23.16,KubeProxyVersion:v1.23.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.16 registry.k8s.io/kube-proxy-amd64:v1.23.16],SizeBytes:112743991,},ContainerImage{Names:[docker.io/library/nginx@sha256:b8f2383a95879e1ae064940d9a200f67a6c79e710ed82ac42263397367e7cc4e docker.io/library/nginx:latest],SizeBytes:56882371,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a k8s.gcr.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 k8s.gcr.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-1477^4 kubernetes.io/csi/ebs.csi.aws.com^vol-00a8f7338bd3c4426],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-00a8f7338bd3c4426,DevicePath:,},},Config:nil,},} Jan 24 12:35:24.195: INFO: Logging kubelet events for node ip-172-20-58-8.us-west-1.compute.internal Jan 24 12:35:24.257: INFO: Logging pods the kubelet thinks is on node ip-172-20-58-8.us-west-1.compute.internal Jan 24 12:35:24.325: INFO: pvc-volume-tester-9s7zp started at 2023-01-24 12:34:54 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:24.325: INFO: Container volume-tester ready: false, restart count 0 Jan 24 12:35:24.325: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-qbrts started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:24.325: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:35:24.325: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-qccgl started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:24.325: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:35:24.325: INFO: csi-mockplugin-attacher-0 started at 2023-01-24 12:32:17 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:24.325: INFO: Container csi-attacher ready: false, restart count 0 Jan 24 12:35:24.325: INFO: ebs-csi-node-4bbqn started at 2023-01-24 12:09:14 +0000 UTC (0+3 container statuses recorded) Jan 24 12:35:24.325: INFO: Container ebs-plugin ready: true, restart count 0 Jan 24 12:35:24.325: INFO: Container liveness-probe ready: true, restart count 0 Jan 24 12:35:24.325: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 24 12:35:24.325: INFO: ss-1 started at 2023-01-24 12:19:34 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:24.325: INFO: Container webserver ready: true, restart count 0 Jan 24 12:35:24.325: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-fhs4l started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:24.325: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:35:24.325: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-26vrc started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:24.325: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:35:24.325: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-c7hrk started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:24.325: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:35:24.325: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-58gdd started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:24.325: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: false, restart count 0 Jan 24 12:35:24.325: INFO: cilium-nchqx started at 2023-01-24 12:09:14 +0000 UTC (1+1 container statuses recorded) Jan 24 12:35:24.325: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 24 12:35:24.325: INFO: Container cilium-agent ready: true, restart count 0 Jan 24 12:35:24.325: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-5q458 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:24.325: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:35:24.325: INFO: netserver-0 started at 2023-01-24 12:30:26 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:24.325: INFO: Container webserver ready: false, restart count 0 Jan 24 12:35:24.326: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-vj22z started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:24.326: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:35:24.326: INFO: coredns-867df8f45c-8jvsj started at 2023-01-24 12:09:41 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:24.326: INFO: Container coredns ready: true, restart count 0 Jan 24 12:35:24.326: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-qdqt9 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:24.326: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:35:24.326: INFO: hostexec-ip-172-20-58-8.us-west-1.compute.internal-zdb9f started at 2023-01-24 12:31:11 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:24.326: INFO: Container agnhost-container ready: true, restart count 0 Jan 24 12:35:24.326: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-5znh6 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:24.326: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:35:24.326: INFO: pod-subpath-test-preprovisionedpv-6vzh started at 2023-01-24 12:31:24 +0000 UTC (1+2 container statuses recorded) Jan 24 12:35:24.326: INFO: Init container test-init-subpath-preprovisionedpv-6vzh ready: false, restart count 0 Jan 24 12:35:24.326: INFO: Container test-container-subpath-preprovisionedpv-6vzh ready: false, restart count 0 Jan 24 12:35:24.326: INFO: Container test-container-volume-preprovisionedpv-6vzh ready: false, restart count 0 Jan 24 12:35:24.326: INFO: csi-mockplugin-0 started at 2023-01-24 12:32:17 +0000 UTC (0+3 container statuses recorded) Jan 24 12:35:24.326: INFO: Container csi-provisioner ready: true, restart count 0 Jan 24 12:35:24.326: INFO: Container driver-registrar ready: true, restart count 0 Jan 24 12:35:24.326: INFO: Container mock ready: true, restart count 0 Jan 24 12:35:24.692: INFO: Latency metrics for node ip-172-20-58-8.us-west-1.compute.internal Jan 24 12:35:24.693: INFO: Logging node info for node ip-172-20-62-42.us-west-1.compute.internal Jan 24 12:35:24.753: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-62-42.us-west-1.compute.internal 2f9a48a1-cd3d-4169-9d63-d46bd4e4c90b 29463 0 2023-01-24 12:09:10 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-1 failure-domain.beta.kubernetes.io/zone:us-west-1a io.kubernetes.storage.mock/node:some-mock-node kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-62-42.us-west-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-1a topology.hostpath.csi/node:ip-172-20-62-42.us-west-1.compute.internal topology.kubernetes.io/region:us-west-1 topology.kubernetes.io/zone:us-west-1a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0d97debf14f45ab50"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-24 12:09:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-24 12:09:11 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-24 12:09:11 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kube-controller-manager Update v1 2023-01-24 12:17:35 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-24 12:17:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {e2e.test Update v1 2023-01-24 12:19:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-1a/i-0d97debf14f45ab50,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051644416 0} {<nil>} 3956684Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946786816 0} {<nil>} 3854284Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-24 12:34:42 +0000 UTC,LastTransitionTime:2023-01-24 12:09:10 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-24 12:34:42 +0000 UTC,LastTransitionTime:2023-01-24 12:09:10 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-24 12:34:42 +0000 UTC,LastTransitionTime:2023-01-24 12:09:10 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-24 12:34:42 +0000 UTC,LastTransitionTime:2023-01-24 12:09:31 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.62.42,},NodeAddress{Type:ExternalIP,Address:18.144.79.13,},NodeAddress{Type:Hostname,Address:ip-172-20-62-42.us-west-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-62-42.us-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-144-79-13.us-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2f0698917764d226ec108df5fcfc56,SystemUUID:ec2f0698-9177-64d2-26ec-108df5fcfc56,BootID:c6c940f9-7462-43d1-92da-e4a2c837556e,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.23.16,KubeProxyVersion:v1.23.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.16 registry.k8s.io/kube-proxy-amd64:v1.23.16],SizeBytes:112743991,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac k8s.gcr.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-08b09c9a68b8e7c77],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-08b09c9a68b8e7c77,DevicePath:,},},Config:nil,},} Jan 24 12:35:24.753: INFO: Logging kubelet events for node ip-172-20-62-42.us-west-1.compute.internal Jan 24 12:35:24.815: INFO: Logging pods the kubelet thinks is on node ip-172-20-62-42.us-west-1.compute.internal Jan 24 12:35:24.882: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-ls58g started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:24.882: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:35:24.882: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-pq8gm started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:24.882: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:35:24.882: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-ct4xp started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:24.882: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:35:24.882: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-cdkxl started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:24.882: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:35:24.882: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-jmg66 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:24.882: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:35:24.882: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-g4s7s started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:24.882: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:35:24.882: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-cc5vr started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:24.882: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:35:24.882: INFO: busybox-00fb9fcb-fccf-445d-ac48-01252d3d03fa started at 2023-01-24 12:34:35 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:24.882: INFO: Container busybox ready: false, restart count 0 Jan 24 12:35:24.882: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-m869g started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:24.882: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:35:24.882: INFO: agnhost-primary-92klg started at 2023-01-24 12:34:39 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:24.882: INFO: Container agnhost-primary ready: false, restart count 0 Jan 24 12:35:24.882: INFO: ebs-csi-node-9pt8t started at 2023-01-24 12:09:11 +0000 UTC (0+3 container statuses recorded) Jan 24 12:35:24.882: INFO: Container ebs-plugin ready: true, restart count 0 Jan 24 12:35:24.882: INFO: Container liveness-probe ready: true, restart count 0 Jan 24 12:35:24.882: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 24 12:35:24.882: INFO: cilium-45k6r started at 2023-01-24 12:09:11 +0000 UTC (1+1 container statuses recorded) Jan 24 12:35:24.882: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 24 12:35:24.882: INFO: Container cilium-agent ready: true, restart count 0 Jan 24 12:35:24.882: INFO: hostexec-ip-172-20-62-42.us-west-1.compute.internal-88lr6 started at 2023-01-24 12:34:38 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:24.882: INFO: Container agnhost-container ready: true, restart count 0 Jan 24 12:35:24.882: INFO: externalname-service-mn5hg started at 2023-01-24 12:31:38 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:24.882: INFO: Container externalname-service ready: false, restart count 0 Jan 24 12:35:24.882: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-w4rqg started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:24.882: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:35:24.882: INFO: ss-0 started at 2023-01-24 12:21:08 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:24.882: INFO: Container webserver ready: true, restart count 0 Jan 24 12:35:24.882: INFO: netserver-1 started at 2023-01-24 12:30:26 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:24.882: INFO: Container webserver ready: true, restart count 0 Jan 24 12:35:24.882: INFO: pod-subpath-test-preprovisionedpv-wfz7 started at 2023-01-24 12:34:54 +0000 UTC (0+2 container statuses recorded) Jan 24 12:35:24.882: INFO: Container test-container-subpath-preprovisionedpv-wfz7 ready: false, restart count 0 Jan 24 12:35:24.882: INFO: Container test-container-volume-preprovisionedpv-wfz7 ready: false, restart count 0 Jan 24 12:35:24.882: INFO: indexed-job-1-4twdx started at 2023-01-24 12:21:23 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:24.882: INFO: Container c ready: false, restart count 0 Jan 24 12:35:24.882: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-l77fq started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:24.882: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:35:25.239: INFO: Latency metrics for node ip-172-20-62-42.us-west-1.compute.internal Jan 24 12:35:25.239: INFO: Logging node info for node ip-172-20-63-134.us-west-1.compute.internal Jan 24 12:35:25.300: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-63-134.us-west-1.compute.internal 30ac81c2-1bcf-49af-aa05-528c41f9d04a 28078 0 2023-01-24 12:09:05 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-1 failure-domain.beta.kubernetes.io/zone:us-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-63-134.us-west-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-1a topology.hostpath.csi/node:ip-172-20-63-134.us-west-1.compute.internal topology.kubernetes.io/region:us-west-1 topology.kubernetes.io/zone:us-west-1a] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-1287":"csi-mock-csi-mock-volumes-1287","ebs.csi.aws.com":"i-0f4c0c89e622dd2cb"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2023-01-24 12:09:05 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-24 12:09:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-01-24 12:09:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-24 12:16:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-01-24 12:16:21 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {e2e.test Update v1 2023-01-24 12:19:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-1a/i-0f4c0c89e622dd2cb,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051644416 0} {<nil>} 3956684Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946786816 0} {<nil>} 3854284Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-24 12:30:59 +0000 UTC,LastTransitionTime:2023-01-24 12:09:05 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-24 12:30:59 +0000 UTC,LastTransitionTime:2023-01-24 12:09:05 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-24 12:30:59 +0000 UTC,LastTransitionTime:2023-01-24 12:09:05 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-24 12:30:59 +0000 UTC,LastTransitionTime:2023-01-24 12:09:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.63.134,},NodeAddress{Type:ExternalIP,Address:13.52.252.72,},NodeAddress{Type:Hostname,Address:ip-172-20-63-134.us-west-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-63-134.us-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-52-252-72.us-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec216b16315774b9b69907761ee0f87b,SystemUUID:ec216b16-3157-74b9-b699-07761ee0f87b,BootID:a0b9767c-5621-442f-8ded-9126e82e52b2,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.23.16,KubeProxyVersion:v1.23.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.16 registry.k8s.io/kube-proxy-amd64:v1.23.16],SizeBytes:112743991,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[docker.io/library/nginx@sha256:b8f2383a95879e1ae064940d9a200f67a6c79e710ed82ac42263397367e7cc4e docker.io/library/nginx:latest],SizeBytes:56882371,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a k8s.gcr.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 k8s.gcr.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac k8s.gcr.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-1287^4 kubernetes.io/csi/ebs.csi.aws.com^vol-0ff989d77482eddbb],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0ff989d77482eddbb,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-1287^4,DevicePath:,},},Config:nil,},} Jan 24 12:35:25.301: INFO: Logging kubelet events for node ip-172-20-63-134.us-west-1.compute.internal Jan 24 12:35:25.363: INFO: Logging pods the kubelet thinks is on node ip-172-20-63-134.us-west-1.compute.internal Jan 24 12:35:25.431: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-b74rw started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:25.431: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:35:25.431: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-g7hv8 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:25.431: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:35:25.431: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-dwht5 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:25.431: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:35:25.431: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-gp5cx started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:25.431: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:35:25.431: INFO: ebs-csi-node-v75jm started at 2023-01-24 12:09:06 +0000 UTC (0+3 container statuses recorded) Jan 24 12:35:25.431: INFO: Container ebs-plugin ready: true, restart count 0 Jan 24 12:35:25.431: INFO: Container liveness-probe ready: true, restart count 0 Jan 24 12:35:25.431: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 24 12:35:25.431: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-vnplb started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:25.431: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:35:25.431: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-8wf5k started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:25.431: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:35:25.431: INFO: coredns-autoscaler-557ccb4c66-gl766 started at 2023-01-24 12:09:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:25.431: INFO: Container autoscaler ready: true, restart count 0 Jan 24 12:35:25.431: INFO: coredns-867df8f45c-wcswf started at 2023-01-24 12:09:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:25.431: INFO: Container coredns ready: true, restart count 0 Jan 24 12:35:25.431: INFO: ss-0 started at 2023-01-24 12:19:42 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:25.431: INFO: Container webserver ready: false, restart count 0 Jan 24 12:35:25.431: INFO: pvc-volume-tester-ctp62 started at 2023-01-24 12:30:56 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:25.431: INFO: Container volume-tester ready: false, restart count 0 Jan 24 12:35:25.431: INFO: csi-mockplugin-attacher-0 started at 2023-01-24 12:27:08 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:25.431: INFO: Container csi-attacher ready: true, restart count 0 Jan 24 12:35:25.431: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-gh2rw started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:25.431: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:35:25.431: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-bqvzk started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:25.431: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: false, restart count 0 Jan 24 12:35:25.431: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-9kzn4 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:25.431: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: false, restart count 0 Jan 24 12:35:25.431: INFO: cilium-mkm5g started at 2023-01-24 12:09:06 +0000 UTC (1+1 container statuses recorded) Jan 24 12:35:25.431: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 24 12:35:25.431: INFO: Container cilium-agent ready: true, restart count 0 Jan 24 12:35:25.431: INFO: netserver-2 started at 2023-01-24 12:30:26 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:25.431: INFO: Container webserver ready: false, restart count 0 Jan 24 12:35:25.431: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-x2c2b started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:25.431: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:35:25.431: INFO: csi-mockplugin-0 started at 2023-01-24 12:27:08 +0000 UTC (0+3 container statuses recorded) Jan 24 12:35:25.431: INFO: Container csi-provisioner ready: true, restart count 0 Jan 24 12:35:25.431: INFO: Container driver-registrar ready: true, restart count 0 Jan 24 12:35:25.431: INFO: Container mock ready: true, restart count 0 Jan 24 12:35:25.691: INFO: Latency metrics for node ip-172-20-63-134.us-west-1.compute.internal Jan 24 12:35:25.691: INFO: Logging node info for node ip-172-20-63-190.us-west-1.compute.internal Jan 24 12:35:25.752: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-63-190.us-west-1.compute.internal d80c92f0-6fa8-4333-b1ea-6b0b4cdbea2d 29083 0 2023-01-24 12:09:12 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-1 failure-domain.beta.kubernetes.io/zone:us-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-63-190.us-west-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-1a topology.hostpath.csi/node:ip-172-20-63-190.us-west-1.compute.internal topology.kubernetes.io/region:us-west-1 topology.kubernetes.io/zone:us-west-1a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0fd113285a9315bba"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2023-01-24 12:09:12 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-24 12:09:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-24 12:09:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-01-24 12:19:02 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-24 12:19:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {e2e.test Update v1 2023-01-24 12:19:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-1a/i-0fd113285a9315bba,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051652608 0} {<nil>} 3956692Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946795008 0} {<nil>} 3854292Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-24 12:34:02 +0000 UTC,LastTransitionTime:2023-01-24 12:09:12 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-24 12:34:02 +0000 UTC,LastTransitionTime:2023-01-24 12:09:12 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-24 12:34:02 +0000 UTC,LastTransitionTime:2023-01-24 12:09:12 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-24 12:34:02 +0000 UTC,LastTransitionTime:2023-01-24 12:09:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.63.190,},NodeAddress{Type:ExternalIP,Address:54.215.249.154,},NodeAddress{Type:Hostname,Address:ip-172-20-63-190.us-west-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-63-190.us-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-215-249-154.us-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec255708dba66ed160033f1fab58ba92,SystemUUID:ec255708-dba6-6ed1-6003-3f1fab58ba92,BootID:4e4cb7aa-a82e-4abd-a66d-5fb285cb6c0b,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.23.16,KubeProxyVersion:v1.23.16,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.16 registry.k8s.io/kube-proxy-amd64:v1.23.16],SizeBytes:112743991,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-057a1367ebd667fa7 kubernetes.io/csi/ebs.csi.aws.com^vol-0d966a9348a99e832],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0d966a9348a99e832,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-057a1367ebd667fa7,DevicePath:,},},Config:nil,},} Jan 24 12:35:25.753: INFO: Logging kubelet events for node ip-172-20-63-190.us-west-1.compute.internal Jan 24 12:35:25.816: INFO: Logging pods the kubelet thinks is on node ip-172-20-63-190.us-west-1.compute.internal Jan 24 12:35:25.886: INFO: indexed-job-2-rhrn5 started at 2023-01-24 12:25:46 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:25.886: INFO: Container c ready: false, restart count 0 Jan 24 12:35:25.886: INFO: ss-0 started at 2023-01-24 12:31:15 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:25.886: INFO: Container webserver ready: false, restart count 0 Jan 24 12:35:25.886: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-kzfz9 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:25.887: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:35:25.887: INFO: all-succeed-thg2m started at 2023-01-24 12:26:10 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:25.887: INFO: Container c ready: false, restart count 0 Jan 24 12:35:25.887: INFO: ebs-csi-node-ld8b2 started at 2023-01-24 12:09:13 +0000 UTC (0+3 container statuses recorded) Jan 24 12:35:25.887: INFO: Container ebs-plugin ready: true, restart count 0 Jan 24 12:35:25.887: INFO: Container liveness-probe ready: true, restart count 0 Jan 24 12:35:25.887: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 24 12:35:25.887: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-dhzcl started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:25.887: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:35:25.887: INFO: fail-once-local-nkjmd started at 2023-01-24 12:20:23 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:25.887: INFO: Container c ready: false, restart count 0 Jan 24 12:35:25.887: INFO: netserver-3 started at 2023-01-24 12:30:26 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:25.887: INFO: Container webserver ready: true, restart count 0 Jan 24 12:35:25.887: INFO: fail-once-local-4kxtz started at 2023-01-24 12:20:23 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:25.887: INFO: Container c ready: false, restart count 1 Jan 24 12:35:25.887: INFO: externalname-service-ww7rd started at 2023-01-24 12:31:38 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:25.887: INFO: Container externalname-service ready: false, restart count 0 Jan 24 12:35:25.887: INFO: pod-0 started at 2023-01-24 12:31:02 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:25.887: INFO: Container donothing ready: false, restart count 0 Jan 24 12:35:25.887: INFO: pfpod started at 2023-01-24 12:30:48 +0000 UTC (0+2 container statuses recorded) Jan 24 12:35:25.887: INFO: Container portforwardtester ready: false, restart count 0 Jan 24 12:35:25.887: INFO: Container readiness ready: false, restart count 0 Jan 24 12:35:25.887: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-5rrg5 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:25.887: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:35:25.887: INFO: hostexec-ip-172-20-63-190.us-west-1.compute.internal-v8vmk started at 2023-01-24 12:30:00 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:25.887: INFO: Container agnhost-container ready: true, restart count 0 Jan 24 12:35:25.887: INFO: cilium-54xb4 started at 2023-01-24 12:09:13 +0000 UTC (1+1 container statuses recorded) Jan 24 12:35:25.887: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 24 12:35:25.887: INFO: Container cilium-agent ready: true, restart count 0 Jan 24 12:35:25.887: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-s27h5 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:25.887: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:35:25.887: INFO: csi-hostpathplugin-0 started at 2023-01-24 12:30:49 +0000 UTC (0+7 container statuses recorded) Jan 24 12:35:25.887: INFO: Container csi-attacher ready: false, restart count 0 Jan 24 12:35:25.887: INFO: Container csi-provisioner ready: false, restart count 0 Jan 24 12:35:25.887: INFO: Container csi-resizer ready: false, restart count 0 Jan 24 12:35:25.887: INFO: Container csi-snapshotter ready: false, restart count 0 Jan 24 12:35:25.887: INFO: Container hostpath ready: false, restart count 0 Jan 24 12:35:25.887: INFO: Container liveness-probe ready: false, restart count 0 Jan 24 12:35:25.887: INFO: Container node-driver-registrar ready: false, restart count 0 Jan 24 12:35:25.887: INFO: fail-once-local-t84jj started at 2023-01-24 12:20:44 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:25.887: INFO: Container c ready: false, restart count 0 Jan 24 12:35:25.887: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-8ztk4 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:25.887: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:35:25.887: INFO: csi-hostpathplugin-0 started at 2023-01-24 12:34:23 +0000 UTC (0+7 container statuses recorded) Jan 24 12:35:25.887: INFO: Container csi-attacher ready: false, restart count 0 Jan 24 12:35:25.887: INFO: Container csi-provisioner ready: false, restart count 0 Jan 24 12:35:25.887: INFO: Container csi-resizer ready: false, restart count 0 Jan 24 12:35:25.887: INFO: Container csi-snapshotter ready: false, restart count 0 Jan 24 12:35:25.887: INFO: Container hostpath ready: false, restart count 0 Jan 24 12:35:25.887: INFO: Container liveness-probe ready: false, restart count 0 Jan 24 12:35:25.887: INFO: Container node-driver-registrar ready: false, restart count 0 Jan 24 12:35:25.887: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-tzgzx started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:25.887: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:35:25.887: INFO: pod-projected-secrets-aa670a7f-62bb-4497-ac7e-1fe0a09627bc started at 2023-01-24 12:35:00 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:25.887: INFO: Container projected-secret-volume-test ready: false, restart count 0 Jan 24 12:35:25.887: INFO: ss-2 started at 2023-01-24 12:25:59 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:25.887: INFO: Container webserver ready: false, restart count 0 Jan 24 12:35:25.887: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-9pdvd started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:25.887: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:35:25.887: INFO: all-succeed-gmhmc started at 2023-01-24 12:26:10 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:25.887: INFO: Container c ready: false, restart count 0 Jan 24 12:35:25.887: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-bcqr7 started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:25.887: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:35:25.887: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-vqntn started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:25.887: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:35:25.887: INFO: cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9-4jptx started at 2023-01-24 12:19:25 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:25.887: INFO: Container cleanup40-74ef8852-4f3e-4579-bd53-35e4a225bcb9 ready: true, restart count 0 Jan 24 12:35:25.887: INFO: test-ss-0 started at 2023-01-24 12:32:18 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:25.887: INFO: Container webserver ready: false, restart count 0 Jan 24 12:35:25.887: INFO: indexed-job-0-q2xds started at 2023-01-24 12:21:23 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:25.887: INFO: Container c ready: false, restart count 0 Jan 24 12:35:25.887: INFO: pod-host-path-test started at 2023-01-24 12:34:32 +0000 UTC (0+2 container statuses recorded) Jan 24 12:35:25.887: INFO: Container test-container-1 ready: false, restart count 0 Jan 24 12:35:25.887: INFO: Container test-container-2 ready: false, restart count 0 Jan 24 12:35:25.887: INFO: ss-1 started at 2023-01-24 12:19:17 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:25.887: INFO: Container webserver ready: false, restart count 0 Jan 24 12:35:25.887: INFO: sample-webhook-deployment-6c69dbd86b-blpbb started at 2023-01-24 12:31:39 +0000 UTC (0+1 container statuses recorded) Jan 24 12:35:25.887: INFO: Container sample-webhook ready: false, restart count 0 Jan 24 12:35:26.150: INFO: Latency metrics for node ip-172-20-63-190.us-west-1.compute.internal Jan 24 12:35:26.150: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "job-3599" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-apps\]\sStatefulSet\sBasic\sStatefulSet\sfunctionality\s\[StatefulSetBasic\]\sshould\snot\sdeadlock\swhen\sa\spod\'s\spredecessor\sfails$'
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/statefulset.go:254 Jan 24 12:29:42.430: Failed waiting for pods to enter running: timed out waiting for the condition /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/statefulset.go:279
[BeforeEach] [sig-apps] StatefulSet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Jan 24 12:18:40.517: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename statefulset �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace [BeforeEach] [sig-apps] StatefulSet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/statefulset.go:94 [BeforeEach] Basic StatefulSet functionality [StatefulSetBasic] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/statefulset.go:109 �[1mSTEP�[0m: Creating service test in namespace statefulset-2720 [It] should not deadlock when a pod's predecessor fails /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/statefulset.go:254 �[1mSTEP�[0m: Creating statefulset ss in namespace statefulset-2720 Jan 24 12:18:41.053: INFO: Default storage class: "kops-csi-1-21" Jan 24 12:18:41.176: INFO: Waiting for pod ss-0 to enter Running - Ready=false, currently Pending - Ready=false Jan 24 12:18:51.236: INFO: Waiting for pod ss-0 to enter Running - Ready=false, currently Pending - Ready=false Jan 24 12:19:01.236: INFO: Waiting for pod ss-0 to enter Running - Ready=false, currently Pending - Ready=false Jan 24 12:19:11.237: INFO: Waiting for pod ss-0 to enter Running - Ready=false, currently Running - Ready=false �[1mSTEP�[0m: Resuming stateful pod at index 0. Jan 24 12:19:11.299: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/041ac993-9bdf-11ed-b10d-8a774b882db2/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2204-k23-ko26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=statefulset-2720 exec ss-0 -- /bin/sh -x -c dd if=/dev/zero of=/data/statefulset-continue bs=1 count=1 conv=fsync' Jan 24 12:19:12.043: INFO: stderr: "+ dd 'if=/dev/zero' 'of=/data/statefulset-continue' 'bs=1' 'count=1' 'conv=fsync'\n1+0 records in\n1+0 records out\n" Jan 24 12:19:12.043: INFO: stdout: "" Jan 24 12:19:12.043: INFO: Resumed pod ss-0 �[1mSTEP�[0m: Waiting for stateful pod at index 1 to enter running. Jan 24 12:19:12.103: INFO: Found 1 stateful pods, waiting for 2 Jan 24 12:19:22.168: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Running - Ready=true Jan 24 12:19:22.168: INFO: Waiting for pod ss-1 to enter Running - Ready=false, currently Pending - Ready=false Jan 24 12:19:32.162: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Running - Ready=true Jan 24 12:19:32.162: INFO: Waiting for pod ss-1 to enter Running - Ready=false, currently Pending - Ready=false Jan 24 12:19:42.163: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Running - Ready=true Jan 24 12:19:42.163: INFO: Waiting for pod ss-1 to enter Running - Ready=false, currently Running - Ready=false �[1mSTEP�[0m: Deleting healthy stateful pod at index 0. �[1mSTEP�[0m: Confirming stateful pod at index 0 is recreated. Jan 24 12:19:42.309: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:19:52.369: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:20:02.371: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:20:12.376: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:20:22.371: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:20:32.369: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:20:42.369: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:20:52.369: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:21:02.371: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:21:12.369: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:21:22.369: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:21:32.371: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:21:42.369: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:21:52.371: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:22:02.370: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:22:12.371: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:22:22.369: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:22:32.369: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:22:42.369: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:22:52.370: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:23:02.371: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:23:12.369: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:23:22.369: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:23:32.371: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:23:42.369: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:23:52.369: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:24:02.370: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:24:12.370: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:24:22.371: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:24:32.369: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:24:42.369: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:24:52.369: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:25:02.371: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:25:12.371: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:25:22.370: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:25:32.369: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:25:42.379: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:25:52.370: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:26:02.369: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:26:12.370: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:26:22.370: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:26:32.369: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:26:42.370: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:26:52.370: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:27:02.369: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:27:12.372: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:27:22.369: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:27:32.369: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:27:42.370: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:27:52.369: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:28:02.370: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:28:12.370: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:28:22.369: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:28:32.372: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:28:42.369: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:28:52.369: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:29:02.369: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:29:12.370: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:29:22.369: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:29:32.369: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:29:42.371: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:29:42.430: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Jan 24 12:29:42.430: FAIL: Failed waiting for pods to enter running: timed out waiting for the condition Full Stack Trace k8s.io/kubernetes/test/e2e/apps.glob..func9.2.5() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/statefulset.go:279 +0x2a5 k8s.io/kubernetes/test/e2e.RunE2ETests(0x24eec17?) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:133 +0x6b7 k8s.io/kubernetes/test/e2e.TestE2E(0x24602d9?) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc0008fa820, 0x72ecb90) /usr/local/go/src/testing/testing.go:1446 +0x10b created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1493 +0x35f [AfterEach] Basic StatefulSet functionality [StatefulSetBasic] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/statefulset.go:120 Jan 24 12:29:42.490: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/041ac993-9bdf-11ed-b10d-8a774b882db2/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2204-k23-ko26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=statefulset-2720 describe po ss-0' Jan 24 12:29:42.893: INFO: stderr: "" Jan 24 12:29:42.893: INFO: stdout: "Name: ss-0\nNamespace: statefulset-2720\nPriority: 0\nNode: ip-172-20-63-134.us-west-1.compute.internal/172.20.63.134\nStart Time: Tue, 24 Jan 2023 12:19:42 +0000\nLabels: baz=blah\n controller-revision-hash=ss-6bf6f6649c\n foo=bar\n statefulset.kubernetes.io/pod-name=ss-0\nAnnotations: <none>\nStatus: Pending\nIP: \nIPs: <none>\nControlled By: StatefulSet/ss\nContainers:\n webserver:\n Container ID: \n Image: k8s.gcr.io/e2e-test-images/httpd:2.4.38-2\n Image ID: \n Port: <none>\n Host Port: <none>\n State: Waiting\n Reason: ContainerCreating\n Ready: False\n Restart Count: 0\n Readiness: exec [test -f /data/statefulset-continue] delay=0s timeout=1s period=1s #success=1 #failure=1\n Environment: <none>\n Mounts:\n /data/ from datadir (rw)\n /home from home (rw)\n /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-8fp4v (ro)\nConditions:\n Type Status\n Initialized True \n Ready False \n ContainersReady False \n PodScheduled True \nVolumes:\n datadir:\n Type: PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace)\n ClaimName: datadir-ss-0\n ReadOnly: false\n home:\n Type: HostPath (bare host directory volume)\n Path: /tmp/home\n HostPathType: \n kube-api-access-8fp4v:\n Type: Projected (a volume that contains injected data from multiple sources)\n TokenExpirationSeconds: 3607\n ConfigMapName: kube-root-ca.crt\n ConfigMapOptional: <nil>\n DownwardAPI: true\nQoS Class: BestEffort\nNode-Selectors: <none>\nTolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s\n node.kubernetes.io/unreachable:NoExecute op=Exists for 300s\nEvents:\n Type Reason Age From Message\n ---- ------ ---- ---- -------\n Warning FailedAttachVolume 10m attachdetach-controller Multi-Attach error for volume \"pvc-a16d9416-0019-4536-afe4-532fbc1c4196\" Volume is already exclusively attached to one node and can't be attached to another\n Normal Scheduled 10m default-scheduler Successfully assigned statefulset-2720/ss-0 to ip-172-20-63-134.us-west-1.compute.internal\n Normal SuccessfulAttachVolume 9m47s attachdetach-controller AttachVolume.Attach succeeded for volume \"pvc-a16d9416-0019-4536-afe4-532fbc1c4196\"\n Warning FailedCreatePodSandBox 9m46s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"deede9b3c24ef105eacff54d880bf5610ca7ec2a32bffc63b3d7e453442a114a\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available\n Warning FailedCreatePodSandBox 9m31s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"f40427249f0c36cbd2e4e2df1ece17e86dfe51960207698a7c55c1c898ee38d8\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available\n Warning FailedCreatePodSandBox 9m17s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"86317841962e384c7ff2a3732192cc44e886c3e1cba6c5c2bbab04aeeee1eea6\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available\n Warning FailedCreatePodSandBox 9m2s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"1124206a368c9c20ec8a6c9cb5ec6eaf79f519e93e16d5e87d7d04ee72fda259\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available\n Warning FailedCreatePodSandBox 8m51s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"105bdf7282d292c70c7bb694355feaf9d69133ad116ef552894c7c5d42d84ac7\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available\n Warning FailedCreatePodSandBox 8m40s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"b56f61bf8943dc129dc5c1a213785747ee1b402cd5c742ad7ed01f01773f537d\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available\n Warning FailedCreatePodSandBox 8m29s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"5769a31097a1b272c9f8b7c6b4cf56b39531eff49f6ae7dc59090f70953432a0\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available\n Warning FailedCreatePodSandBox 8m16s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"bb98eab22eaf870f7fff73227b29c5a735c38fd244b6002d42d21601493ee4ac\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available\n Warning FailedCreatePodSandBox 8m5s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"86db23be217b2689f6aa773079865f0ffb35c525e17e45a341f8543bdafeea93\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available\n Warning FailedCreatePodSandBox 4m12s (x17 over 7m51s) kubelet (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"a80d52f4ccbb096d2278284d2870779f024bef0c2b672c23e4d1a14d7c019ba1\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available\n" Jan 24 12:29:42.894: INFO: Output of kubectl describe ss-0: Name: ss-0 Namespace: statefulset-2720 Priority: 0 Node: ip-172-20-63-134.us-west-1.compute.internal/172.20.63.134 Start Time: Tue, 24 Jan 2023 12:19:42 +0000 Labels: baz=blah controller-revision-hash=ss-6bf6f6649c foo=bar statefulset.kubernetes.io/pod-name=ss-0 Annotations: <none> Status: Pending IP: IPs: <none> Controlled By: StatefulSet/ss Containers: webserver: Container ID: Image: k8s.gcr.io/e2e-test-images/httpd:2.4.38-2 Image ID: Port: <none> Host Port: <none> State: Waiting Reason: ContainerCreating Ready: False Restart Count: 0 Readiness: exec [test -f /data/statefulset-continue] delay=0s timeout=1s period=1s #success=1 #failure=1 Environment: <none> Mounts: /data/ from datadir (rw) /home from home (rw) /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-8fp4v (ro) Conditions: Type Status Initialized True Ready False ContainersReady False PodScheduled True Volumes: datadir: Type: PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace) ClaimName: datadir-ss-0 ReadOnly: false home: Type: HostPath (bare host directory volume) Path: /tmp/home HostPathType: kube-api-access-8fp4v: Type: Projected (a volume that contains injected data from multiple sources) TokenExpirationSeconds: 3607 ConfigMapName: kube-root-ca.crt ConfigMapOptional: <nil> DownwardAPI: true QoS Class: BestEffort Node-Selectors: <none> Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s node.kubernetes.io/unreachable:NoExecute op=Exists for 300s Events: Type Reason Age From Message ---- ------ ---- ---- ------- Warning FailedAttachVolume 10m attachdetach-controller Multi-Attach error for volume "pvc-a16d9416-0019-4536-afe4-532fbc1c4196" Volume is already exclusively attached to one node and can't be attached to another Normal Scheduled 10m default-scheduler Successfully assigned statefulset-2720/ss-0 to ip-172-20-63-134.us-west-1.compute.internal Normal SuccessfulAttachVolume 9m47s attachdetach-controller AttachVolume.Attach succeeded for volume "pvc-a16d9416-0019-4536-afe4-532fbc1c4196" Warning FailedCreatePodSandBox 9m46s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "deede9b3c24ef105eacff54d880bf5610ca7ec2a32bffc63b3d7e453442a114a": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Warning FailedCreatePodSandBox 9m31s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "f40427249f0c36cbd2e4e2df1ece17e86dfe51960207698a7c55c1c898ee38d8": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Warning FailedCreatePodSandBox 9m17s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "86317841962e384c7ff2a3732192cc44e886c3e1cba6c5c2bbab04aeeee1eea6": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Warning FailedCreatePodSandBox 9m2s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "1124206a368c9c20ec8a6c9cb5ec6eaf79f519e93e16d5e87d7d04ee72fda259": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Warning FailedCreatePodSandBox 8m51s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "105bdf7282d292c70c7bb694355feaf9d69133ad116ef552894c7c5d42d84ac7": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Warning FailedCreatePodSandBox 8m40s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b56f61bf8943dc129dc5c1a213785747ee1b402cd5c742ad7ed01f01773f537d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Warning FailedCreatePodSandBox 8m29s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "5769a31097a1b272c9f8b7c6b4cf56b39531eff49f6ae7dc59090f70953432a0": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Warning FailedCreatePodSandBox 8m16s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "bb98eab22eaf870f7fff73227b29c5a735c38fd244b6002d42d21601493ee4ac": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Warning FailedCreatePodSandBox 8m5s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "86db23be217b2689f6aa773079865f0ffb35c525e17e45a341f8543bdafeea93": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Warning FailedCreatePodSandBox 4m12s (x17 over 7m51s) kubelet (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a80d52f4ccbb096d2278284d2870779f024bef0c2b672c23e4d1a14d7c019ba1": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:29:42.894: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/041ac993-9bdf-11ed-b10d-8a774b882db2/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2204-k23-ko26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=statefulset-2720 logs ss-0 --tail=100' Jan 24 12:29:43.230: INFO: rc: 1 Jan 24 12:29:43.230: INFO: Last 100 log lines of ss-0: Jan 24 12:29:43.230: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/041ac993-9bdf-11ed-b10d-8a774b882db2/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2204-k23-ko26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=statefulset-2720 describe po ss-1' Jan 24 12:29:43.610: INFO: stderr: "" Jan 24 12:29:43.610: INFO: stdout: "Name: ss-1\nNamespace: statefulset-2720\nPriority: 0\nNode: ip-172-20-63-190.us-west-1.compute.internal/172.20.63.190\nStart Time: Tue, 24 Jan 2023 12:19:17 +0000\nLabels: baz=blah\n controller-revision-hash=ss-6bf6f6649c\n foo=bar\n statefulset.kubernetes.io/pod-name=ss-1\nAnnotations: <none>\nStatus: Running\nIP: 172.20.39.49\nIPs:\n IP: 172.20.39.49\nControlled By: StatefulSet/ss\nContainers:\n webserver:\n Container ID: containerd://3a04e058561335beff9b67966a9fdd050c177db907c1f3edd261a11ed22212b4\n Image: k8s.gcr.io/e2e-test-images/httpd:2.4.38-2\n Image ID: k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3\n Port: <none>\n Host Port: <none>\n State: Running\n Started: Tue, 24 Jan 2023 12:19:32 +0000\n Ready: False\n Restart Count: 0\n Readiness: exec [test -f /data/statefulset-continue] delay=0s timeout=1s period=1s #success=1 #failure=1\n Environment: <none>\n Mounts:\n /data/ from datadir (rw)\n /home from home (rw)\n /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-gfrxc (ro)\nConditions:\n Type Status\n Initialized True \n Ready False \n ContainersReady False \n PodScheduled True \nVolumes:\n datadir:\n Type: PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace)\n ClaimName: datadir-ss-1\n ReadOnly: false\n home:\n Type: HostPath (bare host directory volume)\n Path: /tmp/home\n HostPathType: \n kube-api-access-gfrxc:\n Type: Projected (a volume that contains injected data from multiple sources)\n TokenExpirationSeconds: 3607\n ConfigMapName: kube-root-ca.crt\n ConfigMapOptional: <nil>\n DownwardAPI: true\nQoS Class: BestEffort\nNode-Selectors: <none>\nTolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s\n node.kubernetes.io/unreachable:NoExecute op=Exists for 300s\nEvents:\n Type Reason Age From Message\n ---- ------ ---- ---- -------\n Normal Scheduled 10m default-scheduler Successfully assigned statefulset-2720/ss-1 to ip-172-20-63-190.us-west-1.compute.internal\n Normal SuccessfulAttachVolume 10m attachdetach-controller AttachVolume.Attach succeeded for volume \"pvc-26782be4-4541-48f0-8d25-17a3b1a680bd\"\n Normal Pulled 10m kubelet Container image \"k8s.gcr.io/e2e-test-images/httpd:2.4.38-2\" already present on machine\n Normal Created 10m kubelet Created container webserver\n Normal Started 10m kubelet Started container webserver\n Warning Unhealthy 11s (x611 over 10m) kubelet Readiness probe failed:\n" Jan 24 12:29:43.610: INFO: Output of kubectl describe ss-1: Name: ss-1 Namespace: statefulset-2720 Priority: 0 Node: ip-172-20-63-190.us-west-1.compute.internal/172.20.63.190 Start Time: Tue, 24 Jan 2023 12:19:17 +0000 Labels: baz=blah controller-revision-hash=ss-6bf6f6649c foo=bar statefulset.kubernetes.io/pod-name=ss-1 Annotations: <none> Status: Running IP: 172.20.39.49 IPs: IP: 172.20.39.49 Controlled By: StatefulSet/ss Containers: webserver: Container ID: containerd://3a04e058561335beff9b67966a9fdd050c177db907c1f3edd261a11ed22212b4 Image: k8s.gcr.io/e2e-test-images/httpd:2.4.38-2 Image ID: k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 Port: <none> Host Port: <none> State: Running Started: Tue, 24 Jan 2023 12:19:32 +0000 Ready: False Restart Count: 0 Readiness: exec [test -f /data/statefulset-continue] delay=0s timeout=1s period=1s #success=1 #failure=1 Environment: <none> Mounts: /data/ from datadir (rw) /home from home (rw) /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-gfrxc (ro) Conditions: Type Status Initialized True Ready False ContainersReady False PodScheduled True Volumes: datadir: Type: PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace) ClaimName: datadir-ss-1 ReadOnly: false home: Type: HostPath (bare host directory volume) Path: /tmp/home HostPathType: kube-api-access-gfrxc: Type: Projected (a volume that contains injected data from multiple sources) TokenExpirationSeconds: 3607 ConfigMapName: kube-root-ca.crt ConfigMapOptional: <nil> DownwardAPI: true QoS Class: BestEffort Node-Selectors: <none> Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s node.kubernetes.io/unreachable:NoExecute op=Exists for 300s Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal Scheduled 10m default-scheduler Successfully assigned statefulset-2720/ss-1 to ip-172-20-63-190.us-west-1.compute.internal Normal SuccessfulAttachVolume 10m attachdetach-controller AttachVolume.Attach succeeded for volume "pvc-26782be4-4541-48f0-8d25-17a3b1a680bd" Normal Pulled 10m kubelet Container image "k8s.gcr.io/e2e-test-images/httpd:2.4.38-2" already present on machine Normal Created 10m kubelet Created container webserver Normal Started 10m kubelet Started container webserver Warning Unhealthy 11s (x611 over 10m) kubelet Readiness probe failed: Jan 24 12:29:43.610: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/041ac993-9bdf-11ed-b10d-8a774b882db2/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2204-k23-ko26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=statefulset-2720 logs ss-1 --tail=100' Jan 24 12:29:43.926: INFO: stderr: "" Jan 24 12:29:43.926: INFO: stdout: "[Tue Jan 24 12:19:32.054967 2023] [mpm_event:notice] [pid 1:tid 139728090962792] AH00489: Apache/2.4.38 (Unix) configured -- resuming normal operations\n[Tue Jan 24 12:19:32.055246 2023] [core:notice] [pid 1:tid 139728090962792] AH00094: Command line: 'httpd -D FOREGROUND'\n" Jan 24 12:29:43.926: INFO: Last 100 log lines of ss-1: [Tue Jan 24 12:19:32.054967 2023] [mpm_event:notice] [pid 1:tid 139728090962792] AH00489: Apache/2.4.38 (Unix) configured -- resuming normal operations [Tue Jan 24 12:19:32.055246 2023] [core:notice] [pid 1:tid 139728090962792] AH00094: Command line: 'httpd -D FOREGROUND' Jan 24 12:29:43.926: INFO: Deleting all statefulset in ns statefulset-2720 Jan 24 12:29:43.985: INFO: Scaling statefulset ss to 0 Jan 24 12:36:24.227: INFO: Waiting for statefulset status.replicas updated to 0 Jan 24 12:36:24.287: INFO: Deleting statefulset ss Jan 24 12:36:24.408: INFO: Deleting pvc: datadir-ss-0 with volume pvc-a16d9416-0019-4536-afe4-532fbc1c4196 Jan 24 12:36:24.469: INFO: Deleting pvc: datadir-ss-1 with volume pvc-26782be4-4541-48f0-8d25-17a3b1a680bd Jan 24 12:36:24.592: INFO: Still waiting for pvs of statefulset to disappear: pvc-26782be4-4541-48f0-8d25-17a3b1a680bd: {Phase:Released Message: Reason:} pvc-a16d9416-0019-4536-afe4-532fbc1c4196: {Phase:Released Message: Reason:} Jan 24 12:36:34.652: INFO: Still waiting for pvs of statefulset to disappear: pvc-a16d9416-0019-4536-afe4-532fbc1c4196: {Phase:Released Message: Reason:} [AfterEach] [sig-apps] StatefulSet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "statefulset-2720". �[1mSTEP�[0m: Found 40 events. Jan 24 12:36:44.711: INFO: At 2023-01-24 12:18:41 +0000 UTC - event for datadir-ss-0: {ebs.csi.aws.com_ip-172-20-42-201_746df1a9-d9c8-443b-9c11-e00bf4e14a5c } Provisioning: External provisioner is provisioning volume for claim "statefulset-2720/datadir-ss-0" Jan 24 12:36:44.711: INFO: At 2023-01-24 12:18:41 +0000 UTC - event for datadir-ss-0: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "ebs.csi.aws.com" or manually created by system administrator Jan 24 12:36:44.711: INFO: At 2023-01-24 12:18:41 +0000 UTC - event for datadir-ss-0: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding Jan 24 12:36:44.711: INFO: At 2023-01-24 12:18:41 +0000 UTC - event for ss: {statefulset-controller } SuccessfulCreate: create Claim datadir-ss-0 Pod ss-0 in StatefulSet ss success Jan 24 12:36:44.711: INFO: At 2023-01-24 12:18:41 +0000 UTC - event for ss: {statefulset-controller } SuccessfulCreate: create Pod ss-0 in StatefulSet ss successful Jan 24 12:36:44.711: INFO: At 2023-01-24 12:18:44 +0000 UTC - event for datadir-ss-0: {ebs.csi.aws.com_ip-172-20-42-201_746df1a9-d9c8-443b-9c11-e00bf4e14a5c } ProvisioningSucceeded: Successfully provisioned volume pvc-a16d9416-0019-4536-afe4-532fbc1c4196 Jan 24 12:36:44.711: INFO: At 2023-01-24 12:18:45 +0000 UTC - event for ss-0: {default-scheduler } Scheduled: Successfully assigned statefulset-2720/ss-0 to ip-172-20-62-42.us-west-1.compute.internal Jan 24 12:36:44.711: INFO: At 2023-01-24 12:18:47 +0000 UTC - event for ss-0: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-a16d9416-0019-4536-afe4-532fbc1c4196" Jan 24 12:36:44.711: INFO: At 2023-01-24 12:18:58 +0000 UTC - event for ss-0: {kubelet ip-172-20-62-42.us-west-1.compute.internal} Started: Started container webserver Jan 24 12:36:44.711: INFO: At 2023-01-24 12:18:58 +0000 UTC - event for ss-0: {kubelet ip-172-20-62-42.us-west-1.compute.internal} Pulled: Container image "k8s.gcr.io/e2e-test-images/httpd:2.4.38-2" already present on machine Jan 24 12:36:44.711: INFO: At 2023-01-24 12:18:58 +0000 UTC - event for ss-0: {kubelet ip-172-20-62-42.us-west-1.compute.internal} Created: Created container webserver Jan 24 12:36:44.712: INFO: At 2023-01-24 12:18:59 +0000 UTC - event for ss-0: {kubelet ip-172-20-62-42.us-west-1.compute.internal} Unhealthy: Readiness probe failed: Jan 24 12:36:44.712: INFO: At 2023-01-24 12:19:13 +0000 UTC - event for datadir-ss-1: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "ebs.csi.aws.com" or manually created by system administrator Jan 24 12:36:44.712: INFO: At 2023-01-24 12:19:13 +0000 UTC - event for datadir-ss-1: {ebs.csi.aws.com_ip-172-20-42-201_746df1a9-d9c8-443b-9c11-e00bf4e14a5c } Provisioning: External provisioner is provisioning volume for claim "statefulset-2720/datadir-ss-1" Jan 24 12:36:44.712: INFO: At 2023-01-24 12:19:13 +0000 UTC - event for datadir-ss-1: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding Jan 24 12:36:44.712: INFO: At 2023-01-24 12:19:13 +0000 UTC - event for ss: {statefulset-controller } SuccessfulCreate: create Pod ss-1 in StatefulSet ss successful Jan 24 12:36:44.712: INFO: At 2023-01-24 12:19:13 +0000 UTC - event for ss: {statefulset-controller } SuccessfulCreate: create Claim datadir-ss-1 Pod ss-1 in StatefulSet ss success Jan 24 12:36:44.712: INFO: At 2023-01-24 12:19:17 +0000 UTC - event for datadir-ss-1: {ebs.csi.aws.com_ip-172-20-42-201_746df1a9-d9c8-443b-9c11-e00bf4e14a5c } ProvisioningSucceeded: Successfully provisioned volume pvc-26782be4-4541-48f0-8d25-17a3b1a680bd Jan 24 12:36:44.712: INFO: At 2023-01-24 12:19:17 +0000 UTC - event for ss-1: {default-scheduler } Scheduled: Successfully assigned statefulset-2720/ss-1 to ip-172-20-63-190.us-west-1.compute.internal Jan 24 12:36:44.712: INFO: At 2023-01-24 12:19:20 +0000 UTC - event for ss-1: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-26782be4-4541-48f0-8d25-17a3b1a680bd" Jan 24 12:36:44.712: INFO: At 2023-01-24 12:19:31 +0000 UTC - event for ss-1: {kubelet ip-172-20-63-190.us-west-1.compute.internal} Pulled: Container image "k8s.gcr.io/e2e-test-images/httpd:2.4.38-2" already present on machine Jan 24 12:36:44.712: INFO: At 2023-01-24 12:19:31 +0000 UTC - event for ss-1: {kubelet ip-172-20-63-190.us-west-1.compute.internal} Created: Created container webserver Jan 24 12:36:44.712: INFO: At 2023-01-24 12:19:32 +0000 UTC - event for ss-1: {kubelet ip-172-20-63-190.us-west-1.compute.internal} Unhealthy: Readiness probe failed: Jan 24 12:36:44.712: INFO: At 2023-01-24 12:19:32 +0000 UTC - event for ss-1: {kubelet ip-172-20-63-190.us-west-1.compute.internal} Started: Started container webserver Jan 24 12:36:44.712: INFO: At 2023-01-24 12:19:42 +0000 UTC - event for ss-0: {kubelet ip-172-20-62-42.us-west-1.compute.internal} Killing: Stopping container webserver Jan 24 12:36:44.712: INFO: At 2023-01-24 12:19:42 +0000 UTC - event for ss-0: {attachdetach-controller } FailedAttachVolume: Multi-Attach error for volume "pvc-a16d9416-0019-4536-afe4-532fbc1c4196" Volume is already exclusively attached to one node and can't be attached to another Jan 24 12:36:44.712: INFO: At 2023-01-24 12:19:42 +0000 UTC - event for ss-0: {default-scheduler } Scheduled: Successfully assigned statefulset-2720/ss-0 to ip-172-20-63-134.us-west-1.compute.internal Jan 24 12:36:44.712: INFO: At 2023-01-24 12:19:55 +0000 UTC - event for ss-0: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-a16d9416-0019-4536-afe4-532fbc1c4196" Jan 24 12:36:44.712: INFO: At 2023-01-24 12:19:56 +0000 UTC - event for ss-0: {kubelet ip-172-20-63-134.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "deede9b3c24ef105eacff54d880bf5610ca7ec2a32bffc63b3d7e453442a114a": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:36:44.712: INFO: At 2023-01-24 12:20:11 +0000 UTC - event for ss-0: {kubelet ip-172-20-63-134.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "f40427249f0c36cbd2e4e2df1ece17e86dfe51960207698a7c55c1c898ee38d8": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:36:44.712: INFO: At 2023-01-24 12:20:25 +0000 UTC - event for ss-0: {kubelet ip-172-20-63-134.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "86317841962e384c7ff2a3732192cc44e886c3e1cba6c5c2bbab04aeeee1eea6": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:36:44.712: INFO: At 2023-01-24 12:20:40 +0000 UTC - event for ss-0: {kubelet ip-172-20-63-134.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "1124206a368c9c20ec8a6c9cb5ec6eaf79f519e93e16d5e87d7d04ee72fda259": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:36:44.712: INFO: At 2023-01-24 12:20:51 +0000 UTC - event for ss-0: {kubelet ip-172-20-63-134.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "105bdf7282d292c70c7bb694355feaf9d69133ad116ef552894c7c5d42d84ac7": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:36:44.712: INFO: At 2023-01-24 12:21:02 +0000 UTC - event for ss-0: {kubelet ip-172-20-63-134.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b56f61bf8943dc129dc5c1a213785747ee1b402cd5c742ad7ed01f01773f537d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:36:44.712: INFO: At 2023-01-24 12:21:13 +0000 UTC - event for ss-0: {kubelet ip-172-20-63-134.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "5769a31097a1b272c9f8b7c6b4cf56b39531eff49f6ae7dc59090f70953432a0": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:36:44.712: INFO: At 2023-01-24 12:21:26 +0000 UTC - event for ss-0: {kubelet ip-172-20-63-134.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "bb98eab22eaf870f7fff73227b29c5a735c38fd244b6002d42d21601493ee4ac": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:36:44.712: INFO: At 2023-01-24 12:21:37 +0000 UTC - event for ss-0: {kubelet ip-172-20-63-134.us-west-1.compute.internal} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "86db23be217b2689f6aa773079865f0ffb35c525e17e45a341f8543bdafeea93": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:36:44.712: INFO: At 2023-01-24 12:21:51 +0000 UTC - event for ss-0: {kubelet ip-172-20-63-134.us-west-1.compute.internal} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "71e7a57f5f6d408a837f6e33b49e6f822b5d54613f4c059104699d1c7a42c829": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 24 12:36:44.712: INFO: At 2023-01-24 12:36:06 +0000 UTC - event for ss: {statefulset-controller } SuccessfulDelete: delete Pod ss-1 in StatefulSet ss successful Jan 24 12:36:44.712: INFO: At 2023-01-24 12:36:19 +0000 UTC - event for ss: {statefulset-controller } SuccessfulDelete: delete Pod ss-0 in StatefulSet ss successful Jan 24 12:36:44.779: INFO: POD NODE PHASE GRACE CONDITIONS Jan 24 12:36:44.779: INFO: Jan 24 12:36:44.846: INFO: Logging node info for node ip-172-20-42-201.us-west-1.compute.internal Jan 24 12:36:44.906: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-42-201.us-west-1.compute.internal cc6006a6-61fd-4f4c-b296-ba72367bb0f8 29735 0 2023-01-24 12:07:14 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-1 failure-domain.beta.kubernetes.io/zone:us-west-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-42-201.us-west-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/control-plane: node-role.kubernetes.io/master: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:us-west-1a topology.kubernetes.io/region:us-west-1 topology.kubernetes.io/zone:us-west-1a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-08c27beef2082266b"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-24 12:07:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {protokube Update v1 2023-01-24 12:07:41 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kops-controller Update v1 2023-01-24 12:07:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/master":{}}}} } {kube-controller-manager Update v1 2023-01-24 12:07:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-24 12:09:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-1a/i-08c27beef2082266b,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892264960 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787407360 0} {<nil&