e2e-kops-aws-upgrade-kstable-kolatest-to-klatest-kolatest #1640035836554645504
Recent runs || View in Spyglass
Recent runs || View in Spyglass
| Result | FAILURE |
| Tests | 269 failed / 648 succeeded |
| Started | |
| Elapsed | 1h1m |
| Revision | master |
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\sExternal\sStorage\s\[Driver\:\sebs\.csi\.aws\.com\]\s\[Testpattern\:\sDynamic\sPV\s\(default\sfs\)\]\ssubPath\sshould\ssupport\sexisting\sdirectories\swhen\sreadOnly\sspecified\sin\sthe\svolumeSource$'
[FAILED] failed to get logs from pod-subpath-test-dynamicpv-nkd7 for test-container-subpath-dynamicpv-nkd7: Get "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/provisioning-8136/pods/pod-subpath-test-dynamicpv-nkd7/log?container=test-container-subpath-dynamicpv-nkd7&previous=false": stream error: stream ID 115; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/26/23 17:36:51.662from junit_01.xml
> Enter [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/storage/framework/testsuite.go:51 @ 03/26/23 17:36:30.942 < Exit [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/storage/framework/testsuite.go:51 @ 03/26/23 17:36:30.942 (0s) > Enter [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath - set up framework | framework.go:191 @ 03/26/23 17:36:30.942 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/26/23 17:36:30.942 Mar 26 17:36:30.942: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename provisioning - test/e2e/framework/framework.go:250 @ 03/26/23 17:36:30.943 STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 03/26/23 17:36:31.258 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:262 @ 03/26/23 17:36:31.471 < Exit [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath - set up framework | framework.go:191 @ 03/26/23 17:36:31.679 (736ms) > Enter [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/framework/metrics/init/init.go:33 @ 03/26/23 17:36:31.679 < Exit [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/framework/metrics/init/init.go:33 @ 03/26/23 17:36:31.679 (0s) > Enter [It] should support existing directories when readOnly specified in the volumeSource - test/e2e/storage/testsuites/subpath.go:397 @ 03/26/23 17:36:31.679 Mar 26 17:36:31.679: INFO: Creating resource for dynamic PV Mar 26 17:36:31.679: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} STEP: creating a StorageClass provisioning-8136-e2e-sckgjff - test/e2e/storage/framework/volume_resource.go:102 @ 03/26/23 17:36:31.679 STEP: creating a claim - test/e2e/storage/framework/volume_resource.go:294 @ 03/26/23 17:36:31.789 Mar 26 17:36:31.789: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil STEP: Creating pod pod-subpath-test-dynamicpv-nkd7 - test/e2e/storage/testsuites/subpath.go:691 @ 03/26/23 17:36:32.005 STEP: Creating a pod to test subpath - test/e2e/framework/pod/output/output.go:243 @ 03/26/23 17:36:32.005 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/26/23 17:36:51.201 Mar 26 17:36:51.321: INFO: Trying to get logs from node i-0c64386131d9d94c5 pod pod-subpath-test-dynamicpv-nkd7 container test-container-subpath-dynamicpv-nkd7: <nil> Mar 26 17:36:51.426: INFO: Failed to get logs from node "i-0c64386131d9d94c5" pod "pod-subpath-test-dynamicpv-nkd7" container "test-container-subpath-dynamicpv-nkd7". Get "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/provisioning-8136/pods/pod-subpath-test-dynamicpv-nkd7/log?container=test-container-subpath-dynamicpv-nkd7&previous=false": stream error: stream ID 115; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/26/23 17:36:51.426 Mar 26 17:36:51.662: INFO: Unexpected error: <*fmt.wrapError | 0xc00394de60>: failed to get logs from pod-subpath-test-dynamicpv-nkd7 for test-container-subpath-dynamicpv-nkd7: Get "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/provisioning-8136/pods/pod-subpath-test-dynamicpv-nkd7/log?container=test-container-subpath-dynamicpv-nkd7&previous=false": stream error: stream ID 115; INTERNAL_ERROR; received from peer { msg: "failed to get logs from pod-subpath-test-dynamicpv-nkd7 for test-container-subpath-dynamicpv-nkd7: Get \"https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/provisioning-8136/pods/pod-subpath-test-dynamicpv-nkd7/log?container=test-container-subpath-dynamicpv-nkd7&previous=false\": stream error: stream ID 115; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc003ff30e0>{ Op: "Get", URL: "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/provisioning-8136/pods/pod-subpath-test-dynamicpv-nkd7/log?container=test-container-subpath-dynamicpv-nkd7&previous=false", Err: <http2.StreamError>{ StreamID: 115, Code: 2, Cause: <*errors.errorString | 0xc000169680>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from pod-subpath-test-dynamicpv-nkd7 for test-container-subpath-dynamicpv-nkd7: Get "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/provisioning-8136/pods/pod-subpath-test-dynamicpv-nkd7/log?container=test-container-subpath-dynamicpv-nkd7&previous=false": stream error: stream ID 115; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/26/23 17:36:51.662 < Exit [It] should support existing directories when readOnly specified in the volumeSource - test/e2e/storage/testsuites/subpath.go:397 @ 03/26/23 17:36:51.662 (19.984s) > Enter [AfterEach] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/framework/node/init/init.go:33 @ 03/26/23 17:36:51.662 Mar 26 17:36:51.662: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/framework/node/init/init.go:33 @ 03/26/23 17:36:51.779 (116ms) > Enter [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/storage/testsuites/subpath.go:399 @ 03/26/23 17:36:51.779 STEP: Deleting pod - test/e2e/storage/testsuites/subpath.go:172 @ 03/26/23 17:36:51.779 Mar 26 17:36:51.779: INFO: Deleting pod "pod-subpath-test-dynamicpv-nkd7" in namespace "provisioning-8136" STEP: Deleting pvc - test/e2e/storage/framework/volume_resource.go:181 @ 03/26/23 17:36:51.891 Mar 26 17:36:52.107: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.comc2psw" Mar 26 17:36:52.223: INFO: Waiting up to 5m0s for PersistentVolume pvc-207432fd-42c3-4a27-883f-60d4b0d8dc03 to get deleted Mar 26 17:36:52.341: INFO: PersistentVolume pvc-207432fd-42c3-4a27-883f-60d4b0d8dc03 found and phase=Released (117.953821ms) Mar 26 17:36:57.455: INFO: PersistentVolume pvc-207432fd-42c3-4a27-883f-60d4b0d8dc03 found and phase=Released (5.23217129s) Mar 26 17:37:02.570: INFO: PersistentVolume pvc-207432fd-42c3-4a27-883f-60d4b0d8dc03 found and phase=Released (10.346772266s) Mar 26 17:37:07.675: INFO: PersistentVolume pvc-207432fd-42c3-4a27-883f-60d4b0d8dc03 found and phase=Released (15.452438981s) Mar 26 17:37:12.797: INFO: PersistentVolume pvc-207432fd-42c3-4a27-883f-60d4b0d8dc03 was removed STEP: Deleting sc - test/e2e/storage/framework/volume_resource.go:228 @ 03/26/23 17:37:12.797 < Exit [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/storage/testsuites/subpath.go:399 @ 03/26/23 17:37:12.94 (21.161s) > Enter [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/framework/metrics/init/init.go:35 @ 03/26/23 17:37:12.94 < Exit [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/framework/metrics/init/init.go:35 @ 03/26/23 17:37:12.94 (0s) > Enter [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - dump namespaces | framework.go:209 @ 03/26/23 17:37:12.94 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/26/23 17:37:12.94 STEP: Collecting events from namespace "provisioning-8136". - test/e2e/framework/debug/dump.go:42 @ 03/26/23 17:37:12.94 STEP: Found 15 events. - test/e2e/framework/debug/dump.go:46 @ 03/26/23 17:37:13.053 Mar 26 17:37:13.053: INFO: At 2023-03-26 17:36:31 +0000 UTC - event for ebs.csi.aws.comc2psw: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding Mar 26 17:37:13.053: INFO: At 2023-03-26 17:36:32 +0000 UTC - event for ebs.csi.aws.comc2psw: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "ebs.csi.aws.com" or manually created by system administrator Mar 26 17:37:13.053: INFO: At 2023-03-26 17:36:32 +0000 UTC - event for ebs.csi.aws.comc2psw: {ebs.csi.aws.com_i-07cdb76b0ac2dbfa1_cb4b68af-2d91-4bfb-9626-7c22a975e7d6 } Provisioning: External provisioner is provisioning volume for claim "provisioning-8136/ebs.csi.aws.comc2psw" Mar 26 17:37:13.053: INFO: At 2023-03-26 17:36:35 +0000 UTC - event for ebs.csi.aws.comc2psw: {ebs.csi.aws.com_i-07cdb76b0ac2dbfa1_cb4b68af-2d91-4bfb-9626-7c22a975e7d6 } ProvisioningSucceeded: Successfully provisioned volume pvc-207432fd-42c3-4a27-883f-60d4b0d8dc03 Mar 26 17:37:13.053: INFO: At 2023-03-26 17:36:36 +0000 UTC - event for pod-subpath-test-dynamicpv-nkd7: {default-scheduler } Scheduled: Successfully assigned provisioning-8136/pod-subpath-test-dynamicpv-nkd7 to i-0c64386131d9d94c5 Mar 26 17:37:13.053: INFO: At 2023-03-26 17:36:38 +0000 UTC - event for pod-subpath-test-dynamicpv-nkd7: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-207432fd-42c3-4a27-883f-60d4b0d8dc03" Mar 26 17:37:13.053: INFO: At 2023-03-26 17:36:46 +0000 UTC - event for pod-subpath-test-dynamicpv-nkd7: {kubelet i-0c64386131d9d94c5} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 26 17:37:13.053: INFO: At 2023-03-26 17:36:46 +0000 UTC - event for pod-subpath-test-dynamicpv-nkd7: {kubelet i-0c64386131d9d94c5} Created: Created container init-volume-dynamicpv-nkd7 Mar 26 17:37:13.053: INFO: At 2023-03-26 17:36:46 +0000 UTC - event for pod-subpath-test-dynamicpv-nkd7: {kubelet i-0c64386131d9d94c5} Started: Started container init-volume-dynamicpv-nkd7 Mar 26 17:37:13.053: INFO: At 2023-03-26 17:36:47 +0000 UTC - event for pod-subpath-test-dynamicpv-nkd7: {kubelet i-0c64386131d9d94c5} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 26 17:37:13.053: INFO: At 2023-03-26 17:36:47 +0000 UTC - event for pod-subpath-test-dynamicpv-nkd7: {kubelet i-0c64386131d9d94c5} Created: Created container test-init-subpath-dynamicpv-nkd7 Mar 26 17:37:13.053: INFO: At 2023-03-26 17:36:47 +0000 UTC - event for pod-subpath-test-dynamicpv-nkd7: {kubelet i-0c64386131d9d94c5} Started: Started container test-init-subpath-dynamicpv-nkd7 Mar 26 17:37:13.053: INFO: At 2023-03-26 17:36:48 +0000 UTC - event for pod-subpath-test-dynamicpv-nkd7: {kubelet i-0c64386131d9d94c5} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 26 17:37:13.053: INFO: At 2023-03-26 17:36:48 +0000 UTC - event for pod-subpath-test-dynamicpv-nkd7: {kubelet i-0c64386131d9d94c5} Created: Created container test-container-subpath-dynamicpv-nkd7 Mar 26 17:37:13.053: INFO: At 2023-03-26 17:36:48 +0000 UTC - event for pod-subpath-test-dynamicpv-nkd7: {kubelet i-0c64386131d9d94c5} Started: Started container test-container-subpath-dynamicpv-nkd7 Mar 26 17:37:13.173: INFO: POD NODE PHASE GRACE CONDITIONS Mar 26 17:37:13.173: INFO: Mar 26 17:37:13.323: INFO: Logging node info for node i-011576d1f2b6be6ec Mar 26 17:37:13.435: INFO: Node Info: &Node{ObjectMeta:{i-011576d1f2b6be6ec ef4bb85b-7188-4ef2-8d1a-583f0fcc379a 8577 0 2023-03-26 17:26:11 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3b kubernetes.io/arch:amd64 kubernetes.io/hostname:i-011576d1f2b6be6ec kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3b topology.hostpath.csi/node:i-011576d1f2b6be6ec topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-9716":"i-011576d1f2b6be6ec","ebs.csi.aws.com":"i-011576d1f2b6be6ec"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.41.235/19 projectcalico.org/IPv4IPIPTunnelAddr:100.127.173.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-03-26 17:26:11 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:26:11 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-03-26 17:26:11 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-03-26 17:26:12 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-03-26 17:26:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.8.0/24\"":{}}}} } {calico-node Update v1 2023-03-26 17:26:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-03-26 17:36:43 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-03-26 17:36:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.8.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3b/i-011576d1f2b6be6ec,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.8.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-26 17:26:30 +0000 UTC,LastTransitionTime:2023-03-26 17:26:30 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-26 17:36:44 +0000 UTC,LastTransitionTime:2023-03-26 17:26:11 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-26 17:36:44 +0000 UTC,LastTransitionTime:2023-03-26 17:26:11 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-26 17:36:44 +0000 UTC,LastTransitionTime:2023-03-26 17:26:11 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-26 17:36:44 +0000 UTC,LastTransitionTime:2023-03-26 17:26:23 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.41.235,},NodeAddress{Type:ExternalIP,Address:35.180.45.101,},NodeAddress{Type:InternalDNS,Address:i-011576d1f2b6be6ec.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-011576d1f2b6be6ec.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-180-45-101.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec26cc6e198da1950569e38fb3a7f618,SystemUUID:ec26cc6e-198d-a195-0569-e38fb3a7f618,BootID:b67057d3-2187-4008-9056-8a843d3c6813,KernelVersion:5.15.0-1031-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0,KubeProxyVersion:v1.28.0-alpha.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/kube-proxy@sha256:8a03b3147cd7be8e8235ae1cd70cf69aca9ce03ba1cfaffea320540bb5afa496 registry.k8s.io/kube-proxy:v1.28.0-alpha.0],SizeBytes:23896850,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0f9c557fd65e8c56c],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0f9c557fd65e8c56c,DevicePath:,},},Config:nil,},} Mar 26 17:37:13.435: INFO: Logging kubelet events for node i-011576d1f2b6be6ec Mar 26 17:37:13.566: INFO: Logging pods the kubelet thinks is on node i-011576d1f2b6be6ec Mar 26 17:37:13.799: INFO: ss-1 started at 2023-03-26 17:36:41 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:13.799: INFO: Container webserver ready: false, restart count 0 Mar 26 17:37:13.799: INFO: csi-hostpathplugin-0 started at 2023-03-26 17:36:09 +0000 UTC (0+7 container statuses recorded) Mar 26 17:37:13.799: INFO: Container csi-attacher ready: true, restart count 0 Mar 26 17:37:13.799: INFO: Container csi-provisioner ready: true, restart count 0 Mar 26 17:37:13.799: INFO: Container csi-resizer ready: true, restart count 0 Mar 26 17:37:13.799: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 26 17:37:13.799: INFO: Container hostpath ready: true, restart count 0 Mar 26 17:37:13.799: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:37:13.799: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:37:13.799: INFO: ss2-2 started at 2023-03-26 17:36:38 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:13.799: INFO: Container webserver ready: true, restart count 0 Mar 26 17:37:13.799: INFO: ebs-csi-node-7dqmm started at 2023-03-26 17:26:12 +0000 UTC (0+3 container statuses recorded) Mar 26 17:37:13.799: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:37:13.799: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:37:13.799: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:37:13.799: INFO: coredns-559769c974-58thj started at 2023-03-26 17:34:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:13.799: INFO: Container coredns ready: true, restart count 0 Mar 26 17:37:13.799: INFO: affinity-clusterip-485gn started at 2023-03-26 17:37:02 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:13.799: INFO: Container affinity-clusterip ready: true, restart count 0 Mar 26 17:37:13.799: INFO: kube-proxy-i-011576d1f2b6be6ec started at 2023-03-26 17:26:12 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:13.799: INFO: Container kube-proxy ready: true, restart count 0 Mar 26 17:37:13.799: INFO: calico-node-tmjhr started at 2023-03-26 17:26:12 +0000 UTC (3+1 container statuses recorded) Mar 26 17:37:13.799: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 26 17:37:13.799: INFO: Init container install-cni ready: true, restart count 0 Mar 26 17:37:13.799: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 26 17:37:13.799: INFO: Container calico-node ready: true, restart count 0 Mar 26 17:37:13.799: INFO: affinity-clusterip-timeout-lhsdp started at 2023-03-26 17:36:49 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:13.799: INFO: Container affinity-clusterip-timeout ready: true, restart count 0 Mar 26 17:37:14.250: INFO: Latency metrics for node i-011576d1f2b6be6ec Mar 26 17:37:14.250: INFO: Logging node info for node i-07cdb76b0ac2dbfa1 Mar 26 17:37:14.371: INFO: Node Info: &Node{ObjectMeta:{i-07cdb76b0ac2dbfa1 d3bcec50-934c-432e-a590-2a35577f3a0d 5994 0 2023-03-26 17:17:19 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3b kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-07cdb76b0ac2dbfa1 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:eu-west-3b topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3b] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-07cdb76b0ac2dbfa1"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.63.230/19 projectcalico.org/IPv4IPIPTunnelAddr:100.127.118.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-26 17:17:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-03-26 17:17:20 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {calico-node Update v1 2023-03-26 17:18:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {aws-cloud-controller-manager Update v1 2023-03-26 17:18:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:18:48 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-03-26 17:18:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.5.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-03-26 17:35:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.5.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3b/i-07cdb76b0ac2dbfa1,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.5.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892301824 0} {<nil>} 3801076Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787444224 0} {<nil>} 3698676Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-26 17:18:46 +0000 UTC,LastTransitionTime:2023-03-26 17:18:46 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-26 17:35:51 +0000 UTC,LastTransitionTime:2023-03-26 17:17:19 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-26 17:35:51 +0000 UTC,LastTransitionTime:2023-03-26 17:17:19 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-26 17:35:51 +0000 UTC,LastTransitionTime:2023-03-26 17:17:19 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-26 17:35:51 +0000 UTC,LastTransitionTime:2023-03-26 17:18:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.63.230,},NodeAddress{Type:ExternalIP,Address:15.237.44.201,},NodeAddress{Type:InternalDNS,Address:i-07cdb76b0ac2dbfa1.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-07cdb76b0ac2dbfa1.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-237-44-201.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2824f976de88ff768c75c0d62c774f,SystemUUID:ec2824f9-76de-88ff-768c-75c0d62c774f,BootID:bc1e3e86-fc91-4be5-acba-90ac2a46faf2,KernelVersion:5.15.0-1031-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0,KubeProxyVersion:v1.28.0-alpha.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 registry.k8s.io/etcd:3.4.3-0],SizeBytes:100947667,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:9ce33ba33d8e738a5b85ed50b5080ac746deceed4a7496c550927a7a19ca3b6d registry.k8s.io/etcd:3.5.0-0],SizeBytes:99868722,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 registry.k8s.io/etcd:3.5.1-0],SizeBytes:98888614,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 registry.k8s.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:0d2ab6b15b4fe0b903b9e81192d942fb39c29be61fe341cd16db5d0165b0435c registry.k8s.io/etcd:3.3.17-0],SizeBytes:85524408,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:17da501f5d2a675be46040422a27b7cc21b8a43895ac998b171db1c346f361f7 registry.k8s.io/etcd:3.3.10-0],SizeBytes:76162358,},ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager-slim@sha256:8727adc059334e0e3329dbccce116a734da4a090da5e86c8cddccaf333caa666 registry.k8s.io/etcdadm/etcd-manager-slim:v3.0.20230201],SizeBytes:63926165,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:905d7ca17fd02bc24c0eba9a062753aba15db3e31422390bc3238eb762339b20 registry.k8s.io/etcd:3.2.24-1],SizeBytes:63423287,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:45208814,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:43629015,},ContainerImage{Names:[registry.k8s.io/kube-apiserver@sha256:49934a29c559e79ed19fc38b4697b18d8fe174b17bf56192588575f980c93956 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0],SizeBytes:33212506,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:2b6acd7f677f76ffe12ecf3ea7df92eb9b1bdb07336d1ac2a54c7631fb753f7e docker.io/calico/kube-controllers:v3.24.5],SizeBytes:31137169,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager@sha256:974748384634982c73527fdb3c9ec0ec476bc0d52b3dd1d611a380b7f99af1f3 registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0],SizeBytes:30820280,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/kube-proxy@sha256:8a03b3147cd7be8e8235ae1cd70cf69aca9ce03ba1cfaffea320540bb5afa496 registry.k8s.io/kube-proxy:v1.28.0-alpha.0],SizeBytes:23896850,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/kube-scheduler@sha256:cbf4007abb076188f16b975bc2b74452603cc7b34c60a29d92f14c38ad02dc11 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0],SizeBytes:18078674,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:5074723,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 26 17:37:14.371: INFO: Logging kubelet events for node i-07cdb76b0ac2dbfa1 Mar 26 17:37:14.487: INFO: Logging pods the kubelet thinks is on node i-07cdb76b0ac2dbfa1 Mar 26 17:37:14.606: INFO: aws-cloud-controller-manager-tbxvs started at 2023-03-26 17:18:29 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:14.606: INFO: Container aws-cloud-controller-manager ready: true, restart count 0 Mar 26 17:37:14.606: INFO: calico-node-5cszq started at 2023-03-26 17:18:29 +0000 UTC (3+1 container statuses recorded) Mar 26 17:37:14.606: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 26 17:37:14.606: INFO: Init container install-cni ready: true, restart count 0 Mar 26 17:37:14.606: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 26 17:37:14.606: INFO: Container calico-node ready: true, restart count 0 Mar 26 17:37:14.606: INFO: ebs-csi-controller-79f984545f-vq8bz started at 2023-03-26 17:19:49 +0000 UTC (0+5 container statuses recorded) Mar 26 17:37:14.606: INFO: Container csi-attacher ready: true, restart count 0 Mar 26 17:37:14.606: INFO: Container csi-provisioner ready: true, restart count 0 Mar 26 17:37:14.606: INFO: Container csi-resizer ready: true, restart count 0 Mar 26 17:37:14.606: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:37:14.606: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:37:14.606: INFO: dns-controller-69987775c6-ntctn started at 2023-03-26 17:17:49 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:14.606: INFO: Container dns-controller ready: true, restart count 0 Mar 26 17:37:14.606: INFO: kube-proxy-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:14.606: INFO: Container kube-proxy ready: true, restart count 0 Mar 26 17:37:14.606: INFO: kube-scheduler-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:14.606: INFO: Container kube-scheduler ready: true, restart count 0 Mar 26 17:37:14.606: INFO: etcd-manager-events-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (11+1 container statuses recorded) Mar 26 17:37:14.606: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0 Mar 26 17:37:14.606: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0 Mar 26 17:37:14.606: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0 Mar 26 17:37:14.606: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0 Mar 26 17:37:14.606: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0 Mar 26 17:37:14.606: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0 Mar 26 17:37:14.606: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0 Mar 26 17:37:14.606: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0 Mar 26 17:37:14.606: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0 Mar 26 17:37:14.606: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0 Mar 26 17:37:14.606: INFO: Init container init-etcd-3-5-7 ready: true, restart count 0 Mar 26 17:37:14.606: INFO: Container etcd-manager ready: true, restart count 0 Mar 26 17:37:14.606: INFO: etcd-manager-main-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (11+1 container statuses recorded) Mar 26 17:37:14.606: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0 Mar 26 17:37:14.606: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0 Mar 26 17:37:14.606: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0 Mar 26 17:37:14.606: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0 Mar 26 17:37:14.606: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0 Mar 26 17:37:14.606: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0 Mar 26 17:37:14.606: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0 Mar 26 17:37:14.606: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0 Mar 26 17:37:14.606: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0 Mar 26 17:37:14.606: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0 Mar 26 17:37:14.606: INFO: Init container init-etcd-3-5-7 ready: true, restart count 0 Mar 26 17:37:14.606: INFO: Container etcd-manager ready: true, restart count 0 Mar 26 17:37:14.606: INFO: kube-apiserver-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (0+2 container statuses recorded) Mar 26 17:37:14.606: INFO: Container healthcheck ready: true, restart count 0 Mar 26 17:37:14.606: INFO: Container kube-apiserver ready: true, restart count 2 Mar 26 17:37:14.606: INFO: ebs-csi-node-2r7mc started at 2023-03-26 17:18:29 +0000 UTC (0+3 container statuses recorded) Mar 26 17:37:14.606: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:37:14.606: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:37:14.606: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:37:14.606: INFO: kops-controller-thh8s started at 2023-03-26 17:18:29 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:14.606: INFO: Container kops-controller ready: true, restart count 0 Mar 26 17:37:14.606: INFO: kube-controller-manager-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:14.606: INFO: Container kube-controller-manager ready: true, restart count 4 Mar 26 17:37:14.606: INFO: calico-kube-controllers-55f488656-mjjr8 started at 2023-03-26 17:18:51 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:14.606: INFO: Container calico-kube-controllers ready: true, restart count 0 Mar 26 17:37:15.039: INFO: Latency metrics for node i-07cdb76b0ac2dbfa1 Mar 26 17:37:15.039: INFO: Logging node info for node i-0b2c24f535e511ae5 Mar 26 17:37:15.145: INFO: Node Info: &Node{ObjectMeta:{i-0b2c24f535e511ae5 8f866583-6b9f-42fc-932a-c5558d02f775 10198 0 2023-03-26 17:30:16 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3b kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0b2c24f535e511ae5 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3b topology.hostpath.csi/node:i-0b2c24f535e511ae5 topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-7727":"i-0b2c24f535e511ae5","ebs.csi.aws.com":"i-0b2c24f535e511ae5"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.54.135/19 projectcalico.org/IPv4IPIPTunnelAddr:100.113.179.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-03-26 17:30:16 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:30:16 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-03-26 17:30:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-03-26 17:30:17 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-03-26 17:30:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.9.0/24\"":{}}}} } {calico-node Update v1 2023-03-26 17:30:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-03-26 17:36:53 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-03-26 17:37:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.9.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3b/i-0b2c24f535e511ae5,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.9.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-26 17:30:43 +0000 UTC,LastTransitionTime:2023-03-26 17:30:43 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-26 17:37:05 +0000 UTC,LastTransitionTime:2023-03-26 17:30:16 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-26 17:37:05 +0000 UTC,LastTransitionTime:2023-03-26 17:30:16 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-26 17:37:05 +0000 UTC,LastTransitionTime:2023-03-26 17:30:16 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-26 17:37:05 +0000 UTC,LastTransitionTime:2023-03-26 17:30:34 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.54.135,},NodeAddress{Type:ExternalIP,Address:13.38.65.62,},NodeAddress{Type:InternalDNS,Address:i-0b2c24f535e511ae5.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-0b2c24f535e511ae5.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-38-65-62.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec256778270128bdfe9c2066f7fedcda,SystemUUID:ec256778-2701-28bd-fe9c-2066f7fedcda,BootID:542316ee-6bea-470f-85fc-51e338ca7e74,KernelVersion:5.15.0-1031-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0,KubeProxyVersion:v1.28.0-alpha.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/kube-proxy@sha256:8a03b3147cd7be8e8235ae1cd70cf69aca9ce03ba1cfaffea320540bb5afa496 registry.k8s.io/kube-proxy:v1.28.0-alpha.0],SizeBytes:23896850,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-7727^c4a826fb-cbfc-11ed-b9fe-cac12407b0bd kubernetes.io/csi/csi-hostpath-ephemeral-7727^ca9cf8a5-cbfc-11ed-b9fe-cac12407b0bd kubernetes.io/csi/ebs.csi.aws.com^vol-0598563114776e04a kubernetes.io/csi/ebs.csi.aws.com^vol-08548d13f8106a913 kubernetes.io/csi/ebs.csi.aws.com^vol-0948956feb75fa79a],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-08548d13f8106a913,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-7727^c4a826fb-cbfc-11ed-b9fe-cac12407b0bd,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-7727^ca9cf8a5-cbfc-11ed-b9fe-cac12407b0bd,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0948956feb75fa79a,DevicePath:,},},Config:nil,},} Mar 26 17:37:15.145: INFO: Logging kubelet events for node i-0b2c24f535e511ae5 Mar 26 17:37:15.257: INFO: Logging pods the kubelet thinks is on node i-0b2c24f535e511ae5 Mar 26 17:37:15.370: INFO: ss-2 started at 2023-03-26 17:36:50 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:15.370: INFO: Container webserver ready: true, restart count 0 Mar 26 17:37:15.370: INFO: csi-hostpathplugin-0 started at 2023-03-26 17:36:31 +0000 UTC (0+7 container statuses recorded) Mar 26 17:37:15.370: INFO: Container csi-attacher ready: true, restart count 0 Mar 26 17:37:15.370: INFO: Container csi-provisioner ready: true, restart count 0 Mar 26 17:37:15.370: INFO: Container csi-resizer ready: true, restart count 0 Mar 26 17:37:15.370: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 26 17:37:15.370: INFO: Container hostpath ready: true, restart count 0 Mar 26 17:37:15.370: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:37:15.370: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:37:15.370: INFO: kube-proxy-mode-detector started at 2023-03-26 17:36:45 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:15.370: INFO: Container agnhost-container ready: true, restart count 0 Mar 26 17:37:15.370: INFO: pod1-handle-http-request started at 2023-03-26 17:37:09 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:15.370: INFO: Container container-handle-8090-request ready: true, restart count 0 Mar 26 17:37:15.370: INFO: affinity-clusterip-timeout-lqftf started at 2023-03-26 17:36:49 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:15.370: INFO: Container affinity-clusterip-timeout ready: true, restart count 0 Mar 26 17:37:15.370: INFO: execpod-affinity88jtk started at 2023-03-26 17:36:55 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:15.370: INFO: Container agnhost-container ready: true, restart count 0 Mar 26 17:37:15.370: INFO: kube-proxy-i-0b2c24f535e511ae5 started at 2023-03-26 17:30:17 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:15.370: INFO: Container kube-proxy ready: true, restart count 0 Mar 26 17:37:15.370: INFO: ephemeral-containers-target-pod started at 2023-03-26 17:36:43 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:15.370: INFO: Container test-container-1 ready: true, restart count 0 Mar 26 17:37:15.370: INFO: foo-bkfbg started at 2023-03-26 17:36:50 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:15.370: INFO: Container c ready: true, restart count 0 Mar 26 17:37:15.370: INFO: inline-volume-tester-gm4j8 started at 2023-03-26 17:36:41 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:15.370: INFO: Container csi-volume-tester ready: true, restart count 0 Mar 26 17:37:15.370: INFO: hostexec-i-0b2c24f535e511ae5-gmjk7 started at 2023-03-26 17:37:04 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:15.370: INFO: Container agnhost-container ready: true, restart count 0 Mar 26 17:37:15.370: INFO: csi-mockplugin-0 started at 2023-03-26 17:37:07 +0000 UTC (0+4 container statuses recorded) Mar 26 17:37:15.370: INFO: Container busybox ready: true, restart count 0 Mar 26 17:37:15.370: INFO: Container csi-provisioner ready: true, restart count 0 Mar 26 17:37:15.370: INFO: Container driver-registrar ready: true, restart count 0 Mar 26 17:37:15.370: INFO: Container mock ready: true, restart count 0 Mar 26 17:37:15.370: INFO: execpod-affinityv5cnv started at 2023-03-26 17:37:09 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:15.370: INFO: Container agnhost-container ready: true, restart count 0 Mar 26 17:37:15.370: INFO: pod-a7503f63-dd6e-4c6c-b369-8dc1628eeea4 started at 2023-03-26 17:37:01 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:15.370: INFO: Container write-pod ready: false, restart count 0 Mar 26 17:37:15.370: INFO: ss2-1 started at 2023-03-26 17:36:45 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:15.370: INFO: Container webserver ready: false, restart count 0 Mar 26 17:37:15.370: INFO: calico-node-rdfns started at 2023-03-26 17:30:17 +0000 UTC (3+1 container statuses recorded) Mar 26 17:37:15.370: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 26 17:37:15.370: INFO: Init container install-cni ready: true, restart count 0 Mar 26 17:37:15.370: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 26 17:37:15.370: INFO: Container calico-node ready: true, restart count 0 Mar 26 17:37:15.370: INFO: ebs-csi-node-x9jln started at 2023-03-26 17:30:17 +0000 UTC (0+3 container statuses recorded) Mar 26 17:37:15.370: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:37:15.370: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:37:15.370: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:37:15.370: INFO: foo-4sn8c started at 2023-03-26 17:36:50 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:15.370: INFO: Container c ready: true, restart count 0 Mar 26 17:37:15.370: INFO: inline-volume-tester2-79mcl started at 2023-03-26 17:36:51 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:15.370: INFO: Container csi-volume-tester ready: true, restart count 0 Mar 26 17:37:15.370: INFO: affinity-clusterip-m6p6j started at 2023-03-26 17:37:02 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:15.370: INFO: Container affinity-clusterip ready: true, restart count 0 Mar 26 17:37:15.933: INFO: Latency metrics for node i-0b2c24f535e511ae5 Mar 26 17:37:15.933: INFO: Logging node info for node i-0c64386131d9d94c5 Mar 26 17:37:16.039: INFO: Node Info: &Node{ObjectMeta:{i-0c64386131d9d94c5 6c5a59f3-69fd-488b-b94e-23777e242a7e 10210 0 2023-03-26 17:34:02 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3b kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0c64386131d9d94c5 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3b topology.hostpath.csi/node:i-0c64386131d9d94c5 topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3b] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0c64386131d9d94c5"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.63.240/19 projectcalico.org/IPv4IPIPTunnelAddr:100.122.71.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-03-26 17:34:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:34:02 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-03-26 17:34:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-03-26 17:34:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-03-26 17:34:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.10.0/24\"":{}}}} } {calico-node Update v1 2023-03-26 17:34:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2023-03-26 17:37:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-03-26 17:37:06 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.10.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3b/i-0c64386131d9d94c5,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.10.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-26 17:34:21 +0000 UTC,LastTransitionTime:2023-03-26 17:34:21 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-26 17:37:05 +0000 UTC,LastTransitionTime:2023-03-26 17:34:02 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-26 17:37:05 +0000 UTC,LastTransitionTime:2023-03-26 17:34:02 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-26 17:37:05 +0000 UTC,LastTransitionTime:2023-03-26 17:34:02 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-26 17:37:05 +0000 UTC,LastTransitionTime:2023-03-26 17:34:14 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.63.240,},NodeAddress{Type:ExternalIP,Address:15.236.210.84,},NodeAddress{Type:InternalDNS,Address:i-0c64386131d9d94c5.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-0c64386131d9d94c5.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-236-210-84.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2c2c56ef9295a859b1f844cff158e8,SystemUUID:ec2c2c56-ef92-95a8-59b1-f844cff158e8,BootID:825bc25d-7144-4ec9-8dfb-f77f9cde8c31,KernelVersion:5.15.0-1031-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0,KubeProxyVersion:v1.28.0-alpha.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/kube-proxy@sha256:8a03b3147cd7be8e8235ae1cd70cf69aca9ce03ba1cfaffea320540bb5afa496 registry.k8s.io/kube-proxy:v1.28.0-alpha.0],SizeBytes:23896850,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0fae9f618539124e0],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0fae9f618539124e0,DevicePath:,},},Config:nil,},} Mar 26 17:37:16.039: INFO: Logging kubelet events for node i-0c64386131d9d94c5 Mar 26 17:37:16.166: INFO: Logging pods the kubelet thinks is on node i-0c64386131d9d94c5 Mar 26 17:37:16.278: INFO: affinity-clusterip-l5c8p started at 2023-03-26 17:37:02 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:16.278: INFO: Container affinity-clusterip ready: true, restart count 0 Mar 26 17:37:16.278: INFO: httpd started at 2023-03-26 17:37:14 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:16.278: INFO: Container httpd ready: false, restart count 0 Mar 26 17:37:16.278: INFO: affinity-clusterip-timeout-8xxwd started at 2023-03-26 17:36:49 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:16.278: INFO: Container affinity-clusterip-timeout ready: true, restart count 0 Mar 26 17:37:16.278: INFO: ss2-0 started at 2023-03-26 17:36:57 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:16.278: INFO: Container webserver ready: true, restart count 0 Mar 26 17:37:16.278: INFO: hostexec-i-0c64386131d9d94c5-wl946 started at 2023-03-26 17:36:58 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:16.278: INFO: Container agnhost-container ready: true, restart count 0 Mar 26 17:37:16.278: INFO: calico-node-jl5lk started at 2023-03-26 17:34:03 +0000 UTC (3+1 container statuses recorded) Mar 26 17:37:16.278: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 26 17:37:16.278: INFO: Init container install-cni ready: true, restart count 0 Mar 26 17:37:16.278: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 26 17:37:16.278: INFO: Container calico-node ready: true, restart count 0 Mar 26 17:37:16.278: INFO: ebs-csi-node-rhk2b started at 2023-03-26 17:34:03 +0000 UTC (0+3 container statuses recorded) Mar 26 17:37:16.278: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:37:16.278: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:37:16.278: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:37:16.278: INFO: hostexec-i-0c64386131d9d94c5-jt7gh started at 2023-03-26 17:37:12 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:16.278: INFO: Container agnhost-container ready: true, restart count 0 Mar 26 17:37:16.278: INFO: ss-0 started at 2023-03-26 17:36:27 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:16.278: INFO: Container webserver ready: true, restart count 0 Mar 26 17:37:16.278: INFO: coredns-autoscaler-7cb5c5b969-xmt8r started at 2023-03-26 17:34:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:16.278: INFO: Container autoscaler ready: true, restart count 0 Mar 26 17:37:16.278: INFO: pod-subpath-test-preprovisionedpv-5pnf started at 2023-03-26 17:37:15 +0000 UTC (1+1 container statuses recorded) Mar 26 17:37:16.278: INFO: Init container init-volume-preprovisionedpv-5pnf ready: false, restart count 0 Mar 26 17:37:16.278: INFO: Container test-container-subpath-preprovisionedpv-5pnf ready: false, restart count 0 Mar 26 17:37:16.278: INFO: kube-proxy-i-0c64386131d9d94c5 started at 2023-03-26 17:34:03 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:16.278: INFO: Container kube-proxy ready: true, restart count 0 Mar 26 17:37:16.278: INFO: pod-projected-secrets-82c3d854-d27a-439d-b60f-b167d871b490 started at 2023-03-26 17:36:25 +0000 UTC (0+3 container statuses recorded) Mar 26 17:37:16.278: INFO: Container creates-volume-test ready: true, restart count 0 Mar 26 17:37:16.278: INFO: Container dels-volume-test ready: true, restart count 0 Mar 26 17:37:16.278: INFO: Container upds-volume-test ready: true, restart count 0 Mar 26 17:37:16.699: INFO: Latency metrics for node i-0c64386131d9d94c5 Mar 26 17:37:16.699: INFO: Logging node info for node i-0ef04f0ca28b74fa4 Mar 26 17:37:16.803: INFO: Node Info: &Node{ObjectMeta:{i-0ef04f0ca28b74fa4 1429588e-1f3b-4a1a-98e2-600879dad0f2 10282 0 2023-03-26 17:21:49 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3b kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0ef04f0ca28b74fa4 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3b topology.hostpath.csi/node:i-0ef04f0ca28b74fa4 topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-6007":"i-0ef04f0ca28b74fa4","ebs.csi.aws.com":"i-0ef04f0ca28b74fa4"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.42.152/19 projectcalico.org/IPv4IPIPTunnelAddr:100.104.100.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-26 17:21:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:21:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:21:50 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-03-26 17:21:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-03-26 17:22:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.7.0/24\"":{}}}} } {calico-node Update v1 2023-03-26 17:22:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2023-03-26 17:37:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.7.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3b/i-0ef04f0ca28b74fa4,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.7.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-26 17:22:08 +0000 UTC,LastTransitionTime:2023-03-26 17:22:08 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-26 17:37:07 +0000 UTC,LastTransitionTime:2023-03-26 17:21:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-26 17:37:07 +0000 UTC,LastTransitionTime:2023-03-26 17:21:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-26 17:37:07 +0000 UTC,LastTransitionTime:2023-03-26 17:21:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-26 17:37:07 +0000 UTC,LastTransitionTime:2023-03-26 17:22:00 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.152,},NodeAddress{Type:ExternalIP,Address:35.180.133.237,},NodeAddress{Type:InternalDNS,Address:i-0ef04f0ca28b74fa4.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-0ef04f0ca28b74fa4.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-180-133-237.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2cd6131a8983e20721f6c173936bc3,SystemUUID:ec2cd613-1a89-83e2-0721-f6c173936bc3,BootID:34695e7c-23d6-4648-b207-41bcd12c2edf,KernelVersion:5.15.0-1031-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0,KubeProxyVersion:v1.28.0-alpha.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/kube-proxy@sha256:8a03b3147cd7be8e8235ae1cd70cf69aca9ce03ba1cfaffea320540bb5afa496 registry.k8s.io/kube-proxy:v1.28.0-alpha.0],SizeBytes:23896850,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 26 17:37:16.803: INFO: Logging kubelet events for node i-0ef04f0ca28b74fa4 Mar 26 17:37:16.923: INFO: Logging pods the kubelet thinks is on node i-0ef04f0ca28b74fa4 Mar 26 17:37:17.033: INFO: boom-server started at 2023-03-26 17:37:12 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:17.033: INFO: Container boom-server ready: false, restart count 0 Mar 26 17:37:17.033: INFO: csi-hostpathplugin-0 started at 2023-03-26 17:36:55 +0000 UTC (0+7 container statuses recorded) Mar 26 17:37:17.033: INFO: Container csi-attacher ready: true, restart count 0 Mar 26 17:37:17.033: INFO: Container csi-provisioner ready: true, restart count 0 Mar 26 17:37:17.033: INFO: Container csi-resizer ready: true, restart count 0 Mar 26 17:37:17.033: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 26 17:37:17.033: INFO: Container hostpath ready: true, restart count 0 Mar 26 17:37:17.033: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:37:17.033: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:37:17.033: INFO: kube-proxy-i-0ef04f0ca28b74fa4 started at 2023-03-26 17:21:50 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:17.033: INFO: Container kube-proxy ready: true, restart count 0 Mar 26 17:37:17.033: INFO: inline-volume-tester-dldrp started at 2023-03-26 17:36:55 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:17.033: INFO: Container csi-volume-tester ready: true, restart count 0 Mar 26 17:37:17.033: INFO: local-client started at 2023-03-26 17:37:15 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:17.033: INFO: Container local-client ready: false, restart count 0 Mar 26 17:37:17.033: INFO: inline-volume-tester2-pkzww started at 2023-03-26 17:37:08 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:17.033: INFO: Container csi-volume-tester ready: true, restart count 0 Mar 26 17:37:17.033: INFO: calico-node-bdwdr started at 2023-03-26 17:21:50 +0000 UTC (3+1 container statuses recorded) Mar 26 17:37:17.033: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 26 17:37:17.033: INFO: Init container install-cni ready: true, restart count 0 Mar 26 17:37:17.033: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 26 17:37:17.033: INFO: Container calico-node ready: true, restart count 0 Mar 26 17:37:17.033: INFO: ebs-csi-node-6wp7p started at 2023-03-26 17:21:50 +0000 UTC (0+3 container statuses recorded) Mar 26 17:37:17.033: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:37:17.033: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:37:17.033: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:37:17.033: INFO: coredns-559769c974-6mjw2 started at 2023-03-26 17:22:53 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:17.033: INFO: Container coredns ready: true, restart count 0 Mar 26 17:37:17.033: INFO: pod-configmaps-28775579-2d84-4eaf-8809-d932f1f3e04f started at 2023-03-26 17:36:07 +0000 UTC (0+3 container statuses recorded) Mar 26 17:37:17.033: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 26 17:37:17.033: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 26 17:37:17.033: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 26 17:37:17.033: INFO: hostexec-i-0ef04f0ca28b74fa4-dhvkh started at 2023-03-26 17:36:43 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:17.033: INFO: Container agnhost-container ready: true, restart count 0 Mar 26 17:37:17.497: INFO: Latency metrics for node i-0ef04f0ca28b74fa4 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/26/23 17:37:17.497 (4.557s) < Exit [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - dump namespaces | framework.go:209 @ 03/26/23 17:37:17.497 (4.557s) > Enter [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - tear down framework | framework.go:206 @ 03/26/23 17:37:17.497 STEP: Destroying namespace "provisioning-8136" for this suite. - test/e2e/framework/framework.go:351 @ 03/26/23 17:37:17.497 < Exit [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - tear down framework | framework.go:206 @ 03/26/23 17:37:17.607 (109ms) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/26/23 17:37:17.607 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/26/23 17:37:17.607 (0s)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\sExternal\sStorage\s\[Driver\:\sebs\.csi\.aws\.com\]\s\[Testpattern\:\sDynamic\sPV\s\(default\sfs\)\]\ssubPath\sshould\ssupport\sexisting\sdirectory$'
[FAILED] failed to get logs from pod-subpath-test-dynamicpv-h99t for test-container-volume-dynamicpv-h99t: Get "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/provisioning-1792/pods/pod-subpath-test-dynamicpv-h99t/log?container=test-container-volume-dynamicpv-h99t&previous=false": stream error: stream ID 47; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/26/23 17:36:23.825from junit_01.xml
> Enter [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/storage/framework/testsuite.go:51 @ 03/26/23 17:36:03.108 < Exit [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/storage/framework/testsuite.go:51 @ 03/26/23 17:36:03.108 (0s) > Enter [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath - set up framework | framework.go:191 @ 03/26/23 17:36:03.108 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/26/23 17:36:03.108 Mar 26 17:36:03.108: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename provisioning - test/e2e/framework/framework.go:250 @ 03/26/23 17:36:03.11 STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 03/26/23 17:36:03.425 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:262 @ 03/26/23 17:36:03.633 < Exit [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath - set up framework | framework.go:191 @ 03/26/23 17:36:03.841 (733ms) > Enter [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/framework/metrics/init/init.go:33 @ 03/26/23 17:36:03.841 < Exit [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/framework/metrics/init/init.go:33 @ 03/26/23 17:36:03.841 (0s) > Enter [It] should support existing directory - test/e2e/storage/testsuites/subpath.go:205 @ 03/26/23 17:36:03.841 Mar 26 17:36:03.841: INFO: Creating resource for dynamic PV Mar 26 17:36:03.841: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} STEP: creating a StorageClass provisioning-1792-e2e-sctfw6f - test/e2e/storage/framework/volume_resource.go:102 @ 03/26/23 17:36:03.842 STEP: creating a claim - test/e2e/storage/framework/volume_resource.go:294 @ 03/26/23 17:36:03.948 Mar 26 17:36:03.948: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil STEP: Creating pod pod-subpath-test-dynamicpv-h99t - test/e2e/storage/testsuites/subpath.go:691 @ 03/26/23 17:36:04.203 STEP: Creating a pod to test subpath - test/e2e/framework/pod/output/output.go:243 @ 03/26/23 17:36:04.203 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/26/23 17:36:23.399 Mar 26 17:36:23.503: INFO: Trying to get logs from node i-0c64386131d9d94c5 pod pod-subpath-test-dynamicpv-h99t container test-container-volume-dynamicpv-h99t: <nil> Mar 26 17:36:23.606: INFO: Failed to get logs from node "i-0c64386131d9d94c5" pod "pod-subpath-test-dynamicpv-h99t" container "test-container-volume-dynamicpv-h99t". Get "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/provisioning-1792/pods/pod-subpath-test-dynamicpv-h99t/log?container=test-container-volume-dynamicpv-h99t&previous=false": stream error: stream ID 47; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/26/23 17:36:23.606 Mar 26 17:36:23.824: INFO: Unexpected error: <*fmt.wrapError | 0xc0007ad000>: failed to get logs from pod-subpath-test-dynamicpv-h99t for test-container-volume-dynamicpv-h99t: Get "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/provisioning-1792/pods/pod-subpath-test-dynamicpv-h99t/log?container=test-container-volume-dynamicpv-h99t&previous=false": stream error: stream ID 47; INTERNAL_ERROR; received from peer { msg: "failed to get logs from pod-subpath-test-dynamicpv-h99t for test-container-volume-dynamicpv-h99t: Get \"https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/provisioning-1792/pods/pod-subpath-test-dynamicpv-h99t/log?container=test-container-volume-dynamicpv-h99t&previous=false\": stream error: stream ID 47; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc0007ff590>{ Op: "Get", URL: "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/provisioning-1792/pods/pod-subpath-test-dynamicpv-h99t/log?container=test-container-volume-dynamicpv-h99t&previous=false", Err: <http2.StreamError>{ StreamID: 47, Code: 2, Cause: <*errors.errorString | 0xc0001b3650>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from pod-subpath-test-dynamicpv-h99t for test-container-volume-dynamicpv-h99t: Get "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/provisioning-1792/pods/pod-subpath-test-dynamicpv-h99t/log?container=test-container-volume-dynamicpv-h99t&previous=false": stream error: stream ID 47; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/26/23 17:36:23.825 < Exit [It] should support existing directory - test/e2e/storage/testsuites/subpath.go:205 @ 03/26/23 17:36:23.825 (19.983s) > Enter [AfterEach] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/framework/node/init/init.go:33 @ 03/26/23 17:36:23.825 Mar 26 17:36:23.825: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/framework/node/init/init.go:33 @ 03/26/23 17:36:24.032 (207ms) > Enter [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/storage/testsuites/subpath.go:207 @ 03/26/23 17:36:24.032 STEP: Deleting pod - test/e2e/storage/testsuites/subpath.go:172 @ 03/26/23 17:36:24.032 Mar 26 17:36:24.032: INFO: Deleting pod "pod-subpath-test-dynamicpv-h99t" in namespace "provisioning-1792" STEP: Deleting pvc - test/e2e/storage/framework/volume_resource.go:181 @ 03/26/23 17:36:24.139 Mar 26 17:36:24.349: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.com6tjrh" Mar 26 17:36:24.461: INFO: Waiting up to 5m0s for PersistentVolume pvc-9c80f443-0907-4d0b-8e36-5a05074de2b6 to get deleted Mar 26 17:36:24.573: INFO: PersistentVolume pvc-9c80f443-0907-4d0b-8e36-5a05074de2b6 found and phase=Released (112.442954ms) Mar 26 17:36:29.678: INFO: PersistentVolume pvc-9c80f443-0907-4d0b-8e36-5a05074de2b6 found and phase=Released (5.217433385s) Mar 26 17:36:34.783: INFO: PersistentVolume pvc-9c80f443-0907-4d0b-8e36-5a05074de2b6 found and phase=Released (10.32226576s) Mar 26 17:36:39.887: INFO: PersistentVolume pvc-9c80f443-0907-4d0b-8e36-5a05074de2b6 was removed STEP: Deleting sc - test/e2e/storage/framework/volume_resource.go:228 @ 03/26/23 17:36:39.887 < Exit [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/storage/testsuites/subpath.go:207 @ 03/26/23 17:36:39.993 (15.961s) > Enter [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/framework/metrics/init/init.go:35 @ 03/26/23 17:36:39.993 < Exit [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/framework/metrics/init/init.go:35 @ 03/26/23 17:36:39.993 (0s) > Enter [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - dump namespaces | framework.go:209 @ 03/26/23 17:36:39.993 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/26/23 17:36:39.993 STEP: Collecting events from namespace "provisioning-1792". - test/e2e/framework/debug/dump.go:42 @ 03/26/23 17:36:39.993 STEP: Found 19 events. - test/e2e/framework/debug/dump.go:46 @ 03/26/23 17:36:40.098 Mar 26 17:36:40.098: INFO: At 2023-03-26 17:36:04 +0000 UTC - event for ebs.csi.aws.com6tjrh: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding Mar 26 17:36:40.098: INFO: At 2023-03-26 17:36:04 +0000 UTC - event for ebs.csi.aws.com6tjrh: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "ebs.csi.aws.com" or manually created by system administrator Mar 26 17:36:40.098: INFO: At 2023-03-26 17:36:04 +0000 UTC - event for ebs.csi.aws.com6tjrh: {ebs.csi.aws.com_i-07cdb76b0ac2dbfa1_cb4b68af-2d91-4bfb-9626-7c22a975e7d6 } Provisioning: External provisioner is provisioning volume for claim "provisioning-1792/ebs.csi.aws.com6tjrh" Mar 26 17:36:40.098: INFO: At 2023-03-26 17:36:08 +0000 UTC - event for ebs.csi.aws.com6tjrh: {ebs.csi.aws.com_i-07cdb76b0ac2dbfa1_cb4b68af-2d91-4bfb-9626-7c22a975e7d6 } ProvisioningSucceeded: Successfully provisioned volume pvc-9c80f443-0907-4d0b-8e36-5a05074de2b6 Mar 26 17:36:40.098: INFO: At 2023-03-26 17:36:08 +0000 UTC - event for pod-subpath-test-dynamicpv-h99t: {default-scheduler } Scheduled: Successfully assigned provisioning-1792/pod-subpath-test-dynamicpv-h99t to i-0c64386131d9d94c5 Mar 26 17:36:40.098: INFO: At 2023-03-26 17:36:10 +0000 UTC - event for pod-subpath-test-dynamicpv-h99t: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-9c80f443-0907-4d0b-8e36-5a05074de2b6" Mar 26 17:36:40.098: INFO: At 2023-03-26 17:36:15 +0000 UTC - event for pod-subpath-test-dynamicpv-h99t: {kubelet i-0c64386131d9d94c5} Pulling: Pulling image "registry.k8s.io/e2e-test-images/busybox:1.29-4" Mar 26 17:36:40.098: INFO: At 2023-03-26 17:36:16 +0000 UTC - event for pod-subpath-test-dynamicpv-h99t: {kubelet i-0c64386131d9d94c5} Pulled: Successfully pulled image "registry.k8s.io/e2e-test-images/busybox:1.29-4" in 135.527728ms (658.165595ms including waiting) Mar 26 17:36:40.098: INFO: At 2023-03-26 17:36:16 +0000 UTC - event for pod-subpath-test-dynamicpv-h99t: {kubelet i-0c64386131d9d94c5} Created: Created container init-volume-dynamicpv-h99t Mar 26 17:36:40.098: INFO: At 2023-03-26 17:36:16 +0000 UTC - event for pod-subpath-test-dynamicpv-h99t: {kubelet i-0c64386131d9d94c5} Started: Started container init-volume-dynamicpv-h99t Mar 26 17:36:40.098: INFO: At 2023-03-26 17:36:16 +0000 UTC - event for pod-subpath-test-dynamicpv-h99t: {kubelet i-0c64386131d9d94c5} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 26 17:36:40.098: INFO: At 2023-03-26 17:36:16 +0000 UTC - event for pod-subpath-test-dynamicpv-h99t: {kubelet i-0c64386131d9d94c5} Created: Created container test-init-subpath-dynamicpv-h99t Mar 26 17:36:40.098: INFO: At 2023-03-26 17:36:17 +0000 UTC - event for pod-subpath-test-dynamicpv-h99t: {kubelet i-0c64386131d9d94c5} Started: Started container test-init-subpath-dynamicpv-h99t Mar 26 17:36:40.098: INFO: At 2023-03-26 17:36:17 +0000 UTC - event for pod-subpath-test-dynamicpv-h99t: {kubelet i-0c64386131d9d94c5} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 26 17:36:40.098: INFO: At 2023-03-26 17:36:17 +0000 UTC - event for pod-subpath-test-dynamicpv-h99t: {kubelet i-0c64386131d9d94c5} Created: Created container test-container-subpath-dynamicpv-h99t Mar 26 17:36:40.098: INFO: At 2023-03-26 17:36:18 +0000 UTC - event for pod-subpath-test-dynamicpv-h99t: {kubelet i-0c64386131d9d94c5} Started: Started container test-container-subpath-dynamicpv-h99t Mar 26 17:36:40.098: INFO: At 2023-03-26 17:36:18 +0000 UTC - event for pod-subpath-test-dynamicpv-h99t: {kubelet i-0c64386131d9d94c5} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 26 17:36:40.098: INFO: At 2023-03-26 17:36:18 +0000 UTC - event for pod-subpath-test-dynamicpv-h99t: {kubelet i-0c64386131d9d94c5} Created: Created container test-container-volume-dynamicpv-h99t Mar 26 17:36:40.098: INFO: At 2023-03-26 17:36:18 +0000 UTC - event for pod-subpath-test-dynamicpv-h99t: {kubelet i-0c64386131d9d94c5} Started: Started container test-container-volume-dynamicpv-h99t Mar 26 17:36:40.204: INFO: POD NODE PHASE GRACE CONDITIONS Mar 26 17:36:40.204: INFO: Mar 26 17:36:40.316: INFO: Logging node info for node i-011576d1f2b6be6ec Mar 26 17:36:40.441: INFO: Node Info: &Node{ObjectMeta:{i-011576d1f2b6be6ec ef4bb85b-7188-4ef2-8d1a-583f0fcc379a 8098 0 2023-03-26 17:26:11 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3b kubernetes.io/arch:amd64 kubernetes.io/hostname:i-011576d1f2b6be6ec kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3b topology.hostpath.csi/node:i-011576d1f2b6be6ec topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-9716":"i-011576d1f2b6be6ec","ebs.csi.aws.com":"i-011576d1f2b6be6ec"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.41.235/19 projectcalico.org/IPv4IPIPTunnelAddr:100.127.173.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-03-26 17:26:11 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:26:11 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-03-26 17:26:11 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-03-26 17:26:12 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-03-26 17:26:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.8.0/24\"":{}}}} } {calico-node Update v1 2023-03-26 17:26:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2023-03-26 17:36:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.8.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3b/i-011576d1f2b6be6ec,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.8.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-26 17:26:30 +0000 UTC,LastTransitionTime:2023-03-26 17:26:30 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-26 17:36:34 +0000 UTC,LastTransitionTime:2023-03-26 17:26:11 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-26 17:36:34 +0000 UTC,LastTransitionTime:2023-03-26 17:26:11 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-26 17:36:34 +0000 UTC,LastTransitionTime:2023-03-26 17:26:11 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-26 17:36:34 +0000 UTC,LastTransitionTime:2023-03-26 17:26:23 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.41.235,},NodeAddress{Type:ExternalIP,Address:35.180.45.101,},NodeAddress{Type:InternalDNS,Address:i-011576d1f2b6be6ec.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-011576d1f2b6be6ec.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-180-45-101.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec26cc6e198da1950569e38fb3a7f618,SystemUUID:ec26cc6e-198d-a195-0569-e38fb3a7f618,BootID:b67057d3-2187-4008-9056-8a843d3c6813,KernelVersion:5.15.0-1031-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0,KubeProxyVersion:v1.28.0-alpha.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/kube-proxy@sha256:8a03b3147cd7be8e8235ae1cd70cf69aca9ce03ba1cfaffea320540bb5afa496 registry.k8s.io/kube-proxy:v1.28.0-alpha.0],SizeBytes:23896850,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 26 17:36:40.441: INFO: Logging kubelet events for node i-011576d1f2b6be6ec Mar 26 17:36:40.560: INFO: Logging pods the kubelet thinks is on node i-011576d1f2b6be6ec Mar 26 17:36:40.776: INFO: inline-volume-tester-2lglf started at 2023-03-26 17:36:09 +0000 UTC (0+1 container statuses recorded) Mar 26 17:36:40.776: INFO: Container csi-volume-tester ready: true, restart count 0 Mar 26 17:36:40.776: INFO: ss2-2 started at 2023-03-26 17:36:38 +0000 UTC (0+1 container statuses recorded) Mar 26 17:36:40.776: INFO: Container webserver ready: false, restart count 0 Mar 26 17:36:40.776: INFO: pod1 started at 2023-03-26 17:36:03 +0000 UTC (0+1 container statuses recorded) Mar 26 17:36:40.776: INFO: Container container1 ready: true, restart count 0 Mar 26 17:36:40.776: INFO: ebs-csi-node-7dqmm started at 2023-03-26 17:26:12 +0000 UTC (0+3 container statuses recorded) Mar 26 17:36:40.776: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:36:40.776: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:36:40.776: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:36:40.776: INFO: coredns-559769c974-58thj started at 2023-03-26 17:34:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:36:40.776: INFO: Container coredns ready: true, restart count 0 Mar 26 17:36:40.776: INFO: netserver-0 started at 2023-03-26 17:36:24 +0000 UTC (0+1 container statuses recorded) Mar 26 17:36:40.776: INFO: Container webserver ready: false, restart count 0 Mar 26 17:36:40.776: INFO: kube-proxy-i-011576d1f2b6be6ec started at 2023-03-26 17:26:12 +0000 UTC (0+1 container statuses recorded) Mar 26 17:36:40.776: INFO: Container kube-proxy ready: true, restart count 0 Mar 26 17:36:40.776: INFO: calico-node-tmjhr started at 2023-03-26 17:26:12 +0000 UTC (3+1 container statuses recorded) Mar 26 17:36:40.776: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 26 17:36:40.776: INFO: Init container install-cni ready: true, restart count 0 Mar 26 17:36:40.776: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 26 17:36:40.776: INFO: Container calico-node ready: true, restart count 0 Mar 26 17:36:40.776: INFO: csi-hostpathplugin-0 started at 2023-03-26 17:36:09 +0000 UTC (0+7 container statuses recorded) Mar 26 17:36:40.776: INFO: Container csi-attacher ready: true, restart count 0 Mar 26 17:36:40.776: INFO: Container csi-provisioner ready: true, restart count 0 Mar 26 17:36:40.776: INFO: Container csi-resizer ready: true, restart count 0 Mar 26 17:36:40.776: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 26 17:36:40.776: INFO: Container hostpath ready: true, restart count 0 Mar 26 17:36:40.776: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:36:40.776: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:36:40.776: INFO: webserver-57d54c6656-9kvd8 started at 2023-03-26 17:36:19 +0000 UTC (0+1 container statuses recorded) Mar 26 17:36:40.776: INFO: Container httpd ready: true, restart count 0 Mar 26 17:36:41.223: INFO: Latency metrics for node i-011576d1f2b6be6ec Mar 26 17:36:41.223: INFO: Logging node info for node i-07cdb76b0ac2dbfa1 Mar 26 17:36:41.327: INFO: Node Info: &Node{ObjectMeta:{i-07cdb76b0ac2dbfa1 d3bcec50-934c-432e-a590-2a35577f3a0d 5994 0 2023-03-26 17:17:19 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3b kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-07cdb76b0ac2dbfa1 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:eu-west-3b topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3b] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-07cdb76b0ac2dbfa1"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.63.230/19 projectcalico.org/IPv4IPIPTunnelAddr:100.127.118.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-26 17:17:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-03-26 17:17:20 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {calico-node Update v1 2023-03-26 17:18:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {aws-cloud-controller-manager Update v1 2023-03-26 17:18:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:18:48 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-03-26 17:18:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.5.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-03-26 17:35:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.5.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3b/i-07cdb76b0ac2dbfa1,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.5.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892301824 0} {<nil>} 3801076Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787444224 0} {<nil>} 3698676Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-26 17:18:46 +0000 UTC,LastTransitionTime:2023-03-26 17:18:46 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-26 17:35:51 +0000 UTC,LastTransitionTime:2023-03-26 17:17:19 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-26 17:35:51 +0000 UTC,LastTransitionTime:2023-03-26 17:17:19 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-26 17:35:51 +0000 UTC,LastTransitionTime:2023-03-26 17:17:19 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-26 17:35:51 +0000 UTC,LastTransitionTime:2023-03-26 17:18:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.63.230,},NodeAddress{Type:ExternalIP,Address:15.237.44.201,},NodeAddress{Type:InternalDNS,Address:i-07cdb76b0ac2dbfa1.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-07cdb76b0ac2dbfa1.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-237-44-201.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2824f976de88ff768c75c0d62c774f,SystemUUID:ec2824f9-76de-88ff-768c-75c0d62c774f,BootID:bc1e3e86-fc91-4be5-acba-90ac2a46faf2,KernelVersion:5.15.0-1031-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0,KubeProxyVersion:v1.28.0-alpha.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 registry.k8s.io/etcd:3.4.3-0],SizeBytes:100947667,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:9ce33ba33d8e738a5b85ed50b5080ac746deceed4a7496c550927a7a19ca3b6d registry.k8s.io/etcd:3.5.0-0],SizeBytes:99868722,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 registry.k8s.io/etcd:3.5.1-0],SizeBytes:98888614,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 registry.k8s.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:0d2ab6b15b4fe0b903b9e81192d942fb39c29be61fe341cd16db5d0165b0435c registry.k8s.io/etcd:3.3.17-0],SizeBytes:85524408,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:17da501f5d2a675be46040422a27b7cc21b8a43895ac998b171db1c346f361f7 registry.k8s.io/etcd:3.3.10-0],SizeBytes:76162358,},ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager-slim@sha256:8727adc059334e0e3329dbccce116a734da4a090da5e86c8cddccaf333caa666 registry.k8s.io/etcdadm/etcd-manager-slim:v3.0.20230201],SizeBytes:63926165,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:905d7ca17fd02bc24c0eba9a062753aba15db3e31422390bc3238eb762339b20 registry.k8s.io/etcd:3.2.24-1],SizeBytes:63423287,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:45208814,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:43629015,},ContainerImage{Names:[registry.k8s.io/kube-apiserver@sha256:49934a29c559e79ed19fc38b4697b18d8fe174b17bf56192588575f980c93956 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0],SizeBytes:33212506,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:2b6acd7f677f76ffe12ecf3ea7df92eb9b1bdb07336d1ac2a54c7631fb753f7e docker.io/calico/kube-controllers:v3.24.5],SizeBytes:31137169,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager@sha256:974748384634982c73527fdb3c9ec0ec476bc0d52b3dd1d611a380b7f99af1f3 registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0],SizeBytes:30820280,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/kube-proxy@sha256:8a03b3147cd7be8e8235ae1cd70cf69aca9ce03ba1cfaffea320540bb5afa496 registry.k8s.io/kube-proxy:v1.28.0-alpha.0],SizeBytes:23896850,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/kube-scheduler@sha256:cbf4007abb076188f16b975bc2b74452603cc7b34c60a29d92f14c38ad02dc11 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0],SizeBytes:18078674,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:5074723,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 26 17:36:41.328: INFO: Logging kubelet events for node i-07cdb76b0ac2dbfa1 Mar 26 17:36:41.448: INFO: Logging pods the kubelet thinks is on node i-07cdb76b0ac2dbfa1 Mar 26 17:36:41.561: INFO: kube-apiserver-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (0+2 container statuses recorded) Mar 26 17:36:41.561: INFO: Container healthcheck ready: true, restart count 0 Mar 26 17:36:41.561: INFO: Container kube-apiserver ready: true, restart count 2 Mar 26 17:36:41.561: INFO: ebs-csi-node-2r7mc started at 2023-03-26 17:18:29 +0000 UTC (0+3 container statuses recorded) Mar 26 17:36:41.561: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:36:41.561: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:36:41.561: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:36:41.561: INFO: kops-controller-thh8s started at 2023-03-26 17:18:29 +0000 UTC (0+1 container statuses recorded) Mar 26 17:36:41.561: INFO: Container kops-controller ready: true, restart count 0 Mar 26 17:36:41.561: INFO: kube-controller-manager-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:36:41.561: INFO: Container kube-controller-manager ready: true, restart count 4 Mar 26 17:36:41.561: INFO: kube-proxy-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:36:41.561: INFO: Container kube-proxy ready: true, restart count 0 Mar 26 17:36:41.561: INFO: kube-scheduler-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:36:41.561: INFO: Container kube-scheduler ready: true, restart count 0 Mar 26 17:36:41.561: INFO: etcd-manager-events-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (11+1 container statuses recorded) Mar 26 17:36:41.561: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0 Mar 26 17:36:41.561: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0 Mar 26 17:36:41.561: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0 Mar 26 17:36:41.561: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0 Mar 26 17:36:41.561: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0 Mar 26 17:36:41.561: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0 Mar 26 17:36:41.561: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0 Mar 26 17:36:41.561: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0 Mar 26 17:36:41.561: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0 Mar 26 17:36:41.561: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0 Mar 26 17:36:41.561: INFO: Init container init-etcd-3-5-7 ready: true, restart count 0 Mar 26 17:36:41.561: INFO: Container etcd-manager ready: true, restart count 0 Mar 26 17:36:41.561: INFO: etcd-manager-main-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (11+1 container statuses recorded) Mar 26 17:36:41.561: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0 Mar 26 17:36:41.561: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0 Mar 26 17:36:41.561: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0 Mar 26 17:36:41.561: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0 Mar 26 17:36:41.561: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0 Mar 26 17:36:41.561: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0 Mar 26 17:36:41.561: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0 Mar 26 17:36:41.561: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0 Mar 26 17:36:41.561: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0 Mar 26 17:36:41.561: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0 Mar 26 17:36:41.561: INFO: Init container init-etcd-3-5-7 ready: true, restart count 0 Mar 26 17:36:41.561: INFO: Container etcd-manager ready: true, restart count 0 Mar 26 17:36:41.561: INFO: calico-kube-controllers-55f488656-mjjr8 started at 2023-03-26 17:18:51 +0000 UTC (0+1 container statuses recorded) Mar 26 17:36:41.561: INFO: Container calico-kube-controllers ready: true, restart count 0 Mar 26 17:36:41.561: INFO: dns-controller-69987775c6-ntctn started at 2023-03-26 17:17:49 +0000 UTC (0+1 container statuses recorded) Mar 26 17:36:41.561: INFO: Container dns-controller ready: true, restart count 0 Mar 26 17:36:41.561: INFO: aws-cloud-controller-manager-tbxvs started at 2023-03-26 17:18:29 +0000 UTC (0+1 container statuses recorded) Mar 26 17:36:41.561: INFO: Container aws-cloud-controller-manager ready: true, restart count 0 Mar 26 17:36:41.561: INFO: calico-node-5cszq started at 2023-03-26 17:18:29 +0000 UTC (3+1 container statuses recorded) Mar 26 17:36:41.561: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 26 17:36:41.561: INFO: Init container install-cni ready: true, restart count 0 Mar 26 17:36:41.561: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 26 17:36:41.561: INFO: Container calico-node ready: true, restart count 0 Mar 26 17:36:41.561: INFO: ebs-csi-controller-79f984545f-vq8bz started at 2023-03-26 17:19:49 +0000 UTC (0+5 container statuses recorded) Mar 26 17:36:41.561: INFO: Container csi-attacher ready: true, restart count 0 Mar 26 17:36:41.561: INFO: Container csi-provisioner ready: true, restart count 0 Mar 26 17:36:41.561: INFO: Container csi-resizer ready: true, restart count 0 Mar 26 17:36:41.561: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:36:41.561: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:36:42.005: INFO: Latency metrics for node i-07cdb76b0ac2dbfa1 Mar 26 17:36:42.005: INFO: Logging node info for node i-0b2c24f535e511ae5 Mar 26 17:36:42.109: INFO: Node Info: &Node{ObjectMeta:{i-0b2c24f535e511ae5 8f866583-6b9f-42fc-932a-c5558d02f775 8352 0 2023-03-26 17:30:16 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3b kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0b2c24f535e511ae5 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3b topology.hostpath.csi/node:i-0b2c24f535e511ae5 topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-7727":"i-0b2c24f535e511ae5","ebs.csi.aws.com":"i-0b2c24f535e511ae5"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.54.135/19 projectcalico.org/IPv4IPIPTunnelAddr:100.113.179.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-03-26 17:30:16 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:30:16 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-03-26 17:30:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-03-26 17:30:17 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-03-26 17:30:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.9.0/24\"":{}}}} } {calico-node Update v1 2023-03-26 17:30:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2023-03-26 17:36:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {kube-controller-manager Update v1 2023-03-26 17:36:40 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.9.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3b/i-0b2c24f535e511ae5,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.9.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-26 17:30:43 +0000 UTC,LastTransitionTime:2023-03-26 17:30:43 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-26 17:36:34 +0000 UTC,LastTransitionTime:2023-03-26 17:30:16 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-26 17:36:34 +0000 UTC,LastTransitionTime:2023-03-26 17:30:16 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-26 17:36:34 +0000 UTC,LastTransitionTime:2023-03-26 17:30:16 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-26 17:36:34 +0000 UTC,LastTransitionTime:2023-03-26 17:30:34 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.54.135,},NodeAddress{Type:ExternalIP,Address:13.38.65.62,},NodeAddress{Type:InternalDNS,Address:i-0b2c24f535e511ae5.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-0b2c24f535e511ae5.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-38-65-62.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec256778270128bdfe9c2066f7fedcda,SystemUUID:ec256778-2701-28bd-fe9c-2066f7fedcda,BootID:542316ee-6bea-470f-85fc-51e338ca7e74,KernelVersion:5.15.0-1031-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0,KubeProxyVersion:v1.28.0-alpha.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/kube-proxy@sha256:8a03b3147cd7be8e8235ae1cd70cf69aca9ce03ba1cfaffea320540bb5afa496 registry.k8s.io/kube-proxy:v1.28.0-alpha.0],SizeBytes:23896850,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-08548d13f8106a913,DevicePath:,},},Config:nil,},} Mar 26 17:36:42.110: INFO: Logging kubelet events for node i-0b2c24f535e511ae5 Mar 26 17:36:42.224: INFO: Logging pods the kubelet thinks is on node i-0b2c24f535e511ae5 Mar 26 17:36:42.341: INFO: ss-0 started at 2023-03-26 17:36:35 +0000 UTC (0+1 container statuses recorded) Mar 26 17:36:42.341: INFO: Container webserver ready: false, restart count 0 Mar 26 17:36:42.341: INFO: inline-volume-tester-gm4j8 started at 2023-03-26 17:36:41 +0000 UTC (0+1 container statuses recorded) Mar 26 17:36:42.341: INFO: Container csi-volume-tester ready: false, restart count 0 Mar 26 17:36:42.341: INFO: pod-service-account-mountsa-mountspec started at 2023-03-26 17:36:42 +0000 UTC (0+1 container statuses recorded) Mar 26 17:36:42.341: INFO: Container token-test ready: false, restart count 0 Mar 26 17:36:42.341: INFO: pod-service-account-nomountsa-mountspec started at 2023-03-26 17:36:42 +0000 UTC (0+1 container statuses recorded) Mar 26 17:36:42.341: INFO: Container token-test ready: false, restart count 0 Mar 26 17:36:42.341: INFO: webserver-67bd4bf6dc-fhcgt started at 2023-03-26 17:36:25 +0000 UTC (0+1 container statuses recorded) Mar 26 17:36:42.341: INFO: Container httpd ready: true, restart count 0 Mar 26 17:36:42.341: INFO: pod-service-account-defaultsa started at 2023-03-26 17:36:41 +0000 UTC (0+1 container statuses recorded) Mar 26 17:36:42.341: INFO: Container token-test ready: false, restart count 0 Mar 26 17:36:42.341: INFO: pod-service-account-nomountsa started at 2023-03-26 17:36:41 +0000 UTC (0+1 container statuses recorded) Mar 26 17:36:42.341: INFO: Container token-test ready: false, restart count 0 Mar 26 17:36:42.341: INFO: csi-hostpathplugin-0 started at 2023-03-26 17:36:31 +0000 UTC (0+7 container statuses recorded) Mar 26 17:36:42.341: INFO: Container csi-attacher ready: false, restart count 0 Mar 26 17:36:42.341: INFO: Container csi-provisioner ready: false, restart count 0 Mar 26 17:36:42.341: INFO: Container csi-resizer ready: false, restart count 0 Mar 26 17:36:42.341: INFO: Container csi-snapshotter ready: false, restart count 0 Mar 26 17:36:42.341: INFO: Container hostpath ready: false, restart count 0 Mar 26 17:36:42.341: INFO: Container liveness-probe ready: false, restart count 0 Mar 26 17:36:42.341: INFO: Container node-driver-registrar ready: false, restart count 0 Mar 26 17:36:42.341: INFO: pod-configmaps-f5d28382-f713-4472-8bde-4c4dd989fbae started at 2023-03-26 17:36:38 +0000 UTC (0+1 container statuses recorded) Mar 26 17:36:42.341: INFO: Container agnhost-container ready: false, restart count 0 Mar 26 17:36:42.341: INFO: calico-node-rdfns started at 2023-03-26 17:30:17 +0000 UTC (3+1 container statuses recorded) Mar 26 17:36:42.341: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 26 17:36:42.341: INFO: Init container install-cni ready: true, restart count 0 Mar 26 17:36:42.341: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 26 17:36:42.341: INFO: Container calico-node ready: true, restart count 0 Mar 26 17:36:42.341: INFO: ebs-csi-node-x9jln started at 2023-03-26 17:30:17 +0000 UTC (0+3 container statuses recorded) Mar 26 17:36:42.341: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:36:42.341: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:36:42.341: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:36:42.341: INFO: kube-proxy-i-0b2c24f535e511ae5 started at 2023-03-26 17:30:17 +0000 UTC (0+1 container statuses recorded) Mar 26 17:36:42.341: INFO: Container kube-proxy ready: true, restart count 0 Mar 26 17:36:42.341: INFO: netserver-1 started at 2023-03-26 17:36:24 +0000 UTC (0+1 container statuses recorded) Mar 26 17:36:42.341: INFO: Container webserver ready: false, restart count 0 Mar 26 17:36:42.809: INFO: Latency metrics for node i-0b2c24f535e511ae5 Mar 26 17:36:42.809: INFO: Logging node info for node i-0c64386131d9d94c5 Mar 26 17:36:42.917: INFO: Node Info: &Node{ObjectMeta:{i-0c64386131d9d94c5 6c5a59f3-69fd-488b-b94e-23777e242a7e 8339 0 2023-03-26 17:34:02 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3b kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0c64386131d9d94c5 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3b topology.hostpath.csi/node:i-0c64386131d9d94c5 topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3b] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-capacity-7798":"i-0c64386131d9d94c5","ebs.csi.aws.com":"i-0c64386131d9d94c5"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.63.240/19 projectcalico.org/IPv4IPIPTunnelAddr:100.122.71.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-03-26 17:34:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:34:02 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-03-26 17:34:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-03-26 17:34:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-03-26 17:34:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.10.0/24\"":{}}}} } {calico-node Update v1 2023-03-26 17:34:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-03-26 17:36:38 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-03-26 17:36:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.10.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3b/i-0c64386131d9d94c5,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.10.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-26 17:34:21 +0000 UTC,LastTransitionTime:2023-03-26 17:34:21 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-26 17:36:35 +0000 UTC,LastTransitionTime:2023-03-26 17:34:02 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-26 17:36:35 +0000 UTC,LastTransitionTime:2023-03-26 17:34:02 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-26 17:36:35 +0000 UTC,LastTransitionTime:2023-03-26 17:34:02 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-26 17:36:35 +0000 UTC,LastTransitionTime:2023-03-26 17:34:14 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.63.240,},NodeAddress{Type:ExternalIP,Address:15.236.210.84,},NodeAddress{Type:InternalDNS,Address:i-0c64386131d9d94c5.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-0c64386131d9d94c5.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-236-210-84.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2c2c56ef9295a859b1f844cff158e8,SystemUUID:ec2c2c56-ef92-95a8-59b1-f844cff158e8,BootID:825bc25d-7144-4ec9-8dfb-f77f9cde8c31,KernelVersion:5.15.0-1031-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0,KubeProxyVersion:v1.28.0-alpha.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/kube-proxy@sha256:8a03b3147cd7be8e8235ae1cd70cf69aca9ce03ba1cfaffea320540bb5afa496 registry.k8s.io/kube-proxy:v1.28.0-alpha.0],SizeBytes:23896850,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0fae9f618539124e0],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0fae9f618539124e0,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-04a6ca9216199f13f,DevicePath:,},},Config:nil,},} Mar 26 17:36:42.918: INFO: Logging kubelet events for node i-0c64386131d9d94c5 Mar 26 17:36:43.039: INFO: Logging pods the kubelet thinks is on node i-0c64386131d9d94c5 Mar 26 17:36:43.161: INFO: kube-proxy-i-0c64386131d9d94c5 started at 2023-03-26 17:34:03 +0000 UTC (0+1 container statuses recorded) Mar 26 17:36:43.161: INFO: Container kube-proxy ready: true, restart count 0 Mar 26 17:36:43.161: INFO: pod-projected-secrets-82c3d854-d27a-439d-b60f-b167d871b490 started at 2023-03-26 17:36:25 +0000 UTC (0+3 container statuses recorded) Mar 26 17:36:43.161: INFO: Container creates-volume-test ready: true, restart count 0 Mar 26 17:36:43.161: INFO: Container dels-volume-test ready: true, restart count 0 Mar 26 17:36:43.161: INFO: Container upds-volume-test ready: true, restart count 0 Mar 26 17:36:43.161: INFO: csi-mockplugin-0 started at 2023-03-26 17:36:32 +0000 UTC (0+3 container statuses recorded) Mar 26 17:36:43.161: INFO: Container csi-provisioner ready: true, restart count 0 Mar 26 17:36:43.161: INFO: Container driver-registrar ready: true, restart count 0 Mar 26 17:36:43.161: INFO: Container mock ready: true, restart count 0 Mar 26 17:36:43.161: INFO: ss2-1 started at 2023-03-26 17:36:10 +0000 UTC (0+1 container statuses recorded) Mar 26 17:36:43.161: INFO: Container webserver ready: true, restart count 0 Mar 26 17:36:43.161: INFO: calico-node-jl5lk started at 2023-03-26 17:34:03 +0000 UTC (3+1 container statuses recorded) Mar 26 17:36:43.161: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 26 17:36:43.161: INFO: Init container install-cni ready: true, restart count 0 Mar 26 17:36:43.161: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 26 17:36:43.161: INFO: Container calico-node ready: true, restart count 0 Mar 26 17:36:43.161: INFO: ebs-csi-node-rhk2b started at 2023-03-26 17:34:03 +0000 UTC (0+3 container statuses recorded) Mar 26 17:36:43.161: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:36:43.161: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:36:43.161: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:36:43.161: INFO: pod2 started at 2023-03-26 17:36:03 +0000 UTC (0+1 container statuses recorded) Mar 26 17:36:43.161: INFO: Container container1 ready: true, restart count 0 Mar 26 17:36:43.161: INFO: httpd started at 2023-03-26 17:36:06 +0000 UTC (0+1 container statuses recorded) Mar 26 17:36:43.161: INFO: Container httpd ready: true, restart count 0 Mar 26 17:36:43.161: INFO: netserver-2 started at 2023-03-26 17:36:24 +0000 UTC (0+1 container statuses recorded) Mar 26 17:36:43.161: INFO: Container webserver ready: false, restart count 0 Mar 26 17:36:43.161: INFO: pod-subpath-test-dynamicpv-nkd7 started at 2023-03-26 17:36:36 +0000 UTC (2+1 container statuses recorded) Mar 26 17:36:43.161: INFO: Init container init-volume-dynamicpv-nkd7 ready: false, restart count 0 Mar 26 17:36:43.161: INFO: Init container test-init-subpath-dynamicpv-nkd7 ready: false, restart count 0 Mar 26 17:36:43.161: INFO: Container test-container-subpath-dynamicpv-nkd7 ready: false, restart count 0 Mar 26 17:36:43.161: INFO: coredns-autoscaler-7cb5c5b969-xmt8r started at 2023-03-26 17:34:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:36:43.161: INFO: Container autoscaler ready: true, restart count 0 Mar 26 17:36:43.161: INFO: webserver-57d54c6656-5vfsr started at 2023-03-26 17:36:25 +0000 UTC (0+1 container statuses recorded) Mar 26 17:36:43.161: INFO: Container httpd ready: true, restart count 0 Mar 26 17:36:43.161: INFO: ss-0 started at 2023-03-26 17:36:27 +0000 UTC (0+1 container statuses recorded) Mar 26 17:36:43.161: INFO: Container webserver ready: true, restart count 0 Mar 26 17:36:43.161: INFO: csi-mockplugin-attacher-0 started at 2023-03-26 17:36:32 +0000 UTC (0+1 container statuses recorded) Mar 26 17:36:43.161: INFO: Container csi-attacher ready: true, restart count 0 Mar 26 17:36:43.598: INFO: Latency metrics for node i-0c64386131d9d94c5 Mar 26 17:36:43.598: INFO: Logging node info for node i-0ef04f0ca28b74fa4 Mar 26 17:36:43.713: INFO: Node Info: &Node{ObjectMeta:{i-0ef04f0ca28b74fa4 1429588e-1f3b-4a1a-98e2-600879dad0f2 8489 0 2023-03-26 17:21:49 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3b kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0ef04f0ca28b74fa4 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3b topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3b] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0ef04f0ca28b74fa4"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.42.152/19 projectcalico.org/IPv4IPIPTunnelAddr:100.104.100.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-26 17:21:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:21:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:21:50 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-03-26 17:21:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-03-26 17:22:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.7.0/24\"":{}}}} } {calico-node Update v1 2023-03-26 17:22:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2023-03-26 17:36:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {kube-controller-manager Update v1 2023-03-26 17:36:42 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.7.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3b/i-0ef04f0ca28b74fa4,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.7.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-26 17:22:08 +0000 UTC,LastTransitionTime:2023-03-26 17:22:08 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-26 17:36:26 +0000 UTC,LastTransitionTime:2023-03-26 17:21:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-26 17:36:26 +0000 UTC,LastTransitionTime:2023-03-26 17:21:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-26 17:36:26 +0000 UTC,LastTransitionTime:2023-03-26 17:21:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-26 17:36:26 +0000 UTC,LastTransitionTime:2023-03-26 17:22:00 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.152,},NodeAddress{Type:ExternalIP,Address:35.180.133.237,},NodeAddress{Type:InternalDNS,Address:i-0ef04f0ca28b74fa4.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-0ef04f0ca28b74fa4.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-180-133-237.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2cd6131a8983e20721f6c173936bc3,SystemUUID:ec2cd613-1a89-83e2-0721-f6c173936bc3,BootID:34695e7c-23d6-4648-b207-41bcd12c2edf,KernelVersion:5.15.0-1031-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0,KubeProxyVersion:v1.28.0-alpha.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/kube-proxy@sha256:8a03b3147cd7be8e8235ae1cd70cf69aca9ce03ba1cfaffea320540bb5afa496 registry.k8s.io/kube-proxy:v1.28.0-alpha.0],SizeBytes:23896850,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0598563114776e04a,DevicePath:,},},Config:nil,},} Mar 26 17:36:43.714: INFO: Logging kubelet events for node i-0ef04f0ca28b74fa4 Mar 26 17:36:43.825: INFO: Logging pods the kubelet thinks is on node i-0ef04f0ca28b74fa4 Mar 26 17:36:43.935: INFO: netserver-3 started at 2023-03-26 17:36:24 +0000 UTC (0+1 container statuses recorded) Mar 26 17:36:43.935: INFO: Container webserver ready: true, restart count 0 Mar 26 17:36:43.935: INFO: pod-configmaps-28775579-2d84-4eaf-8809-d932f1f3e04f started at 2023-03-26 17:36:07 +0000 UTC (0+3 container statuses recorded) Mar 26 17:36:43.935: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 26 17:36:43.935: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 26 17:36:43.935: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 26 17:36:43.935: INFO: calico-node-bdwdr started at 2023-03-26 17:21:50 +0000 UTC (3+1 container statuses recorded) Mar 26 17:36:43.935: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 26 17:36:43.935: INFO: Init container install-cni ready: true, restart count 0 Mar 26 17:36:43.935: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 26 17:36:43.935: INFO: Container calico-node ready: true, restart count 0 Mar 26 17:36:43.935: INFO: ebs-csi-node-6wp7p started at 2023-03-26 17:21:50 +0000 UTC (0+3 container statuses recorded) Mar 26 17:36:43.935: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:36:43.935: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:36:43.935: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:36:43.935: INFO: coredns-559769c974-6mjw2 started at 2023-03-26 17:22:53 +0000 UTC (0+1 container statuses recorded) Mar 26 17:36:43.935: INFO: Container coredns ready: true, restart count 0 Mar 26 17:36:43.935: INFO: hostexec-i-0ef04f0ca28b74fa4-bzh4f started at 2023-03-26 17:36:36 +0000 UTC (0+1 container statuses recorded) Mar 26 17:36:43.935: INFO: Container agnhost-container ready: true, restart count 0 Mar 26 17:36:43.935: INFO: pod-service-account-defaultsa-mountspec started at 2023-03-26 17:36:42 +0000 UTC (0+1 container statuses recorded) Mar 26 17:36:43.935: INFO: Container token-test ready: false, restart count 0 Mar 26 17:36:43.935: INFO: ss2-0 started at 2023-03-26 17:36:03 +0000 UTC (0+1 container statuses recorded) Mar 26 17:36:43.935: INFO: Container webserver ready: true, restart count 0 Mar 26 17:36:43.935: INFO: webserver-67bd4bf6dc-7r55p started at 2023-03-26 17:36:25 +0000 UTC (0+1 container statuses recorded) Mar 26 17:36:43.935: INFO: Container httpd ready: true, restart count 0 Mar 26 17:36:43.935: INFO: pod-service-account-mountsa started at 2023-03-26 17:36:41 +0000 UTC (0+1 container statuses recorded) Mar 26 17:36:43.935: INFO: Container token-test ready: false, restart count 0 Mar 26 17:36:43.935: INFO: probe-test-0eeb69ff-affc-46c1-b999-3668cab2883b started at 2023-03-26 17:36:41 +0000 UTC (0+1 container statuses recorded) Mar 26 17:36:43.935: INFO: Container probe-test-0eeb69ff-affc-46c1-b999-3668cab2883b ready: false, restart count 0 Mar 26 17:36:43.935: INFO: pvc-tester-45wqt started at 2023-03-26 17:36:42 +0000 UTC (0+1 container statuses recorded) Mar 26 17:36:43.935: INFO: Container write-pod ready: false, restart count 0 Mar 26 17:36:43.935: INFO: kube-proxy-i-0ef04f0ca28b74fa4 started at 2023-03-26 17:21:50 +0000 UTC (0+1 container statuses recorded) Mar 26 17:36:43.935: INFO: Container kube-proxy ready: true, restart count 0 Mar 26 17:36:43.935: INFO: pod-service-account-mountsa-nomountspec started at 2023-03-26 17:36:42 +0000 UTC (0+1 container statuses recorded) Mar 26 17:36:43.935: INFO: Container token-test ready: false, restart count 0 Mar 26 17:36:43.935: INFO: pod-515b416c-1c94-45af-b79f-885981cfef03 started at 2023-03-26 17:36:40 +0000 UTC (0+1 container statuses recorded) Mar 26 17:36:43.935: INFO: Container write-pod ready: false, restart count 0 Mar 26 17:36:44.358: INFO: Latency metrics for node i-0ef04f0ca28b74fa4 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/26/23 17:36:44.358 (4.365s) < Exit [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - dump namespaces | framework.go:209 @ 03/26/23 17:36:44.358 (4.365s) > Enter [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - tear down framework | framework.go:206 @ 03/26/23 17:36:44.358 STEP: Destroying namespace "provisioning-1792" for this suite. - test/e2e/framework/framework.go:351 @ 03/26/23 17:36:44.358 < Exit [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - tear down framework | framework.go:206 @ 03/26/23 17:36:44.476 (118ms) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/26/23 17:36:44.476 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/26/23 17:36:44.476 (0s)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\sExternal\sStorage\s\[Driver\:\sebs\.csi\.aws\.com\]\s\[Testpattern\:\sDynamic\sPV\s\(default\sfs\)\]\ssubPath\sshould\ssupport\sexisting\ssingle\sfile\s\[LinuxOnly\]$'
[FAILED] failed to get logs from pod-subpath-test-dynamicpv-ndvp for test-container-subpath-dynamicpv-ndvp: Get "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/provisioning-8504/pods/pod-subpath-test-dynamicpv-ndvp/log?container=test-container-subpath-dynamicpv-ndvp&previous=false": stream error: stream ID 3523; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/26/23 17:52:11.118from junit_01.xml
> Enter [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/storage/framework/testsuite.go:51 @ 03/26/23 17:51:33.051 < Exit [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/storage/framework/testsuite.go:51 @ 03/26/23 17:51:33.051 (0s) > Enter [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath - set up framework | framework.go:191 @ 03/26/23 17:51:33.051 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/26/23 17:51:33.051 Mar 26 17:51:33.051: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename provisioning - test/e2e/framework/framework.go:250 @ 03/26/23 17:51:33.052 STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 03/26/23 17:51:33.386 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:262 @ 03/26/23 17:51:33.596 < Exit [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath - set up framework | framework.go:191 @ 03/26/23 17:51:33.806 (755ms) > Enter [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/framework/metrics/init/init.go:33 @ 03/26/23 17:51:33.806 < Exit [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/framework/metrics/init/init.go:33 @ 03/26/23 17:51:33.806 (0s) > Enter [It] should support existing single file [LinuxOnly] - test/e2e/storage/testsuites/subpath.go:219 @ 03/26/23 17:51:33.806 Mar 26 17:51:33.806: INFO: Creating resource for dynamic PV Mar 26 17:51:33.806: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} STEP: creating a StorageClass provisioning-8504-e2e-scsl57w - test/e2e/storage/framework/volume_resource.go:102 @ 03/26/23 17:51:33.807 STEP: creating a claim - test/e2e/storage/framework/volume_resource.go:294 @ 03/26/23 17:51:33.914 Mar 26 17:51:33.914: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil STEP: Creating pod pod-subpath-test-dynamicpv-ndvp - test/e2e/storage/testsuites/subpath.go:691 @ 03/26/23 17:51:34.13 STEP: Creating a pod to test subpath - test/e2e/framework/pod/output/output.go:243 @ 03/26/23 17:51:34.13 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/26/23 17:52:10.649 Mar 26 17:52:10.758: INFO: Trying to get logs from node i-0ef04f0ca28b74fa4 pod pod-subpath-test-dynamicpv-ndvp container test-container-subpath-dynamicpv-ndvp: <nil> Mar 26 17:52:10.867: INFO: Failed to get logs from node "i-0ef04f0ca28b74fa4" pod "pod-subpath-test-dynamicpv-ndvp" container "test-container-subpath-dynamicpv-ndvp". Get "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/provisioning-8504/pods/pod-subpath-test-dynamicpv-ndvp/log?container=test-container-subpath-dynamicpv-ndvp&previous=false": stream error: stream ID 3523; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/26/23 17:52:10.867 Mar 26 17:52:11.118: INFO: Unexpected error: <*fmt.wrapError | 0xc0032a18e0>: failed to get logs from pod-subpath-test-dynamicpv-ndvp for test-container-subpath-dynamicpv-ndvp: Get "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/provisioning-8504/pods/pod-subpath-test-dynamicpv-ndvp/log?container=test-container-subpath-dynamicpv-ndvp&previous=false": stream error: stream ID 3523; INTERNAL_ERROR; received from peer { msg: "failed to get logs from pod-subpath-test-dynamicpv-ndvp for test-container-subpath-dynamicpv-ndvp: Get \"https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/provisioning-8504/pods/pod-subpath-test-dynamicpv-ndvp/log?container=test-container-subpath-dynamicpv-ndvp&previous=false\": stream error: stream ID 3523; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc004ef53e0>{ Op: "Get", URL: "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/provisioning-8504/pods/pod-subpath-test-dynamicpv-ndvp/log?container=test-container-subpath-dynamicpv-ndvp&previous=false", Err: <http2.StreamError>{ StreamID: 3523, Code: 2, Cause: <*errors.errorString | 0xc000167680>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from pod-subpath-test-dynamicpv-ndvp for test-container-subpath-dynamicpv-ndvp: Get "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/provisioning-8504/pods/pod-subpath-test-dynamicpv-ndvp/log?container=test-container-subpath-dynamicpv-ndvp&previous=false": stream error: stream ID 3523; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/26/23 17:52:11.118 < Exit [It] should support existing single file [LinuxOnly] - test/e2e/storage/testsuites/subpath.go:219 @ 03/26/23 17:52:11.118 (37.312s) > Enter [AfterEach] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/framework/node/init/init.go:33 @ 03/26/23 17:52:11.118 Mar 26 17:52:11.118: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/framework/node/init/init.go:33 @ 03/26/23 17:52:11.264 (146ms) > Enter [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/storage/testsuites/subpath.go:221 @ 03/26/23 17:52:11.264 STEP: Deleting pod - test/e2e/storage/testsuites/subpath.go:172 @ 03/26/23 17:52:11.264 Mar 26 17:52:11.264: INFO: Deleting pod "pod-subpath-test-dynamicpv-ndvp" in namespace "provisioning-8504" STEP: Deleting pvc - test/e2e/storage/framework/volume_resource.go:181 @ 03/26/23 17:52:11.373 Mar 26 17:52:11.593: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.comq7js7" Mar 26 17:52:11.704: INFO: Waiting up to 5m0s for PersistentVolume pvc-c7a908b5-a344-4a78-9a0e-ecd8072c8bf4 to get deleted Mar 26 17:52:11.809: INFO: PersistentVolume pvc-c7a908b5-a344-4a78-9a0e-ecd8072c8bf4 found and phase=Released (105.695457ms) Mar 26 17:52:16.918: INFO: PersistentVolume pvc-c7a908b5-a344-4a78-9a0e-ecd8072c8bf4 found and phase=Released (5.213944961s) Mar 26 17:52:22.025: INFO: PersistentVolume pvc-c7a908b5-a344-4a78-9a0e-ecd8072c8bf4 found and phase=Released (10.320918128s) Mar 26 17:52:27.133: INFO: PersistentVolume pvc-c7a908b5-a344-4a78-9a0e-ecd8072c8bf4 was removed STEP: Deleting sc - test/e2e/storage/framework/volume_resource.go:228 @ 03/26/23 17:52:27.133 < Exit [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/storage/testsuites/subpath.go:221 @ 03/26/23 17:52:27.244 (15.98s) > Enter [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/framework/metrics/init/init.go:35 @ 03/26/23 17:52:27.244 < Exit [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/framework/metrics/init/init.go:35 @ 03/26/23 17:52:27.244 (0s) > Enter [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - dump namespaces | framework.go:209 @ 03/26/23 17:52:27.244 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/26/23 17:52:27.244 STEP: Collecting events from namespace "provisioning-8504". - test/e2e/framework/debug/dump.go:42 @ 03/26/23 17:52:27.244 STEP: Found 12 events. - test/e2e/framework/debug/dump.go:46 @ 03/26/23 17:52:27.36 Mar 26 17:52:27.360: INFO: At 2023-03-26 17:51:33 +0000 UTC - event for ebs.csi.aws.comq7js7: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding Mar 26 17:52:27.360: INFO: At 2023-03-26 17:51:34 +0000 UTC - event for ebs.csi.aws.comq7js7: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "ebs.csi.aws.com" or manually created by system administrator Mar 26 17:52:27.360: INFO: At 2023-03-26 17:51:34 +0000 UTC - event for ebs.csi.aws.comq7js7: {ebs.csi.aws.com_i-07cdb76b0ac2dbfa1_cb4b68af-2d91-4bfb-9626-7c22a975e7d6 } Provisioning: External provisioner is provisioning volume for claim "provisioning-8504/ebs.csi.aws.comq7js7" Mar 26 17:52:27.360: INFO: At 2023-03-26 17:51:37 +0000 UTC - event for ebs.csi.aws.comq7js7: {ebs.csi.aws.com_i-07cdb76b0ac2dbfa1_cb4b68af-2d91-4bfb-9626-7c22a975e7d6 } ProvisioningSucceeded: Successfully provisioned volume pvc-c7a908b5-a344-4a78-9a0e-ecd8072c8bf4 Mar 26 17:52:27.360: INFO: At 2023-03-26 17:51:38 +0000 UTC - event for pod-subpath-test-dynamicpv-ndvp: {default-scheduler } Scheduled: Successfully assigned provisioning-8504/pod-subpath-test-dynamicpv-ndvp to i-0ef04f0ca28b74fa4 Mar 26 17:52:27.360: INFO: At 2023-03-26 17:51:41 +0000 UTC - event for pod-subpath-test-dynamicpv-ndvp: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-c7a908b5-a344-4a78-9a0e-ecd8072c8bf4" Mar 26 17:52:27.360: INFO: At 2023-03-26 17:51:55 +0000 UTC - event for pod-subpath-test-dynamicpv-ndvp: {kubelet i-0ef04f0ca28b74fa4} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 26 17:52:27.360: INFO: At 2023-03-26 17:51:56 +0000 UTC - event for pod-subpath-test-dynamicpv-ndvp: {kubelet i-0ef04f0ca28b74fa4} Created: Created container init-volume-dynamicpv-ndvp Mar 26 17:52:27.360: INFO: At 2023-03-26 17:51:57 +0000 UTC - event for pod-subpath-test-dynamicpv-ndvp: {kubelet i-0ef04f0ca28b74fa4} Started: Started container init-volume-dynamicpv-ndvp Mar 26 17:52:27.360: INFO: At 2023-03-26 17:51:59 +0000 UTC - event for pod-subpath-test-dynamicpv-ndvp: {kubelet i-0ef04f0ca28b74fa4} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 26 17:52:27.360: INFO: At 2023-03-26 17:51:59 +0000 UTC - event for pod-subpath-test-dynamicpv-ndvp: {kubelet i-0ef04f0ca28b74fa4} Created: Created container test-container-subpath-dynamicpv-ndvp Mar 26 17:52:27.360: INFO: At 2023-03-26 17:52:02 +0000 UTC - event for pod-subpath-test-dynamicpv-ndvp: {kubelet i-0ef04f0ca28b74fa4} Started: Started container test-container-subpath-dynamicpv-ndvp Mar 26 17:52:27.468: INFO: POD NODE PHASE GRACE CONDITIONS Mar 26 17:52:27.468: INFO: Mar 26 17:52:27.580: INFO: Logging node info for node i-011576d1f2b6be6ec Mar 26 17:52:27.688: INFO: Node Info: &Node{ObjectMeta:{i-011576d1f2b6be6ec ef4bb85b-7188-4ef2-8d1a-583f0fcc379a 57400 0 2023-03-26 17:26:11 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3b io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:i-011576d1f2b6be6ec kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3b topology.hostpath.csi/node:i-011576d1f2b6be6ec topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-2828":"i-011576d1f2b6be6ec","ebs.csi.aws.com":"i-011576d1f2b6be6ec"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.41.235/19 projectcalico.org/IPv4IPIPTunnelAddr:100.127.173.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-03-26 17:26:11 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:26:11 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-03-26 17:26:11 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-03-26 17:26:12 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-03-26 17:26:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.8.0/24\"":{}}}} } {calico-node Update v1 2023-03-26 17:26:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-03-26 17:52:24 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-03-26 17:52:24 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.8.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3b/i-011576d1f2b6be6ec,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.8.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-26 17:26:30 +0000 UTC,LastTransitionTime:2023-03-26 17:26:30 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-26 17:52:24 +0000 UTC,LastTransitionTime:2023-03-26 17:26:11 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-26 17:52:24 +0000 UTC,LastTransitionTime:2023-03-26 17:26:11 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-26 17:52:24 +0000 UTC,LastTransitionTime:2023-03-26 17:26:11 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-26 17:52:24 +0000 UTC,LastTransitionTime:2023-03-26 17:26:23 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.41.235,},NodeAddress{Type:ExternalIP,Address:35.180.45.101,},NodeAddress{Type:InternalDNS,Address:i-011576d1f2b6be6ec.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-011576d1f2b6be6ec.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-180-45-101.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec26cc6e198da1950569e38fb3a7f618,SystemUUID:ec26cc6e-198d-a195-0569-e38fb3a7f618,BootID:b67057d3-2187-4008-9056-8a843d3c6813,KernelVersion:5.15.0-1031-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0,KubeProxyVersion:v1.28.0-alpha.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/kube-proxy@sha256:8a03b3147cd7be8e8235ae1cd70cf69aca9ce03ba1cfaffea320540bb5afa496 registry.k8s.io/kube-proxy:v1.28.0-alpha.0],SizeBytes:23896850,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-2828^d5f18f18-cbfe-11ed-8d8b-7e7ec15f5ac0 kubernetes.io/csi/csi-hostpath-ephemeral-2828^db384422-cbfe-11ed-8d8b-7e7ec15f5ac0],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-2828^db384422-cbfe-11ed-8d8b-7e7ec15f5ac0,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-2828^d5f18f18-cbfe-11ed-8d8b-7e7ec15f5ac0,DevicePath:,},},Config:nil,},} Mar 26 17:52:27.689: INFO: Logging kubelet events for node i-011576d1f2b6be6ec Mar 26 17:52:27.823: INFO: Logging pods the kubelet thinks is on node i-011576d1f2b6be6ec Mar 26 17:52:27.944: INFO: simpletest.rc-phxt6 started at 2023-03-26 17:51:41 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:27.944: INFO: Container nginx ready: true, restart count 0 Mar 26 17:52:27.944: INFO: simpletest.rc-mpxk7 started at 2023-03-26 17:51:42 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:27.944: INFO: Container nginx ready: true, restart count 0 Mar 26 17:52:27.944: INFO: ebs-csi-node-7dqmm started at 2023-03-26 17:26:12 +0000 UTC (0+3 container statuses recorded) Mar 26 17:52:27.944: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:52:27.944: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:52:27.944: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:52:27.944: INFO: inline-volume-tester2-nvq4f started at 2023-03-26 17:51:38 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:27.944: INFO: Container csi-volume-tester ready: true, restart count 0 Mar 26 17:52:27.944: INFO: calico-node-tmjhr started at 2023-03-26 17:26:12 +0000 UTC (3+1 container statuses recorded) Mar 26 17:52:27.944: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 26 17:52:27.944: INFO: Init container install-cni ready: true, restart count 0 Mar 26 17:52:27.944: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 26 17:52:27.944: INFO: Container calico-node ready: true, restart count 0 Mar 26 17:52:27.944: INFO: simpletest.rc-ztpwx started at 2023-03-26 17:51:40 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:27.944: INFO: Container nginx ready: true, restart count 0 Mar 26 17:52:27.944: INFO: csi-hostpathplugin-0 started at 2023-03-26 17:51:27 +0000 UTC (0+7 container statuses recorded) Mar 26 17:52:27.944: INFO: Container csi-attacher ready: true, restart count 0 Mar 26 17:52:27.944: INFO: Container csi-provisioner ready: true, restart count 0 Mar 26 17:52:27.944: INFO: Container csi-resizer ready: true, restart count 0 Mar 26 17:52:27.944: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 26 17:52:27.944: INFO: Container hostpath ready: true, restart count 0 Mar 26 17:52:27.944: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:52:27.944: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:52:27.944: INFO: simpletest.rc-zwb8r started at 2023-03-26 17:51:43 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:27.944: INFO: Container nginx ready: true, restart count 0 Mar 26 17:52:27.944: INFO: coredns-559769c974-58thj started at 2023-03-26 17:34:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:27.944: INFO: Container coredns ready: true, restart count 0 Mar 26 17:52:27.944: INFO: inline-volume-tester-vmnzt started at 2023-03-26 17:51:29 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:27.944: INFO: Container csi-volume-tester ready: true, restart count 0 Mar 26 17:52:27.944: INFO: simpletest.rc-mpxtc started at 2023-03-26 17:51:44 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:27.944: INFO: Container nginx ready: true, restart count 0 Mar 26 17:52:27.944: INFO: simpletest.rc-nvstn started at 2023-03-26 17:51:40 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:27.944: INFO: Container nginx ready: true, restart count 0 Mar 26 17:52:27.944: INFO: simpletest.rc-hxw7j started at 2023-03-26 17:51:41 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:27.944: INFO: Container nginx ready: true, restart count 0 Mar 26 17:52:27.944: INFO: simpletest.rc-r7pzv started at 2023-03-26 17:51:42 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:27.944: INFO: Container nginx ready: true, restart count 0 Mar 26 17:52:27.944: INFO: simpletest.rc-mz72c started at 2023-03-26 17:51:43 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:27.944: INFO: Container nginx ready: true, restart count 0 Mar 26 17:52:27.944: INFO: simpletest.rc-mtq9f started at 2023-03-26 17:51:40 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:27.944: INFO: Container nginx ready: true, restart count 0 Mar 26 17:52:27.944: INFO: simpletest.rc-h75r4 started at 2023-03-26 17:51:40 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:27.944: INFO: Container nginx ready: true, restart count 0 Mar 26 17:52:27.944: INFO: simpletest.rc-k8lwr started at 2023-03-26 17:51:40 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:27.944: INFO: Container nginx ready: true, restart count 0 Mar 26 17:52:27.944: INFO: simpletest.rc-q7glq started at 2023-03-26 17:51:41 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:27.944: INFO: Container nginx ready: true, restart count 0 Mar 26 17:52:27.944: INFO: simpletest.rc-wgzjd started at 2023-03-26 17:51:40 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:27.944: INFO: Container nginx ready: true, restart count 0 Mar 26 17:52:27.944: INFO: service-headless-cjqr2 started at 2023-03-26 17:51:57 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:27.944: INFO: Container service-headless ready: true, restart count 0 Mar 26 17:52:27.944: INFO: kube-proxy-i-011576d1f2b6be6ec started at 2023-03-26 17:26:12 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:27.944: INFO: Container kube-proxy ready: true, restart count 0 Mar 26 17:52:27.944: INFO: simpletest.rc-thdqb started at 2023-03-26 17:51:44 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:27.944: INFO: Container nginx ready: true, restart count 0 Mar 26 17:52:28.443: INFO: Latency metrics for node i-011576d1f2b6be6ec Mar 26 17:52:28.443: INFO: Logging node info for node i-07cdb76b0ac2dbfa1 Mar 26 17:52:28.555: INFO: Node Info: &Node{ObjectMeta:{i-07cdb76b0ac2dbfa1 d3bcec50-934c-432e-a590-2a35577f3a0d 51300 0 2023-03-26 17:17:19 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3b kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-07cdb76b0ac2dbfa1 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:eu-west-3b topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3b] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-07cdb76b0ac2dbfa1"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.63.230/19 projectcalico.org/IPv4IPIPTunnelAddr:100.127.118.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-26 17:17:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-03-26 17:17:20 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {calico-node Update v1 2023-03-26 17:18:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {aws-cloud-controller-manager Update v1 2023-03-26 17:18:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:18:48 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-03-26 17:18:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.5.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-03-26 17:51:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.5.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3b/i-07cdb76b0ac2dbfa1,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.5.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892301824 0} {<nil>} 3801076Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787444224 0} {<nil>} 3698676Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-26 17:18:46 +0000 UTC,LastTransitionTime:2023-03-26 17:18:46 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-26 17:51:08 +0000 UTC,LastTransitionTime:2023-03-26 17:17:19 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-26 17:51:08 +0000 UTC,LastTransitionTime:2023-03-26 17:17:19 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-26 17:51:08 +0000 UTC,LastTransitionTime:2023-03-26 17:17:19 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-26 17:51:08 +0000 UTC,LastTransitionTime:2023-03-26 17:18:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.63.230,},NodeAddress{Type:ExternalIP,Address:15.237.44.201,},NodeAddress{Type:InternalDNS,Address:i-07cdb76b0ac2dbfa1.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-07cdb76b0ac2dbfa1.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-237-44-201.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2824f976de88ff768c75c0d62c774f,SystemUUID:ec2824f9-76de-88ff-768c-75c0d62c774f,BootID:bc1e3e86-fc91-4be5-acba-90ac2a46faf2,KernelVersion:5.15.0-1031-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0,KubeProxyVersion:v1.28.0-alpha.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 registry.k8s.io/etcd:3.4.3-0],SizeBytes:100947667,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:9ce33ba33d8e738a5b85ed50b5080ac746deceed4a7496c550927a7a19ca3b6d registry.k8s.io/etcd:3.5.0-0],SizeBytes:99868722,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 registry.k8s.io/etcd:3.5.1-0],SizeBytes:98888614,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 registry.k8s.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:0d2ab6b15b4fe0b903b9e81192d942fb39c29be61fe341cd16db5d0165b0435c registry.k8s.io/etcd:3.3.17-0],SizeBytes:85524408,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:17da501f5d2a675be46040422a27b7cc21b8a43895ac998b171db1c346f361f7 registry.k8s.io/etcd:3.3.10-0],SizeBytes:76162358,},ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager-slim@sha256:8727adc059334e0e3329dbccce116a734da4a090da5e86c8cddccaf333caa666 registry.k8s.io/etcdadm/etcd-manager-slim:v3.0.20230201],SizeBytes:63926165,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:905d7ca17fd02bc24c0eba9a062753aba15db3e31422390bc3238eb762339b20 registry.k8s.io/etcd:3.2.24-1],SizeBytes:63423287,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:45208814,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:43629015,},ContainerImage{Names:[registry.k8s.io/kube-apiserver@sha256:49934a29c559e79ed19fc38b4697b18d8fe174b17bf56192588575f980c93956 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0],SizeBytes:33212506,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:2b6acd7f677f76ffe12ecf3ea7df92eb9b1bdb07336d1ac2a54c7631fb753f7e docker.io/calico/kube-controllers:v3.24.5],SizeBytes:31137169,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager@sha256:974748384634982c73527fdb3c9ec0ec476bc0d52b3dd1d611a380b7f99af1f3 registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0],SizeBytes:30820280,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/kube-proxy@sha256:8a03b3147cd7be8e8235ae1cd70cf69aca9ce03ba1cfaffea320540bb5afa496 registry.k8s.io/kube-proxy:v1.28.0-alpha.0],SizeBytes:23896850,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/kube-scheduler@sha256:cbf4007abb076188f16b975bc2b74452603cc7b34c60a29d92f14c38ad02dc11 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0],SizeBytes:18078674,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:5074723,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 26 17:52:28.555: INFO: Logging kubelet events for node i-07cdb76b0ac2dbfa1 Mar 26 17:52:28.683: INFO: Logging pods the kubelet thinks is on node i-07cdb76b0ac2dbfa1 Mar 26 17:52:28.800: INFO: ebs-csi-controller-79f984545f-vq8bz started at 2023-03-26 17:19:49 +0000 UTC (0+5 container statuses recorded) Mar 26 17:52:28.800: INFO: Container csi-attacher ready: true, restart count 0 Mar 26 17:52:28.800: INFO: Container csi-provisioner ready: true, restart count 0 Mar 26 17:52:28.800: INFO: Container csi-resizer ready: true, restart count 0 Mar 26 17:52:28.800: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:52:28.800: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:52:28.800: INFO: dns-controller-69987775c6-ntctn started at 2023-03-26 17:17:49 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:28.800: INFO: Container dns-controller ready: true, restart count 0 Mar 26 17:52:28.800: INFO: aws-cloud-controller-manager-tbxvs started at 2023-03-26 17:18:29 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:28.800: INFO: Container aws-cloud-controller-manager ready: true, restart count 0 Mar 26 17:52:28.800: INFO: calico-node-5cszq started at 2023-03-26 17:18:29 +0000 UTC (3+1 container statuses recorded) Mar 26 17:52:28.800: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 26 17:52:28.800: INFO: Init container install-cni ready: true, restart count 0 Mar 26 17:52:28.800: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 26 17:52:28.800: INFO: Container calico-node ready: true, restart count 0 Mar 26 17:52:28.800: INFO: etcd-manager-events-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (11+1 container statuses recorded) Mar 26 17:52:28.800: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0 Mar 26 17:52:28.800: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0 Mar 26 17:52:28.800: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0 Mar 26 17:52:28.800: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0 Mar 26 17:52:28.800: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0 Mar 26 17:52:28.800: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0 Mar 26 17:52:28.800: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0 Mar 26 17:52:28.800: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0 Mar 26 17:52:28.800: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0 Mar 26 17:52:28.800: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0 Mar 26 17:52:28.800: INFO: Init container init-etcd-3-5-7 ready: true, restart count 0 Mar 26 17:52:28.800: INFO: Container etcd-manager ready: true, restart count 0 Mar 26 17:52:28.800: INFO: etcd-manager-main-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (11+1 container statuses recorded) Mar 26 17:52:28.800: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0 Mar 26 17:52:28.800: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0 Mar 26 17:52:28.800: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0 Mar 26 17:52:28.800: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0 Mar 26 17:52:28.800: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0 Mar 26 17:52:28.800: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0 Mar 26 17:52:28.800: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0 Mar 26 17:52:28.800: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0 Mar 26 17:52:28.800: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0 Mar 26 17:52:28.800: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0 Mar 26 17:52:28.800: INFO: Init container init-etcd-3-5-7 ready: true, restart count 0 Mar 26 17:52:28.800: INFO: Container etcd-manager ready: true, restart count 0 Mar 26 17:52:28.800: INFO: kube-apiserver-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (0+2 container statuses recorded) Mar 26 17:52:28.800: INFO: Container healthcheck ready: true, restart count 0 Mar 26 17:52:28.800: INFO: Container kube-apiserver ready: true, restart count 2 Mar 26 17:52:28.800: INFO: ebs-csi-node-2r7mc started at 2023-03-26 17:18:29 +0000 UTC (0+3 container statuses recorded) Mar 26 17:52:28.800: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:52:28.800: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:52:28.800: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:52:28.800: INFO: kops-controller-thh8s started at 2023-03-26 17:18:29 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:28.800: INFO: Container kops-controller ready: true, restart count 0 Mar 26 17:52:28.800: INFO: kube-controller-manager-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:28.800: INFO: Container kube-controller-manager ready: true, restart count 4 Mar 26 17:52:28.800: INFO: kube-proxy-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:28.800: INFO: Container kube-proxy ready: true, restart count 0 Mar 26 17:52:28.800: INFO: kube-scheduler-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:28.800: INFO: Container kube-scheduler ready: true, restart count 0 Mar 26 17:52:28.800: INFO: calico-kube-controllers-55f488656-mjjr8 started at 2023-03-26 17:18:51 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:28.800: INFO: Container calico-kube-controllers ready: true, restart count 0 Mar 26 17:52:29.293: INFO: Latency metrics for node i-07cdb76b0ac2dbfa1 Mar 26 17:52:29.293: INFO: Logging node info for node i-0b2c24f535e511ae5 Mar 26 17:52:29.399: INFO: Node Info: &Node{ObjectMeta:{i-0b2c24f535e511ae5 8f866583-6b9f-42fc-932a-c5558d02f775 57646 0 2023-03-26 17:30:16 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3b kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0b2c24f535e511ae5 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3b topology.hostpath.csi/node:i-0b2c24f535e511ae5 topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-9696":"i-0b2c24f535e511ae5","csi-hostpath-read-write-once-pod-2201":"i-0b2c24f535e511ae5","ebs.csi.aws.com":"i-0b2c24f535e511ae5"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.54.135/19 projectcalico.org/IPv4IPIPTunnelAddr:100.113.179.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-03-26 17:30:16 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:30:16 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-03-26 17:30:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-03-26 17:30:17 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-03-26 17:30:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.9.0/24\"":{}}}} } {calico-node Update v1 2023-03-26 17:30:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-03-26 17:52:26 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-03-26 17:52:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.9.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3b/i-0b2c24f535e511ae5,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.9.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-26 17:30:43 +0000 UTC,LastTransitionTime:2023-03-26 17:30:43 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-26 17:52:26 +0000 UTC,LastTransitionTime:2023-03-26 17:30:16 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-26 17:52:26 +0000 UTC,LastTransitionTime:2023-03-26 17:30:16 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-26 17:52:26 +0000 UTC,LastTransitionTime:2023-03-26 17:30:16 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-26 17:52:26 +0000 UTC,LastTransitionTime:2023-03-26 17:30:34 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.54.135,},NodeAddress{Type:ExternalIP,Address:13.38.65.62,},NodeAddress{Type:InternalDNS,Address:i-0b2c24f535e511ae5.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-0b2c24f535e511ae5.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-38-65-62.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec256778270128bdfe9c2066f7fedcda,SystemUUID:ec256778-2701-28bd-fe9c-2066f7fedcda,BootID:542316ee-6bea-470f-85fc-51e338ca7e74,KernelVersion:5.15.0-1031-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0,KubeProxyVersion:v1.28.0-alpha.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/kube-proxy@sha256:8a03b3147cd7be8e8235ae1cd70cf69aca9ce03ba1cfaffea320540bb5afa496 registry.k8s.io/kube-proxy:v1.28.0-alpha.0],SizeBytes:23896850,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-04491415360e74399],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-04491415360e74399,DevicePath:,},},Config:nil,},} Mar 26 17:52:29.399: INFO: Logging kubelet events for node i-0b2c24f535e511ae5 Mar 26 17:52:29.514: INFO: Logging pods the kubelet thinks is on node i-0b2c24f535e511ae5 Mar 26 17:52:29.655: INFO: kube-proxy-i-0b2c24f535e511ae5 started at 2023-03-26 17:30:17 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:29.655: INFO: Container kube-proxy ready: true, restart count 0 Mar 26 17:52:29.655: INFO: simpletest.rc-w5mpc started at 2023-03-26 17:51:40 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:29.655: INFO: Container nginx ready: true, restart count 0 Mar 26 17:52:29.655: INFO: simpletest.rc-p8bt7 started at 2023-03-26 17:51:41 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:29.655: INFO: Container nginx ready: true, restart count 0 Mar 26 17:52:29.655: INFO: simpletest.rc-p4t8z started at 2023-03-26 17:51:42 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:29.655: INFO: Container nginx ready: true, restart count 0 Mar 26 17:52:29.655: INFO: verify-service-up-exec-pod-q95jk started at 2023-03-26 17:52:21 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:29.655: INFO: Container agnhost-container ready: true, restart count 0 Mar 26 17:52:29.655: INFO: simpletest.rc-wvb5d started at 2023-03-26 17:51:40 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:29.655: INFO: Container nginx ready: true, restart count 0 Mar 26 17:52:29.655: INFO: simpletest.rc-tn7pb started at 2023-03-26 17:51:40 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:29.655: INFO: Container nginx ready: true, restart count 0 Mar 26 17:52:29.655: INFO: simpletest.rc-xxvj6 started at 2023-03-26 17:51:43 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:29.655: INFO: Container nginx ready: true, restart count 0 Mar 26 17:52:29.655: INFO: calico-node-rdfns started at 2023-03-26 17:30:17 +0000 UTC (3+1 container statuses recorded) Mar 26 17:52:29.655: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 26 17:52:29.655: INFO: Init container install-cni ready: true, restart count 0 Mar 26 17:52:29.655: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 26 17:52:29.655: INFO: Container calico-node ready: true, restart count 0 Mar 26 17:52:29.655: INFO: ebs-csi-node-x9jln started at 2023-03-26 17:30:17 +0000 UTC (0+3 container statuses recorded) Mar 26 17:52:29.655: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:52:29.655: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:52:29.655: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:52:29.655: INFO: simpletest.rc-swd4t started at 2023-03-26 17:51:40 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:29.655: INFO: Container nginx ready: true, restart count 0 Mar 26 17:52:29.655: INFO: service-headless-toggled-pfj8h started at 2023-03-26 17:52:12 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:29.655: INFO: Container service-headless-toggled ready: true, restart count 0 Mar 26 17:52:29.655: INFO: simpletest.rc-wtx8q started at 2023-03-26 17:51:40 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:29.655: INFO: Container nginx ready: true, restart count 0 Mar 26 17:52:29.655: INFO: execpod9twqt started at 2023-03-26 17:52:26 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:29.655: INFO: Container agnhost-container ready: false, restart count 0 Mar 26 17:52:29.655: INFO: csi-hostpathplugin-0 started at 2023-03-26 17:51:04 +0000 UTC (0+7 container statuses recorded) Mar 26 17:52:29.655: INFO: Container csi-attacher ready: true, restart count 0 Mar 26 17:52:29.655: INFO: Container csi-provisioner ready: true, restart count 0 Mar 26 17:52:29.655: INFO: Container csi-resizer ready: true, restart count 0 Mar 26 17:52:29.655: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 26 17:52:29.655: INFO: Container hostpath ready: true, restart count 0 Mar 26 17:52:29.655: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:52:29.655: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:52:29.655: INFO: webserver-pod started at 2023-03-26 17:49:38 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:29.655: INFO: Container agnhost ready: false, restart count 0 Mar 26 17:52:29.655: INFO: csi-hostpathplugin-0 started at 2023-03-26 17:51:28 +0000 UTC (0+7 container statuses recorded) Mar 26 17:52:29.655: INFO: Container csi-attacher ready: true, restart count 0 Mar 26 17:52:29.655: INFO: Container csi-provisioner ready: true, restart count 0 Mar 26 17:52:29.655: INFO: Container csi-resizer ready: true, restart count 0 Mar 26 17:52:29.655: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 26 17:52:29.655: INFO: Container hostpath ready: true, restart count 0 Mar 26 17:52:29.655: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:52:29.655: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:52:29.655: INFO: simpletest.rc-qmlpx started at 2023-03-26 17:51:43 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:29.655: INFO: Container nginx ready: true, restart count 0 Mar 26 17:52:29.655: INFO: simpletest.rc-srjjc started at 2023-03-26 17:51:43 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:29.655: INFO: Container nginx ready: true, restart count 0 Mar 26 17:52:29.655: INFO: simpletest.rc-rl5jt started at 2023-03-26 17:51:40 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:29.655: INFO: Container nginx ready: true, restart count 0 Mar 26 17:52:29.655: INFO: simpletest.rc-zwvtm started at 2023-03-26 17:51:41 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:29.655: INFO: Container nginx ready: true, restart count 0 Mar 26 17:52:29.655: INFO: liveness-aa281934-a87f-4590-8112-09cc2a18791a started at 2023-03-26 17:51:42 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:29.655: INFO: Container agnhost-container ready: true, restart count 1 Mar 26 17:52:29.655: INFO: pod-logs-websocket-b86e2ece-77c8-44a8-a600-ac67b366a1eb started at 2023-03-26 17:52:19 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:29.655: INFO: Container main ready: true, restart count 0 Mar 26 17:52:29.655: INFO: downwardapi-volume-b8b280ec-296c-4f2c-a28e-75f612e55f00 started at 2023-03-26 17:52:27 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:29.655: INFO: Container client-container ready: false, restart count 0 Mar 26 17:52:29.655: INFO: csi-mockplugin-0 started at 2023-03-26 17:50:48 +0000 UTC (0+4 container statuses recorded) Mar 26 17:52:29.655: INFO: Container busybox ready: true, restart count 0 Mar 26 17:52:29.655: INFO: Container csi-provisioner ready: true, restart count 0 Mar 26 17:52:29.655: INFO: Container driver-registrar ready: true, restart count 0 Mar 26 17:52:29.655: INFO: Container mock ready: true, restart count 0 Mar 26 17:52:29.655: INFO: simpletest.rc-wgngn started at 2023-03-26 17:51:42 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:29.655: INFO: Container nginx ready: true, restart count 0 Mar 26 17:52:29.655: INFO: service-headless-pdh7r started at 2023-03-26 17:51:57 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:29.655: INFO: Container service-headless ready: true, restart count 0 Mar 26 17:52:29.655: INFO: simpletest.rc-tqhcj started at 2023-03-26 17:51:40 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:29.655: INFO: Container nginx ready: true, restart count 0 Mar 26 17:52:29.655: INFO: simpletest.rc-zzjc2 started at 2023-03-26 17:51:42 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:29.655: INFO: Container nginx ready: true, restart count 0 Mar 26 17:52:29.655: INFO: csi-hostpathplugin-0 started at 2023-03-26 17:50:56 +0000 UTC (0+7 container statuses recorded) Mar 26 17:52:29.655: INFO: Container csi-attacher ready: true, restart count 0 Mar 26 17:52:29.655: INFO: Container csi-provisioner ready: true, restart count 0 Mar 26 17:52:29.655: INFO: Container csi-resizer ready: true, restart count 0 Mar 26 17:52:29.655: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 26 17:52:29.655: INFO: Container hostpath ready: true, restart count 0 Mar 26 17:52:29.655: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:52:29.655: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:52:29.655: INFO: externalip-test-rl9jc started at 2023-03-26 17:52:20 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:29.655: INFO: Container externalip-test ready: true, restart count 0 Mar 26 17:52:29.655: INFO: pod-subpath-test-dynamicpv-n7lt started at 2023-03-26 17:52:24 +0000 UTC (1+2 container statuses recorded) Mar 26 17:52:29.655: INFO: Init container test-init-subpath-dynamicpv-n7lt ready: false, restart count 0 Mar 26 17:52:29.655: INFO: Container test-container-subpath-dynamicpv-n7lt ready: false, restart count 0 Mar 26 17:52:29.655: INFO: Container test-container-volume-dynamicpv-n7lt ready: false, restart count 0 Mar 26 17:52:29.655: INFO: simpletest.rc-xrn8w started at 2023-03-26 17:51:42 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:29.655: INFO: Container nginx ready: true, restart count 0 Mar 26 17:52:29.655: INFO: verify-service-up-host-exec-pod started at 2023-03-26 17:52:18 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:29.655: INFO: Container agnhost-container ready: true, restart count 0 Mar 26 17:52:30.711: INFO: Latency metrics for node i-0b2c24f535e511ae5 Mar 26 17:52:30.711: INFO: Logging node info for node i-0c64386131d9d94c5 Mar 26 17:52:30.896: INFO: Node Info: &Node{ObjectMeta:{i-0c64386131d9d94c5 6c5a59f3-69fd-488b-b94e-23777e242a7e 57133 0 2023-03-26 17:34:02 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3b kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0c64386131d9d94c5 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3b topology.hostpath.csi/node:i-0c64386131d9d94c5 topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3b] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0c64386131d9d94c5"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.63.240/19 projectcalico.org/IPv4IPIPTunnelAddr:100.122.71.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-03-26 17:34:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:34:02 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-03-26 17:34:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-03-26 17:34:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-03-26 17:34:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.10.0/24\"":{}}}} } {calico-node Update v1 2023-03-26 17:34:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2023-03-26 17:52:20 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.10.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3b/i-0c64386131d9d94c5,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.10.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-26 17:34:21 +0000 UTC,LastTransitionTime:2023-03-26 17:34:21 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-26 17:52:17 +0000 UTC,LastTransitionTime:2023-03-26 17:34:02 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-26 17:52:17 +0000 UTC,LastTransitionTime:2023-03-26 17:34:02 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-26 17:52:17 +0000 UTC,LastTransitionTime:2023-03-26 17:34:02 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-26 17:52:17 +0000 UTC,LastTransitionTime:2023-03-26 17:34:14 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.63.240,},NodeAddress{Type:ExternalIP,Address:15.236.210.84,},NodeAddress{Type:InternalDNS,Address:i-0c64386131d9d94c5.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-0c64386131d9d94c5.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-236-210-84.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2c2c56ef9295a859b1f844cff158e8,SystemUUID:ec2c2c56-ef92-95a8-59b1-f844cff158e8,BootID:825bc25d-7144-4ec9-8dfb-f77f9cde8c31,KernelVersion:5.15.0-1031-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0,KubeProxyVersion:v1.28.0-alpha.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/kube-proxy@sha256:8a03b3147cd7be8e8235ae1cd70cf69aca9ce03ba1cfaffea320540bb5afa496 registry.k8s.io/kube-proxy:v1.28.0-alpha.0],SizeBytes:23896850,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:13ac9b3c476d7290a4451d65d09d6016a2cb89836ffbfa4eae55b72731a22080 registry.k8s.io/build-image/distroless-iptables:v0.2.2],SizeBytes:7729580,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-021fe00bc7ee4a15c],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 26 17:52:30.896: INFO: Logging kubelet events for node i-0c64386131d9d94c5 Mar 26 17:52:31.019: INFO: Logging pods the kubelet thinks is on node i-0c64386131d9d94c5 Mar 26 17:52:31.136: INFO: test-runtimeclass-runtimeclass-1375-preconfigured-handler-fgd4d started at 2023-03-26 17:52:30 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:31.136: INFO: Container test ready: false, restart count 0 Mar 26 17:52:31.136: INFO: pod-secrets-65c1903f-ac1d-4994-a139-1322ba03876e started at 2023-03-26 17:50:30 +0000 UTC (0+3 container statuses recorded) Mar 26 17:52:31.136: INFO: Container creates-volume-test ready: true, restart count 0 Mar 26 17:52:31.136: INFO: Container dels-volume-test ready: true, restart count 0 Mar 26 17:52:31.136: INFO: Container upds-volume-test ready: true, restart count 0 Mar 26 17:52:31.136: INFO: simpletest.rc-tmk9x started at 2023-03-26 17:51:40 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:31.136: INFO: Container nginx ready: true, restart count 0 Mar 26 17:52:31.136: INFO: hostexec-i-0c64386131d9d94c5-c8mwc started at 2023-03-26 17:51:39 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:31.136: INFO: Container agnhost-container ready: true, restart count 0 Mar 26 17:52:31.136: INFO: image-pull-test610e3e2c-c32c-4b1f-b25a-84e0646a3ea8 started at 2023-03-26 17:52:30 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:31.136: INFO: Container image-pull-test ready: false, restart count 0 Mar 26 17:52:31.136: INFO: simpletest.rc-wrnq8 started at 2023-03-26 17:51:44 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:31.136: INFO: Container nginx ready: true, restart count 0 Mar 26 17:52:31.136: INFO: pod-15c69657-7ff8-42a3-bacf-9215772e4f61 started at 2023-03-26 17:51:49 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:31.136: INFO: Container write-pod ready: true, restart count 0 Mar 26 17:52:31.136: INFO: pod-13bf6997-74aa-4622-8d3b-f67b4535547c started at 2023-03-26 17:52:11 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:31.136: INFO: Container write-pod ready: false, restart count 0 Mar 26 17:52:31.136: INFO: simpletest.rc-ttmrr started at 2023-03-26 17:51:40 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:31.136: INFO: Container nginx ready: true, restart count 0 Mar 26 17:52:31.136: INFO: simpletest.rc-rzmwv started at 2023-03-26 17:51:40 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:31.136: INFO: Container nginx ready: true, restart count 0 Mar 26 17:52:31.136: INFO: ebs-csi-node-rhk2b started at 2023-03-26 17:34:03 +0000 UTC (0+3 container statuses recorded) Mar 26 17:52:31.136: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:52:31.136: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:52:31.136: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:52:31.136: INFO: simpletest.rc-t4jnw started at 2023-03-26 17:51:41 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:31.136: INFO: Container nginx ready: true, restart count 0 Mar 26 17:52:31.136: INFO: simpletest.rc-ztfnt started at 2023-03-26 17:51:43 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:31.136: INFO: Container nginx ready: true, restart count 0 Mar 26 17:52:31.136: INFO: coredns-autoscaler-7cb5c5b969-xmt8r started at 2023-03-26 17:34:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:31.136: INFO: Container autoscaler ready: true, restart count 0 Mar 26 17:52:31.136: INFO: simpletest.rc-xm2bv started at 2023-03-26 17:51:40 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:31.136: INFO: Container nginx ready: true, restart count 0 Mar 26 17:52:31.136: INFO: simpletest.rc-tsk69 started at 2023-03-26 17:51:40 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:31.136: INFO: Container nginx ready: true, restart count 0 Mar 26 17:52:31.136: INFO: externalip-test-kkklg started at 2023-03-26 17:52:20 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:31.136: INFO: Container externalip-test ready: true, restart count 0 Mar 26 17:52:31.136: INFO: verify-service-down-host-exec-pod started at 2023-03-26 17:52:30 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:31.136: INFO: Container agnhost-container ready: false, restart count 0 Mar 26 17:52:31.136: INFO: service-headless-toggled-4rcm7 started at 2023-03-26 17:52:12 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:31.136: INFO: Container service-headless-toggled ready: true, restart count 0 Mar 26 17:52:31.136: INFO: simpletest.rc-tj6d6 started at 2023-03-26 17:51:40 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:31.136: INFO: Container nginx ready: true, restart count 0 Mar 26 17:52:31.136: INFO: kube-proxy-i-0c64386131d9d94c5 started at 2023-03-26 17:34:03 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:31.136: INFO: Container kube-proxy ready: true, restart count 0 Mar 26 17:52:31.136: INFO: calico-node-jl5lk started at 2023-03-26 17:34:03 +0000 UTC (3+1 container statuses recorded) Mar 26 17:52:31.136: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 26 17:52:31.136: INFO: Init container install-cni ready: true, restart count 0 Mar 26 17:52:31.136: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 26 17:52:31.136: INFO: Container calico-node ready: true, restart count 0 Mar 26 17:52:31.136: INFO: simpletest.rc-t9sdq started at 2023-03-26 17:51:40 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:31.136: INFO: Container nginx ready: true, restart count 0 Mar 26 17:52:31.690: INFO: Latency metrics for node i-0c64386131d9d94c5 Mar 26 17:52:31.690: INFO: Logging node info for node i-0ef04f0ca28b74fa4 Mar 26 17:52:31.800: INFO: Node Info: &Node{ObjectMeta:{i-0ef04f0ca28b74fa4 1429588e-1f3b-4a1a-98e2-600879dad0f2 56846 0 2023-03-26 17:21:49 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3b kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0ef04f0ca28b74fa4 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3b topology.hostpath.csi/node:i-0ef04f0ca28b74fa4 topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3b] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0ef04f0ca28b74fa4"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.42.152/19 projectcalico.org/IPv4IPIPTunnelAddr:100.104.100.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-26 17:21:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:21:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:21:50 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-03-26 17:21:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-03-26 17:22:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.7.0/24\"":{}}}} } {calico-node Update v1 2023-03-26 17:22:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2023-03-26 17:52:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.7.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3b/i-0ef04f0ca28b74fa4,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.7.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-26 17:22:08 +0000 UTC,LastTransitionTime:2023-03-26 17:22:08 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-26 17:52:15 +0000 UTC,LastTransitionTime:2023-03-26 17:21:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-26 17:52:15 +0000 UTC,LastTransitionTime:2023-03-26 17:21:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-26 17:52:15 +0000 UTC,LastTransitionTime:2023-03-26 17:21:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-26 17:52:15 +0000 UTC,LastTransitionTime:2023-03-26 17:22:00 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.152,},NodeAddress{Type:ExternalIP,Address:35.180.133.237,},NodeAddress{Type:InternalDNS,Address:i-0ef04f0ca28b74fa4.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-0ef04f0ca28b74fa4.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-180-133-237.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2cd6131a8983e20721f6c173936bc3,SystemUUID:ec2cd613-1a89-83e2-0721-f6c173936bc3,BootID:34695e7c-23d6-4648-b207-41bcd12c2edf,KernelVersion:5.15.0-1031-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0,KubeProxyVersion:v1.28.0-alpha.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/kube-proxy@sha256:8a03b3147cd7be8e8235ae1cd70cf69aca9ce03ba1cfaffea320540bb5afa496 registry.k8s.io/kube-proxy:v1.28.0-alpha.0],SizeBytes:23896850,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 26 17:52:31.800: INFO: Logging kubelet events for node i-0ef04f0ca28b74fa4 Mar 26 17:52:31.921: INFO: Logging pods the kubelet thinks is on node i-0ef04f0ca28b74fa4 Mar 26 17:52:32.040: INFO: liveness-98819b4b-5e8c-4707-afa5-47a774468375 started at 2023-03-26 17:50:16 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:32.040: INFO: Container agnhost-container ready: true, restart count 0 Mar 26 17:52:32.040: INFO: labelsupdate89553ffe-db57-485c-8c2e-3033dcae22c6 started at 2023-03-26 17:51:44 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:32.040: INFO: Container client-container ready: true, restart count 0 Mar 26 17:52:32.040: INFO: service-headless-toggled-r679l started at 2023-03-26 17:52:12 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:32.040: INFO: Container service-headless-toggled ready: true, restart count 0 Mar 26 17:52:32.040: INFO: startup-86fac25e-94ed-46f5-87c0-9776095c4056 started at 2023-03-26 17:48:56 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:32.040: INFO: Container busybox ready: false, restart count 0 Mar 26 17:52:32.040: INFO: simpletest.rc-v8pjh started at 2023-03-26 17:51:42 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:32.040: INFO: Container nginx ready: true, restart count 0 Mar 26 17:52:32.040: INFO: simpletest.rc-zcr8n started at 2023-03-26 17:51:40 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:32.040: INFO: Container nginx ready: true, restart count 0 Mar 26 17:52:32.040: INFO: simpletest.rc-tpkw7 started at 2023-03-26 17:51:41 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:32.040: INFO: Container nginx ready: true, restart count 0 Mar 26 17:52:32.040: INFO: simpletest.rc-zp728 started at 2023-03-26 17:51:40 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:32.040: INFO: Container nginx ready: true, restart count 0 Mar 26 17:52:32.040: INFO: coredns-559769c974-6mjw2 started at 2023-03-26 17:22:53 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:32.040: INFO: Container coredns ready: true, restart count 0 Mar 26 17:52:32.040: INFO: simpletest.rc-xj4rh started at 2023-03-26 17:51:43 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:32.040: INFO: Container nginx ready: true, restart count 0 Mar 26 17:52:32.040: INFO: simpletest.rc-x5fnb started at 2023-03-26 17:51:44 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:32.040: INFO: Container nginx ready: true, restart count 0 Mar 26 17:52:32.040: INFO: service-headless-l7zdh started at 2023-03-26 17:51:57 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:32.040: INFO: Container service-headless ready: true, restart count 0 Mar 26 17:52:32.040: INFO: kube-proxy-i-0ef04f0ca28b74fa4 started at 2023-03-26 17:21:50 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:32.040: INFO: Container kube-proxy ready: true, restart count 0 Mar 26 17:52:32.040: INFO: liveness-f07cd7ad-7f53-408f-9ba0-02fe49537f88 started at 2023-03-26 17:49:01 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:32.040: INFO: Container agnhost-container ready: true, restart count 0 Mar 26 17:52:32.040: INFO: simpletest.rc-vd8lz started at 2023-03-26 17:51:41 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:32.040: INFO: Container nginx ready: true, restart count 0 Mar 26 17:52:32.040: INFO: calico-node-bdwdr started at 2023-03-26 17:21:50 +0000 UTC (3+1 container statuses recorded) Mar 26 17:52:32.040: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 26 17:52:32.040: INFO: Init container install-cni ready: true, restart count 0 Mar 26 17:52:32.040: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 26 17:52:32.040: INFO: Container calico-node ready: true, restart count 0 Mar 26 17:52:32.040: INFO: ebs-csi-node-6wp7p started at 2023-03-26 17:21:50 +0000 UTC (0+3 container statuses recorded) Mar 26 17:52:32.040: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:52:32.040: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:52:32.040: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:52:32.528: INFO: Latency metrics for node i-0ef04f0ca28b74fa4 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/26/23 17:52:32.528 (5.284s) < Exit [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - dump namespaces | framework.go:209 @ 03/26/23 17:52:32.528 (5.284s) > Enter [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - tear down framework | framework.go:206 @ 03/26/23 17:52:32.528 STEP: Destroying namespace "provisioning-8504" for this suite. - test/e2e/framework/framework.go:351 @ 03/26/23 17:52:32.528 < Exit [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - tear down framework | framework.go:206 @ 03/26/23 17:52:32.644 (116ms) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/26/23 17:52:32.644 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/26/23 17:52:32.644 (0s)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\sExternal\sStorage\s\[Driver\:\sebs\.csi\.aws\.com\]\s\[Testpattern\:\sDynamic\sPV\s\(default\sfs\)\]\ssubPath\sshould\ssupport\sfile\sas\ssubpath\s\[LinuxOnly\]$'
[FAILED] failed to get logs from pod-subpath-test-dynamicpv-vf9b for test-container-subpath-dynamicpv-vf9b: Get "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/provisioning-6482/pods/pod-subpath-test-dynamicpv-vf9b/log?container=test-container-subpath-dynamicpv-vf9b&previous=false": stream error: stream ID 4161; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/26/23 17:54:11.398from junit_01.xml
> Enter [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/storage/framework/testsuite.go:51 @ 03/26/23 17:53:33.816 < Exit [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/storage/framework/testsuite.go:51 @ 03/26/23 17:53:33.816 (0s) > Enter [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath - set up framework | framework.go:191 @ 03/26/23 17:53:33.816 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/26/23 17:53:33.816 Mar 26 17:53:33.816: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename provisioning - test/e2e/framework/framework.go:250 @ 03/26/23 17:53:33.817 STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 03/26/23 17:53:34.132 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:262 @ 03/26/23 17:53:34.343 < Exit [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath - set up framework | framework.go:191 @ 03/26/23 17:53:34.552 (736ms) > Enter [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/framework/metrics/init/init.go:33 @ 03/26/23 17:53:34.552 < Exit [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/framework/metrics/init/init.go:33 @ 03/26/23 17:53:34.552 (0s) > Enter [It] should support file as subpath [LinuxOnly] - test/e2e/storage/testsuites/subpath.go:230 @ 03/26/23 17:53:34.552 Mar 26 17:53:34.552: INFO: Creating resource for dynamic PV Mar 26 17:53:34.552: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} STEP: creating a StorageClass provisioning-6482-e2e-scn7mvp - test/e2e/storage/framework/volume_resource.go:102 @ 03/26/23 17:53:34.552 STEP: creating a claim - test/e2e/storage/framework/volume_resource.go:294 @ 03/26/23 17:53:34.66 Mar 26 17:53:34.660: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil STEP: Creating pod pod-subpath-test-dynamicpv-vf9b - test/e2e/storage/testsuites/subpath.go:489 @ 03/26/23 17:53:34.884 STEP: Creating a pod to test atomic-volume-subpath - test/e2e/framework/pod/output/output.go:243 @ 03/26/23 17:53:34.884 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/26/23 17:54:10.932 Mar 26 17:54:11.037: INFO: Trying to get logs from node i-011576d1f2b6be6ec pod pod-subpath-test-dynamicpv-vf9b container test-container-subpath-dynamicpv-vf9b: <nil> Mar 26 17:54:11.145: INFO: Failed to get logs from node "i-011576d1f2b6be6ec" pod "pod-subpath-test-dynamicpv-vf9b" container "test-container-subpath-dynamicpv-vf9b". Get "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/provisioning-6482/pods/pod-subpath-test-dynamicpv-vf9b/log?container=test-container-subpath-dynamicpv-vf9b&previous=false": stream error: stream ID 4161; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/26/23 17:54:11.145 Mar 26 17:54:11.397: INFO: Unexpected error: <*fmt.wrapError | 0xc00429f440>: failed to get logs from pod-subpath-test-dynamicpv-vf9b for test-container-subpath-dynamicpv-vf9b: Get "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/provisioning-6482/pods/pod-subpath-test-dynamicpv-vf9b/log?container=test-container-subpath-dynamicpv-vf9b&previous=false": stream error: stream ID 4161; INTERNAL_ERROR; received from peer { msg: "failed to get logs from pod-subpath-test-dynamicpv-vf9b for test-container-subpath-dynamicpv-vf9b: Get \"https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/provisioning-6482/pods/pod-subpath-test-dynamicpv-vf9b/log?container=test-container-subpath-dynamicpv-vf9b&previous=false\": stream error: stream ID 4161; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc003e17140>{ Op: "Get", URL: "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/provisioning-6482/pods/pod-subpath-test-dynamicpv-vf9b/log?container=test-container-subpath-dynamicpv-vf9b&previous=false", Err: <http2.StreamError>{ StreamID: 4161, Code: 2, Cause: <*errors.errorString | 0xc0002123f0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from pod-subpath-test-dynamicpv-vf9b for test-container-subpath-dynamicpv-vf9b: Get "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/provisioning-6482/pods/pod-subpath-test-dynamicpv-vf9b/log?container=test-container-subpath-dynamicpv-vf9b&previous=false": stream error: stream ID 4161; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/26/23 17:54:11.398 < Exit [It] should support file as subpath [LinuxOnly] - test/e2e/storage/testsuites/subpath.go:230 @ 03/26/23 17:54:11.398 (36.846s) > Enter [AfterEach] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/framework/node/init/init.go:33 @ 03/26/23 17:54:11.398 Mar 26 17:54:11.398: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/framework/node/init/init.go:33 @ 03/26/23 17:54:11.511 (113ms) > Enter [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/storage/testsuites/subpath.go:232 @ 03/26/23 17:54:11.511 STEP: Deleting pod - test/e2e/storage/testsuites/subpath.go:172 @ 03/26/23 17:54:11.511 Mar 26 17:54:11.511: INFO: Deleting pod "pod-subpath-test-dynamicpv-vf9b" in namespace "provisioning-6482" STEP: Deleting pvc - test/e2e/storage/framework/volume_resource.go:181 @ 03/26/23 17:54:11.619 Mar 26 17:54:11.829: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.comkhshj" Mar 26 17:54:11.937: INFO: Waiting up to 5m0s for PersistentVolume pvc-0750126c-9c49-4f79-8dd0-29ca6221e99b to get deleted Mar 26 17:54:12.041: INFO: PersistentVolume pvc-0750126c-9c49-4f79-8dd0-29ca6221e99b found and phase=Released (104.495158ms) Mar 26 17:54:17.149: INFO: PersistentVolume pvc-0750126c-9c49-4f79-8dd0-29ca6221e99b found and phase=Released (5.212530385s) Mar 26 17:54:22.256: INFO: PersistentVolume pvc-0750126c-9c49-4f79-8dd0-29ca6221e99b found and phase=Released (10.319355794s) Mar 26 17:54:27.363: INFO: PersistentVolume pvc-0750126c-9c49-4f79-8dd0-29ca6221e99b was removed STEP: Deleting sc - test/e2e/storage/framework/volume_resource.go:228 @ 03/26/23 17:54:27.363 < Exit [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/storage/testsuites/subpath.go:232 @ 03/26/23 17:54:27.472 (15.961s) > Enter [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/framework/metrics/init/init.go:35 @ 03/26/23 17:54:27.472 < Exit [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/framework/metrics/init/init.go:35 @ 03/26/23 17:54:27.472 (0s) > Enter [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - dump namespaces | framework.go:209 @ 03/26/23 17:54:27.472 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/26/23 17:54:27.472 STEP: Collecting events from namespace "provisioning-6482". - test/e2e/framework/debug/dump.go:42 @ 03/26/23 17:54:27.472 STEP: Found 12 events. - test/e2e/framework/debug/dump.go:46 @ 03/26/23 17:54:27.577 Mar 26 17:54:27.577: INFO: At 2023-03-26 17:53:34 +0000 UTC - event for ebs.csi.aws.comkhshj: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding Mar 26 17:54:27.577: INFO: At 2023-03-26 17:53:34 +0000 UTC - event for ebs.csi.aws.comkhshj: {ebs.csi.aws.com_i-07cdb76b0ac2dbfa1_cb4b68af-2d91-4bfb-9626-7c22a975e7d6 } Provisioning: External provisioner is provisioning volume for claim "provisioning-6482/ebs.csi.aws.comkhshj" Mar 26 17:54:27.577: INFO: At 2023-03-26 17:53:34 +0000 UTC - event for ebs.csi.aws.comkhshj: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "ebs.csi.aws.com" or manually created by system administrator Mar 26 17:54:27.577: INFO: At 2023-03-26 17:53:38 +0000 UTC - event for ebs.csi.aws.comkhshj: {ebs.csi.aws.com_i-07cdb76b0ac2dbfa1_cb4b68af-2d91-4bfb-9626-7c22a975e7d6 } ProvisioningSucceeded: Successfully provisioned volume pvc-0750126c-9c49-4f79-8dd0-29ca6221e99b Mar 26 17:54:27.577: INFO: At 2023-03-26 17:53:38 +0000 UTC - event for pod-subpath-test-dynamicpv-vf9b: {default-scheduler } Scheduled: Successfully assigned provisioning-6482/pod-subpath-test-dynamicpv-vf9b to i-011576d1f2b6be6ec Mar 26 17:54:27.577: INFO: At 2023-03-26 17:53:41 +0000 UTC - event for pod-subpath-test-dynamicpv-vf9b: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-0750126c-9c49-4f79-8dd0-29ca6221e99b" Mar 26 17:54:27.577: INFO: At 2023-03-26 17:53:47 +0000 UTC - event for pod-subpath-test-dynamicpv-vf9b: {kubelet i-011576d1f2b6be6ec} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 26 17:54:27.577: INFO: At 2023-03-26 17:53:47 +0000 UTC - event for pod-subpath-test-dynamicpv-vf9b: {kubelet i-011576d1f2b6be6ec} Created: Created container init-volume-dynamicpv-vf9b Mar 26 17:54:27.577: INFO: At 2023-03-26 17:53:47 +0000 UTC - event for pod-subpath-test-dynamicpv-vf9b: {kubelet i-011576d1f2b6be6ec} Started: Started container init-volume-dynamicpv-vf9b Mar 26 17:54:27.577: INFO: At 2023-03-26 17:53:47 +0000 UTC - event for pod-subpath-test-dynamicpv-vf9b: {kubelet i-011576d1f2b6be6ec} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 26 17:54:27.577: INFO: At 2023-03-26 17:53:47 +0000 UTC - event for pod-subpath-test-dynamicpv-vf9b: {kubelet i-011576d1f2b6be6ec} Created: Created container test-container-subpath-dynamicpv-vf9b Mar 26 17:54:27.577: INFO: At 2023-03-26 17:53:48 +0000 UTC - event for pod-subpath-test-dynamicpv-vf9b: {kubelet i-011576d1f2b6be6ec} Started: Started container test-container-subpath-dynamicpv-vf9b Mar 26 17:54:27.682: INFO: POD NODE PHASE GRACE CONDITIONS Mar 26 17:54:27.682: INFO: Mar 26 17:54:27.787: INFO: Logging node info for node i-011576d1f2b6be6ec Mar 26 17:54:27.892: INFO: Node Info: &Node{ObjectMeta:{i-011576d1f2b6be6ec ef4bb85b-7188-4ef2-8d1a-583f0fcc379a 62765 0 2023-03-26 17:26:11 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3b io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:i-011576d1f2b6be6ec kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3b topology.hostpath.csi/node:i-011576d1f2b6be6ec topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3b] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-011576d1f2b6be6ec"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.41.235/19 projectcalico.org/IPv4IPIPTunnelAddr:100.127.173.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-03-26 17:26:11 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:26:11 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-03-26 17:26:11 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-03-26 17:26:12 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-03-26 17:26:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.8.0/24\"":{}}}} } {calico-node Update v1 2023-03-26 17:26:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2023-03-26 17:54:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.8.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3b/i-011576d1f2b6be6ec,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.8.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-26 17:26:30 +0000 UTC,LastTransitionTime:2023-03-26 17:26:30 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-26 17:54:16 +0000 UTC,LastTransitionTime:2023-03-26 17:26:11 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-26 17:54:16 +0000 UTC,LastTransitionTime:2023-03-26 17:26:11 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-26 17:54:16 +0000 UTC,LastTransitionTime:2023-03-26 17:26:11 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-26 17:54:16 +0000 UTC,LastTransitionTime:2023-03-26 17:26:23 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.41.235,},NodeAddress{Type:ExternalIP,Address:35.180.45.101,},NodeAddress{Type:InternalDNS,Address:i-011576d1f2b6be6ec.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-011576d1f2b6be6ec.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-180-45-101.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec26cc6e198da1950569e38fb3a7f618,SystemUUID:ec26cc6e-198d-a195-0569-e38fb3a7f618,BootID:b67057d3-2187-4008-9056-8a843d3c6813,KernelVersion:5.15.0-1031-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0,KubeProxyVersion:v1.28.0-alpha.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/kube-proxy@sha256:8a03b3147cd7be8e8235ae1cd70cf69aca9ce03ba1cfaffea320540bb5afa496 registry.k8s.io/kube-proxy:v1.28.0-alpha.0],SizeBytes:23896850,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 26 17:54:27.892: INFO: Logging kubelet events for node i-011576d1f2b6be6ec Mar 26 17:54:28.006: INFO: Logging pods the kubelet thinks is on node i-011576d1f2b6be6ec Mar 26 17:54:28.121: INFO: pod-0e42a007-49d5-417a-b875-9a0492947c38 started at 2023-03-26 17:54:24 +0000 UTC (0+1 container statuses recorded) Mar 26 17:54:28.121: INFO: Container write-pod ready: true, restart count 0 Mar 26 17:54:28.121: INFO: test-grpc-3f5210fe-7d27-4cf1-bd37-9f3195e6eaf6 started at 2023-03-26 17:54:05 +0000 UTC (0+1 container statuses recorded) Mar 26 17:54:28.121: INFO: Container agnhost ready: true, restart count 0 Mar 26 17:54:28.121: INFO: test-deployment-6fc78d85c6-xhfsf started at 2023-03-26 17:54:23 +0000 UTC (0+1 container statuses recorded) Mar 26 17:54:28.121: INFO: Container test-deployment ready: true, restart count 0 Mar 26 17:54:28.121: INFO: kube-proxy-i-011576d1f2b6be6ec started at 2023-03-26 17:26:12 +0000 UTC (0+1 container statuses recorded) Mar 26 17:54:28.121: INFO: Container kube-proxy ready: true, restart count 0 Mar 26 17:54:28.121: INFO: ss2-1 started at 2023-03-26 17:54:20 +0000 UTC (0+1 container statuses recorded) Mar 26 17:54:28.121: INFO: Container webserver ready: true, restart count 0 Mar 26 17:54:28.121: INFO: ebs-csi-node-7dqmm started at 2023-03-26 17:26:12 +0000 UTC (0+3 container statuses recorded) Mar 26 17:54:28.121: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:54:28.121: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:54:28.121: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:54:28.121: INFO: test-deployment-5b5dcbcd95-dbhp9 started at 2023-03-26 17:54:23 +0000 UTC (0+1 container statuses recorded) Mar 26 17:54:28.121: INFO: Container test-deployment ready: false, restart count 0 Mar 26 17:54:28.121: INFO: calico-node-tmjhr started at 2023-03-26 17:26:12 +0000 UTC (3+1 container statuses recorded) Mar 26 17:54:28.121: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 26 17:54:28.121: INFO: Init container install-cni ready: true, restart count 0 Mar 26 17:54:28.121: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 26 17:54:28.121: INFO: Container calico-node ready: true, restart count 0 Mar 26 17:54:28.121: INFO: coredns-559769c974-58thj started at 2023-03-26 17:34:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:54:28.121: INFO: Container coredns ready: true, restart count 0 Mar 26 17:54:28.121: INFO: inline-volume-jnh7l started at 2023-03-26 17:54:02 +0000 UTC (0+1 container statuses recorded) Mar 26 17:54:28.121: INFO: Container volume-tester ready: false, restart count 0 Mar 26 17:54:28.121: INFO: pause-pod-1 started at 2023-03-26 17:53:05 +0000 UTC (0+1 container statuses recorded) Mar 26 17:54:28.121: INFO: Container agnhost-container ready: true, restart count 0 Mar 26 17:54:28.121: INFO: hostexec-i-011576d1f2b6be6ec-hh9h4 started at 2023-03-26 17:54:20 +0000 UTC (0+1 container statuses recorded) Mar 26 17:54:28.121: INFO: Container agnhost-container ready: true, restart count 0 Mar 26 17:54:28.530: INFO: Latency metrics for node i-011576d1f2b6be6ec Mar 26 17:54:28.530: INFO: Logging node info for node i-07cdb76b0ac2dbfa1 Mar 26 17:54:28.635: INFO: Node Info: &Node{ObjectMeta:{i-07cdb76b0ac2dbfa1 d3bcec50-934c-432e-a590-2a35577f3a0d 51300 0 2023-03-26 17:17:19 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3b kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-07cdb76b0ac2dbfa1 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:eu-west-3b topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3b] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-07cdb76b0ac2dbfa1"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.63.230/19 projectcalico.org/IPv4IPIPTunnelAddr:100.127.118.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-26 17:17:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-03-26 17:17:20 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {calico-node Update v1 2023-03-26 17:18:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {aws-cloud-controller-manager Update v1 2023-03-26 17:18:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:18:48 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-03-26 17:18:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.5.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-03-26 17:51:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.5.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3b/i-07cdb76b0ac2dbfa1,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.5.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892301824 0} {<nil>} 3801076Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787444224 0} {<nil>} 3698676Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-26 17:18:46 +0000 UTC,LastTransitionTime:2023-03-26 17:18:46 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-26 17:51:08 +0000 UTC,LastTransitionTime:2023-03-26 17:17:19 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-26 17:51:08 +0000 UTC,LastTransitionTime:2023-03-26 17:17:19 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-26 17:51:08 +0000 UTC,LastTransitionTime:2023-03-26 17:17:19 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-26 17:51:08 +0000 UTC,LastTransitionTime:2023-03-26 17:18:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.63.230,},NodeAddress{Type:ExternalIP,Address:15.237.44.201,},NodeAddress{Type:InternalDNS,Address:i-07cdb76b0ac2dbfa1.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-07cdb76b0ac2dbfa1.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-237-44-201.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2824f976de88ff768c75c0d62c774f,SystemUUID:ec2824f9-76de-88ff-768c-75c0d62c774f,BootID:bc1e3e86-fc91-4be5-acba-90ac2a46faf2,KernelVersion:5.15.0-1031-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0,KubeProxyVersion:v1.28.0-alpha.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 registry.k8s.io/etcd:3.4.3-0],SizeBytes:100947667,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:9ce33ba33d8e738a5b85ed50b5080ac746deceed4a7496c550927a7a19ca3b6d registry.k8s.io/etcd:3.5.0-0],SizeBytes:99868722,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 registry.k8s.io/etcd:3.5.1-0],SizeBytes:98888614,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 registry.k8s.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:0d2ab6b15b4fe0b903b9e81192d942fb39c29be61fe341cd16db5d0165b0435c registry.k8s.io/etcd:3.3.17-0],SizeBytes:85524408,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:17da501f5d2a675be46040422a27b7cc21b8a43895ac998b171db1c346f361f7 registry.k8s.io/etcd:3.3.10-0],SizeBytes:76162358,},ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager-slim@sha256:8727adc059334e0e3329dbccce116a734da4a090da5e86c8cddccaf333caa666 registry.k8s.io/etcdadm/etcd-manager-slim:v3.0.20230201],SizeBytes:63926165,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:905d7ca17fd02bc24c0eba9a062753aba15db3e31422390bc3238eb762339b20 registry.k8s.io/etcd:3.2.24-1],SizeBytes:63423287,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:45208814,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:43629015,},ContainerImage{Names:[registry.k8s.io/kube-apiserver@sha256:49934a29c559e79ed19fc38b4697b18d8fe174b17bf56192588575f980c93956 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0],SizeBytes:33212506,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:2b6acd7f677f76ffe12ecf3ea7df92eb9b1bdb07336d1ac2a54c7631fb753f7e docker.io/calico/kube-controllers:v3.24.5],SizeBytes:31137169,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager@sha256:974748384634982c73527fdb3c9ec0ec476bc0d52b3dd1d611a380b7f99af1f3 registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0],SizeBytes:30820280,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/kube-proxy@sha256:8a03b3147cd7be8e8235ae1cd70cf69aca9ce03ba1cfaffea320540bb5afa496 registry.k8s.io/kube-proxy:v1.28.0-alpha.0],SizeBytes:23896850,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/kube-scheduler@sha256:cbf4007abb076188f16b975bc2b74452603cc7b34c60a29d92f14c38ad02dc11 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0],SizeBytes:18078674,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:5074723,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 26 17:54:28.635: INFO: Logging kubelet events for node i-07cdb76b0ac2dbfa1 Mar 26 17:54:28.747: INFO: Logging pods the kubelet thinks is on node i-07cdb76b0ac2dbfa1 Mar 26 17:54:28.860: INFO: dns-controller-69987775c6-ntctn started at 2023-03-26 17:17:49 +0000 UTC (0+1 container statuses recorded) Mar 26 17:54:28.860: INFO: Container dns-controller ready: true, restart count 0 Mar 26 17:54:28.860: INFO: aws-cloud-controller-manager-tbxvs started at 2023-03-26 17:18:29 +0000 UTC (0+1 container statuses recorded) Mar 26 17:54:28.860: INFO: Container aws-cloud-controller-manager ready: true, restart count 0 Mar 26 17:54:28.860: INFO: calico-node-5cszq started at 2023-03-26 17:18:29 +0000 UTC (3+1 container statuses recorded) Mar 26 17:54:28.860: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 26 17:54:28.860: INFO: Init container install-cni ready: true, restart count 0 Mar 26 17:54:28.860: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 26 17:54:28.860: INFO: Container calico-node ready: true, restart count 0 Mar 26 17:54:28.860: INFO: ebs-csi-controller-79f984545f-vq8bz started at 2023-03-26 17:19:49 +0000 UTC (0+5 container statuses recorded) Mar 26 17:54:28.860: INFO: Container csi-attacher ready: true, restart count 0 Mar 26 17:54:28.860: INFO: Container csi-provisioner ready: true, restart count 0 Mar 26 17:54:28.860: INFO: Container csi-resizer ready: true, restart count 0 Mar 26 17:54:28.860: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:54:28.860: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:54:28.860: INFO: ebs-csi-node-2r7mc started at 2023-03-26 17:18:29 +0000 UTC (0+3 container statuses recorded) Mar 26 17:54:28.860: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:54:28.860: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:54:28.860: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:54:28.860: INFO: kops-controller-thh8s started at 2023-03-26 17:18:29 +0000 UTC (0+1 container statuses recorded) Mar 26 17:54:28.860: INFO: Container kops-controller ready: true, restart count 0 Mar 26 17:54:28.860: INFO: kube-controller-manager-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:54:28.860: INFO: Container kube-controller-manager ready: true, restart count 4 Mar 26 17:54:28.860: INFO: kube-proxy-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:54:28.860: INFO: Container kube-proxy ready: true, restart count 0 Mar 26 17:54:28.860: INFO: kube-scheduler-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:54:28.860: INFO: Container kube-scheduler ready: true, restart count 0 Mar 26 17:54:28.860: INFO: etcd-manager-events-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (11+1 container statuses recorded) Mar 26 17:54:28.860: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0 Mar 26 17:54:28.860: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0 Mar 26 17:54:28.860: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0 Mar 26 17:54:28.860: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0 Mar 26 17:54:28.860: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0 Mar 26 17:54:28.860: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0 Mar 26 17:54:28.860: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0 Mar 26 17:54:28.860: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0 Mar 26 17:54:28.860: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0 Mar 26 17:54:28.860: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0 Mar 26 17:54:28.860: INFO: Init container init-etcd-3-5-7 ready: true, restart count 0 Mar 26 17:54:28.860: INFO: Container etcd-manager ready: true, restart count 0 Mar 26 17:54:28.860: INFO: etcd-manager-main-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (11+1 container statuses recorded) Mar 26 17:54:28.860: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0 Mar 26 17:54:28.860: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0 Mar 26 17:54:28.860: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0 Mar 26 17:54:28.860: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0 Mar 26 17:54:28.860: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0 Mar 26 17:54:28.860: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0 Mar 26 17:54:28.860: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0 Mar 26 17:54:28.860: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0 Mar 26 17:54:28.860: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0 Mar 26 17:54:28.860: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0 Mar 26 17:54:28.860: INFO: Init container init-etcd-3-5-7 ready: true, restart count 0 Mar 26 17:54:28.860: INFO: Container etcd-manager ready: true, restart count 0 Mar 26 17:54:28.860: INFO: kube-apiserver-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (0+2 container statuses recorded) Mar 26 17:54:28.860: INFO: Container healthcheck ready: true, restart count 0 Mar 26 17:54:28.860: INFO: Container kube-apiserver ready: true, restart count 2 Mar 26 17:54:28.860: INFO: calico-kube-controllers-55f488656-mjjr8 started at 2023-03-26 17:18:51 +0000 UTC (0+1 container statuses recorded) Mar 26 17:54:28.860: INFO: Container calico-kube-controllers ready: true, restart count 0 Mar 26 17:54:29.267: INFO: Latency metrics for node i-07cdb76b0ac2dbfa1 Mar 26 17:54:29.267: INFO: Logging node info for node i-0b2c24f535e511ae5 Mar 26 17:54:29.372: INFO: Node Info: &Node{ObjectMeta:{i-0b2c24f535e511ae5 8f866583-6b9f-42fc-932a-c5558d02f775 62553 0 2023-03-26 17:30:16 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3b kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0b2c24f535e511ae5 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3b topology.hostpath.csi/node:i-0b2c24f535e511ae5 topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3b] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-capacity-5909":"csi-mock-csi-mock-volumes-capacity-5909","csi-mock-csi-mock-volumes-capacity-8925":"i-0b2c24f535e511ae5","ebs.csi.aws.com":"i-0b2c24f535e511ae5"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.54.135/19 projectcalico.org/IPv4IPIPTunnelAddr:100.113.179.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-03-26 17:30:16 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:30:16 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-03-26 17:30:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-03-26 17:30:17 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-03-26 17:30:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.9.0/24\"":{}}}} } {calico-node Update v1 2023-03-26 17:30:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-03-26 17:53:48 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-03-26 17:54:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.9.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3b/i-0b2c24f535e511ae5,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.9.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-26 17:30:43 +0000 UTC,LastTransitionTime:2023-03-26 17:30:43 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-26 17:53:48 +0000 UTC,LastTransitionTime:2023-03-26 17:30:16 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-26 17:53:48 +0000 UTC,LastTransitionTime:2023-03-26 17:30:16 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-26 17:53:48 +0000 UTC,LastTransitionTime:2023-03-26 17:30:16 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-26 17:53:48 +0000 UTC,LastTransitionTime:2023-03-26 17:30:34 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.54.135,},NodeAddress{Type:ExternalIP,Address:13.38.65.62,},NodeAddress{Type:InternalDNS,Address:i-0b2c24f535e511ae5.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-0b2c24f535e511ae5.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-38-65-62.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec256778270128bdfe9c2066f7fedcda,SystemUUID:ec256778-2701-28bd-fe9c-2066f7fedcda,BootID:542316ee-6bea-470f-85fc-51e338ca7e74,KernelVersion:5.15.0-1031-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0,KubeProxyVersion:v1.28.0-alpha.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/kube-proxy@sha256:8a03b3147cd7be8e8235ae1cd70cf69aca9ce03ba1cfaffea320540bb5afa496 registry.k8s.io/kube-proxy:v1.28.0-alpha.0],SizeBytes:23896850,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0daaf871cea5a93c5],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0daaf871cea5a93c5,DevicePath:,},},Config:nil,},} Mar 26 17:54:29.373: INFO: Logging kubelet events for node i-0b2c24f535e511ae5 Mar 26 17:54:29.502: INFO: Logging pods the kubelet thinks is on node i-0b2c24f535e511ae5 Mar 26 17:54:29.619: INFO: inline-volume-tester-c6cv4 started at 2023-03-26 17:53:41 +0000 UTC (0+1 container statuses recorded) Mar 26 17:54:29.619: INFO: Container csi-volume-tester ready: true, restart count 0 Mar 26 17:54:29.619: INFO: webserver-pod started at 2023-03-26 17:49:38 +0000 UTC (0+1 container statuses recorded) Mar 26 17:54:29.619: INFO: Container agnhost ready: false, restart count 0 Mar 26 17:54:29.619: INFO: pfpod started at 2023-03-26 17:53:33 +0000 UTC (0+2 container statuses recorded) Mar 26 17:54:29.619: INFO: Container portforwardtester ready: false, restart count 0 Mar 26 17:54:29.619: INFO: Container readiness ready: false, restart count 0 Mar 26 17:54:29.619: INFO: webserver-pod started at 2023-03-26 17:53:18 +0000 UTC (0+1 container statuses recorded) Mar 26 17:54:29.619: INFO: Container agnhost-container ready: true, restart count 0 Mar 26 17:54:29.619: INFO: csi-mockplugin-0 started at 2023-03-26 17:54:03 +0000 UTC (0+4 container statuses recorded) Mar 26 17:54:29.619: INFO: Container busybox ready: true, restart count 0 Mar 26 17:54:29.619: INFO: Container csi-provisioner ready: true, restart count 0 Mar 26 17:54:29.619: INFO: Container driver-registrar ready: true, restart count 0 Mar 26 17:54:29.619: INFO: Container mock ready: true, restart count 0 Mar 26 17:54:29.619: INFO: netserver-1 started at 2023-03-26 17:54:29 +0000 UTC (0+1 container statuses recorded) Mar 26 17:54:29.619: INFO: Container webserver ready: false, restart count 0 Mar 26 17:54:29.619: INFO: ss2-2 started at 2023-03-26 17:54:10 +0000 UTC (0+1 container statuses recorded) Mar 26 17:54:29.619: INFO: Container webserver ready: true, restart count 0 Mar 26 17:54:29.619: INFO: kube-proxy-i-0b2c24f535e511ae5 started at 2023-03-26 17:30:17 +0000 UTC (0+1 container statuses recorded) Mar 26 17:54:29.619: INFO: Container kube-proxy ready: true, restart count 0 Mar 26 17:54:29.619: INFO: csi-mockplugin-0 started at 2023-03-26 17:52:45 +0000 UTC (0+3 container statuses recorded) Mar 26 17:54:29.619: INFO: Container csi-provisioner ready: true, restart count 0 Mar 26 17:54:29.619: INFO: Container driver-registrar ready: true, restart count 0 Mar 26 17:54:29.619: INFO: Container mock ready: true, restart count 0 Mar 26 17:54:29.619: INFO: ebs-csi-node-x9jln started at 2023-03-26 17:30:17 +0000 UTC (0+3 container statuses recorded) Mar 26 17:54:29.619: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:54:29.619: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:54:29.619: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:54:29.619: INFO: calico-node-rdfns started at 2023-03-26 17:30:17 +0000 UTC (3+1 container statuses recorded) Mar 26 17:54:29.619: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 26 17:54:29.619: INFO: Init container install-cni ready: true, restart count 0 Mar 26 17:54:29.619: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 26 17:54:29.619: INFO: Container calico-node ready: true, restart count 0 Mar 26 17:54:30.215: INFO: Latency metrics for node i-0b2c24f535e511ae5 Mar 26 17:54:30.215: INFO: Logging node info for node i-0c64386131d9d94c5 Mar 26 17:54:30.334: INFO: Node Info: &Node{ObjectMeta:{i-0c64386131d9d94c5 6c5a59f3-69fd-488b-b94e-23777e242a7e 62579 0 2023-03-26 17:34:02 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3b kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0c64386131d9d94c5 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3b topology.hostpath.csi/node:i-0c64386131d9d94c5 topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-volume-expand-1930":"i-0c64386131d9d94c5","csi-mock-csi-mock-volumes-workload-906":"i-0c64386131d9d94c5","ebs.csi.aws.com":"i-0c64386131d9d94c5"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.63.240/19 projectcalico.org/IPv4IPIPTunnelAddr:100.122.71.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-03-26 17:34:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:34:02 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-03-26 17:34:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-03-26 17:34:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-03-26 17:34:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.10.0/24\"":{}}}} } {calico-node Update v1 2023-03-26 17:34:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-03-26 17:54:09 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-03-26 17:54:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.10.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3b/i-0c64386131d9d94c5,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.10.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-26 17:34:21 +0000 UTC,LastTransitionTime:2023-03-26 17:34:21 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-26 17:54:09 +0000 UTC,LastTransitionTime:2023-03-26 17:34:02 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-26 17:54:09 +0000 UTC,LastTransitionTime:2023-03-26 17:34:02 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-26 17:54:09 +0000 UTC,LastTransitionTime:2023-03-26 17:34:02 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-26 17:54:09 +0000 UTC,LastTransitionTime:2023-03-26 17:34:14 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.63.240,},NodeAddress{Type:ExternalIP,Address:15.236.210.84,},NodeAddress{Type:InternalDNS,Address:i-0c64386131d9d94c5.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-0c64386131d9d94c5.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-236-210-84.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2c2c56ef9295a859b1f844cff158e8,SystemUUID:ec2c2c56-ef92-95a8-59b1-f844cff158e8,BootID:825bc25d-7144-4ec9-8dfb-f77f9cde8c31,KernelVersion:5.15.0-1031-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0,KubeProxyVersion:v1.28.0-alpha.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/kube-proxy@sha256:8a03b3147cd7be8e8235ae1cd70cf69aca9ce03ba1cfaffea320540bb5afa496 registry.k8s.io/kube-proxy:v1.28.0-alpha.0],SizeBytes:23896850,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:13ac9b3c476d7290a4451d65d09d6016a2cb89836ffbfa4eae55b72731a22080 registry.k8s.io/build-image/distroless-iptables:v0.2.2],SizeBytes:7729580,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-volume-expand-1930^33ddeed1-cbff-11ed-a27b-da8c13b79370],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-volume-expand-1930^33ddeed1-cbff-11ed-a27b-da8c13b79370,DevicePath:,},},Config:nil,},} Mar 26 17:54:30.335: INFO: Logging kubelet events for node i-0c64386131d9d94c5 Mar 26 17:54:30.458: INFO: Logging pods the kubelet thinks is on node i-0c64386131d9d94c5 Mar 26 17:54:30.578: INFO: pod-secrets-65c1903f-ac1d-4994-a139-1322ba03876e started at 2023-03-26 17:50:30 +0000 UTC (0+3 container statuses recorded) Mar 26 17:54:30.578: INFO: Container creates-volume-test ready: true, restart count 0 Mar 26 17:54:30.578: INFO: Container dels-volume-test ready: true, restart count 0 Mar 26 17:54:30.578: INFO: Container upds-volume-test ready: true, restart count 0 Mar 26 17:54:30.578: INFO: csi-mockplugin-attacher-0 started at 2023-03-26 17:53:57 +0000 UTC (0+1 container statuses recorded) Mar 26 17:54:30.578: INFO: Container csi-attacher ready: true, restart count 0 Mar 26 17:54:30.578: INFO: pod-4e9d481a-80ce-4fd2-bb1b-5343dfd9c51b started at 2023-03-26 17:54:09 +0000 UTC (0+1 container statuses recorded) Mar 26 17:54:30.578: INFO: Container write-pod ready: true, restart count 0 Mar 26 17:54:30.578: INFO: csi-mockplugin-0 started at 2023-03-26 17:53:57 +0000 UTC (0+3 container statuses recorded) Mar 26 17:54:30.578: INFO: Container csi-provisioner ready: true, restart count 0 Mar 26 17:54:30.578: INFO: Container driver-registrar ready: true, restart count 0 Mar 26 17:54:30.578: INFO: Container mock ready: true, restart count 0 Mar 26 17:54:30.578: INFO: ebs-csi-node-rhk2b started at 2023-03-26 17:34:03 +0000 UTC (0+3 container statuses recorded) Mar 26 17:54:30.578: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:54:30.578: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:54:30.578: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:54:30.578: INFO: hostexec-i-0c64386131d9d94c5-wtvdw started at 2023-03-26 17:54:21 +0000 UTC (0+1 container statuses recorded) Mar 26 17:54:30.578: INFO: Container agnhost-container ready: true, restart count 0 Mar 26 17:54:30.578: INFO: coredns-autoscaler-7cb5c5b969-xmt8r started at 2023-03-26 17:34:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:54:30.578: INFO: Container autoscaler ready: true, restart count 0 Mar 26 17:54:30.578: INFO: pvc-volume-tester-h54tl started at 2023-03-26 17:54:00 +0000 UTC (0+1 container statuses recorded) Mar 26 17:54:30.578: INFO: Container volume-tester ready: true, restart count 0 Mar 26 17:54:30.578: INFO: csi-hostpathplugin-0 started at 2023-03-26 17:54:04 +0000 UTC (0+7 container statuses recorded) Mar 26 17:54:30.578: INFO: Container csi-attacher ready: true, restart count 0 Mar 26 17:54:30.578: INFO: Container csi-provisioner ready: true, restart count 0 Mar 26 17:54:30.578: INFO: Container csi-resizer ready: true, restart count 0 Mar 26 17:54:30.578: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 26 17:54:30.578: INFO: Container hostpath ready: true, restart count 0 Mar 26 17:54:30.578: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:54:30.578: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:54:30.578: INFO: kube-proxy-i-0c64386131d9d94c5 started at 2023-03-26 17:34:03 +0000 UTC (0+1 container statuses recorded) Mar 26 17:54:30.578: INFO: Container kube-proxy ready: true, restart count 0 Mar 26 17:54:30.578: INFO: calico-node-jl5lk started at 2023-03-26 17:34:03 +0000 UTC (3+1 container statuses recorded) Mar 26 17:54:30.578: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 26 17:54:30.578: INFO: Init container install-cni ready: true, restart count 0 Mar 26 17:54:30.578: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 26 17:54:30.578: INFO: Container calico-node ready: true, restart count 0 Mar 26 17:54:30.578: INFO: netserver-2 started at 2023-03-26 17:54:29 +0000 UTC (0+1 container statuses recorded) Mar 26 17:54:30.578: INFO: Container webserver ready: false, restart count 0 Mar 26 17:54:31.069: INFO: Latency metrics for node i-0c64386131d9d94c5 Mar 26 17:54:31.069: INFO: Logging node info for node i-0ef04f0ca28b74fa4 Mar 26 17:54:31.176: INFO: Node Info: &Node{ObjectMeta:{i-0ef04f0ca28b74fa4 1429588e-1f3b-4a1a-98e2-600879dad0f2 62470 0 2023-03-26 17:21:49 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3b kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0ef04f0ca28b74fa4 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3b topology.hostpath.csi/node:i-0ef04f0ca28b74fa4 topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3b] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0ef04f0ca28b74fa4"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.42.152/19 projectcalico.org/IPv4IPIPTunnelAddr:100.104.100.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-26 17:21:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:21:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:21:50 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-03-26 17:21:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-03-26 17:22:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.7.0/24\"":{}}}} } {calico-node Update v1 2023-03-26 17:22:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2023-03-26 17:54:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.7.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3b/i-0ef04f0ca28b74fa4,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.7.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-26 17:22:08 +0000 UTC,LastTransitionTime:2023-03-26 17:22:08 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-26 17:54:07 +0000 UTC,LastTransitionTime:2023-03-26 17:21:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-26 17:54:07 +0000 UTC,LastTransitionTime:2023-03-26 17:21:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-26 17:54:07 +0000 UTC,LastTransitionTime:2023-03-26 17:21:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-26 17:54:07 +0000 UTC,LastTransitionTime:2023-03-26 17:22:00 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.152,},NodeAddress{Type:ExternalIP,Address:35.180.133.237,},NodeAddress{Type:InternalDNS,Address:i-0ef04f0ca28b74fa4.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-0ef04f0ca28b74fa4.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-180-133-237.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2cd6131a8983e20721f6c173936bc3,SystemUUID:ec2cd613-1a89-83e2-0721-f6c173936bc3,BootID:34695e7c-23d6-4648-b207-41bcd12c2edf,KernelVersion:5.15.0-1031-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0,KubeProxyVersion:v1.28.0-alpha.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/kube-proxy@sha256:8a03b3147cd7be8e8235ae1cd70cf69aca9ce03ba1cfaffea320540bb5afa496 registry.k8s.io/kube-proxy:v1.28.0-alpha.0],SizeBytes:23896850,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 26 17:54:31.176: INFO: Logging kubelet events for node i-0ef04f0ca28b74fa4 Mar 26 17:54:31.293: INFO: Logging pods the kubelet thinks is on node i-0ef04f0ca28b74fa4 Mar 26 17:54:31.409: INFO: coredns-559769c974-6mjw2 started at 2023-03-26 17:22:53 +0000 UTC (0+1 container statuses recorded) Mar 26 17:54:31.409: INFO: Container coredns ready: true, restart count 0 Mar 26 17:54:31.409: INFO: ss2-0 started at 2023-03-26 17:54:31 +0000 UTC (0+1 container statuses recorded) Mar 26 17:54:31.409: INFO: Container webserver ready: false, restart count 0 Mar 26 17:54:31.409: INFO: kube-proxy-i-0ef04f0ca28b74fa4 started at 2023-03-26 17:21:50 +0000 UTC (0+1 container statuses recorded) Mar 26 17:54:31.409: INFO: Container kube-proxy ready: true, restart count 0 Mar 26 17:54:31.409: INFO: calico-node-bdwdr started at 2023-03-26 17:21:50 +0000 UTC (3+1 container statuses recorded) Mar 26 17:54:31.409: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 26 17:54:31.409: INFO: Init container install-cni ready: true, restart count 0 Mar 26 17:54:31.409: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 26 17:54:31.409: INFO: Container calico-node ready: true, restart count 0 Mar 26 17:54:31.409: INFO: ebs-csi-node-6wp7p started at 2023-03-26 17:21:50 +0000 UTC (0+3 container statuses recorded) Mar 26 17:54:31.409: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:54:31.409: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:54:31.409: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:54:31.409: INFO: test-grpc-d2670623-dc30-4042-bc50-a1583d43951d started at 2023-03-26 17:54:07 +0000 UTC (0+1 container statuses recorded) Mar 26 17:54:31.409: INFO: Container agnhost ready: true, restart count 0 Mar 26 17:54:31.409: INFO: pod-prestop-hook-3c18f473-ae37-43ec-bb88-387693d7ff2e started at 2023-03-26 17:54:25 +0000 UTC (0+1 container statuses recorded) Mar 26 17:54:31.409: INFO: Container nginx ready: true, restart count 0 Mar 26 17:54:31.409: INFO: agnhost started at 2023-03-26 17:54:28 +0000 UTC (0+1 container statuses recorded) Mar 26 17:54:31.409: INFO: Container agnhost ready: true, restart count 0 Mar 26 17:54:31.409: INFO: busybox-43b1a9ea-82c6-485d-a002-1b0986b52eef started at 2023-03-26 17:52:39 +0000 UTC (0+1 container statuses recorded) Mar 26 17:54:31.409: INFO: Container busybox ready: true, restart count 0 Mar 26 17:54:31.409: INFO: labelsupdate89553ffe-db57-485c-8c2e-3033dcae22c6 started at 2023-03-26 17:51:44 +0000 UTC (0+1 container statuses recorded) Mar 26 17:54:31.409: INFO: Container client-container ready: false, restart count 0 Mar 26 17:54:31.409: INFO: pod-ready started at 2023-03-26 17:54:21 +0000 UTC (0+1 container statuses recorded) Mar 26 17:54:31.409: INFO: Container pod-readiness-gate ready: true, restart count 0 Mar 26 17:54:31.409: INFO: netserver-3 started at 2023-03-26 17:54:29 +0000 UTC (0+1 container statuses recorded) Mar 26 17:54:31.409: INFO: Container webserver ready: false, restart count 0 Mar 26 17:54:31.841: INFO: Latency metrics for node i-0ef04f0ca28b74fa4 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/26/23 17:54:31.841 (4.369s) < Exit [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - dump namespaces | framework.go:209 @ 03/26/23 17:54:31.841 (4.369s) > Enter [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - tear down framework | framework.go:206 @ 03/26/23 17:54:31.841 STEP: Destroying namespace "provisioning-6482" for this suite. - test/e2e/framework/framework.go:351 @ 03/26/23 17:54:31.841 < Exit [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - tear down framework | framework.go:206 @ 03/26/23 17:54:31.951 (109ms) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/26/23 17:54:31.951 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/26/23 17:54:31.951 (0s)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\sExternal\sStorage\s\[Driver\:\sebs\.csi\.aws\.com\]\s\[Testpattern\:\sDynamic\sPV\s\(default\sfs\)\]\ssubPath\sshould\ssupport\snon\-existent\spath$'
[FAILED] failed to get logs from pod-subpath-test-dynamicpv-n7lt for test-container-volume-dynamicpv-n7lt: Get "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/provisioning-6644/pods/pod-subpath-test-dynamicpv-n7lt/log?container=test-container-volume-dynamicpv-n7lt&previous=false": stream error: stream ID 2827; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/26/23 17:52:39.891from junit_01.xml
> Enter [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/storage/framework/testsuite.go:51 @ 03/26/23 17:52:19.057 < Exit [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/storage/framework/testsuite.go:51 @ 03/26/23 17:52:19.057 (0s) > Enter [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath - set up framework | framework.go:191 @ 03/26/23 17:52:19.057 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/26/23 17:52:19.057 Mar 26 17:52:19.057: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename provisioning - test/e2e/framework/framework.go:250 @ 03/26/23 17:52:19.058 STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 03/26/23 17:52:19.388 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:262 @ 03/26/23 17:52:19.596 < Exit [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath - set up framework | framework.go:191 @ 03/26/23 17:52:19.807 (750ms) > Enter [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/framework/metrics/init/init.go:33 @ 03/26/23 17:52:19.807 < Exit [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/framework/metrics/init/init.go:33 @ 03/26/23 17:52:19.807 (0s) > Enter [It] should support non-existent path - test/e2e/storage/testsuites/subpath.go:194 @ 03/26/23 17:52:19.807 Mar 26 17:52:19.807: INFO: Creating resource for dynamic PV Mar 26 17:52:19.807: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} STEP: creating a StorageClass provisioning-6644-e2e-scxw89b - test/e2e/storage/framework/volume_resource.go:102 @ 03/26/23 17:52:19.808 STEP: creating a claim - test/e2e/storage/framework/volume_resource.go:294 @ 03/26/23 17:52:19.918 Mar 26 17:52:19.918: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil STEP: Creating pod pod-subpath-test-dynamicpv-n7lt - test/e2e/storage/testsuites/subpath.go:691 @ 03/26/23 17:52:20.145 STEP: Creating a pod to test subpath - test/e2e/framework/pod/output/output.go:243 @ 03/26/23 17:52:20.145 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/26/23 17:52:39.434 Mar 26 17:52:39.540: INFO: Trying to get logs from node i-0b2c24f535e511ae5 pod pod-subpath-test-dynamicpv-n7lt container test-container-volume-dynamicpv-n7lt: <nil> Mar 26 17:52:39.652: INFO: Failed to get logs from node "i-0b2c24f535e511ae5" pod "pod-subpath-test-dynamicpv-n7lt" container "test-container-volume-dynamicpv-n7lt". Get "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/provisioning-6644/pods/pod-subpath-test-dynamicpv-n7lt/log?container=test-container-volume-dynamicpv-n7lt&previous=false": stream error: stream ID 2827; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/26/23 17:52:39.652 Mar 26 17:52:39.891: INFO: Unexpected error: <*fmt.wrapError | 0xc00075ff00>: failed to get logs from pod-subpath-test-dynamicpv-n7lt for test-container-volume-dynamicpv-n7lt: Get "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/provisioning-6644/pods/pod-subpath-test-dynamicpv-n7lt/log?container=test-container-volume-dynamicpv-n7lt&previous=false": stream error: stream ID 2827; INTERNAL_ERROR; received from peer { msg: "failed to get logs from pod-subpath-test-dynamicpv-n7lt for test-container-volume-dynamicpv-n7lt: Get \"https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/provisioning-6644/pods/pod-subpath-test-dynamicpv-n7lt/log?container=test-container-volume-dynamicpv-n7lt&previous=false\": stream error: stream ID 2827; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc001b2b500>{ Op: "Get", URL: "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/provisioning-6644/pods/pod-subpath-test-dynamicpv-n7lt/log?container=test-container-volume-dynamicpv-n7lt&previous=false", Err: <http2.StreamError>{ StreamID: 2827, Code: 2, Cause: <*errors.errorString | 0xc0001e76c0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from pod-subpath-test-dynamicpv-n7lt for test-container-volume-dynamicpv-n7lt: Get "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/provisioning-6644/pods/pod-subpath-test-dynamicpv-n7lt/log?container=test-container-volume-dynamicpv-n7lt&previous=false": stream error: stream ID 2827; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/26/23 17:52:39.891 < Exit [It] should support non-existent path - test/e2e/storage/testsuites/subpath.go:194 @ 03/26/23 17:52:39.891 (20.084s) > Enter [AfterEach] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/framework/node/init/init.go:33 @ 03/26/23 17:52:39.891 Mar 26 17:52:39.891: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/framework/node/init/init.go:33 @ 03/26/23 17:52:39.997 (106ms) > Enter [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/storage/testsuites/subpath.go:196 @ 03/26/23 17:52:39.997 STEP: Deleting pod - test/e2e/storage/testsuites/subpath.go:172 @ 03/26/23 17:52:39.997 Mar 26 17:52:39.997: INFO: Deleting pod "pod-subpath-test-dynamicpv-n7lt" in namespace "provisioning-6644" STEP: Deleting pvc - test/e2e/storage/framework/volume_resource.go:181 @ 03/26/23 17:52:40.209 Mar 26 17:52:40.420: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.comjhvds" Mar 26 17:52:40.573: INFO: Waiting up to 5m0s for PersistentVolume pvc-436c80c8-4449-439e-a77a-1527ab68b309 to get deleted Mar 26 17:52:40.679: INFO: PersistentVolume pvc-436c80c8-4449-439e-a77a-1527ab68b309 found and phase=Released (106.61544ms) Mar 26 17:52:45.787: INFO: PersistentVolume pvc-436c80c8-4449-439e-a77a-1527ab68b309 found and phase=Released (5.214176812s) Mar 26 17:52:50.895: INFO: PersistentVolume pvc-436c80c8-4449-439e-a77a-1527ab68b309 found and phase=Released (10.322262153s) Mar 26 17:52:56.001: INFO: PersistentVolume pvc-436c80c8-4449-439e-a77a-1527ab68b309 was removed STEP: Deleting sc - test/e2e/storage/framework/volume_resource.go:228 @ 03/26/23 17:52:56.001 < Exit [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/storage/testsuites/subpath.go:196 @ 03/26/23 17:52:56.109 (16.112s) > Enter [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/framework/metrics/init/init.go:35 @ 03/26/23 17:52:56.109 < Exit [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/framework/metrics/init/init.go:35 @ 03/26/23 17:52:56.109 (0s) > Enter [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - dump namespaces | framework.go:209 @ 03/26/23 17:52:56.109 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/26/23 17:52:56.109 STEP: Collecting events from namespace "provisioning-6644". - test/e2e/framework/debug/dump.go:42 @ 03/26/23 17:52:56.109 STEP: Found 15 events. - test/e2e/framework/debug/dump.go:46 @ 03/26/23 17:52:56.216 Mar 26 17:52:56.216: INFO: At 2023-03-26 17:52:19 +0000 UTC - event for ebs.csi.aws.comjhvds: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding Mar 26 17:52:56.216: INFO: At 2023-03-26 17:52:20 +0000 UTC - event for ebs.csi.aws.comjhvds: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "ebs.csi.aws.com" or manually created by system administrator Mar 26 17:52:56.216: INFO: At 2023-03-26 17:52:20 +0000 UTC - event for ebs.csi.aws.comjhvds: {ebs.csi.aws.com_i-07cdb76b0ac2dbfa1_cb4b68af-2d91-4bfb-9626-7c22a975e7d6 } Provisioning: External provisioner is provisioning volume for claim "provisioning-6644/ebs.csi.aws.comjhvds" Mar 26 17:52:56.216: INFO: At 2023-03-26 17:52:23 +0000 UTC - event for ebs.csi.aws.comjhvds: {ebs.csi.aws.com_i-07cdb76b0ac2dbfa1_cb4b68af-2d91-4bfb-9626-7c22a975e7d6 } ProvisioningSucceeded: Successfully provisioned volume pvc-436c80c8-4449-439e-a77a-1527ab68b309 Mar 26 17:52:56.216: INFO: At 2023-03-26 17:52:24 +0000 UTC - event for pod-subpath-test-dynamicpv-n7lt: {default-scheduler } Scheduled: Successfully assigned provisioning-6644/pod-subpath-test-dynamicpv-n7lt to i-0b2c24f535e511ae5 Mar 26 17:52:56.216: INFO: At 2023-03-26 17:52:26 +0000 UTC - event for pod-subpath-test-dynamicpv-n7lt: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-436c80c8-4449-439e-a77a-1527ab68b309" Mar 26 17:52:56.216: INFO: At 2023-03-26 17:52:29 +0000 UTC - event for pod-subpath-test-dynamicpv-n7lt: {kubelet i-0b2c24f535e511ae5} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 26 17:52:56.216: INFO: At 2023-03-26 17:52:29 +0000 UTC - event for pod-subpath-test-dynamicpv-n7lt: {kubelet i-0b2c24f535e511ae5} Created: Created container test-init-subpath-dynamicpv-n7lt Mar 26 17:52:56.216: INFO: At 2023-03-26 17:52:30 +0000 UTC - event for pod-subpath-test-dynamicpv-n7lt: {kubelet i-0b2c24f535e511ae5} Started: Started container test-init-subpath-dynamicpv-n7lt Mar 26 17:52:56.216: INFO: At 2023-03-26 17:52:33 +0000 UTC - event for pod-subpath-test-dynamicpv-n7lt: {kubelet i-0b2c24f535e511ae5} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 26 17:52:56.216: INFO: At 2023-03-26 17:52:33 +0000 UTC - event for pod-subpath-test-dynamicpv-n7lt: {kubelet i-0b2c24f535e511ae5} Created: Created container test-container-subpath-dynamicpv-n7lt Mar 26 17:52:56.216: INFO: At 2023-03-26 17:52:34 +0000 UTC - event for pod-subpath-test-dynamicpv-n7lt: {kubelet i-0b2c24f535e511ae5} Started: Started container test-container-subpath-dynamicpv-n7lt Mar 26 17:52:56.216: INFO: At 2023-03-26 17:52:34 +0000 UTC - event for pod-subpath-test-dynamicpv-n7lt: {kubelet i-0b2c24f535e511ae5} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 26 17:52:56.216: INFO: At 2023-03-26 17:52:34 +0000 UTC - event for pod-subpath-test-dynamicpv-n7lt: {kubelet i-0b2c24f535e511ae5} Created: Created container test-container-volume-dynamicpv-n7lt Mar 26 17:52:56.216: INFO: At 2023-03-26 17:52:35 +0000 UTC - event for pod-subpath-test-dynamicpv-n7lt: {kubelet i-0b2c24f535e511ae5} Started: Started container test-container-volume-dynamicpv-n7lt Mar 26 17:52:56.323: INFO: POD NODE PHASE GRACE CONDITIONS Mar 26 17:52:56.323: INFO: Mar 26 17:52:56.429: INFO: Logging node info for node i-011576d1f2b6be6ec Mar 26 17:52:56.535: INFO: Node Info: &Node{ObjectMeta:{i-011576d1f2b6be6ec ef4bb85b-7188-4ef2-8d1a-583f0fcc379a 58105 0 2023-03-26 17:26:11 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3b io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:i-011576d1f2b6be6ec kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3b topology.hostpath.csi/node:i-011576d1f2b6be6ec topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-2828":"i-011576d1f2b6be6ec","ebs.csi.aws.com":"i-011576d1f2b6be6ec"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.41.235/19 projectcalico.org/IPv4IPIPTunnelAddr:100.127.173.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-03-26 17:26:11 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:26:11 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-03-26 17:26:11 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-03-26 17:26:12 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-03-26 17:26:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.8.0/24\"":{}}}} } {calico-node Update v1 2023-03-26 17:26:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-03-26 17:52:34 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-03-26 17:52:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.8.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3b/i-011576d1f2b6be6ec,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.8.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-26 17:26:30 +0000 UTC,LastTransitionTime:2023-03-26 17:26:30 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-26 17:52:34 +0000 UTC,LastTransitionTime:2023-03-26 17:26:11 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-26 17:52:34 +0000 UTC,LastTransitionTime:2023-03-26 17:26:11 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-26 17:52:34 +0000 UTC,LastTransitionTime:2023-03-26 17:26:11 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-26 17:52:34 +0000 UTC,LastTransitionTime:2023-03-26 17:26:23 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.41.235,},NodeAddress{Type:ExternalIP,Address:35.180.45.101,},NodeAddress{Type:InternalDNS,Address:i-011576d1f2b6be6ec.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-011576d1f2b6be6ec.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-180-45-101.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec26cc6e198da1950569e38fb3a7f618,SystemUUID:ec26cc6e-198d-a195-0569-e38fb3a7f618,BootID:b67057d3-2187-4008-9056-8a843d3c6813,KernelVersion:5.15.0-1031-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0,KubeProxyVersion:v1.28.0-alpha.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/kube-proxy@sha256:8a03b3147cd7be8e8235ae1cd70cf69aca9ce03ba1cfaffea320540bb5afa496 registry.k8s.io/kube-proxy:v1.28.0-alpha.0],SizeBytes:23896850,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-2828^d5f18f18-cbfe-11ed-8d8b-7e7ec15f5ac0],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-2828^d5f18f18-cbfe-11ed-8d8b-7e7ec15f5ac0,DevicePath:,},},Config:nil,},} Mar 26 17:52:56.535: INFO: Logging kubelet events for node i-011576d1f2b6be6ec Mar 26 17:52:56.657: INFO: Logging pods the kubelet thinks is on node i-011576d1f2b6be6ec Mar 26 17:52:56.781: INFO: hostexec-i-011576d1f2b6be6ec-q4mnn started at 2023-03-26 17:52:45 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:56.781: INFO: Container agnhost-container ready: true, restart count 0 Mar 26 17:52:56.781: INFO: calico-node-tmjhr started at 2023-03-26 17:26:12 +0000 UTC (3+1 container statuses recorded) Mar 26 17:52:56.781: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 26 17:52:56.781: INFO: Init container install-cni ready: true, restart count 0 Mar 26 17:52:56.781: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 26 17:52:56.781: INFO: Container calico-node ready: true, restart count 0 Mar 26 17:52:56.781: INFO: csi-hostpathplugin-0 started at 2023-03-26 17:51:27 +0000 UTC (0+7 container statuses recorded) Mar 26 17:52:56.781: INFO: Container csi-attacher ready: true, restart count 0 Mar 26 17:52:56.781: INFO: Container csi-provisioner ready: true, restart count 0 Mar 26 17:52:56.781: INFO: Container csi-resizer ready: true, restart count 0 Mar 26 17:52:56.781: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 26 17:52:56.781: INFO: Container hostpath ready: true, restart count 0 Mar 26 17:52:56.781: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:52:56.781: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:52:56.781: INFO: pod-867480c6-e87c-4fda-b941-ff836599a9df started at 2023-03-26 17:52:50 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:56.781: INFO: Container write-pod ready: true, restart count 0 Mar 26 17:52:56.781: INFO: hostexec-i-011576d1f2b6be6ec-cshfk started at 2023-03-26 17:52:35 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:56.781: INFO: Container agnhost-container ready: true, restart count 0 Mar 26 17:52:56.781: INFO: coredns-559769c974-58thj started at 2023-03-26 17:34:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:56.781: INFO: Container coredns ready: true, restart count 0 Mar 26 17:52:56.781: INFO: inline-volume-tester-vmnzt started at 2023-03-26 17:51:29 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:56.781: INFO: Container csi-volume-tester ready: true, restart count 0 Mar 26 17:52:56.781: INFO: netserver-0 started at 2023-03-26 17:52:44 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:56.781: INFO: Container webserver ready: true, restart count 0 Mar 26 17:52:56.781: INFO: service-headless-cjqr2 started at 2023-03-26 17:51:57 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:56.781: INFO: Container service-headless ready: true, restart count 0 Mar 26 17:52:56.781: INFO: pod-67f4163c-ffc8-4cb6-9d29-90324fca0e35 started at 2023-03-26 17:52:56 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:56.781: INFO: Container write-pod ready: false, restart count 0 Mar 26 17:52:56.781: INFO: kube-proxy-i-011576d1f2b6be6ec started at 2023-03-26 17:26:12 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:56.781: INFO: Container kube-proxy ready: true, restart count 0 Mar 26 17:52:56.781: INFO: local-client started at 2023-03-26 17:52:53 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:56.781: INFO: Container local-client ready: true, restart count 0 Mar 26 17:52:56.781: INFO: ebs-csi-node-7dqmm started at 2023-03-26 17:26:12 +0000 UTC (0+3 container statuses recorded) Mar 26 17:52:56.781: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:52:56.781: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:52:56.781: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:52:57.214: INFO: Latency metrics for node i-011576d1f2b6be6ec Mar 26 17:52:57.214: INFO: Logging node info for node i-07cdb76b0ac2dbfa1 Mar 26 17:52:57.320: INFO: Node Info: &Node{ObjectMeta:{i-07cdb76b0ac2dbfa1 d3bcec50-934c-432e-a590-2a35577f3a0d 51300 0 2023-03-26 17:17:19 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3b kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-07cdb76b0ac2dbfa1 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:eu-west-3b topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3b] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-07cdb76b0ac2dbfa1"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.63.230/19 projectcalico.org/IPv4IPIPTunnelAddr:100.127.118.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-26 17:17:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-03-26 17:17:20 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {calico-node Update v1 2023-03-26 17:18:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {aws-cloud-controller-manager Update v1 2023-03-26 17:18:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:18:48 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-03-26 17:18:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.5.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-03-26 17:51:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.5.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3b/i-07cdb76b0ac2dbfa1,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.5.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892301824 0} {<nil>} 3801076Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787444224 0} {<nil>} 3698676Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-26 17:18:46 +0000 UTC,LastTransitionTime:2023-03-26 17:18:46 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-26 17:51:08 +0000 UTC,LastTransitionTime:2023-03-26 17:17:19 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-26 17:51:08 +0000 UTC,LastTransitionTime:2023-03-26 17:17:19 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-26 17:51:08 +0000 UTC,LastTransitionTime:2023-03-26 17:17:19 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-26 17:51:08 +0000 UTC,LastTransitionTime:2023-03-26 17:18:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.63.230,},NodeAddress{Type:ExternalIP,Address:15.237.44.201,},NodeAddress{Type:InternalDNS,Address:i-07cdb76b0ac2dbfa1.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-07cdb76b0ac2dbfa1.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-237-44-201.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2824f976de88ff768c75c0d62c774f,SystemUUID:ec2824f9-76de-88ff-768c-75c0d62c774f,BootID:bc1e3e86-fc91-4be5-acba-90ac2a46faf2,KernelVersion:5.15.0-1031-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0,KubeProxyVersion:v1.28.0-alpha.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 registry.k8s.io/etcd:3.4.3-0],SizeBytes:100947667,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:9ce33ba33d8e738a5b85ed50b5080ac746deceed4a7496c550927a7a19ca3b6d registry.k8s.io/etcd:3.5.0-0],SizeBytes:99868722,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 registry.k8s.io/etcd:3.5.1-0],SizeBytes:98888614,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 registry.k8s.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:0d2ab6b15b4fe0b903b9e81192d942fb39c29be61fe341cd16db5d0165b0435c registry.k8s.io/etcd:3.3.17-0],SizeBytes:85524408,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:17da501f5d2a675be46040422a27b7cc21b8a43895ac998b171db1c346f361f7 registry.k8s.io/etcd:3.3.10-0],SizeBytes:76162358,},ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager-slim@sha256:8727adc059334e0e3329dbccce116a734da4a090da5e86c8cddccaf333caa666 registry.k8s.io/etcdadm/etcd-manager-slim:v3.0.20230201],SizeBytes:63926165,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:905d7ca17fd02bc24c0eba9a062753aba15db3e31422390bc3238eb762339b20 registry.k8s.io/etcd:3.2.24-1],SizeBytes:63423287,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:45208814,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:43629015,},ContainerImage{Names:[registry.k8s.io/kube-apiserver@sha256:49934a29c559e79ed19fc38b4697b18d8fe174b17bf56192588575f980c93956 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0],SizeBytes:33212506,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:2b6acd7f677f76ffe12ecf3ea7df92eb9b1bdb07336d1ac2a54c7631fb753f7e docker.io/calico/kube-controllers:v3.24.5],SizeBytes:31137169,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager@sha256:974748384634982c73527fdb3c9ec0ec476bc0d52b3dd1d611a380b7f99af1f3 registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0],SizeBytes:30820280,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/kube-proxy@sha256:8a03b3147cd7be8e8235ae1cd70cf69aca9ce03ba1cfaffea320540bb5afa496 registry.k8s.io/kube-proxy:v1.28.0-alpha.0],SizeBytes:23896850,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/kube-scheduler@sha256:cbf4007abb076188f16b975bc2b74452603cc7b34c60a29d92f14c38ad02dc11 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0],SizeBytes:18078674,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:5074723,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 26 17:52:57.321: INFO: Logging kubelet events for node i-07cdb76b0ac2dbfa1 Mar 26 17:52:57.434: INFO: Logging pods the kubelet thinks is on node i-07cdb76b0ac2dbfa1 Mar 26 17:52:57.554: INFO: etcd-manager-events-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (11+1 container statuses recorded) Mar 26 17:52:57.554: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0 Mar 26 17:52:57.554: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0 Mar 26 17:52:57.554: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0 Mar 26 17:52:57.554: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0 Mar 26 17:52:57.554: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0 Mar 26 17:52:57.554: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0 Mar 26 17:52:57.554: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0 Mar 26 17:52:57.554: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0 Mar 26 17:52:57.554: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0 Mar 26 17:52:57.554: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0 Mar 26 17:52:57.554: INFO: Init container init-etcd-3-5-7 ready: true, restart count 0 Mar 26 17:52:57.554: INFO: Container etcd-manager ready: true, restart count 0 Mar 26 17:52:57.554: INFO: etcd-manager-main-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (11+1 container statuses recorded) Mar 26 17:52:57.554: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0 Mar 26 17:52:57.554: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0 Mar 26 17:52:57.554: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0 Mar 26 17:52:57.554: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0 Mar 26 17:52:57.554: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0 Mar 26 17:52:57.554: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0 Mar 26 17:52:57.554: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0 Mar 26 17:52:57.554: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0 Mar 26 17:52:57.554: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0 Mar 26 17:52:57.554: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0 Mar 26 17:52:57.554: INFO: Init container init-etcd-3-5-7 ready: true, restart count 0 Mar 26 17:52:57.554: INFO: Container etcd-manager ready: true, restart count 0 Mar 26 17:52:57.554: INFO: kube-apiserver-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (0+2 container statuses recorded) Mar 26 17:52:57.554: INFO: Container healthcheck ready: true, restart count 0 Mar 26 17:52:57.554: INFO: Container kube-apiserver ready: true, restart count 2 Mar 26 17:52:57.554: INFO: ebs-csi-node-2r7mc started at 2023-03-26 17:18:29 +0000 UTC (0+3 container statuses recorded) Mar 26 17:52:57.554: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:52:57.554: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:52:57.554: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:52:57.554: INFO: kops-controller-thh8s started at 2023-03-26 17:18:29 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:57.554: INFO: Container kops-controller ready: true, restart count 0 Mar 26 17:52:57.554: INFO: kube-controller-manager-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:57.554: INFO: Container kube-controller-manager ready: true, restart count 4 Mar 26 17:52:57.554: INFO: kube-proxy-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:57.554: INFO: Container kube-proxy ready: true, restart count 0 Mar 26 17:52:57.554: INFO: kube-scheduler-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:57.554: INFO: Container kube-scheduler ready: true, restart count 0 Mar 26 17:52:57.554: INFO: calico-kube-controllers-55f488656-mjjr8 started at 2023-03-26 17:18:51 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:57.554: INFO: Container calico-kube-controllers ready: true, restart count 0 Mar 26 17:52:57.554: INFO: ebs-csi-controller-79f984545f-vq8bz started at 2023-03-26 17:19:49 +0000 UTC (0+5 container statuses recorded) Mar 26 17:52:57.554: INFO: Container csi-attacher ready: true, restart count 0 Mar 26 17:52:57.554: INFO: Container csi-provisioner ready: true, restart count 0 Mar 26 17:52:57.554: INFO: Container csi-resizer ready: true, restart count 0 Mar 26 17:52:57.554: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:52:57.554: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:52:57.554: INFO: dns-controller-69987775c6-ntctn started at 2023-03-26 17:17:49 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:57.554: INFO: Container dns-controller ready: true, restart count 0 Mar 26 17:52:57.554: INFO: aws-cloud-controller-manager-tbxvs started at 2023-03-26 17:18:29 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:57.554: INFO: Container aws-cloud-controller-manager ready: true, restart count 0 Mar 26 17:52:57.554: INFO: calico-node-5cszq started at 2023-03-26 17:18:29 +0000 UTC (3+1 container statuses recorded) Mar 26 17:52:57.554: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 26 17:52:57.554: INFO: Init container install-cni ready: true, restart count 0 Mar 26 17:52:57.554: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 26 17:52:57.554: INFO: Container calico-node ready: true, restart count 0 Mar 26 17:52:57.951: INFO: Latency metrics for node i-07cdb76b0ac2dbfa1 Mar 26 17:52:57.951: INFO: Logging node info for node i-0b2c24f535e511ae5 Mar 26 17:52:58.056: INFO: Node Info: &Node{ObjectMeta:{i-0b2c24f535e511ae5 8f866583-6b9f-42fc-932a-c5558d02f775 58735 0 2023-03-26 17:30:16 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3b kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0b2c24f535e511ae5 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3b topology.hostpath.csi/node:i-0b2c24f535e511ae5 topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3b] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-capacity-8925":"i-0b2c24f535e511ae5","ebs.csi.aws.com":"i-0b2c24f535e511ae5"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.54.135/19 projectcalico.org/IPv4IPIPTunnelAddr:100.113.179.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-03-26 17:30:16 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:30:16 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-03-26 17:30:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-03-26 17:30:17 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-03-26 17:30:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.9.0/24\"":{}}}} } {calico-node Update v1 2023-03-26 17:30:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2023-03-26 17:52:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.9.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3b/i-0b2c24f535e511ae5,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.9.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-26 17:30:43 +0000 UTC,LastTransitionTime:2023-03-26 17:30:43 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-26 17:52:46 +0000 UTC,LastTransitionTime:2023-03-26 17:30:16 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-26 17:52:46 +0000 UTC,LastTransitionTime:2023-03-26 17:30:16 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-26 17:52:46 +0000 UTC,LastTransitionTime:2023-03-26 17:30:16 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-26 17:52:46 +0000 UTC,LastTransitionTime:2023-03-26 17:30:34 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.54.135,},NodeAddress{Type:ExternalIP,Address:13.38.65.62,},NodeAddress{Type:InternalDNS,Address:i-0b2c24f535e511ae5.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-0b2c24f535e511ae5.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-38-65-62.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec256778270128bdfe9c2066f7fedcda,SystemUUID:ec256778-2701-28bd-fe9c-2066f7fedcda,BootID:542316ee-6bea-470f-85fc-51e338ca7e74,KernelVersion:5.15.0-1031-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0,KubeProxyVersion:v1.28.0-alpha.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/kube-proxy@sha256:8a03b3147cd7be8e8235ae1cd70cf69aca9ce03ba1cfaffea320540bb5afa496 registry.k8s.io/kube-proxy:v1.28.0-alpha.0],SizeBytes:23896850,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 26 17:52:58.057: INFO: Logging kubelet events for node i-0b2c24f535e511ae5 Mar 26 17:52:58.173: INFO: Logging pods the kubelet thinks is on node i-0b2c24f535e511ae5 Mar 26 17:52:58.303: INFO: service-headless-pdh7r started at 2023-03-26 17:51:57 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:58.303: INFO: Container service-headless ready: true, restart count 0 Mar 26 17:52:58.303: INFO: netserver-1 started at 2023-03-26 17:52:45 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:58.303: INFO: Container webserver ready: true, restart count 0 Mar 26 17:52:58.303: INFO: kube-proxy-i-0b2c24f535e511ae5 started at 2023-03-26 17:30:17 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:58.303: INFO: Container kube-proxy ready: true, restart count 0 Mar 26 17:52:58.303: INFO: pod-b2d7fa2c-b818-4f49-b51d-9aee01b2b68e started at 2023-03-26 17:52:57 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:58.303: INFO: Container test-container ready: false, restart count 0 Mar 26 17:52:58.303: INFO: hostexec-i-0b2c24f535e511ae5-j2n8s started at 2023-03-26 17:52:44 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:58.303: INFO: Container agnhost-container ready: true, restart count 0 Mar 26 17:52:58.303: INFO: csi-mockplugin-0 started at 2023-03-26 17:52:45 +0000 UTC (0+3 container statuses recorded) Mar 26 17:52:58.303: INFO: Container csi-provisioner ready: true, restart count 0 Mar 26 17:52:58.303: INFO: Container driver-registrar ready: true, restart count 0 Mar 26 17:52:58.303: INFO: Container mock ready: true, restart count 0 Mar 26 17:52:58.303: INFO: service-headless-toggled-pfj8h started at 2023-03-26 17:52:12 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:58.303: INFO: Container service-headless-toggled ready: true, restart count 0 Mar 26 17:52:58.303: INFO: calico-node-rdfns started at 2023-03-26 17:30:17 +0000 UTC (3+1 container statuses recorded) Mar 26 17:52:58.303: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 26 17:52:58.303: INFO: Init container install-cni ready: true, restart count 0 Mar 26 17:52:58.303: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 26 17:52:58.303: INFO: Container calico-node ready: true, restart count 0 Mar 26 17:52:58.303: INFO: ebs-csi-node-x9jln started at 2023-03-26 17:30:17 +0000 UTC (0+3 container statuses recorded) Mar 26 17:52:58.303: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:52:58.303: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:52:58.303: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:52:58.303: INFO: pod-handle-http-request started at 2023-03-26 17:52:43 +0000 UTC (0+2 container statuses recorded) Mar 26 17:52:58.303: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 26 17:52:58.303: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 26 17:52:58.303: INFO: webserver-pod started at 2023-03-26 17:49:38 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:58.303: INFO: Container agnhost ready: false, restart count 0 Mar 26 17:52:58.303: INFO: liveness-aa281934-a87f-4590-8112-09cc2a18791a started at 2023-03-26 17:51:42 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:58.303: INFO: Container agnhost-container ready: true, restart count 3 Mar 26 17:52:58.303: INFO: pod-logs-websocket-b86e2ece-77c8-44a8-a600-ac67b366a1eb started at 2023-03-26 17:52:19 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:58.303: INFO: Container main ready: true, restart count 0 Mar 26 17:52:58.832: INFO: Latency metrics for node i-0b2c24f535e511ae5 Mar 26 17:52:58.832: INFO: Logging node info for node i-0c64386131d9d94c5 Mar 26 17:52:58.938: INFO: Node Info: &Node{ObjectMeta:{i-0c64386131d9d94c5 6c5a59f3-69fd-488b-b94e-23777e242a7e 58751 0 2023-03-26 17:34:02 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3b kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0c64386131d9d94c5 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3b topology.hostpath.csi/node:i-0c64386131d9d94c5 topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3b] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0c64386131d9d94c5"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.63.240/19 projectcalico.org/IPv4IPIPTunnelAddr:100.122.71.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-03-26 17:34:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:34:02 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-03-26 17:34:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-03-26 17:34:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-03-26 17:34:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.10.0/24\"":{}}}} } {calico-node Update v1 2023-03-26 17:34:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2023-03-26 17:52:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.10.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3b/i-0c64386131d9d94c5,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.10.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-26 17:34:21 +0000 UTC,LastTransitionTime:2023-03-26 17:34:21 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-26 17:52:47 +0000 UTC,LastTransitionTime:2023-03-26 17:34:02 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-26 17:52:47 +0000 UTC,LastTransitionTime:2023-03-26 17:34:02 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-26 17:52:47 +0000 UTC,LastTransitionTime:2023-03-26 17:34:02 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-26 17:52:47 +0000 UTC,LastTransitionTime:2023-03-26 17:34:14 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.63.240,},NodeAddress{Type:ExternalIP,Address:15.236.210.84,},NodeAddress{Type:InternalDNS,Address:i-0c64386131d9d94c5.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-0c64386131d9d94c5.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-236-210-84.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2c2c56ef9295a859b1f844cff158e8,SystemUUID:ec2c2c56-ef92-95a8-59b1-f844cff158e8,BootID:825bc25d-7144-4ec9-8dfb-f77f9cde8c31,KernelVersion:5.15.0-1031-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0,KubeProxyVersion:v1.28.0-alpha.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/kube-proxy@sha256:8a03b3147cd7be8e8235ae1cd70cf69aca9ce03ba1cfaffea320540bb5afa496 registry.k8s.io/kube-proxy:v1.28.0-alpha.0],SizeBytes:23896850,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:13ac9b3c476d7290a4451d65d09d6016a2cb89836ffbfa4eae55b72731a22080 registry.k8s.io/build-image/distroless-iptables:v0.2.2],SizeBytes:7729580,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 26 17:52:58.938: INFO: Logging kubelet events for node i-0c64386131d9d94c5 Mar 26 17:52:59.052: INFO: Logging pods the kubelet thinks is on node i-0c64386131d9d94c5 Mar 26 17:52:59.165: INFO: netserver-2 started at 2023-03-26 17:52:45 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:59.165: INFO: Container webserver ready: false, restart count 0 Mar 26 17:52:59.165: INFO: service-headless-toggled-4rcm7 started at 2023-03-26 17:52:12 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:59.165: INFO: Container service-headless-toggled ready: true, restart count 0 Mar 26 17:52:59.165: INFO: hostexec-i-0c64386131d9d94c5-6rn7h started at 2023-03-26 17:52:44 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:59.165: INFO: Container agnhost-container ready: true, restart count 0 Mar 26 17:52:59.165: INFO: kube-proxy-i-0c64386131d9d94c5 started at 2023-03-26 17:34:03 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:59.165: INFO: Container kube-proxy ready: true, restart count 0 Mar 26 17:52:59.165: INFO: calico-node-jl5lk started at 2023-03-26 17:34:03 +0000 UTC (3+1 container statuses recorded) Mar 26 17:52:59.165: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 26 17:52:59.165: INFO: Init container install-cni ready: true, restart count 0 Mar 26 17:52:59.165: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 26 17:52:59.165: INFO: Container calico-node ready: true, restart count 0 Mar 26 17:52:59.165: INFO: pod-init-5960688a-c1af-4075-9f9f-6fb51503b8b1 started at 2023-03-26 17:52:42 +0000 UTC (2+1 container statuses recorded) Mar 26 17:52:59.165: INFO: Init container init1 ready: false, restart count 1 Mar 26 17:52:59.165: INFO: Init container init2 ready: false, restart count 0 Mar 26 17:52:59.165: INFO: Container run1 ready: false, restart count 0 Mar 26 17:52:59.165: INFO: pod-a53a6922-de02-4dce-a185-739447946261 started at 2023-03-26 17:52:56 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:59.165: INFO: Container test-container ready: false, restart count 0 Mar 26 17:52:59.165: INFO: pod-secrets-65c1903f-ac1d-4994-a139-1322ba03876e started at 2023-03-26 17:50:30 +0000 UTC (0+3 container statuses recorded) Mar 26 17:52:59.165: INFO: Container creates-volume-test ready: true, restart count 0 Mar 26 17:52:59.165: INFO: Container dels-volume-test ready: true, restart count 0 Mar 26 17:52:59.165: INFO: Container upds-volume-test ready: true, restart count 0 Mar 26 17:52:59.165: INFO: hostexec-i-0c64386131d9d94c5-c8mwc started at 2023-03-26 17:51:39 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:59.165: INFO: Container agnhost-container ready: true, restart count 0 Mar 26 17:52:59.165: INFO: pod-15c69657-7ff8-42a3-bacf-9215772e4f61 started at 2023-03-26 17:51:49 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:59.165: INFO: Container write-pod ready: true, restart count 0 Mar 26 17:52:59.165: INFO: webhook-to-be-mutated started at 2023-03-26 17:52:57 +0000 UTC (1+1 container statuses recorded) Mar 26 17:52:59.165: INFO: Init container webhook-added-init-container ready: false, restart count 0 Mar 26 17:52:59.165: INFO: Container example ready: false, restart count 0 Mar 26 17:52:59.165: INFO: ebs-csi-node-rhk2b started at 2023-03-26 17:34:03 +0000 UTC (0+3 container statuses recorded) Mar 26 17:52:59.165: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:52:59.165: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:52:59.165: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:52:59.165: INFO: coredns-autoscaler-7cb5c5b969-xmt8r started at 2023-03-26 17:34:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:59.165: INFO: Container autoscaler ready: true, restart count 0 Mar 26 17:52:59.165: INFO: exceed-active-deadline-gs8kx started at 2023-03-26 17:52:35 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:59.165: INFO: Container c ready: true, restart count 0 Mar 26 17:52:59.586: INFO: Latency metrics for node i-0c64386131d9d94c5 Mar 26 17:52:59.586: INFO: Logging node info for node i-0ef04f0ca28b74fa4 Mar 26 17:52:59.694: INFO: Node Info: &Node{ObjectMeta:{i-0ef04f0ca28b74fa4 1429588e-1f3b-4a1a-98e2-600879dad0f2 59007 0 2023-03-26 17:21:49 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3b kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0ef04f0ca28b74fa4 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3b topology.hostpath.csi/node:i-0ef04f0ca28b74fa4 topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3b] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-capacity-4023":"i-0ef04f0ca28b74fa4","ebs.csi.aws.com":"i-0ef04f0ca28b74fa4"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.42.152/19 projectcalico.org/IPv4IPIPTunnelAddr:100.104.100.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-26 17:21:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:21:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:21:50 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-03-26 17:21:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-03-26 17:22:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.7.0/24\"":{}}}} } {calico-node Update v1 2023-03-26 17:22:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-03-26 17:52:53 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-03-26 17:52:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.7.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3b/i-0ef04f0ca28b74fa4,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.7.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-26 17:22:08 +0000 UTC,LastTransitionTime:2023-03-26 17:22:08 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-26 17:52:55 +0000 UTC,LastTransitionTime:2023-03-26 17:21:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-26 17:52:55 +0000 UTC,LastTransitionTime:2023-03-26 17:21:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-26 17:52:55 +0000 UTC,LastTransitionTime:2023-03-26 17:21:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-26 17:52:55 +0000 UTC,LastTransitionTime:2023-03-26 17:22:00 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.152,},NodeAddress{Type:ExternalIP,Address:35.180.133.237,},NodeAddress{Type:InternalDNS,Address:i-0ef04f0ca28b74fa4.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-0ef04f0ca28b74fa4.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-180-133-237.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2cd6131a8983e20721f6c173936bc3,SystemUUID:ec2cd613-1a89-83e2-0721-f6c173936bc3,BootID:34695e7c-23d6-4648-b207-41bcd12c2edf,KernelVersion:5.15.0-1031-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0,KubeProxyVersion:v1.28.0-alpha.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/kube-proxy@sha256:8a03b3147cd7be8e8235ae1cd70cf69aca9ce03ba1cfaffea320540bb5afa496 registry.k8s.io/kube-proxy:v1.28.0-alpha.0],SizeBytes:23896850,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-capacity-4023^0723e684-cbff-11ed-a42e-5e836726cef6],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-capacity-4023^0723e684-cbff-11ed-a42e-5e836726cef6,DevicePath:,},},Config:nil,},} Mar 26 17:52:59.694: INFO: Logging kubelet events for node i-0ef04f0ca28b74fa4 Mar 26 17:52:59.807: INFO: Logging pods the kubelet thinks is on node i-0ef04f0ca28b74fa4 Mar 26 17:52:59.922: INFO: pvc-volume-tester-sxr6c started at 2023-03-26 17:52:52 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:59.922: INFO: Container volume-tester ready: false, restart count 0 Mar 26 17:52:59.922: INFO: liveness-98819b4b-5e8c-4707-afa5-47a774468375 started at 2023-03-26 17:50:16 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:59.922: INFO: Container agnhost-container ready: true, restart count 0 Mar 26 17:52:59.922: INFO: busybox-43b1a9ea-82c6-485d-a002-1b0986b52eef started at 2023-03-26 17:52:39 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:59.922: INFO: Container busybox ready: true, restart count 0 Mar 26 17:52:59.922: INFO: labelsupdate89553ffe-db57-485c-8c2e-3033dcae22c6 started at 2023-03-26 17:51:44 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:59.922: INFO: Container client-container ready: true, restart count 0 Mar 26 17:52:59.922: INFO: service-headless-toggled-r679l started at 2023-03-26 17:52:12 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:59.922: INFO: Container service-headless-toggled ready: true, restart count 0 Mar 26 17:52:59.922: INFO: startup-86fac25e-94ed-46f5-87c0-9776095c4056 started at 2023-03-26 17:48:56 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:59.922: INFO: Container busybox ready: false, restart count 0 Mar 26 17:52:59.922: INFO: exceed-active-deadline-mkhfv started at 2023-03-26 17:52:35 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:59.922: INFO: Container c ready: true, restart count 0 Mar 26 17:52:59.922: INFO: csi-mockplugin-0 started at 2023-03-26 17:52:40 +0000 UTC (0+3 container statuses recorded) Mar 26 17:52:59.922: INFO: Container csi-provisioner ready: true, restart count 0 Mar 26 17:52:59.922: INFO: Container driver-registrar ready: true, restart count 0 Mar 26 17:52:59.922: INFO: Container mock ready: true, restart count 0 Mar 26 17:52:59.922: INFO: netserver-3 started at 2023-03-26 17:52:45 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:59.922: INFO: Container webserver ready: false, restart count 0 Mar 26 17:52:59.922: INFO: coredns-559769c974-6mjw2 started at 2023-03-26 17:22:53 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:59.922: INFO: Container coredns ready: true, restart count 0 Mar 26 17:52:59.922: INFO: hostexec-i-0ef04f0ca28b74fa4-r9rrv started at 2023-03-26 17:52:59 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:59.922: INFO: Container agnhost-container ready: false, restart count 0 Mar 26 17:52:59.922: INFO: service-headless-l7zdh started at 2023-03-26 17:51:57 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:59.922: INFO: Container service-headless ready: true, restart count 0 Mar 26 17:52:59.922: INFO: kube-proxy-i-0ef04f0ca28b74fa4 started at 2023-03-26 17:21:50 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:59.922: INFO: Container kube-proxy ready: true, restart count 0 Mar 26 17:52:59.922: INFO: liveness-f07cd7ad-7f53-408f-9ba0-02fe49537f88 started at 2023-03-26 17:49:01 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:59.922: INFO: Container agnhost-container ready: true, restart count 0 Mar 26 17:52:59.922: INFO: calico-node-bdwdr started at 2023-03-26 17:21:50 +0000 UTC (3+1 container statuses recorded) Mar 26 17:52:59.922: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 26 17:52:59.922: INFO: Init container install-cni ready: true, restart count 0 Mar 26 17:52:59.922: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 26 17:52:59.922: INFO: Container calico-node ready: true, restart count 0 Mar 26 17:52:59.922: INFO: ebs-csi-node-6wp7p started at 2023-03-26 17:21:50 +0000 UTC (0+3 container statuses recorded) Mar 26 17:52:59.922: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:52:59.922: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:52:59.922: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:52:59.922: INFO: csi-mockplugin-attacher-0 started at 2023-03-26 17:52:40 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:59.922: INFO: Container csi-attacher ready: true, restart count 0 Mar 26 17:53:00.369: INFO: Latency metrics for node i-0ef04f0ca28b74fa4 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/26/23 17:53:00.369 (4.26s) < Exit [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - dump namespaces | framework.go:209 @ 03/26/23 17:53:00.369 (4.26s) > Enter [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - tear down framework | framework.go:206 @ 03/26/23 17:53:00.369 STEP: Destroying namespace "provisioning-6644" for this suite. - test/e2e/framework/framework.go:351 @ 03/26/23 17:53:00.369 < Exit [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - tear down framework | framework.go:206 @ 03/26/23 17:53:00.481 (112ms) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/26/23 17:53:00.481 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/26/23 17:53:00.481 (0s)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\sExternal\sStorage\s\[Driver\:\sebs\.csi\.aws\.com\]\s\[Testpattern\:\sDynamic\sPV\s\(default\sfs\)\]\ssubPath\sshould\ssupport\sreadOnly\sdirectory\sspecified\sin\sthe\svolumeMount$'
[FAILED] failed to get logs from pod-subpath-test-dynamicpv-s7rl for test-container-subpath-dynamicpv-s7rl: Get "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/provisioning-7834/pods/pod-subpath-test-dynamicpv-s7rl/log?container=test-container-subpath-dynamicpv-s7rl&previous=false": stream error: stream ID 663; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/26/23 17:40:47.884from junit_01.xml
> Enter [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/storage/framework/testsuite.go:51 @ 03/26/23 17:40:29.295 < Exit [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/storage/framework/testsuite.go:51 @ 03/26/23 17:40:29.295 (0s) > Enter [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath - set up framework | framework.go:191 @ 03/26/23 17:40:29.295 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/26/23 17:40:29.295 Mar 26 17:40:29.295: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename provisioning - test/e2e/framework/framework.go:250 @ 03/26/23 17:40:29.296 STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 03/26/23 17:40:29.611 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:262 @ 03/26/23 17:40:29.817 < Exit [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath - set up framework | framework.go:191 @ 03/26/23 17:40:30.024 (728ms) > Enter [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/framework/metrics/init/init.go:33 @ 03/26/23 17:40:30.024 < Exit [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/framework/metrics/init/init.go:33 @ 03/26/23 17:40:30.024 (0s) > Enter [It] should support readOnly directory specified in the volumeMount - test/e2e/storage/testsuites/subpath.go:367 @ 03/26/23 17:40:30.024 Mar 26 17:40:30.024: INFO: Creating resource for dynamic PV Mar 26 17:40:30.024: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} STEP: creating a StorageClass provisioning-7834-e2e-scr9wdr - test/e2e/storage/framework/volume_resource.go:102 @ 03/26/23 17:40:30.024 STEP: creating a claim - test/e2e/storage/framework/volume_resource.go:294 @ 03/26/23 17:40:30.144 Mar 26 17:40:30.144: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil STEP: Creating pod pod-subpath-test-dynamicpv-s7rl - test/e2e/storage/testsuites/subpath.go:691 @ 03/26/23 17:40:30.373 STEP: Creating a pod to test subpath - test/e2e/framework/pod/output/output.go:243 @ 03/26/23 17:40:30.373 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/26/23 17:40:47.44 Mar 26 17:40:47.546: INFO: Trying to get logs from node i-0c64386131d9d94c5 pod pod-subpath-test-dynamicpv-s7rl container test-container-subpath-dynamicpv-s7rl: <nil> Mar 26 17:40:47.651: INFO: Failed to get logs from node "i-0c64386131d9d94c5" pod "pod-subpath-test-dynamicpv-s7rl" container "test-container-subpath-dynamicpv-s7rl". Get "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/provisioning-7834/pods/pod-subpath-test-dynamicpv-s7rl/log?container=test-container-subpath-dynamicpv-s7rl&previous=false": stream error: stream ID 663; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/26/23 17:40:47.651 Mar 26 17:40:47.884: INFO: Unexpected error: <*fmt.wrapError | 0xc002998fa0>: failed to get logs from pod-subpath-test-dynamicpv-s7rl for test-container-subpath-dynamicpv-s7rl: Get "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/provisioning-7834/pods/pod-subpath-test-dynamicpv-s7rl/log?container=test-container-subpath-dynamicpv-s7rl&previous=false": stream error: stream ID 663; INTERNAL_ERROR; received from peer { msg: "failed to get logs from pod-subpath-test-dynamicpv-s7rl for test-container-subpath-dynamicpv-s7rl: Get \"https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/provisioning-7834/pods/pod-subpath-test-dynamicpv-s7rl/log?container=test-container-subpath-dynamicpv-s7rl&previous=false\": stream error: stream ID 663; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc004f8f2f0>{ Op: "Get", URL: "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/provisioning-7834/pods/pod-subpath-test-dynamicpv-s7rl/log?container=test-container-subpath-dynamicpv-s7rl&previous=false", Err: <http2.StreamError>{ StreamID: 663, Code: 2, Cause: <*errors.errorString | 0xc0001e7680>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from pod-subpath-test-dynamicpv-s7rl for test-container-subpath-dynamicpv-s7rl: Get "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/provisioning-7834/pods/pod-subpath-test-dynamicpv-s7rl/log?container=test-container-subpath-dynamicpv-s7rl&previous=false": stream error: stream ID 663; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/26/23 17:40:47.884 < Exit [It] should support readOnly directory specified in the volumeMount - test/e2e/storage/testsuites/subpath.go:367 @ 03/26/23 17:40:47.884 (17.861s) > Enter [AfterEach] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/framework/node/init/init.go:33 @ 03/26/23 17:40:47.884 Mar 26 17:40:47.884: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/framework/node/init/init.go:33 @ 03/26/23 17:40:47.99 (105ms) > Enter [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/storage/testsuites/subpath.go:369 @ 03/26/23 17:40:47.99 STEP: Deleting pod - test/e2e/storage/testsuites/subpath.go:172 @ 03/26/23 17:40:47.99 Mar 26 17:40:47.990: INFO: Deleting pod "pod-subpath-test-dynamicpv-s7rl" in namespace "provisioning-7834" STEP: Deleting pvc - test/e2e/storage/framework/volume_resource.go:181 @ 03/26/23 17:40:48.097 Mar 26 17:40:48.304: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.com8g8wd" Mar 26 17:40:48.409: INFO: Waiting up to 5m0s for PersistentVolume pvc-f547679e-8d68-4fdf-a6e1-a654ccf36b68 to get deleted Mar 26 17:40:48.513: INFO: PersistentVolume pvc-f547679e-8d68-4fdf-a6e1-a654ccf36b68 found and phase=Released (104.265129ms) Mar 26 17:40:53.619: INFO: PersistentVolume pvc-f547679e-8d68-4fdf-a6e1-a654ccf36b68 found and phase=Released (5.209896232s) Mar 26 17:40:58.723: INFO: PersistentVolume pvc-f547679e-8d68-4fdf-a6e1-a654ccf36b68 found and phase=Released (10.314069488s) Mar 26 17:41:03.827: INFO: PersistentVolume pvc-f547679e-8d68-4fdf-a6e1-a654ccf36b68 was removed STEP: Deleting sc - test/e2e/storage/framework/volume_resource.go:228 @ 03/26/23 17:41:03.827 < Exit [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/storage/testsuites/subpath.go:369 @ 03/26/23 17:41:03.933 (15.943s) > Enter [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/framework/metrics/init/init.go:35 @ 03/26/23 17:41:03.933 < Exit [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/framework/metrics/init/init.go:35 @ 03/26/23 17:41:03.933 (0s) > Enter [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - dump namespaces | framework.go:209 @ 03/26/23 17:41:03.933 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/26/23 17:41:03.933 STEP: Collecting events from namespace "provisioning-7834". - test/e2e/framework/debug/dump.go:42 @ 03/26/23 17:41:03.933 STEP: Found 15 events. - test/e2e/framework/debug/dump.go:46 @ 03/26/23 17:41:04.037 Mar 26 17:41:04.037: INFO: At 2023-03-26 17:40:30 +0000 UTC - event for ebs.csi.aws.com8g8wd: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding Mar 26 17:41:04.037: INFO: At 2023-03-26 17:40:30 +0000 UTC - event for ebs.csi.aws.com8g8wd: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "ebs.csi.aws.com" or manually created by system administrator Mar 26 17:41:04.037: INFO: At 2023-03-26 17:40:30 +0000 UTC - event for ebs.csi.aws.com8g8wd: {ebs.csi.aws.com_i-07cdb76b0ac2dbfa1_cb4b68af-2d91-4bfb-9626-7c22a975e7d6 } Provisioning: External provisioner is provisioning volume for claim "provisioning-7834/ebs.csi.aws.com8g8wd" Mar 26 17:41:04.037: INFO: At 2023-03-26 17:40:36 +0000 UTC - event for ebs.csi.aws.com8g8wd: {ebs.csi.aws.com_i-07cdb76b0ac2dbfa1_cb4b68af-2d91-4bfb-9626-7c22a975e7d6 } ProvisioningSucceeded: Successfully provisioned volume pvc-f547679e-8d68-4fdf-a6e1-a654ccf36b68 Mar 26 17:41:04.037: INFO: At 2023-03-26 17:40:37 +0000 UTC - event for pod-subpath-test-dynamicpv-s7rl: {default-scheduler } Scheduled: Successfully assigned provisioning-7834/pod-subpath-test-dynamicpv-s7rl to i-0c64386131d9d94c5 Mar 26 17:41:04.037: INFO: At 2023-03-26 17:40:39 +0000 UTC - event for pod-subpath-test-dynamicpv-s7rl: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-f547679e-8d68-4fdf-a6e1-a654ccf36b68" Mar 26 17:41:04.037: INFO: At 2023-03-26 17:40:42 +0000 UTC - event for pod-subpath-test-dynamicpv-s7rl: {kubelet i-0c64386131d9d94c5} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 26 17:41:04.037: INFO: At 2023-03-26 17:40:42 +0000 UTC - event for pod-subpath-test-dynamicpv-s7rl: {kubelet i-0c64386131d9d94c5} Created: Created container init-volume-dynamicpv-s7rl Mar 26 17:41:04.037: INFO: At 2023-03-26 17:40:42 +0000 UTC - event for pod-subpath-test-dynamicpv-s7rl: {kubelet i-0c64386131d9d94c5} Started: Started container init-volume-dynamicpv-s7rl Mar 26 17:41:04.037: INFO: At 2023-03-26 17:40:43 +0000 UTC - event for pod-subpath-test-dynamicpv-s7rl: {kubelet i-0c64386131d9d94c5} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 26 17:41:04.037: INFO: At 2023-03-26 17:40:43 +0000 UTC - event for pod-subpath-test-dynamicpv-s7rl: {kubelet i-0c64386131d9d94c5} Created: Created container test-init-volume-dynamicpv-s7rl Mar 26 17:41:04.037: INFO: At 2023-03-26 17:40:43 +0000 UTC - event for pod-subpath-test-dynamicpv-s7rl: {kubelet i-0c64386131d9d94c5} Started: Started container test-init-volume-dynamicpv-s7rl Mar 26 17:41:04.037: INFO: At 2023-03-26 17:40:44 +0000 UTC - event for pod-subpath-test-dynamicpv-s7rl: {kubelet i-0c64386131d9d94c5} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 26 17:41:04.037: INFO: At 2023-03-26 17:40:44 +0000 UTC - event for pod-subpath-test-dynamicpv-s7rl: {kubelet i-0c64386131d9d94c5} Created: Created container test-container-subpath-dynamicpv-s7rl Mar 26 17:41:04.037: INFO: At 2023-03-26 17:40:44 +0000 UTC - event for pod-subpath-test-dynamicpv-s7rl: {kubelet i-0c64386131d9d94c5} Started: Started container test-container-subpath-dynamicpv-s7rl Mar 26 17:41:04.141: INFO: POD NODE PHASE GRACE CONDITIONS Mar 26 17:41:04.141: INFO: Mar 26 17:41:04.249: INFO: Logging node info for node i-011576d1f2b6be6ec Mar 26 17:41:04.354: INFO: Node Info: &Node{ObjectMeta:{i-011576d1f2b6be6ec ef4bb85b-7188-4ef2-8d1a-583f0fcc379a 19814 0 2023-03-26 17:26:11 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3b kubernetes.io/arch:amd64 kubernetes.io/hostname:i-011576d1f2b6be6ec kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3b topology.hostpath.csi/node:i-011576d1f2b6be6ec topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3b] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-011576d1f2b6be6ec"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.41.235/19 projectcalico.org/IPv4IPIPTunnelAddr:100.127.173.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-03-26 17:26:11 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:26:11 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-03-26 17:26:11 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-03-26 17:26:12 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-03-26 17:26:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.8.0/24\"":{}}}} } {calico-node Update v1 2023-03-26 17:26:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2023-03-26 17:40:59 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.8.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3b/i-011576d1f2b6be6ec,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.8.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-26 17:26:30 +0000 UTC,LastTransitionTime:2023-03-26 17:26:30 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-26 17:41:00 +0000 UTC,LastTransitionTime:2023-03-26 17:26:11 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-26 17:41:00 +0000 UTC,LastTransitionTime:2023-03-26 17:26:11 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-26 17:41:00 +0000 UTC,LastTransitionTime:2023-03-26 17:26:11 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-26 17:41:00 +0000 UTC,LastTransitionTime:2023-03-26 17:26:23 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.41.235,},NodeAddress{Type:ExternalIP,Address:35.180.45.101,},NodeAddress{Type:InternalDNS,Address:i-011576d1f2b6be6ec.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-011576d1f2b6be6ec.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-180-45-101.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec26cc6e198da1950569e38fb3a7f618,SystemUUID:ec26cc6e-198d-a195-0569-e38fb3a7f618,BootID:b67057d3-2187-4008-9056-8a843d3c6813,KernelVersion:5.15.0-1031-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0,KubeProxyVersion:v1.28.0-alpha.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/kube-proxy@sha256:8a03b3147cd7be8e8235ae1cd70cf69aca9ce03ba1cfaffea320540bb5afa496 registry.k8s.io/kube-proxy:v1.28.0-alpha.0],SizeBytes:23896850,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 26 17:41:04.354: INFO: Logging kubelet events for node i-011576d1f2b6be6ec Mar 26 17:41:04.466: INFO: Logging pods the kubelet thinks is on node i-011576d1f2b6be6ec Mar 26 17:41:04.576: INFO: httpd started at 2023-03-26 17:40:57 +0000 UTC (0+1 container statuses recorded) Mar 26 17:41:04.576: INFO: Container httpd ready: false, restart count 0 Mar 26 17:41:04.576: INFO: pod-configmaps-1561186f-1555-47a5-836f-0a6b05488410 started at 2023-03-26 17:40:38 +0000 UTC (0+2 container statuses recorded) Mar 26 17:41:04.576: INFO: Container agnhost-container ready: true, restart count 0 Mar 26 17:41:04.576: INFO: Container configmap-volume-binary-test ready: false, restart count 0 Mar 26 17:41:04.576: INFO: concurrent-27997541-wgzt2 started at 2023-03-26 17:41:00 +0000 UTC (0+1 container statuses recorded) Mar 26 17:41:04.576: INFO: Container c ready: true, restart count 0 Mar 26 17:41:04.576: INFO: netserver-0 started at 2023-03-26 17:40:31 +0000 UTC (0+1 container statuses recorded) Mar 26 17:41:04.576: INFO: Container webserver ready: true, restart count 0 Mar 26 17:41:04.576: INFO: hostpath-client started at 2023-03-26 17:41:00 +0000 UTC (0+1 container statuses recorded) Mar 26 17:41:04.576: INFO: Container hostpath-client ready: true, restart count 0 Mar 26 17:41:04.576: INFO: ebs-csi-node-7dqmm started at 2023-03-26 17:26:12 +0000 UTC (0+3 container statuses recorded) Mar 26 17:41:04.576: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:41:04.576: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:41:04.576: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:41:04.576: INFO: coredns-559769c974-58thj started at 2023-03-26 17:34:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:41:04.576: INFO: Container coredns ready: true, restart count 0 Mar 26 17:41:04.576: INFO: pod-ephm-test-secret-7qlf started at 2023-03-26 17:40:56 +0000 UTC (0+1 container statuses recorded) Mar 26 17:41:04.576: INFO: Container test-container-subpath-secret-7qlf ready: false, restart count 0 Mar 26 17:41:04.576: INFO: pod-ephm-test-configmap-btg8 started at 2023-03-26 17:40:14 +0000 UTC (0+1 container statuses recorded) Mar 26 17:41:04.576: INFO: Container test-container-subpath-configmap-btg8 ready: false, restart count 0 Mar 26 17:41:04.576: INFO: kube-proxy-i-011576d1f2b6be6ec started at 2023-03-26 17:26:12 +0000 UTC (0+1 container statuses recorded) Mar 26 17:41:04.576: INFO: Container kube-proxy ready: true, restart count 0 Mar 26 17:41:04.576: INFO: calico-node-tmjhr started at 2023-03-26 17:26:12 +0000 UTC (3+1 container statuses recorded) Mar 26 17:41:04.576: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 26 17:41:04.576: INFO: Init container install-cni ready: true, restart count 0 Mar 26 17:41:04.576: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 26 17:41:04.576: INFO: Container calico-node ready: true, restart count 0 Mar 26 17:41:04.576: INFO: pfpod started at 2023-03-26 17:40:27 +0000 UTC (0+2 container statuses recorded) Mar 26 17:41:04.576: INFO: Container portforwardtester ready: false, restart count 0 Mar 26 17:41:04.576: INFO: Container readiness ready: false, restart count 0 Mar 26 17:41:04.576: INFO: execpodr4tl7 started at 2023-03-26 17:40:57 +0000 UTC (0+1 container statuses recorded) Mar 26 17:41:04.576: INFO: Container agnhost-container ready: true, restart count 0 Mar 26 17:41:04.966: INFO: Latency metrics for node i-011576d1f2b6be6ec Mar 26 17:41:04.966: INFO: Logging node info for node i-07cdb76b0ac2dbfa1 Mar 26 17:41:05.070: INFO: Node Info: &Node{ObjectMeta:{i-07cdb76b0ac2dbfa1 d3bcec50-934c-432e-a590-2a35577f3a0d 19712 0 2023-03-26 17:17:19 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3b kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-07cdb76b0ac2dbfa1 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:eu-west-3b topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3b] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-07cdb76b0ac2dbfa1"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.63.230/19 projectcalico.org/IPv4IPIPTunnelAddr:100.127.118.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-26 17:17:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-03-26 17:17:20 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {calico-node Update v1 2023-03-26 17:18:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {aws-cloud-controller-manager Update v1 2023-03-26 17:18:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:18:48 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-03-26 17:18:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.5.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-03-26 17:40:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.5.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3b/i-07cdb76b0ac2dbfa1,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.5.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892301824 0} {<nil>} 3801076Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787444224 0} {<nil>} 3698676Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-26 17:18:46 +0000 UTC,LastTransitionTime:2023-03-26 17:18:46 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-26 17:40:57 +0000 UTC,LastTransitionTime:2023-03-26 17:17:19 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-26 17:40:57 +0000 UTC,LastTransitionTime:2023-03-26 17:17:19 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-26 17:40:57 +0000 UTC,LastTransitionTime:2023-03-26 17:17:19 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-26 17:40:57 +0000 UTC,LastTransitionTime:2023-03-26 17:18:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.63.230,},NodeAddress{Type:ExternalIP,Address:15.237.44.201,},NodeAddress{Type:InternalDNS,Address:i-07cdb76b0ac2dbfa1.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-07cdb76b0ac2dbfa1.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-237-44-201.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2824f976de88ff768c75c0d62c774f,SystemUUID:ec2824f9-76de-88ff-768c-75c0d62c774f,BootID:bc1e3e86-fc91-4be5-acba-90ac2a46faf2,KernelVersion:5.15.0-1031-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0,KubeProxyVersion:v1.28.0-alpha.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 registry.k8s.io/etcd:3.4.3-0],SizeBytes:100947667,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:9ce33ba33d8e738a5b85ed50b5080ac746deceed4a7496c550927a7a19ca3b6d registry.k8s.io/etcd:3.5.0-0],SizeBytes:99868722,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 registry.k8s.io/etcd:3.5.1-0],SizeBytes:98888614,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 registry.k8s.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:0d2ab6b15b4fe0b903b9e81192d942fb39c29be61fe341cd16db5d0165b0435c registry.k8s.io/etcd:3.3.17-0],SizeBytes:85524408,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:17da501f5d2a675be46040422a27b7cc21b8a43895ac998b171db1c346f361f7 registry.k8s.io/etcd:3.3.10-0],SizeBytes:76162358,},ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager-slim@sha256:8727adc059334e0e3329dbccce116a734da4a090da5e86c8cddccaf333caa666 registry.k8s.io/etcdadm/etcd-manager-slim:v3.0.20230201],SizeBytes:63926165,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:905d7ca17fd02bc24c0eba9a062753aba15db3e31422390bc3238eb762339b20 registry.k8s.io/etcd:3.2.24-1],SizeBytes:63423287,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:45208814,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:43629015,},ContainerImage{Names:[registry.k8s.io/kube-apiserver@sha256:49934a29c559e79ed19fc38b4697b18d8fe174b17bf56192588575f980c93956 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0],SizeBytes:33212506,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:2b6acd7f677f76ffe12ecf3ea7df92eb9b1bdb07336d1ac2a54c7631fb753f7e docker.io/calico/kube-controllers:v3.24.5],SizeBytes:31137169,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager@sha256:974748384634982c73527fdb3c9ec0ec476bc0d52b3dd1d611a380b7f99af1f3 registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0],SizeBytes:30820280,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/kube-proxy@sha256:8a03b3147cd7be8e8235ae1cd70cf69aca9ce03ba1cfaffea320540bb5afa496 registry.k8s.io/kube-proxy:v1.28.0-alpha.0],SizeBytes:23896850,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/kube-scheduler@sha256:cbf4007abb076188f16b975bc2b74452603cc7b34c60a29d92f14c38ad02dc11 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0],SizeBytes:18078674,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:5074723,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 26 17:41:05.071: INFO: Logging kubelet events for node i-07cdb76b0ac2dbfa1 Mar 26 17:41:05.188: INFO: Logging pods the kubelet thinks is on node i-07cdb76b0ac2dbfa1 Mar 26 17:41:05.300: INFO: ebs-csi-controller-79f984545f-vq8bz started at 2023-03-26 17:19:49 +0000 UTC (0+5 container statuses recorded) Mar 26 17:41:05.300: INFO: Container csi-attacher ready: true, restart count 0 Mar 26 17:41:05.300: INFO: Container csi-provisioner ready: true, restart count 0 Mar 26 17:41:05.300: INFO: Container csi-resizer ready: true, restart count 0 Mar 26 17:41:05.300: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:41:05.300: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:41:05.300: INFO: dns-controller-69987775c6-ntctn started at 2023-03-26 17:17:49 +0000 UTC (0+1 container statuses recorded) Mar 26 17:41:05.300: INFO: Container dns-controller ready: true, restart count 0 Mar 26 17:41:05.300: INFO: aws-cloud-controller-manager-tbxvs started at 2023-03-26 17:18:29 +0000 UTC (0+1 container statuses recorded) Mar 26 17:41:05.300: INFO: Container aws-cloud-controller-manager ready: true, restart count 0 Mar 26 17:41:05.300: INFO: calico-node-5cszq started at 2023-03-26 17:18:29 +0000 UTC (3+1 container statuses recorded) Mar 26 17:41:05.300: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 26 17:41:05.300: INFO: Init container install-cni ready: true, restart count 0 Mar 26 17:41:05.300: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 26 17:41:05.300: INFO: Container calico-node ready: true, restart count 0 Mar 26 17:41:05.300: INFO: etcd-manager-events-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (11+1 container statuses recorded) Mar 26 17:41:05.300: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0 Mar 26 17:41:05.300: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0 Mar 26 17:41:05.300: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0 Mar 26 17:41:05.300: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0 Mar 26 17:41:05.300: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0 Mar 26 17:41:05.300: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0 Mar 26 17:41:05.300: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0 Mar 26 17:41:05.300: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0 Mar 26 17:41:05.300: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0 Mar 26 17:41:05.300: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0 Mar 26 17:41:05.300: INFO: Init container init-etcd-3-5-7 ready: true, restart count 0 Mar 26 17:41:05.300: INFO: Container etcd-manager ready: true, restart count 0 Mar 26 17:41:05.300: INFO: etcd-manager-main-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (11+1 container statuses recorded) Mar 26 17:41:05.300: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0 Mar 26 17:41:05.300: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0 Mar 26 17:41:05.300: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0 Mar 26 17:41:05.300: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0 Mar 26 17:41:05.300: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0 Mar 26 17:41:05.300: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0 Mar 26 17:41:05.300: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0 Mar 26 17:41:05.300: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0 Mar 26 17:41:05.300: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0 Mar 26 17:41:05.300: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0 Mar 26 17:41:05.300: INFO: Init container init-etcd-3-5-7 ready: true, restart count 0 Mar 26 17:41:05.300: INFO: Container etcd-manager ready: true, restart count 0 Mar 26 17:41:05.300: INFO: kube-apiserver-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (0+2 container statuses recorded) Mar 26 17:41:05.300: INFO: Container healthcheck ready: true, restart count 0 Mar 26 17:41:05.300: INFO: Container kube-apiserver ready: true, restart count 2 Mar 26 17:41:05.300: INFO: ebs-csi-node-2r7mc started at 2023-03-26 17:18:29 +0000 UTC (0+3 container statuses recorded) Mar 26 17:41:05.300: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:41:05.300: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:41:05.300: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:41:05.300: INFO: kops-controller-thh8s started at 2023-03-26 17:18:29 +0000 UTC (0+1 container statuses recorded) Mar 26 17:41:05.300: INFO: Container kops-controller ready: true, restart count 0 Mar 26 17:41:05.300: INFO: kube-controller-manager-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:41:05.300: INFO: Container kube-controller-manager ready: true, restart count 4 Mar 26 17:41:05.300: INFO: kube-proxy-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:41:05.300: INFO: Container kube-proxy ready: true, restart count 0 Mar 26 17:41:05.300: INFO: kube-scheduler-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:41:05.300: INFO: Container kube-scheduler ready: true, restart count 0 Mar 26 17:41:05.300: INFO: calico-kube-controllers-55f488656-mjjr8 started at 2023-03-26 17:18:51 +0000 UTC (0+1 container statuses recorded) Mar 26 17:41:05.300: INFO: Container calico-kube-controllers ready: true, restart count 0 Mar 26 17:41:05.727: INFO: Latency metrics for node i-07cdb76b0ac2dbfa1 Mar 26 17:41:05.727: INFO: Logging node info for node i-0b2c24f535e511ae5 Mar 26 17:41:05.831: INFO: Node Info: &Node{ObjectMeta:{i-0b2c24f535e511ae5 8f866583-6b9f-42fc-932a-c5558d02f775 19868 0 2023-03-26 17:30:16 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3b kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0b2c24f535e511ae5 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3b topology.hostpath.csi/node:i-0b2c24f535e511ae5 topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-6607":"i-0b2c24f535e511ae5","ebs.csi.aws.com":"i-0b2c24f535e511ae5"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.54.135/19 projectcalico.org/IPv4IPIPTunnelAddr:100.113.179.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-03-26 17:30:16 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:30:16 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-03-26 17:30:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-03-26 17:30:17 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-03-26 17:30:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.9.0/24\"":{}}}} } {calico-node Update v1 2023-03-26 17:30:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2023-03-26 17:41:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-03-26 17:41:01 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.9.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3b/i-0b2c24f535e511ae5,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.9.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-26 17:30:43 +0000 UTC,LastTransitionTime:2023-03-26 17:30:43 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-26 17:41:00 +0000 UTC,LastTransitionTime:2023-03-26 17:30:16 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-26 17:41:00 +0000 UTC,LastTransitionTime:2023-03-26 17:30:16 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-26 17:41:00 +0000 UTC,LastTransitionTime:2023-03-26 17:30:16 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-26 17:41:00 +0000 UTC,LastTransitionTime:2023-03-26 17:30:34 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.54.135,},NodeAddress{Type:ExternalIP,Address:13.38.65.62,},NodeAddress{Type:InternalDNS,Address:i-0b2c24f535e511ae5.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-0b2c24f535e511ae5.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-38-65-62.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec256778270128bdfe9c2066f7fedcda,SystemUUID:ec256778-2701-28bd-fe9c-2066f7fedcda,BootID:542316ee-6bea-470f-85fc-51e338ca7e74,KernelVersion:5.15.0-1031-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0,KubeProxyVersion:v1.28.0-alpha.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/kube-proxy@sha256:8a03b3147cd7be8e8235ae1cd70cf69aca9ce03ba1cfaffea320540bb5afa496 registry.k8s.io/kube-proxy:v1.28.0-alpha.0],SizeBytes:23896850,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-6607^1dd7a607-cbfd-11ed-b816-ce0d7aed5881],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-6607^1dd7a607-cbfd-11ed-b816-ce0d7aed5881,DevicePath:,},},Config:nil,},} Mar 26 17:41:05.832: INFO: Logging kubelet events for node i-0b2c24f535e511ae5 Mar 26 17:41:05.948: INFO: Logging pods the kubelet thinks is on node i-0b2c24f535e511ae5 Mar 26 17:41:06.059: INFO: pfpod started at 2023-03-26 17:39:18 +0000 UTC (0+2 container statuses recorded) Mar 26 17:41:06.059: INFO: Container portforwardtester ready: false, restart count 0 Mar 26 17:41:06.059: INFO: Container readiness ready: false, restart count 0 Mar 26 17:41:06.059: INFO: inline-volume-tester-2r9s6 started at 2023-03-26 17:39:11 +0000 UTC (0+1 container statuses recorded) Mar 26 17:41:06.059: INFO: Container csi-volume-tester ready: true, restart count 0 Mar 26 17:41:06.059: INFO: kube-proxy-i-0b2c24f535e511ae5 started at 2023-03-26 17:30:17 +0000 UTC (0+1 container statuses recorded) Mar 26 17:41:06.059: INFO: Container kube-proxy ready: true, restart count 0 Mar 26 17:41:06.059: INFO: netserver-1 started at 2023-03-26 17:40:31 +0000 UTC (0+1 container statuses recorded) Mar 26 17:41:06.059: INFO: Container webserver ready: true, restart count 0 Mar 26 17:41:06.059: INFO: dns-test-2c2a12ae-edcc-4004-97a5-4aa08b0e03ae started at 2023-03-26 17:40:47 +0000 UTC (0+3 container statuses recorded) Mar 26 17:41:06.059: INFO: Container jessie-querier ready: true, restart count 0 Mar 26 17:41:06.059: INFO: Container querier ready: true, restart count 0 Mar 26 17:41:06.059: INFO: Container webserver ready: true, restart count 0 Mar 26 17:41:06.059: INFO: calico-node-rdfns started at 2023-03-26 17:30:17 +0000 UTC (3+1 container statuses recorded) Mar 26 17:41:06.059: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 26 17:41:06.059: INFO: Init container install-cni ready: true, restart count 0 Mar 26 17:41:06.059: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 26 17:41:06.059: INFO: Container calico-node ready: true, restart count 0 Mar 26 17:41:06.059: INFO: ebs-csi-node-x9jln started at 2023-03-26 17:30:17 +0000 UTC (0+3 container statuses recorded) Mar 26 17:41:06.059: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:41:06.059: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:41:06.059: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:41:06.059: INFO: suspend-false-to-true-nhpb2 started at 2023-03-26 17:40:43 +0000 UTC (0+1 container statuses recorded) Mar 26 17:41:06.059: INFO: Container c ready: true, restart count 0 Mar 26 17:41:06.059: INFO: externalname-service-zmb5t started at 2023-03-26 17:40:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:41:06.059: INFO: Container externalname-service ready: true, restart count 0 Mar 26 17:41:06.059: INFO: csi-hostpathplugin-0 started at 2023-03-26 17:39:08 +0000 UTC (0+7 container statuses recorded) Mar 26 17:41:06.060: INFO: Container csi-attacher ready: true, restart count 0 Mar 26 17:41:06.060: INFO: Container csi-provisioner ready: true, restart count 0 Mar 26 17:41:06.060: INFO: Container csi-resizer ready: true, restart count 0 Mar 26 17:41:06.060: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 26 17:41:06.060: INFO: Container hostpath ready: true, restart count 0 Mar 26 17:41:06.060: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:41:06.060: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:41:06.534: INFO: Latency metrics for node i-0b2c24f535e511ae5 Mar 26 17:41:06.534: INFO: Logging node info for node i-0c64386131d9d94c5 Mar 26 17:41:06.638: INFO: Node Info: &Node{ObjectMeta:{i-0c64386131d9d94c5 6c5a59f3-69fd-488b-b94e-23777e242a7e 19895 0 2023-03-26 17:34:02 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3b kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0c64386131d9d94c5 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3b topology.hostpath.csi/node:i-0c64386131d9d94c5 topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3b] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-expansion-6846":"csi-mock-csi-mock-volumes-expansion-6846","csi-mock-csi-mock-volumes-workload-2002":"i-0c64386131d9d94c5","ebs.csi.aws.com":"i-0c64386131d9d94c5"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.63.240/19 projectcalico.org/IPv4IPIPTunnelAddr:100.122.71.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-03-26 17:34:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:34:02 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-03-26 17:34:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-03-26 17:34:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-03-26 17:34:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.10.0/24\"":{}}}} } {calico-node Update v1 2023-03-26 17:34:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2023-03-26 17:41:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.10.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3b/i-0c64386131d9d94c5,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.10.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-26 17:34:21 +0000 UTC,LastTransitionTime:2023-03-26 17:34:21 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-26 17:41:02 +0000 UTC,LastTransitionTime:2023-03-26 17:34:02 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-26 17:41:02 +0000 UTC,LastTransitionTime:2023-03-26 17:34:02 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-26 17:41:02 +0000 UTC,LastTransitionTime:2023-03-26 17:34:02 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-26 17:41:02 +0000 UTC,LastTransitionTime:2023-03-26 17:34:14 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.63.240,},NodeAddress{Type:ExternalIP,Address:15.236.210.84,},NodeAddress{Type:InternalDNS,Address:i-0c64386131d9d94c5.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-0c64386131d9d94c5.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-236-210-84.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2c2c56ef9295a859b1f844cff158e8,SystemUUID:ec2c2c56-ef92-95a8-59b1-f844cff158e8,BootID:825bc25d-7144-4ec9-8dfb-f77f9cde8c31,KernelVersion:5.15.0-1031-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0,KubeProxyVersion:v1.28.0-alpha.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/kube-proxy@sha256:8a03b3147cd7be8e8235ae1cd70cf69aca9ce03ba1cfaffea320540bb5afa496 registry.k8s.io/kube-proxy:v1.28.0-alpha.0],SizeBytes:23896850,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 26 17:41:06.638: INFO: Logging kubelet events for node i-0c64386131d9d94c5 Mar 26 17:41:06.754: INFO: Logging pods the kubelet thinks is on node i-0c64386131d9d94c5 Mar 26 17:41:06.865: INFO: calico-node-jl5lk started at 2023-03-26 17:34:03 +0000 UTC (3+1 container statuses recorded) Mar 26 17:41:06.865: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 26 17:41:06.865: INFO: Init container install-cni ready: true, restart count 0 Mar 26 17:41:06.865: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 26 17:41:06.865: INFO: Container calico-node ready: true, restart count 0 Mar 26 17:41:06.865: INFO: ebs-csi-node-rhk2b started at 2023-03-26 17:34:03 +0000 UTC (0+3 container statuses recorded) Mar 26 17:41:06.865: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:41:06.865: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:41:06.865: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:41:06.865: INFO: csi-mockplugin-0 started at 2023-03-26 17:40:13 +0000 UTC (0+4 container statuses recorded) Mar 26 17:41:06.865: INFO: Container busybox ready: true, restart count 0 Mar 26 17:41:06.865: INFO: Container csi-provisioner ready: true, restart count 0 Mar 26 17:41:06.865: INFO: Container driver-registrar ready: true, restart count 0 Mar 26 17:41:06.865: INFO: Container mock ready: true, restart count 0 Mar 26 17:41:06.865: INFO: csi-mockplugin-attacher-0 started at 2023-03-26 17:40:13 +0000 UTC (0+1 container statuses recorded) Mar 26 17:41:06.865: INFO: Container csi-attacher ready: true, restart count 0 Mar 26 17:41:06.865: INFO: csi-mockplugin-0 started at 2023-03-26 17:40:44 +0000 UTC (0+3 container statuses recorded) Mar 26 17:41:06.865: INFO: Container csi-provisioner ready: true, restart count 0 Mar 26 17:41:06.865: INFO: Container driver-registrar ready: true, restart count 0 Mar 26 17:41:06.865: INFO: Container mock ready: true, restart count 0 Mar 26 17:41:06.865: INFO: coredns-autoscaler-7cb5c5b969-xmt8r started at 2023-03-26 17:34:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:41:06.865: INFO: Container autoscaler ready: true, restart count 0 Mar 26 17:41:06.865: INFO: csi-mockplugin-resizer-0 started at 2023-03-26 17:40:13 +0000 UTC (0+1 container statuses recorded) Mar 26 17:41:06.865: INFO: Container csi-resizer ready: true, restart count 0 Mar 26 17:41:06.865: INFO: suspend-false-to-true-th57r started at 2023-03-26 17:40:43 +0000 UTC (0+1 container statuses recorded) Mar 26 17:41:06.865: INFO: Container c ready: true, restart count 0 Mar 26 17:41:06.865: INFO: netserver-2 started at 2023-03-26 17:40:31 +0000 UTC (0+1 container statuses recorded) Mar 26 17:41:06.865: INFO: Container webserver ready: true, restart count 0 Mar 26 17:41:06.865: INFO: kube-proxy-i-0c64386131d9d94c5 started at 2023-03-26 17:34:03 +0000 UTC (0+1 container statuses recorded) Mar 26 17:41:06.865: INFO: Container kube-proxy ready: true, restart count 0 Mar 26 17:41:06.865: INFO: csi-mockplugin-attacher-0 started at 2023-03-26 17:40:44 +0000 UTC (0+1 container statuses recorded) Mar 26 17:41:06.865: INFO: Container csi-attacher ready: true, restart count 0 Mar 26 17:41:06.865: INFO: concurrent-27997540-n8hqn started at 2023-03-26 17:40:00 +0000 UTC (0+1 container statuses recorded) Mar 26 17:41:06.865: INFO: Container c ready: true, restart count 0 Mar 26 17:41:07.249: INFO: Latency metrics for node i-0c64386131d9d94c5 Mar 26 17:41:07.249: INFO: Logging node info for node i-0ef04f0ca28b74fa4 Mar 26 17:41:07.353: INFO: Node Info: &Node{ObjectMeta:{i-0ef04f0ca28b74fa4 1429588e-1f3b-4a1a-98e2-600879dad0f2 19862 0 2023-03-26 17:21:49 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3b kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0ef04f0ca28b74fa4 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3b topology.hostpath.csi/node:i-0ef04f0ca28b74fa4 topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3b] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-expansion-8401":"i-0ef04f0ca28b74fa4","ebs.csi.aws.com":"i-0ef04f0ca28b74fa4"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.42.152/19 projectcalico.org/IPv4IPIPTunnelAddr:100.104.100.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-26 17:21:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:21:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:21:50 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-03-26 17:21:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-03-26 17:22:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.7.0/24\"":{}}}} } {calico-node Update v1 2023-03-26 17:22:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-03-26 17:41:00 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-03-26 17:41:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.7.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3b/i-0ef04f0ca28b74fa4,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.7.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-26 17:22:08 +0000 UTC,LastTransitionTime:2023-03-26 17:22:08 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-26 17:41:00 +0000 UTC,LastTransitionTime:2023-03-26 17:21:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-26 17:41:00 +0000 UTC,LastTransitionTime:2023-03-26 17:21:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-26 17:41:00 +0000 UTC,LastTransitionTime:2023-03-26 17:21:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-26 17:41:00 +0000 UTC,LastTransitionTime:2023-03-26 17:22:00 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.152,},NodeAddress{Type:ExternalIP,Address:35.180.133.237,},NodeAddress{Type:InternalDNS,Address:i-0ef04f0ca28b74fa4.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-0ef04f0ca28b74fa4.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-180-133-237.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2cd6131a8983e20721f6c173936bc3,SystemUUID:ec2cd613-1a89-83e2-0721-f6c173936bc3,BootID:34695e7c-23d6-4648-b207-41bcd12c2edf,KernelVersion:5.15.0-1031-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0,KubeProxyVersion:v1.28.0-alpha.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/kube-proxy@sha256:8a03b3147cd7be8e8235ae1cd70cf69aca9ce03ba1cfaffea320540bb5afa496 registry.k8s.io/kube-proxy:v1.28.0-alpha.0],SizeBytes:23896850,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-expansion-8401^4c09f371-cbfd-11ed-b2c8-2e4a4af65608 kubernetes.io/csi/ebs.csi.aws.com^vol-0a2cb66da2086ef40],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0a2cb66da2086ef40,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-expansion-8401^4c09f371-cbfd-11ed-b2c8-2e4a4af65608,DevicePath:,},},Config:nil,},} Mar 26 17:41:07.353: INFO: Logging kubelet events for node i-0ef04f0ca28b74fa4 Mar 26 17:41:07.466: INFO: Logging pods the kubelet thinks is on node i-0ef04f0ca28b74fa4 Mar 26 17:41:07.577: INFO: pvc-volume-tester-xhwpd started at 2023-03-26 17:40:28 +0000 UTC (0+1 container statuses recorded) Mar 26 17:41:07.577: INFO: Container volume-tester ready: true, restart count 0 Mar 26 17:41:07.577: INFO: inline-volume-tester-459f8 started at 2023-03-26 17:40:34 +0000 UTC (0+1 container statuses recorded) Mar 26 17:41:07.577: INFO: Container csi-volume-tester ready: true, restart count 0 Mar 26 17:41:07.577: INFO: forbid-27997541-fmlhl started at 2023-03-26 17:41:00 +0000 UTC (0+1 container statuses recorded) Mar 26 17:41:07.577: INFO: Container c ready: true, restart count 0 Mar 26 17:41:07.577: INFO: test-container-pod started at 2023-03-26 17:40:53 +0000 UTC (0+1 container statuses recorded) Mar 26 17:41:07.577: INFO: Container webserver ready: true, restart count 0 Mar 26 17:41:07.577: INFO: test-webserver-59287bf1-a2e9-42a2-9401-749b295f96f2 started at 2023-03-26 17:40:56 +0000 UTC (0+1 container statuses recorded) Mar 26 17:41:07.577: INFO: Container test-webserver ready: false, restart count 0 Mar 26 17:41:07.577: INFO: kube-proxy-i-0ef04f0ca28b74fa4 started at 2023-03-26 17:21:50 +0000 UTC (0+1 container statuses recorded) Mar 26 17:41:07.577: INFO: Container kube-proxy ready: true, restart count 0 Mar 26 17:41:07.577: INFO: csi-mockplugin-resizer-0 started at 2023-03-26 17:40:22 +0000 UTC (0+1 container statuses recorded) Mar 26 17:41:07.577: INFO: Container csi-resizer ready: true, restart count 0 Mar 26 17:41:07.577: INFO: externalname-service-tjws9 started at 2023-03-26 17:40:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:41:07.577: INFO: Container externalname-service ready: true, restart count 0 Mar 26 17:41:07.577: INFO: netserver-3 started at 2023-03-26 17:40:31 +0000 UTC (0+1 container statuses recorded) Mar 26 17:41:07.577: INFO: Container webserver ready: true, restart count 0 Mar 26 17:41:07.577: INFO: csi-mockplugin-attacher-0 started at 2023-03-26 17:40:22 +0000 UTC (0+1 container statuses recorded) Mar 26 17:41:07.577: INFO: Container csi-attacher ready: true, restart count 0 Mar 26 17:41:07.577: INFO: calico-node-bdwdr started at 2023-03-26 17:21:50 +0000 UTC (3+1 container statuses recorded) Mar 26 17:41:07.577: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 26 17:41:07.577: INFO: Init container install-cni ready: true, restart count 0 Mar 26 17:41:07.577: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 26 17:41:07.577: INFO: Container calico-node ready: true, restart count 0 Mar 26 17:41:07.577: INFO: ebs-csi-node-6wp7p started at 2023-03-26 17:21:50 +0000 UTC (0+3 container statuses recorded) Mar 26 17:41:07.577: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:41:07.577: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:41:07.577: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:41:07.577: INFO: coredns-559769c974-6mjw2 started at 2023-03-26 17:22:53 +0000 UTC (0+1 container statuses recorded) Mar 26 17:41:07.577: INFO: Container coredns ready: true, restart count 0 Mar 26 17:41:07.577: INFO: hostexec-i-0ef04f0ca28b74fa4-nd8gt started at 2023-03-26 17:41:06 +0000 UTC (0+1 container statuses recorded) Mar 26 17:41:07.577: INFO: Container agnhost-container ready: false, restart count 0 Mar 26 17:41:07.577: INFO: csi-mockplugin-0 started at 2023-03-26 17:40:22 +0000 UTC (0+3 container statuses recorded) Mar 26 17:41:07.577: INFO: Container csi-provisioner ready: true, restart count 0 Mar 26 17:41:07.577: INFO: Container driver-registrar ready: true, restart count 0 Mar 26 17:41:07.577: INFO: Container mock ready: true, restart count 0 Mar 26 17:41:07.577: INFO: pod-exec-websocket-9e6a1f84-1b8a-4914-a8ea-ed3811745a75 started at 2023-03-26 17:41:03 +0000 UTC (0+1 container statuses recorded) Mar 26 17:41:07.577: INFO: Container main ready: true, restart count 0 Mar 26 17:41:07.979: INFO: Latency metrics for node i-0ef04f0ca28b74fa4 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/26/23 17:41:07.979 (4.046s) < Exit [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - dump namespaces | framework.go:209 @ 03/26/23 17:41:07.979 (4.046s) > Enter [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - tear down framework | framework.go:206 @ 03/26/23 17:41:07.979 STEP: Destroying namespace "provisioning-7834" for this suite. - test/e2e/framework/framework.go:351 @ 03/26/23 17:41:07.979 < Exit [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - tear down framework | framework.go:206 @ 03/26/23 17:41:08.088 (109ms) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/26/23 17:41:08.089 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/26/23 17:41:08.089 (0s)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\sExternal\sStorage\s\[Driver\:\sebs\.csi\.aws\.com\]\s\[Testpattern\:\sDynamic\sPV\s\(default\sfs\)\]\ssubPath\sshould\ssupport\sreadOnly\sfile\sspecified\sin\sthe\svolumeMount\s\[LinuxOnly\]$'
[FAILED] failed to get logs from pod-subpath-test-dynamicpv-lnx7 for test-container-subpath-dynamicpv-lnx7: Get "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/provisioning-6504/pods/pod-subpath-test-dynamicpv-lnx7/log?container=test-container-subpath-dynamicpv-lnx7&previous=false": stream error: stream ID 2017; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/26/23 17:46:17.444from junit_01.xml
> Enter [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/storage/framework/testsuite.go:51 @ 03/26/23 17:46:00.869 < Exit [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/storage/framework/testsuite.go:51 @ 03/26/23 17:46:00.869 (0s) > Enter [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath - set up framework | framework.go:191 @ 03/26/23 17:46:00.869 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/26/23 17:46:00.869 Mar 26 17:46:00.869: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename provisioning - test/e2e/framework/framework.go:250 @ 03/26/23 17:46:00.87 STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 03/26/23 17:46:01.207 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:262 @ 03/26/23 17:46:01.416 < Exit [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath - set up framework | framework.go:191 @ 03/26/23 17:46:01.637 (768ms) > Enter [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/framework/metrics/init/init.go:33 @ 03/26/23 17:46:01.637 < Exit [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/framework/metrics/init/init.go:33 @ 03/26/23 17:46:01.637 (0s) > Enter [It] should support readOnly file specified in the volumeMount [LinuxOnly] - test/e2e/storage/testsuites/subpath.go:382 @ 03/26/23 17:46:01.637 Mar 26 17:46:01.637: INFO: Creating resource for dynamic PV Mar 26 17:46:01.637: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} STEP: creating a StorageClass provisioning-6504-e2e-scd4sr8 - test/e2e/storage/framework/volume_resource.go:102 @ 03/26/23 17:46:01.638 STEP: creating a claim - test/e2e/storage/framework/volume_resource.go:294 @ 03/26/23 17:46:01.76 Mar 26 17:46:01.760: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil STEP: Creating pod pod-subpath-test-dynamicpv-lnx7 - test/e2e/storage/testsuites/subpath.go:691 @ 03/26/23 17:46:01.992 STEP: Creating a pod to test subpath - test/e2e/framework/pod/output/output.go:243 @ 03/26/23 17:46:01.992 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/26/23 17:46:16.99 Mar 26 17:46:17.097: INFO: Trying to get logs from node i-0b2c24f535e511ae5 pod pod-subpath-test-dynamicpv-lnx7 container test-container-subpath-dynamicpv-lnx7: <nil> Mar 26 17:46:17.209: INFO: Failed to get logs from node "i-0b2c24f535e511ae5" pod "pod-subpath-test-dynamicpv-lnx7" container "test-container-subpath-dynamicpv-lnx7". Get "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/provisioning-6504/pods/pod-subpath-test-dynamicpv-lnx7/log?container=test-container-subpath-dynamicpv-lnx7&previous=false": stream error: stream ID 2017; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/26/23 17:46:17.209 Mar 26 17:46:17.443: INFO: Unexpected error: <*fmt.wrapError | 0xc003a21900>: failed to get logs from pod-subpath-test-dynamicpv-lnx7 for test-container-subpath-dynamicpv-lnx7: Get "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/provisioning-6504/pods/pod-subpath-test-dynamicpv-lnx7/log?container=test-container-subpath-dynamicpv-lnx7&previous=false": stream error: stream ID 2017; INTERNAL_ERROR; received from peer { msg: "failed to get logs from pod-subpath-test-dynamicpv-lnx7 for test-container-subpath-dynamicpv-lnx7: Get \"https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/provisioning-6504/pods/pod-subpath-test-dynamicpv-lnx7/log?container=test-container-subpath-dynamicpv-lnx7&previous=false\": stream error: stream ID 2017; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc002ca6ff0>{ Op: "Get", URL: "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/provisioning-6504/pods/pod-subpath-test-dynamicpv-lnx7/log?container=test-container-subpath-dynamicpv-lnx7&previous=false", Err: <http2.StreamError>{ StreamID: 2017, Code: 2, Cause: <*errors.errorString | 0xc0001e76c0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from pod-subpath-test-dynamicpv-lnx7 for test-container-subpath-dynamicpv-lnx7: Get "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/provisioning-6504/pods/pod-subpath-test-dynamicpv-lnx7/log?container=test-container-subpath-dynamicpv-lnx7&previous=false": stream error: stream ID 2017; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/26/23 17:46:17.444 < Exit [It] should support readOnly file specified in the volumeMount [LinuxOnly] - test/e2e/storage/testsuites/subpath.go:382 @ 03/26/23 17:46:17.444 (15.807s) > Enter [AfterEach] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/framework/node/init/init.go:33 @ 03/26/23 17:46:17.444 Mar 26 17:46:17.444: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/framework/node/init/init.go:33 @ 03/26/23 17:46:17.55 (106ms) > Enter [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/storage/testsuites/subpath.go:384 @ 03/26/23 17:46:17.55 STEP: Deleting pod - test/e2e/storage/testsuites/subpath.go:172 @ 03/26/23 17:46:17.55 Mar 26 17:46:17.550: INFO: Deleting pod "pod-subpath-test-dynamicpv-lnx7" in namespace "provisioning-6504" STEP: Deleting pvc - test/e2e/storage/framework/volume_resource.go:181 @ 03/26/23 17:46:17.655 Mar 26 17:46:17.866: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.comzh84k" Mar 26 17:46:17.976: INFO: Waiting up to 5m0s for PersistentVolume pvc-53bd44de-7164-4be3-8a59-13066b5c270a to get deleted Mar 26 17:46:18.081: INFO: PersistentVolume pvc-53bd44de-7164-4be3-8a59-13066b5c270a found and phase=Released (104.561547ms) Mar 26 17:46:23.186: INFO: PersistentVolume pvc-53bd44de-7164-4be3-8a59-13066b5c270a found and phase=Released (5.209930759s) Mar 26 17:46:28.292: INFO: PersistentVolume pvc-53bd44de-7164-4be3-8a59-13066b5c270a found and phase=Released (10.315526219s) Mar 26 17:46:33.405: INFO: PersistentVolume pvc-53bd44de-7164-4be3-8a59-13066b5c270a found and phase=Released (15.428339157s) Mar 26 17:46:38.510: INFO: PersistentVolume pvc-53bd44de-7164-4be3-8a59-13066b5c270a was removed STEP: Deleting sc - test/e2e/storage/framework/volume_resource.go:228 @ 03/26/23 17:46:38.51 < Exit [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/storage/testsuites/subpath.go:384 @ 03/26/23 17:46:38.633 (21.083s) > Enter [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/framework/metrics/init/init.go:35 @ 03/26/23 17:46:38.633 < Exit [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - test/e2e/framework/metrics/init/init.go:35 @ 03/26/23 17:46:38.633 (0s) > Enter [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - dump namespaces | framework.go:209 @ 03/26/23 17:46:38.633 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/26/23 17:46:38.633 STEP: Collecting events from namespace "provisioning-6504". - test/e2e/framework/debug/dump.go:42 @ 03/26/23 17:46:38.633 STEP: Found 15 events. - test/e2e/framework/debug/dump.go:46 @ 03/26/23 17:46:38.738 Mar 26 17:46:38.738: INFO: At 2023-03-26 17:46:01 +0000 UTC - event for ebs.csi.aws.comzh84k: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding Mar 26 17:46:38.738: INFO: At 2023-03-26 17:46:02 +0000 UTC - event for ebs.csi.aws.comzh84k: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "ebs.csi.aws.com" or manually created by system administrator Mar 26 17:46:38.738: INFO: At 2023-03-26 17:46:02 +0000 UTC - event for ebs.csi.aws.comzh84k: {ebs.csi.aws.com_i-07cdb76b0ac2dbfa1_cb4b68af-2d91-4bfb-9626-7c22a975e7d6 } Provisioning: External provisioner is provisioning volume for claim "provisioning-6504/ebs.csi.aws.comzh84k" Mar 26 17:46:38.738: INFO: At 2023-03-26 17:46:05 +0000 UTC - event for ebs.csi.aws.comzh84k: {ebs.csi.aws.com_i-07cdb76b0ac2dbfa1_cb4b68af-2d91-4bfb-9626-7c22a975e7d6 } ProvisioningSucceeded: Successfully provisioned volume pvc-53bd44de-7164-4be3-8a59-13066b5c270a Mar 26 17:46:38.738: INFO: At 2023-03-26 17:46:06 +0000 UTC - event for pod-subpath-test-dynamicpv-lnx7: {default-scheduler } Scheduled: Successfully assigned provisioning-6504/pod-subpath-test-dynamicpv-lnx7 to i-0b2c24f535e511ae5 Mar 26 17:46:38.738: INFO: At 2023-03-26 17:46:09 +0000 UTC - event for pod-subpath-test-dynamicpv-lnx7: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-53bd44de-7164-4be3-8a59-13066b5c270a" Mar 26 17:46:38.738: INFO: At 2023-03-26 17:46:10 +0000 UTC - event for pod-subpath-test-dynamicpv-lnx7: {kubelet i-0b2c24f535e511ae5} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 26 17:46:38.738: INFO: At 2023-03-26 17:46:10 +0000 UTC - event for pod-subpath-test-dynamicpv-lnx7: {kubelet i-0b2c24f535e511ae5} Created: Created container init-volume-dynamicpv-lnx7 Mar 26 17:46:38.738: INFO: At 2023-03-26 17:46:11 +0000 UTC - event for pod-subpath-test-dynamicpv-lnx7: {kubelet i-0b2c24f535e511ae5} Started: Started container init-volume-dynamicpv-lnx7 Mar 26 17:46:38.738: INFO: At 2023-03-26 17:46:12 +0000 UTC - event for pod-subpath-test-dynamicpv-lnx7: {kubelet i-0b2c24f535e511ae5} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 26 17:46:38.738: INFO: At 2023-03-26 17:46:13 +0000 UTC - event for pod-subpath-test-dynamicpv-lnx7: {kubelet i-0b2c24f535e511ae5} Created: Created container test-init-volume-dynamicpv-lnx7 Mar 26 17:46:38.738: INFO: At 2023-03-26 17:46:13 +0000 UTC - event for pod-subpath-test-dynamicpv-lnx7: {kubelet i-0b2c24f535e511ae5} Started: Started container test-init-volume-dynamicpv-lnx7 Mar 26 17:46:38.738: INFO: At 2023-03-26 17:46:13 +0000 UTC - event for pod-subpath-test-dynamicpv-lnx7: {kubelet i-0b2c24f535e511ae5} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 26 17:46:38.738: INFO: At 2023-03-26 17:46:13 +0000 UTC - event for pod-subpath-test-dynamicpv-lnx7: {kubelet i-0b2c24f535e511ae5} Created: Created container test-container-subpath-dynamicpv-lnx7 Mar 26 17:46:38.738: INFO: At 2023-03-26 17:46:13 +0000 UTC - event for pod-subpath-test-dynamicpv-lnx7: {kubelet i-0b2c24f535e511ae5} Started: Started container test-container-subpath-dynamicpv-lnx7 Mar 26 17:46:38.844: INFO: POD NODE PHASE GRACE CONDITIONS Mar 26 17:46:38.844: INFO: Mar 26 17:46:38.950: INFO: Logging node info for node i-011576d1f2b6be6ec Mar 26 17:46:39.055: INFO: Node Info: &Node{ObjectMeta:{i-011576d1f2b6be6ec ef4bb85b-7188-4ef2-8d1a-583f0fcc379a 36508 0 2023-03-26 17:26:11 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3b kubernetes.io/arch:amd64 kubernetes.io/hostname:i-011576d1f2b6be6ec kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3b topology.hostpath.csi/node:i-011576d1f2b6be6ec topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-7102":"i-011576d1f2b6be6ec","csi-hostpath-provisioning-5360":"i-011576d1f2b6be6ec","ebs.csi.aws.com":"i-011576d1f2b6be6ec"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.41.235/19 projectcalico.org/IPv4IPIPTunnelAddr:100.127.173.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-03-26 17:26:11 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:26:11 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-03-26 17:26:11 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-03-26 17:26:12 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-03-26 17:26:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.8.0/24\"":{}}}} } {calico-node Update v1 2023-03-26 17:26:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-03-26 17:46:12 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-03-26 17:46:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.8.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3b/i-011576d1f2b6be6ec,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.8.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-26 17:26:30 +0000 UTC,LastTransitionTime:2023-03-26 17:26:30 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-26 17:46:17 +0000 UTC,LastTransitionTime:2023-03-26 17:26:11 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-26 17:46:17 +0000 UTC,LastTransitionTime:2023-03-26 17:26:11 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-26 17:46:17 +0000 UTC,LastTransitionTime:2023-03-26 17:26:11 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-26 17:46:17 +0000 UTC,LastTransitionTime:2023-03-26 17:26:23 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.41.235,},NodeAddress{Type:ExternalIP,Address:35.180.45.101,},NodeAddress{Type:InternalDNS,Address:i-011576d1f2b6be6ec.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-011576d1f2b6be6ec.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-180-45-101.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec26cc6e198da1950569e38fb3a7f618,SystemUUID:ec26cc6e-198d-a195-0569-e38fb3a7f618,BootID:b67057d3-2187-4008-9056-8a843d3c6813,KernelVersion:5.15.0-1031-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0,KubeProxyVersion:v1.28.0-alpha.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/kube-proxy@sha256:8a03b3147cd7be8e8235ae1cd70cf69aca9ce03ba1cfaffea320540bb5afa496 registry.k8s.io/kube-proxy:v1.28.0-alpha.0],SizeBytes:23896850,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-5360^18578a51-cbfe-11ed-b5ee-66b73dce23cc],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-5360^18578a51-cbfe-11ed-b5ee-66b73dce23cc,DevicePath:,},},Config:nil,},} Mar 26 17:46:39.056: INFO: Logging kubelet events for node i-011576d1f2b6be6ec Mar 26 17:46:39.169: INFO: Logging pods the kubelet thinks is on node i-011576d1f2b6be6ec Mar 26 17:46:39.290: INFO: csi-hostpathplugin-0 started at 2023-03-26 17:45:57 +0000 UTC (0+7 container statuses recorded) Mar 26 17:46:39.290: INFO: Container csi-attacher ready: true, restart count 0 Mar 26 17:46:39.290: INFO: Container csi-provisioner ready: true, restart count 0 Mar 26 17:46:39.290: INFO: Container csi-resizer ready: true, restart count 0 Mar 26 17:46:39.290: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 26 17:46:39.290: INFO: Container hostpath ready: true, restart count 0 Mar 26 17:46:39.290: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:46:39.290: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:46:39.290: INFO: hostexec-i-011576d1f2b6be6ec-48h5c started at 2023-03-26 17:46:28 +0000 UTC (0+1 container statuses recorded) Mar 26 17:46:39.290: INFO: Container agnhost-container ready: true, restart count 0 Mar 26 17:46:39.290: INFO: ebs-csi-node-7dqmm started at 2023-03-26 17:26:12 +0000 UTC (0+3 container statuses recorded) Mar 26 17:46:39.290: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:46:39.290: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:46:39.290: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:46:39.290: INFO: coredns-559769c974-58thj started at 2023-03-26 17:34:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:46:39.290: INFO: Container coredns ready: true, restart count 0 Mar 26 17:46:39.290: INFO: csi-hostpathplugin-0 started at 2023-03-26 17:46:08 +0000 UTC (0+7 container statuses recorded) Mar 26 17:46:39.290: INFO: Container csi-attacher ready: true, restart count 0 Mar 26 17:46:39.290: INFO: Container csi-provisioner ready: true, restart count 0 Mar 26 17:46:39.290: INFO: Container csi-resizer ready: true, restart count 0 Mar 26 17:46:39.290: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 26 17:46:39.290: INFO: Container hostpath ready: true, restart count 0 Mar 26 17:46:39.290: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:46:39.290: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:46:39.290: INFO: pod-8e27321a-5877-4a55-93fb-fbd1bc83370a started at 2023-03-26 17:46:11 +0000 UTC (0+1 container statuses recorded) Mar 26 17:46:39.290: INFO: Container write-pod ready: true, restart count 0 Mar 26 17:46:39.290: INFO: pod-handle-http-request started at 2023-03-26 17:46:37 +0000 UTC (0+2 container statuses recorded) Mar 26 17:46:39.290: INFO: Container container-handle-http-request ready: false, restart count 0 Mar 26 17:46:39.290: INFO: Container container-handle-https-request ready: false, restart count 0 Mar 26 17:46:39.290: INFO: kube-proxy-i-011576d1f2b6be6ec started at 2023-03-26 17:26:12 +0000 UTC (0+1 container statuses recorded) Mar 26 17:46:39.290: INFO: Container kube-proxy ready: true, restart count 0 Mar 26 17:46:39.290: INFO: calico-node-tmjhr started at 2023-03-26 17:26:12 +0000 UTC (3+1 container statuses recorded) Mar 26 17:46:39.290: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 26 17:46:39.290: INFO: Init container install-cni ready: true, restart count 0 Mar 26 17:46:39.290: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 26 17:46:39.290: INFO: Container calico-node ready: true, restart count 0 Mar 26 17:46:39.290: INFO: pod-e15a9def-eab3-4958-955c-d25e779ace7f started at 2023-03-26 17:46:36 +0000 UTC (0+1 container statuses recorded) Mar 26 17:46:39.290: INFO: Container write-pod ready: true, restart count 0 Mar 26 17:46:39.290: INFO: pod-should-be-evicted30ff63e7-43c4-4fd6-b4b7-a1f2c5921901 started at 2023-03-26 17:46:06 +0000 UTC (0+1 container statuses recorded) Mar 26 17:46:39.290: INFO: Container bar ready: true, restart count 0 Mar 26 17:46:39.290: INFO: pod-1 started at 2023-03-26 17:45:49 +0000 UTC (0+1 container statuses recorded) Mar 26 17:46:39.290: INFO: Container donothing ready: true, restart count 0 Mar 26 17:46:39.765: INFO: Latency metrics for node i-011576d1f2b6be6ec Mar 26 17:46:39.765: INFO: Logging node info for node i-07cdb76b0ac2dbfa1 Mar 26 17:46:39.870: INFO: Node Info: &Node{ObjectMeta:{i-07cdb76b0ac2dbfa1 d3bcec50-934c-432e-a590-2a35577f3a0d 35692 0 2023-03-26 17:17:19 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3b kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-07cdb76b0ac2dbfa1 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:eu-west-3b topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3b] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-07cdb76b0ac2dbfa1"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.63.230/19 projectcalico.org/IPv4IPIPTunnelAddr:100.127.118.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-26 17:17:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-03-26 17:17:20 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {calico-node Update v1 2023-03-26 17:18:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {aws-cloud-controller-manager Update v1 2023-03-26 17:18:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:18:48 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-03-26 17:18:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.5.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-03-26 17:46:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.5.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3b/i-07cdb76b0ac2dbfa1,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.5.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892301824 0} {<nil>} 3801076Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787444224 0} {<nil>} 3698676Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-26 17:18:46 +0000 UTC,LastTransitionTime:2023-03-26 17:18:46 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-26 17:46:03 +0000 UTC,LastTransitionTime:2023-03-26 17:17:19 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-26 17:46:03 +0000 UTC,LastTransitionTime:2023-03-26 17:17:19 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-26 17:46:03 +0000 UTC,LastTransitionTime:2023-03-26 17:17:19 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-26 17:46:03 +0000 UTC,LastTransitionTime:2023-03-26 17:18:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.63.230,},NodeAddress{Type:ExternalIP,Address:15.237.44.201,},NodeAddress{Type:InternalDNS,Address:i-07cdb76b0ac2dbfa1.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-07cdb76b0ac2dbfa1.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-237-44-201.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2824f976de88ff768c75c0d62c774f,SystemUUID:ec2824f9-76de-88ff-768c-75c0d62c774f,BootID:bc1e3e86-fc91-4be5-acba-90ac2a46faf2,KernelVersion:5.15.0-1031-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0,KubeProxyVersion:v1.28.0-alpha.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 registry.k8s.io/etcd:3.4.3-0],SizeBytes:100947667,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:9ce33ba33d8e738a5b85ed50b5080ac746deceed4a7496c550927a7a19ca3b6d registry.k8s.io/etcd:3.5.0-0],SizeBytes:99868722,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 registry.k8s.io/etcd:3.5.1-0],SizeBytes:98888614,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 registry.k8s.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:0d2ab6b15b4fe0b903b9e81192d942fb39c29be61fe341cd16db5d0165b0435c registry.k8s.io/etcd:3.3.17-0],SizeBytes:85524408,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:17da501f5d2a675be46040422a27b7cc21b8a43895ac998b171db1c346f361f7 registry.k8s.io/etcd:3.3.10-0],SizeBytes:76162358,},ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager-slim@sha256:8727adc059334e0e3329dbccce116a734da4a090da5e86c8cddccaf333caa666 registry.k8s.io/etcdadm/etcd-manager-slim:v3.0.20230201],SizeBytes:63926165,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:905d7ca17fd02bc24c0eba9a062753aba15db3e31422390bc3238eb762339b20 registry.k8s.io/etcd:3.2.24-1],SizeBytes:63423287,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:45208814,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:43629015,},ContainerImage{Names:[registry.k8s.io/kube-apiserver@sha256:49934a29c559e79ed19fc38b4697b18d8fe174b17bf56192588575f980c93956 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0],SizeBytes:33212506,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:2b6acd7f677f76ffe12ecf3ea7df92eb9b1bdb07336d1ac2a54c7631fb753f7e docker.io/calico/kube-controllers:v3.24.5],SizeBytes:31137169,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager@sha256:974748384634982c73527fdb3c9ec0ec476bc0d52b3dd1d611a380b7f99af1f3 registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0],SizeBytes:30820280,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/kube-proxy@sha256:8a03b3147cd7be8e8235ae1cd70cf69aca9ce03ba1cfaffea320540bb5afa496 registry.k8s.io/kube-proxy:v1.28.0-alpha.0],SizeBytes:23896850,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/kube-scheduler@sha256:cbf4007abb076188f16b975bc2b74452603cc7b34c60a29d92f14c38ad02dc11 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0],SizeBytes:18078674,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:5074723,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 26 17:46:39.871: INFO: Logging kubelet events for node i-07cdb76b0ac2dbfa1 Mar 26 17:46:40.003: INFO: Logging pods the kubelet thinks is on node i-07cdb76b0ac2dbfa1 Mar 26 17:46:40.131: INFO: dns-controller-69987775c6-ntctn started at 2023-03-26 17:17:49 +0000 UTC (0+1 container statuses recorded) Mar 26 17:46:40.131: INFO: Container dns-controller ready: true, restart count 0 Mar 26 17:46:40.131: INFO: aws-cloud-controller-manager-tbxvs started at 2023-03-26 17:18:29 +0000 UTC (0+1 container statuses recorded) Mar 26 17:46:40.131: INFO: Container aws-cloud-controller-manager ready: true, restart count 0 Mar 26 17:46:40.131: INFO: calico-node-5cszq started at 2023-03-26 17:18:29 +0000 UTC (3+1 container statuses recorded) Mar 26 17:46:40.131: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 26 17:46:40.131: INFO: Init container install-cni ready: true, restart count 0 Mar 26 17:46:40.131: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 26 17:46:40.131: INFO: Container calico-node ready: true, restart count 0 Mar 26 17:46:40.131: INFO: ebs-csi-controller-79f984545f-vq8bz started at 2023-03-26 17:19:49 +0000 UTC (0+5 container statuses recorded) Mar 26 17:46:40.131: INFO: Container csi-attacher ready: true, restart count 0 Mar 26 17:46:40.131: INFO: Container csi-provisioner ready: true, restart count 0 Mar 26 17:46:40.131: INFO: Container csi-resizer ready: true, restart count 0 Mar 26 17:46:40.131: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:46:40.131: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:46:40.131: INFO: etcd-manager-main-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (11+1 container statuses recorded) Mar 26 17:46:40.131: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0 Mar 26 17:46:40.131: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0 Mar 26 17:46:40.131: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0 Mar 26 17:46:40.131: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0 Mar 26 17:46:40.131: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0 Mar 26 17:46:40.131: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0 Mar 26 17:46:40.131: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0 Mar 26 17:46:40.131: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0 Mar 26 17:46:40.131: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0 Mar 26 17:46:40.131: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0 Mar 26 17:46:40.131: INFO: Init container init-etcd-3-5-7 ready: true, restart count 0 Mar 26 17:46:40.131: INFO: Container etcd-manager ready: true, restart count 0 Mar 26 17:46:40.131: INFO: kube-apiserver-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (0+2 container statuses recorded) Mar 26 17:46:40.131: INFO: Container healthcheck ready: true, restart count 0 Mar 26 17:46:40.131: INFO: Container kube-apiserver ready: true, restart count 2 Mar 26 17:46:40.131: INFO: ebs-csi-node-2r7mc started at 2023-03-26 17:18:29 +0000 UTC (0+3 container statuses recorded) Mar 26 17:46:40.131: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:46:40.131: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:46:40.131: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:46:40.131: INFO: kops-controller-thh8s started at 2023-03-26 17:18:29 +0000 UTC (0+1 container statuses recorded) Mar 26 17:46:40.131: INFO: Container kops-controller ready: true, restart count 0 Mar 26 17:46:40.131: INFO: kube-controller-manager-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:46:40.131: INFO: Container kube-controller-manager ready: true, restart count 4 Mar 26 17:46:40.131: INFO: kube-proxy-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:46:40.131: INFO: Container kube-proxy ready: true, restart count 0 Mar 26 17:46:40.131: INFO: kube-scheduler-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:46:40.131: INFO: Container kube-scheduler ready: true, restart count 0 Mar 26 17:46:40.131: INFO: etcd-manager-events-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (11+1 container statuses recorded) Mar 26 17:46:40.131: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0 Mar 26 17:46:40.131: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0 Mar 26 17:46:40.131: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0 Mar 26 17:46:40.131: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0 Mar 26 17:46:40.131: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0 Mar 26 17:46:40.131: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0 Mar 26 17:46:40.131: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0 Mar 26 17:46:40.131: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0 Mar 26 17:46:40.131: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0 Mar 26 17:46:40.131: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0 Mar 26 17:46:40.131: INFO: Init container init-etcd-3-5-7 ready: true, restart count 0 Mar 26 17:46:40.131: INFO: Container etcd-manager ready: true, restart count 0 Mar 26 17:46:40.131: INFO: calico-kube-controllers-55f488656-mjjr8 started at 2023-03-26 17:18:51 +0000 UTC (0+1 container statuses recorded) Mar 26 17:46:40.131: INFO: Container calico-kube-controllers ready: true, restart count 0 Mar 26 17:46:40.622: INFO: Latency metrics for node i-07cdb76b0ac2dbfa1 Mar 26 17:46:40.622: INFO: Logging node info for node i-0b2c24f535e511ae5 Mar 26 17:46:40.727: INFO: Node Info: &Node{ObjectMeta:{i-0b2c24f535e511ae5 8f866583-6b9f-42fc-932a-c5558d02f775 37467 0 2023-03-26 17:30:16 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3b kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0b2c24f535e511ae5 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3b topology.hostpath.csi/node:i-0b2c24f535e511ae5 topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-2871":"i-0b2c24f535e511ae5","ebs.csi.aws.com":"i-0b2c24f535e511ae5"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.54.135/19 projectcalico.org/IPv4IPIPTunnelAddr:100.113.179.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-03-26 17:30:16 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:30:16 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-03-26 17:30:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-03-26 17:30:17 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-03-26 17:30:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.9.0/24\"":{}}}} } {calico-node Update v1 2023-03-26 17:30:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2023-03-26 17:46:40 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.9.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3b/i-0b2c24f535e511ae5,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.9.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-26 17:30:43 +0000 UTC,LastTransitionTime:2023-03-26 17:30:43 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-26 17:46:18 +0000 UTC,LastTransitionTime:2023-03-26 17:30:16 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-26 17:46:18 +0000 UTC,LastTransitionTime:2023-03-26 17:30:16 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-26 17:46:18 +0000 UTC,LastTransitionTime:2023-03-26 17:30:16 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-26 17:46:18 +0000 UTC,LastTransitionTime:2023-03-26 17:30:34 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.54.135,},NodeAddress{Type:ExternalIP,Address:13.38.65.62,},NodeAddress{Type:InternalDNS,Address:i-0b2c24f535e511ae5.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-0b2c24f535e511ae5.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-38-65-62.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec256778270128bdfe9c2066f7fedcda,SystemUUID:ec256778-2701-28bd-fe9c-2066f7fedcda,BootID:542316ee-6bea-470f-85fc-51e338ca7e74,KernelVersion:5.15.0-1031-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0,KubeProxyVersion:v1.28.0-alpha.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/kube-proxy@sha256:8a03b3147cd7be8e8235ae1cd70cf69aca9ce03ba1cfaffea320540bb5afa496 registry.k8s.io/kube-proxy:v1.28.0-alpha.0],SizeBytes:23896850,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 26 17:46:40.727: INFO: Logging kubelet events for node i-0b2c24f535e511ae5 Mar 26 17:46:40.842: INFO: Logging pods the kubelet thinks is on node i-0b2c24f535e511ae5 Mar 26 17:46:40.956: INFO: csi-hostpathplugin-0 started at 2023-03-26 17:46:38 +0000 UTC (0+7 container statuses recorded) Mar 26 17:46:40.956: INFO: Container csi-attacher ready: false, restart count 0 Mar 26 17:46:40.956: INFO: Container csi-provisioner ready: false, restart count 0 Mar 26 17:46:40.957: INFO: Container csi-resizer ready: false, restart count 0 Mar 26 17:46:40.957: INFO: Container csi-snapshotter ready: false, restart count 0 Mar 26 17:46:40.957: INFO: Container hostpath ready: false, restart count 0 Mar 26 17:46:40.957: INFO: Container liveness-probe ready: false, restart count 0 Mar 26 17:46:40.957: INFO: Container node-driver-registrar ready: false, restart count 0 Mar 26 17:46:40.957: INFO: pod-0 started at 2023-03-26 17:45:48 +0000 UTC (0+1 container statuses recorded) Mar 26 17:46:40.957: INFO: Container donothing ready: true, restart count 0 Mar 26 17:46:40.957: INFO: inline-volume-tester-wptm7 started at 2023-03-26 17:46:40 +0000 UTC (0+1 container statuses recorded) Mar 26 17:46:40.957: INFO: Container csi-volume-tester ready: false, restart count 0 Mar 26 17:46:40.957: INFO: calico-node-rdfns started at 2023-03-26 17:30:17 +0000 UTC (3+1 container statuses recorded) Mar 26 17:46:40.957: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 26 17:46:40.957: INFO: Init container install-cni ready: true, restart count 0 Mar 26 17:46:40.957: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 26 17:46:40.957: INFO: Container calico-node ready: true, restart count 0 Mar 26 17:46:40.957: INFO: ebs-csi-node-x9jln started at 2023-03-26 17:30:17 +0000 UTC (0+3 container statuses recorded) Mar 26 17:46:40.957: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:46:40.957: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:46:40.957: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:46:40.957: INFO: webserver-pod started at 2023-03-26 17:42:00 +0000 UTC (0+1 container statuses recorded) Mar 26 17:46:40.957: INFO: Container agnhost ready: false, restart count 0 Mar 26 17:46:40.957: INFO: pod-handle-http-request started at 2023-03-26 17:46:28 +0000 UTC (0+2 container statuses recorded) Mar 26 17:46:40.957: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 26 17:46:40.957: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 26 17:46:40.957: INFO: verify-service-up-host-exec-pod started at 2023-03-26 17:46:36 +0000 UTC (0+1 container statuses recorded) Mar 26 17:46:40.957: INFO: Container agnhost-container ready: true, restart count 0 Mar 26 17:46:40.957: INFO: hostexec-i-0b2c24f535e511ae5-vpnll started at 2023-03-26 17:46:09 +0000 UTC (0+1 container statuses recorded) Mar 26 17:46:40.957: INFO: Container agnhost-container ready: true, restart count 0 Mar 26 17:46:40.957: INFO: busybox-4dfbcb11-6019-4ba3-959f-fa78739f3992 started at 2023-03-26 17:46:01 +0000 UTC (0+1 container statuses recorded) Mar 26 17:46:40.957: INFO: Container busybox ready: true, restart count 0 Mar 26 17:46:40.957: INFO: pod-0178f4d1-def9-46fd-9743-268564f1a9a6 started at 2023-03-26 17:46:38 +0000 UTC (0+1 container statuses recorded) Mar 26 17:46:40.957: INFO: Container test-container ready: false, restart count 0 Mar 26 17:46:40.957: INFO: pod-2 started at 2023-03-26 17:45:49 +0000 UTC (0+1 container statuses recorded) Mar 26 17:46:40.957: INFO: Container donothing ready: true, restart count 0 Mar 26 17:46:40.957: INFO: kube-proxy-i-0b2c24f535e511ae5 started at 2023-03-26 17:30:17 +0000 UTC (0+1 container statuses recorded) Mar 26 17:46:40.957: INFO: Container kube-proxy ready: true, restart count 0 Mar 26 17:46:40.957: INFO: concurrent-27997546-vfljf started at 2023-03-26 17:46:00 +0000 UTC (0+1 container statuses recorded) Mar 26 17:46:40.957: INFO: Container c ready: false, restart count 0 Mar 26 17:46:40.957: INFO: up-down-2-hnmhl started at 2023-03-26 17:46:33 +0000 UTC (0+1 container statuses recorded) Mar 26 17:46:40.957: INFO: Container up-down-2 ready: true, restart count 0 Mar 26 17:46:40.957: INFO: up-down-1-jzt5d started at 2023-03-26 17:46:29 +0000 UTC (0+1 container statuses recorded) Mar 26 17:46:40.957: INFO: Container up-down-1 ready: true, restart count 0 Mar 26 17:46:41.523: INFO: Latency metrics for node i-0b2c24f535e511ae5 Mar 26 17:46:41.523: INFO: Logging node info for node i-0c64386131d9d94c5 Mar 26 17:46:41.634: INFO: Node Info: &Node{ObjectMeta:{i-0c64386131d9d94c5 6c5a59f3-69fd-488b-b94e-23777e242a7e 37463 0 2023-03-26 17:34:02 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3b kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0c64386131d9d94c5 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3b topology.hostpath.csi/node:i-0c64386131d9d94c5 topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3b] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-workload-7119":"i-0c64386131d9d94c5","ebs.csi.aws.com":"i-0c64386131d9d94c5"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.63.240/19 projectcalico.org/IPv4IPIPTunnelAddr:100.122.71.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-03-26 17:34:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:34:02 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-03-26 17:34:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-03-26 17:34:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-03-26 17:34:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.10.0/24\"":{}}}} } {calico-node Update v1 2023-03-26 17:34:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-03-26 17:46:38 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-03-26 17:46:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.10.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3b/i-0c64386131d9d94c5,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.10.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-26 17:34:21 +0000 UTC,LastTransitionTime:2023-03-26 17:34:21 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-26 17:46:39 +0000 UTC,LastTransitionTime:2023-03-26 17:34:02 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-26 17:46:39 +0000 UTC,LastTransitionTime:2023-03-26 17:34:02 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-26 17:46:39 +0000 UTC,LastTransitionTime:2023-03-26 17:34:02 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-26 17:46:39 +0000 UTC,LastTransitionTime:2023-03-26 17:34:14 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.63.240,},NodeAddress{Type:ExternalIP,Address:15.236.210.84,},NodeAddress{Type:InternalDNS,Address:i-0c64386131d9d94c5.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-0c64386131d9d94c5.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-236-210-84.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2c2c56ef9295a859b1f844cff158e8,SystemUUID:ec2c2c56-ef92-95a8-59b1-f844cff158e8,BootID:825bc25d-7144-4ec9-8dfb-f77f9cde8c31,KernelVersion:5.15.0-1031-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0,KubeProxyVersion:v1.28.0-alpha.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/kube-proxy@sha256:8a03b3147cd7be8e8235ae1cd70cf69aca9ce03ba1cfaffea320540bb5afa496 registry.k8s.io/kube-proxy:v1.28.0-alpha.0],SizeBytes:23896850,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0f125c0569b832ada],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0f125c0569b832ada,DevicePath:,},},Config:nil,},} Mar 26 17:46:41.634: INFO: Logging kubelet events for node i-0c64386131d9d94c5 Mar 26 17:46:41.765: INFO: Logging pods the kubelet thinks is on node i-0c64386131d9d94c5 Mar 26 17:46:41.897: INFO: sample-webhook-deployment-7497495989-fptdl started at 2023-03-26 17:46:37 +0000 UTC (0+1 container statuses recorded) Mar 26 17:46:41.897: INFO: Container sample-webhook ready: true, restart count 0 Mar 26 17:46:41.897: INFO: up-down-2-8hj4w started at 2023-03-26 17:46:33 +0000 UTC (0+1 container statuses recorded) Mar 26 17:46:41.897: INFO: Container up-down-2 ready: true, restart count 0 Mar 26 17:46:41.897: INFO: pod-39d1efe4-6c1e-4e11-af5f-278b89cc9936 started at 2023-03-26 17:46:30 +0000 UTC (0+1 container statuses recorded) Mar 26 17:46:41.897: INFO: Container write-pod ready: true, restart count 0 Mar 26 17:46:41.897: INFO: coredns-autoscaler-7cb5c5b969-xmt8r started at 2023-03-26 17:34:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:46:41.897: INFO: Container autoscaler ready: true, restart count 0 Mar 26 17:46:41.897: INFO: verify-service-up-exec-pod-v8sj7 started at 2023-03-26 17:46:38 +0000 UTC (0+1 container statuses recorded) Mar 26 17:46:41.897: INFO: Container agnhost-container ready: true, restart count 0 Mar 26 17:46:41.897: INFO: kube-proxy-i-0c64386131d9d94c5 started at 2023-03-26 17:34:03 +0000 UTC (0+1 container statuses recorded) Mar 26 17:46:41.897: INFO: Container kube-proxy ready: true, restart count 0 Mar 26 17:46:41.897: INFO: ebs-csi-node-rhk2b started at 2023-03-26 17:34:03 +0000 UTC (0+3 container statuses recorded) Mar 26 17:46:41.897: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:46:41.897: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:46:41.897: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:46:41.897: INFO: hostexec-i-0c64386131d9d94c5-d8ssd started at 2023-03-26 17:46:26 +0000 UTC (0+1 container statuses recorded) Mar 26 17:46:41.897: INFO: Container agnhost-container ready: true, restart count 0 Mar 26 17:46:41.897: INFO: csi-mockplugin-0 started at 2023-03-26 17:44:06 +0000 UTC (0+3 container statuses recorded) Mar 26 17:46:41.897: INFO: Container csi-provisioner ready: true, restart count 0 Mar 26 17:46:41.897: INFO: Container driver-registrar ready: true, restart count 0 Mar 26 17:46:41.897: INFO: Container mock ready: true, restart count 0 Mar 26 17:46:41.897: INFO: up-down-1-6njsn started at 2023-03-26 17:46:29 +0000 UTC (0+1 container statuses recorded) Mar 26 17:46:41.897: INFO: Container up-down-1 ready: true, restart count 0 Mar 26 17:46:41.897: INFO: pod-with-poststart-exec-hook started at 2023-03-26 17:46:31 +0000 UTC (0+1 container statuses recorded) Mar 26 17:46:41.897: INFO: Container pod-with-poststart-exec-hook ready: true, restart count 0 Mar 26 17:46:41.897: INFO: calico-node-jl5lk started at 2023-03-26 17:34:03 +0000 UTC (3+1 container statuses recorded) Mar 26 17:46:41.897: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 26 17:46:41.897: INFO: Init container install-cni ready: true, restart count 0 Mar 26 17:46:41.897: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 26 17:46:41.897: INFO: Container calico-node ready: true, restart count 0 Mar 26 17:46:41.897: INFO: csi-mockplugin-attacher-0 started at 2023-03-26 17:44:06 +0000 UTC (0+1 container statuses recorded) Mar 26 17:46:41.897: INFO: Container csi-attacher ready: true, restart count 0 Mar 26 17:46:42.297: INFO: Latency metrics for node i-0c64386131d9d94c5 Mar 26 17:46:42.297: INFO: Logging node info for node i-0ef04f0ca28b74fa4 Mar 26 17:46:42.402: INFO: Node Info: &Node{ObjectMeta:{i-0ef04f0ca28b74fa4 1429588e-1f3b-4a1a-98e2-600879dad0f2 37226 0 2023-03-26 17:21:49 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3b kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0ef04f0ca28b74fa4 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3b topology.hostpath.csi/node:i-0ef04f0ca28b74fa4 topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3b] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-expansion-5817":"csi-mock-csi-mock-volumes-expansion-5817","csi-mock-csi-mock-volumes-fsgroup-mount-4734":"csi-mock-csi-mock-volumes-fsgroup-mount-4734","ebs.csi.aws.com":"i-0ef04f0ca28b74fa4"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.42.152/19 projectcalico.org/IPv4IPIPTunnelAddr:100.104.100.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-26 17:21:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:21:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:21:50 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-03-26 17:21:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-03-26 17:22:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.7.0/24\"":{}}}} } {calico-node Update v1 2023-03-26 17:22:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2023-03-26 17:46:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.7.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3b/i-0ef04f0ca28b74fa4,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.7.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-26 17:22:08 +0000 UTC,LastTransitionTime:2023-03-26 17:22:08 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-26 17:46:28 +0000 UTC,LastTransitionTime:2023-03-26 17:21:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-26 17:46:28 +0000 UTC,LastTransitionTime:2023-03-26 17:21:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-26 17:46:28 +0000 UTC,LastTransitionTime:2023-03-26 17:21:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-26 17:46:28 +0000 UTC,LastTransitionTime:2023-03-26 17:22:00 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.152,},NodeAddress{Type:ExternalIP,Address:35.180.133.237,},NodeAddress{Type:InternalDNS,Address:i-0ef04f0ca28b74fa4.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-0ef04f0ca28b74fa4.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-180-133-237.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2cd6131a8983e20721f6c173936bc3,SystemUUID:ec2cd613-1a89-83e2-0721-f6c173936bc3,BootID:34695e7c-23d6-4648-b207-41bcd12c2edf,KernelVersion:5.15.0-1031-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0,KubeProxyVersion:v1.28.0-alpha.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/kube-proxy@sha256:8a03b3147cd7be8e8235ae1cd70cf69aca9ce03ba1cfaffea320540bb5afa496 registry.k8s.io/kube-proxy:v1.28.0-alpha.0],SizeBytes:23896850,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 26 17:46:42.403: INFO: Logging kubelet events for node i-0ef04f0ca28b74fa4 Mar 26 17:46:42.521: INFO: Logging pods the kubelet thinks is on node i-0ef04f0ca28b74fa4 Mar 26 17:46:42.633: INFO: pod-csi-inline-volumes started at 2023-03-26 17:45:13 +0000 UTC (0+1 container statuses recorded) Mar 26 17:46:42.633: INFO: Container pod-csi-inline-volumes ready: false, restart count 0 Mar 26 17:46:42.633: INFO: kube-proxy-i-0ef04f0ca28b74fa4 started at 2023-03-26 17:21:50 +0000 UTC (0+1 container statuses recorded) Mar 26 17:46:42.633: INFO: Container kube-proxy ready: true, restart count 0 Mar 26 17:46:42.633: INFO: ebs-csi-node-6wp7p started at 2023-03-26 17:21:50 +0000 UTC (0+3 container statuses recorded) Mar 26 17:46:42.633: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:46:42.633: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:46:42.633: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:46:42.633: INFO: coredns-559769c974-6mjw2 started at 2023-03-26 17:22:53 +0000 UTC (0+1 container statuses recorded) Mar 26 17:46:42.633: INFO: Container coredns ready: true, restart count 0 Mar 26 17:46:42.633: INFO: csi-mockplugin-resizer-0 started at 2023-03-26 17:45:59 +0000 UTC (0+1 container statuses recorded) Mar 26 17:46:42.633: INFO: Container csi-resizer ready: true, restart count 0 Mar 26 17:46:42.633: INFO: csi-mockplugin-0 started at 2023-03-26 17:46:27 +0000 UTC (0+4 container statuses recorded) Mar 26 17:46:42.633: INFO: Container busybox ready: true, restart count 0 Mar 26 17:46:42.633: INFO: Container csi-provisioner ready: true, restart count 0 Mar 26 17:46:42.633: INFO: Container driver-registrar ready: true, restart count 0 Mar 26 17:46:42.633: INFO: Container mock ready: true, restart count 0 Mar 26 17:46:42.633: INFO: up-down-2-b55gc started at 2023-03-26 17:46:33 +0000 UTC (0+1 container statuses recorded) Mar 26 17:46:42.633: INFO: Container up-down-2 ready: true, restart count 0 Mar 26 17:46:42.633: INFO: calico-node-bdwdr started at 2023-03-26 17:21:50 +0000 UTC (3+1 container statuses recorded) Mar 26 17:46:42.633: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 26 17:46:42.633: INFO: Init container install-cni ready: true, restart count 0 Mar 26 17:46:42.633: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 26 17:46:42.633: INFO: Container calico-node ready: true, restart count 0 Mar 26 17:46:42.633: INFO: up-down-1-6s7lc started at 2023-03-26 17:46:29 +0000 UTC (0+1 container statuses recorded) Mar 26 17:46:42.633: INFO: Container up-down-1 ready: true, restart count 0 Mar 26 17:46:42.633: INFO: pvc-volume-tester-tcjcd started at 2023-03-26 17:46:40 +0000 UTC (0+1 container statuses recorded) Mar 26 17:46:42.633: INFO: Container volume-tester ready: false, restart count 0 Mar 26 17:46:42.633: INFO: csi-mockplugin-0 started at 2023-03-26 17:45:58 +0000 UTC (0+4 container statuses recorded) Mar 26 17:46:42.633: INFO: Container busybox ready: true, restart count 0 Mar 26 17:46:42.633: INFO: Container csi-provisioner ready: true, restart count 0 Mar 26 17:46:42.633: INFO: Container driver-registrar ready: true, restart count 0 Mar 26 17:46:42.633: INFO: Container mock ready: true, restart count 0 Mar 26 17:46:43.056: INFO: Latency metrics for node i-0ef04f0ca28b74fa4 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/26/23 17:46:43.056 (4.423s) < Exit [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - dump namespaces | framework.go:209 @ 03/26/23 17:46:43.056 (4.423s) > Enter [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - tear down framework | framework.go:206 @ 03/26/23 17:46:43.056 STEP: Destroying namespace "provisioning-6504" for this suite. - test/e2e/framework/framework.go:351 @ 03/26/23 17:46:43.056 < Exit [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath - tear down framework | framework.go:206 @ 03/26/23 17:46:43.164 (109ms) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/26/23 17:46:43.164 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/26/23 17:46:43.165 (0s)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\sExternal\sStorage\s\[Driver\:\sebs\.csi\.aws\.com\]\s\[Testpattern\:\sDynamic\sPV\s\(default\sfs\)\]\svolumes\sshould\sallow\sexec\sof\sfiles\son\sthe\svolume$'
[FAILED] failed to get logs from exec-volume-test-dynamicpv-w69n for exec-container-dynamicpv-w69n: Get "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/volume-8094/pods/exec-volume-test-dynamicpv-w69n/log?container=exec-container-dynamicpv-w69n&previous=false": stream error: stream ID 403; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/26/23 17:52:19.895from junit_01.xml
> Enter [BeforeEach] [Testpattern: Dynamic PV (default fs)] volumes - test/e2e/storage/framework/testsuite.go:51 @ 03/26/23 17:52:05.336 < Exit [BeforeEach] [Testpattern: Dynamic PV (default fs)] volumes - test/e2e/storage/framework/testsuite.go:51 @ 03/26/23 17:52:05.336 (0s) > Enter [BeforeEach] [Testpattern: Dynamic PV (default fs)] volumes - set up framework | framework.go:191 @ 03/26/23 17:52:05.336 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/26/23 17:52:05.336 Mar 26 17:52:05.336: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename volume - test/e2e/framework/framework.go:250 @ 03/26/23 17:52:05.337 STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 03/26/23 17:52:05.653 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:262 @ 03/26/23 17:52:05.886 < Exit [BeforeEach] [Testpattern: Dynamic PV (default fs)] volumes - set up framework | framework.go:191 @ 03/26/23 17:52:06.1 (764ms) > Enter [BeforeEach] [Testpattern: Dynamic PV (default fs)] volumes - test/e2e/framework/metrics/init/init.go:33 @ 03/26/23 17:52:06.1 < Exit [BeforeEach] [Testpattern: Dynamic PV (default fs)] volumes - test/e2e/framework/metrics/init/init.go:33 @ 03/26/23 17:52:06.1 (0s) > Enter [It] should allow exec of files on the volume - test/e2e/storage/testsuites/volumes.go:194 @ 03/26/23 17:52:06.1 Mar 26 17:52:06.100: INFO: Creating resource for dynamic PV Mar 26 17:52:06.100: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} STEP: creating a StorageClass volume-8094-e2e-scfr44v - test/e2e/storage/framework/volume_resource.go:102 @ 03/26/23 17:52:06.101 STEP: creating a claim - test/e2e/storage/framework/volume_resource.go:294 @ 03/26/23 17:52:06.227 Mar 26 17:52:06.227: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil STEP: Creating pod exec-volume-test-dynamicpv-w69n - test/e2e/storage/testsuites/volumes.go:253 @ 03/26/23 17:52:06.55 STEP: Creating a pod to test exec-volume-test - test/e2e/framework/pod/output/output.go:243 @ 03/26/23 17:52:06.55 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/26/23 17:52:19.458 Mar 26 17:52:19.562: INFO: Trying to get logs from node i-011576d1f2b6be6ec pod exec-volume-test-dynamicpv-w69n container exec-container-dynamicpv-w69n: <nil> Mar 26 17:52:19.667: INFO: Failed to get logs from node "i-011576d1f2b6be6ec" pod "exec-volume-test-dynamicpv-w69n" container "exec-container-dynamicpv-w69n". Get "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/volume-8094/pods/exec-volume-test-dynamicpv-w69n/log?container=exec-container-dynamicpv-w69n&previous=false": stream error: stream ID 403; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/26/23 17:52:19.667 Mar 26 17:52:19.895: INFO: Unexpected error: <*fmt.wrapError | 0xc0047c2620>: failed to get logs from exec-volume-test-dynamicpv-w69n for exec-container-dynamicpv-w69n: Get "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/volume-8094/pods/exec-volume-test-dynamicpv-w69n/log?container=exec-container-dynamicpv-w69n&previous=false": stream error: stream ID 403; INTERNAL_ERROR; received from peer { msg: "failed to get logs from exec-volume-test-dynamicpv-w69n for exec-container-dynamicpv-w69n: Get \"https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/volume-8094/pods/exec-volume-test-dynamicpv-w69n/log?container=exec-container-dynamicpv-w69n&previous=false\": stream error: stream ID 403; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc0047ea060>{ Op: "Get", URL: "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/volume-8094/pods/exec-volume-test-dynamicpv-w69n/log?container=exec-container-dynamicpv-w69n&previous=false", Err: <http2.StreamError>{ StreamID: 403, Code: 2, Cause: <*errors.errorString | 0xc0001e76a0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from exec-volume-test-dynamicpv-w69n for exec-container-dynamicpv-w69n: Get "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/volume-8094/pods/exec-volume-test-dynamicpv-w69n/log?container=exec-container-dynamicpv-w69n&previous=false": stream error: stream ID 403; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/26/23 17:52:19.895 < Exit [It] should allow exec of files on the volume - test/e2e/storage/testsuites/volumes.go:194 @ 03/26/23 17:52:19.895 (13.795s) > Enter [AfterEach] [Testpattern: Dynamic PV (default fs)] volumes - test/e2e/framework/node/init/init.go:33 @ 03/26/23 17:52:19.895 Mar 26 17:52:19.895: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [Testpattern: Dynamic PV (default fs)] volumes - test/e2e/framework/node/init/init.go:33 @ 03/26/23 17:52:20 (105ms) > Enter [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] volumes - test/e2e/storage/testsuites/volumes.go:197 @ 03/26/23 17:52:20 STEP: Deleting pvc - test/e2e/storage/framework/volume_resource.go:181 @ 03/26/23 17:52:20 Mar 26 17:52:20.235: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.com5rqwk" Mar 26 17:52:20.362: INFO: Waiting up to 5m0s for PersistentVolume pvc-4fe4a816-0921-46f9-8c94-31019b63c7ab to get deleted Mar 26 17:52:20.467: INFO: PersistentVolume pvc-4fe4a816-0921-46f9-8c94-31019b63c7ab found and phase=Released (104.96886ms) Mar 26 17:52:25.580: INFO: PersistentVolume pvc-4fe4a816-0921-46f9-8c94-31019b63c7ab found and phase=Released (5.218139398s) Mar 26 17:52:30.712: INFO: PersistentVolume pvc-4fe4a816-0921-46f9-8c94-31019b63c7ab found and phase=Released (10.350572955s) Mar 26 17:52:35.834: INFO: PersistentVolume pvc-4fe4a816-0921-46f9-8c94-31019b63c7ab was removed STEP: Deleting sc - test/e2e/storage/framework/volume_resource.go:228 @ 03/26/23 17:52:35.834 < Exit [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] volumes - test/e2e/storage/testsuites/volumes.go:197 @ 03/26/23 17:52:35.941 (15.94s) > Enter [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] volumes - test/e2e/framework/metrics/init/init.go:35 @ 03/26/23 17:52:35.941 < Exit [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] volumes - test/e2e/framework/metrics/init/init.go:35 @ 03/26/23 17:52:35.941 (0s) > Enter [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] volumes - dump namespaces | framework.go:209 @ 03/26/23 17:52:35.941 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/26/23 17:52:35.941 STEP: Collecting events from namespace "volume-8094". - test/e2e/framework/debug/dump.go:42 @ 03/26/23 17:52:35.941 STEP: Found 9 events. - test/e2e/framework/debug/dump.go:46 @ 03/26/23 17:52:36.045 Mar 26 17:52:36.045: INFO: At 2023-03-26 17:52:06 +0000 UTC - event for ebs.csi.aws.com5rqwk: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding Mar 26 17:52:36.045: INFO: At 2023-03-26 17:52:06 +0000 UTC - event for ebs.csi.aws.com5rqwk: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "ebs.csi.aws.com" or manually created by system administrator Mar 26 17:52:36.045: INFO: At 2023-03-26 17:52:06 +0000 UTC - event for ebs.csi.aws.com5rqwk: {ebs.csi.aws.com_i-07cdb76b0ac2dbfa1_cb4b68af-2d91-4bfb-9626-7c22a975e7d6 } Provisioning: External provisioner is provisioning volume for claim "volume-8094/ebs.csi.aws.com5rqwk" Mar 26 17:52:36.045: INFO: At 2023-03-26 17:52:10 +0000 UTC - event for ebs.csi.aws.com5rqwk: {ebs.csi.aws.com_i-07cdb76b0ac2dbfa1_cb4b68af-2d91-4bfb-9626-7c22a975e7d6 } ProvisioningSucceeded: Successfully provisioned volume pvc-4fe4a816-0921-46f9-8c94-31019b63c7ab Mar 26 17:52:36.045: INFO: At 2023-03-26 17:52:10 +0000 UTC - event for exec-volume-test-dynamicpv-w69n: {default-scheduler } Scheduled: Successfully assigned volume-8094/exec-volume-test-dynamicpv-w69n to i-011576d1f2b6be6ec Mar 26 17:52:36.045: INFO: At 2023-03-26 17:52:13 +0000 UTC - event for exec-volume-test-dynamicpv-w69n: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-4fe4a816-0921-46f9-8c94-31019b63c7ab" Mar 26 17:52:36.045: INFO: At 2023-03-26 17:52:16 +0000 UTC - event for exec-volume-test-dynamicpv-w69n: {kubelet i-011576d1f2b6be6ec} Pulled: Container image "registry.k8s.io/e2e-test-images/nginx:1.14-4" already present on machine Mar 26 17:52:36.045: INFO: At 2023-03-26 17:52:16 +0000 UTC - event for exec-volume-test-dynamicpv-w69n: {kubelet i-011576d1f2b6be6ec} Created: Created container exec-container-dynamicpv-w69n Mar 26 17:52:36.045: INFO: At 2023-03-26 17:52:16 +0000 UTC - event for exec-volume-test-dynamicpv-w69n: {kubelet i-011576d1f2b6be6ec} Started: Started container exec-container-dynamicpv-w69n Mar 26 17:52:36.157: INFO: POD NODE PHASE GRACE CONDITIONS Mar 26 17:52:36.157: INFO: Mar 26 17:52:36.269: INFO: Logging node info for node i-011576d1f2b6be6ec Mar 26 17:52:36.374: INFO: Node Info: &Node{ObjectMeta:{i-011576d1f2b6be6ec ef4bb85b-7188-4ef2-8d1a-583f0fcc379a 58105 0 2023-03-26 17:26:11 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3b io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:i-011576d1f2b6be6ec kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3b topology.hostpath.csi/node:i-011576d1f2b6be6ec topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-2828":"i-011576d1f2b6be6ec","ebs.csi.aws.com":"i-011576d1f2b6be6ec"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.41.235/19 projectcalico.org/IPv4IPIPTunnelAddr:100.127.173.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-03-26 17:26:11 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:26:11 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-03-26 17:26:11 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-03-26 17:26:12 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-03-26 17:26:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.8.0/24\"":{}}}} } {calico-node Update v1 2023-03-26 17:26:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-03-26 17:52:34 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-03-26 17:52:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.8.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3b/i-011576d1f2b6be6ec,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.8.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-26 17:26:30 +0000 UTC,LastTransitionTime:2023-03-26 17:26:30 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-26 17:52:34 +0000 UTC,LastTransitionTime:2023-03-26 17:26:11 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-26 17:52:34 +0000 UTC,LastTransitionTime:2023-03-26 17:26:11 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-26 17:52:34 +0000 UTC,LastTransitionTime:2023-03-26 17:26:11 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-26 17:52:34 +0000 UTC,LastTransitionTime:2023-03-26 17:26:23 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.41.235,},NodeAddress{Type:ExternalIP,Address:35.180.45.101,},NodeAddress{Type:InternalDNS,Address:i-011576d1f2b6be6ec.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-011576d1f2b6be6ec.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-180-45-101.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec26cc6e198da1950569e38fb3a7f618,SystemUUID:ec26cc6e-198d-a195-0569-e38fb3a7f618,BootID:b67057d3-2187-4008-9056-8a843d3c6813,KernelVersion:5.15.0-1031-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0,KubeProxyVersion:v1.28.0-alpha.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/kube-proxy@sha256:8a03b3147cd7be8e8235ae1cd70cf69aca9ce03ba1cfaffea320540bb5afa496 registry.k8s.io/kube-proxy:v1.28.0-alpha.0],SizeBytes:23896850,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-2828^d5f18f18-cbfe-11ed-8d8b-7e7ec15f5ac0],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-2828^d5f18f18-cbfe-11ed-8d8b-7e7ec15f5ac0,DevicePath:,},},Config:nil,},} Mar 26 17:52:36.374: INFO: Logging kubelet events for node i-011576d1f2b6be6ec Mar 26 17:52:36.511: INFO: Logging pods the kubelet thinks is on node i-011576d1f2b6be6ec Mar 26 17:52:36.645: INFO: service-headless-cjqr2 started at 2023-03-26 17:51:57 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:36.645: INFO: Container service-headless ready: true, restart count 0 Mar 26 17:52:36.645: INFO: kube-proxy-i-011576d1f2b6be6ec started at 2023-03-26 17:26:12 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:36.645: INFO: Container kube-proxy ready: true, restart count 0 Mar 26 17:52:36.645: INFO: ebs-csi-node-7dqmm started at 2023-03-26 17:26:12 +0000 UTC (0+3 container statuses recorded) Mar 26 17:52:36.645: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:52:36.645: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:52:36.645: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:52:36.645: INFO: calico-node-tmjhr started at 2023-03-26 17:26:12 +0000 UTC (3+1 container statuses recorded) Mar 26 17:52:36.645: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 26 17:52:36.645: INFO: Init container install-cni ready: true, restart count 0 Mar 26 17:52:36.645: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 26 17:52:36.645: INFO: Container calico-node ready: true, restart count 0 Mar 26 17:52:36.645: INFO: csi-hostpathplugin-0 started at 2023-03-26 17:51:27 +0000 UTC (0+7 container statuses recorded) Mar 26 17:52:36.645: INFO: Container csi-attacher ready: true, restart count 0 Mar 26 17:52:36.645: INFO: Container csi-provisioner ready: true, restart count 0 Mar 26 17:52:36.645: INFO: Container csi-resizer ready: true, restart count 0 Mar 26 17:52:36.645: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 26 17:52:36.645: INFO: Container hostpath ready: true, restart count 0 Mar 26 17:52:36.645: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:52:36.645: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:52:36.645: INFO: hostexec-i-011576d1f2b6be6ec-cshfk started at 2023-03-26 17:52:35 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:36.645: INFO: Container agnhost-container ready: true, restart count 0 Mar 26 17:52:36.645: INFO: coredns-559769c974-58thj started at 2023-03-26 17:34:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:36.645: INFO: Container coredns ready: true, restart count 0 Mar 26 17:52:36.645: INFO: pod-projected-configmaps-057e9fe1-5ede-4ad3-8f95-f68169c8488f started at 2023-03-26 17:52:32 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:36.645: INFO: Container agnhost-container ready: false, restart count 0 Mar 26 17:52:36.645: INFO: inline-volume-tester-vmnzt started at 2023-03-26 17:51:29 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:36.645: INFO: Container csi-volume-tester ready: true, restart count 0 Mar 26 17:52:37.092: INFO: Latency metrics for node i-011576d1f2b6be6ec Mar 26 17:52:37.092: INFO: Logging node info for node i-07cdb76b0ac2dbfa1 Mar 26 17:52:37.208: INFO: Node Info: &Node{ObjectMeta:{i-07cdb76b0ac2dbfa1 d3bcec50-934c-432e-a590-2a35577f3a0d 51300 0 2023-03-26 17:17:19 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3b kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-07cdb76b0ac2dbfa1 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:eu-west-3b topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3b] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-07cdb76b0ac2dbfa1"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.63.230/19 projectcalico.org/IPv4IPIPTunnelAddr:100.127.118.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-26 17:17:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-03-26 17:17:20 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {calico-node Update v1 2023-03-26 17:18:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {aws-cloud-controller-manager Update v1 2023-03-26 17:18:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:18:48 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-03-26 17:18:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.5.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-03-26 17:51:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.5.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3b/i-07cdb76b0ac2dbfa1,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.5.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892301824 0} {<nil>} 3801076Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787444224 0} {<nil>} 3698676Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-26 17:18:46 +0000 UTC,LastTransitionTime:2023-03-26 17:18:46 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-26 17:51:08 +0000 UTC,LastTransitionTime:2023-03-26 17:17:19 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-26 17:51:08 +0000 UTC,LastTransitionTime:2023-03-26 17:17:19 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-26 17:51:08 +0000 UTC,LastTransitionTime:2023-03-26 17:17:19 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-26 17:51:08 +0000 UTC,LastTransitionTime:2023-03-26 17:18:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.63.230,},NodeAddress{Type:ExternalIP,Address:15.237.44.201,},NodeAddress{Type:InternalDNS,Address:i-07cdb76b0ac2dbfa1.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-07cdb76b0ac2dbfa1.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-237-44-201.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2824f976de88ff768c75c0d62c774f,SystemUUID:ec2824f9-76de-88ff-768c-75c0d62c774f,BootID:bc1e3e86-fc91-4be5-acba-90ac2a46faf2,KernelVersion:5.15.0-1031-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0,KubeProxyVersion:v1.28.0-alpha.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 registry.k8s.io/etcd:3.4.3-0],SizeBytes:100947667,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:9ce33ba33d8e738a5b85ed50b5080ac746deceed4a7496c550927a7a19ca3b6d registry.k8s.io/etcd:3.5.0-0],SizeBytes:99868722,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 registry.k8s.io/etcd:3.5.1-0],SizeBytes:98888614,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 registry.k8s.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:0d2ab6b15b4fe0b903b9e81192d942fb39c29be61fe341cd16db5d0165b0435c registry.k8s.io/etcd:3.3.17-0],SizeBytes:85524408,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:17da501f5d2a675be46040422a27b7cc21b8a43895ac998b171db1c346f361f7 registry.k8s.io/etcd:3.3.10-0],SizeBytes:76162358,},ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager-slim@sha256:8727adc059334e0e3329dbccce116a734da4a090da5e86c8cddccaf333caa666 registry.k8s.io/etcdadm/etcd-manager-slim:v3.0.20230201],SizeBytes:63926165,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:905d7ca17fd02bc24c0eba9a062753aba15db3e31422390bc3238eb762339b20 registry.k8s.io/etcd:3.2.24-1],SizeBytes:63423287,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:45208814,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:43629015,},ContainerImage{Names:[registry.k8s.io/kube-apiserver@sha256:49934a29c559e79ed19fc38b4697b18d8fe174b17bf56192588575f980c93956 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0],SizeBytes:33212506,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:2b6acd7f677f76ffe12ecf3ea7df92eb9b1bdb07336d1ac2a54c7631fb753f7e docker.io/calico/kube-controllers:v3.24.5],SizeBytes:31137169,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager@sha256:974748384634982c73527fdb3c9ec0ec476bc0d52b3dd1d611a380b7f99af1f3 registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0],SizeBytes:30820280,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/kube-proxy@sha256:8a03b3147cd7be8e8235ae1cd70cf69aca9ce03ba1cfaffea320540bb5afa496 registry.k8s.io/kube-proxy:v1.28.0-alpha.0],SizeBytes:23896850,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/kube-scheduler@sha256:cbf4007abb076188f16b975bc2b74452603cc7b34c60a29d92f14c38ad02dc11 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0],SizeBytes:18078674,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:5074723,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 26 17:52:37.209: INFO: Logging kubelet events for node i-07cdb76b0ac2dbfa1 Mar 26 17:52:37.339: INFO: Logging pods the kubelet thinks is on node i-07cdb76b0ac2dbfa1 Mar 26 17:52:37.456: INFO: aws-cloud-controller-manager-tbxvs started at 2023-03-26 17:18:29 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:37.456: INFO: Container aws-cloud-controller-manager ready: true, restart count 0 Mar 26 17:52:37.456: INFO: calico-node-5cszq started at 2023-03-26 17:18:29 +0000 UTC (3+1 container statuses recorded) Mar 26 17:52:37.456: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 26 17:52:37.456: INFO: Init container install-cni ready: true, restart count 0 Mar 26 17:52:37.456: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 26 17:52:37.456: INFO: Container calico-node ready: true, restart count 0 Mar 26 17:52:37.456: INFO: ebs-csi-controller-79f984545f-vq8bz started at 2023-03-26 17:19:49 +0000 UTC (0+5 container statuses recorded) Mar 26 17:52:37.456: INFO: Container csi-attacher ready: true, restart count 0 Mar 26 17:52:37.456: INFO: Container csi-provisioner ready: true, restart count 0 Mar 26 17:52:37.456: INFO: Container csi-resizer ready: true, restart count 0 Mar 26 17:52:37.456: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:52:37.456: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:52:37.456: INFO: dns-controller-69987775c6-ntctn started at 2023-03-26 17:17:49 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:37.456: INFO: Container dns-controller ready: true, restart count 0 Mar 26 17:52:37.456: INFO: kube-proxy-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:37.456: INFO: Container kube-proxy ready: true, restart count 0 Mar 26 17:52:37.456: INFO: kube-scheduler-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:37.456: INFO: Container kube-scheduler ready: true, restart count 0 Mar 26 17:52:37.456: INFO: etcd-manager-events-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (11+1 container statuses recorded) Mar 26 17:52:37.456: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0 Mar 26 17:52:37.456: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0 Mar 26 17:52:37.456: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0 Mar 26 17:52:37.456: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0 Mar 26 17:52:37.456: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0 Mar 26 17:52:37.456: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0 Mar 26 17:52:37.456: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0 Mar 26 17:52:37.456: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0 Mar 26 17:52:37.456: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0 Mar 26 17:52:37.456: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0 Mar 26 17:52:37.456: INFO: Init container init-etcd-3-5-7 ready: true, restart count 0 Mar 26 17:52:37.456: INFO: Container etcd-manager ready: true, restart count 0 Mar 26 17:52:37.456: INFO: etcd-manager-main-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (11+1 container statuses recorded) Mar 26 17:52:37.456: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0 Mar 26 17:52:37.456: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0 Mar 26 17:52:37.456: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0 Mar 26 17:52:37.456: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0 Mar 26 17:52:37.456: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0 Mar 26 17:52:37.456: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0 Mar 26 17:52:37.456: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0 Mar 26 17:52:37.456: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0 Mar 26 17:52:37.456: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0 Mar 26 17:52:37.456: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0 Mar 26 17:52:37.456: INFO: Init container init-etcd-3-5-7 ready: true, restart count 0 Mar 26 17:52:37.456: INFO: Container etcd-manager ready: true, restart count 0 Mar 26 17:52:37.456: INFO: kube-apiserver-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (0+2 container statuses recorded) Mar 26 17:52:37.456: INFO: Container healthcheck ready: true, restart count 0 Mar 26 17:52:37.456: INFO: Container kube-apiserver ready: true, restart count 2 Mar 26 17:52:37.456: INFO: ebs-csi-node-2r7mc started at 2023-03-26 17:18:29 +0000 UTC (0+3 container statuses recorded) Mar 26 17:52:37.456: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:52:37.456: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:52:37.456: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:52:37.456: INFO: kops-controller-thh8s started at 2023-03-26 17:18:29 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:37.456: INFO: Container kops-controller ready: true, restart count 0 Mar 26 17:52:37.456: INFO: kube-controller-manager-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:37.456: INFO: Container kube-controller-manager ready: true, restart count 4 Mar 26 17:52:37.456: INFO: calico-kube-controllers-55f488656-mjjr8 started at 2023-03-26 17:18:51 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:37.456: INFO: Container calico-kube-controllers ready: true, restart count 0 Mar 26 17:52:37.913: INFO: Latency metrics for node i-07cdb76b0ac2dbfa1 Mar 26 17:52:37.913: INFO: Logging node info for node i-0b2c24f535e511ae5 Mar 26 17:52:38.022: INFO: Node Info: &Node{ObjectMeta:{i-0b2c24f535e511ae5 8f866583-6b9f-42fc-932a-c5558d02f775 58154 0 2023-03-26 17:30:16 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3b kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0b2c24f535e511ae5 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3b topology.hostpath.csi/node:i-0b2c24f535e511ae5 topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3b] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0b2c24f535e511ae5"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.54.135/19 projectcalico.org/IPv4IPIPTunnelAddr:100.113.179.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-03-26 17:30:16 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:30:16 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-03-26 17:30:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-03-26 17:30:17 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-03-26 17:30:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.9.0/24\"":{}}}} } {calico-node Update v1 2023-03-26 17:30:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-03-26 17:52:26 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-03-26 17:52:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.9.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3b/i-0b2c24f535e511ae5,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.9.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-26 17:30:43 +0000 UTC,LastTransitionTime:2023-03-26 17:30:43 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-26 17:52:26 +0000 UTC,LastTransitionTime:2023-03-26 17:30:16 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-26 17:52:26 +0000 UTC,LastTransitionTime:2023-03-26 17:30:16 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-26 17:52:26 +0000 UTC,LastTransitionTime:2023-03-26 17:30:16 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-26 17:52:26 +0000 UTC,LastTransitionTime:2023-03-26 17:30:34 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.54.135,},NodeAddress{Type:ExternalIP,Address:13.38.65.62,},NodeAddress{Type:InternalDNS,Address:i-0b2c24f535e511ae5.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-0b2c24f535e511ae5.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-38-65-62.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec256778270128bdfe9c2066f7fedcda,SystemUUID:ec256778-2701-28bd-fe9c-2066f7fedcda,BootID:542316ee-6bea-470f-85fc-51e338ca7e74,KernelVersion:5.15.0-1031-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0,KubeProxyVersion:v1.28.0-alpha.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/kube-proxy@sha256:8a03b3147cd7be8e8235ae1cd70cf69aca9ce03ba1cfaffea320540bb5afa496 registry.k8s.io/kube-proxy:v1.28.0-alpha.0],SizeBytes:23896850,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-04491415360e74399],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-04491415360e74399,DevicePath:,},},Config:nil,},} Mar 26 17:52:38.022: INFO: Logging kubelet events for node i-0b2c24f535e511ae5 Mar 26 17:52:38.150: INFO: Logging pods the kubelet thinks is on node i-0b2c24f535e511ae5 Mar 26 17:52:38.267: INFO: webserver-pod started at 2023-03-26 17:49:38 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:38.267: INFO: Container agnhost ready: false, restart count 0 Mar 26 17:52:38.267: INFO: csi-hostpathplugin-0 started at 2023-03-26 17:51:28 +0000 UTC (0+7 container statuses recorded) Mar 26 17:52:38.267: INFO: Container csi-attacher ready: true, restart count 0 Mar 26 17:52:38.267: INFO: Container csi-provisioner ready: true, restart count 0 Mar 26 17:52:38.267: INFO: Container csi-resizer ready: true, restart count 0 Mar 26 17:52:38.267: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 26 17:52:38.267: INFO: Container hostpath ready: true, restart count 0 Mar 26 17:52:38.267: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:52:38.267: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:52:38.267: INFO: hostexec-i-0b2c24f535e511ae5-nbtbx started at 2023-03-26 17:52:32 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:38.267: INFO: Container agnhost-container ready: true, restart count 0 Mar 26 17:52:38.267: INFO: liveness-aa281934-a87f-4590-8112-09cc2a18791a started at 2023-03-26 17:51:42 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:38.267: INFO: Container agnhost-container ready: true, restart count 2 Mar 26 17:52:38.267: INFO: pod-logs-websocket-b86e2ece-77c8-44a8-a600-ac67b366a1eb started at 2023-03-26 17:52:19 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:38.267: INFO: Container main ready: true, restart count 0 Mar 26 17:52:38.267: INFO: downwardapi-volume-b8b280ec-296c-4f2c-a28e-75f612e55f00 started at 2023-03-26 17:52:27 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:38.267: INFO: Container client-container ready: false, restart count 0 Mar 26 17:52:38.267: INFO: csi-mockplugin-0 started at 2023-03-26 17:50:48 +0000 UTC (0+4 container statuses recorded) Mar 26 17:52:38.267: INFO: Container busybox ready: true, restart count 0 Mar 26 17:52:38.267: INFO: Container csi-provisioner ready: true, restart count 0 Mar 26 17:52:38.267: INFO: Container driver-registrar ready: true, restart count 0 Mar 26 17:52:38.267: INFO: Container mock ready: true, restart count 0 Mar 26 17:52:38.267: INFO: service-headless-pdh7r started at 2023-03-26 17:51:57 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:38.267: INFO: Container service-headless ready: true, restart count 0 Mar 26 17:52:38.267: INFO: externalip-test-rl9jc started at 2023-03-26 17:52:20 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:38.267: INFO: Container externalip-test ready: true, restart count 0 Mar 26 17:52:38.267: INFO: pod-subpath-test-dynamicpv-n7lt started at 2023-03-26 17:52:24 +0000 UTC (1+2 container statuses recorded) Mar 26 17:52:38.267: INFO: Init container test-init-subpath-dynamicpv-n7lt ready: true, restart count 0 Mar 26 17:52:38.267: INFO: Container test-container-subpath-dynamicpv-n7lt ready: false, restart count 0 Mar 26 17:52:38.267: INFO: Container test-container-volume-dynamicpv-n7lt ready: false, restart count 0 Mar 26 17:52:38.267: INFO: kube-proxy-i-0b2c24f535e511ae5 started at 2023-03-26 17:30:17 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:38.267: INFO: Container kube-proxy ready: true, restart count 0 Mar 26 17:52:38.267: INFO: calico-node-rdfns started at 2023-03-26 17:30:17 +0000 UTC (3+1 container statuses recorded) Mar 26 17:52:38.267: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 26 17:52:38.267: INFO: Init container install-cni ready: true, restart count 0 Mar 26 17:52:38.267: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 26 17:52:38.267: INFO: Container calico-node ready: true, restart count 0 Mar 26 17:52:38.267: INFO: ebs-csi-node-x9jln started at 2023-03-26 17:30:17 +0000 UTC (0+3 container statuses recorded) Mar 26 17:52:38.267: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:52:38.267: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:52:38.267: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:52:38.267: INFO: service-headless-toggled-pfj8h started at 2023-03-26 17:52:12 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:38.267: INFO: Container service-headless-toggled ready: true, restart count 0 Mar 26 17:52:38.267: INFO: execpod9twqt started at 2023-03-26 17:52:26 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:38.267: INFO: Container agnhost-container ready: true, restart count 0 Mar 26 17:52:38.774: INFO: Latency metrics for node i-0b2c24f535e511ae5 Mar 26 17:52:38.774: INFO: Logging node info for node i-0c64386131d9d94c5 Mar 26 17:52:38.879: INFO: Node Info: &Node{ObjectMeta:{i-0c64386131d9d94c5 6c5a59f3-69fd-488b-b94e-23777e242a7e 57813 0 2023-03-26 17:34:02 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3b kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0c64386131d9d94c5 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3b topology.hostpath.csi/node:i-0c64386131d9d94c5 topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3b] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0c64386131d9d94c5"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.63.240/19 projectcalico.org/IPv4IPIPTunnelAddr:100.122.71.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-03-26 17:34:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:34:02 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-03-26 17:34:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-03-26 17:34:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-03-26 17:34:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.10.0/24\"":{}}}} } {calico-node Update v1 2023-03-26 17:34:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2023-03-26 17:52:20 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-03-26 17:52:31 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.10.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3b/i-0c64386131d9d94c5,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.10.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-26 17:34:21 +0000 UTC,LastTransitionTime:2023-03-26 17:34:21 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-26 17:52:17 +0000 UTC,LastTransitionTime:2023-03-26 17:34:02 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-26 17:52:17 +0000 UTC,LastTransitionTime:2023-03-26 17:34:02 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-26 17:52:17 +0000 UTC,LastTransitionTime:2023-03-26 17:34:02 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-26 17:52:17 +0000 UTC,LastTransitionTime:2023-03-26 17:34:14 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.63.240,},NodeAddress{Type:ExternalIP,Address:15.236.210.84,},NodeAddress{Type:InternalDNS,Address:i-0c64386131d9d94c5.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-0c64386131d9d94c5.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-236-210-84.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2c2c56ef9295a859b1f844cff158e8,SystemUUID:ec2c2c56-ef92-95a8-59b1-f844cff158e8,BootID:825bc25d-7144-4ec9-8dfb-f77f9cde8c31,KernelVersion:5.15.0-1031-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0,KubeProxyVersion:v1.28.0-alpha.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/kube-proxy@sha256:8a03b3147cd7be8e8235ae1cd70cf69aca9ce03ba1cfaffea320540bb5afa496 registry.k8s.io/kube-proxy:v1.28.0-alpha.0],SizeBytes:23896850,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:13ac9b3c476d7290a4451d65d09d6016a2cb89836ffbfa4eae55b72731a22080 registry.k8s.io/build-image/distroless-iptables:v0.2.2],SizeBytes:7729580,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-021fe00bc7ee4a15c],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-021fe00bc7ee4a15c,DevicePath:,},},Config:nil,},} Mar 26 17:52:38.879: INFO: Logging kubelet events for node i-0c64386131d9d94c5 Mar 26 17:52:38.997: INFO: Logging pods the kubelet thinks is on node i-0c64386131d9d94c5 Mar 26 17:52:39.106: INFO: pod-secrets-65c1903f-ac1d-4994-a139-1322ba03876e started at 2023-03-26 17:50:30 +0000 UTC (0+3 container statuses recorded) Mar 26 17:52:39.107: INFO: Container creates-volume-test ready: true, restart count 0 Mar 26 17:52:39.107: INFO: Container dels-volume-test ready: true, restart count 0 Mar 26 17:52:39.107: INFO: Container upds-volume-test ready: true, restart count 0 Mar 26 17:52:39.107: INFO: hostexec-i-0c64386131d9d94c5-c8mwc started at 2023-03-26 17:51:39 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:39.107: INFO: Container agnhost-container ready: true, restart count 0 Mar 26 17:52:39.107: INFO: pod-15c69657-7ff8-42a3-bacf-9215772e4f61 started at 2023-03-26 17:51:49 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:39.107: INFO: Container write-pod ready: true, restart count 0 Mar 26 17:52:39.107: INFO: ebs-csi-node-rhk2b started at 2023-03-26 17:34:03 +0000 UTC (0+3 container statuses recorded) Mar 26 17:52:39.107: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:52:39.107: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:52:39.107: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:52:39.107: INFO: coredns-autoscaler-7cb5c5b969-xmt8r started at 2023-03-26 17:34:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:39.107: INFO: Container autoscaler ready: true, restart count 0 Mar 26 17:52:39.107: INFO: exceed-active-deadline-gs8kx started at 2023-03-26 17:52:35 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:39.107: INFO: Container c ready: true, restart count 0 Mar 26 17:52:39.107: INFO: externalip-test-kkklg started at 2023-03-26 17:52:20 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:39.107: INFO: Container externalip-test ready: true, restart count 0 Mar 26 17:52:39.107: INFO: service-headless-toggled-4rcm7 started at 2023-03-26 17:52:12 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:39.107: INFO: Container service-headless-toggled ready: true, restart count 0 Mar 26 17:52:39.107: INFO: kube-proxy-i-0c64386131d9d94c5 started at 2023-03-26 17:34:03 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:39.107: INFO: Container kube-proxy ready: true, restart count 0 Mar 26 17:52:39.107: INFO: verify-service-down-host-exec-pod started at 2023-03-26 17:52:36 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:39.107: INFO: Container agnhost-container ready: true, restart count 0 Mar 26 17:52:39.107: INFO: calico-node-jl5lk started at 2023-03-26 17:34:03 +0000 UTC (3+1 container statuses recorded) Mar 26 17:52:39.107: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 26 17:52:39.107: INFO: Init container install-cni ready: true, restart count 0 Mar 26 17:52:39.107: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 26 17:52:39.107: INFO: Container calico-node ready: true, restart count 0 Mar 26 17:52:39.573: INFO: Latency metrics for node i-0c64386131d9d94c5 Mar 26 17:52:39.573: INFO: Logging node info for node i-0ef04f0ca28b74fa4 Mar 26 17:52:39.680: INFO: Node Info: &Node{ObjectMeta:{i-0ef04f0ca28b74fa4 1429588e-1f3b-4a1a-98e2-600879dad0f2 56846 0 2023-03-26 17:21:49 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3b kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0ef04f0ca28b74fa4 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3b topology.hostpath.csi/node:i-0ef04f0ca28b74fa4 topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3b] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0ef04f0ca28b74fa4"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.42.152/19 projectcalico.org/IPv4IPIPTunnelAddr:100.104.100.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-26 17:21:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:21:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:21:50 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-03-26 17:21:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-03-26 17:22:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.7.0/24\"":{}}}} } {calico-node Update v1 2023-03-26 17:22:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2023-03-26 17:52:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.7.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3b/i-0ef04f0ca28b74fa4,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.7.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-26 17:22:08 +0000 UTC,LastTransitionTime:2023-03-26 17:22:08 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-26 17:52:15 +0000 UTC,LastTransitionTime:2023-03-26 17:21:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-26 17:52:15 +0000 UTC,LastTransitionTime:2023-03-26 17:21:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-26 17:52:15 +0000 UTC,LastTransitionTime:2023-03-26 17:21:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-26 17:52:15 +0000 UTC,LastTransitionTime:2023-03-26 17:22:00 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.152,},NodeAddress{Type:ExternalIP,Address:35.180.133.237,},NodeAddress{Type:InternalDNS,Address:i-0ef04f0ca28b74fa4.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-0ef04f0ca28b74fa4.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-180-133-237.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2cd6131a8983e20721f6c173936bc3,SystemUUID:ec2cd613-1a89-83e2-0721-f6c173936bc3,BootID:34695e7c-23d6-4648-b207-41bcd12c2edf,KernelVersion:5.15.0-1031-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0,KubeProxyVersion:v1.28.0-alpha.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/kube-proxy@sha256:8a03b3147cd7be8e8235ae1cd70cf69aca9ce03ba1cfaffea320540bb5afa496 registry.k8s.io/kube-proxy:v1.28.0-alpha.0],SizeBytes:23896850,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 26 17:52:39.681: INFO: Logging kubelet events for node i-0ef04f0ca28b74fa4 Mar 26 17:52:39.799: INFO: Logging pods the kubelet thinks is on node i-0ef04f0ca28b74fa4 Mar 26 17:52:39.911: INFO: coredns-559769c974-6mjw2 started at 2023-03-26 17:22:53 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:39.912: INFO: Container coredns ready: true, restart count 0 Mar 26 17:52:39.912: INFO: service-headless-l7zdh started at 2023-03-26 17:51:57 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:39.912: INFO: Container service-headless ready: true, restart count 0 Mar 26 17:52:39.912: INFO: kube-proxy-i-0ef04f0ca28b74fa4 started at 2023-03-26 17:21:50 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:39.912: INFO: Container kube-proxy ready: true, restart count 0 Mar 26 17:52:39.912: INFO: liveness-f07cd7ad-7f53-408f-9ba0-02fe49537f88 started at 2023-03-26 17:49:01 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:39.912: INFO: Container agnhost-container ready: true, restart count 0 Mar 26 17:52:39.912: INFO: calico-node-bdwdr started at 2023-03-26 17:21:50 +0000 UTC (3+1 container statuses recorded) Mar 26 17:52:39.912: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 26 17:52:39.912: INFO: Init container install-cni ready: true, restart count 0 Mar 26 17:52:39.912: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 26 17:52:39.912: INFO: Container calico-node ready: true, restart count 0 Mar 26 17:52:39.912: INFO: ebs-csi-node-6wp7p started at 2023-03-26 17:21:50 +0000 UTC (0+3 container statuses recorded) Mar 26 17:52:39.912: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:52:39.912: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:52:39.912: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:52:39.912: INFO: labelsupdate89553ffe-db57-485c-8c2e-3033dcae22c6 started at 2023-03-26 17:51:44 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:39.912: INFO: Container client-container ready: true, restart count 0 Mar 26 17:52:39.912: INFO: liveness-98819b4b-5e8c-4707-afa5-47a774468375 started at 2023-03-26 17:50:16 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:39.912: INFO: Container agnhost-container ready: true, restart count 0 Mar 26 17:52:39.912: INFO: busybox-43b1a9ea-82c6-485d-a002-1b0986b52eef started at 2023-03-26 17:52:39 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:39.912: INFO: Container busybox ready: false, restart count 0 Mar 26 17:52:39.912: INFO: configmap-client started at 2023-03-26 17:52:39 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:39.912: INFO: Container configmap-client ready: false, restart count 0 Mar 26 17:52:39.912: INFO: service-headless-toggled-r679l started at 2023-03-26 17:52:12 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:39.912: INFO: Container service-headless-toggled ready: true, restart count 0 Mar 26 17:52:39.912: INFO: startup-86fac25e-94ed-46f5-87c0-9776095c4056 started at 2023-03-26 17:48:56 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:39.912: INFO: Container busybox ready: false, restart count 0 Mar 26 17:52:39.912: INFO: exceed-active-deadline-mkhfv started at 2023-03-26 17:52:35 +0000 UTC (0+1 container statuses recorded) Mar 26 17:52:39.912: INFO: Container c ready: true, restart count 0 Mar 26 17:52:40.394: INFO: Latency metrics for node i-0ef04f0ca28b74fa4 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/26/23 17:52:40.394 (4.453s) < Exit [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] volumes - dump namespaces | framework.go:209 @ 03/26/23 17:52:40.394 (4.453s) > Enter [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] volumes - tear down framework | framework.go:206 @ 03/26/23 17:52:40.394 STEP: Destroying namespace "volume-8094" for this suite. - test/e2e/framework/framework.go:351 @ 03/26/23 17:52:40.394 < Exit [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] volumes - tear down framework | framework.go:206 @ 03/26/23 17:52:40.534 (140ms) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/26/23 17:52:40.535 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/26/23 17:52:40.535 (0s)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\sExternal\sStorage\s\[Driver\:\sebs\.csi\.aws\.com\]\s\[Testpattern\:\sDynamic\sPV\s\(ext4\)\]\svolumes\sshould\sallow\sexec\sof\sfiles\son\sthe\svolume$'
[FAILED] failed to get logs from exec-volume-test-dynamicpv-fxbk for exec-container-dynamicpv-fxbk: Get "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/volume-4590/pods/exec-volume-test-dynamicpv-fxbk/log?container=exec-container-dynamicpv-fxbk&previous=false": stream error: stream ID 331; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/26/23 17:39:14.445from junit_01.xml
> Enter [BeforeEach] [Testpattern: Dynamic PV (ext4)] volumes - test/e2e/storage/framework/testsuite.go:51 @ 03/26/23 17:38:55.868 < Exit [BeforeEach] [Testpattern: Dynamic PV (ext4)] volumes - test/e2e/storage/framework/testsuite.go:51 @ 03/26/23 17:38:55.868 (0s) > Enter [BeforeEach] [Testpattern: Dynamic PV (ext4)] volumes - set up framework | framework.go:191 @ 03/26/23 17:38:55.868 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/26/23 17:38:55.868 Mar 26 17:38:55.868: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename volume - test/e2e/framework/framework.go:250 @ 03/26/23 17:38:55.869 STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 03/26/23 17:38:56.2 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:262 @ 03/26/23 17:38:56.413 < Exit [BeforeEach] [Testpattern: Dynamic PV (ext4)] volumes - set up framework | framework.go:191 @ 03/26/23 17:38:56.622 (754ms) > Enter [BeforeEach] [Testpattern: Dynamic PV (ext4)] volumes - test/e2e/framework/metrics/init/init.go:33 @ 03/26/23 17:38:56.622 < Exit [BeforeEach] [Testpattern: Dynamic PV (ext4)] volumes - test/e2e/framework/metrics/init/init.go:33 @ 03/26/23 17:38:56.622 (0s) > Enter [It] should allow exec of files on the volume - test/e2e/storage/testsuites/volumes.go:194 @ 03/26/23 17:38:56.622 Mar 26 17:38:56.622: INFO: Creating resource for dynamic PV Mar 26 17:38:56.622: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} STEP: creating a StorageClass volume-4590-e2e-sc79wc5 - test/e2e/storage/framework/volume_resource.go:102 @ 03/26/23 17:38:56.623 STEP: creating a claim - test/e2e/storage/framework/volume_resource.go:294 @ 03/26/23 17:38:56.729 Mar 26 17:38:56.729: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil STEP: Creating pod exec-volume-test-dynamicpv-fxbk - test/e2e/storage/testsuites/volumes.go:253 @ 03/26/23 17:38:56.944 STEP: Creating a pod to test exec-volume-test - test/e2e/framework/pod/output/output.go:243 @ 03/26/23 17:38:56.944 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/26/23 17:39:14.006 Mar 26 17:39:14.111: INFO: Trying to get logs from node i-0b2c24f535e511ae5 pod exec-volume-test-dynamicpv-fxbk container exec-container-dynamicpv-fxbk: <nil> Mar 26 17:39:14.221: INFO: Failed to get logs from node "i-0b2c24f535e511ae5" pod "exec-volume-test-dynamicpv-fxbk" container "exec-container-dynamicpv-fxbk". Get "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/volume-4590/pods/exec-volume-test-dynamicpv-fxbk/log?container=exec-container-dynamicpv-fxbk&previous=false": stream error: stream ID 331; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/26/23 17:39:14.221 Mar 26 17:39:14.444: INFO: Unexpected error: <*fmt.wrapError | 0xc000426000>: failed to get logs from exec-volume-test-dynamicpv-fxbk for exec-container-dynamicpv-fxbk: Get "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/volume-4590/pods/exec-volume-test-dynamicpv-fxbk/log?container=exec-container-dynamicpv-fxbk&previous=false": stream error: stream ID 331; INTERNAL_ERROR; received from peer { msg: "failed to get logs from exec-volume-test-dynamicpv-fxbk for exec-container-dynamicpv-fxbk: Get \"https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/volume-4590/pods/exec-volume-test-dynamicpv-fxbk/log?container=exec-container-dynamicpv-fxbk&previous=false\": stream error: stream ID 331; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc0033ae390>{ Op: "Get", URL: "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/volume-4590/pods/exec-volume-test-dynamicpv-fxbk/log?container=exec-container-dynamicpv-fxbk&previous=false", Err: <http2.StreamError>{ StreamID: 331, Code: 2, Cause: <*errors.errorString | 0xc0001676c0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from exec-volume-test-dynamicpv-fxbk for exec-container-dynamicpv-fxbk: Get "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/volume-4590/pods/exec-volume-test-dynamicpv-fxbk/log?container=exec-container-dynamicpv-fxbk&previous=false": stream error: stream ID 331; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/26/23 17:39:14.445 < Exit [It] should allow exec of files on the volume - test/e2e/storage/testsuites/volumes.go:194 @ 03/26/23 17:39:14.445 (17.822s) > Enter [AfterEach] [Testpattern: Dynamic PV (ext4)] volumes - test/e2e/framework/node/init/init.go:33 @ 03/26/23 17:39:14.445 Mar 26 17:39:14.445: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [Testpattern: Dynamic PV (ext4)] volumes - test/e2e/framework/node/init/init.go:33 @ 03/26/23 17:39:14.553 (108ms) > Enter [DeferCleanup (Each)] [Testpattern: Dynamic PV (ext4)] volumes - test/e2e/storage/testsuites/volumes.go:197 @ 03/26/23 17:39:14.553 STEP: Deleting pvc - test/e2e/storage/framework/volume_resource.go:181 @ 03/26/23 17:39:14.553 Mar 26 17:39:14.764: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.comflqzc" Mar 26 17:39:14.876: INFO: Waiting up to 5m0s for PersistentVolume pvc-0cef77fe-8a92-4f3d-b8c2-d1a0304d14db to get deleted Mar 26 17:39:14.984: INFO: PersistentVolume pvc-0cef77fe-8a92-4f3d-b8c2-d1a0304d14db found and phase=Released (107.409151ms) Mar 26 17:39:20.089: INFO: PersistentVolume pvc-0cef77fe-8a92-4f3d-b8c2-d1a0304d14db found and phase=Released (5.213003102s) Mar 26 17:39:25.196: INFO: PersistentVolume pvc-0cef77fe-8a92-4f3d-b8c2-d1a0304d14db found and phase=Released (10.319313668s) Mar 26 17:39:30.301: INFO: PersistentVolume pvc-0cef77fe-8a92-4f3d-b8c2-d1a0304d14db was removed STEP: Deleting sc - test/e2e/storage/framework/volume_resource.go:228 @ 03/26/23 17:39:30.301 < Exit [DeferCleanup (Each)] [Testpattern: Dynamic PV (ext4)] volumes - test/e2e/storage/testsuites/volumes.go:197 @ 03/26/23 17:39:30.407 (15.854s) > Enter [DeferCleanup (Each)] [Testpattern: Dynamic PV (ext4)] volumes - test/e2e/framework/metrics/init/init.go:35 @ 03/26/23 17:39:30.407 < Exit [DeferCleanup (Each)] [Testpattern: Dynamic PV (ext4)] volumes - test/e2e/framework/metrics/init/init.go:35 @ 03/26/23 17:39:30.407 (0s) > Enter [DeferCleanup (Each)] [Testpattern: Dynamic PV (ext4)] volumes - dump namespaces | framework.go:209 @ 03/26/23 17:39:30.407 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/26/23 17:39:30.407 STEP: Collecting events from namespace "volume-4590". - test/e2e/framework/debug/dump.go:42 @ 03/26/23 17:39:30.407 STEP: Found 9 events. - test/e2e/framework/debug/dump.go:46 @ 03/26/23 17:39:30.512 Mar 26 17:39:30.512: INFO: At 2023-03-26 17:38:56 +0000 UTC - event for ebs.csi.aws.comflqzc: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding Mar 26 17:39:30.512: INFO: At 2023-03-26 17:38:57 +0000 UTC - event for ebs.csi.aws.comflqzc: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "ebs.csi.aws.com" or manually created by system administrator Mar 26 17:39:30.512: INFO: At 2023-03-26 17:38:57 +0000 UTC - event for ebs.csi.aws.comflqzc: {ebs.csi.aws.com_i-07cdb76b0ac2dbfa1_cb4b68af-2d91-4bfb-9626-7c22a975e7d6 } Provisioning: External provisioner is provisioning volume for claim "volume-4590/ebs.csi.aws.comflqzc" Mar 26 17:39:30.512: INFO: At 2023-03-26 17:39:00 +0000 UTC - event for ebs.csi.aws.comflqzc: {ebs.csi.aws.com_i-07cdb76b0ac2dbfa1_cb4b68af-2d91-4bfb-9626-7c22a975e7d6 } ProvisioningSucceeded: Successfully provisioned volume pvc-0cef77fe-8a92-4f3d-b8c2-d1a0304d14db Mar 26 17:39:30.512: INFO: At 2023-03-26 17:39:01 +0000 UTC - event for exec-volume-test-dynamicpv-fxbk: {default-scheduler } Scheduled: Successfully assigned volume-4590/exec-volume-test-dynamicpv-fxbk to i-0b2c24f535e511ae5 Mar 26 17:39:30.512: INFO: At 2023-03-26 17:39:05 +0000 UTC - event for exec-volume-test-dynamicpv-fxbk: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-0cef77fe-8a92-4f3d-b8c2-d1a0304d14db" Mar 26 17:39:30.512: INFO: At 2023-03-26 17:39:09 +0000 UTC - event for exec-volume-test-dynamicpv-fxbk: {kubelet i-0b2c24f535e511ae5} Pulled: Container image "registry.k8s.io/e2e-test-images/nginx:1.14-4" already present on machine Mar 26 17:39:30.512: INFO: At 2023-03-26 17:39:09 +0000 UTC - event for exec-volume-test-dynamicpv-fxbk: {kubelet i-0b2c24f535e511ae5} Created: Created container exec-container-dynamicpv-fxbk Mar 26 17:39:30.512: INFO: At 2023-03-26 17:39:09 +0000 UTC - event for exec-volume-test-dynamicpv-fxbk: {kubelet i-0b2c24f535e511ae5} Started: Started container exec-container-dynamicpv-fxbk Mar 26 17:39:30.617: INFO: POD NODE PHASE GRACE CONDITIONS Mar 26 17:39:30.617: INFO: Mar 26 17:39:30.723: INFO: Logging node info for node i-011576d1f2b6be6ec Mar 26 17:39:30.829: INFO: Node Info: &Node{ObjectMeta:{i-011576d1f2b6be6ec ef4bb85b-7188-4ef2-8d1a-583f0fcc379a 14205 0 2023-03-26 17:26:11 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3b kubernetes.io/arch:amd64 kubernetes.io/hostname:i-011576d1f2b6be6ec kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3b topology.hostpath.csi/node:i-011576d1f2b6be6ec topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3b] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-011576d1f2b6be6ec"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.41.235/19 projectcalico.org/IPv4IPIPTunnelAddr:100.127.173.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-03-26 17:26:11 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:26:11 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-03-26 17:26:11 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-03-26 17:26:12 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-03-26 17:26:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.8.0/24\"":{}}}} } {calico-node Update v1 2023-03-26 17:26:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2023-03-26 17:38:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.8.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3b/i-011576d1f2b6be6ec,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.8.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-26 17:26:30 +0000 UTC,LastTransitionTime:2023-03-26 17:26:30 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-26 17:38:37 +0000 UTC,LastTransitionTime:2023-03-26 17:26:11 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-26 17:38:37 +0000 UTC,LastTransitionTime:2023-03-26 17:26:11 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-26 17:38:37 +0000 UTC,LastTransitionTime:2023-03-26 17:26:11 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-26 17:38:37 +0000 UTC,LastTransitionTime:2023-03-26 17:26:23 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.41.235,},NodeAddress{Type:ExternalIP,Address:35.180.45.101,},NodeAddress{Type:InternalDNS,Address:i-011576d1f2b6be6ec.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-011576d1f2b6be6ec.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-180-45-101.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec26cc6e198da1950569e38fb3a7f618,SystemUUID:ec26cc6e-198d-a195-0569-e38fb3a7f618,BootID:b67057d3-2187-4008-9056-8a843d3c6813,KernelVersion:5.15.0-1031-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0,KubeProxyVersion:v1.28.0-alpha.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/kube-proxy@sha256:8a03b3147cd7be8e8235ae1cd70cf69aca9ce03ba1cfaffea320540bb5afa496 registry.k8s.io/kube-proxy:v1.28.0-alpha.0],SizeBytes:23896850,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 26 17:39:30.829: INFO: Logging kubelet events for node i-011576d1f2b6be6ec Mar 26 17:39:30.942: INFO: Logging pods the kubelet thinks is on node i-011576d1f2b6be6ec Mar 26 17:39:31.054: INFO: hostexec-i-011576d1f2b6be6ec-4jbw9 started at 2023-03-26 17:39:12 +0000 UTC (0+1 container statuses recorded) Mar 26 17:39:31.054: INFO: Container agnhost-container ready: true, restart count 0 Mar 26 17:39:31.054: INFO: pfpod started at 2023-03-26 17:37:31 +0000 UTC (0+2 container statuses recorded) Mar 26 17:39:31.054: INFO: Container portforwardtester ready: false, restart count 0 Mar 26 17:39:31.054: INFO: Container readiness ready: false, restart count 0 Mar 26 17:39:31.054: INFO: coredns-559769c974-58thj started at 2023-03-26 17:34:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:39:31.054: INFO: Container coredns ready: true, restart count 0 Mar 26 17:39:31.054: INFO: pod-handle-http-request started at 2023-03-26 17:37:57 +0000 UTC (0+2 container statuses recorded) Mar 26 17:39:31.054: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 26 17:39:31.054: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 26 17:39:31.054: INFO: ebs-csi-node-7dqmm started at 2023-03-26 17:26:12 +0000 UTC (0+3 container statuses recorded) Mar 26 17:39:31.054: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:39:31.054: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:39:31.054: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:39:31.054: INFO: calico-node-tmjhr started at 2023-03-26 17:26:12 +0000 UTC (3+1 container statuses recorded) Mar 26 17:39:31.054: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 26 17:39:31.054: INFO: Init container install-cni ready: true, restart count 0 Mar 26 17:39:31.054: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 26 17:39:31.054: INFO: Container calico-node ready: true, restart count 0 Mar 26 17:39:31.054: INFO: pfpod started at 2023-03-26 17:37:32 +0000 UTC (0+2 container statuses recorded) Mar 26 17:39:31.054: INFO: Container portforwardtester ready: false, restart count 0 Mar 26 17:39:31.054: INFO: Container readiness ready: false, restart count 0 Mar 26 17:39:31.054: INFO: labelsupdate0ad729f8-394a-4b7a-bffe-012d40540ea7 started at 2023-03-26 17:37:28 +0000 UTC (0+1 container statuses recorded) Mar 26 17:39:31.054: INFO: Container client-container ready: true, restart count 0 Mar 26 17:39:31.054: INFO: service-proxy-disabled-jzsd2 started at 2023-03-26 17:39:11 +0000 UTC (0+1 container statuses recorded) Mar 26 17:39:31.054: INFO: Container service-proxy-disabled ready: true, restart count 0 Mar 26 17:39:31.054: INFO: kube-proxy-i-011576d1f2b6be6ec started at 2023-03-26 17:26:12 +0000 UTC (0+1 container statuses recorded) Mar 26 17:39:31.054: INFO: Container kube-proxy ready: true, restart count 0 Mar 26 17:39:31.054: INFO: test-ss-1 started at 2023-03-26 17:38:45 +0000 UTC (0+1 container statuses recorded) Mar 26 17:39:31.054: INFO: Container webserver ready: true, restart count 0 Mar 26 17:39:31.054: INFO: pod-with-poststart-http-hook started at 2023-03-26 17:38:00 +0000 UTC (0+1 container statuses recorded) Mar 26 17:39:31.054: INFO: Container pod-with-poststart-http-hook ready: true, restart count 0 Mar 26 17:39:31.054: INFO: netserver-0 started at 2023-03-26 17:39:14 +0000 UTC (0+1 container statuses recorded) Mar 26 17:39:31.054: INFO: Container webserver ready: true, restart count 0 Mar 26 17:39:31.489: INFO: Latency metrics for node i-011576d1f2b6be6ec Mar 26 17:39:31.489: INFO: Logging node info for node i-07cdb76b0ac2dbfa1 Mar 26 17:39:31.594: INFO: Node Info: &Node{ObjectMeta:{i-07cdb76b0ac2dbfa1 d3bcec50-934c-432e-a590-2a35577f3a0d 5994 0 2023-03-26 17:17:19 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3b kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-07cdb76b0ac2dbfa1 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:eu-west-3b topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3b] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-07cdb76b0ac2dbfa1"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.63.230/19 projectcalico.org/IPv4IPIPTunnelAddr:100.127.118.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-26 17:17:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-03-26 17:17:20 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {calico-node Update v1 2023-03-26 17:18:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {aws-cloud-controller-manager Update v1 2023-03-26 17:18:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:18:48 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-03-26 17:18:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.5.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-03-26 17:35:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.5.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3b/i-07cdb76b0ac2dbfa1,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.5.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892301824 0} {<nil>} 3801076Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787444224 0} {<nil>} 3698676Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-26 17:18:46 +0000 UTC,LastTransitionTime:2023-03-26 17:18:46 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-26 17:35:51 +0000 UTC,LastTransitionTime:2023-03-26 17:17:19 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-26 17:35:51 +0000 UTC,LastTransitionTime:2023-03-26 17:17:19 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-26 17:35:51 +0000 UTC,LastTransitionTime:2023-03-26 17:17:19 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-26 17:35:51 +0000 UTC,LastTransitionTime:2023-03-26 17:18:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.63.230,},NodeAddress{Type:ExternalIP,Address:15.237.44.201,},NodeAddress{Type:InternalDNS,Address:i-07cdb76b0ac2dbfa1.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-07cdb76b0ac2dbfa1.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-237-44-201.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2824f976de88ff768c75c0d62c774f,SystemUUID:ec2824f9-76de-88ff-768c-75c0d62c774f,BootID:bc1e3e86-fc91-4be5-acba-90ac2a46faf2,KernelVersion:5.15.0-1031-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0,KubeProxyVersion:v1.28.0-alpha.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 registry.k8s.io/etcd:3.4.3-0],SizeBytes:100947667,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:9ce33ba33d8e738a5b85ed50b5080ac746deceed4a7496c550927a7a19ca3b6d registry.k8s.io/etcd:3.5.0-0],SizeBytes:99868722,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 registry.k8s.io/etcd:3.5.1-0],SizeBytes:98888614,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 registry.k8s.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:0d2ab6b15b4fe0b903b9e81192d942fb39c29be61fe341cd16db5d0165b0435c registry.k8s.io/etcd:3.3.17-0],SizeBytes:85524408,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:17da501f5d2a675be46040422a27b7cc21b8a43895ac998b171db1c346f361f7 registry.k8s.io/etcd:3.3.10-0],SizeBytes:76162358,},ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager-slim@sha256:8727adc059334e0e3329dbccce116a734da4a090da5e86c8cddccaf333caa666 registry.k8s.io/etcdadm/etcd-manager-slim:v3.0.20230201],SizeBytes:63926165,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:905d7ca17fd02bc24c0eba9a062753aba15db3e31422390bc3238eb762339b20 registry.k8s.io/etcd:3.2.24-1],SizeBytes:63423287,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:45208814,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:43629015,},ContainerImage{Names:[registry.k8s.io/kube-apiserver@sha256:49934a29c559e79ed19fc38b4697b18d8fe174b17bf56192588575f980c93956 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0],SizeBytes:33212506,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:2b6acd7f677f76ffe12ecf3ea7df92eb9b1bdb07336d1ac2a54c7631fb753f7e docker.io/calico/kube-controllers:v3.24.5],SizeBytes:31137169,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager@sha256:974748384634982c73527fdb3c9ec0ec476bc0d52b3dd1d611a380b7f99af1f3 registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0],SizeBytes:30820280,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/kube-proxy@sha256:8a03b3147cd7be8e8235ae1cd70cf69aca9ce03ba1cfaffea320540bb5afa496 registry.k8s.io/kube-proxy:v1.28.0-alpha.0],SizeBytes:23896850,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/kube-scheduler@sha256:cbf4007abb076188f16b975bc2b74452603cc7b34c60a29d92f14c38ad02dc11 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0],SizeBytes:18078674,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:5074723,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 26 17:39:31.595: INFO: Logging kubelet events for node i-07cdb76b0ac2dbfa1 Mar 26 17:39:31.717: INFO: Logging pods the kubelet thinks is on node i-07cdb76b0ac2dbfa1 Mar 26 17:39:31.833: INFO: kube-apiserver-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (0+2 container statuses recorded) Mar 26 17:39:31.833: INFO: Container healthcheck ready: true, restart count 0 Mar 26 17:39:31.833: INFO: Container kube-apiserver ready: true, restart count 2 Mar 26 17:39:31.833: INFO: ebs-csi-node-2r7mc started at 2023-03-26 17:18:29 +0000 UTC (0+3 container statuses recorded) Mar 26 17:39:31.833: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:39:31.833: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:39:31.833: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:39:31.833: INFO: kops-controller-thh8s started at 2023-03-26 17:18:29 +0000 UTC (0+1 container statuses recorded) Mar 26 17:39:31.833: INFO: Container kops-controller ready: true, restart count 0 Mar 26 17:39:31.833: INFO: kube-controller-manager-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:39:31.833: INFO: Container kube-controller-manager ready: true, restart count 4 Mar 26 17:39:31.833: INFO: kube-proxy-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:39:31.833: INFO: Container kube-proxy ready: true, restart count 0 Mar 26 17:39:31.833: INFO: kube-scheduler-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:39:31.833: INFO: Container kube-scheduler ready: true, restart count 0 Mar 26 17:39:31.833: INFO: etcd-manager-events-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (11+1 container statuses recorded) Mar 26 17:39:31.833: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0 Mar 26 17:39:31.833: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0 Mar 26 17:39:31.833: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0 Mar 26 17:39:31.833: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0 Mar 26 17:39:31.833: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0 Mar 26 17:39:31.833: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0 Mar 26 17:39:31.833: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0 Mar 26 17:39:31.833: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0 Mar 26 17:39:31.833: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0 Mar 26 17:39:31.833: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0 Mar 26 17:39:31.833: INFO: Init container init-etcd-3-5-7 ready: true, restart count 0 Mar 26 17:39:31.833: INFO: Container etcd-manager ready: true, restart count 0 Mar 26 17:39:31.833: INFO: etcd-manager-main-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (11+1 container statuses recorded) Mar 26 17:39:31.833: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0 Mar 26 17:39:31.833: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0 Mar 26 17:39:31.833: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0 Mar 26 17:39:31.833: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0 Mar 26 17:39:31.833: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0 Mar 26 17:39:31.833: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0 Mar 26 17:39:31.833: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0 Mar 26 17:39:31.833: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0 Mar 26 17:39:31.833: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0 Mar 26 17:39:31.833: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0 Mar 26 17:39:31.833: INFO: Init container init-etcd-3-5-7 ready: true, restart count 0 Mar 26 17:39:31.833: INFO: Container etcd-manager ready: true, restart count 0 Mar 26 17:39:31.833: INFO: calico-kube-controllers-55f488656-mjjr8 started at 2023-03-26 17:18:51 +0000 UTC (0+1 container statuses recorded) Mar 26 17:39:31.833: INFO: Container calico-kube-controllers ready: true, restart count 0 Mar 26 17:39:31.833: INFO: dns-controller-69987775c6-ntctn started at 2023-03-26 17:17:49 +0000 UTC (0+1 container statuses recorded) Mar 26 17:39:31.833: INFO: Container dns-controller ready: true, restart count 0 Mar 26 17:39:31.833: INFO: aws-cloud-controller-manager-tbxvs started at 2023-03-26 17:18:29 +0000 UTC (0+1 container statuses recorded) Mar 26 17:39:31.833: INFO: Container aws-cloud-controller-manager ready: true, restart count 0 Mar 26 17:39:31.833: INFO: calico-node-5cszq started at 2023-03-26 17:18:29 +0000 UTC (3+1 container statuses recorded) Mar 26 17:39:31.833: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 26 17:39:31.833: INFO: Init container install-cni ready: true, restart count 0 Mar 26 17:39:31.833: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 26 17:39:31.833: INFO: Container calico-node ready: true, restart count 0 Mar 26 17:39:31.833: INFO: ebs-csi-controller-79f984545f-vq8bz started at 2023-03-26 17:19:49 +0000 UTC (0+5 container statuses recorded) Mar 26 17:39:31.833: INFO: Container csi-attacher ready: true, restart count 0 Mar 26 17:39:31.833: INFO: Container csi-provisioner ready: true, restart count 0 Mar 26 17:39:31.833: INFO: Container csi-resizer ready: true, restart count 0 Mar 26 17:39:31.833: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:39:31.833: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:39:32.307: INFO: Latency metrics for node i-07cdb76b0ac2dbfa1 Mar 26 17:39:32.307: INFO: Logging node info for node i-0b2c24f535e511ae5 Mar 26 17:39:32.412: INFO: Node Info: &Node{ObjectMeta:{i-0b2c24f535e511ae5 8f866583-6b9f-42fc-932a-c5558d02f775 15630 0 2023-03-26 17:30:16 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3b kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0b2c24f535e511ae5 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3b topology.hostpath.csi/node:i-0b2c24f535e511ae5 topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-6607":"i-0b2c24f535e511ae5","ebs.csi.aws.com":"i-0b2c24f535e511ae5"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.54.135/19 projectcalico.org/IPv4IPIPTunnelAddr:100.113.179.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-03-26 17:30:16 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:30:16 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-03-26 17:30:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-03-26 17:30:17 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-03-26 17:30:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.9.0/24\"":{}}}} } {calico-node Update v1 2023-03-26 17:30:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-03-26 17:39:18 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-03-26 17:39:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.9.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3b/i-0b2c24f535e511ae5,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.9.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-26 17:30:43 +0000 UTC,LastTransitionTime:2023-03-26 17:30:43 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-26 17:39:18 +0000 UTC,LastTransitionTime:2023-03-26 17:30:16 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-26 17:39:18 +0000 UTC,LastTransitionTime:2023-03-26 17:30:16 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-26 17:39:18 +0000 UTC,LastTransitionTime:2023-03-26 17:30:16 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-26 17:39:18 +0000 UTC,LastTransitionTime:2023-03-26 17:30:34 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.54.135,},NodeAddress{Type:ExternalIP,Address:13.38.65.62,},NodeAddress{Type:InternalDNS,Address:i-0b2c24f535e511ae5.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-0b2c24f535e511ae5.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-38-65-62.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec256778270128bdfe9c2066f7fedcda,SystemUUID:ec256778-2701-28bd-fe9c-2066f7fedcda,BootID:542316ee-6bea-470f-85fc-51e338ca7e74,KernelVersion:5.15.0-1031-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0,KubeProxyVersion:v1.28.0-alpha.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/kube-proxy@sha256:8a03b3147cd7be8e8235ae1cd70cf69aca9ce03ba1cfaffea320540bb5afa496 registry.k8s.io/kube-proxy:v1.28.0-alpha.0],SizeBytes:23896850,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-6607^1dd7a607-cbfd-11ed-b816-ce0d7aed5881],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-6607^1dd7a607-cbfd-11ed-b816-ce0d7aed5881,DevicePath:,},},Config:nil,},} Mar 26 17:39:32.413: INFO: Logging kubelet events for node i-0b2c24f535e511ae5 Mar 26 17:39:32.530: INFO: Logging pods the kubelet thinks is on node i-0b2c24f535e511ae5 Mar 26 17:39:32.647: INFO: csi-hostpathplugin-0 started at 2023-03-26 17:39:08 +0000 UTC (0+7 container statuses recorded) Mar 26 17:39:32.647: INFO: Container csi-attacher ready: true, restart count 0 Mar 26 17:39:32.647: INFO: Container csi-provisioner ready: true, restart count 0 Mar 26 17:39:32.647: INFO: Container csi-resizer ready: true, restart count 0 Mar 26 17:39:32.647: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 26 17:39:32.647: INFO: Container hostpath ready: true, restart count 0 Mar 26 17:39:32.647: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:39:32.647: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:39:32.647: INFO: calico-node-rdfns started at 2023-03-26 17:30:17 +0000 UTC (3+1 container statuses recorded) Mar 26 17:39:32.647: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 26 17:39:32.647: INFO: Init container install-cni ready: true, restart count 0 Mar 26 17:39:32.647: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 26 17:39:32.647: INFO: Container calico-node ready: true, restart count 0 Mar 26 17:39:32.647: INFO: ebs-csi-node-x9jln started at 2023-03-26 17:30:17 +0000 UTC (0+3 container statuses recorded) Mar 26 17:39:32.647: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:39:32.647: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:39:32.647: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:39:32.647: INFO: simpletest.rc-pdzb8 started at 2023-03-26 17:39:14 +0000 UTC (0+1 container statuses recorded) Mar 26 17:39:32.647: INFO: Container nginx ready: true, restart count 0 Mar 26 17:39:32.647: INFO: netserver-1 started at 2023-03-26 17:39:14 +0000 UTC (0+1 container statuses recorded) Mar 26 17:39:32.647: INFO: Container webserver ready: false, restart count 0 Mar 26 17:39:32.647: INFO: busybox-3cabeb0c-3a88-4dd6-83ac-35e9a7032858 started at 2023-03-26 17:38:55 +0000 UTC (0+1 container statuses recorded) Mar 26 17:39:32.647: INFO: Container busybox ready: true, restart count 0 Mar 26 17:39:32.647: INFO: pfpod started at 2023-03-26 17:39:18 +0000 UTC (0+2 container statuses recorded) Mar 26 17:39:32.647: INFO: Container portforwardtester ready: false, restart count 0 Mar 26 17:39:32.647: INFO: Container readiness ready: false, restart count 0 Mar 26 17:39:32.647: INFO: execpodbtcns started at 2023-03-26 17:39:21 +0000 UTC (0+1 container statuses recorded) Mar 26 17:39:32.647: INFO: Container agnhost-container ready: true, restart count 0 Mar 26 17:39:32.647: INFO: inline-volume-tester-2r9s6 started at 2023-03-26 17:39:11 +0000 UTC (0+1 container statuses recorded) Mar 26 17:39:32.647: INFO: Container csi-volume-tester ready: true, restart count 0 Mar 26 17:39:32.647: INFO: hostexec-i-0b2c24f535e511ae5-5cx72 started at 2023-03-26 17:39:12 +0000 UTC (0+1 container statuses recorded) Mar 26 17:39:32.647: INFO: Container agnhost-container ready: true, restart count 0 Mar 26 17:39:32.647: INFO: kube-proxy-i-0b2c24f535e511ae5 started at 2023-03-26 17:30:17 +0000 UTC (0+1 container statuses recorded) Mar 26 17:39:32.647: INFO: Container kube-proxy ready: true, restart count 0 Mar 26 17:39:32.647: INFO: pod-subpath-test-preprovisionedpv-v9bb started at 2023-03-26 17:39:31 +0000 UTC (2+2 container statuses recorded) Mar 26 17:39:32.647: INFO: Init container init-volume-preprovisionedpv-v9bb ready: false, restart count 0 Mar 26 17:39:32.647: INFO: Init container test-init-subpath-preprovisionedpv-v9bb ready: false, restart count 0 Mar 26 17:39:32.647: INFO: Container test-container-subpath-preprovisionedpv-v9bb ready: false, restart count 0 Mar 26 17:39:32.647: INFO: Container test-container-volume-preprovisionedpv-v9bb ready: false, restart count 0 Mar 26 17:39:32.647: INFO: pod-subpath-test-configmap-bdnf started at 2023-03-26 17:39:14 +0000 UTC (1+2 container statuses recorded) Mar 26 17:39:32.647: INFO: Init container init-volume-configmap-bdnf ready: true, restart count 0 Mar 26 17:39:32.647: INFO: Container test-container-subpath-configmap-bdnf ready: true, restart count 2 Mar 26 17:39:32.647: INFO: Container test-container-volume-configmap-bdnf ready: true, restart count 0 Mar 26 17:39:32.647: INFO: pfpod started at 2023-03-26 17:38:30 +0000 UTC (0+2 container statuses recorded) Mar 26 17:39:32.647: INFO: Container portforwardtester ready: false, restart count 0 Mar 26 17:39:32.647: INFO: Container readiness ready: false, restart count 0 Mar 26 17:39:32.647: INFO: service-proxy-disabled-nfpfl started at 2023-03-26 17:39:11 +0000 UTC (0+1 container statuses recorded) Mar 26 17:39:32.647: INFO: Container service-proxy-disabled ready: true, restart count 0 Mar 26 17:39:32.647: INFO: service-proxy-toggled-97fcq started at 2023-03-26 17:39:17 +0000 UTC (0+1 container statuses recorded) Mar 26 17:39:32.647: INFO: Container service-proxy-toggled ready: true, restart count 0 Mar 26 17:39:32.647: INFO: nodeport-update-service-q97sh started at 2023-03-26 17:39:18 +0000 UTC (0+1 container statuses recorded) Mar 26 17:39:32.647: INFO: Container nodeport-update-service ready: true, restart count 0 Mar 26 17:39:33.162: INFO: Latency metrics for node i-0b2c24f535e511ae5 Mar 26 17:39:33.163: INFO: Logging node info for node i-0c64386131d9d94c5 Mar 26 17:39:33.268: INFO: Node Info: &Node{ObjectMeta:{i-0c64386131d9d94c5 6c5a59f3-69fd-488b-b94e-23777e242a7e 15213 0 2023-03-26 17:34:02 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3b kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0c64386131d9d94c5 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3b topology.hostpath.csi/node:i-0c64386131d9d94c5 topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3b] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0c64386131d9d94c5"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.63.240/19 projectcalico.org/IPv4IPIPTunnelAddr:100.122.71.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-03-26 17:34:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:34:02 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-03-26 17:34:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-03-26 17:34:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-03-26 17:34:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.10.0/24\"":{}}}} } {calico-node Update v1 2023-03-26 17:34:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2023-03-26 17:39:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.10.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3b/i-0c64386131d9d94c5,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.10.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-26 17:34:21 +0000 UTC,LastTransitionTime:2023-03-26 17:34:21 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-26 17:39:09 +0000 UTC,LastTransitionTime:2023-03-26 17:34:02 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-26 17:39:09 +0000 UTC,LastTransitionTime:2023-03-26 17:34:02 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-26 17:39:09 +0000 UTC,LastTransitionTime:2023-03-26 17:34:02 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-26 17:39:09 +0000 UTC,LastTransitionTime:2023-03-26 17:34:14 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.63.240,},NodeAddress{Type:ExternalIP,Address:15.236.210.84,},NodeAddress{Type:InternalDNS,Address:i-0c64386131d9d94c5.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-0c64386131d9d94c5.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-236-210-84.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2c2c56ef9295a859b1f844cff158e8,SystemUUID:ec2c2c56-ef92-95a8-59b1-f844cff158e8,BootID:825bc25d-7144-4ec9-8dfb-f77f9cde8c31,KernelVersion:5.15.0-1031-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0,KubeProxyVersion:v1.28.0-alpha.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/kube-proxy@sha256:8a03b3147cd7be8e8235ae1cd70cf69aca9ce03ba1cfaffea320540bb5afa496 registry.k8s.io/kube-proxy:v1.28.0-alpha.0],SizeBytes:23896850,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 26 17:39:33.268: INFO: Logging kubelet events for node i-0c64386131d9d94c5 Mar 26 17:39:33.387: INFO: Logging pods the kubelet thinks is on node i-0c64386131d9d94c5 Mar 26 17:39:33.499: INFO: simpletest.rc-p7fss started at 2023-03-26 17:39:14 +0000 UTC (0+1 container statuses recorded) Mar 26 17:39:33.499: INFO: Container nginx ready: true, restart count 0 Mar 26 17:39:33.499: INFO: annotationupdate6c12ec6a-d3c9-4897-bf41-53028a0687d2 started at 2023-03-26 17:37:28 +0000 UTC (0+1 container statuses recorded) Mar 26 17:39:33.499: INFO: Container client-container ready: true, restart count 0 Mar 26 17:39:33.499: INFO: coredns-autoscaler-7cb5c5b969-xmt8r started at 2023-03-26 17:34:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:39:33.499: INFO: Container autoscaler ready: true, restart count 0 Mar 26 17:39:33.499: INFO: kube-proxy-i-0c64386131d9d94c5 started at 2023-03-26 17:34:03 +0000 UTC (0+1 container statuses recorded) Mar 26 17:39:33.499: INFO: Container kube-proxy ready: true, restart count 0 Mar 26 17:39:33.499: INFO: pod-projected-secrets-82c3d854-d27a-439d-b60f-b167d871b490 started at 2023-03-26 17:36:25 +0000 UTC (0+3 container statuses recorded) Mar 26 17:39:33.499: INFO: Container creates-volume-test ready: true, restart count 0 Mar 26 17:39:33.499: INFO: Container dels-volume-test ready: true, restart count 0 Mar 26 17:39:33.499: INFO: Container upds-volume-test ready: true, restart count 0 Mar 26 17:39:33.499: INFO: service-proxy-disabled-nssns started at 2023-03-26 17:39:11 +0000 UTC (0+1 container statuses recorded) Mar 26 17:39:33.499: INFO: Container service-proxy-disabled ready: true, restart count 0 Mar 26 17:39:33.499: INFO: nodeport-update-service-dklgz started at 2023-03-26 17:39:18 +0000 UTC (0+1 container statuses recorded) Mar 26 17:39:33.499: INFO: Container nodeport-update-service ready: true, restart count 0 Mar 26 17:39:33.499: INFO: netserver-2 started at 2023-03-26 17:39:15 +0000 UTC (0+1 container statuses recorded) Mar 26 17:39:33.499: INFO: Container webserver ready: false, restart count 0 Mar 26 17:39:33.499: INFO: service-proxy-toggled-7trpx started at 2023-03-26 17:39:17 +0000 UTC (0+1 container statuses recorded) Mar 26 17:39:33.499: INFO: Container service-proxy-toggled ready: true, restart count 0 Mar 26 17:39:33.499: INFO: verify-service-down-host-exec-pod started at 2023-03-26 17:39:28 +0000 UTC (0+1 container statuses recorded) Mar 26 17:39:33.499: INFO: Container agnhost-container ready: true, restart count 0 Mar 26 17:39:33.499: INFO: calico-node-jl5lk started at 2023-03-26 17:34:03 +0000 UTC (3+1 container statuses recorded) Mar 26 17:39:33.499: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 26 17:39:33.499: INFO: Init container install-cni ready: true, restart count 0 Mar 26 17:39:33.499: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 26 17:39:33.499: INFO: Container calico-node ready: true, restart count 0 Mar 26 17:39:33.499: INFO: ebs-csi-node-rhk2b started at 2023-03-26 17:34:03 +0000 UTC (0+3 container statuses recorded) Mar 26 17:39:33.499: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:39:33.499: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:39:33.499: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:39:33.499: INFO: test-ss-0 started at 2023-03-26 17:37:45 +0000 UTC (0+1 container statuses recorded) Mar 26 17:39:33.499: INFO: Container webserver ready: true, restart count 0 Mar 26 17:39:33.499: INFO: concurrent-27997539-gm8qn started at 2023-03-26 17:39:00 +0000 UTC (0+1 container statuses recorded) Mar 26 17:39:33.499: INFO: Container c ready: true, restart count 0 Mar 26 17:39:33.906: INFO: Latency metrics for node i-0c64386131d9d94c5 Mar 26 17:39:33.906: INFO: Logging node info for node i-0ef04f0ca28b74fa4 Mar 26 17:39:34.012: INFO: Node Info: &Node{ObjectMeta:{i-0ef04f0ca28b74fa4 1429588e-1f3b-4a1a-98e2-600879dad0f2 14776 0 2023-03-26 17:21:49 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3b kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0ef04f0ca28b74fa4 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3b topology.hostpath.csi/node:i-0ef04f0ca28b74fa4 topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-3412":"i-0ef04f0ca28b74fa4","ebs.csi.aws.com":"i-0ef04f0ca28b74fa4"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.42.152/19 projectcalico.org/IPv4IPIPTunnelAddr:100.104.100.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-26 17:21:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:21:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:21:50 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-03-26 17:21:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-03-26 17:22:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.7.0/24\"":{}}}} } {calico-node Update v1 2023-03-26 17:22:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-03-26 17:38:03 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-03-26 17:38:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.7.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3b/i-0ef04f0ca28b74fa4,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.7.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-26 17:22:08 +0000 UTC,LastTransitionTime:2023-03-26 17:22:08 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-26 17:38:58 +0000 UTC,LastTransitionTime:2023-03-26 17:21:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-26 17:38:58 +0000 UTC,LastTransitionTime:2023-03-26 17:21:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-26 17:38:58 +0000 UTC,LastTransitionTime:2023-03-26 17:21:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-26 17:38:58 +0000 UTC,LastTransitionTime:2023-03-26 17:22:00 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.152,},NodeAddress{Type:ExternalIP,Address:35.180.133.237,},NodeAddress{Type:InternalDNS,Address:i-0ef04f0ca28b74fa4.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-0ef04f0ca28b74fa4.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-180-133-237.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2cd6131a8983e20721f6c173936bc3,SystemUUID:ec2cd613-1a89-83e2-0721-f6c173936bc3,BootID:34695e7c-23d6-4648-b207-41bcd12c2edf,KernelVersion:5.15.0-1031-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0,KubeProxyVersion:v1.28.0-alpha.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/kube-proxy@sha256:8a03b3147cd7be8e8235ae1cd70cf69aca9ce03ba1cfaffea320540bb5afa496 registry.k8s.io/kube-proxy:v1.28.0-alpha.0],SizeBytes:23896850,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-3412^f5344491-cbfc-11ed-a0e3-7eaf9c0b2d9d],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-3412^f5344491-cbfc-11ed-a0e3-7eaf9c0b2d9d,DevicePath:,},},Config:nil,},} Mar 26 17:39:34.012: INFO: Logging kubelet events for node i-0ef04f0ca28b74fa4 Mar 26 17:39:34.128: INFO: Logging pods the kubelet thinks is on node i-0ef04f0ca28b74fa4 Mar 26 17:39:34.240: INFO: kube-proxy-i-0ef04f0ca28b74fa4 started at 2023-03-26 17:21:50 +0000 UTC (0+1 container statuses recorded) Mar 26 17:39:34.240: INFO: Container kube-proxy ready: true, restart count 0 Mar 26 17:39:34.240: INFO: calico-node-bdwdr started at 2023-03-26 17:21:50 +0000 UTC (3+1 container statuses recorded) Mar 26 17:39:34.240: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 26 17:39:34.240: INFO: Init container install-cni ready: true, restart count 0 Mar 26 17:39:34.240: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 26 17:39:34.240: INFO: Container calico-node ready: true, restart count 0 Mar 26 17:39:34.240: INFO: ebs-csi-node-6wp7p started at 2023-03-26 17:21:50 +0000 UTC (0+3 container statuses recorded) Mar 26 17:39:34.240: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:39:34.240: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:39:34.240: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:39:34.240: INFO: coredns-559769c974-6mjw2 started at 2023-03-26 17:22:53 +0000 UTC (0+1 container statuses recorded) Mar 26 17:39:34.240: INFO: Container coredns ready: true, restart count 0 Mar 26 17:39:34.240: INFO: inline-volume-tester-hx76s started at 2023-03-26 17:38:03 +0000 UTC (0+1 container statuses recorded) Mar 26 17:39:34.240: INFO: Container csi-volume-tester ready: true, restart count 0 Mar 26 17:39:34.240: INFO: pod-configmaps-28775579-2d84-4eaf-8809-d932f1f3e04f started at 2023-03-26 17:36:07 +0000 UTC (0+3 container statuses recorded) Mar 26 17:39:34.240: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 26 17:39:34.240: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 26 17:39:34.240: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 26 17:39:34.240: INFO: busybox-scheduling-17194320-9516-4d95-891c-a9acb8cb4136 started at 2023-03-26 17:37:55 +0000 UTC (0+1 container statuses recorded) Mar 26 17:39:34.240: INFO: Container busybox-scheduling-17194320-9516-4d95-891c-a9acb8cb4136 ready: true, restart count 0 Mar 26 17:39:34.240: INFO: csi-hostpathplugin-0 started at 2023-03-26 17:38:00 +0000 UTC (0+7 container statuses recorded) Mar 26 17:39:34.240: INFO: Container csi-attacher ready: true, restart count 0 Mar 26 17:39:34.240: INFO: Container csi-provisioner ready: true, restart count 0 Mar 26 17:39:34.240: INFO: Container csi-resizer ready: true, restart count 0 Mar 26 17:39:34.240: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 26 17:39:34.240: INFO: Container hostpath ready: true, restart count 0 Mar 26 17:39:34.240: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:39:34.240: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:39:34.240: INFO: netserver-3 started at 2023-03-26 17:39:15 +0000 UTC (0+1 container statuses recorded) Mar 26 17:39:34.240: INFO: Container webserver ready: true, restart count 0 Mar 26 17:39:34.240: INFO: service-proxy-toggled-5ktng started at 2023-03-26 17:39:17 +0000 UTC (0+1 container statuses recorded) Mar 26 17:39:34.240: INFO: Container service-proxy-toggled ready: true, restart count 0 Mar 26 17:39:34.650: INFO: Latency metrics for node i-0ef04f0ca28b74fa4 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/26/23 17:39:34.65 (4.243s) < Exit [DeferCleanup (Each)] [Testpattern: Dynamic PV (ext4)] volumes - dump namespaces | framework.go:209 @ 03/26/23 17:39:34.65 (4.243s) > Enter [DeferCleanup (Each)] [Testpattern: Dynamic PV (ext4)] volumes - tear down framework | framework.go:206 @ 03/26/23 17:39:34.65 STEP: Destroying namespace "volume-4590" for this suite. - test/e2e/framework/framework.go:351 @ 03/26/23 17:39:34.65 < Exit [DeferCleanup (Each)] [Testpattern: Dynamic PV (ext4)] volumes - tear down framework | framework.go:206 @ 03/26/23 17:39:34.757 (107ms) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/26/23 17:39:34.757 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/26/23 17:39:34.757 (0s)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-auth\]\sServiceAccounts\sServiceAccountIssuerDiscovery\sshould\ssupport\sOIDC\sdiscovery\sof\sservice\saccount\sissuer\s\[Conformance\]$'
[FAILED] Unexpected error getting pod logs: timed out waiting for the condition In [It] at: test/e2e/auth/service_accounts.go:630 @ 03/26/23 17:50:00.7from junit_01.xml
> Enter [BeforeEach] [sig-auth] ServiceAccounts - set up framework | framework.go:191 @ 03/26/23 17:47:55.013 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/26/23 17:47:55.013 Mar 26 17:47:55.013: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename svcaccounts - test/e2e/framework/framework.go:250 @ 03/26/23 17:47:55.014 STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 03/26/23 17:47:55.329 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:262 @ 03/26/23 17:47:55.535 < Exit [BeforeEach] [sig-auth] ServiceAccounts - set up framework | framework.go:191 @ 03/26/23 17:47:55.742 (729ms) > Enter [BeforeEach] [sig-auth] ServiceAccounts - test/e2e/framework/metrics/init/init.go:33 @ 03/26/23 17:47:55.742 < Exit [BeforeEach] [sig-auth] ServiceAccounts - test/e2e/framework/metrics/init/init.go:33 @ 03/26/23 17:47:55.742 (0s) > Enter [It] ServiceAccountIssuerDiscovery should support OIDC discovery of service account issuer [Conformance] - test/e2e/auth/service_accounts.go:529 @ 03/26/23 17:47:55.742 Mar 26 17:47:55.954: INFO: created pod STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/26/23 17:48:00.271 Mar 26 17:48:30.271: INFO: polling logs Mar 26 17:48:30.385: INFO: Error pulling logs: Get "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/svcaccounts-5472/pods/oidc-discovery-validator/log?container=oidc-discovery-validator&previous=false": stream error: stream ID 1557; INTERNAL_ERROR; received from peer Mar 26 17:49:00.272: INFO: polling logs Mar 26 17:49:00.385: INFO: Error pulling logs: Get "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/svcaccounts-5472/pods/oidc-discovery-validator/log?container=oidc-discovery-validator&previous=false": stream error: stream ID 1559; INTERNAL_ERROR; received from peer Mar 26 17:49:30.272: INFO: polling logs Mar 26 17:49:30.376: INFO: Error pulling logs: Get "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/svcaccounts-5472/pods/oidc-discovery-validator/log?container=oidc-discovery-validator&previous=false": stream error: stream ID 1561; INTERNAL_ERROR; received from peer Mar 26 17:50:00.271: INFO: polling logs Mar 26 17:50:00.392: INFO: Error pulling logs: Get "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/svcaccounts-5472/pods/oidc-discovery-validator/log?container=oidc-discovery-validator&previous=false": stream error: stream ID 1563; INTERNAL_ERROR; received from peer Mar 26 17:50:00.392: INFO: polling logs Mar 26 17:50:00.513: INFO: Error pulling logs: Get "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/svcaccounts-5472/pods/oidc-discovery-validator/log?container=oidc-discovery-validator&previous=false": stream error: stream ID 1565; INTERNAL_ERROR; received from peer [FAILED] Unexpected error getting pod logs: timed out waiting for the condition In [It] at: test/e2e/auth/service_accounts.go:630 @ 03/26/23 17:50:00.7 < Exit [It] ServiceAccountIssuerDiscovery should support OIDC discovery of service account issuer [Conformance] - test/e2e/auth/service_accounts.go:529 @ 03/26/23 17:50:00.7 (2m4.958s) > Enter [AfterEach] [sig-auth] ServiceAccounts - test/e2e/framework/node/init/init.go:33 @ 03/26/23 17:50:00.7 Mar 26 17:50:00.700: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-auth] ServiceAccounts - test/e2e/framework/node/init/init.go:33 @ 03/26/23 17:50:00.814 (114ms) > Enter [DeferCleanup (Each)] [sig-auth] ServiceAccounts - test/e2e/framework/metrics/init/init.go:35 @ 03/26/23 17:50:00.814 < Exit [DeferCleanup (Each)] [sig-auth] ServiceAccounts - test/e2e/framework/metrics/init/init.go:35 @ 03/26/23 17:50:00.814 (0s) > Enter [DeferCleanup (Each)] [sig-auth] ServiceAccounts - dump namespaces | framework.go:209 @ 03/26/23 17:50:00.814 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/26/23 17:50:00.814 STEP: Collecting events from namespace "svcaccounts-5472". - test/e2e/framework/debug/dump.go:42 @ 03/26/23 17:50:00.814 STEP: Found 4 events. - test/e2e/framework/debug/dump.go:46 @ 03/26/23 17:50:01.031 Mar 26 17:50:01.031: INFO: At 2023-03-26 17:47:55 +0000 UTC - event for oidc-discovery-validator: {default-scheduler } Scheduled: Successfully assigned svcaccounts-5472/oidc-discovery-validator to i-0c64386131d9d94c5 Mar 26 17:50:01.031: INFO: At 2023-03-26 17:47:56 +0000 UTC - event for oidc-discovery-validator: {kubelet i-0c64386131d9d94c5} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 26 17:50:01.031: INFO: At 2023-03-26 17:47:56 +0000 UTC - event for oidc-discovery-validator: {kubelet i-0c64386131d9d94c5} Created: Created container oidc-discovery-validator Mar 26 17:50:01.031: INFO: At 2023-03-26 17:47:56 +0000 UTC - event for oidc-discovery-validator: {kubelet i-0c64386131d9d94c5} Started: Started container oidc-discovery-validator Mar 26 17:50:01.134: INFO: POD NODE PHASE GRACE CONDITIONS Mar 26 17:50:01.134: INFO: oidc-discovery-validator i-0c64386131d9d94c5 Succeeded [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-26 17:47:55 +0000 UTC PodCompleted } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-03-26 17:47:55 +0000 UTC PodCompleted } {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-03-26 17:47:55 +0000 UTC PodCompleted } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-26 17:47:55 +0000 UTC }] Mar 26 17:50:01.135: INFO: Mar 26 17:50:01.251: INFO: Unable to fetch svcaccounts-5472/oidc-discovery-validator/oidc-discovery-validator logs: Get "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/svcaccounts-5472/pods/oidc-discovery-validator/log?container=oidc-discovery-validator&previous=false&tailLines=42": stream error: stream ID 1575; INTERNAL_ERROR; received from peer Mar 26 17:50:01.373: INFO: Logging node info for node i-011576d1f2b6be6ec Mar 26 17:50:01.515: INFO: Node Info: &Node{ObjectMeta:{i-011576d1f2b6be6ec ef4bb85b-7188-4ef2-8d1a-583f0fcc379a 47178 0 2023-03-26 17:26:11 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3b kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-011576d1f2b6be6ec kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3b topology.hostpath.csi/node:i-011576d1f2b6be6ec topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3b] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-011576d1f2b6be6ec"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.41.235/19 projectcalico.org/IPv4IPIPTunnelAddr:100.127.173.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-03-26 17:26:11 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:26:11 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-03-26 17:26:11 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-03-26 17:26:12 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-03-26 17:26:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.8.0/24\"":{}}}} } {calico-node Update v1 2023-03-26 17:26:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2023-03-26 17:49:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {e2e.test Update v1 2023-03-26 17:49:58 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.8.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3b/i-011576d1f2b6be6ec,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.8.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-26 17:26:30 +0000 UTC,LastTransitionTime:2023-03-26 17:26:30 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-26 17:49:51 +0000 UTC,LastTransitionTime:2023-03-26 17:26:11 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-26 17:49:51 +0000 UTC,LastTransitionTime:2023-03-26 17:26:11 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-26 17:49:51 +0000 UTC,LastTransitionTime:2023-03-26 17:26:11 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-26 17:49:51 +0000 UTC,LastTransitionTime:2023-03-26 17:26:23 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.41.235,},NodeAddress{Type:ExternalIP,Address:35.180.45.101,},NodeAddress{Type:InternalDNS,Address:i-011576d1f2b6be6ec.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-011576d1f2b6be6ec.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-180-45-101.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec26cc6e198da1950569e38fb3a7f618,SystemUUID:ec26cc6e-198d-a195-0569-e38fb3a7f618,BootID:b67057d3-2187-4008-9056-8a843d3c6813,KernelVersion:5.15.0-1031-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0,KubeProxyVersion:v1.28.0-alpha.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/kube-proxy@sha256:8a03b3147cd7be8e8235ae1cd70cf69aca9ce03ba1cfaffea320540bb5afa496 registry.k8s.io/kube-proxy:v1.28.0-alpha.0],SizeBytes:23896850,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0e373abdf528ecc3c],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 26 17:50:01.515: INFO: Logging kubelet events for node i-011576d1f2b6be6ec Mar 26 17:50:01.661: INFO: Logging pods the kubelet thinks is on node i-011576d1f2b6be6ec Mar 26 17:50:01.845: INFO: pvc-volume-tester-writer-ljw9g started at 2023-03-26 17:49:44 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:01.845: INFO: Container volume-tester ready: false, restart count 0 Mar 26 17:50:01.845: INFO: rs-jxbhs started at 2023-03-26 17:49:41 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:01.845: INFO: Container donothing ready: false, restart count 0 Mar 26 17:50:01.845: INFO: test-webserver-92411cc0-0b71-40eb-97e5-02e1650f1b5f started at 2023-03-26 17:49:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:01.845: INFO: Container test-webserver ready: false, restart count 0 Mar 26 17:50:01.845: INFO: hostexec-i-011576d1f2b6be6ec-qptq7 started at 2023-03-26 17:49:56 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:01.845: INFO: Container agnhost-container ready: true, restart count 0 Mar 26 17:50:01.845: INFO: cleanup40-f947c08a-deed-4b24-899e-90108c36ea94-f9hp4 started at 2023-03-26 17:49:59 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:01.845: INFO: Container cleanup40-f947c08a-deed-4b24-899e-90108c36ea94 ready: false, restart count 0 Mar 26 17:50:01.845: INFO: cleanup40-f947c08a-deed-4b24-899e-90108c36ea94-mvxls started at 2023-03-26 17:49:59 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:01.845: INFO: Container cleanup40-f947c08a-deed-4b24-899e-90108c36ea94 ready: false, restart count 0 Mar 26 17:50:01.845: INFO: cleanup40-f947c08a-deed-4b24-899e-90108c36ea94-8h9ch started at 2023-03-26 17:49:59 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:01.845: INFO: Container cleanup40-f947c08a-deed-4b24-899e-90108c36ea94 ready: false, restart count 0 Mar 26 17:50:01.845: INFO: cleanup40-f947c08a-deed-4b24-899e-90108c36ea94-kcblb started at 2023-03-26 17:50:00 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:01.845: INFO: Container cleanup40-f947c08a-deed-4b24-899e-90108c36ea94 ready: false, restart count 0 Mar 26 17:50:01.845: INFO: ebs-csi-node-7dqmm started at 2023-03-26 17:26:12 +0000 UTC (0+3 container statuses recorded) Mar 26 17:50:01.845: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:50:01.845: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:50:01.845: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:50:01.845: INFO: coredns-559769c974-58thj started at 2023-03-26 17:34:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:01.845: INFO: Container coredns ready: true, restart count 0 Mar 26 17:50:01.845: INFO: successful-jobs-history-limit-27997549-mz2g9 started at 2023-03-26 17:49:00 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:01.845: INFO: Container c ready: false, restart count 0 Mar 26 17:50:01.845: INFO: cleanup40-f947c08a-deed-4b24-899e-90108c36ea94-m7wsk started at 2023-03-26 17:49:59 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:01.845: INFO: Container cleanup40-f947c08a-deed-4b24-899e-90108c36ea94 ready: false, restart count 0 Mar 26 17:50:01.845: INFO: pod-client started at 2023-03-26 17:49:48 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:01.845: INFO: Container pod-client ready: true, restart count 0 Mar 26 17:50:01.845: INFO: kube-proxy-i-011576d1f2b6be6ec started at 2023-03-26 17:26:12 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:01.845: INFO: Container kube-proxy ready: true, restart count 0 Mar 26 17:50:01.845: INFO: calico-node-tmjhr started at 2023-03-26 17:26:12 +0000 UTC (3+1 container statuses recorded) Mar 26 17:50:01.845: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 26 17:50:01.845: INFO: Init container install-cni ready: true, restart count 0 Mar 26 17:50:01.845: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 26 17:50:01.845: INFO: Container calico-node ready: true, restart count 0 Mar 26 17:50:01.845: INFO: cleanup40-f947c08a-deed-4b24-899e-90108c36ea94-gxb9p started at 2023-03-26 17:49:59 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:01.845: INFO: Container cleanup40-f947c08a-deed-4b24-899e-90108c36ea94 ready: false, restart count 0 Mar 26 17:50:01.845: INFO: cleanup40-f947c08a-deed-4b24-899e-90108c36ea94-dsllq started at 2023-03-26 17:50:00 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:01.845: INFO: Container cleanup40-f947c08a-deed-4b24-899e-90108c36ea94 ready: false, restart count 0 Mar 26 17:50:01.845: INFO: pause-pod-1 started at 2023-03-26 17:49:41 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:01.845: INFO: Container agnhost-container ready: true, restart count 0 Mar 26 17:50:01.845: INFO: cleanup40-f947c08a-deed-4b24-899e-90108c36ea94-plzm5 started at 2023-03-26 17:49:59 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:01.845: INFO: Container cleanup40-f947c08a-deed-4b24-899e-90108c36ea94 ready: false, restart count 0 Mar 26 17:50:01.845: INFO: cleanup40-f947c08a-deed-4b24-899e-90108c36ea94-vhzhz started at 2023-03-26 17:49:59 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:01.845: INFO: Container cleanup40-f947c08a-deed-4b24-899e-90108c36ea94 ready: false, restart count 0 Mar 26 17:50:01.845: INFO: cleanup40-f947c08a-deed-4b24-899e-90108c36ea94-996b9 started at 2023-03-26 17:49:59 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:01.845: INFO: Container cleanup40-f947c08a-deed-4b24-899e-90108c36ea94 ready: false, restart count 0 Mar 26 17:50:02.563: INFO: Latency metrics for node i-011576d1f2b6be6ec Mar 26 17:50:02.563: INFO: Logging node info for node i-07cdb76b0ac2dbfa1 Mar 26 17:50:02.668: INFO: Node Info: &Node{ObjectMeta:{i-07cdb76b0ac2dbfa1 d3bcec50-934c-432e-a590-2a35577f3a0d 35692 0 2023-03-26 17:17:19 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3b kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-07cdb76b0ac2dbfa1 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:eu-west-3b topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3b] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-07cdb76b0ac2dbfa1"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.63.230/19 projectcalico.org/IPv4IPIPTunnelAddr:100.127.118.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-26 17:17:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-03-26 17:17:20 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {calico-node Update v1 2023-03-26 17:18:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {aws-cloud-controller-manager Update v1 2023-03-26 17:18:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:18:48 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-03-26 17:18:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.5.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-03-26 17:46:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.5.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3b/i-07cdb76b0ac2dbfa1,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.5.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892301824 0} {<nil>} 3801076Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787444224 0} {<nil>} 3698676Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-26 17:18:46 +0000 UTC,LastTransitionTime:2023-03-26 17:18:46 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-26 17:46:03 +0000 UTC,LastTransitionTime:2023-03-26 17:17:19 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-26 17:46:03 +0000 UTC,LastTransitionTime:2023-03-26 17:17:19 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-26 17:46:03 +0000 UTC,LastTransitionTime:2023-03-26 17:17:19 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-26 17:46:03 +0000 UTC,LastTransitionTime:2023-03-26 17:18:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.63.230,},NodeAddress{Type:ExternalIP,Address:15.237.44.201,},NodeAddress{Type:InternalDNS,Address:i-07cdb76b0ac2dbfa1.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-07cdb76b0ac2dbfa1.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-237-44-201.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2824f976de88ff768c75c0d62c774f,SystemUUID:ec2824f9-76de-88ff-768c-75c0d62c774f,BootID:bc1e3e86-fc91-4be5-acba-90ac2a46faf2,KernelVersion:5.15.0-1031-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0,KubeProxyVersion:v1.28.0-alpha.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 registry.k8s.io/etcd:3.4.3-0],SizeBytes:100947667,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:9ce33ba33d8e738a5b85ed50b5080ac746deceed4a7496c550927a7a19ca3b6d registry.k8s.io/etcd:3.5.0-0],SizeBytes:99868722,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 registry.k8s.io/etcd:3.5.1-0],SizeBytes:98888614,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 registry.k8s.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:0d2ab6b15b4fe0b903b9e81192d942fb39c29be61fe341cd16db5d0165b0435c registry.k8s.io/etcd:3.3.17-0],SizeBytes:85524408,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:17da501f5d2a675be46040422a27b7cc21b8a43895ac998b171db1c346f361f7 registry.k8s.io/etcd:3.3.10-0],SizeBytes:76162358,},ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager-slim@sha256:8727adc059334e0e3329dbccce116a734da4a090da5e86c8cddccaf333caa666 registry.k8s.io/etcdadm/etcd-manager-slim:v3.0.20230201],SizeBytes:63926165,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:905d7ca17fd02bc24c0eba9a062753aba15db3e31422390bc3238eb762339b20 registry.k8s.io/etcd:3.2.24-1],SizeBytes:63423287,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:45208814,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:43629015,},ContainerImage{Names:[registry.k8s.io/kube-apiserver@sha256:49934a29c559e79ed19fc38b4697b18d8fe174b17bf56192588575f980c93956 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0],SizeBytes:33212506,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:2b6acd7f677f76ffe12ecf3ea7df92eb9b1bdb07336d1ac2a54c7631fb753f7e docker.io/calico/kube-controllers:v3.24.5],SizeBytes:31137169,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager@sha256:974748384634982c73527fdb3c9ec0ec476bc0d52b3dd1d611a380b7f99af1f3 registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0],SizeBytes:30820280,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/kube-proxy@sha256:8a03b3147cd7be8e8235ae1cd70cf69aca9ce03ba1cfaffea320540bb5afa496 registry.k8s.io/kube-proxy:v1.28.0-alpha.0],SizeBytes:23896850,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/kube-scheduler@sha256:cbf4007abb076188f16b975bc2b74452603cc7b34c60a29d92f14c38ad02dc11 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0],SizeBytes:18078674,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:5074723,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 26 17:50:02.669: INFO: Logging kubelet events for node i-07cdb76b0ac2dbfa1 Mar 26 17:50:02.855: INFO: Logging pods the kubelet thinks is on node i-07cdb76b0ac2dbfa1 Mar 26 17:50:03.023: INFO: kube-proxy-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:03.023: INFO: Container kube-proxy ready: true, restart count 0 Mar 26 17:50:03.023: INFO: kube-scheduler-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:03.023: INFO: Container kube-scheduler ready: true, restart count 0 Mar 26 17:50:03.023: INFO: etcd-manager-events-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (11+1 container statuses recorded) Mar 26 17:50:03.023: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0 Mar 26 17:50:03.023: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0 Mar 26 17:50:03.023: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0 Mar 26 17:50:03.023: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0 Mar 26 17:50:03.023: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0 Mar 26 17:50:03.023: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0 Mar 26 17:50:03.023: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0 Mar 26 17:50:03.023: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0 Mar 26 17:50:03.023: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0 Mar 26 17:50:03.023: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0 Mar 26 17:50:03.023: INFO: Init container init-etcd-3-5-7 ready: true, restart count 0 Mar 26 17:50:03.023: INFO: Container etcd-manager ready: true, restart count 0 Mar 26 17:50:03.023: INFO: etcd-manager-main-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (11+1 container statuses recorded) Mar 26 17:50:03.023: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0 Mar 26 17:50:03.023: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0 Mar 26 17:50:03.023: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0 Mar 26 17:50:03.023: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0 Mar 26 17:50:03.023: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0 Mar 26 17:50:03.023: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0 Mar 26 17:50:03.023: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0 Mar 26 17:50:03.023: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0 Mar 26 17:50:03.023: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0 Mar 26 17:50:03.023: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0 Mar 26 17:50:03.023: INFO: Init container init-etcd-3-5-7 ready: true, restart count 0 Mar 26 17:50:03.023: INFO: Container etcd-manager ready: true, restart count 0 Mar 26 17:50:03.023: INFO: kube-apiserver-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (0+2 container statuses recorded) Mar 26 17:50:03.023: INFO: Container healthcheck ready: true, restart count 0 Mar 26 17:50:03.023: INFO: Container kube-apiserver ready: true, restart count 2 Mar 26 17:50:03.023: INFO: ebs-csi-node-2r7mc started at 2023-03-26 17:18:29 +0000 UTC (0+3 container statuses recorded) Mar 26 17:50:03.023: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:50:03.023: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:50:03.023: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:50:03.023: INFO: kops-controller-thh8s started at 2023-03-26 17:18:29 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:03.023: INFO: Container kops-controller ready: true, restart count 0 Mar 26 17:50:03.023: INFO: kube-controller-manager-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:03.023: INFO: Container kube-controller-manager ready: true, restart count 4 Mar 26 17:50:03.023: INFO: calico-kube-controllers-55f488656-mjjr8 started at 2023-03-26 17:18:51 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:03.023: INFO: Container calico-kube-controllers ready: true, restart count 0 Mar 26 17:50:03.023: INFO: aws-cloud-controller-manager-tbxvs started at 2023-03-26 17:18:29 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:03.023: INFO: Container aws-cloud-controller-manager ready: true, restart count 0 Mar 26 17:50:03.023: INFO: calico-node-5cszq started at 2023-03-26 17:18:29 +0000 UTC (3+1 container statuses recorded) Mar 26 17:50:03.023: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 26 17:50:03.023: INFO: Init container install-cni ready: true, restart count 0 Mar 26 17:50:03.023: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 26 17:50:03.023: INFO: Container calico-node ready: true, restart count 0 Mar 26 17:50:03.023: INFO: ebs-csi-controller-79f984545f-vq8bz started at 2023-03-26 17:19:49 +0000 UTC (0+5 container statuses recorded) Mar 26 17:50:03.023: INFO: Container csi-attacher ready: true, restart count 0 Mar 26 17:50:03.023: INFO: Container csi-provisioner ready: true, restart count 0 Mar 26 17:50:03.023: INFO: Container csi-resizer ready: true, restart count 0 Mar 26 17:50:03.023: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:50:03.023: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:50:03.023: INFO: dns-controller-69987775c6-ntctn started at 2023-03-26 17:17:49 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:03.023: INFO: Container dns-controller ready: true, restart count 0 Mar 26 17:50:03.690: INFO: Latency metrics for node i-07cdb76b0ac2dbfa1 Mar 26 17:50:03.690: INFO: Logging node info for node i-0b2c24f535e511ae5 Mar 26 17:50:03.816: INFO: Node Info: &Node{ObjectMeta:{i-0b2c24f535e511ae5 8f866583-6b9f-42fc-932a-c5558d02f775 47180 0 2023-03-26 17:30:16 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3b kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0b2c24f535e511ae5 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3b topology.hostpath.csi/node:i-0b2c24f535e511ae5 topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3b] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0b2c24f535e511ae5"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.54.135/19 projectcalico.org/IPv4IPIPTunnelAddr:100.113.179.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-03-26 17:30:16 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:30:16 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-03-26 17:30:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-03-26 17:30:17 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-03-26 17:30:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.9.0/24\"":{}}}} } {calico-node Update v1 2023-03-26 17:30:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-03-26 17:49:11 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-03-26 17:49:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {e2e.test Update v1 2023-03-26 17:49:58 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.9.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3b/i-0b2c24f535e511ae5,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.9.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-26 17:30:43 +0000 UTC,LastTransitionTime:2023-03-26 17:30:43 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-26 17:49:11 +0000 UTC,LastTransitionTime:2023-03-26 17:30:16 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-26 17:49:11 +0000 UTC,LastTransitionTime:2023-03-26 17:30:16 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-26 17:49:11 +0000 UTC,LastTransitionTime:2023-03-26 17:30:16 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-26 17:49:11 +0000 UTC,LastTransitionTime:2023-03-26 17:30:34 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.54.135,},NodeAddress{Type:ExternalIP,Address:13.38.65.62,},NodeAddress{Type:InternalDNS,Address:i-0b2c24f535e511ae5.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-0b2c24f535e511ae5.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-38-65-62.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec256778270128bdfe9c2066f7fedcda,SystemUUID:ec256778-2701-28bd-fe9c-2066f7fedcda,BootID:542316ee-6bea-470f-85fc-51e338ca7e74,KernelVersion:5.15.0-1031-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0,KubeProxyVersion:v1.28.0-alpha.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/kube-proxy@sha256:8a03b3147cd7be8e8235ae1cd70cf69aca9ce03ba1cfaffea320540bb5afa496 registry.k8s.io/kube-proxy:v1.28.0-alpha.0],SizeBytes:23896850,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0665c812bdcd06696],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0665c812bdcd06696,DevicePath:,},},Config:nil,},} Mar 26 17:50:03.816: INFO: Logging kubelet events for node i-0b2c24f535e511ae5 Mar 26 17:50:03.954: INFO: Logging pods the kubelet thinks is on node i-0b2c24f535e511ae5 Mar 26 17:50:04.111: INFO: calico-node-rdfns started at 2023-03-26 17:30:17 +0000 UTC (3+1 container statuses recorded) Mar 26 17:50:04.111: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 26 17:50:04.111: INFO: Init container install-cni ready: true, restart count 0 Mar 26 17:50:04.111: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 26 17:50:04.111: INFO: Container calico-node ready: true, restart count 0 Mar 26 17:50:04.111: INFO: ebs-csi-node-x9jln started at 2023-03-26 17:30:17 +0000 UTC (0+3 container statuses recorded) Mar 26 17:50:04.111: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:50:04.111: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:50:04.111: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:50:04.111: INFO: successful-jobs-history-limit-27997550-tk4dx started at 2023-03-26 17:50:00 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:04.111: INFO: Container c ready: false, restart count 0 Mar 26 17:50:04.111: INFO: inline-volume-tester-bdvjj started at 2023-03-26 17:48:53 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:04.111: INFO: Container csi-volume-tester ready: true, restart count 0 Mar 26 17:50:04.111: INFO: cleanup40-f947c08a-deed-4b24-899e-90108c36ea94-dwm42 started at 2023-03-26 17:49:59 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:04.111: INFO: Container cleanup40-f947c08a-deed-4b24-899e-90108c36ea94 ready: false, restart count 0 Mar 26 17:50:04.111: INFO: cleanup40-f947c08a-deed-4b24-899e-90108c36ea94-gvrd4 started at 2023-03-26 17:49:59 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:04.111: INFO: Container cleanup40-f947c08a-deed-4b24-899e-90108c36ea94 ready: false, restart count 0 Mar 26 17:50:04.111: INFO: hostexec-i-0b2c24f535e511ae5-j28bc started at 2023-03-26 17:50:03 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:04.111: INFO: Container agnhost-container ready: false, restart count 0 Mar 26 17:50:04.111: INFO: cleanup40-f947c08a-deed-4b24-899e-90108c36ea94-bpcpv started at 2023-03-26 17:49:59 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:04.111: INFO: Container cleanup40-f947c08a-deed-4b24-899e-90108c36ea94 ready: false, restart count 0 Mar 26 17:50:04.111: INFO: webserver-pod started at 2023-03-26 17:49:38 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:04.111: INFO: Container agnhost ready: true, restart count 0 Mar 26 17:50:04.111: INFO: cleanup40-f947c08a-deed-4b24-899e-90108c36ea94-tcj4x started at 2023-03-26 17:49:59 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:04.111: INFO: Container cleanup40-f947c08a-deed-4b24-899e-90108c36ea94 ready: false, restart count 0 Mar 26 17:50:04.111: INFO: kube-proxy-i-0b2c24f535e511ae5 started at 2023-03-26 17:30:17 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:04.111: INFO: Container kube-proxy ready: true, restart count 0 Mar 26 17:50:04.111: INFO: cleanup40-f947c08a-deed-4b24-899e-90108c36ea94-mdk45 started at 2023-03-26 17:49:59 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:04.111: INFO: Container cleanup40-f947c08a-deed-4b24-899e-90108c36ea94 ready: false, restart count 0 Mar 26 17:50:04.111: INFO: cleanup40-f947c08a-deed-4b24-899e-90108c36ea94-7qhdd started at 2023-03-26 17:49:59 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:04.111: INFO: Container cleanup40-f947c08a-deed-4b24-899e-90108c36ea94 ready: false, restart count 0 Mar 26 17:50:04.111: INFO: cleanup40-f947c08a-deed-4b24-899e-90108c36ea94-jtkl7 started at 2023-03-26 17:49:59 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:04.111: INFO: Container cleanup40-f947c08a-deed-4b24-899e-90108c36ea94 ready: false, restart count 0 Mar 26 17:50:04.111: INFO: local-injector started at 2023-03-26 17:50:01 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:04.111: INFO: Container local-injector ready: false, restart count 0 Mar 26 17:50:04.111: INFO: hostexec-i-0b2c24f535e511ae5-9gkbc started at 2023-03-26 17:49:53 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:04.111: INFO: Container agnhost-container ready: true, restart count 0 Mar 26 17:50:04.111: INFO: cleanup40-f947c08a-deed-4b24-899e-90108c36ea94-mrx8c started at 2023-03-26 17:49:59 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:04.111: INFO: Container cleanup40-f947c08a-deed-4b24-899e-90108c36ea94 ready: false, restart count 0 Mar 26 17:50:04.111: INFO: cleanup40-f947c08a-deed-4b24-899e-90108c36ea94-n5dkc started at 2023-03-26 17:49:59 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:04.111: INFO: Container cleanup40-f947c08a-deed-4b24-899e-90108c36ea94 ready: false, restart count 0 Mar 26 17:50:04.111: INFO: cleanup40-f947c08a-deed-4b24-899e-90108c36ea94-fq957 started at 2023-03-26 17:49:59 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:04.111: INFO: Container cleanup40-f947c08a-deed-4b24-899e-90108c36ea94 ready: false, restart count 0 Mar 26 17:50:04.862: INFO: Latency metrics for node i-0b2c24f535e511ae5 Mar 26 17:50:04.862: INFO: Logging node info for node i-0c64386131d9d94c5 Mar 26 17:50:04.973: INFO: Node Info: &Node{ObjectMeta:{i-0c64386131d9d94c5 6c5a59f3-69fd-488b-b94e-23777e242a7e 47537 0 2023-03-26 17:34:02 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3b kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0c64386131d9d94c5 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3b topology.hostpath.csi/node:i-0c64386131d9d94c5 topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3b] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0c64386131d9d94c5"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.63.240/19 projectcalico.org/IPv4IPIPTunnelAddr:100.122.71.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-03-26 17:34:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:34:02 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-03-26 17:34:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-03-26 17:34:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-03-26 17:34:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.10.0/24\"":{}}}} } {calico-node Update v1 2023-03-26 17:34:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {e2e.test Update v1 2023-03-26 17:49:58 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-03-26 17:50:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.10.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3b/i-0c64386131d9d94c5,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.10.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-26 17:34:21 +0000 UTC,LastTransitionTime:2023-03-26 17:34:21 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-26 17:49:54 +0000 UTC,LastTransitionTime:2023-03-26 17:34:02 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-26 17:49:54 +0000 UTC,LastTransitionTime:2023-03-26 17:34:02 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-26 17:49:54 +0000 UTC,LastTransitionTime:2023-03-26 17:34:02 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-26 17:49:54 +0000 UTC,LastTransitionTime:2023-03-26 17:34:14 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.63.240,},NodeAddress{Type:ExternalIP,Address:15.236.210.84,},NodeAddress{Type:InternalDNS,Address:i-0c64386131d9d94c5.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-0c64386131d9d94c5.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-236-210-84.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2c2c56ef9295a859b1f844cff158e8,SystemUUID:ec2c2c56-ef92-95a8-59b1-f844cff158e8,BootID:825bc25d-7144-4ec9-8dfb-f77f9cde8c31,KernelVersion:5.15.0-1031-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0,KubeProxyVersion:v1.28.0-alpha.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/kube-proxy@sha256:8a03b3147cd7be8e8235ae1cd70cf69aca9ce03ba1cfaffea320540bb5afa496 registry.k8s.io/kube-proxy:v1.28.0-alpha.0],SizeBytes:23896850,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:13ac9b3c476d7290a4451d65d09d6016a2cb89836ffbfa4eae55b72731a22080 registry.k8s.io/build-image/distroless-iptables:v0.2.2],SizeBytes:7729580,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 26 17:50:04.973: INFO: Logging kubelet events for node i-0c64386131d9d94c5 Mar 26 17:50:05.089: INFO: Logging pods the kubelet thinks is on node i-0c64386131d9d94c5 Mar 26 17:50:05.200: INFO: cleanup40-f947c08a-deed-4b24-899e-90108c36ea94-5k572 started at 2023-03-26 17:49:59 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:05.200: INFO: Container cleanup40-f947c08a-deed-4b24-899e-90108c36ea94 ready: true, restart count 0 Mar 26 17:50:05.200: INFO: oidc-discovery-validator started at 2023-03-26 17:47:55 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:05.200: INFO: Container oidc-discovery-validator ready: false, restart count 0 Mar 26 17:50:05.200: INFO: cleanup40-f947c08a-deed-4b24-899e-90108c36ea94-7w6z8 started at 2023-03-26 17:49:59 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:05.200: INFO: Container cleanup40-f947c08a-deed-4b24-899e-90108c36ea94 ready: true, restart count 0 Mar 26 17:50:05.200: INFO: coredns-autoscaler-7cb5c5b969-xmt8r started at 2023-03-26 17:34:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:05.200: INFO: Container autoscaler ready: true, restart count 0 Mar 26 17:50:05.200: INFO: rs-5jvpt started at 2023-03-26 17:48:18 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:05.200: INFO: Container donothing ready: false, restart count 0 Mar 26 17:50:05.200: INFO: pod-configmaps-e4425615-b256-4189-985c-8306c3807212 started at 2023-03-26 17:47:15 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:05.200: INFO: Container agnhost-container ready: true, restart count 0 Mar 26 17:50:05.200: INFO: cleanup40-f947c08a-deed-4b24-899e-90108c36ea94-pfs5g started at 2023-03-26 17:49:59 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:05.200: INFO: Container cleanup40-f947c08a-deed-4b24-899e-90108c36ea94 ready: true, restart count 0 Mar 26 17:50:05.200: INFO: cleanup40-f947c08a-deed-4b24-899e-90108c36ea94-zrjpl started at 2023-03-26 17:49:59 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:05.200: INFO: Container cleanup40-f947c08a-deed-4b24-899e-90108c36ea94 ready: true, restart count 0 Mar 26 17:50:05.200: INFO: cleanup40-f947c08a-deed-4b24-899e-90108c36ea94-j6ngg started at 2023-03-26 17:49:59 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:05.200: INFO: Container cleanup40-f947c08a-deed-4b24-899e-90108c36ea94 ready: true, restart count 0 Mar 26 17:50:05.200: INFO: cleanup40-f947c08a-deed-4b24-899e-90108c36ea94-652zh started at 2023-03-26 17:49:59 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:05.200: INFO: Container cleanup40-f947c08a-deed-4b24-899e-90108c36ea94 ready: true, restart count 0 Mar 26 17:50:05.200: INFO: cleanup40-f947c08a-deed-4b24-899e-90108c36ea94-dngz7 started at 2023-03-26 17:49:59 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:05.200: INFO: Container cleanup40-f947c08a-deed-4b24-899e-90108c36ea94 ready: true, restart count 0 Mar 26 17:50:05.200: INFO: kube-proxy-i-0c64386131d9d94c5 started at 2023-03-26 17:34:03 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:05.200: INFO: Container kube-proxy ready: true, restart count 0 Mar 26 17:50:05.200: INFO: annotationupdate6890c2f3-df78-43b8-9132-d3a6bbd7656d started at 2023-03-26 17:48:22 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:05.200: INFO: Container client-container ready: true, restart count 0 Mar 26 17:50:05.200: INFO: pod-projected-configmaps-de996c56-a9f3-401e-af2b-6dcf961e335a started at 2023-03-26 17:47:10 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:05.200: INFO: Container agnhost-container ready: true, restart count 0 Mar 26 17:50:05.200: INFO: cleanup40-f947c08a-deed-4b24-899e-90108c36ea94-4672n started at 2023-03-26 17:49:59 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:05.200: INFO: Container cleanup40-f947c08a-deed-4b24-899e-90108c36ea94 ready: true, restart count 0 Mar 26 17:50:05.200: INFO: calico-node-jl5lk started at 2023-03-26 17:34:03 +0000 UTC (3+1 container statuses recorded) Mar 26 17:50:05.200: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 26 17:50:05.200: INFO: Init container install-cni ready: true, restart count 0 Mar 26 17:50:05.200: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 26 17:50:05.200: INFO: Container calico-node ready: true, restart count 0 Mar 26 17:50:05.200: INFO: ebs-csi-node-rhk2b started at 2023-03-26 17:34:03 +0000 UTC (0+3 container statuses recorded) Mar 26 17:50:05.200: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:50:05.200: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:50:05.200: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:50:05.200: INFO: cleanup40-f947c08a-deed-4b24-899e-90108c36ea94-556gj started at 2023-03-26 17:49:59 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:05.200: INFO: Container cleanup40-f947c08a-deed-4b24-899e-90108c36ea94 ready: true, restart count 0 Mar 26 17:50:05.200: INFO: cleanup40-f947c08a-deed-4b24-899e-90108c36ea94-s4w25 started at 2023-03-26 17:50:00 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:05.200: INFO: Container cleanup40-f947c08a-deed-4b24-899e-90108c36ea94 ready: true, restart count 0 Mar 26 17:50:05.600: INFO: Latency metrics for node i-0c64386131d9d94c5 Mar 26 17:50:05.600: INFO: Logging node info for node i-0ef04f0ca28b74fa4 Mar 26 17:50:05.705: INFO: Node Info: &Node{ObjectMeta:{i-0ef04f0ca28b74fa4 1429588e-1f3b-4a1a-98e2-600879dad0f2 47168 0 2023-03-26 17:21:49 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3b kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0ef04f0ca28b74fa4 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3b topology.hostpath.csi/node:i-0ef04f0ca28b74fa4 topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3b] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0ef04f0ca28b74fa4"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.42.152/19 projectcalico.org/IPv4IPIPTunnelAddr:100.104.100.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-26 17:21:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:21:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:21:50 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-03-26 17:21:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-03-26 17:22:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.7.0/24\"":{}}}} } {calico-node Update v1 2023-03-26 17:22:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2023-03-26 17:49:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {e2e.test Update v1 2023-03-26 17:49:58 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.7.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3b/i-0ef04f0ca28b74fa4,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.7.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-26 17:22:08 +0000 UTC,LastTransitionTime:2023-03-26 17:22:08 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-26 17:49:52 +0000 UTC,LastTransitionTime:2023-03-26 17:21:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-26 17:49:52 +0000 UTC,LastTransitionTime:2023-03-26 17:21:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-26 17:49:52 +0000 UTC,LastTransitionTime:2023-03-26 17:21:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-26 17:49:52 +0000 UTC,LastTransitionTime:2023-03-26 17:22:00 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.152,},NodeAddress{Type:ExternalIP,Address:35.180.133.237,},NodeAddress{Type:InternalDNS,Address:i-0ef04f0ca28b74fa4.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-0ef04f0ca28b74fa4.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-180-133-237.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2cd6131a8983e20721f6c173936bc3,SystemUUID:ec2cd613-1a89-83e2-0721-f6c173936bc3,BootID:34695e7c-23d6-4648-b207-41bcd12c2edf,KernelVersion:5.15.0-1031-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0,KubeProxyVersion:v1.28.0-alpha.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/kube-proxy@sha256:8a03b3147cd7be8e8235ae1cd70cf69aca9ce03ba1cfaffea320540bb5afa496 registry.k8s.io/kube-proxy:v1.28.0-alpha.0],SizeBytes:23896850,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 26 17:50:05.705: INFO: Logging kubelet events for node i-0ef04f0ca28b74fa4 Mar 26 17:50:05.838: INFO: Logging pods the kubelet thinks is on node i-0ef04f0ca28b74fa4 Mar 26 17:50:05.949: INFO: cleanup40-f947c08a-deed-4b24-899e-90108c36ea94-zzbcp started at 2023-03-26 17:49:59 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:05.949: INFO: Container cleanup40-f947c08a-deed-4b24-899e-90108c36ea94 ready: true, restart count 0 Mar 26 17:50:05.949: INFO: cleanup40-f947c08a-deed-4b24-899e-90108c36ea94-gtvtf started at 2023-03-26 17:49:59 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:05.949: INFO: Container cleanup40-f947c08a-deed-4b24-899e-90108c36ea94 ready: true, restart count 0 Mar 26 17:50:05.949: INFO: cleanup40-f947c08a-deed-4b24-899e-90108c36ea94-8l46f started at 2023-03-26 17:49:59 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:05.949: INFO: Container cleanup40-f947c08a-deed-4b24-899e-90108c36ea94 ready: true, restart count 0 Mar 26 17:50:05.949: INFO: cleanup40-f947c08a-deed-4b24-899e-90108c36ea94-hjzst started at 2023-03-26 17:49:59 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:05.949: INFO: Container cleanup40-f947c08a-deed-4b24-899e-90108c36ea94 ready: true, restart count 0 Mar 26 17:50:05.949: INFO: cleanup40-f947c08a-deed-4b24-899e-90108c36ea94-nqtll started at 2023-03-26 17:49:59 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:05.949: INFO: Container cleanup40-f947c08a-deed-4b24-899e-90108c36ea94 ready: true, restart count 0 Mar 26 17:50:05.949: INFO: cleanup40-f947c08a-deed-4b24-899e-90108c36ea94-vjbxr started at 2023-03-26 17:49:59 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:05.949: INFO: Container cleanup40-f947c08a-deed-4b24-899e-90108c36ea94 ready: true, restart count 0 Mar 26 17:50:05.949: INFO: cleanup40-f947c08a-deed-4b24-899e-90108c36ea94-hrq7b started at 2023-03-26 17:49:59 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:05.949: INFO: Container cleanup40-f947c08a-deed-4b24-899e-90108c36ea94 ready: true, restart count 0 Mar 26 17:50:05.949: INFO: client-containers-8a3e479e-28a3-4e39-8f41-0d7edaa35258 started at 2023-03-26 17:50:04 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:05.949: INFO: Container agnhost-container ready: false, restart count 0 Mar 26 17:50:05.949: INFO: kube-proxy-i-0ef04f0ca28b74fa4 started at 2023-03-26 17:21:50 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:05.949: INFO: Container kube-proxy ready: true, restart count 0 Mar 26 17:50:05.949: INFO: startup-86fac25e-94ed-46f5-87c0-9776095c4056 started at 2023-03-26 17:48:56 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:05.949: INFO: Container busybox ready: false, restart count 0 Mar 26 17:50:05.949: INFO: cleanup40-f947c08a-deed-4b24-899e-90108c36ea94-c24hs started at 2023-03-26 17:49:59 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:05.949: INFO: Container cleanup40-f947c08a-deed-4b24-899e-90108c36ea94 ready: true, restart count 0 Mar 26 17:50:05.949: INFO: liveness-f07cd7ad-7f53-408f-9ba0-02fe49537f88 started at 2023-03-26 17:49:01 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:05.949: INFO: Container agnhost-container ready: true, restart count 0 Mar 26 17:50:05.949: INFO: cleanup40-f947c08a-deed-4b24-899e-90108c36ea94-fbzc5 started at 2023-03-26 17:49:59 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:05.949: INFO: Container cleanup40-f947c08a-deed-4b24-899e-90108c36ea94 ready: true, restart count 0 Mar 26 17:50:05.949: INFO: calico-node-bdwdr started at 2023-03-26 17:21:50 +0000 UTC (3+1 container statuses recorded) Mar 26 17:50:05.949: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 26 17:50:05.949: INFO: Init container install-cni ready: true, restart count 0 Mar 26 17:50:05.949: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 26 17:50:05.949: INFO: Container calico-node ready: true, restart count 0 Mar 26 17:50:05.949: INFO: ebs-csi-node-6wp7p started at 2023-03-26 17:21:50 +0000 UTC (0+3 container statuses recorded) Mar 26 17:50:05.949: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:50:05.949: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:50:05.949: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:50:05.949: INFO: coredns-559769c974-6mjw2 started at 2023-03-26 17:22:53 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:05.949: INFO: Container coredns ready: true, restart count 0 Mar 26 17:50:05.949: INFO: cleanup40-f947c08a-deed-4b24-899e-90108c36ea94-rtfmb started at 2023-03-26 17:49:59 +0000 UTC (0+1 container statuses recorded) Mar 26 17:50:05.949: INFO: Container cleanup40-f947c08a-deed-4b24-899e-90108c36ea94 ready: true, restart count 0 Mar 26 17:50:06.454: INFO: Latency metrics for node i-0ef04f0ca28b74fa4 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/26/23 17:50:06.454 (5.641s) < Exit [DeferCleanup (Each)] [sig-auth] ServiceAccounts - dump namespaces | framework.go:209 @ 03/26/23 17:50:06.454 (5.641s) > Enter [DeferCleanup (Each)] [sig-auth] ServiceAccounts - tear down framework | framework.go:206 @ 03/26/23 17:50:06.454 STEP: Destroying namespace "svcaccounts-5472" for this suite. - test/e2e/framework/framework.go:351 @ 03/26/23 17:50:06.455 < Exit [DeferCleanup (Each)] [sig-auth] ServiceAccounts - tear down framework | framework.go:206 @ 03/26/23 17:50:06.565 (110ms) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/26/23 17:50:06.565 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/26/23 17:50:06.565 (0s)
Find logs mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-auth\]\sServiceAccounts\sshould\smount\sprojected\sservice\saccount\stoken\s\[Conformance\]$'
[FAILED] failed to get logs from test-pod-92034d1f-ebe7-49f4-9f85-4d211659a764 for agnhost-container: Get "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/svcaccounts-7448/pods/test-pod-92034d1f-ebe7-49f4-9f85-4d211659a764/log?container=agnhost-container&previous=false": stream error: stream ID 63; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/26/23 17:37:06.736
> Enter [BeforeEach] [sig-auth] ServiceAccounts - set up framework | framework.go:191 @ 03/26/23 17:36:58.922 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/26/23 17:36:58.922 Mar 26 17:36:58.922: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename svcaccounts - test/e2e/framework/framework.go:250 @ 03/26/23 17:36:58.923 STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 03/26/23 17:36:59.243 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:262 @ 03/26/23 17:36:59.491 < Exit [BeforeEach] [sig-auth] ServiceAccounts - set up framework | framework.go:191 @ 03/26/23 17:36:59.712 (790ms) > Enter [BeforeEach] [sig-auth] ServiceAccounts - test/e2e/framework/metrics/init/init.go:33 @ 03/26/23 17:36:59.712 < Exit [BeforeEach] [sig-auth] ServiceAccounts - test/e2e/framework/metrics/init/init.go:33 @ 03/26/23 17:36:59.712 (0s) > Enter [It] should mount projected service account token [Conformance] - test/e2e/auth/service_accounts.go:275 @ 03/26/23 17:36:59.712 STEP: Creating a pod to test service account token: - test/e2e/framework/pod/output/output.go:243 @ 03/26/23 17:36:59.712 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/26/23 17:37:06.289 Mar 26 17:37:06.397: INFO: Trying to get logs from node i-0b2c24f535e511ae5 pod test-pod-92034d1f-ebe7-49f4-9f85-4d211659a764 container agnhost-container: <nil> Mar 26 17:37:06.504: INFO: Failed to get logs from node "i-0b2c24f535e511ae5" pod "test-pod-92034d1f-ebe7-49f4-9f85-4d211659a764" container "agnhost-container". Get "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/svcaccounts-7448/pods/test-pod-92034d1f-ebe7-49f4-9f85-4d211659a764/log?container=agnhost-container&previous=false": stream error: stream ID 63; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/26/23 17:37:06.504 Mar 26 17:37:06.736: INFO: Unexpected error: <*fmt.wrapError | 0xc0058e36a0>: failed to get logs from test-pod-92034d1f-ebe7-49f4-9f85-4d211659a764 for agnhost-container: Get "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/svcaccounts-7448/pods/test-pod-92034d1f-ebe7-49f4-9f85-4d211659a764/log?container=agnhost-container&previous=false": stream error: stream ID 63; INTERNAL_ERROR; received from peer { msg: "failed to get logs from test-pod-92034d1f-ebe7-49f4-9f85-4d211659a764 for agnhost-container: Get \"https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/svcaccounts-7448/pods/test-pod-92034d1f-ebe7-49f4-9f85-4d211659a764/log?container=agnhost-container&previous=false\": stream error: stream ID 63; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc005914ab0>{ Op: "Get", URL: "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/svcaccounts-7448/pods/test-pod-92034d1f-ebe7-49f4-9f85-4d211659a764/log?container=agnhost-container&previous=false", Err: <http2.StreamError>{ StreamID: 63, Code: 2, Cause: <*errors.errorString | 0xc000167680>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from test-pod-92034d1f-ebe7-49f4-9f85-4d211659a764 for agnhost-container: Get "https://api.e2e-3a5daf4e9a-96255.test-cncf-aws.k8s.io/api/v1/namespaces/svcaccounts-7448/pods/test-pod-92034d1f-ebe7-49f4-9f85-4d211659a764/log?container=agnhost-container&previous=false": stream error: stream ID 63; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/26/23 17:37:06.736 < Exit [It] should mount projected service account token [Conformance] - test/e2e/auth/service_accounts.go:275 @ 03/26/23 17:37:06.736 (7.024s) > Enter [AfterEach] [sig-auth] ServiceAccounts - test/e2e/framework/node/init/init.go:33 @ 03/26/23 17:37:06.736 Mar 26 17:37:06.736: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-auth] ServiceAccounts - test/e2e/framework/node/init/init.go:33 @ 03/26/23 17:37:06.843 (107ms) > Enter [DeferCleanup (Each)] [sig-auth] ServiceAccounts - test/e2e/framework/metrics/init/init.go:35 @ 03/26/23 17:37:06.843 < Exit [DeferCleanup (Each)] [sig-auth] ServiceAccounts - test/e2e/framework/metrics/init/init.go:35 @ 03/26/23 17:37:06.843 (0s) > Enter [DeferCleanup (Each)] [sig-auth] ServiceAccounts - dump namespaces | framework.go:209 @ 03/26/23 17:37:06.843 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/26/23 17:37:06.843 STEP: Collecting events from namespace "svcaccounts-7448". - test/e2e/framework/debug/dump.go:42 @ 03/26/23 17:37:06.843 STEP: Found 4 events. - test/e2e/framework/debug/dump.go:46 @ 03/26/23 17:37:06.959 Mar 26 17:37:06.959: INFO: At 2023-03-26 17:36:59 +0000 UTC - event for test-pod-92034d1f-ebe7-49f4-9f85-4d211659a764: {default-scheduler } Scheduled: Successfully assigned svcaccounts-7448/test-pod-92034d1f-ebe7-49f4-9f85-4d211659a764 to i-0b2c24f535e511ae5 Mar 26 17:37:06.959: INFO: At 2023-03-26 17:37:01 +0000 UTC - event for test-pod-92034d1f-ebe7-49f4-9f85-4d211659a764: {kubelet i-0b2c24f535e511ae5} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 26 17:37:06.959: INFO: At 2023-03-26 17:37:01 +0000 UTC - event for test-pod-92034d1f-ebe7-49f4-9f85-4d211659a764: {kubelet i-0b2c24f535e511ae5} Created: Created container agnhost-container Mar 26 17:37:06.959: INFO: At 2023-03-26 17:37:01 +0000 UTC - event for test-pod-92034d1f-ebe7-49f4-9f85-4d211659a764: {kubelet i-0b2c24f535e511ae5} Started: Started container agnhost-container Mar 26 17:37:07.068: INFO: POD NODE PHASE GRACE CONDITIONS Mar 26 17:37:07.068: INFO: Mar 26 17:37:07.180: INFO: Logging node info for node i-011576d1f2b6be6ec Mar 26 17:37:07.289: INFO: Node Info: &Node{ObjectMeta:{i-011576d1f2b6be6ec ef4bb85b-7188-4ef2-8d1a-583f0fcc379a 8577 0 2023-03-26 17:26:11 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3b kubernetes.io/arch:amd64 kubernetes.io/hostname:i-011576d1f2b6be6ec kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3b topology.hostpath.csi/node:i-011576d1f2b6be6ec topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-9716":"i-011576d1f2b6be6ec","ebs.csi.aws.com":"i-011576d1f2b6be6ec"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.41.235/19 projectcalico.org/IPv4IPIPTunnelAddr:100.127.173.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-03-26 17:26:11 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:26:11 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-03-26 17:26:11 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-03-26 17:26:12 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-03-26 17:26:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.8.0/24\"":{}}}} } {calico-node Update v1 2023-03-26 17:26:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-03-26 17:36:43 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-03-26 17:36:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.8.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3b/i-011576d1f2b6be6ec,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.8.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-26 17:26:30 +0000 UTC,LastTransitionTime:2023-03-26 17:26:30 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-26 17:36:44 +0000 UTC,LastTransitionTime:2023-03-26 17:26:11 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-26 17:36:44 +0000 UTC,LastTransitionTime:2023-03-26 17:26:11 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-26 17:36:44 +0000 UTC,LastTransitionTime:2023-03-26 17:26:11 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-26 17:36:44 +0000 UTC,LastTransitionTime:2023-03-26 17:26:23 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.41.235,},NodeAddress{Type:ExternalIP,Address:35.180.45.101,},NodeAddress{Type:InternalDNS,Address:i-011576d1f2b6be6ec.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-011576d1f2b6be6ec.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-180-45-101.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec26cc6e198da1950569e38fb3a7f618,SystemUUID:ec26cc6e-198d-a195-0569-e38fb3a7f618,BootID:b67057d3-2187-4008-9056-8a843d3c6813,KernelVersion:5.15.0-1031-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0,KubeProxyVersion:v1.28.0-alpha.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/kube-proxy@sha256:8a03b3147cd7be8e8235ae1cd70cf69aca9ce03ba1cfaffea320540bb5afa496 registry.k8s.io/kube-proxy:v1.28.0-alpha.0],SizeBytes:23896850,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0f9c557fd65e8c56c],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0f9c557fd65e8c56c,DevicePath:,},},Config:nil,},} Mar 26 17:37:07.289: INFO: Logging kubelet events for node i-011576d1f2b6be6ec Mar 26 17:37:07.405: INFO: Logging pods the kubelet thinks is on node i-011576d1f2b6be6ec Mar 26 17:37:07.623: INFO: webserver-deployment-67bd4bf6dc-fn29c started at 2023-03-26 17:37:03 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:07.623: INFO: Container httpd ready: true, restart count 0 Mar 26 17:37:07.623: INFO: ebs-csi-node-7dqmm started at 2023-03-26 17:26:12 +0000 UTC (0+3 container statuses recorded) Mar 26 17:37:07.623: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:37:07.623: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:37:07.623: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:37:07.623: INFO: coredns-559769c974-58thj started at 2023-03-26 17:34:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:07.623: INFO: Container coredns ready: true, restart count 0 Mar 26 17:37:07.623: INFO: webserver-deployment-7b75d79cf5-ctktv started at 2023-03-26 17:37:01 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:07.623: INFO: Container httpd ready: false, restart count 0 Mar 26 17:37:07.623: INFO: webserver-deployment-67bd4bf6dc-5kjf2 started at 2023-03-26 17:36:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:07.623: INFO: Container httpd ready: true, restart count 0 Mar 26 17:37:07.623: INFO: webserver-deployment-67bd4bf6dc-c4sz6 started at 2023-03-26 17:37:03 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:07.623: INFO: Container httpd ready: true, restart count 0 Mar 26 17:37:07.623: INFO: affinity-clusterip-485gn started at 2023-03-26 17:37:02 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:07.623: INFO: Container affinity-clusterip ready: true, restart count 0 Mar 26 17:37:07.623: INFO: webserver-deployment-7b75d79cf5-8pbcg started at 2023-03-26 17:37:03 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:07.623: INFO: Container httpd ready: false, restart count 0 Mar 26 17:37:07.623: INFO: webserver-deployment-67bd4bf6dc-pqj5q started at 2023-03-26 17:37:03 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:07.623: INFO: Container httpd ready: true, restart count 0 Mar 26 17:37:07.623: INFO: kube-proxy-i-011576d1f2b6be6ec started at 2023-03-26 17:26:12 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:07.623: INFO: Container kube-proxy ready: true, restart count 0 Mar 26 17:37:07.623: INFO: calico-node-tmjhr started at 2023-03-26 17:26:12 +0000 UTC (3+1 container statuses recorded) Mar 26 17:37:07.623: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 26 17:37:07.623: INFO: Init container install-cni ready: true, restart count 0 Mar 26 17:37:07.623: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 26 17:37:07.623: INFO: Container calico-node ready: true, restart count 0 Mar 26 17:37:07.623: INFO: affinity-clusterip-timeout-lhsdp started at 2023-03-26 17:36:49 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:07.623: INFO: Container affinity-clusterip-timeout ready: true, restart count 0 Mar 26 17:37:07.623: INFO: hostexec-i-011576d1f2b6be6ec-tlrf7 started at 2023-03-26 17:36:50 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:07.623: INFO: Container agnhost-container ready: true, restart count 0 Mar 26 17:37:07.623: INFO: ss-1 started at 2023-03-26 17:36:41 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:07.623: INFO: Container webserver ready: false, restart count 0 Mar 26 17:37:07.623: INFO: webserver-deployment-7b75d79cf5-2mfmn started at 2023-03-26 17:37:03 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:07.623: INFO: Container httpd ready: false, restart count 0 Mar 26 17:37:07.623: INFO: csi-hostpathplugin-0 started at 2023-03-26 17:36:09 +0000 UTC (0+7 container statuses recorded) Mar 26 17:37:07.623: INFO: Container csi-attacher ready: true, restart count 0 Mar 26 17:37:07.623: INFO: Container csi-provisioner ready: true, restart count 0 Mar 26 17:37:07.623: INFO: Container csi-resizer ready: true, restart count 0 Mar 26 17:37:07.623: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 26 17:37:07.623: INFO: Container hostpath ready: true, restart count 0 Mar 26 17:37:07.623: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:37:07.623: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:37:07.623: INFO: ss2-2 started at 2023-03-26 17:36:38 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:07.623: INFO: Container webserver ready: true, restart count 0 Mar 26 17:37:07.623: INFO: webserver-deployment-67bd4bf6dc-vfq5j started at 2023-03-26 17:36:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:07.623: INFO: Container httpd ready: true, restart count 0 Mar 26 17:37:08.070: INFO: Latency metrics for node i-011576d1f2b6be6ec Mar 26 17:37:08.070: INFO: Logging node info for node i-07cdb76b0ac2dbfa1 Mar 26 17:37:08.177: INFO: Node Info: &Node{ObjectMeta:{i-07cdb76b0ac2dbfa1 d3bcec50-934c-432e-a590-2a35577f3a0d 5994 0 2023-03-26 17:17:19 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3b kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-07cdb76b0ac2dbfa1 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:eu-west-3b topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3b] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-07cdb76b0ac2dbfa1"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.63.230/19 projectcalico.org/IPv4IPIPTunnelAddr:100.127.118.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-26 17:17:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-03-26 17:17:20 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {calico-node Update v1 2023-03-26 17:18:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {aws-cloud-controller-manager Update v1 2023-03-26 17:18:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:18:48 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-03-26 17:18:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.5.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-03-26 17:35:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.5.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3b/i-07cdb76b0ac2dbfa1,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.5.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892301824 0} {<nil>} 3801076Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787444224 0} {<nil>} 3698676Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-26 17:18:46 +0000 UTC,LastTransitionTime:2023-03-26 17:18:46 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-26 17:35:51 +0000 UTC,LastTransitionTime:2023-03-26 17:17:19 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-26 17:35:51 +0000 UTC,LastTransitionTime:2023-03-26 17:17:19 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-26 17:35:51 +0000 UTC,LastTransitionTime:2023-03-26 17:17:19 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-26 17:35:51 +0000 UTC,LastTransitionTime:2023-03-26 17:18:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.63.230,},NodeAddress{Type:ExternalIP,Address:15.237.44.201,},NodeAddress{Type:InternalDNS,Address:i-07cdb76b0ac2dbfa1.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-07cdb76b0ac2dbfa1.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-237-44-201.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2824f976de88ff768c75c0d62c774f,SystemUUID:ec2824f9-76de-88ff-768c-75c0d62c774f,BootID:bc1e3e86-fc91-4be5-acba-90ac2a46faf2,KernelVersion:5.15.0-1031-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0,KubeProxyVersion:v1.28.0-alpha.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 registry.k8s.io/etcd:3.4.3-0],SizeBytes:100947667,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:9ce33ba33d8e738a5b85ed50b5080ac746deceed4a7496c550927a7a19ca3b6d registry.k8s.io/etcd:3.5.0-0],SizeBytes:99868722,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 registry.k8s.io/etcd:3.5.1-0],SizeBytes:98888614,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 registry.k8s.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:0d2ab6b15b4fe0b903b9e81192d942fb39c29be61fe341cd16db5d0165b0435c registry.k8s.io/etcd:3.3.17-0],SizeBytes:85524408,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:17da501f5d2a675be46040422a27b7cc21b8a43895ac998b171db1c346f361f7 registry.k8s.io/etcd:3.3.10-0],SizeBytes:76162358,},ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager-slim@sha256:8727adc059334e0e3329dbccce116a734da4a090da5e86c8cddccaf333caa666 registry.k8s.io/etcdadm/etcd-manager-slim:v3.0.20230201],SizeBytes:63926165,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:905d7ca17fd02bc24c0eba9a062753aba15db3e31422390bc3238eb762339b20 registry.k8s.io/etcd:3.2.24-1],SizeBytes:63423287,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:45208814,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:43629015,},ContainerImage{Names:[registry.k8s.io/kube-apiserver@sha256:49934a29c559e79ed19fc38b4697b18d8fe174b17bf56192588575f980c93956 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0],SizeBytes:33212506,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:2b6acd7f677f76ffe12ecf3ea7df92eb9b1bdb07336d1ac2a54c7631fb753f7e docker.io/calico/kube-controllers:v3.24.5],SizeBytes:31137169,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager@sha256:974748384634982c73527fdb3c9ec0ec476bc0d52b3dd1d611a380b7f99af1f3 registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0],SizeBytes:30820280,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/kube-proxy@sha256:8a03b3147cd7be8e8235ae1cd70cf69aca9ce03ba1cfaffea320540bb5afa496 registry.k8s.io/kube-proxy:v1.28.0-alpha.0],SizeBytes:23896850,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/kube-scheduler@sha256:cbf4007abb076188f16b975bc2b74452603cc7b34c60a29d92f14c38ad02dc11 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0],SizeBytes:18078674,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:5074723,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 26 17:37:08.177: INFO: Logging kubelet events for node i-07cdb76b0ac2dbfa1 Mar 26 17:37:08.292: INFO: Logging pods the kubelet thinks is on node i-07cdb76b0ac2dbfa1 Mar 26 17:37:08.407: INFO: calico-node-5cszq started at 2023-03-26 17:18:29 +0000 UTC (3+1 container statuses recorded) Mar 26 17:37:08.407: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 26 17:37:08.407: INFO: Init container install-cni ready: true, restart count 0 Mar 26 17:37:08.407: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 26 17:37:08.407: INFO: Container calico-node ready: true, restart count 0 Mar 26 17:37:08.407: INFO: ebs-csi-controller-79f984545f-vq8bz started at 2023-03-26 17:19:49 +0000 UTC (0+5 container statuses recorded) Mar 26 17:37:08.407: INFO: Container csi-attacher ready: true, restart count 0 Mar 26 17:37:08.407: INFO: Container csi-provisioner ready: true, restart count 0 Mar 26 17:37:08.407: INFO: Container csi-resizer ready: true, restart count 0 Mar 26 17:37:08.407: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:37:08.407: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:37:08.407: INFO: dns-controller-69987775c6-ntctn started at 2023-03-26 17:17:49 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:08.407: INFO: Container dns-controller ready: true, restart count 0 Mar 26 17:37:08.407: INFO: aws-cloud-controller-manager-tbxvs started at 2023-03-26 17:18:29 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:08.407: INFO: Container aws-cloud-controller-manager ready: true, restart count 0 Mar 26 17:37:08.407: INFO: kube-scheduler-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:08.407: INFO: Container kube-scheduler ready: true, restart count 0 Mar 26 17:37:08.407: INFO: etcd-manager-events-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (11+1 container statuses recorded) Mar 26 17:37:08.407: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0 Mar 26 17:37:08.407: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0 Mar 26 17:37:08.407: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0 Mar 26 17:37:08.407: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0 Mar 26 17:37:08.407: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0 Mar 26 17:37:08.407: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0 Mar 26 17:37:08.407: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0 Mar 26 17:37:08.407: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0 Mar 26 17:37:08.407: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0 Mar 26 17:37:08.407: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0 Mar 26 17:37:08.407: INFO: Init container init-etcd-3-5-7 ready: true, restart count 0 Mar 26 17:37:08.407: INFO: Container etcd-manager ready: true, restart count 0 Mar 26 17:37:08.407: INFO: etcd-manager-main-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (11+1 container statuses recorded) Mar 26 17:37:08.407: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0 Mar 26 17:37:08.407: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0 Mar 26 17:37:08.407: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0 Mar 26 17:37:08.407: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0 Mar 26 17:37:08.407: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0 Mar 26 17:37:08.407: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0 Mar 26 17:37:08.407: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0 Mar 26 17:37:08.407: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0 Mar 26 17:37:08.407: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0 Mar 26 17:37:08.407: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0 Mar 26 17:37:08.407: INFO: Init container init-etcd-3-5-7 ready: true, restart count 0 Mar 26 17:37:08.407: INFO: Container etcd-manager ready: true, restart count 0 Mar 26 17:37:08.407: INFO: kube-apiserver-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (0+2 container statuses recorded) Mar 26 17:37:08.407: INFO: Container healthcheck ready: true, restart count 0 Mar 26 17:37:08.407: INFO: Container kube-apiserver ready: true, restart count 2 Mar 26 17:37:08.407: INFO: ebs-csi-node-2r7mc started at 2023-03-26 17:18:29 +0000 UTC (0+3 container statuses recorded) Mar 26 17:37:08.407: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:37:08.407: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:37:08.407: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:37:08.407: INFO: kops-controller-thh8s started at 2023-03-26 17:18:29 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:08.407: INFO: Container kops-controller ready: true, restart count 0 Mar 26 17:37:08.407: INFO: kube-controller-manager-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:08.407: INFO: Container kube-controller-manager ready: true, restart count 4 Mar 26 17:37:08.407: INFO: kube-proxy-i-07cdb76b0ac2dbfa1 started at 2023-03-26 17:15:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:08.407: INFO: Container kube-proxy ready: true, restart count 0 Mar 26 17:37:08.407: INFO: calico-kube-controllers-55f488656-mjjr8 started at 2023-03-26 17:18:51 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:08.407: INFO: Container calico-kube-controllers ready: true, restart count 0 Mar 26 17:37:08.850: INFO: Latency metrics for node i-07cdb76b0ac2dbfa1 Mar 26 17:37:08.850: INFO: Logging node info for node i-0b2c24f535e511ae5 Mar 26 17:37:08.956: INFO: Node Info: &Node{ObjectMeta:{i-0b2c24f535e511ae5 8f866583-6b9f-42fc-932a-c5558d02f775 10198 0 2023-03-26 17:30:16 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3b kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0b2c24f535e511ae5 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3b topology.hostpath.csi/node:i-0b2c24f535e511ae5 topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-7727":"i-0b2c24f535e511ae5","ebs.csi.aws.com":"i-0b2c24f535e511ae5"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.54.135/19 projectcalico.org/IPv4IPIPTunnelAddr:100.113.179.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-03-26 17:30:16 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:30:16 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-03-26 17:30:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-03-26 17:30:17 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-03-26 17:30:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.9.0/24\"":{}}}} } {calico-node Update v1 2023-03-26 17:30:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-03-26 17:36:53 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-03-26 17:37:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.9.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3b/i-0b2c24f535e511ae5,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.9.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-26 17:30:43 +0000 UTC,LastTransitionTime:2023-03-26 17:30:43 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-26 17:37:05 +0000 UTC,LastTransitionTime:2023-03-26 17:30:16 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-26 17:37:05 +0000 UTC,LastTransitionTime:2023-03-26 17:30:16 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-26 17:37:05 +0000 UTC,LastTransitionTime:2023-03-26 17:30:16 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-26 17:37:05 +0000 UTC,LastTransitionTime:2023-03-26 17:30:34 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.54.135,},NodeAddress{Type:ExternalIP,Address:13.38.65.62,},NodeAddress{Type:InternalDNS,Address:i-0b2c24f535e511ae5.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-0b2c24f535e511ae5.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-38-65-62.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec256778270128bdfe9c2066f7fedcda,SystemUUID:ec256778-2701-28bd-fe9c-2066f7fedcda,BootID:542316ee-6bea-470f-85fc-51e338ca7e74,KernelVersion:5.15.0-1031-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0,KubeProxyVersion:v1.28.0-alpha.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/kube-proxy@sha256:8a03b3147cd7be8e8235ae1cd70cf69aca9ce03ba1cfaffea320540bb5afa496 registry.k8s.io/kube-proxy:v1.28.0-alpha.0],SizeBytes:23896850,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-7727^c4a826fb-cbfc-11ed-b9fe-cac12407b0bd kubernetes.io/csi/csi-hostpath-ephemeral-7727^ca9cf8a5-cbfc-11ed-b9fe-cac12407b0bd kubernetes.io/csi/ebs.csi.aws.com^vol-0598563114776e04a kubernetes.io/csi/ebs.csi.aws.com^vol-08548d13f8106a913 kubernetes.io/csi/ebs.csi.aws.com^vol-0948956feb75fa79a],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-08548d13f8106a913,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-7727^c4a826fb-cbfc-11ed-b9fe-cac12407b0bd,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-7727^ca9cf8a5-cbfc-11ed-b9fe-cac12407b0bd,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0948956feb75fa79a,DevicePath:,},},Config:nil,},} Mar 26 17:37:08.957: INFO: Logging kubelet events for node i-0b2c24f535e511ae5 Mar 26 17:37:09.071: INFO: Logging pods the kubelet thinks is on node i-0b2c24f535e511ae5 Mar 26 17:37:09.208: INFO: foo-4sn8c started at 2023-03-26 17:36:50 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:09.208: INFO: Container c ready: true, restart count 0 Mar 26 17:37:09.208: INFO: inline-volume-tester2-79mcl started at 2023-03-26 17:36:51 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:09.208: INFO: Container csi-volume-tester ready: true, restart count 0 Mar 26 17:37:09.208: INFO: affinity-clusterip-m6p6j started at 2023-03-26 17:37:02 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:09.208: INFO: Container affinity-clusterip ready: true, restart count 0 Mar 26 17:37:09.208: INFO: ss-0 started at 2023-03-26 17:36:35 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:09.208: INFO: Container webserver ready: true, restart count 0 Mar 26 17:37:09.208: INFO: webserver-deployment-67bd4bf6dc-qnnwz started at 2023-03-26 17:37:03 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:09.208: INFO: Container httpd ready: true, restart count 0 Mar 26 17:37:09.208: INFO: csi-hostpathplugin-0 started at 2023-03-26 17:36:31 +0000 UTC (0+7 container statuses recorded) Mar 26 17:37:09.208: INFO: Container csi-attacher ready: true, restart count 0 Mar 26 17:37:09.208: INFO: Container csi-provisioner ready: true, restart count 0 Mar 26 17:37:09.208: INFO: Container csi-resizer ready: true, restart count 0 Mar 26 17:37:09.208: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 26 17:37:09.208: INFO: Container hostpath ready: true, restart count 0 Mar 26 17:37:09.208: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:37:09.208: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:37:09.208: INFO: kube-proxy-mode-detector started at 2023-03-26 17:36:45 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:09.208: INFO: Container agnhost-container ready: true, restart count 0 Mar 26 17:37:09.208: INFO: ss-2 started at 2023-03-26 17:36:50 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:09.208: INFO: Container webserver ready: true, restart count 0 Mar 26 17:37:09.208: INFO: webserver-deployment-67bd4bf6dc-r9jjm started at 2023-03-26 17:37:03 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:09.208: INFO: Container httpd ready: true, restart count 0 Mar 26 17:37:09.208: INFO: affinity-clusterip-timeout-lqftf started at 2023-03-26 17:36:49 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:09.208: INFO: Container affinity-clusterip-timeout ready: true, restart count 0 Mar 26 17:37:09.208: INFO: execpod-affinity88jtk started at 2023-03-26 17:36:55 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:09.208: INFO: Container agnhost-container ready: true, restart count 0 Mar 26 17:37:09.208: INFO: webserver-deployment-67bd4bf6dc-5bz75 started at 2023-03-26 17:37:03 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:09.208: INFO: Container httpd ready: true, restart count 0 Mar 26 17:37:09.208: INFO: kube-proxy-i-0b2c24f535e511ae5 started at 2023-03-26 17:30:17 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:09.208: INFO: Container kube-proxy ready: true, restart count 0 Mar 26 17:37:09.208: INFO: webserver-deployment-7b75d79cf5-s289h started at 2023-03-26 17:37:01 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:09.208: INFO: Container httpd ready: false, restart count 0 Mar 26 17:37:09.208: INFO: webserver-deployment-7b75d79cf5-4n8wh started at 2023-03-26 17:37:03 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:09.208: INFO: Container httpd ready: false, restart count 0 Mar 26 17:37:09.208: INFO: foo-bkfbg started at 2023-03-26 17:36:50 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:09.208: INFO: Container c ready: true, restart count 0 Mar 26 17:37:09.208: INFO: inline-volume-tester-gm4j8 started at 2023-03-26 17:36:41 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:09.208: INFO: Container csi-volume-tester ready: true, restart count 0 Mar 26 17:37:09.208: INFO: ephemeral-containers-target-pod started at 2023-03-26 17:36:43 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:09.208: INFO: Container test-container-1 ready: true, restart count 0 Mar 26 17:37:09.208: INFO: execpod-affinityv5cnv started at 2023-03-26 17:37:09 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:09.208: INFO: Container agnhost-container ready: false, restart count 0 Mar 26 17:37:09.208: INFO: pod-a7503f63-dd6e-4c6c-b369-8dc1628eeea4 started at 2023-03-26 17:37:01 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:09.208: INFO: Container write-pod ready: false, restart count 0 Mar 26 17:37:09.208: INFO: webserver-deployment-7b75d79cf5-lrjnz started at 2023-03-26 17:37:01 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:09.208: INFO: Container httpd ready: false, restart count 0 Mar 26 17:37:09.208: INFO: webserver-deployment-7b75d79cf5-2ptw9 started at 2023-03-26 17:37:03 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:09.208: INFO: Container httpd ready: false, restart count 0 Mar 26 17:37:09.208: INFO: hostexec-i-0b2c24f535e511ae5-gmjk7 started at 2023-03-26 17:37:04 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:09.208: INFO: Container agnhost-container ready: true, restart count 0 Mar 26 17:37:09.208: INFO: csi-mockplugin-0 started at 2023-03-26 17:37:07 +0000 UTC (0+4 container statuses recorded) Mar 26 17:37:09.208: INFO: Container busybox ready: false, restart count 0 Mar 26 17:37:09.208: INFO: Container csi-provisioner ready: false, restart count 0 Mar 26 17:37:09.208: INFO: Container driver-registrar ready: false, restart count 0 Mar 26 17:37:09.208: INFO: Container mock ready: false, restart count 0 Mar 26 17:37:09.208: INFO: calico-node-rdfns started at 2023-03-26 17:30:17 +0000 UTC (3+1 container statuses recorded) Mar 26 17:37:09.208: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 26 17:37:09.208: INFO: Init container install-cni ready: true, restart count 0 Mar 26 17:37:09.208: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 26 17:37:09.208: INFO: Container calico-node ready: true, restart count 0 Mar 26 17:37:09.208: INFO: ebs-csi-node-x9jln started at 2023-03-26 17:30:17 +0000 UTC (0+3 container statuses recorded) Mar 26 17:37:09.208: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:37:09.208: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:37:09.208: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:37:09.208: INFO: webserver-deployment-67bd4bf6dc-r27th started at 2023-03-26 17:36:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:09.208: INFO: Container httpd ready: true, restart count 0 Mar 26 17:37:09.208: INFO: ss2-1 started at 2023-03-26 17:36:45 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:09.208: INFO: Container webserver ready: true, restart count 0 Mar 26 17:37:09.208: INFO: webserver-deployment-67bd4bf6dc-6tlm8 started at 2023-03-26 17:37:03 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:09.208: INFO: Container httpd ready: true, restart count 0 Mar 26 17:37:09.729: INFO: Latency metrics for node i-0b2c24f535e511ae5 Mar 26 17:37:09.729: INFO: Logging node info for node i-0c64386131d9d94c5 Mar 26 17:37:09.845: INFO: Node Info: &Node{ObjectMeta:{i-0c64386131d9d94c5 6c5a59f3-69fd-488b-b94e-23777e242a7e 10210 0 2023-03-26 17:34:02 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3b kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0c64386131d9d94c5 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3b topology.hostpath.csi/node:i-0c64386131d9d94c5 topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3b] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0c64386131d9d94c5"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.63.240/19 projectcalico.org/IPv4IPIPTunnelAddr:100.122.71.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-03-26 17:34:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-03-26 17:34:02 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-03-26 17:34:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-03-26 17:34:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-03-26 17:34:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.10.0/24\"":{}}}} } {calico-node Update v1 2023-03-26 17:34:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2023-03-26 17:37:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-03-26 17:37:06 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.10.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3b/i-0c64386131d9d94c5,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.10.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-26 17:34:21 +0000 UTC,LastTransitionTime:2023-03-26 17:34:21 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-26 17:37:05 +0000 UTC,LastTransitionTime:2023-03-26 17:34:02 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-26 17:37:05 +0000 UTC,LastTransitionTime:2023-03-26 17:34:02 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-26 17:37:05 +0000 UTC,LastTransitionTime:2023-03-26 17:34:02 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-26 17:37:05 +0000 UTC,LastTransitionTime:2023-03-26 17:34:14 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.63.240,},NodeAddress{Type:ExternalIP,Address:15.236.210.84,},NodeAddress{Type:InternalDNS,Address:i-0c64386131d9d94c5.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-0c64386131d9d94c5.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-236-210-84.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2c2c56ef9295a859b1f844cff158e8,SystemUUID:ec2c2c56-ef92-95a8-59b1-f844cff158e8,BootID:825bc25d-7144-4ec9-8dfb-f77f9cde8c31,KernelVersion:5.15.0-1031-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0,KubeProxyVersion:v1.28.0-alpha.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/kube-proxy@sha256:8a03b3147cd7be8e8235ae1cd70cf69aca9ce03ba1cfaffea320540bb5afa496 registry.k8s.io/kube-proxy:v1.28.0-alpha.0],SizeBytes:23896850,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0fae9f618539124e0],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0fae9f618539124e0,DevicePath:,},},Config:nil,},} Mar 26 17:37:09.846: INFO: Logging kubelet events for node i-0c64386131d9d94c5 Mar 26 17:37:09.977: INFO: Logging pods the kubelet thinks is on node i-0c64386131d9d94c5 Mar 26 17:37:10.092: INFO: ebs-csi-node-rhk2b started at 2023-03-26 17:34:03 +0000 UTC (0+3 container statuses recorded) Mar 26 17:37:10.092: INFO: Container ebs-plugin ready: true, restart count 0 Mar 26 17:37:10.092: INFO: Container liveness-probe ready: true, restart count 0 Mar 26 17:37:10.092: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 26 17:37:10.092: INFO: affinity-clusterip-l5c8p started at 2023-03-26 17:37:02 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:10.092: INFO: Container affinity-clusterip ready: true, restart count 0 Mar 26 17:37:10.092: INFO: affinity-clusterip-timeout-8xxwd started at 2023-03-26 17:36:49 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:10.092: INFO: Container affinity-clusterip-timeout ready: true, restart count 0 Mar 26 17:37:10.092: INFO: ss2-0 started at 2023-03-26 17:36:57 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:10.092: INFO: Container webserver ready: true, restart count 0 Mar 26 17:37:10.092: INFO: hostexec-i-0c64386131d9d94c5-wl946 started at 2023-03-26 17:36:58 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:10.092: INFO: Container agnhost-container ready: true, restart count 0 Mar 26 17:37:10.092: INFO: calico-node-jl5lk started at 2023-03-26 17:34:03 +0000 UTC (3+1 container statuses recorded) Mar 26 17:37:10.092: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 26 17:37:10.092: INFO: Init container install-cni ready: true, restart count 0 Mar 26 17:37:10.092: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 26 17:37:10.092: INFO: Container calico-node ready: true, restart count 0 Mar 26 17:37:10.092: INFO: ss-0 started at 2023-03-26 17:36:27 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:10.092: INFO: Container webserver ready: true, restart count 0 Mar 26 17:37:10.092: INFO: hostexec-i-0c64386131d9d94c5-vbfgw started at 2023-03-26 17:36:43 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:10.092: INFO: Container agnhost-container ready: true, restart count 0 Mar 26 17:37:10.092: INFO: coredns-autoscaler-7cb5c5b969-xmt8r started at 2023-03-26 17:34:54 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:10.092: INFO: Container autoscaler ready: true, restart count 0 Mar 26 17:37:10.092: INFO: pod-projected-secrets-82c3d854-d27a-439d-b60f-b167d871b490 started at 2023-03-26 17:36:25 +0000 UTC (0+3 container statuses recorded) Mar 26 17:37:10.092: INFO: Container creates-volume-test ready: true, restart count 0 Mar 26 17:37:10.092: INFO: Container dels-volume-test ready: true, restart count 0 Mar 26 17:37:10.092: INFO: Container upds-volume-test ready: true, restart count 0 Mar 26 17:37:10.092: INFO: webserver-deployment-7b75d79cf5-bgngn started at 2023-03-26 17:37:03 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:10.092: INFO: Container httpd ready: false, restart count 0 Mar 26 17:37:10.092: INFO: hostexec-i-0c64386131d9d94c5-ph8g8 started at 2023-03-26 17:37:05 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:10.092: INFO: Container agnhost-container ready: true, restart count 0 Mar 26 17:37:10.092: INFO: webserver-deployment-7b75d79cf5-zprxc started at 2023-03-26 17:37:01 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:10.092: INFO: Container httpd ready: false, restart count 0 Mar 26 17:37:10.092: INFO: webserver-deployment-7b75d79cf5-8ftf4 started at 2023-03-26 17:37:03 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:10.092: INFO: Container httpd ready: false, restart count 0 Mar 26 17:37:10.092: INFO: kube-proxy-i-0c64386131d9d94c5 started at 2023-03-26 17:34:03 +0000 UTC (0+1 container statuses recorded) Mar 26 17:37:10.092: INFO: Conta