Recent runs || View in Spyglass
PR | Ashley-wenyizha: Remove hostNetwork options from controller & node-daemonset |
Result | FAILURE |
Tests | 2 failed / 33 succeeded |
Started | |
Elapsed | 23m32s |
Revision | 8190f0f7938b6af8b1834f012b7cd5d4ad0da05e |
Refs |
907 |
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=EFS\sCSI\sSuite\s\[efs\-csi\]\sEFS\sCSI\s\[Driver\:\sefs\.csi\.aws\.com\]\s\[Testpattern\:\sDynamic\sPV\s\(default\sfs\)\]\ssubPath\sshould\sfail\sif\ssubpath\swith\sbackstepping\sis\soutside\sthe\svolume\s\[Slow\]\[LinuxOnly\]$'
/home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:278 "touch /mnt/volume1/efs-9718-2023-02-06T18:39:25Z" should succeed, but failed with error message "command terminated with exit code 137" stdout: stderr: Unexpected error: <exec.CodeExitError>: { Err: { s: "command terminated with exit code 137", }, Code: 137, } command terminated with exit code 137 occurred /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/volume/fixtures.go:636from junit_04.xml
[BeforeEach] [efs-csi] EFS CSI /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/test/e2e/e2e.go:219 [BeforeEach] [efs-csi] EFS CSI /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Feb 6 18:39:58.053: INFO: >>> kubeConfig: /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/hack/e2e/csi-test-artifacts/test-cluster-30617.k8s.local.kops.kubeconfig �[1mSTEP�[0m: Building a namespace api object, basename efs �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51 [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Feb 6 18:39:58.391: INFO: >>> kubeConfig: /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/hack/e2e/csi-test-artifacts/test-cluster-30617.k8s.local.kops.kubeconfig �[1mSTEP�[0m: Building a namespace api object, basename provisioning �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [It] should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly] /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:278 Feb 6 18:39:58.927: INFO: Creating resource for dynamic PV Feb 6 18:39:58.927: INFO: Using claimSize:1Mi, test suite supported size:{ 1Mi}, driver(efs.csi.aws.com) supported size:{ 1Mi} �[1mSTEP�[0m: creating a StorageClass �[1mSTEP�[0m: creating a claim Feb 6 18:39:58.996: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil Feb 6 18:39:59.069: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [efs.csi.aws.comndssz] to have phase Bound Feb 6 18:39:59.138: INFO: PersistentVolumeClaim efs.csi.aws.comndssz found but phase is Pending instead of Bound. Feb 6 18:40:01.212: INFO: PersistentVolumeClaim efs.csi.aws.comndssz found and phase=Bound (2.143030545s) �[1mSTEP�[0m: Creating pod pod-subpath-test-dynamicpv-28lc �[1mSTEP�[0m: Checking for subpath error in container status Feb 6 18:40:05.631: INFO: Deleting pod "pod-subpath-test-dynamicpv-28lc" in namespace "provisioning-3133" Feb 6 18:40:05.699: INFO: Wait up to 5m0s for pod "pod-subpath-test-dynamicpv-28lc" to be fully deleted �[1mSTEP�[0m: Deleting pod Feb 6 18:40:09.839: INFO: Deleting pod "pod-subpath-test-dynamicpv-28lc" in namespace "provisioning-3133" �[1mSTEP�[0m: Deleting pvc Feb 6 18:40:09.905: INFO: Deleting PersistentVolumeClaim "efs.csi.aws.comndssz" Feb 6 18:40:09.973: INFO: Waiting up to 5m0s for PersistentVolume pvc-e69c05b6-b7d4-4883-a3eb-53cbc4289404 to get deleted Feb 6 18:40:10.039: INFO: PersistentVolume pvc-e69c05b6-b7d4-4883-a3eb-53cbc4289404 found and phase=Released (66.7537ms) Feb 6 18:40:15.110: INFO: PersistentVolume pvc-e69c05b6-b7d4-4883-a3eb-53cbc4289404 was removed �[1mSTEP�[0m: Deleting sc [AfterEach] [Testpattern: Dynamic PV (default fs)] subPath /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "provisioning-3133". �[1mSTEP�[0m: Found 9 events. Feb 6 18:40:15.257: INFO: At 2023-02-06 18:39:59 +0000 UTC - event for efs.csi.aws.comndssz: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "efs.csi.aws.com" or manually created by system administrator Feb 6 18:40:15.257: INFO: At 2023-02-06 18:39:59 +0000 UTC - event for efs.csi.aws.comndssz: {efs.csi.aws.com_efs-csi-controller-6f8fcdc46b-2dpxk_7d29b54a-e847-4f76-a9c7-56c6a9d12e8e } Provisioning: External provisioner is provisioning volume for claim "provisioning-3133/efs.csi.aws.comndssz" Feb 6 18:40:15.257: INFO: At 2023-02-06 18:39:59 +0000 UTC - event for efs.csi.aws.comndssz: {efs.csi.aws.com_efs-csi-controller-6f8fcdc46b-2dpxk_7d29b54a-e847-4f76-a9c7-56c6a9d12e8e } ProvisioningSucceeded: Successfully provisioned volume pvc-e69c05b6-b7d4-4883-a3eb-53cbc4289404 Feb 6 18:40:15.257: INFO: At 2023-02-06 18:40:01 +0000 UTC - event for pod-subpath-test-dynamicpv-28lc: {default-scheduler } Scheduled: Successfully assigned provisioning-3133/pod-subpath-test-dynamicpv-28lc to ip-172-20-89-136.us-west-2.compute.internal Feb 6 18:40:15.257: INFO: At 2023-02-06 18:40:02 +0000 UTC - event for pod-subpath-test-dynamicpv-28lc: {kubelet ip-172-20-89-136.us-west-2.compute.internal} Pulled: Container image "k8s.gcr.io/e2e-test-images/busybox:1.29-1" already present on machine Feb 6 18:40:15.257: INFO: At 2023-02-06 18:40:02 +0000 UTC - event for pod-subpath-test-dynamicpv-28lc: {kubelet ip-172-20-89-136.us-west-2.compute.internal} Created: Created container init-volume-dynamicpv-28lc Feb 6 18:40:15.257: INFO: At 2023-02-06 18:40:02 +0000 UTC - event for pod-subpath-test-dynamicpv-28lc: {kubelet ip-172-20-89-136.us-west-2.compute.internal} Started: Started container init-volume-dynamicpv-28lc Feb 6 18:40:15.257: INFO: At 2023-02-06 18:40:03 +0000 UTC - event for pod-subpath-test-dynamicpv-28lc: {kubelet ip-172-20-89-136.us-west-2.compute.internal} Pulled: Container image "k8s.gcr.io/e2e-test-images/agnhost:2.32" already present on machine Feb 6 18:40:15.257: INFO: At 2023-02-06 18:40:03 +0000 UTC - event for pod-subpath-test-dynamicpv-28lc: {kubelet ip-172-20-89-136.us-west-2.compute.internal} Failed: Error: failed to prepare subPath for volumeMount "test-volume" of container "test-container-subpath-dynamicpv-28lc" Feb 6 18:40:15.327: INFO: POD NODE PHASE GRACE CONDITIONS Feb 6 18:40:15.327: INFO: Feb 6 18:40:15.397: INFO: Logging node info for node ip-172-20-36-201.us-west-2.compute.internal Feb 6 18:40:15.464: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-36-201.us-west-2.compute.internal 9d8ee86e-9677-4989-8045-990fc4c97d74 2484 0 2023-02-06 18:34:29 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kops.k8s.io/instancegroup:nodes-us-west-2a kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-36-201.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:c5.large topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[csi.volume.kubernetes.io/nodeid:{"efs.csi.aws.com":"i-08a0198709884d2e0"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2023-02-06 18:34:29 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/instancegroup":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-02-06 18:34:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} } {kubelet Update v1 2023-02-06 18:39:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-aws-ebs":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-aws-ebs":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-08a0198709884d2e0,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{25 0} {<nil>} 25 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{133003395072 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3862937600 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{25 0} {<nil>} 25 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{119703055367 0} {<nil>} 119703055367 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3758080000 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-02-06 18:34:37 +0000 UTC,LastTransitionTime:2023-02-06 18:34:37 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-06 18:39:00 +0000 UTC,LastTransitionTime:2023-02-06 18:34:29 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-06 18:39:00 +0000 UTC,LastTransitionTime:2023-02-06 18:34:29 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-06 18:39:00 +0000 UTC,LastTransitionTime:2023-02-06 18:34:29 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-06 18:39:00 +0000 UTC,LastTransitionTime:2023-02-06 18:34:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.36.201,},NodeAddress{Type:ExternalIP,Address:52.24.141.34,},NodeAddress{Type:Hostname,Address:ip-172-20-36-201.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-36-201.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-52-24-141-34.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec22da743aa0e60d534d3e85ce3c0aae,SystemUUID:ec22da74-3aa0-e60d-534d-3e85ce3c0aae,BootID:61b651cd-be9a-4267-ac23-1bc34ec918e9,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.20.8,KubeProxyVersion:v1.20.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[607362164682.dkr.ecr.us-west-2.amazonaws.com/aws-efs-csi-driver@sha256:00fcde998e6653147443f7807194644d5ca9273e83cd9af3b4ca996514181339 607362164682.dkr.ecr.us-west-2.amazonaws.com/aws-efs-csi-driver:30617],SizeBytes:501573866,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:0c867c82a0a8ce6d093595f9d2e4b10517d6c9c26323075de9d82d9f7d056bfc k8s.gcr.io/kube-proxy:v1.20.8],SizeBytes:52056682,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/external-provisioner@sha256:e677f72d499e09557e20ba9b5ade9fbbc70b73f658b95226963215eaa9fdb1ad public.ecr.aws/eks-distro/kubernetes-csi/external-provisioner:v3.3.0-eks-1-25-latest],SizeBytes:13992120,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/node-driver-registrar@sha256:9cd9ef74078997d4d05f5061b6a4948b54b591bb5152675f45a183c3a1cbbfd8 public.ecr.aws/eks-distro/kubernetes-csi/node-driver-registrar:v2.6.2-eks-1-25-latest],SizeBytes:6553584,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/livenessprobe@sha256:d790820d19a6253ee31418be4d1a9ae023d4a6b64c5591f8f031b4194828cc5b public.ecr.aws/eks-distro/kubernetes-csi/livenessprobe:v2.8.0-eks-1-25-latest],SizeBytes:6005708,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Feb 6 18:40:15.464: INFO: Logging kubelet events for node ip-172-20-36-201.us-west-2.compute.internal Feb 6 18:40:15.544: INFO: Logging pods the kubelet thinks is on node ip-172-20-36-201.us-west-2.compute.internal Feb 6 18:40:15.617: INFO: kube-proxy-ip-172-20-36-201.us-west-2.compute.internal started at 2023-02-06 18:33:56 +0000 UTC (0+1 container statuses recorded) Feb 6 18:40:15.617: INFO: Container kube-proxy ready: true, restart count 0 Feb 6 18:40:15.617: INFO: efs-csi-node-wlkdg started at 2023-02-06 18:39:24 +0000 UTC (0+3 container statuses recorded) Feb 6 18:40:15.617: INFO: Container csi-driver-registrar ready: true, restart count 0 Feb 6 18:40:15.617: INFO: Container efs-plugin ready: true, restart count 0 Feb 6 18:40:15.617: INFO: Container liveness-probe ready: true, restart count 0 Feb 6 18:40:15.617: INFO: efs-csi-controller-6f8fcdc46b-zjxxh started at 2023-02-06 18:34:51 +0000 UTC (0+3 container statuses recorded) Feb 6 18:40:15.617: INFO: Container csi-provisioner ready: true, restart count 0 Feb 6 18:40:15.617: INFO: Container efs-plugin ready: true, restart count 0 Feb 6 18:40:15.617: INFO: Container liveness-probe ready: true, restart count 0 Feb 6 18:40:15.617: INFO: pvc-tester-mdj88 started at 2023-02-06 18:38:54 +0000 UTC (0+1 container statuses recorded) Feb 6 18:40:15.618: INFO: Container write-pod ready: false, restart count 0 Feb 6 18:40:15.887: INFO: Latency metrics for node ip-172-20-36-201.us-west-2.compute.internal Feb 6 18:40:15.887: INFO: Logging node info for node ip-172-20-40-80.us-west-2.compute.internal Feb 6 18:40:15.966: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-40-80.us-west-2.compute.internal b29b340b-f3ce-4742-ba88-f250a2d9421e 885 0 2023-02-06 18:33:13 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kops.k8s.io/instancegroup:master-us-west-2a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-40-80.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/control-plane: node-role.kubernetes.io/master: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:t3.medium topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[csi.volume.kubernetes.io/nodeid:{"efs.csi.aws.com":"i-05fabd0b52ed672a2"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{protokube Update v1 2023-02-06 18:33:18 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/control-plane":{},"f:node-role.kubernetes.io/master":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-02-06 18:33:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} } {kops-controller Update v1 2023-02-06 18:33:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/instancegroup":{}}}} } {kubelet Update v1 2023-02-06 18:35:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-aws-ebs":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-aws-ebs":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-05fabd0b52ed672a2,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{25 0} {<nil>} 25 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{66404147200 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051677184 0} {<nil>} 3956716Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{25 0} {<nil>} 25 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{59763732382 0} {<nil>} 59763732382 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946819584 0} {<nil>} 3854316Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-02-06 18:33:27 +0000 UTC,LastTransitionTime:2023-02-06 18:33:27 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-06 18:35:34 +0000 UTC,LastTransitionTime:2023-02-06 18:33:13 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-06 18:35:34 +0000 UTC,LastTransitionTime:2023-02-06 18:33:13 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-06 18:35:34 +0000 UTC,LastTransitionTime:2023-02-06 18:33:13 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-06 18:35:34 +0000 UTC,LastTransitionTime:2023-02-06 18:33:26 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.40.80,},NodeAddress{Type:ExternalIP,Address:35.87.143.68,},NodeAddress{Type:Hostname,Address:ip-172-20-40-80.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-40-80.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-87-143-68.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2f6cf66646ff5aa97c9705a7214303,SystemUUID:ec2f6cf6-6646-ff5a-a97c-9705a7214303,BootID:f158a57b-0ffd-4c66-a926-1b48d08cfda6,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.20.8,KubeProxyVersion:v1.20.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[607362164682.dkr.ecr.us-west-2.amazonaws.com/aws-efs-csi-driver@sha256:00fcde998e6653147443f7807194644d5ca9273e83cd9af3b4ca996514181339 607362164682.dkr.ecr.us-west-2.amazonaws.com/aws-efs-csi-driver:30617],SizeBytes:501573866,},ContainerImage{Names:[k8s.gcr.io/etcdadm/etcd-manager@sha256:ebb73d3d4a99da609f9e01c556cd9f9aa7a0aecba8f5bc5588d7c45eb38e3a7e k8s.gcr.io/etcdadm/etcd-manager:3.0.20210430],SizeBytes:171082409,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:0c867c82a0a8ce6d093595f9d2e4b10517d6c9c26323075de9d82d9f7d056bfc k8s.gcr.io/kube-proxy:v1.20.8],SizeBytes:52056682,},ContainerImage{Names:[k8s.gcr.io/kops/dns-controller@sha256:f3724709f264bd47d2251f4ec5b16ec5482e8a2d65da006cd3165eb4da0bd3d1 k8s.gcr.io/kops/dns-controller:1.21.0],SizeBytes:40960953,},ContainerImage{Names:[k8s.gcr.io/kops/kops-controller@sha256:05b7d6511df0084aed954a009099402d2a7e7227adf0f410c4583204e6f76429 k8s.gcr.io/kops/kops-controller:1.21.0],SizeBytes:40618104,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:531ffd92bd954f5c27002ce11502771146e7c867c09a6e1755631953ff584df4 k8s.gcr.io/kube-apiserver:v1.20.8],SizeBytes:30462643,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:13509f0b36bbd4d2d142cf4c35d77f32ec3728975d96cf833b60b484effa8c43 k8s.gcr.io/kube-controller-manager:v1.20.8],SizeBytes:29554511,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:6fc53cbc3f035ba2b0ac9127e9dc5aa7a95b73f041f7cc14c36cdfc095b13080 k8s.gcr.io/kube-scheduler:v1.20.8],SizeBytes:14243733,},ContainerImage{Names:[k8s.gcr.io/kops/kube-apiserver-healthcheck@sha256:d772e49a0ae9dea319f26aaa40d58a123860b19da6378d29898eb30208359241 k8s.gcr.io/kops/kube-apiserver-healthcheck:1.21.0],SizeBytes:11771024,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/node-driver-registrar@sha256:9cd9ef74078997d4d05f5061b6a4948b54b591bb5152675f45a183c3a1cbbfd8 public.ecr.aws/eks-distro/kubernetes-csi/node-driver-registrar:v2.6.2-eks-1-25-latest],SizeBytes:6553584,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/livenessprobe@sha256:d790820d19a6253ee31418be4d1a9ae023d4a6b64c5591f8f031b4194828cc5b public.ecr.aws/eks-distro/kubernetes-csi/livenessprobe:v2.8.0-eks-1-25-latest],SizeBytes:6005708,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Feb 6 18:40:15.967: INFO: Logging kubelet events for node ip-172-20-40-80.us-west-2.compute.internal Feb 6 18:40:16.038: INFO: Logging pods the kubelet thinks is on node ip-172-20-40-80.us-west-2.compute.internal Feb 6 18:40:16.113: INFO: dns-controller-5d59c585d8-wtbbd started at 2023-02-06 18:33:29 +0000 UTC (0+1 container statuses recorded) Feb 6 18:40:16.113: INFO: Container dns-controller ready: true, restart count 0 Feb 6 18:40:16.114: INFO: kube-apiserver-ip-172-20-40-80.us-west-2.compute.internal started at 2023-02-06 18:32:29 +0000 UTC (0+2 container statuses recorded) Feb 6 18:40:16.114: INFO: Container healthcheck ready: true, restart count 0 Feb 6 18:40:16.114: INFO: Container kube-apiserver ready: true, restart count 0 Feb 6 18:40:16.114: INFO: etcd-manager-events-ip-172-20-40-80.us-west-2.compute.internal started at 2023-02-06 18:32:29 +0000 UTC (0+1 container statuses recorded) Feb 6 18:40:16.114: INFO: Container etcd-manager ready: true, restart count 0 Feb 6 18:40:16.114: INFO: etcd-manager-main-ip-172-20-40-80.us-west-2.compute.internal started at 2023-02-06 18:32:29 +0000 UTC (0+1 container statuses recorded) Feb 6 18:40:16.114: INFO: Container etcd-manager ready: true, restart count 0 Feb 6 18:40:16.114: INFO: kube-controller-manager-ip-172-20-40-80.us-west-2.compute.internal started at 2023-02-06 18:32:29 +0000 UTC (0+1 container statuses recorded) Feb 6 18:40:16.114: INFO: Container kube-controller-manager ready: true, restart count 0 Feb 6 18:40:16.114: INFO: kube-proxy-ip-172-20-40-80.us-west-2.compute.internal started at 2023-02-06 18:32:29 +0000 UTC (0+1 container statuses recorded) Feb 6 18:40:16.114: INFO: Container kube-proxy ready: true, restart count 0 Feb 6 18:40:16.114: INFO: kops-controller-qjqj9 started at 2023-02-06 18:33:29 +0000 UTC (0+1 container statuses recorded) Feb 6 18:40:16.114: INFO: Container kops-controller ready: true, restart count 0 Feb 6 18:40:16.114: INFO: efs-csi-node-p8468 started at 2023-02-06 18:34:50 +0000 UTC (0+3 container statuses recorded) Feb 6 18:40:16.114: INFO: Container csi-driver-registrar ready: true, restart count 0 Feb 6 18:40:16.114: INFO: Container efs-plugin ready: true, restart count 0 Feb 6 18:40:16.114: INFO: Container liveness-probe ready: true, restart count 0 Feb 6 18:40:16.114: INFO: kube-scheduler-ip-172-20-40-80.us-west-2.compute.internal started at 2023-02-06 18:32:29 +0000 UTC (0+1 container statuses recorded) Feb 6 18:40:16.114: INFO: Container kube-scheduler ready: true, restart count 0 Feb 6 18:40:16.427: INFO: Latency metrics for node ip-172-20-40-80.us-west-2.compute.internal Feb 6 18:40:16.427: INFO: Logging node info for node ip-172-20-89-136.us-west-2.compute.internal Feb 6 18:40:16.494: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-89-136.us-west-2.compute.internal e335751a-165b-4457-9c6b-241b6473529f 2606 0 2023-02-06 18:34:22 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2b kops.k8s.io/instancegroup:nodes-us-west-2b kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-89-136.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:c5.large topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2b] map[csi.volume.kubernetes.io/nodeid:{"efs.csi.aws.com":"i-0ea19d5a1f3b6be9f"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2023-02-06 18:34:22 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/instancegroup":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-02-06 18:34:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} } {kubelet Update v1 2023-02-06 18:35:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-aws-ebs":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-aws-ebs":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2b/i-0ea19d5a1f3b6be9f,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{25 0} {<nil>} 25 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{133003395072 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3862937600 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{25 0} {<nil>} 25 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{119703055367 0} {<nil>} 119703055367 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3758080000 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-02-06 18:34:27 +0000 UTC,LastTransitionTime:2023-02-06 18:34:27 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-06 18:39:52 +0000 UTC,LastTransitionTime:2023-02-06 18:34:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-06 18:39:52 +0000 UTC,LastTransitionTime:2023-02-06 18:34:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-06 18:39:52 +0000 UTC,LastTransitionTime:2023-02-06 18:34:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-06 18:39:52 +0000 UTC,LastTransitionTime:2023-02-06 18:34:26 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.89.136,},NodeAddress{Type:ExternalIP,Address:52.12.97.247,},NodeAddress{Type:Hostname,Address:ip-172-20-89-136.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-89-136.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-52-12-97-247.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec257e7678d6046236e12dbbabe2f469,SystemUUID:ec257e76-78d6-0462-36e1-2dbbabe2f469,BootID:3909e2da-37b0-4606-abae-ac53d743344c,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.20.8,KubeProxyVersion:v1.20.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[607362164682.dkr.ecr.us-west-2.amazonaws.com/aws-efs-csi-driver@sha256:00fcde998e6653147443f7807194644d5ca9273e83cd9af3b4ca996514181339 607362164682.dkr.ecr.us-west-2.amazonaws.com/aws-efs-csi-driver:30617],SizeBytes:501573866,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:0c867c82a0a8ce6d093595f9d2e4b10517d6c9c26323075de9d82d9f7d056bfc k8s.gcr.io/kube-proxy:v1.20.8],SizeBytes:52056682,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:758db666ac7028534dba72e7e9bb1e57bb81b8196f976f7a5cc351ef8b3529e1 k8s.gcr.io/e2e-test-images/agnhost:2.32],SizeBytes:50002177,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler@sha256:67640771ad9fc56f109d5b01e020f0c858e7c890bb0eb15ba0ebd325df3285e7 k8s.gcr.io/cpa/cluster-proportional-autoscaler:1.8.3],SizeBytes:15191740,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/external-provisioner@sha256:e677f72d499e09557e20ba9b5ade9fbbc70b73f658b95226963215eaa9fdb1ad public.ecr.aws/eks-distro/kubernetes-csi/external-provisioner:v3.3.0-eks-1-25-latest],SizeBytes:13992120,},ContainerImage{Names:[docker.io/coredns/coredns@sha256:642ff9910da6ea9a8624b0234eef52af9ca75ecbec474c5507cb096bdfbae4e5 docker.io/coredns/coredns:1.8.3],SizeBytes:12893350,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/node-driver-registrar@sha256:9cd9ef74078997d4d05f5061b6a4948b54b591bb5152675f45a183c3a1cbbfd8 public.ecr.aws/eks-distro/kubernetes-csi/node-driver-registrar:v2.6.2-eks-1-25-latest],SizeBytes:6553584,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/livenessprobe@sha256:d790820d19a6253ee31418be4d1a9ae023d4a6b64c5591f8f031b4194828cc5b public.ecr.aws/eks-distro/kubernetes-csi/livenessprobe:v2.8.0-eks-1-25-latest],SizeBytes:6005708,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Feb 6 18:40:16.494: INFO: Logging kubelet events for node ip-172-20-89-136.us-west-2.compute.internal Feb 6 18:40:16.566: INFO: Logging pods the kubelet thinks is on node ip-172-20-89-136.us-west-2.compute.internal Feb 6 18:40:16.637: INFO: coredns-autoscaler-6f594f4c58-ml9dm started at 2023-02-06 18:34:32 +0000 UTC (0+1 container statuses recorded) Feb 6 18:40:16.637: INFO: Container autoscaler ready: true, restart count 0 Feb 6 18:40:16.637: INFO: coredns-8f5559c9b-89pvw started at 2023-02-06 18:34:35 +0000 UTC (0+1 container statuses recorded) Feb 6 18:40:16.637: INFO: Container coredns ready: true, restart count 0 Feb 6 18:40:16.637: INFO: efs-csi-node-2fqrk started at 2023-02-06 18:34:50 +0000 UTC (0+3 container statuses recorded) Feb 6 18:40:16.637: INFO: Container csi-driver-registrar ready: true, restart count 0 Feb 6 18:40:16.637: INFO: Container efs-plugin ready: true, restart count 0 Feb 6 18:40:16.637: INFO: Container liveness-probe ready: true, restart count 0 Feb 6 18:40:16.637: INFO: efs-csi-controller-6f8fcdc46b-2dpxk started at 2023-02-06 18:34:51 +0000 UTC (0+3 container statuses recorded) Feb 6 18:40:16.637: INFO: Container csi-provisioner ready: true, restart count 0 Feb 6 18:40:16.637: INFO: Container efs-plugin ready: true, restart count 0 Feb 6 18:40:16.637: INFO: Container liveness-probe ready: true, restart count 0 Feb 6 18:40:16.637: INFO: kube-proxy-ip-172-20-89-136.us-west-2.compute.internal started at 2023-02-06 18:33:48 +0000 UTC (0+1 container statuses recorded) Feb 6 18:40:16.637: INFO: Container kube-proxy ready: true, restart count 0 Feb 6 18:40:16.922: INFO: Latency metrics for node ip-172-20-89-136.us-west-2.compute.internal Feb 6 18:40:16.922: INFO: Logging node info for node ip-172-20-98-141.us-west-2.compute.internal Feb 6 18:40:16.990: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-98-141.us-west-2.compute.internal c15e2c71-936d-4793-b30a-01e71954ef8c 2278 0 2023-02-06 18:34:21 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2c kops.k8s.io/instancegroup:nodes-us-west-2c kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-98-141.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:c5.large topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2c] map[csi.volume.kubernetes.io/nodeid:{"efs.csi.aws.com":"i-00825eb655ec01817"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2023-02-06 18:34:21 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/instancegroup":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-02-06 18:34:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} } {kubelet Update v1 2023-02-06 18:35:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-aws-ebs":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-aws-ebs":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2c/i-00825eb655ec01817,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{25 0} {<nil>} 25 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{133003395072 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3862937600 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{25 0} {<nil>} 25 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{119703055367 0} {<nil>} 119703055367 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3758080000 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-02-06 18:34:27 +0000 UTC,LastTransitionTime:2023-02-06 18:34:27 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-06 18:39:22 +0000 UTC,LastTransitionTime:2023-02-06 18:34:21 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-06 18:39:22 +0000 UTC,LastTransitionTime:2023-02-06 18:34:21 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-06 18:39:22 +0000 UTC,LastTransitionTime:2023-02-06 18:34:21 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-06 18:39:22 +0000 UTC,LastTransitionTime:2023-02-06 18:34:24 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.98.141,},NodeAddress{Type:ExternalIP,Address:34.214.50.217,},NodeAddress{Type:Hostname,Address:ip-172-20-98-141.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-98-141.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-34-214-50-217.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec287f07067fd27916bc5be6673e7c47,SystemUUID:ec287f07-067f-d279-16bc-5be6673e7c47,BootID:e1a83e6f-430c-43a4-9a39-2738d97aeeba,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.20.8,KubeProxyVersion:v1.20.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[607362164682.dkr.ecr.us-west-2.amazonaws.com/aws-efs-csi-driver@sha256:00fcde998e6653147443f7807194644d5ca9273e83cd9af3b4ca996514181339 607362164682.dkr.ecr.us-west-2.amazonaws.com/aws-efs-csi-driver:30617],SizeBytes:501573866,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:702a992280fb7c3303e84a5801acbb4c9c7fcf48cffe0e9c8be3f0c60f74cf89 k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.4],SizeBytes:112029652,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:0c867c82a0a8ce6d093595f9d2e4b10517d6c9c26323075de9d82d9f7d056bfc k8s.gcr.io/kube-proxy:v1.20.8],SizeBytes:52056682,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:758db666ac7028534dba72e7e9bb1e57bb81b8196f976f7a5cc351ef8b3529e1 k8s.gcr.io/e2e-test-images/agnhost:2.32],SizeBytes:50002177,},ContainerImage{Names:[docker.io/coredns/coredns@sha256:642ff9910da6ea9a8624b0234eef52af9ca75ecbec474c5507cb096bdfbae4e5 docker.io/coredns/coredns:1.8.3],SizeBytes:12893350,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:503b7abb89e57383eba61cc8a9cb0b495ea575c516108f7d972a6ff6e1ab3c9b k8s.gcr.io/e2e-test-images/nginx:1.14-1],SizeBytes:6979365,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/node-driver-registrar@sha256:9cd9ef74078997d4d05f5061b6a4948b54b591bb5152675f45a183c3a1cbbfd8 public.ecr.aws/eks-distro/kubernetes-csi/node-driver-registrar:v2.6.2-eks-1-25-latest],SizeBytes:6553584,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/livenessprobe@sha256:d790820d19a6253ee31418be4d1a9ae023d4a6b64c5591f8f031b4194828cc5b public.ecr.aws/eks-distro/kubernetes-csi/livenessprobe:v2.8.0-eks-1-25-latest],SizeBytes:6005708,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Feb 6 18:40:16.990: INFO: Logging kubelet events for node ip-172-20-98-141.us-west-2.compute.internal Feb 6 18:40:17.067: INFO: Logging pods the kubelet thinks is on node ip-172-20-98-141.us-west-2.compute.internal Feb 6 18:40:17.143: INFO: coredns-8f5559c9b-l726x started at 2023-02-06 18:34:30 +0000 UTC (0+1 container statuses recorded) Feb 6 18:40:17.143: INFO: Container coredns ready: true, restart count 0 Feb 6 18:40:17.143: INFO: efs-csi-node-5tj82 started at 2023-02-06 18:34:51 +0000 UTC (0+3 container statuses recorded) Feb 6 18:40:17.143: INFO: Container csi-driver-registrar ready: true, restart count 0 Feb 6 18:40:17.143: INFO: Container efs-plugin ready: true, restart count 0 Feb 6 18:40:17.143: INFO: Container liveness-probe ready: true, restart count 0 Feb 6 18:40:17.143: INFO: pod-subpath-test-dynamicpv-58gd started at 2023-02-06 18:39:29 +0000 UTC (1+2 container statuses recorded) Feb 6 18:40:17.143: INFO: Init container init-volume-dynamicpv-58gd ready: true, restart count 0 Feb 6 18:40:17.143: INFO: Container test-container-subpath-dynamicpv-58gd ready: true, restart count 3 Feb 6 18:40:17.143: INFO: Container test-container-volume-dynamicpv-58gd ready: true, restart count 0 Feb 6 18:40:17.143: INFO: pod-50c71565-c0fb-47b0-aefd-001ebd3297fd started at 2023-02-06 18:38:44 +0000 UTC (0+1 container statuses recorded) Feb 6 18:40:17.143: INFO: Container write-pod ready: false, restart count 0 Feb 6 18:40:17.143: INFO: kube-proxy-ip-172-20-98-141.us-west-2.compute.internal started at 2023-02-06 18:33:47 +0000 UTC (0+1 container statuses recorded) Feb 6 18:40:17.143: INFO: Container kube-proxy ready: true, restart count 0 Feb 6 18:40:17.414: INFO: Latency metrics for node ip-172-20-98-141.us-west-2.compute.internal Feb 6 18:40:17.414: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "provisioning-3133" for this suite. [AfterEach] [efs-csi] EFS CSI /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "efs-7996". �[1mSTEP�[0m: Found 0 events. Feb 6 18:40:17.688: INFO: POD NODE PHASE GRACE CONDITIONS Feb 6 18:40:17.688: INFO: Feb 6 18:40:17.756: INFO: Logging node info for node ip-172-20-36-201.us-west-2.compute.internal Feb 6 18:40:17.823: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-36-201.us-west-2.compute.internal 9d8ee86e-9677-4989-8045-990fc4c97d74 2484 0 2023-02-06 18:34:29 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kops.k8s.io/instancegroup:nodes-us-west-2a kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-36-201.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:c5.large topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[csi.volume.kubernetes.io/nodeid:{"efs.csi.aws.com":"i-08a0198709884d2e0"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2023-02-06 18:34:29 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/instancegroup":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-02-06 18:34:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} } {kubelet Update v1 2023-02-06 18:39:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-aws-ebs":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-aws-ebs":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-08a0198709884d2e0,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{25 0} {<nil>} 25 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{133003395072 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3862937600 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{25 0} {<nil>} 25 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{119703055367 0} {<nil>} 119703055367 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3758080000 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-02-06 18:34:37 +0000 UTC,LastTransitionTime:2023-02-06 18:34:37 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-06 18:39:00 +0000 UTC,LastTransitionTime:2023-02-06 18:34:29 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-06 18:39:00 +0000 UTC,LastTransitionTime:2023-02-06 18:34:29 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-06 18:39:00 +0000 UTC,LastTransitionTime:2023-02-06 18:34:29 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-06 18:39:00 +0000 UTC,LastTransitionTime:2023-02-06 18:34:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.36.201,},NodeAddress{Type:ExternalIP,Address:52.24.141.34,},NodeAddress{Type:Hostname,Address:ip-172-20-36-201.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-36-201.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-52-24-141-34.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec22da743aa0e60d534d3e85ce3c0aae,SystemUUID:ec22da74-3aa0-e60d-534d-3e85ce3c0aae,BootID:61b651cd-be9a-4267-ac23-1bc34ec918e9,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.20.8,KubeProxyVersion:v1.20.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[607362164682.dkr.ecr.us-west-2.amazonaws.com/aws-efs-csi-driver@sha256:00fcde998e6653147443f7807194644d5ca9273e83cd9af3b4ca996514181339 607362164682.dkr.ecr.us-west-2.amazonaws.com/aws-efs-csi-driver:30617],SizeBytes:501573866,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:0c867c82a0a8ce6d093595f9d2e4b10517d6c9c26323075de9d82d9f7d056bfc k8s.gcr.io/kube-proxy:v1.20.8],SizeBytes:52056682,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/external-provisioner@sha256:e677f72d499e09557e20ba9b5ade9fbbc70b73f658b95226963215eaa9fdb1ad public.ecr.aws/eks-distro/kubernetes-csi/external-provisioner:v3.3.0-eks-1-25-latest],SizeBytes:13992120,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/node-driver-registrar@sha256:9cd9ef74078997d4d05f5061b6a4948b54b591bb5152675f45a183c3a1cbbfd8 public.ecr.aws/eks-distro/kubernetes-csi/node-driver-registrar:v2.6.2-eks-1-25-latest],SizeBytes:6553584,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/livenessprobe@sha256:d790820d19a6253ee31418be4d1a9ae023d4a6b64c5591f8f031b4194828cc5b public.ecr.aws/eks-distro/kubernetes-csi/livenessprobe:v2.8.0-eks-1-25-latest],SizeBytes:6005708,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Feb 6 18:40:17.824: INFO: Logging kubelet events for node ip-172-20-36-201.us-west-2.compute.internal Feb 6 18:40:17.895: INFO: Logging pods the kubelet thinks is on node ip-172-20-36-201.us-west-2.compute.internal Feb 6 18:40:17.965: INFO: kube-proxy-ip-172-20-36-201.us-west-2.compute.internal started at 2023-02-06 18:33:56 +0000 UTC (0+1 container statuses recorded) Feb 6 18:40:17.965: INFO: Container kube-proxy ready: true, restart count 0 Feb 6 18:40:17.965: INFO: efs-csi-node-wlkdg started at 2023-02-06 18:39:24 +0000 UTC (0+3 container statuses recorded) Feb 6 18:40:17.965: INFO: Container csi-driver-registrar ready: true, restart count 0 Feb 6 18:40:17.965: INFO: Container efs-plugin ready: true, restart count 0 Feb 6 18:40:17.965: INFO: Container liveness-probe ready: true, restart count 0 Feb 6 18:40:17.965: INFO: efs-csi-controller-6f8fcdc46b-zjxxh started at 2023-02-06 18:34:51 +0000 UTC (0+3 container statuses recorded) Feb 6 18:40:17.965: INFO: Container csi-provisioner ready: true, restart count 0 Feb 6 18:40:17.965: INFO: Container efs-plugin ready: true, restart count 0 Feb 6 18:40:17.965: INFO: Container liveness-probe ready: true, restart count 0 Feb 6 18:40:17.965: INFO: pvc-tester-mdj88 started at 2023-02-06 18:38:54 +0000 UTC (0+1 container statuses recorded) Feb 6 18:40:17.965: INFO: Container write-pod ready: false, restart count 0 Feb 6 18:40:18.241: INFO: Latency metrics for node ip-172-20-36-201.us-west-2.compute.internal Feb 6 18:40:18.241: INFO: Logging node info for node ip-172-20-40-80.us-west-2.compute.internal Feb 6 18:40:18.308: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-40-80.us-west-2.compute.internal b29b340b-f3ce-4742-ba88-f250a2d9421e 885 0 2023-02-06 18:33:13 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kops.k8s.io/instancegroup:master-us-west-2a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-40-80.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/control-plane: node-role.kubernetes.io/master: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:t3.medium topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[csi.volume.kubernetes.io/nodeid:{"efs.csi.aws.com":"i-05fabd0b52ed672a2"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{protokube Update v1 2023-02-06 18:33:18 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/control-plane":{},"f:node-role.kubernetes.io/master":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-02-06 18:33:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} } {kops-controller Update v1 2023-02-06 18:33:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/instancegroup":{}}}} } {kubelet Update v1 2023-02-06 18:35:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-aws-ebs":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-aws-ebs":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-05fabd0b52ed672a2,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{25 0} {<nil>} 25 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{66404147200 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051677184 0} {<nil>} 3956716Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{25 0} {<nil>} 25 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{59763732382 0} {<nil>} 59763732382 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946819584 0} {<nil>} 3854316Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-02-06 18:33:27 +0000 UTC,LastTransitionTime:2023-02-06 18:33:27 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-06 18:35:34 +0000 UTC,LastTransitionTime:2023-02-06 18:33:13 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-06 18:35:34 +0000 UTC,LastTransitionTime:2023-02-06 18:33:13 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-06 18:35:34 +0000 UTC,LastTransitionTime:2023-02-06 18:33:13 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-06 18:35:34 +0000 UTC,LastTransitionTime:2023-02-06 18:33:26 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.40.80,},NodeAddress{Type:ExternalIP,Address:35.87.143.68,},NodeAddress{Type:Hostname,Address:ip-172-20-40-80.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-40-80.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-87-143-68.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2f6cf66646ff5aa97c9705a7214303,SystemUUID:ec2f6cf6-6646-ff5a-a97c-9705a7214303,BootID:f158a57b-0ffd-4c66-a926-1b48d08cfda6,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.20.8,KubeProxyVersion:v1.20.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[607362164682.dkr.ecr.us-west-2.amazonaws.com/aws-efs-csi-driver@sha256:00fcde998e6653147443f7807194644d5ca9273e83cd9af3b4ca996514181339 607362164682.dkr.ecr.us-west-2.amazonaws.com/aws-efs-csi-driver:30617],SizeBytes:501573866,},ContainerImage{Names:[k8s.gcr.io/etcdadm/etcd-manager@sha256:ebb73d3d4a99da609f9e01c556cd9f9aa7a0aecba8f5bc5588d7c45eb38e3a7e k8s.gcr.io/etcdadm/etcd-manager:3.0.20210430],SizeBytes:171082409,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:0c867c82a0a8ce6d093595f9d2e4b10517d6c9c26323075de9d82d9f7d056bfc k8s.gcr.io/kube-proxy:v1.20.8],SizeBytes:52056682,},ContainerImage{Names:[k8s.gcr.io/kops/dns-controller@sha256:f3724709f264bd47d2251f4ec5b16ec5482e8a2d65da006cd3165eb4da0bd3d1 k8s.gcr.io/kops/dns-controller:1.21.0],SizeBytes:40960953,},ContainerImage{Names:[k8s.gcr.io/kops/kops-controller@sha256:05b7d6511df0084aed954a009099402d2a7e7227adf0f410c4583204e6f76429 k8s.gcr.io/kops/kops-controller:1.21.0],SizeBytes:40618104,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:531ffd92bd954f5c27002ce11502771146e7c867c09a6e1755631953ff584df4 k8s.gcr.io/kube-apiserver:v1.20.8],SizeBytes:30462643,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:13509f0b36bbd4d2d142cf4c35d77f32ec3728975d96cf833b60b484effa8c43 k8s.gcr.io/kube-controller-manager:v1.20.8],SizeBytes:29554511,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:6fc53cbc3f035ba2b0ac9127e9dc5aa7a95b73f041f7cc14c36cdfc095b13080 k8s.gcr.io/kube-scheduler:v1.20.8],SizeBytes:14243733,},ContainerImage{Names:[k8s.gcr.io/kops/kube-apiserver-healthcheck@sha256:d772e49a0ae9dea319f26aaa40d58a123860b19da6378d29898eb30208359241 k8s.gcr.io/kops/kube-apiserver-healthcheck:1.21.0],SizeBytes:11771024,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/node-driver-registrar@sha256:9cd9ef74078997d4d05f5061b6a4948b54b591bb5152675f45a183c3a1cbbfd8 public.ecr.aws/eks-distro/kubernetes-csi/node-driver-registrar:v2.6.2-eks-1-25-latest],SizeBytes:6553584,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/livenessprobe@sha256:d790820d19a6253ee31418be4d1a9ae023d4a6b64c5591f8f031b4194828cc5b public.ecr.aws/eks-distro/kubernetes-csi/livenessprobe:v2.8.0-eks-1-25-latest],SizeBytes:6005708,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Feb 6 18:40:18.308: INFO: Logging kubelet events for node ip-172-20-40-80.us-west-2.compute.internal Feb 6 18:40:18.383: INFO: Logging pods the kubelet thinks is on node ip-172-20-40-80.us-west-2.compute.internal Feb 6 18:40:18.455: INFO: kube-apiserver-ip-172-20-40-80.us-west-2.compute.internal started at 2023-02-06 18:32:29 +0000 UTC (0+2 container statuses recorded) Feb 6 18:40:18.455: INFO: Container healthcheck ready: true, restart count 0 Feb 6 18:40:18.455: INFO: Container kube-apiserver ready: true, restart count 0 Feb 6 18:40:18.455: INFO: dns-controller-5d59c585d8-wtbbd started at 2023-02-06 18:33:29 +0000 UTC (0+1 container statuses recorded) Feb 6 18:40:18.455: INFO: Container dns-controller ready: true, restart count 0 Feb 6 18:40:18.455: INFO: etcd-manager-main-ip-172-20-40-80.us-west-2.compute.internal started at 2023-02-06 18:32:29 +0000 UTC (0+1 container statuses recorded) Feb 6 18:40:18.455: INFO: Container etcd-manager ready: true, restart count 0 Feb 6 18:40:18.455: INFO: kube-controller-manager-ip-172-20-40-80.us-west-2.compute.internal started at 2023-02-06 18:32:29 +0000 UTC (0+1 container statuses recorded) Feb 6 18:40:18.455: INFO: Container kube-controller-manager ready: true, restart count 0 Feb 6 18:40:18.455: INFO: kube-proxy-ip-172-20-40-80.us-west-2.compute.internal started at 2023-02-06 18:32:29 +0000 UTC (0+1 container statuses recorded) Feb 6 18:40:18.455: INFO: Container kube-proxy ready: true, restart count 0 Feb 6 18:40:18.455: INFO: kops-controller-qjqj9 started at 2023-02-06 18:33:29 +0000 UTC (0+1 container statuses recorded) Feb 6 18:40:18.455: INFO: Container kops-controller ready: true, restart count 0 Feb 6 18:40:18.455: INFO: efs-csi-node-p8468 started at 2023-02-06 18:34:50 +0000 UTC (0+3 container statuses recorded) Feb 6 18:40:18.455: INFO: Container csi-driver-registrar ready: true, restart count 0 Feb 6 18:40:18.455: INFO: Container efs-plugin ready: true, restart count 0 Feb 6 18:40:18.455: INFO: Container liveness-probe ready: true, restart count 0 Feb 6 18:40:18.455: INFO: kube-scheduler-ip-172-20-40-80.us-west-2.compute.internal started at 2023-02-06 18:32:29 +0000 UTC (0+1 container statuses recorded) Feb 6 18:40:18.455: INFO: Container kube-scheduler ready: true, restart count 0 Feb 6 18:40:18.455: INFO: etcd-manager-events-ip-172-20-40-80.us-west-2.compute.internal started at 2023-02-06 18:32:29 +0000 UTC (0+1 container statuses recorded) Feb 6 18:40:18.455: INFO: Container etcd-manager ready: true, restart count 0 Feb 6 18:40:18.808: INFO: Latency metrics for node ip-172-20-40-80.us-west-2.compute.internal Feb 6 18:40:18.808: INFO: Logging node info for node ip-172-20-89-136.us-west-2.compute.internal Feb 6 18:40:18.875: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-89-136.us-west-2.compute.internal e335751a-165b-4457-9c6b-241b6473529f 2606 0 2023-02-06 18:34:22 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2b kops.k8s.io/instancegroup:nodes-us-west-2b kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-89-136.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:c5.large topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2b] map[csi.volume.kubernetes.io/nodeid:{"efs.csi.aws.com":"i-0ea19d5a1f3b6be9f"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2023-02-06 18:34:22 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/instancegroup":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-02-06 18:34:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} } {kubelet Update v1 2023-02-06 18:35:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-aws-ebs":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-aws-ebs":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2b/i-0ea19d5a1f3b6be9f,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{25 0} {<nil>} 25 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{133003395072 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3862937600 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{25 0} {<nil>} 25 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{119703055367 0} {<nil>} 119703055367 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3758080000 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-02-06 18:34:27 +0000 UTC,LastTransitionTime:2023-02-06 18:34:27 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-06 18:39:52 +0000 UTC,LastTransitionTime:2023-02-06 18:34:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-06 18:39:52 +0000 UTC,LastTransitionTime:2023-02-06 18:34:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-06 18:39:52 +0000 UTC,LastTransitionTime:2023-02-06 18:34:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-06 18:39:52 +0000 UTC,LastTransitionTime:2023-02-06 18:34:26 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.89.136,},NodeAddress{Type:ExternalIP,Address:52.12.97.247,},NodeAddress{Type:Hostname,Address:ip-172-20-89-136.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-89-136.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-52-12-97-247.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec257e7678d6046236e12dbbabe2f469,SystemUUID:ec257e76-78d6-0462-36e1-2dbbabe2f469,BootID:3909e2da-37b0-4606-abae-ac53d743344c,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.20.8,KubeProxyVersion:v1.20.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[607362164682.dkr.ecr.us-west-2.amazonaws.com/aws-efs-csi-driver@sha256:00fcde998e6653147443f7807194644d5ca9273e83cd9af3b4ca996514181339 607362164682.dkr.ecr.us-west-2.amazonaws.com/aws-efs-csi-driver:30617],SizeBytes:501573866,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:0c867c82a0a8ce6d093595f9d2e4b10517d6c9c26323075de9d82d9f7d056bfc k8s.gcr.io/kube-proxy:v1.20.8],SizeBytes:52056682,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:758db666ac7028534dba72e7e9bb1e57bb81b8196f976f7a5cc351ef8b3529e1 k8s.gcr.io/e2e-test-images/agnhost:2.32],SizeBytes:50002177,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler@sha256:67640771ad9fc56f109d5b01e020f0c858e7c890bb0eb15ba0ebd325df3285e7 k8s.gcr.io/cpa/cluster-proportional-autoscaler:1.8.3],SizeBytes:15191740,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/external-provisioner@sha256:e677f72d499e09557e20ba9b5ade9fbbc70b73f658b95226963215eaa9fdb1ad public.ecr.aws/eks-distro/kubernetes-csi/external-provisioner:v3.3.0-eks-1-25-latest],SizeBytes:13992120,},ContainerImage{Names:[docker.io/coredns/coredns@sha256:642ff9910da6ea9a8624b0234eef52af9ca75ecbec474c5507cb096bdfbae4e5 docker.io/coredns/coredns:1.8.3],SizeBytes:12893350,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/node-driver-registrar@sha256:9cd9ef74078997d4d05f5061b6a4948b54b591bb5152675f45a183c3a1cbbfd8 public.ecr.aws/eks-distro/kubernetes-csi/node-driver-registrar:v2.6.2-eks-1-25-latest],SizeBytes:6553584,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/livenessprobe@sha256:d790820d19a6253ee31418be4d1a9ae023d4a6b64c5591f8f031b4194828cc5b public.ecr.aws/eks-distro/kubernetes-csi/livenessprobe:v2.8.0-eks-1-25-latest],SizeBytes:6005708,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Feb 6 18:40:18.877: INFO: Logging kubelet events for node ip-172-20-89-136.us-west-2.compute.internal Feb 6 18:40:18.947: INFO: Logging pods the kubelet thinks is on node ip-172-20-89-136.us-west-2.compute.internal Feb 6 18:40:19.018: INFO: coredns-8f5559c9b-89pvw started at 2023-02-06 18:34:35 +0000 UTC (0+1 container statuses recorded) Feb 6 18:40:19.018: INFO: Container coredns ready: true, restart count 0 Feb 6 18:40:19.018: INFO: efs-csi-node-2fqrk started at 2023-02-06 18:34:50 +0000 UTC (0+3 container statuses recorded) Feb 6 18:40:19.018: INFO: Container csi-driver-registrar ready: true, restart count 0 Feb 6 18:40:19.018: INFO: Container efs-plugin ready: true, restart count 0 Feb 6 18:40:19.018: INFO: Container liveness-probe ready: true, restart count 0 Feb 6 18:40:19.018: INFO: efs-csi-controller-6f8fcdc46b-2dpxk started at 2023-02-06 18:34:51 +0000 UTC (0+3 container statuses recorded) Feb 6 18:40:19.018: INFO: Container csi-provisioner ready: true, restart count 0 Feb 6 18:40:19.018: INFO: Container efs-plugin ready: true, restart count 0 Feb 6 18:40:19.018: INFO: Container liveness-probe ready: true, restart count 0 Feb 6 18:40:19.018: INFO: kube-proxy-ip-172-20-89-136.us-west-2.compute.internal started at 2023-02-06 18:33:48 +0000 UTC (0+1 container statuses recorded) Feb 6 18:40:19.018: INFO: Container kube-proxy ready: true, restart count 0 Feb 6 18:40:19.018: INFO: coredns-autoscaler-6f594f4c58-ml9dm started at 2023-02-06 18:34:32 +0000 UTC (0+1 container statuses recorded) Feb 6 18:40:19.018: INFO: Container autoscaler ready: true, restart count 0 Feb 6 18:40:19.303: INFO: Latency metrics for node ip-172-20-89-136.us-west-2.compute.internal Feb 6 18:40:19.304: INFO: Logging node info for node ip-172-20-98-141.us-west-2.compute.internal Feb 6 18:40:19.371: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-98-141.us-west-2.compute.internal c15e2c71-936d-4793-b30a-01e71954ef8c 2278 0 2023-02-06 18:34:21 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2c kops.k8s.io/instancegroup:nodes-us-west-2c kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-98-141.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:c5.large topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2c] map[csi.volume.kubernetes.io/nodeid:{"efs.csi.aws.com":"i-00825eb655ec01817"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2023-02-06 18:34:21 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/instancegroup":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-02-06 18:34:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} } {kubelet Update v1 2023-02-06 18:35:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-aws-ebs":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-aws-ebs":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2c/i-00825eb655ec01817,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{25 0} {<nil>} 25 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{133003395072 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3862937600 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{25 0} {<nil>} 25 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{119703055367 0} {<nil>} 119703055367 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3758080000 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-02-06 18:34:27 +0000 UTC,LastTransitionTime:2023-02-06 18:34:27 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-06 18:39:22 +0000 UTC,LastTransitionTime:2023-02-06 18:34:21 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-06 18:39:22 +0000 UTC,LastTransitionTime:2023-02-06 18:34:21 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-06 18:39:22 +0000 UTC,LastTransitionTime:2023-02-06 18:34:21 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-06 18:39:22 +0000 UTC,LastTransitionTime:2023-02-06 18:34:24 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.98.141,},NodeAddress{Type:ExternalIP,Address:34.214.50.217,},NodeAddress{Type:Hostname,Address:ip-172-20-98-141.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-98-141.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-34-214-50-217.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec287f07067fd27916bc5be6673e7c47,SystemUUID:ec287f07-067f-d279-16bc-5be6673e7c47,BootID:e1a83e6f-430c-43a4-9a39-2738d97aeeba,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.20.8,KubeProxyVersion:v1.20.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[607362164682.dkr.ecr.us-west-2.amazonaws.com/aws-efs-csi-driver@sha256:00fcde998e6653147443f7807194644d5ca9273e83cd9af3b4ca996514181339 607362164682.dkr.ecr.us-west-2.amazonaws.com/aws-efs-csi-driver:30617],SizeBytes:501573866,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:702a992280fb7c3303e84a5801acbb4c9c7fcf48cffe0e9c8be3f0c60f74cf89 k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.4],SizeBytes:112029652,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:0c867c82a0a8ce6d093595f9d2e4b10517d6c9c26323075de9d82d9f7d056bfc k8s.gcr.io/kube-proxy:v1.20.8],SizeBytes:52056682,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:758db666ac7028534dba72e7e9bb1e57bb81b8196f976f7a5cc351ef8b3529e1 k8s.gcr.io/e2e-test-images/agnhost:2.32],SizeBytes:50002177,},ContainerImage{Names:[docker.io/coredns/coredns@sha256:642ff9910da6ea9a8624b0234eef52af9ca75ecbec474c5507cb096bdfbae4e5 docker.io/coredns/coredns:1.8.3],SizeBytes:12893350,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:503b7abb89e57383eba61cc8a9cb0b495ea575c516108f7d972a6ff6e1ab3c9b k8s.gcr.io/e2e-test-images/nginx:1.14-1],SizeBytes:6979365,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/node-driver-registrar@sha256:9cd9ef74078997d4d05f5061b6a4948b54b591bb5152675f45a183c3a1cbbfd8 public.ecr.aws/eks-distro/kubernetes-csi/node-driver-registrar:v2.6.2-eks-1-25-latest],SizeBytes:6553584,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/livenessprobe@sha256:d790820d19a6253ee31418be4d1a9ae023d4a6b64c5591f8f031b4194828cc5b public.ecr.aws/eks-distro/kubernetes-csi/livenessprobe:v2.8.0-eks-1-25-latest],SizeBytes:6005708,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Feb 6 18:40:19.372: INFO: Logging kubelet events for node ip-172-20-98-141.us-west-2.compute.internal Feb 6 18:40:19.441: INFO: Logging pods the kubelet thinks is on node ip-172-20-98-141.us-west-2.compute.internal Feb 6 18:40:19.514: INFO: pod-subpath-test-dynamicpv-2g6k started at 2023-02-06 18:40:19 +0000 UTC (1+1 container statuses recorded) Feb 6 18:40:19.514: INFO: Init container init-volume-dynamicpv-2g6k ready: false, restart count 0 Feb 6 18:40:19.514: INFO: Container test-container-subpath-dynamicpv-2g6k ready: false, restart count 0 Feb 6 18:40:19.514: INFO: kube-proxy-ip-172-20-98-141.us-west-2.compute.internal started at 2023-02-06 18:33:47 +0000 UTC (0+1 container statuses recorded) Feb 6 18:40:19.514: INFO: Container kube-proxy ready: true, restart count 0 Feb 6 18:40:19.514: INFO: coredns-8f5559c9b-l726x started at 2023-02-06 18:34:30 +0000 UTC (0+1 container statuses recorded) Feb 6 18:40:19.514: INFO: Container coredns ready: true, restart count 0 Feb 6 18:40:19.514: INFO: efs-csi-node-5tj82 started at 2023-02-06 18:34:51 +0000 UTC (0+3 container statuses recorded) Feb 6 18:40:19.514: INFO: Container csi-driver-registrar ready: true, restart count 0 Feb 6 18:40:19.514: INFO: Container efs-plugin ready: true, restart count 0 Feb 6 18:40:19.514: INFO: Container liveness-probe ready: true, restart count 0 Feb 6 18:40:19.514: INFO: pod-subpath-test-dynamicpv-58gd started at 2023-02-06 18:39:29 +0000 UTC (1+2 container statuses recorded) Feb 6 18:40:19.514: INFO: Init container init-volume-dynamicpv-58gd ready: true, restart count 0 Feb 6 18:40:19.514: INFO: Container test-container-subpath-dynamicpv-58gd ready: true, restart count 3 Feb 6 18:40:19.514: INFO: Container test-container-volume-dynamicpv-58gd ready: true, restart count 0 Feb 6 18:40:19.514: INFO: pod-50c71565-c0fb-47b0-aefd-001ebd3297fd started at 2023-02-06 18:38:44 +0000 UTC (0+1 container statuses recorded) Feb 6 18:40:19.514: INFO: Container write-pod ready: false, restart count 0 Feb 6 18:40:19.813: INFO: Latency metrics for node ip-172-20-98-141.us-west-2.compute.internal Feb 6 18:40:19.813: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "efs-7996" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=EFS\sCSI\sSuite\s\[efs\-csi\]\sEFS\sCSI\s\[Driver\:\sefs\.csi\.aws\.com\]\sshould\scontinue\sreading\/writing\swithout\shanging\safter\sthe\sdriver\spod\sis\srestarted$'
/home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/test/e2e/e2e.go:268 Feb 6 18:39:55.403: timed out verifying exec in pod succeeded /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/vendor/github.com/onsi/ginkgo/internal/leafnodes/runner.go:113from junit_04.xml
[BeforeEach] [efs-csi] EFS CSI /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/test/e2e/e2e.go:219 [BeforeEach] [efs-csi] EFS CSI /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Feb 6 18:38:54.336: INFO: >>> kubeConfig: /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/hack/e2e/csi-test-artifacts/test-cluster-30617.k8s.local.kops.kubeconfig �[1mSTEP�[0m: Building a namespace api object, basename efs �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [It] should continue reading/writing without hanging after the driver pod is restarted /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/test/e2e/e2e.go:268 �[1mSTEP�[0m: Creating efs pvc & pv �[1mSTEP�[0m: Creating pod on node "ip-172-20-36-201.us-west-2.compute.internal" to mount pvc "efs-9718" and run "touch /mnt/volume1/efs-9718-2023-02-06T18:38:54Z && trap exit TERM; while true; do sleep 1; done" �[1mSTEP�[0m: Getting driver pod on node "ip-172-20-36-201.us-west-2.compute.internal" �[1mSTEP�[0m: Deleting driver pod "efs-csi-node-ctmvl" on node "ip-172-20-36-201.us-west-2.compute.internal" Feb 6 18:39:23.195: INFO: Deleting pod "efs-csi-node-ctmvl" in namespace "kube-system" Feb 6 18:39:23.265: INFO: Wait up to 5m0s for pod "efs-csi-node-ctmvl" to be fully deleted �[1mSTEP�[0m: Execing a write via the pod on node "ip-172-20-36-201.us-west-2.compute.internal" Feb 6 18:39:25.398: INFO: ExecWithOptions {Command:[/bin/sh -c touch /mnt/volume1/efs-9718-2023-02-06T18:39:25Z] Namespace:efs-9718 PodName:pvc-tester-mdj88 ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Feb 6 18:39:25.398: INFO: >>> kubeConfig: /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/hack/e2e/csi-test-artifacts/test-cluster-30617.k8s.local.kops.kubeconfig Feb 6 18:39:55.403: FAIL: timed out verifying exec in pod succeeded Full Stack Trace github.com/kubernetes-sigs/aws-efs-csi-driver/test/e2e.TestEFSCSI(0x408659?) /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/test/e2e/e2e_test.go:102 +0x311 testing.tRunner(0xc000502820, 0x1da2eb8) /usr/local/go/src/testing/testing.go:1446 +0x10b created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1493 +0x35f [AfterEach] [efs-csi] EFS CSI /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "efs-9718". �[1mSTEP�[0m: Found 4 events. Feb 6 18:39:55.542: INFO: At 2023-02-06 18:38:55 +0000 UTC - event for pvc-tester-mdj88: {kubelet ip-172-20-36-201.us-west-2.compute.internal} FailedMount: Unable to attach or mount volumes: unmounted volumes=[volume1], unattached volumes=[volume1 default-token-4z4xk]: error processing PVC efs-9718/efs-9718: PVC is not bound Feb 6 18:39:55.542: INFO: At 2023-02-06 18:39:21 +0000 UTC - event for pvc-tester-mdj88: {kubelet ip-172-20-36-201.us-west-2.compute.internal} Pulled: Container image "k8s.gcr.io/e2e-test-images/busybox:1.29-1" already present on machine Feb 6 18:39:55.542: INFO: At 2023-02-06 18:39:21 +0000 UTC - event for pvc-tester-mdj88: {kubelet ip-172-20-36-201.us-west-2.compute.internal} Created: Created container write-pod Feb 6 18:39:55.542: INFO: At 2023-02-06 18:39:21 +0000 UTC - event for pvc-tester-mdj88: {kubelet ip-172-20-36-201.us-west-2.compute.internal} Started: Started container write-pod Feb 6 18:39:55.610: INFO: POD NODE PHASE GRACE CONDITIONS Feb 6 18:39:55.610: INFO: pvc-tester-mdj88 ip-172-20-36-201.us-west-2.compute.internal Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-02-06 18:38:54 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-02-06 18:39:21 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-02-06 18:39:21 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-02-06 18:38:54 +0000 UTC }] Feb 6 18:39:55.610: INFO: Feb 6 18:39:55.678: INFO: Logging node info for node ip-172-20-36-201.us-west-2.compute.internal Feb 6 18:39:55.754: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-36-201.us-west-2.compute.internal 9d8ee86e-9677-4989-8045-990fc4c97d74 2484 0 2023-02-06 18:34:29 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kops.k8s.io/instancegroup:nodes-us-west-2a kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-36-201.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:c5.large topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[csi.volume.kubernetes.io/nodeid:{"efs.csi.aws.com":"i-08a0198709884d2e0"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2023-02-06 18:34:29 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/instancegroup":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-02-06 18:34:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} } {kubelet Update v1 2023-02-06 18:39:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-aws-ebs":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-aws-ebs":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-08a0198709884d2e0,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{25 0} {<nil>} 25 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{133003395072 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3862937600 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{25 0} {<nil>} 25 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{119703055367 0} {<nil>} 119703055367 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3758080000 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-02-06 18:34:37 +0000 UTC,LastTransitionTime:2023-02-06 18:34:37 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-06 18:39:00 +0000 UTC,LastTransitionTime:2023-02-06 18:34:29 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-06 18:39:00 +0000 UTC,LastTransitionTime:2023-02-06 18:34:29 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-06 18:39:00 +0000 UTC,LastTransitionTime:2023-02-06 18:34:29 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-06 18:39:00 +0000 UTC,LastTransitionTime:2023-02-06 18:34:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.36.201,},NodeAddress{Type:ExternalIP,Address:52.24.141.34,},NodeAddress{Type:Hostname,Address:ip-172-20-36-201.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-36-201.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-52-24-141-34.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec22da743aa0e60d534d3e85ce3c0aae,SystemUUID:ec22da74-3aa0-e60d-534d-3e85ce3c0aae,BootID:61b651cd-be9a-4267-ac23-1bc34ec918e9,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.20.8,KubeProxyVersion:v1.20.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[607362164682.dkr.ecr.us-west-2.amazonaws.com/aws-efs-csi-driver@sha256:00fcde998e6653147443f7807194644d5ca9273e83cd9af3b4ca996514181339 607362164682.dkr.ecr.us-west-2.amazonaws.com/aws-efs-csi-driver:30617],SizeBytes:501573866,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:0c867c82a0a8ce6d093595f9d2e4b10517d6c9c26323075de9d82d9f7d056bfc k8s.gcr.io/kube-proxy:v1.20.8],SizeBytes:52056682,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/external-provisioner@sha256:e677f72d499e09557e20ba9b5ade9fbbc70b73f658b95226963215eaa9fdb1ad public.ecr.aws/eks-distro/kubernetes-csi/external-provisioner:v3.3.0-eks-1-25-latest],SizeBytes:13992120,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/node-driver-registrar@sha256:9cd9ef74078997d4d05f5061b6a4948b54b591bb5152675f45a183c3a1cbbfd8 public.ecr.aws/eks-distro/kubernetes-csi/node-driver-registrar:v2.6.2-eks-1-25-latest],SizeBytes:6553584,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/livenessprobe@sha256:d790820d19a6253ee31418be4d1a9ae023d4a6b64c5591f8f031b4194828cc5b public.ecr.aws/eks-distro/kubernetes-csi/livenessprobe:v2.8.0-eks-1-25-latest],SizeBytes:6005708,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Feb 6 18:39:55.754: INFO: Logging kubelet events for node ip-172-20-36-201.us-west-2.compute.internal Feb 6 18:39:55.875: INFO: Logging pods the kubelet thinks is on node ip-172-20-36-201.us-west-2.compute.internal Feb 6 18:39:55.956: INFO: kube-proxy-ip-172-20-36-201.us-west-2.compute.internal started at 2023-02-06 18:33:56 +0000 UTC (0+1 container statuses recorded) Feb 6 18:39:55.956: INFO: Container kube-proxy ready: true, restart count 0 Feb 6 18:39:55.956: INFO: efs-csi-node-wlkdg started at 2023-02-06 18:39:24 +0000 UTC (0+3 container statuses recorded) Feb 6 18:39:55.956: INFO: Container csi-driver-registrar ready: true, restart count 0 Feb 6 18:39:55.956: INFO: Container efs-plugin ready: true, restart count 0 Feb 6 18:39:55.956: INFO: Container liveness-probe ready: true, restart count 0 Feb 6 18:39:55.956: INFO: efs-csi-controller-6f8fcdc46b-zjxxh started at 2023-02-06 18:34:51 +0000 UTC (0+3 container statuses recorded) Feb 6 18:39:55.956: INFO: Container csi-provisioner ready: true, restart count 0 Feb 6 18:39:55.956: INFO: Container efs-plugin ready: true, restart count 0 Feb 6 18:39:55.956: INFO: Container liveness-probe ready: true, restart count 0 Feb 6 18:39:55.956: INFO: pvc-tester-mdj88 started at 2023-02-06 18:38:54 +0000 UTC (0+1 container statuses recorded) Feb 6 18:39:55.956: INFO: Container write-pod ready: true, restart count 0 Feb 6 18:39:56.324: INFO: Latency metrics for node ip-172-20-36-201.us-west-2.compute.internal Feb 6 18:39:56.324: INFO: Logging node info for node ip-172-20-40-80.us-west-2.compute.internal Feb 6 18:39:56.392: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-40-80.us-west-2.compute.internal b29b340b-f3ce-4742-ba88-f250a2d9421e 885 0 2023-02-06 18:33:13 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kops.k8s.io/instancegroup:master-us-west-2a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-40-80.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/control-plane: node-role.kubernetes.io/master: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:t3.medium topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[csi.volume.kubernetes.io/nodeid:{"efs.csi.aws.com":"i-05fabd0b52ed672a2"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{protokube Update v1 2023-02-06 18:33:18 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/control-plane":{},"f:node-role.kubernetes.io/master":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-02-06 18:33:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} } {kops-controller Update v1 2023-02-06 18:33:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/instancegroup":{}}}} } {kubelet Update v1 2023-02-06 18:35:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-aws-ebs":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-aws-ebs":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-05fabd0b52ed672a2,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{25 0} {<nil>} 25 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{66404147200 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051677184 0} {<nil>} 3956716Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{25 0} {<nil>} 25 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{59763732382 0} {<nil>} 59763732382 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946819584 0} {<nil>} 3854316Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-02-06 18:33:27 +0000 UTC,LastTransitionTime:2023-02-06 18:33:27 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-06 18:35:34 +0000 UTC,LastTransitionTime:2023-02-06 18:33:13 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-06 18:35:34 +0000 UTC,LastTransitionTime:2023-02-06 18:33:13 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-06 18:35:34 +0000 UTC,LastTransitionTime:2023-02-06 18:33:13 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-06 18:35:34 +0000 UTC,LastTransitionTime:2023-02-06 18:33:26 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.40.80,},NodeAddress{Type:ExternalIP,Address:35.87.143.68,},NodeAddress{Type:Hostname,Address:ip-172-20-40-80.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-40-80.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-87-143-68.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2f6cf66646ff5aa97c9705a7214303,SystemUUID:ec2f6cf6-6646-ff5a-a97c-9705a7214303,BootID:f158a57b-0ffd-4c66-a926-1b48d08cfda6,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.20.8,KubeProxyVersion:v1.20.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[607362164682.dkr.ecr.us-west-2.amazonaws.com/aws-efs-csi-driver@sha256:00fcde998e6653147443f7807194644d5ca9273e83cd9af3b4ca996514181339 607362164682.dkr.ecr.us-west-2.amazonaws.com/aws-efs-csi-driver:30617],SizeBytes:501573866,},ContainerImage{Names:[k8s.gcr.io/etcdadm/etcd-manager@sha256:ebb73d3d4a99da609f9e01c556cd9f9aa7a0aecba8f5bc5588d7c45eb38e3a7e k8s.gcr.io/etcdadm/etcd-manager:3.0.20210430],SizeBytes:171082409,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:0c867c82a0a8ce6d093595f9d2e4b10517d6c9c26323075de9d82d9f7d056bfc k8s.gcr.io/kube-proxy:v1.20.8],SizeBytes:52056682,},ContainerImage{Names:[k8s.gcr.io/kops/dns-controller@sha256:f3724709f264bd47d2251f4ec5b16ec5482e8a2d65da006cd3165eb4da0bd3d1 k8s.gcr.io/kops/dns-controller:1.21.0],SizeBytes:40960953,},ContainerImage{Names:[k8s.gcr.io/kops/kops-controller@sha256:05b7d6511df0084aed954a009099402d2a7e7227adf0f410c4583204e6f76429 k8s.gcr.io/kops/kops-controller:1.21.0],SizeBytes:40618104,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:531ffd92bd954f5c27002ce11502771146e7c867c09a6e1755631953ff584df4 k8s.gcr.io/kube-apiserver:v1.20.8],SizeBytes:30462643,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:13509f0b36bbd4d2d142cf4c35d77f32ec3728975d96cf833b60b484effa8c43 k8s.gcr.io/kube-controller-manager:v1.20.8],SizeBytes:29554511,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:6fc53cbc3f035ba2b0ac9127e9dc5aa7a95b73f041f7cc14c36cdfc095b13080 k8s.gcr.io/kube-scheduler:v1.20.8],SizeBytes:14243733,},ContainerImage{Names:[k8s.gcr.io/kops/kube-apiserver-healthcheck@sha256:d772e49a0ae9dea319f26aaa40d58a123860b19da6378d29898eb30208359241 k8s.gcr.io/kops/kube-apiserver-healthcheck:1.21.0],SizeBytes:11771024,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/node-driver-registrar@sha256:9cd9ef74078997d4d05f5061b6a4948b54b591bb5152675f45a183c3a1cbbfd8 public.ecr.aws/eks-distro/kubernetes-csi/node-driver-registrar:v2.6.2-eks-1-25-latest],SizeBytes:6553584,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/livenessprobe@sha256:d790820d19a6253ee31418be4d1a9ae023d4a6b64c5591f8f031b4194828cc5b public.ecr.aws/eks-distro/kubernetes-csi/livenessprobe:v2.8.0-eks-1-25-latest],SizeBytes:6005708,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Feb 6 18:39:56.393: INFO: Logging kubelet events for node ip-172-20-40-80.us-west-2.compute.internal Feb 6 18:39:56.466: INFO: Logging pods the kubelet thinks is on node ip-172-20-40-80.us-west-2.compute.internal Feb 6 18:39:56.574: INFO: kube-apiserver-ip-172-20-40-80.us-west-2.compute.internal started at 2023-02-06 18:32:29 +0000 UTC (0+2 container statuses recorded) Feb 6 18:39:56.574: INFO: Container healthcheck ready: true, restart count 0 Feb 6 18:39:56.574: INFO: Container kube-apiserver ready: true, restart count 0 Feb 6 18:39:56.574: INFO: dns-controller-5d59c585d8-wtbbd started at 2023-02-06 18:33:29 +0000 UTC (0+1 container statuses recorded) Feb 6 18:39:56.574: INFO: Container dns-controller ready: true, restart count 0 Feb 6 18:39:56.574: INFO: kube-scheduler-ip-172-20-40-80.us-west-2.compute.internal started at 2023-02-06 18:32:29 +0000 UTC (0+1 container statuses recorded) Feb 6 18:39:56.574: INFO: Container kube-scheduler ready: true, restart count 0 Feb 6 18:39:56.574: INFO: etcd-manager-events-ip-172-20-40-80.us-west-2.compute.internal started at 2023-02-06 18:32:29 +0000 UTC (0+1 container statuses recorded) Feb 6 18:39:56.574: INFO: Container etcd-manager ready: true, restart count 0 Feb 6 18:39:56.574: INFO: etcd-manager-main-ip-172-20-40-80.us-west-2.compute.internal started at 2023-02-06 18:32:29 +0000 UTC (0+1 container statuses recorded) Feb 6 18:39:56.574: INFO: Container etcd-manager ready: true, restart count 0 Feb 6 18:39:56.574: INFO: kube-controller-manager-ip-172-20-40-80.us-west-2.compute.internal started at 2023-02-06 18:32:29 +0000 UTC (0+1 container statuses recorded) Feb 6 18:39:56.574: INFO: Container kube-controller-manager ready: true, restart count 0 Feb 6 18:39:56.574: INFO: kube-proxy-ip-172-20-40-80.us-west-2.compute.internal started at 2023-02-06 18:32:29 +0000 UTC (0+1 container statuses recorded) Feb 6 18:39:56.574: INFO: Container kube-proxy ready: true, restart count 0 Feb 6 18:39:56.574: INFO: kops-controller-qjqj9 started at 2023-02-06 18:33:29 +0000 UTC (0+1 container statuses recorded) Feb 6 18:39:56.574: INFO: Container kops-controller ready: true, restart count 0 Feb 6 18:39:56.574: INFO: efs-csi-node-p8468 started at 2023-02-06 18:34:50 +0000 UTC (0+3 container statuses recorded) Feb 6 18:39:56.574: INFO: Container csi-driver-registrar ready: true, restart count 0 Feb 6 18:39:56.574: INFO: Container efs-plugin ready: true, restart count 0 Feb 6 18:39:56.574: INFO: Container liveness-probe ready: true, restart count 0 Feb 6 18:39:56.910: INFO: Latency metrics for node ip-172-20-40-80.us-west-2.compute.internal Feb 6 18:39:56.910: INFO: Logging node info for node ip-172-20-89-136.us-west-2.compute.internal Feb 6 18:39:56.977: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-89-136.us-west-2.compute.internal e335751a-165b-4457-9c6b-241b6473529f 2606 0 2023-02-06 18:34:22 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2b kops.k8s.io/instancegroup:nodes-us-west-2b kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-89-136.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:c5.large topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2b] map[csi.volume.kubernetes.io/nodeid:{"efs.csi.aws.com":"i-0ea19d5a1f3b6be9f"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2023-02-06 18:34:22 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/instancegroup":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-02-06 18:34:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} } {kubelet Update v1 2023-02-06 18:35:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-aws-ebs":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-aws-ebs":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2b/i-0ea19d5a1f3b6be9f,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{25 0} {<nil>} 25 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{133003395072 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3862937600 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{25 0} {<nil>} 25 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{119703055367 0} {<nil>} 119703055367 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3758080000 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-02-06 18:34:27 +0000 UTC,LastTransitionTime:2023-02-06 18:34:27 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-06 18:39:52 +0000 UTC,LastTransitionTime:2023-02-06 18:34:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-06 18:39:52 +0000 UTC,LastTransitionTime:2023-02-06 18:34:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-06 18:39:52 +0000 UTC,LastTransitionTime:2023-02-06 18:34:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-06 18:39:52 +0000 UTC,LastTransitionTime:2023-02-06 18:34:26 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.89.136,},NodeAddress{Type:ExternalIP,Address:52.12.97.247,},NodeAddress{Type:Hostname,Address:ip-172-20-89-136.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-89-136.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-52-12-97-247.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec257e7678d6046236e12dbbabe2f469,SystemUUID:ec257e76-78d6-0462-36e1-2dbbabe2f469,BootID:3909e2da-37b0-4606-abae-ac53d743344c,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.20.8,KubeProxyVersion:v1.20.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[607362164682.dkr.ecr.us-west-2.amazonaws.com/aws-efs-csi-driver@sha256:00fcde998e6653147443f7807194644d5ca9273e83cd9af3b4ca996514181339 607362164682.dkr.ecr.us-west-2.amazonaws.com/aws-efs-csi-driver:30617],SizeBytes:501573866,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:0c867c82a0a8ce6d093595f9d2e4b10517d6c9c26323075de9d82d9f7d056bfc k8s.gcr.io/kube-proxy:v1.20.8],SizeBytes:52056682,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:758db666ac7028534dba72e7e9bb1e57bb81b8196f976f7a5cc351ef8b3529e1 k8s.gcr.io/e2e-test-images/agnhost:2.32],SizeBytes:50002177,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler@sha256:67640771ad9fc56f109d5b01e020f0c858e7c890bb0eb15ba0ebd325df3285e7 k8s.gcr.io/cpa/cluster-proportional-autoscaler:1.8.3],SizeBytes:15191740,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/external-provisioner@sha256:e677f72d499e09557e20ba9b5ade9fbbc70b73f658b95226963215eaa9fdb1ad public.ecr.aws/eks-distro/kubernetes-csi/external-provisioner:v3.3.0-eks-1-25-latest],SizeBytes:13992120,},ContainerImage{Names:[docker.io/coredns/coredns@sha256:642ff9910da6ea9a8624b0234eef52af9ca75ecbec474c5507cb096bdfbae4e5 docker.io/coredns/coredns:1.8.3],SizeBytes:12893350,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/node-driver-registrar@sha256:9cd9ef74078997d4d05f5061b6a4948b54b591bb5152675f45a183c3a1cbbfd8 public.ecr.aws/eks-distro/kubernetes-csi/node-driver-registrar:v2.6.2-eks-1-25-latest],SizeBytes:6553584,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/livenessprobe@sha256:d790820d19a6253ee31418be4d1a9ae023d4a6b64c5591f8f031b4194828cc5b public.ecr.aws/eks-distro/kubernetes-csi/livenessprobe:v2.8.0-eks-1-25-latest],SizeBytes:6005708,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Feb 6 18:39:56.978: INFO: Logging kubelet events for node ip-172-20-89-136.us-west-2.compute.internal Feb 6 18:39:57.047: INFO: Logging pods the kubelet thinks is on node ip-172-20-89-136.us-west-2.compute.internal Feb 6 18:39:57.120: INFO: coredns-autoscaler-6f594f4c58-ml9dm started at 2023-02-06 18:34:32 +0000 UTC (0+1 container statuses recorded) Feb 6 18:39:57.120: INFO: Container autoscaler ready: true, restart count 0 Feb 6 18:39:57.120: INFO: coredns-8f5559c9b-89pvw started at 2023-02-06 18:34:35 +0000 UTC (0+1 container statuses recorded) Feb 6 18:39:57.120: INFO: Container coredns ready: true, restart count 0 Feb 6 18:39:57.120: INFO: efs-csi-node-2fqrk started at 2023-02-06 18:34:50 +0000 UTC (0+3 container statuses recorded) Feb 6 18:39:57.120: INFO: Container csi-driver-registrar ready: true, restart count 0 Feb 6 18:39:57.120: INFO: Container efs-plugin ready: true, restart count 0 Feb 6 18:39:57.120: INFO: Container liveness-probe ready: true, restart count 0 Feb 6 18:39:57.120: INFO: efs-csi-controller-6f8fcdc46b-2dpxk started at 2023-02-06 18:34:51 +0000 UTC (0+3 container statuses recorded) Feb 6 18:39:57.120: INFO: Container csi-provisioner ready: true, restart count 0 Feb 6 18:39:57.120: INFO: Container efs-plugin ready: true, restart count 0 Feb 6 18:39:57.120: INFO: Container liveness-probe ready: true, restart count 0 Feb 6 18:39:57.120: INFO: kube-proxy-ip-172-20-89-136.us-west-2.compute.internal started at 2023-02-06 18:33:48 +0000 UTC (0+1 container statuses recorded) Feb 6 18:39:57.120: INFO: Container kube-proxy ready: true, restart count 0 Feb 6 18:39:57.409: INFO: Latency metrics for node ip-172-20-89-136.us-west-2.compute.internal Feb 6 18:39:57.409: INFO: Logging node info for node ip-172-20-98-141.us-west-2.compute.internal Feb 6 18:39:57.476: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-98-141.us-west-2.compute.internal c15e2c71-936d-4793-b30a-01e71954ef8c 2278 0 2023-02-06 18:34:21 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2c kops.k8s.io/instancegroup:nodes-us-west-2c kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-98-141.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:c5.large topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2c] map[csi.volume.kubernetes.io/nodeid:{"efs.csi.aws.com":"i-00825eb655ec01817"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2023-02-06 18:34:21 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/instancegroup":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-02-06 18:34:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} } {kubelet Update v1 2023-02-06 18:35:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-aws-ebs":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-aws-ebs":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2c/i-00825eb655ec01817,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{25 0} {<nil>} 25 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{133003395072 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3862937600 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{25 0} {<nil>} 25 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{119703055367 0} {<nil>} 119703055367 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3758080000 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-02-06 18:34:27 +0000 UTC,LastTransitionTime:2023-02-06 18:34:27 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-06 18:39:22 +0000 UTC,LastTransitionTime:2023-02-06 18:34:21 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-06 18:39:22 +0000 UTC,LastTransitionTime:2023-02-06 18:34:21 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-06 18:39:22 +0000 UTC,LastTransitionTime:2023-02-06 18:34:21 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-06 18:39:22 +0000 UTC,LastTransitionTime:2023-02-06 18:34:24 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.98.141,},NodeAddress{Type:ExternalIP,Address:34.214.50.217,},NodeAddress{Type:Hostname,Address:ip-172-20-98-141.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-98-141.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-34-214-50-217.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec287f07067fd27916bc5be6673e7c47,SystemUUID:ec287f07-067f-d279-16bc-5be6673e7c47,BootID:e1a83e6f-430c-43a4-9a39-2738d97aeeba,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.20.8,KubeProxyVersion:v1.20.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[607362164682.dkr.ecr.us-west-2.amazonaws.com/aws-efs-csi-driver@sha256:00fcde998e6653147443f7807194644d5ca9273e83cd9af3b4ca996514181339 607362164682.dkr.ecr.us-west-2.amazonaws.com/aws-efs-csi-driver:30617],SizeBytes:501573866,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:702a992280fb7c3303e84a5801acbb4c9c7fcf48cffe0e9c8be3f0c60f74cf89 k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.4],SizeBytes:112029652,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:0c867c82a0a8ce6d093595f9d2e4b10517d6c9c26323075de9d82d9f7d056bfc k8s.gcr.io/kube-proxy:v1.20.8],SizeBytes:52056682,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:758db666ac7028534dba72e7e9bb1e57bb81b8196f976f7a5cc351ef8b3529e1 k8s.gcr.io/e2e-test-images/agnhost:2.32],SizeBytes:50002177,},ContainerImage{Names:[docker.io/coredns/coredns@sha256:642ff9910da6ea9a8624b0234eef52af9ca75ecbec474c5507cb096bdfbae4e5 docker.io/coredns/coredns:1.8.3],SizeBytes:12893350,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:503b7abb89e57383eba61cc8a9cb0b495ea575c516108f7d972a6ff6e1ab3c9b k8s.gcr.io/e2e-test-images/nginx:1.14-1],SizeBytes:6979365,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/node-driver-registrar@sha256:9cd9ef74078997d4d05f5061b6a4948b54b591bb5152675f45a183c3a1cbbfd8 public.ecr.aws/eks-distro/kubernetes-csi/node-driver-registrar:v2.6.2-eks-1-25-latest],SizeBytes:6553584,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/livenessprobe@sha256:d790820d19a6253ee31418be4d1a9ae023d4a6b64c5591f8f031b4194828cc5b public.ecr.aws/eks-distro/kubernetes-csi/livenessprobe:v2.8.0-eks-1-25-latest],SizeBytes:6005708,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Feb 6 18:39:57.476: INFO: Logging kubelet events for node ip-172-20-98-141.us-west-2.compute.internal Feb 6 18:39:57.545: INFO: Logging pods the kubelet thinks is on node ip-172-20-98-141.us-west-2.compute.internal Feb 6 18:39:57.623: INFO: coredns-8f5559c9b-l726x started at 2023-02-06 18:34:30 +0000 UTC (0+1 container statuses recorded) Feb 6 18:39:57.623: INFO: Container coredns ready: true, restart count 0 Feb 6 18:39:57.623: INFO: efs-csi-node-5tj82 started at 2023-02-06 18:34:51 +0000 UTC (0+3 container statuses recorded) Feb 6 18:39:57.623: INFO: Container csi-driver-registrar ready: true, restart count 0 Feb 6 18:39:57.623: INFO: Container efs-plugin ready: true, restart count 0 Feb 6 18:39:57.623: INFO: Container liveness-probe ready: true, restart count 0 Feb 6 18:39:57.623: INFO: pod-subpath-test-dynamicpv-58gd started at 2023-02-06 18:39:29 +0000 UTC (1+2 container statuses recorded) Feb 6 18:39:57.623: INFO: Init container init-volume-dynamicpv-58gd ready: true, restart count 0 Feb 6 18:39:57.623: INFO: Container test-container-subpath-dynamicpv-58gd ready: false, restart count 2 Feb 6 18:39:57.623: INFO: Container test-container-volume-dynamicpv-58gd ready: true, restart count 0 Feb 6 18:39:57.623: INFO: pod-50c71565-c0fb-47b0-aefd-001ebd3297fd started at 2023-02-06 18:38:44 +0000 UTC (0+1 container statuses recorded) Feb 6 18:39:57.623: INFO: Container write-pod ready: false, restart count 0 Feb 6 18:39:57.623: INFO: kube-proxy-ip-172-20-98-141.us-west-2.compute.internal started at 2023-02-06 18:33:47 +0000 UTC (0+1 container statuses recorded) Feb 6 18:39:57.623: INFO: Container kube-proxy ready: true, restart count 0 Feb 6 18:39:57.910: INFO: Latency metrics for node ip-172-20-98-141.us-west-2.compute.internal Feb 6 18:39:57.910: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "efs-9718" for this suite.
Find succeeded mentions in log files | View test history on testgrid
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (block volmode)] volumeMode should fail in binding dynamic provisioned PV to PVC [Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] subPath should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] subPath should fail if subpath directory is outside the volume [Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] subPath should fail if subpath file is outside the volume [Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] subPath should support creating multiple subpath from same volumes [Slow]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] subPath should support existing directories when readOnly specified in the volumeSource
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] subPath should support existing directory
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] subPath should support existing single file [LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] subPath should support file as subpath [LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] subPath should support non-existent path
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] subPath should support readOnly directory specified in the volumeMount
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] subPath should support readOnly file specified in the volumeMount [LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] subPath should support restarting containers using directory as subpath [Slow]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] subPath should support restarting containers using file as subpath [Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] subPath should verify container cannot write to subpath readonly volumes [Slow]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] volumeIO should write files of various sizes, verify size, validate content [Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] volumes should allow exec of files on the volume
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] volumes should store data
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single volume from pods on different node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single volume from pods on the same node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (filesystem volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (block volmode)] volumeMode should fail to create pod by failing to mount volume [Slow]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (default fs)] volumes should allow exec of files on the volume
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (default fs)] volumes should store data
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] should mount different paths on same volume on same node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] should mount with option tls when encryptInTransit set true
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] should mount with option tls when encryptInTransit unset
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] should mount without option tls when encryptInTransit set false
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should concurrently access the single volume from pods on different node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should concurrently access the single volume from pods on the same node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with mount options
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with pvc data source
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with pvc data source in parallel [Slow]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (block volmode)] volumeMode should fail to use a volume in a pod with mismatched mode [Slow]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (block volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (block volmode)] volumes should store data
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with mount options
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with pvc data source
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with pvc data source in parallel [Slow]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] subPath should unmount if pod is force deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] subPath should unmount if pod is gracefully deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ext3)] volumes should allow exec of files on the volume
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ext3)] volumes should store data
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should concurrently access the single volume from pods on different node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should concurrently access the single volume from pods on the same node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ext4)] volumes should allow exec of files on the volume
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ext4)] volumes should store data
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (filesystem volmode)] volumeMode should fail to use a volume in a pod with mismatched mode [Slow]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning should provision storage with mount options
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning should provision storage with pvc data source
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning should provision storage with pvc data source in parallel [Slow]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should fail if subpath directory is outside the volume [Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should fail if subpath file is outside the volume [Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support creating multiple subpath from same volumes [Slow]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support existing directories when readOnly specified in the volumeSource
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support existing directory
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support existing single file [LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support file as subpath [LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support non-existent path
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support readOnly directory specified in the volumeMount
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support readOnly file specified in the volumeMount [LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support restarting containers using directory as subpath [Slow]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support restarting containers using file as subpath [Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should unmount if pod is force deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should unmount if pod is gracefully deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should verify container cannot write to subpath readonly volumes [Slow]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] volumes should allow exec of files on the volume
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] volumes should store data
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should concurrently access the single volume from pods on different node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should concurrently access the single volume from pods on the same node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (xfs)][Slow] volumes should allow exec of files on the volume
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (xfs)][Slow] volumes should store data
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (default fs)] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (default fs)] subPath should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (default fs)] subPath should fail if subpath directory is outside the volume [Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (default fs)] subPath should fail if subpath file is outside the volume [Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (default fs)] subPath should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (default fs)] subPath should support creating multiple subpath from same volumes [Slow]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (default fs)] subPath should support existing directories when readOnly specified in the volumeSource
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (default fs)] subPath should support existing directory
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (default fs)] subPath should support existing single file [LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (default fs)] subPath should support file as subpath [LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (default fs)] subPath should support non-existent path
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (default fs)] subPath should support readOnly directory specified in the volumeMount
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (default fs)] subPath should support readOnly file specified in the volumeMount [LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (default fs)] subPath should support restarting containers using directory as subpath [Slow]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (default fs)] subPath should support restarting containers using file as subpath [Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (default fs)] subPath should unmount if pod is force deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (default fs)] subPath should unmount if pod is gracefully deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (default fs)] subPath should verify container cannot write to subpath readonly volumes [Slow]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (default fs)] volumeIO should write files of various sizes, verify size, validate content [Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (default fs)] volumes should allow exec of files on the volume
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (default fs)] volumes should store data
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (ext3)] volumes should allow exec of files on the volume
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (ext3)] volumes should store data
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (ext4)] volumes should allow exec of files on the volume
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (ext4)] volumes should store data
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (ntfs)][Feature:Windows] volumes should allow exec of files on the volume
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (ntfs)][Feature:Windows] volumes should store data
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (xfs)][Slow] volumes should allow exec of files on the volume
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (xfs)][Slow] volumes should store data
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should concurrently access the single volume from pods on different node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should concurrently access the single volume from pods on the same node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (block volmode)] volumeMode should fail to use a volume in a pod with mismatched mode [Slow]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (block volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (block volmode)] volumes should store data
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (default fs)] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (default fs)] subPath should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (default fs)] subPath should fail if subpath directory is outside the volume [Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (default fs)] subPath should fail if subpath file is outside the volume [Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (default fs)] subPath should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (default fs)] subPath should support creating multiple subpath from same volumes [Slow]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (default fs)] subPath should support existing directories when readOnly specified in the volumeSource
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (default fs)] subPath should support existing directory
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (default fs)] subPath should support existing single file [LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (default fs)] subPath should support file as subpath [LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (default fs)] subPath should support non-existent path
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (default fs)] subPath should support readOnly directory specified in the volumeMount
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (default fs)] subPath should support readOnly file specified in the volumeMount [LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (default fs)] subPath should support restarting containers using directory as subpath [Slow]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (default fs)] subPath should support restarting containers using file as subpath [Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (default fs)] subPath should unmount if pod is force deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (default fs)] subPath should unmount if pod is gracefully deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (default fs)] subPath should verify container cannot write to subpath readonly volumes [Slow]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (default fs)] volumeIO should write files of various sizes, verify size, validate content [Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (ext3)] volumes should allow exec of files on the volume
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (ext3)] volumes should store data
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (ext4)] volumes should allow exec of files on the volume
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (ext4)] volumes should store data
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single volume from pods on different node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single volume from pods on the same node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode should fail to use a volume in a pod with mismatched mode [Slow]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (ntfs)][Feature:Windows] volumes should allow exec of files on the volume
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (ntfs)][Feature:Windows] volumes should store data
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (xfs)][Slow] volumes should allow exec of files on the volume
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (xfs)][Slow] volumes should store data