Recent runs || View in Spyglass
PR | Ashley-wenyizha: Remove hostNetwork options from controller & node-daemonset |
Result | FAILURE |
Tests | 2 failed / 33 succeeded |
Started | |
Elapsed | 24m38s |
Revision | 0d546ae262cb76fef51dd483f534cb2c09bdd176 |
Refs |
906 |
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=EFS\sCSI\sSuite\s\[efs\-csi\]\sEFS\sCSI\s\[Driver\:\sefs\.csi\.aws\.com\]\s\[Testpattern\:\sDynamic\sPV\s\(filesystem\svolmode\)\]\smultiVolume\s\[Slow\]\sshould\saccess\sto\stwo\svolumes\swith\sthe\ssame\svolume\smode\sand\sretain\sdata\sacross\spod\srecreation\son\sthe\ssame\snode$'
/home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/multivolume.go:135 "touch /mnt/volume1/efs-6831-2023-02-06T18:54:45Z" should succeed, but failed with error message "command terminated with exit code 137" stdout: stderr: Unexpected error: <exec.CodeExitError>: { Err: { s: "command terminated with exit code 137", }, Code: 137, } command terminated with exit code 137 occurred /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/volume/fixtures.go:636from junit_03.xml
[BeforeEach] [efs-csi] EFS CSI /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/test/e2e/e2e.go:219 [BeforeEach] [efs-csi] EFS CSI /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Feb 6 18:55:19.300: INFO: >>> kubeConfig: /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/hack/e2e/csi-test-artifacts/test-cluster-26295.k8s.local.kops.kubeconfig �[1mSTEP�[0m: Building a namespace api object, basename efs �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51 [BeforeEach] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Feb 6 18:55:19.621: INFO: >>> kubeConfig: /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/hack/e2e/csi-test-artifacts/test-cluster-26295.k8s.local.kops.kubeconfig �[1mSTEP�[0m: Building a namespace api object, basename multivolume �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [It] should access to two volumes with the same volume mode and retain data across pod recreation on the same node /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/multivolume.go:135 Feb 6 18:55:20.132: INFO: Creating resource for dynamic PV Feb 6 18:55:20.132: INFO: Using claimSize:1Mi, test suite supported size:{ 1Mi}, driver(efs.csi.aws.com) supported size:{ 1Mi} �[1mSTEP�[0m: creating a StorageClass �[1mSTEP�[0m: creating a claim Feb 6 18:55:20.268: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [efs.csi.aws.comwgwmz] to have phase Bound Feb 6 18:55:20.333: INFO: PersistentVolumeClaim efs.csi.aws.comwgwmz found but phase is Pending instead of Bound. Feb 6 18:55:22.397: INFO: PersistentVolumeClaim efs.csi.aws.comwgwmz found and phase=Bound (2.128935283s) Feb 6 18:55:22.533: INFO: Creating resource for dynamic PV Feb 6 18:55:22.533: INFO: Using claimSize:1Mi, test suite supported size:{ 1Mi}, driver(efs.csi.aws.com) supported size:{ 1Mi} �[1mSTEP�[0m: creating a StorageClass �[1mSTEP�[0m: creating a claim Feb 6 18:55:22.665: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [efs.csi.aws.comnzxvr] to have phase Bound Feb 6 18:55:22.728: INFO: PersistentVolumeClaim efs.csi.aws.comnzxvr found but phase is Pending instead of Bound. Feb 6 18:55:24.793: INFO: PersistentVolumeClaim efs.csi.aws.comnzxvr found and phase=Bound (2.127612273s) �[1mSTEP�[0m: Creating pod on {Name: Selector:map[] Affinity:nil} with multiple volumes �[1mSTEP�[0m: Checking if the volume1 exists as expected volume mode (Filesystem) Feb 6 18:55:27.182: INFO: ExecWithOptions {Command:[/bin/sh -c test -d /mnt/volume1] Namespace:multivolume-2199 PodName:pod-071777e3-d216-4a69-ba95-197294819336 ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Feb 6 18:55:27.182: INFO: >>> kubeConfig: /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/hack/e2e/csi-test-artifacts/test-cluster-26295.k8s.local.kops.kubeconfig Feb 6 18:55:27.667: INFO: ExecWithOptions {Command:[/bin/sh -c test -b /mnt/volume1] Namespace:multivolume-2199 PodName:pod-071777e3-d216-4a69-ba95-197294819336 ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Feb 6 18:55:27.667: INFO: >>> kubeConfig: /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/hack/e2e/csi-test-artifacts/test-cluster-26295.k8s.local.kops.kubeconfig �[1mSTEP�[0m: Checking if write to the volume1 works properly Feb 6 18:55:28.144: INFO: ExecWithOptions {Command:[/bin/sh -c echo VhCeW8ZZESBzGallH9/Ma2Wi8lX2P94FiZIxSMR+ztpy//d9cWK/UKzBt6Rh9w6tw3Atof3Huy0ZfoEsWa/fpw== | base64 -d | sha256sum] Namespace:multivolume-2199 PodName:pod-071777e3-d216-4a69-ba95-197294819336 ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Feb 6 18:55:28.144: INFO: >>> kubeConfig: /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/hack/e2e/csi-test-artifacts/test-cluster-26295.k8s.local.kops.kubeconfig Feb 6 18:55:28.642: INFO: ExecWithOptions {Command:[/bin/sh -c echo VhCeW8ZZESBzGallH9/Ma2Wi8lX2P94FiZIxSMR+ztpy//d9cWK/UKzBt6Rh9w6tw3Atof3Huy0ZfoEsWa/fpw== | base64 -d | dd of=/mnt/volume1/file1.txt bs=64 count=1] Namespace:multivolume-2199 PodName:pod-071777e3-d216-4a69-ba95-197294819336 ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Feb 6 18:55:28.642: INFO: >>> kubeConfig: /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/hack/e2e/csi-test-artifacts/test-cluster-26295.k8s.local.kops.kubeconfig �[1mSTEP�[0m: Checking if read from the volume1 works properly Feb 6 18:55:29.137: INFO: ExecWithOptions {Command:[/bin/sh -c dd if=/mnt/volume1/file1.txt bs=64 count=1 | sha256sum] Namespace:multivolume-2199 PodName:pod-071777e3-d216-4a69-ba95-197294819336 ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Feb 6 18:55:29.137: INFO: >>> kubeConfig: /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/hack/e2e/csi-test-artifacts/test-cluster-26295.k8s.local.kops.kubeconfig Feb 6 18:55:29.639: INFO: ExecWithOptions {Command:[/bin/sh -c dd if=/mnt/volume1/file1.txt bs=64 count=1 | sha256sum | grep -Fq 18d7cca3c17729b8d8d36eacf526386794aa6e95d5b93cdcd2a89d53278c5387] Namespace:multivolume-2199 PodName:pod-071777e3-d216-4a69-ba95-197294819336 ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Feb 6 18:55:29.639: INFO: >>> kubeConfig: /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/hack/e2e/csi-test-artifacts/test-cluster-26295.k8s.local.kops.kubeconfig �[1mSTEP�[0m: Checking if the volume2 exists as expected volume mode (Filesystem) Feb 6 18:55:30.089: INFO: ExecWithOptions {Command:[/bin/sh -c test -d /mnt/volume2] Namespace:multivolume-2199 PodName:pod-071777e3-d216-4a69-ba95-197294819336 ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Feb 6 18:55:30.089: INFO: >>> kubeConfig: /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/hack/e2e/csi-test-artifacts/test-cluster-26295.k8s.local.kops.kubeconfig Feb 6 18:55:30.559: INFO: ExecWithOptions {Command:[/bin/sh -c test -b /mnt/volume2] Namespace:multivolume-2199 PodName:pod-071777e3-d216-4a69-ba95-197294819336 ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Feb 6 18:55:30.559: INFO: >>> kubeConfig: /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/hack/e2e/csi-test-artifacts/test-cluster-26295.k8s.local.kops.kubeconfig �[1mSTEP�[0m: Checking if write to the volume2 works properly Feb 6 18:55:31.025: INFO: ExecWithOptions {Command:[/bin/sh -c echo tMEzAZR9zz9u2GF/vXAExT0r2EP2vEw9MrSper4zlyTaBq6BYQHbvYeBWs8JsuhoIutja82/LMeXfnMbmG5/jg== | base64 -d | sha256sum] Namespace:multivolume-2199 PodName:pod-071777e3-d216-4a69-ba95-197294819336 ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Feb 6 18:55:31.025: INFO: >>> kubeConfig: /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/hack/e2e/csi-test-artifacts/test-cluster-26295.k8s.local.kops.kubeconfig Feb 6 18:55:31.509: INFO: ExecWithOptions {Command:[/bin/sh -c echo tMEzAZR9zz9u2GF/vXAExT0r2EP2vEw9MrSper4zlyTaBq6BYQHbvYeBWs8JsuhoIutja82/LMeXfnMbmG5/jg== | base64 -d | dd of=/mnt/volume2/file1.txt bs=64 count=1] Namespace:multivolume-2199 PodName:pod-071777e3-d216-4a69-ba95-197294819336 ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Feb 6 18:55:31.509: INFO: >>> kubeConfig: /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/hack/e2e/csi-test-artifacts/test-cluster-26295.k8s.local.kops.kubeconfig �[1mSTEP�[0m: Checking if read from the volume2 works properly Feb 6 18:55:31.995: INFO: ExecWithOptions {Command:[/bin/sh -c dd if=/mnt/volume2/file1.txt bs=64 count=1 | sha256sum] Namespace:multivolume-2199 PodName:pod-071777e3-d216-4a69-ba95-197294819336 ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Feb 6 18:55:31.995: INFO: >>> kubeConfig: /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/hack/e2e/csi-test-artifacts/test-cluster-26295.k8s.local.kops.kubeconfig Feb 6 18:55:32.474: INFO: ExecWithOptions {Command:[/bin/sh -c dd if=/mnt/volume2/file1.txt bs=64 count=1 | sha256sum | grep -Fq 92e3d4e73fb60d2fbed5f4db70289ba2545ada762f5f44bcb21bec4046f7ae3a] Namespace:multivolume-2199 PodName:pod-071777e3-d216-4a69-ba95-197294819336 ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Feb 6 18:55:32.474: INFO: >>> kubeConfig: /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/hack/e2e/csi-test-artifacts/test-cluster-26295.k8s.local.kops.kubeconfig Feb 6 18:55:33.023: INFO: Deleting pod "pod-071777e3-d216-4a69-ba95-197294819336" in namespace "multivolume-2199" Feb 6 18:55:33.088: INFO: Wait up to 5m0s for pod "pod-071777e3-d216-4a69-ba95-197294819336" to be fully deleted �[1mSTEP�[0m: Creating pod on {Name: Selector:map[] Affinity:&Affinity{NodeAffinity:&NodeAffinity{RequiredDuringSchedulingIgnoredDuringExecution:&NodeSelector{NodeSelectorTerms:[]NodeSelectorTerm{NodeSelectorTerm{MatchExpressions:[]NodeSelectorRequirement{},MatchFields:[]NodeSelectorRequirement{NodeSelectorRequirement{Key:metadata.name,Operator:In,Values:[ip-172-20-39-190.us-west-2.compute.internal],},},},},},PreferredDuringSchedulingIgnoredDuringExecution:[]PreferredSchedulingTerm{},},PodAffinity:nil,PodAntiAffinity:nil,}} with multiple volumes �[1mSTEP�[0m: Checking if the volume1 exists as expected volume mode (Filesystem) Feb 6 18:55:41.485: INFO: ExecWithOptions {Command:[/bin/sh -c test -d /mnt/volume1] Namespace:multivolume-2199 PodName:pod-70952cbc-d6e2-442e-ad9c-dca5c6cbd0cf ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Feb 6 18:55:41.485: INFO: >>> kubeConfig: /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/hack/e2e/csi-test-artifacts/test-cluster-26295.k8s.local.kops.kubeconfig Feb 6 18:55:41.997: INFO: ExecWithOptions {Command:[/bin/sh -c test -b /mnt/volume1] Namespace:multivolume-2199 PodName:pod-70952cbc-d6e2-442e-ad9c-dca5c6cbd0cf ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Feb 6 18:55:41.997: INFO: >>> kubeConfig: /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/hack/e2e/csi-test-artifacts/test-cluster-26295.k8s.local.kops.kubeconfig �[1mSTEP�[0m: Checking if read from the volume1 works properly Feb 6 18:55:42.518: INFO: ExecWithOptions {Command:[/bin/sh -c dd if=/mnt/volume1/file1.txt bs=64 count=1 | sha256sum] Namespace:multivolume-2199 PodName:pod-70952cbc-d6e2-442e-ad9c-dca5c6cbd0cf ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Feb 6 18:55:42.518: INFO: >>> kubeConfig: /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/hack/e2e/csi-test-artifacts/test-cluster-26295.k8s.local.kops.kubeconfig Feb 6 18:55:43.057: INFO: ExecWithOptions {Command:[/bin/sh -c dd if=/mnt/volume1/file1.txt bs=64 count=1 | sha256sum | grep -Fq 18d7cca3c17729b8d8d36eacf526386794aa6e95d5b93cdcd2a89d53278c5387] Namespace:multivolume-2199 PodName:pod-70952cbc-d6e2-442e-ad9c-dca5c6cbd0cf ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Feb 6 18:55:43.057: INFO: >>> kubeConfig: /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/hack/e2e/csi-test-artifacts/test-cluster-26295.k8s.local.kops.kubeconfig �[1mSTEP�[0m: Checking if write to the volume1 works properly Feb 6 18:55:43.557: INFO: ExecWithOptions {Command:[/bin/sh -c echo hZl/eHuaeGrral3O20uHnZIJwagT4SHjOGQi7H/JncDYPKbmRn54pI8G2+rWX2wASBg3O/W3/SUsIliTwUE6eg== | base64 -d | sha256sum] Namespace:multivolume-2199 PodName:pod-70952cbc-d6e2-442e-ad9c-dca5c6cbd0cf ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Feb 6 18:55:43.557: INFO: >>> kubeConfig: /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/hack/e2e/csi-test-artifacts/test-cluster-26295.k8s.local.kops.kubeconfig Feb 6 18:55:44.070: INFO: ExecWithOptions {Command:[/bin/sh -c echo hZl/eHuaeGrral3O20uHnZIJwagT4SHjOGQi7H/JncDYPKbmRn54pI8G2+rWX2wASBg3O/W3/SUsIliTwUE6eg== | base64 -d | dd of=/mnt/volume1/file1.txt bs=64 count=1] Namespace:multivolume-2199 PodName:pod-70952cbc-d6e2-442e-ad9c-dca5c6cbd0cf ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Feb 6 18:55:44.070: INFO: >>> kubeConfig: /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/hack/e2e/csi-test-artifacts/test-cluster-26295.k8s.local.kops.kubeconfig �[1mSTEP�[0m: Checking if read from the volume1 works properly Feb 6 18:55:44.717: INFO: ExecWithOptions {Command:[/bin/sh -c dd if=/mnt/volume1/file1.txt bs=64 count=1 | sha256sum] Namespace:multivolume-2199 PodName:pod-70952cbc-d6e2-442e-ad9c-dca5c6cbd0cf ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Feb 6 18:55:44.717: INFO: >>> kubeConfig: /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/hack/e2e/csi-test-artifacts/test-cluster-26295.k8s.local.kops.kubeconfig Feb 6 18:55:45.249: INFO: ExecWithOptions {Command:[/bin/sh -c dd if=/mnt/volume1/file1.txt bs=64 count=1 | sha256sum | grep -Fq 82c29f5944b3813c3a9ee5acfe70adc58d9f83f8afdf7d561643b40e05c4a511] Namespace:multivolume-2199 PodName:pod-70952cbc-d6e2-442e-ad9c-dca5c6cbd0cf ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Feb 6 18:55:45.249: INFO: >>> kubeConfig: /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/hack/e2e/csi-test-artifacts/test-cluster-26295.k8s.local.kops.kubeconfig �[1mSTEP�[0m: Checking if the volume2 exists as expected volume mode (Filesystem) Feb 6 18:55:45.784: INFO: ExecWithOptions {Command:[/bin/sh -c test -d /mnt/volume2] Namespace:multivolume-2199 PodName:pod-70952cbc-d6e2-442e-ad9c-dca5c6cbd0cf ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Feb 6 18:55:45.784: INFO: >>> kubeConfig: /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/hack/e2e/csi-test-artifacts/test-cluster-26295.k8s.local.kops.kubeconfig Feb 6 18:55:46.258: INFO: ExecWithOptions {Command:[/bin/sh -c test -b /mnt/volume2] Namespace:multivolume-2199 PodName:pod-70952cbc-d6e2-442e-ad9c-dca5c6cbd0cf ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Feb 6 18:55:46.258: INFO: >>> kubeConfig: /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/hack/e2e/csi-test-artifacts/test-cluster-26295.k8s.local.kops.kubeconfig �[1mSTEP�[0m: Checking if read from the volume2 works properly Feb 6 18:55:46.754: INFO: ExecWithOptions {Command:[/bin/sh -c dd if=/mnt/volume2/file1.txt bs=64 count=1 | sha256sum] Namespace:multivolume-2199 PodName:pod-70952cbc-d6e2-442e-ad9c-dca5c6cbd0cf ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Feb 6 18:55:46.754: INFO: >>> kubeConfig: /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/hack/e2e/csi-test-artifacts/test-cluster-26295.k8s.local.kops.kubeconfig Feb 6 18:55:47.270: INFO: ExecWithOptions {Command:[/bin/sh -c dd if=/mnt/volume2/file1.txt bs=64 count=1 | sha256sum | grep -Fq 92e3d4e73fb60d2fbed5f4db70289ba2545ada762f5f44bcb21bec4046f7ae3a] Namespace:multivolume-2199 PodName:pod-70952cbc-d6e2-442e-ad9c-dca5c6cbd0cf ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Feb 6 18:55:47.270: INFO: >>> kubeConfig: /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/hack/e2e/csi-test-artifacts/test-cluster-26295.k8s.local.kops.kubeconfig �[1mSTEP�[0m: Checking if write to the volume2 works properly Feb 6 18:55:47.785: INFO: ExecWithOptions {Command:[/bin/sh -c echo 2h5lbu0I/ZLGrfzpdtbANq8xnrTWvAzy/6Cu/egdA76Q/HTJvtz6ENXWLiU+utbEZJuL0eGQjJ9JJgy3ALyxqQ== | base64 -d | sha256sum] Namespace:multivolume-2199 PodName:pod-70952cbc-d6e2-442e-ad9c-dca5c6cbd0cf ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Feb 6 18:55:47.785: INFO: >>> kubeConfig: /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/hack/e2e/csi-test-artifacts/test-cluster-26295.k8s.local.kops.kubeconfig Feb 6 18:55:48.324: INFO: ExecWithOptions {Command:[/bin/sh -c echo 2h5lbu0I/ZLGrfzpdtbANq8xnrTWvAzy/6Cu/egdA76Q/HTJvtz6ENXWLiU+utbEZJuL0eGQjJ9JJgy3ALyxqQ== | base64 -d | dd of=/mnt/volume2/file1.txt bs=64 count=1] Namespace:multivolume-2199 PodName:pod-70952cbc-d6e2-442e-ad9c-dca5c6cbd0cf ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Feb 6 18:55:48.324: INFO: >>> kubeConfig: /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/hack/e2e/csi-test-artifacts/test-cluster-26295.k8s.local.kops.kubeconfig �[1mSTEP�[0m: Checking if read from the volume2 works properly Feb 6 18:55:48.822: INFO: ExecWithOptions {Command:[/bin/sh -c dd if=/mnt/volume2/file1.txt bs=64 count=1 | sha256sum] Namespace:multivolume-2199 PodName:pod-70952cbc-d6e2-442e-ad9c-dca5c6cbd0cf ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Feb 6 18:55:48.822: INFO: >>> kubeConfig: /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/hack/e2e/csi-test-artifacts/test-cluster-26295.k8s.local.kops.kubeconfig Feb 6 18:55:49.327: INFO: ExecWithOptions {Command:[/bin/sh -c dd if=/mnt/volume2/file1.txt bs=64 count=1 | sha256sum | grep -Fq edd8b465cd70f2c1311b8e73f142dcb089d674ba6327890aef0f0748e4173bfe] Namespace:multivolume-2199 PodName:pod-70952cbc-d6e2-442e-ad9c-dca5c6cbd0cf ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Feb 6 18:55:49.327: INFO: >>> kubeConfig: /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/hack/e2e/csi-test-artifacts/test-cluster-26295.k8s.local.kops.kubeconfig Feb 6 18:55:49.892: INFO: Deleting pod "pod-70952cbc-d6e2-442e-ad9c-dca5c6cbd0cf" in namespace "multivolume-2199" Feb 6 18:55:49.958: INFO: Wait up to 5m0s for pod "pod-70952cbc-d6e2-442e-ad9c-dca5c6cbd0cf" to be fully deleted �[1mSTEP�[0m: Deleting pvc Feb 6 18:55:58.094: INFO: Deleting PersistentVolumeClaim "efs.csi.aws.comwgwmz" Feb 6 18:55:58.158: INFO: Waiting up to 5m0s for PersistentVolume pvc-b89f3ea9-a2a8-4b32-9aee-61dfc300f80c to get deleted Feb 6 18:55:58.223: INFO: PersistentVolume pvc-b89f3ea9-a2a8-4b32-9aee-61dfc300f80c found and phase=Released (64.780859ms) Feb 6 18:56:03.288: INFO: PersistentVolume pvc-b89f3ea9-a2a8-4b32-9aee-61dfc300f80c was removed �[1mSTEP�[0m: Deleting sc �[1mSTEP�[0m: Deleting pvc Feb 6 18:56:03.353: INFO: Deleting PersistentVolumeClaim "efs.csi.aws.comnzxvr" Feb 6 18:56:03.418: INFO: Waiting up to 5m0s for PersistentVolume pvc-a22725a7-1a9c-4860-96d2-4919cfa54a25 to get deleted Feb 6 18:56:03.482: INFO: PersistentVolume pvc-a22725a7-1a9c-4860-96d2-4919cfa54a25 was removed �[1mSTEP�[0m: Deleting sc [AfterEach] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "multivolume-2199". �[1mSTEP�[0m: Found 16 events. Feb 6 18:56:03.612: INFO: At 2023-02-06 18:55:20 +0000 UTC - event for efs.csi.aws.comwgwmz: {efs.csi.aws.com_efs-csi-controller-c584f665c-ktmqc_6a1f4b99-2794-4a66-bb8f-75d81aa407c0 } Provisioning: External provisioner is provisioning volume for claim "multivolume-2199/efs.csi.aws.comwgwmz" Feb 6 18:56:03.612: INFO: At 2023-02-06 18:55:20 +0000 UTC - event for efs.csi.aws.comwgwmz: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "efs.csi.aws.com" or manually created by system administrator Feb 6 18:56:03.612: INFO: At 2023-02-06 18:55:20 +0000 UTC - event for efs.csi.aws.comwgwmz: {efs.csi.aws.com_efs-csi-controller-c584f665c-ktmqc_6a1f4b99-2794-4a66-bb8f-75d81aa407c0 } ProvisioningSucceeded: Successfully provisioned volume pvc-b89f3ea9-a2a8-4b32-9aee-61dfc300f80c Feb 6 18:56:03.612: INFO: At 2023-02-06 18:55:22 +0000 UTC - event for efs.csi.aws.comnzxvr: {efs.csi.aws.com_efs-csi-controller-c584f665c-ktmqc_6a1f4b99-2794-4a66-bb8f-75d81aa407c0 } Provisioning: External provisioner is provisioning volume for claim "multivolume-2199/efs.csi.aws.comnzxvr" Feb 6 18:56:03.612: INFO: At 2023-02-06 18:55:22 +0000 UTC - event for efs.csi.aws.comnzxvr: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "efs.csi.aws.com" or manually created by system administrator Feb 6 18:56:03.612: INFO: At 2023-02-06 18:55:22 +0000 UTC - event for efs.csi.aws.comnzxvr: {efs.csi.aws.com_efs-csi-controller-c584f665c-ktmqc_6a1f4b99-2794-4a66-bb8f-75d81aa407c0 } ProvisioningSucceeded: Successfully provisioned volume pvc-a22725a7-1a9c-4860-96d2-4919cfa54a25 Feb 6 18:56:03.612: INFO: At 2023-02-06 18:55:24 +0000 UTC - event for pod-071777e3-d216-4a69-ba95-197294819336: {default-scheduler } Scheduled: Successfully assigned multivolume-2199/pod-071777e3-d216-4a69-ba95-197294819336 to ip-172-20-39-190.us-west-2.compute.internal Feb 6 18:56:03.612: INFO: At 2023-02-06 18:55:26 +0000 UTC - event for pod-071777e3-d216-4a69-ba95-197294819336: {kubelet ip-172-20-39-190.us-west-2.compute.internal} Created: Created container write-pod Feb 6 18:56:03.612: INFO: At 2023-02-06 18:55:26 +0000 UTC - event for pod-071777e3-d216-4a69-ba95-197294819336: {kubelet ip-172-20-39-190.us-west-2.compute.internal} Pulled: Container image "k8s.gcr.io/e2e-test-images/busybox:1.29-1" already present on machine Feb 6 18:56:03.612: INFO: At 2023-02-06 18:55:26 +0000 UTC - event for pod-071777e3-d216-4a69-ba95-197294819336: {kubelet ip-172-20-39-190.us-west-2.compute.internal} Started: Started container write-pod Feb 6 18:56:03.612: INFO: At 2023-02-06 18:55:33 +0000 UTC - event for pod-071777e3-d216-4a69-ba95-197294819336: {kubelet ip-172-20-39-190.us-west-2.compute.internal} Killing: Stopping container write-pod Feb 6 18:56:03.612: INFO: At 2023-02-06 18:55:37 +0000 UTC - event for pod-70952cbc-d6e2-442e-ad9c-dca5c6cbd0cf: {default-scheduler } Scheduled: Successfully assigned multivolume-2199/pod-70952cbc-d6e2-442e-ad9c-dca5c6cbd0cf to ip-172-20-39-190.us-west-2.compute.internal Feb 6 18:56:03.612: INFO: At 2023-02-06 18:55:38 +0000 UTC - event for pod-70952cbc-d6e2-442e-ad9c-dca5c6cbd0cf: {kubelet ip-172-20-39-190.us-west-2.compute.internal} Pulled: Container image "k8s.gcr.io/e2e-test-images/busybox:1.29-1" already present on machine Feb 6 18:56:03.612: INFO: At 2023-02-06 18:55:38 +0000 UTC - event for pod-70952cbc-d6e2-442e-ad9c-dca5c6cbd0cf: {kubelet ip-172-20-39-190.us-west-2.compute.internal} Created: Created container write-pod Feb 6 18:56:03.612: INFO: At 2023-02-06 18:55:38 +0000 UTC - event for pod-70952cbc-d6e2-442e-ad9c-dca5c6cbd0cf: {kubelet ip-172-20-39-190.us-west-2.compute.internal} Started: Started container write-pod Feb 6 18:56:03.612: INFO: At 2023-02-06 18:55:49 +0000 UTC - event for pod-70952cbc-d6e2-442e-ad9c-dca5c6cbd0cf: {kubelet ip-172-20-39-190.us-west-2.compute.internal} Killing: Stopping container write-pod Feb 6 18:56:03.675: INFO: POD NODE PHASE GRACE CONDITIONS Feb 6 18:56:03.676: INFO: Feb 6 18:56:03.742: INFO: Logging node info for node ip-172-20-107-56.us-west-2.compute.internal Feb 6 18:56:03.808: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-107-56.us-west-2.compute.internal 73d868c1-0561-4bd0-8eb5-49367953c042 2130 0 2023-02-06 18:49:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2c kops.k8s.io/instancegroup:nodes-us-west-2c kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-107-56.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:c5.large topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2c] map[csi.volume.kubernetes.io/nodeid:{"efs.csi.aws.com":"i-048b7babafdb24269"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2023-02-06 18:49:34 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/instancegroup":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-02-06 18:49:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} } {kubelet Update v1 2023-02-06 18:54:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-aws-ebs":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-aws-ebs":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2c/i-048b7babafdb24269,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{25 0} {<nil>} 25 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{133003395072 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3862945792 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{25 0} {<nil>} 25 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{119703055367 0} {<nil>} 119703055367 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3758088192 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-02-06 18:49:43 +0000 UTC,LastTransitionTime:2023-02-06 18:49:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-06 18:54:44 +0000 UTC,LastTransitionTime:2023-02-06 18:49:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-06 18:54:44 +0000 UTC,LastTransitionTime:2023-02-06 18:49:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-06 18:54:44 +0000 UTC,LastTransitionTime:2023-02-06 18:49:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-06 18:54:44 +0000 UTC,LastTransitionTime:2023-02-06 18:49:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.107.56,},NodeAddress{Type:ExternalIP,Address:35.89.207.5,},NodeAddress{Type:Hostname,Address:ip-172-20-107-56.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-107-56.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-89-207-5.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec26fb1b06e6bc6a75c9924b4fc61b1e,SystemUUID:ec26fb1b-06e6-bc6a-75c9-924b4fc61b1e,BootID:fa669e77-47c4-4a4d-8068-4257b9fb8f3f,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.20.8,KubeProxyVersion:v1.20.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[607362164682.dkr.ecr.us-west-2.amazonaws.com/aws-efs-csi-driver@sha256:cfb4417dbd36e453d92b427bd06719934fa133d51451b867a25615d18b02421f 607362164682.dkr.ecr.us-west-2.amazonaws.com/aws-efs-csi-driver:26295],SizeBytes:501573953,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:0c867c82a0a8ce6d093595f9d2e4b10517d6c9c26323075de9d82d9f7d056bfc k8s.gcr.io/kube-proxy:v1.20.8],SizeBytes:52056682,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/external-provisioner@sha256:e677f72d499e09557e20ba9b5ade9fbbc70b73f658b95226963215eaa9fdb1ad public.ecr.aws/eks-distro/kubernetes-csi/external-provisioner:v3.3.0-eks-1-25-latest],SizeBytes:13992120,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/node-driver-registrar@sha256:9cd9ef74078997d4d05f5061b6a4948b54b591bb5152675f45a183c3a1cbbfd8 public.ecr.aws/eks-distro/kubernetes-csi/node-driver-registrar:v2.6.2-eks-1-25-latest],SizeBytes:6553584,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/livenessprobe@sha256:d790820d19a6253ee31418be4d1a9ae023d4a6b64c5591f8f031b4194828cc5b public.ecr.aws/eks-distro/kubernetes-csi/livenessprobe:v2.8.0-eks-1-25-latest],SizeBytes:6005708,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Feb 6 18:56:03.809: INFO: Logging kubelet events for node ip-172-20-107-56.us-west-2.compute.internal Feb 6 18:56:03.880: INFO: Logging pods the kubelet thinks is on node ip-172-20-107-56.us-west-2.compute.internal Feb 6 18:56:03.964: INFO: kube-proxy-ip-172-20-107-56.us-west-2.compute.internal started at 2023-02-06 18:49:14 +0000 UTC (0+1 container statuses recorded) Feb 6 18:56:03.964: INFO: Container kube-proxy ready: true, restart count 0 Feb 6 18:56:03.964: INFO: efs-csi-node-fk7vp started at 2023-02-06 18:54:44 +0000 UTC (0+3 container statuses recorded) Feb 6 18:56:03.964: INFO: Container csi-driver-registrar ready: true, restart count 0 Feb 6 18:56:03.964: INFO: Container efs-plugin ready: true, restart count 0 Feb 6 18:56:03.964: INFO: Container liveness-probe ready: true, restart count 0 Feb 6 18:56:03.964: INFO: efs-csi-controller-c584f665c-8wgrt started at 2023-02-06 18:50:05 +0000 UTC (0+3 container statuses recorded) Feb 6 18:56:03.965: INFO: Container csi-provisioner ready: true, restart count 0 Feb 6 18:56:03.965: INFO: Container efs-plugin ready: true, restart count 0 Feb 6 18:56:03.965: INFO: Container liveness-probe ready: true, restart count 0 Feb 6 18:56:03.965: INFO: pvc-tester-zmzxl started at 2023-02-06 18:54:25 +0000 UTC (0+1 container statuses recorded) Feb 6 18:56:03.965: INFO: Container write-pod ready: false, restart count 0 Feb 6 18:56:04.234: INFO: Latency metrics for node ip-172-20-107-56.us-west-2.compute.internal Feb 6 18:56:04.234: INFO: Logging node info for node ip-172-20-35-183.us-west-2.compute.internal Feb 6 18:56:04.298: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-35-183.us-west-2.compute.internal 1348c951-9ddb-4d2c-a6ab-09ca2aacd9f4 2855 0 2023-02-06 18:48:25 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kops.k8s.io/instancegroup:master-us-west-2a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-35-183.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/control-plane: node-role.kubernetes.io/master: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:t3.medium topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[csi.volume.kubernetes.io/nodeid:{"efs.csi.aws.com":"i-0725700ff8e28d48d"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{protokube Update v1 2023-02-06 18:48:30 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/control-plane":{},"f:node-role.kubernetes.io/master":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-02-06 18:48:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} } {kops-controller Update v1 2023-02-06 18:48:57 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/instancegroup":{}}}} } {kubelet Update v1 2023-02-06 18:50:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-aws-ebs":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-aws-ebs":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-0725700ff8e28d48d,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{25 0} {<nil>} 25 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{66404147200 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051685376 0} {<nil>} 3956724Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{25 0} {<nil>} 25 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{59763732382 0} {<nil>} 59763732382 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946827776 0} {<nil>} 3854324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-02-06 18:48:42 +0000 UTC,LastTransitionTime:2023-02-06 18:48:42 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-06 18:55:48 +0000 UTC,LastTransitionTime:2023-02-06 18:48:21 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-06 18:55:48 +0000 UTC,LastTransitionTime:2023-02-06 18:48:21 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-06 18:55:48 +0000 UTC,LastTransitionTime:2023-02-06 18:48:21 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-06 18:55:48 +0000 UTC,LastTransitionTime:2023-02-06 18:48:52 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.35.183,},NodeAddress{Type:ExternalIP,Address:34.222.145.229,},NodeAddress{Type:Hostname,Address:ip-172-20-35-183.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-35-183.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-34-222-145-229.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec20586bb158fd4c929ecfb5adb0cce2,SystemUUID:ec20586b-b158-fd4c-929e-cfb5adb0cce2,BootID:c39134eb-d8bc-4ce1-bf49-554704d186b9,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.20.8,KubeProxyVersion:v1.20.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[607362164682.dkr.ecr.us-west-2.amazonaws.com/aws-efs-csi-driver@sha256:cfb4417dbd36e453d92b427bd06719934fa133d51451b867a25615d18b02421f 607362164682.dkr.ecr.us-west-2.amazonaws.com/aws-efs-csi-driver:26295],SizeBytes:501573953,},ContainerImage{Names:[k8s.gcr.io/etcdadm/etcd-manager@sha256:ebb73d3d4a99da609f9e01c556cd9f9aa7a0aecba8f5bc5588d7c45eb38e3a7e k8s.gcr.io/etcdadm/etcd-manager:3.0.20210430],SizeBytes:171082409,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:0c867c82a0a8ce6d093595f9d2e4b10517d6c9c26323075de9d82d9f7d056bfc k8s.gcr.io/kube-proxy:v1.20.8],SizeBytes:52056682,},ContainerImage{Names:[k8s.gcr.io/kops/dns-controller@sha256:f3724709f264bd47d2251f4ec5b16ec5482e8a2d65da006cd3165eb4da0bd3d1 k8s.gcr.io/kops/dns-controller:1.21.0],SizeBytes:40960953,},ContainerImage{Names:[k8s.gcr.io/kops/kops-controller@sha256:05b7d6511df0084aed954a009099402d2a7e7227adf0f410c4583204e6f76429 k8s.gcr.io/kops/kops-controller:1.21.0],SizeBytes:40618104,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:531ffd92bd954f5c27002ce11502771146e7c867c09a6e1755631953ff584df4 k8s.gcr.io/kube-apiserver:v1.20.8],SizeBytes:30462643,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:13509f0b36bbd4d2d142cf4c35d77f32ec3728975d96cf833b60b484effa8c43 k8s.gcr.io/kube-controller-manager:v1.20.8],SizeBytes:29554511,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:6fc53cbc3f035ba2b0ac9127e9dc5aa7a95b73f041f7cc14c36cdfc095b13080 k8s.gcr.io/kube-scheduler:v1.20.8],SizeBytes:14243733,},ContainerImage{Names:[k8s.gcr.io/kops/kube-apiserver-healthcheck@sha256:d772e49a0ae9dea319f26aaa40d58a123860b19da6378d29898eb30208359241 k8s.gcr.io/kops/kube-apiserver-healthcheck:1.21.0],SizeBytes:11771024,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/node-driver-registrar@sha256:9cd9ef74078997d4d05f5061b6a4948b54b591bb5152675f45a183c3a1cbbfd8 public.ecr.aws/eks-distro/kubernetes-csi/node-driver-registrar:v2.6.2-eks-1-25-latest],SizeBytes:6553584,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/livenessprobe@sha256:d790820d19a6253ee31418be4d1a9ae023d4a6b64c5591f8f031b4194828cc5b public.ecr.aws/eks-distro/kubernetes-csi/livenessprobe:v2.8.0-eks-1-25-latest],SizeBytes:6005708,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Feb 6 18:56:04.299: INFO: Logging kubelet events for node ip-172-20-35-183.us-west-2.compute.internal Feb 6 18:56:04.367: INFO: Logging pods the kubelet thinks is on node ip-172-20-35-183.us-west-2.compute.internal Feb 6 18:56:04.437: INFO: kube-apiserver-ip-172-20-35-183.us-west-2.compute.internal started at 2023-02-06 18:47:38 +0000 UTC (0+2 container statuses recorded) Feb 6 18:56:04.437: INFO: Container healthcheck ready: true, restart count 0 Feb 6 18:56:04.437: INFO: Container kube-apiserver ready: true, restart count 0 Feb 6 18:56:04.437: INFO: etcd-manager-events-ip-172-20-35-183.us-west-2.compute.internal started at 2023-02-06 18:47:38 +0000 UTC (0+1 container statuses recorded) Feb 6 18:56:04.437: INFO: Container etcd-manager ready: true, restart count 0 Feb 6 18:56:04.437: INFO: kops-controller-m8w87 started at 2023-02-06 18:48:53 +0000 UTC (0+1 container statuses recorded) Feb 6 18:56:04.437: INFO: Container kops-controller ready: true, restart count 0 Feb 6 18:56:04.437: INFO: efs-csi-node-97npp started at 2023-02-06 18:50:05 +0000 UTC (0+3 container statuses recorded) Feb 6 18:56:04.437: INFO: Container csi-driver-registrar ready: true, restart count 0 Feb 6 18:56:04.437: INFO: Container efs-plugin ready: true, restart count 0 Feb 6 18:56:04.437: INFO: Container liveness-probe ready: true, restart count 0 Feb 6 18:56:04.437: INFO: kube-controller-manager-ip-172-20-35-183.us-west-2.compute.internal started at 2023-02-06 18:47:38 +0000 UTC (0+1 container statuses recorded) Feb 6 18:56:04.437: INFO: Container kube-controller-manager ready: true, restart count 0 Feb 6 18:56:04.437: INFO: kube-proxy-ip-172-20-35-183.us-west-2.compute.internal started at 2023-02-06 18:47:38 +0000 UTC (0+1 container statuses recorded) Feb 6 18:56:04.437: INFO: Container kube-proxy ready: true, restart count 0 Feb 6 18:56:04.437: INFO: kube-scheduler-ip-172-20-35-183.us-west-2.compute.internal started at 2023-02-06 18:47:38 +0000 UTC (0+1 container statuses recorded) Feb 6 18:56:04.437: INFO: Container kube-scheduler ready: true, restart count 0 Feb 6 18:56:04.437: INFO: etcd-manager-main-ip-172-20-35-183.us-west-2.compute.internal started at 2023-02-06 18:47:38 +0000 UTC (0+1 container statuses recorded) Feb 6 18:56:04.437: INFO: Container etcd-manager ready: true, restart count 0 Feb 6 18:56:04.437: INFO: dns-controller-5d59c585d8-6rjvt started at 2023-02-06 18:48:53 +0000 UTC (0+1 container statuses recorded) Feb 6 18:56:04.437: INFO: Container dns-controller ready: true, restart count 0 Feb 6 18:56:04.806: INFO: Latency metrics for node ip-172-20-35-183.us-west-2.compute.internal Feb 6 18:56:04.806: INFO: Logging node info for node ip-172-20-39-190.us-west-2.compute.internal Feb 6 18:56:04.877: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-39-190.us-west-2.compute.internal 639b701f-454f-4006-9106-500e5ee5d0d2 2885 0 2023-02-06 18:49:29 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kops.k8s.io/instancegroup:nodes-us-west-2a kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-39-190.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:c5.large topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[csi.volume.kubernetes.io/nodeid:{"efs.csi.aws.com":"i-06d1c87be3fa9644f"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2023-02-06 18:49:29 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/instancegroup":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-02-06 18:49:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} } {kubelet Update v1 2023-02-06 18:50:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-aws-ebs":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-aws-ebs":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-06d1c87be3fa9644f,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{25 0} {<nil>} 25 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{133003395072 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892305920 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{25 0} {<nil>} 25 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{119703055367 0} {<nil>} 119703055367 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787448320 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-02-06 18:49:33 +0000 UTC,LastTransitionTime:2023-02-06 18:49:33 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-06 18:55:49 +0000 UTC,LastTransitionTime:2023-02-06 18:49:29 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-06 18:55:49 +0000 UTC,LastTransitionTime:2023-02-06 18:49:29 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-06 18:55:49 +0000 UTC,LastTransitionTime:2023-02-06 18:49:29 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-06 18:55:49 +0000 UTC,LastTransitionTime:2023-02-06 18:49:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.39.190,},NodeAddress{Type:ExternalIP,Address:52.40.251.97,},NodeAddress{Type:Hostname,Address:ip-172-20-39-190.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-39-190.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-52-40-251-97.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec28fe7c04520bffe074b028bac9b94b,SystemUUID:ec28fe7c-0452-0bff-e074-b028bac9b94b,BootID:70a79809-a9cf-45b1-90fc-67582ec7bb68,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.20.8,KubeProxyVersion:v1.20.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[607362164682.dkr.ecr.us-west-2.amazonaws.com/aws-efs-csi-driver@sha256:cfb4417dbd36e453d92b427bd06719934fa133d51451b867a25615d18b02421f 607362164682.dkr.ecr.us-west-2.amazonaws.com/aws-efs-csi-driver:26295],SizeBytes:501573953,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:702a992280fb7c3303e84a5801acbb4c9c7fcf48cffe0e9c8be3f0c60f74cf89 k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.4],SizeBytes:112029652,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:0c867c82a0a8ce6d093595f9d2e4b10517d6c9c26323075de9d82d9f7d056bfc k8s.gcr.io/kube-proxy:v1.20.8],SizeBytes:52056682,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:758db666ac7028534dba72e7e9bb1e57bb81b8196f976f7a5cc351ef8b3529e1 k8s.gcr.io/e2e-test-images/agnhost:2.32],SizeBytes:50002177,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler@sha256:67640771ad9fc56f109d5b01e020f0c858e7c890bb0eb15ba0ebd325df3285e7 k8s.gcr.io/cpa/cluster-proportional-autoscaler:1.8.3],SizeBytes:15191740,},ContainerImage{Names:[docker.io/coredns/coredns@sha256:642ff9910da6ea9a8624b0234eef52af9ca75ecbec474c5507cb096bdfbae4e5 docker.io/coredns/coredns:1.8.3],SizeBytes:12893350,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:503b7abb89e57383eba61cc8a9cb0b495ea575c516108f7d972a6ff6e1ab3c9b k8s.gcr.io/e2e-test-images/nginx:1.14-1],SizeBytes:6979365,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/node-driver-registrar@sha256:9cd9ef74078997d4d05f5061b6a4948b54b591bb5152675f45a183c3a1cbbfd8 public.ecr.aws/eks-distro/kubernetes-csi/node-driver-registrar:v2.6.2-eks-1-25-latest],SizeBytes:6553584,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/livenessprobe@sha256:d790820d19a6253ee31418be4d1a9ae023d4a6b64c5591f8f031b4194828cc5b public.ecr.aws/eks-distro/kubernetes-csi/livenessprobe:v2.8.0-eks-1-25-latest],SizeBytes:6005708,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Feb 6 18:56:04.877: INFO: Logging kubelet events for node ip-172-20-39-190.us-west-2.compute.internal Feb 6 18:56:04.956: INFO: Logging pods the kubelet thinks is on node ip-172-20-39-190.us-west-2.compute.internal Feb 6 18:56:05.024: INFO: efs-csi-node-zjlnx started at 2023-02-06 18:50:05 +0000 UTC (0+3 container statuses recorded) Feb 6 18:56:05.024: INFO: Container csi-driver-registrar ready: true, restart count 0 Feb 6 18:56:05.024: INFO: Container efs-plugin ready: true, restart count 0 Feb 6 18:56:05.024: INFO: Container liveness-probe ready: true, restart count 0 Feb 6 18:56:05.024: INFO: pod-96d21ae8-6a28-429f-a95e-d40df87de5b7 started at 2023-02-06 18:55:54 +0000 UTC (0+1 container statuses recorded) Feb 6 18:56:05.024: INFO: Container write-pod ready: false, restart count 0 Feb 6 18:56:05.024: INFO: kube-proxy-ip-172-20-39-190.us-west-2.compute.internal started at 2023-02-06 18:49:17 +0000 UTC (0+1 container statuses recorded) Feb 6 18:56:05.025: INFO: Container kube-proxy ready: true, restart count 0 Feb 6 18:56:05.025: INFO: coredns-autoscaler-6f594f4c58-lp27t started at 2023-02-06 18:49:40 +0000 UTC (0+1 container statuses recorded) Feb 6 18:56:05.025: INFO: Container autoscaler ready: true, restart count 0 Feb 6 18:56:05.025: INFO: coredns-8f5559c9b-2jrst started at 2023-02-06 18:49:40 +0000 UTC (0+1 container statuses recorded) Feb 6 18:56:05.025: INFO: Container coredns ready: true, restart count 0 Feb 6 18:56:05.328: INFO: Latency metrics for node ip-172-20-39-190.us-west-2.compute.internal Feb 6 18:56:05.328: INFO: Logging node info for node ip-172-20-90-111.us-west-2.compute.internal Feb 6 18:56:05.392: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-90-111.us-west-2.compute.internal aa609e60-20bd-4f17-86a7-9393b747e3b8 2917 0 2023-02-06 18:49:31 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2b kops.k8s.io/instancegroup:nodes-us-west-2b kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-90-111.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:c5.large topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2b] map[csi.volume.kubernetes.io/nodeid:{"efs.csi.aws.com":"i-072b58f0331d07c6d"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2023-02-06 18:49:31 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/instancegroup":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-02-06 18:49:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} } {kubelet Update v1 2023-02-06 18:50:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-aws-ebs":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-aws-ebs":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2b/i-072b58f0331d07c6d,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{25 0} {<nil>} 25 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{133003395072 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3862945792 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{25 0} {<nil>} 25 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{119703055367 0} {<nil>} 119703055367 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3758088192 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-02-06 18:49:33 +0000 UTC,LastTransitionTime:2023-02-06 18:49:33 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-06 18:55:52 +0000 UTC,LastTransitionTime:2023-02-06 18:49:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-06 18:55:52 +0000 UTC,LastTransitionTime:2023-02-06 18:49:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-06 18:55:52 +0000 UTC,LastTransitionTime:2023-02-06 18:49:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-06 18:55:52 +0000 UTC,LastTransitionTime:2023-02-06 18:49:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.90.111,},NodeAddress{Type:ExternalIP,Address:34.217.38.7,},NodeAddress{Type:Hostname,Address:ip-172-20-90-111.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-90-111.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-34-217-38-7.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2f5f3c7e61d5016d297e6cfc8c06a1,SystemUUID:ec2f5f3c-7e61-d501-6d29-7e6cfc8c06a1,BootID:5b26bfd5-224a-456b-b547-604b3ea9faab,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.20.8,KubeProxyVersion:v1.20.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[607362164682.dkr.ecr.us-west-2.amazonaws.com/aws-efs-csi-driver@sha256:cfb4417dbd36e453d92b427bd06719934fa133d51451b867a25615d18b02421f 607362164682.dkr.ecr.us-west-2.amazonaws.com/aws-efs-csi-driver:26295],SizeBytes:501573953,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:702a992280fb7c3303e84a5801acbb4c9c7fcf48cffe0e9c8be3f0c60f74cf89 k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.4],SizeBytes:112029652,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:0c867c82a0a8ce6d093595f9d2e4b10517d6c9c26323075de9d82d9f7d056bfc k8s.gcr.io/kube-proxy:v1.20.8],SizeBytes:52056682,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:758db666ac7028534dba72e7e9bb1e57bb81b8196f976f7a5cc351ef8b3529e1 k8s.gcr.io/e2e-test-images/agnhost:2.32],SizeBytes:50002177,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/external-provisioner@sha256:e677f72d499e09557e20ba9b5ade9fbbc70b73f658b95226963215eaa9fdb1ad public.ecr.aws/eks-distro/kubernetes-csi/external-provisioner:v3.3.0-eks-1-25-latest],SizeBytes:13992120,},ContainerImage{Names:[docker.io/coredns/coredns@sha256:642ff9910da6ea9a8624b0234eef52af9ca75ecbec474c5507cb096bdfbae4e5 docker.io/coredns/coredns:1.8.3],SizeBytes:12893350,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/node-driver-registrar@sha256:9cd9ef74078997d4d05f5061b6a4948b54b591bb5152675f45a183c3a1cbbfd8 public.ecr.aws/eks-distro/kubernetes-csi/node-driver-registrar:v2.6.2-eks-1-25-latest],SizeBytes:6553584,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/livenessprobe@sha256:d790820d19a6253ee31418be4d1a9ae023d4a6b64c5591f8f031b4194828cc5b public.ecr.aws/eks-distro/kubernetes-csi/livenessprobe:v2.8.0-eks-1-25-latest],SizeBytes:6005708,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Feb 6 18:56:05.394: INFO: Logging kubelet events for node ip-172-20-90-111.us-west-2.compute.internal Feb 6 18:56:05.466: INFO: Logging pods the kubelet thinks is on node ip-172-20-90-111.us-west-2.compute.internal Feb 6 18:56:05.533: INFO: kube-proxy-ip-172-20-90-111.us-west-2.compute.internal started at 2023-02-06 18:49:19 +0000 UTC (0+1 container statuses recorded) Feb 6 18:56:05.533: INFO: Container kube-proxy ready: true, restart count 0 Feb 6 18:56:05.533: INFO: coredns-8f5559c9b-rdtwd started at 2023-02-06 18:49:42 +0000 UTC (0+1 container statuses recorded) Feb 6 18:56:05.533: INFO: Container coredns ready: true, restart count 0 Feb 6 18:56:05.533: INFO: efs-csi-node-zq654 started at 2023-02-06 18:50:05 +0000 UTC (0+3 container statuses recorded) Feb 6 18:56:05.533: INFO: Container csi-driver-registrar ready: true, restart count 0 Feb 6 18:56:05.533: INFO: Container efs-plugin ready: true, restart count 0 Feb 6 18:56:05.533: INFO: Container liveness-probe ready: true, restart count 0 Feb 6 18:56:05.533: INFO: efs-csi-controller-c584f665c-ktmqc started at 2023-02-06 18:50:05 +0000 UTC (0+3 container statuses recorded) Feb 6 18:56:05.533: INFO: Container csi-provisioner ready: true, restart count 0 Feb 6 18:56:05.533: INFO: Container efs-plugin ready: true, restart count 0 Feb 6 18:56:05.533: INFO: Container liveness-probe ready: true, restart count 0 Feb 6 18:56:05.819: INFO: Latency metrics for node ip-172-20-90-111.us-west-2.compute.internal Feb 6 18:56:05.819: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "multivolume-2199" for this suite. [AfterEach] [efs-csi] EFS CSI /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "efs-6159". �[1mSTEP�[0m: Found 0 events. Feb 6 18:56:06.087: INFO: POD NODE PHASE GRACE CONDITIONS Feb 6 18:56:06.087: INFO: Feb 6 18:56:06.163: INFO: Logging node info for node ip-172-20-107-56.us-west-2.compute.internal Feb 6 18:56:06.226: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-107-56.us-west-2.compute.internal 73d868c1-0561-4bd0-8eb5-49367953c042 2130 0 2023-02-06 18:49:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2c kops.k8s.io/instancegroup:nodes-us-west-2c kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-107-56.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:c5.large topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2c] map[csi.volume.kubernetes.io/nodeid:{"efs.csi.aws.com":"i-048b7babafdb24269"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2023-02-06 18:49:34 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/instancegroup":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-02-06 18:49:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} } {kubelet Update v1 2023-02-06 18:54:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-aws-ebs":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-aws-ebs":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2c/i-048b7babafdb24269,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{25 0} {<nil>} 25 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{133003395072 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3862945792 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{25 0} {<nil>} 25 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{119703055367 0} {<nil>} 119703055367 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3758088192 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-02-06 18:49:43 +0000 UTC,LastTransitionTime:2023-02-06 18:49:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-06 18:54:44 +0000 UTC,LastTransitionTime:2023-02-06 18:49:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-06 18:54:44 +0000 UTC,LastTransitionTime:2023-02-06 18:49:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-06 18:54:44 +0000 UTC,LastTransitionTime:2023-02-06 18:49:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-06 18:54:44 +0000 UTC,LastTransitionTime:2023-02-06 18:49:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.107.56,},NodeAddress{Type:ExternalIP,Address:35.89.207.5,},NodeAddress{Type:Hostname,Address:ip-172-20-107-56.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-107-56.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-89-207-5.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec26fb1b06e6bc6a75c9924b4fc61b1e,SystemUUID:ec26fb1b-06e6-bc6a-75c9-924b4fc61b1e,BootID:fa669e77-47c4-4a4d-8068-4257b9fb8f3f,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.20.8,KubeProxyVersion:v1.20.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[607362164682.dkr.ecr.us-west-2.amazonaws.com/aws-efs-csi-driver@sha256:cfb4417dbd36e453d92b427bd06719934fa133d51451b867a25615d18b02421f 607362164682.dkr.ecr.us-west-2.amazonaws.com/aws-efs-csi-driver:26295],SizeBytes:501573953,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:0c867c82a0a8ce6d093595f9d2e4b10517d6c9c26323075de9d82d9f7d056bfc k8s.gcr.io/kube-proxy:v1.20.8],SizeBytes:52056682,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/external-provisioner@sha256:e677f72d499e09557e20ba9b5ade9fbbc70b73f658b95226963215eaa9fdb1ad public.ecr.aws/eks-distro/kubernetes-csi/external-provisioner:v3.3.0-eks-1-25-latest],SizeBytes:13992120,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/node-driver-registrar@sha256:9cd9ef74078997d4d05f5061b6a4948b54b591bb5152675f45a183c3a1cbbfd8 public.ecr.aws/eks-distro/kubernetes-csi/node-driver-registrar:v2.6.2-eks-1-25-latest],SizeBytes:6553584,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/livenessprobe@sha256:d790820d19a6253ee31418be4d1a9ae023d4a6b64c5591f8f031b4194828cc5b public.ecr.aws/eks-distro/kubernetes-csi/livenessprobe:v2.8.0-eks-1-25-latest],SizeBytes:6005708,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Feb 6 18:56:06.226: INFO: Logging kubelet events for node ip-172-20-107-56.us-west-2.compute.internal Feb 6 18:56:06.297: INFO: Logging pods the kubelet thinks is on node ip-172-20-107-56.us-west-2.compute.internal Feb 6 18:56:06.365: INFO: pvc-tester-zmzxl started at 2023-02-06 18:54:25 +0000 UTC (0+1 container statuses recorded) Feb 6 18:56:06.365: INFO: Container write-pod ready: false, restart count 0 Feb 6 18:56:06.365: INFO: kube-proxy-ip-172-20-107-56.us-west-2.compute.internal started at 2023-02-06 18:49:14 +0000 UTC (0+1 container statuses recorded) Feb 6 18:56:06.365: INFO: Container kube-proxy ready: true, restart count 0 Feb 6 18:56:06.365: INFO: efs-csi-node-fk7vp started at 2023-02-06 18:54:44 +0000 UTC (0+3 container statuses recorded) Feb 6 18:56:06.365: INFO: Container csi-driver-registrar ready: true, restart count 0 Feb 6 18:56:06.365: INFO: Container efs-plugin ready: true, restart count 0 Feb 6 18:56:06.365: INFO: Container liveness-probe ready: true, restart count 0 Feb 6 18:56:06.365: INFO: efs-csi-controller-c584f665c-8wgrt started at 2023-02-06 18:50:05 +0000 UTC (0+3 container statuses recorded) Feb 6 18:56:06.365: INFO: Container csi-provisioner ready: true, restart count 0 Feb 6 18:56:06.365: INFO: Container efs-plugin ready: true, restart count 0 Feb 6 18:56:06.365: INFO: Container liveness-probe ready: true, restart count 0 Feb 6 18:56:06.644: INFO: Latency metrics for node ip-172-20-107-56.us-west-2.compute.internal Feb 6 18:56:06.644: INFO: Logging node info for node ip-172-20-35-183.us-west-2.compute.internal Feb 6 18:56:06.713: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-35-183.us-west-2.compute.internal 1348c951-9ddb-4d2c-a6ab-09ca2aacd9f4 2855 0 2023-02-06 18:48:25 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kops.k8s.io/instancegroup:master-us-west-2a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-35-183.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/control-plane: node-role.kubernetes.io/master: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:t3.medium topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[csi.volume.kubernetes.io/nodeid:{"efs.csi.aws.com":"i-0725700ff8e28d48d"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{protokube Update v1 2023-02-06 18:48:30 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/control-plane":{},"f:node-role.kubernetes.io/master":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-02-06 18:48:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} } {kops-controller Update v1 2023-02-06 18:48:57 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/instancegroup":{}}}} } {kubelet Update v1 2023-02-06 18:50:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-aws-ebs":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-aws-ebs":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-0725700ff8e28d48d,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{25 0} {<nil>} 25 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{66404147200 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051685376 0} {<nil>} 3956724Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{25 0} {<nil>} 25 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{59763732382 0} {<nil>} 59763732382 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946827776 0} {<nil>} 3854324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-02-06 18:48:42 +0000 UTC,LastTransitionTime:2023-02-06 18:48:42 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-06 18:55:48 +0000 UTC,LastTransitionTime:2023-02-06 18:48:21 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-06 18:55:48 +0000 UTC,LastTransitionTime:2023-02-06 18:48:21 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-06 18:55:48 +0000 UTC,LastTransitionTime:2023-02-06 18:48:21 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-06 18:55:48 +0000 UTC,LastTransitionTime:2023-02-06 18:48:52 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.35.183,},NodeAddress{Type:ExternalIP,Address:34.222.145.229,},NodeAddress{Type:Hostname,Address:ip-172-20-35-183.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-35-183.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-34-222-145-229.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec20586bb158fd4c929ecfb5adb0cce2,SystemUUID:ec20586b-b158-fd4c-929e-cfb5adb0cce2,BootID:c39134eb-d8bc-4ce1-bf49-554704d186b9,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.20.8,KubeProxyVersion:v1.20.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[607362164682.dkr.ecr.us-west-2.amazonaws.com/aws-efs-csi-driver@sha256:cfb4417dbd36e453d92b427bd06719934fa133d51451b867a25615d18b02421f 607362164682.dkr.ecr.us-west-2.amazonaws.com/aws-efs-csi-driver:26295],SizeBytes:501573953,},ContainerImage{Names:[k8s.gcr.io/etcdadm/etcd-manager@sha256:ebb73d3d4a99da609f9e01c556cd9f9aa7a0aecba8f5bc5588d7c45eb38e3a7e k8s.gcr.io/etcdadm/etcd-manager:3.0.20210430],SizeBytes:171082409,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:0c867c82a0a8ce6d093595f9d2e4b10517d6c9c26323075de9d82d9f7d056bfc k8s.gcr.io/kube-proxy:v1.20.8],SizeBytes:52056682,},ContainerImage{Names:[k8s.gcr.io/kops/dns-controller@sha256:f3724709f264bd47d2251f4ec5b16ec5482e8a2d65da006cd3165eb4da0bd3d1 k8s.gcr.io/kops/dns-controller:1.21.0],SizeBytes:40960953,},ContainerImage{Names:[k8s.gcr.io/kops/kops-controller@sha256:05b7d6511df0084aed954a009099402d2a7e7227adf0f410c4583204e6f76429 k8s.gcr.io/kops/kops-controller:1.21.0],SizeBytes:40618104,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:531ffd92bd954f5c27002ce11502771146e7c867c09a6e1755631953ff584df4 k8s.gcr.io/kube-apiserver:v1.20.8],SizeBytes:30462643,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:13509f0b36bbd4d2d142cf4c35d77f32ec3728975d96cf833b60b484effa8c43 k8s.gcr.io/kube-controller-manager:v1.20.8],SizeBytes:29554511,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:6fc53cbc3f035ba2b0ac9127e9dc5aa7a95b73f041f7cc14c36cdfc095b13080 k8s.gcr.io/kube-scheduler:v1.20.8],SizeBytes:14243733,},ContainerImage{Names:[k8s.gcr.io/kops/kube-apiserver-healthcheck@sha256:d772e49a0ae9dea319f26aaa40d58a123860b19da6378d29898eb30208359241 k8s.gcr.io/kops/kube-apiserver-healthcheck:1.21.0],SizeBytes:11771024,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/node-driver-registrar@sha256:9cd9ef74078997d4d05f5061b6a4948b54b591bb5152675f45a183c3a1cbbfd8 public.ecr.aws/eks-distro/kubernetes-csi/node-driver-registrar:v2.6.2-eks-1-25-latest],SizeBytes:6553584,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/livenessprobe@sha256:d790820d19a6253ee31418be4d1a9ae023d4a6b64c5591f8f031b4194828cc5b public.ecr.aws/eks-distro/kubernetes-csi/livenessprobe:v2.8.0-eks-1-25-latest],SizeBytes:6005708,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Feb 6 18:56:06.714: INFO: Logging kubelet events for node ip-172-20-35-183.us-west-2.compute.internal Feb 6 18:56:06.779: INFO: Logging pods the kubelet thinks is on node ip-172-20-35-183.us-west-2.compute.internal Feb 6 18:56:06.857: INFO: dns-controller-5d59c585d8-6rjvt started at 2023-02-06 18:48:53 +0000 UTC (0+1 container statuses recorded) Feb 6 18:56:06.857: INFO: Container dns-controller ready: true, restart count 0 Feb 6 18:56:06.857: INFO: kops-controller-m8w87 started at 2023-02-06 18:48:53 +0000 UTC (0+1 container statuses recorded) Feb 6 18:56:06.857: INFO: Container kops-controller ready: true, restart count 0 Feb 6 18:56:06.857: INFO: efs-csi-node-97npp started at 2023-02-06 18:50:05 +0000 UTC (0+3 container statuses recorded) Feb 6 18:56:06.857: INFO: Container csi-driver-registrar ready: true, restart count 0 Feb 6 18:56:06.857: INFO: Container efs-plugin ready: true, restart count 0 Feb 6 18:56:06.857: INFO: Container liveness-probe ready: true, restart count 0 Feb 6 18:56:06.857: INFO: kube-controller-manager-ip-172-20-35-183.us-west-2.compute.internal started at 2023-02-06 18:47:38 +0000 UTC (0+1 container statuses recorded) Feb 6 18:56:06.857: INFO: Container kube-controller-manager ready: true, restart count 0 Feb 6 18:56:06.857: INFO: kube-proxy-ip-172-20-35-183.us-west-2.compute.internal started at 2023-02-06 18:47:38 +0000 UTC (0+1 container statuses recorded) Feb 6 18:56:06.857: INFO: Container kube-proxy ready: true, restart count 0 Feb 6 18:56:06.857: INFO: kube-scheduler-ip-172-20-35-183.us-west-2.compute.internal started at 2023-02-06 18:47:38 +0000 UTC (0+1 container statuses recorded) Feb 6 18:56:06.857: INFO: Container kube-scheduler ready: true, restart count 0 Feb 6 18:56:06.857: INFO: etcd-manager-main-ip-172-20-35-183.us-west-2.compute.internal started at 2023-02-06 18:47:38 +0000 UTC (0+1 container statuses recorded) Feb 6 18:56:06.857: INFO: Container etcd-manager ready: true, restart count 0 Feb 6 18:56:06.857: INFO: kube-apiserver-ip-172-20-35-183.us-west-2.compute.internal started at 2023-02-06 18:47:38 +0000 UTC (0+2 container statuses recorded) Feb 6 18:56:06.857: INFO: Container healthcheck ready: true, restart count 0 Feb 6 18:56:06.857: INFO: Container kube-apiserver ready: true, restart count 0 Feb 6 18:56:06.857: INFO: etcd-manager-events-ip-172-20-35-183.us-west-2.compute.internal started at 2023-02-06 18:47:38 +0000 UTC (0+1 container statuses recorded) Feb 6 18:56:06.857: INFO: Container etcd-manager ready: true, restart count 0 Feb 6 18:56:07.318: INFO: Latency metrics for node ip-172-20-35-183.us-west-2.compute.internal Feb 6 18:56:07.319: INFO: Logging node info for node ip-172-20-39-190.us-west-2.compute.internal Feb 6 18:56:07.384: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-39-190.us-west-2.compute.internal 639b701f-454f-4006-9106-500e5ee5d0d2 2885 0 2023-02-06 18:49:29 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kops.k8s.io/instancegroup:nodes-us-west-2a kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-39-190.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:c5.large topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[csi.volume.kubernetes.io/nodeid:{"efs.csi.aws.com":"i-06d1c87be3fa9644f"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2023-02-06 18:49:29 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/instancegroup":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-02-06 18:49:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} } {kubelet Update v1 2023-02-06 18:50:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-aws-ebs":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-aws-ebs":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-06d1c87be3fa9644f,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{25 0} {<nil>} 25 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{133003395072 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892305920 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{25 0} {<nil>} 25 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{119703055367 0} {<nil>} 119703055367 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787448320 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-02-06 18:49:33 +0000 UTC,LastTransitionTime:2023-02-06 18:49:33 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-06 18:55:49 +0000 UTC,LastTransitionTime:2023-02-06 18:49:29 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-06 18:55:49 +0000 UTC,LastTransitionTime:2023-02-06 18:49:29 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-06 18:55:49 +0000 UTC,LastTransitionTime:2023-02-06 18:49:29 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-06 18:55:49 +0000 UTC,LastTransitionTime:2023-02-06 18:49:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.39.190,},NodeAddress{Type:ExternalIP,Address:52.40.251.97,},NodeAddress{Type:Hostname,Address:ip-172-20-39-190.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-39-190.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-52-40-251-97.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec28fe7c04520bffe074b028bac9b94b,SystemUUID:ec28fe7c-0452-0bff-e074-b028bac9b94b,BootID:70a79809-a9cf-45b1-90fc-67582ec7bb68,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.20.8,KubeProxyVersion:v1.20.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[607362164682.dkr.ecr.us-west-2.amazonaws.com/aws-efs-csi-driver@sha256:cfb4417dbd36e453d92b427bd06719934fa133d51451b867a25615d18b02421f 607362164682.dkr.ecr.us-west-2.amazonaws.com/aws-efs-csi-driver:26295],SizeBytes:501573953,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:702a992280fb7c3303e84a5801acbb4c9c7fcf48cffe0e9c8be3f0c60f74cf89 k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.4],SizeBytes:112029652,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:0c867c82a0a8ce6d093595f9d2e4b10517d6c9c26323075de9d82d9f7d056bfc k8s.gcr.io/kube-proxy:v1.20.8],SizeBytes:52056682,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:758db666ac7028534dba72e7e9bb1e57bb81b8196f976f7a5cc351ef8b3529e1 k8s.gcr.io/e2e-test-images/agnhost:2.32],SizeBytes:50002177,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler@sha256:67640771ad9fc56f109d5b01e020f0c858e7c890bb0eb15ba0ebd325df3285e7 k8s.gcr.io/cpa/cluster-proportional-autoscaler:1.8.3],SizeBytes:15191740,},ContainerImage{Names:[docker.io/coredns/coredns@sha256:642ff9910da6ea9a8624b0234eef52af9ca75ecbec474c5507cb096bdfbae4e5 docker.io/coredns/coredns:1.8.3],SizeBytes:12893350,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:503b7abb89e57383eba61cc8a9cb0b495ea575c516108f7d972a6ff6e1ab3c9b k8s.gcr.io/e2e-test-images/nginx:1.14-1],SizeBytes:6979365,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/node-driver-registrar@sha256:9cd9ef74078997d4d05f5061b6a4948b54b591bb5152675f45a183c3a1cbbfd8 public.ecr.aws/eks-distro/kubernetes-csi/node-driver-registrar:v2.6.2-eks-1-25-latest],SizeBytes:6553584,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/livenessprobe@sha256:d790820d19a6253ee31418be4d1a9ae023d4a6b64c5591f8f031b4194828cc5b public.ecr.aws/eks-distro/kubernetes-csi/livenessprobe:v2.8.0-eks-1-25-latest],SizeBytes:6005708,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Feb 6 18:56:07.384: INFO: Logging kubelet events for node ip-172-20-39-190.us-west-2.compute.internal Feb 6 18:56:07.454: INFO: Logging pods the kubelet thinks is on node ip-172-20-39-190.us-west-2.compute.internal Feb 6 18:56:07.521: INFO: coredns-8f5559c9b-2jrst started at 2023-02-06 18:49:40 +0000 UTC (0+1 container statuses recorded) Feb 6 18:56:07.521: INFO: Container coredns ready: true, restart count 0 Feb 6 18:56:07.521: INFO: efs-csi-node-zjlnx started at 2023-02-06 18:50:05 +0000 UTC (0+3 container statuses recorded) Feb 6 18:56:07.521: INFO: Container csi-driver-registrar ready: true, restart count 0 Feb 6 18:56:07.521: INFO: Container efs-plugin ready: true, restart count 0 Feb 6 18:56:07.521: INFO: Container liveness-probe ready: true, restart count 0 Feb 6 18:56:07.521: INFO: kube-proxy-ip-172-20-39-190.us-west-2.compute.internal started at 2023-02-06 18:49:17 +0000 UTC (0+1 container statuses recorded) Feb 6 18:56:07.521: INFO: Container kube-proxy ready: true, restart count 0 Feb 6 18:56:07.521: INFO: coredns-autoscaler-6f594f4c58-lp27t started at 2023-02-06 18:49:40 +0000 UTC (0+1 container statuses recorded) Feb 6 18:56:07.521: INFO: Container autoscaler ready: true, restart count 0 Feb 6 18:56:07.776: INFO: Latency metrics for node ip-172-20-39-190.us-west-2.compute.internal Feb 6 18:56:07.776: INFO: Logging node info for node ip-172-20-90-111.us-west-2.compute.internal Feb 6 18:56:07.840: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-90-111.us-west-2.compute.internal aa609e60-20bd-4f17-86a7-9393b747e3b8 2917 0 2023-02-06 18:49:31 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2b kops.k8s.io/instancegroup:nodes-us-west-2b kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-90-111.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:c5.large topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2b] map[csi.volume.kubernetes.io/nodeid:{"efs.csi.aws.com":"i-072b58f0331d07c6d"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2023-02-06 18:49:31 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/instancegroup":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-02-06 18:49:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} } {kubelet Update v1 2023-02-06 18:50:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-aws-ebs":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-aws-ebs":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2b/i-072b58f0331d07c6d,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{25 0} {<nil>} 25 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{133003395072 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3862945792 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{25 0} {<nil>} 25 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{119703055367 0} {<nil>} 119703055367 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3758088192 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-02-06 18:49:33 +0000 UTC,LastTransitionTime:2023-02-06 18:49:33 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-06 18:55:52 +0000 UTC,LastTransitionTime:2023-02-06 18:49:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-06 18:55:52 +0000 UTC,LastTransitionTime:2023-02-06 18:49:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-06 18:55:52 +0000 UTC,LastTransitionTime:2023-02-06 18:49:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-06 18:55:52 +0000 UTC,LastTransitionTime:2023-02-06 18:49:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.90.111,},NodeAddress{Type:ExternalIP,Address:34.217.38.7,},NodeAddress{Type:Hostname,Address:ip-172-20-90-111.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-90-111.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-34-217-38-7.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2f5f3c7e61d5016d297e6cfc8c06a1,SystemUUID:ec2f5f3c-7e61-d501-6d29-7e6cfc8c06a1,BootID:5b26bfd5-224a-456b-b547-604b3ea9faab,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.20.8,KubeProxyVersion:v1.20.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[607362164682.dkr.ecr.us-west-2.amazonaws.com/aws-efs-csi-driver@sha256:cfb4417dbd36e453d92b427bd06719934fa133d51451b867a25615d18b02421f 607362164682.dkr.ecr.us-west-2.amazonaws.com/aws-efs-csi-driver:26295],SizeBytes:501573953,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:702a992280fb7c3303e84a5801acbb4c9c7fcf48cffe0e9c8be3f0c60f74cf89 k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.4],SizeBytes:112029652,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:0c867c82a0a8ce6d093595f9d2e4b10517d6c9c26323075de9d82d9f7d056bfc k8s.gcr.io/kube-proxy:v1.20.8],SizeBytes:52056682,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:758db666ac7028534dba72e7e9bb1e57bb81b8196f976f7a5cc351ef8b3529e1 k8s.gcr.io/e2e-test-images/agnhost:2.32],SizeBytes:50002177,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/external-provisioner@sha256:e677f72d499e09557e20ba9b5ade9fbbc70b73f658b95226963215eaa9fdb1ad public.ecr.aws/eks-distro/kubernetes-csi/external-provisioner:v3.3.0-eks-1-25-latest],SizeBytes:13992120,},ContainerImage{Names:[docker.io/coredns/coredns@sha256:642ff9910da6ea9a8624b0234eef52af9ca75ecbec474c5507cb096bdfbae4e5 docker.io/coredns/coredns:1.8.3],SizeBytes:12893350,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/node-driver-registrar@sha256:9cd9ef74078997d4d05f5061b6a4948b54b591bb5152675f45a183c3a1cbbfd8 public.ecr.aws/eks-distro/kubernetes-csi/node-driver-registrar:v2.6.2-eks-1-25-latest],SizeBytes:6553584,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/livenessprobe@sha256:d790820d19a6253ee31418be4d1a9ae023d4a6b64c5591f8f031b4194828cc5b public.ecr.aws/eks-distro/kubernetes-csi/livenessprobe:v2.8.0-eks-1-25-latest],SizeBytes:6005708,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Feb 6 18:56:07.841: INFO: Logging kubelet events for node ip-172-20-90-111.us-west-2.compute.internal Feb 6 18:56:07.908: INFO: Logging pods the kubelet thinks is on node ip-172-20-90-111.us-west-2.compute.internal Feb 6 18:56:07.981: INFO: efs-csi-node-zq654 started at 2023-02-06 18:50:05 +0000 UTC (0+3 container statuses recorded) Feb 6 18:56:07.981: INFO: Container csi-driver-registrar ready: true, restart count 0 Feb 6 18:56:07.981: INFO: Container efs-plugin ready: true, restart count 0 Feb 6 18:56:07.981: INFO: Container liveness-probe ready: true, restart count 0 Feb 6 18:56:07.981: INFO: efs-csi-controller-c584f665c-ktmqc started at 2023-02-06 18:50:05 +0000 UTC (0+3 container statuses recorded) Feb 6 18:56:07.981: INFO: Container csi-provisioner ready: true, restart count 0 Feb 6 18:56:07.981: INFO: Container efs-plugin ready: true, restart count 0 Feb 6 18:56:07.981: INFO: Container liveness-probe ready: true, restart count 0 Feb 6 18:56:07.981: INFO: kube-proxy-ip-172-20-90-111.us-west-2.compute.internal started at 2023-02-06 18:49:19 +0000 UTC (0+1 container statuses recorded) Feb 6 18:56:07.981: INFO: Container kube-proxy ready: true, restart count 0 Feb 6 18:56:07.981: INFO: coredns-8f5559c9b-rdtwd started at 2023-02-06 18:49:42 +0000 UTC (0+1 container statuses recorded) Feb 6 18:56:07.981: INFO: Container coredns ready: true, restart count 0 Feb 6 18:56:08.259: INFO: Latency metrics for node ip-172-20-90-111.us-west-2.compute.internal Feb 6 18:56:08.260: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "efs-6159" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=EFS\sCSI\sSuite\s\[efs\-csi\]\sEFS\sCSI\s\[Driver\:\sefs\.csi\.aws\.com\]\sshould\scontinue\sreading\/writing\swithout\shanging\safter\sthe\sdriver\spod\sis\srestarted$'
/home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/test/e2e/e2e.go:268 Feb 6 18:55:15.649: timed out verifying exec in pod succeeded /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/vendor/github.com/onsi/ginkgo/internal/leafnodes/runner.go:113from junit_03.xml
[BeforeEach] [efs-csi] EFS CSI /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/test/e2e/e2e.go:219 [BeforeEach] [efs-csi] EFS CSI /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Feb 6 18:54:24.658: INFO: >>> kubeConfig: /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/hack/e2e/csi-test-artifacts/test-cluster-26295.k8s.local.kops.kubeconfig �[1mSTEP�[0m: Building a namespace api object, basename efs �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [It] should continue reading/writing without hanging after the driver pod is restarted /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/test/e2e/e2e.go:268 �[1mSTEP�[0m: Creating efs pvc & pv �[1mSTEP�[0m: Creating pod on node "ip-172-20-107-56.us-west-2.compute.internal" to mount pvc "efs-6831" and run "touch /mnt/volume1/efs-6831-2023-02-06T18:54:25Z && trap exit TERM; while true; do sleep 1; done" �[1mSTEP�[0m: Getting driver pod on node "ip-172-20-107-56.us-west-2.compute.internal" �[1mSTEP�[0m: Deleting driver pod "efs-csi-node-skscp" on node "ip-172-20-107-56.us-west-2.compute.internal" Feb 6 18:54:43.443: INFO: Deleting pod "efs-csi-node-skscp" in namespace "kube-system" Feb 6 18:54:43.509: INFO: Wait up to 5m0s for pod "efs-csi-node-skscp" to be fully deleted �[1mSTEP�[0m: Execing a write via the pod on node "ip-172-20-107-56.us-west-2.compute.internal" Feb 6 18:54:45.644: INFO: ExecWithOptions {Command:[/bin/sh -c touch /mnt/volume1/efs-6831-2023-02-06T18:54:45Z] Namespace:efs-6831 PodName:pvc-tester-zmzxl ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Feb 6 18:54:45.644: INFO: >>> kubeConfig: /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/hack/e2e/csi-test-artifacts/test-cluster-26295.k8s.local.kops.kubeconfig Feb 6 18:55:15.648: FAIL: timed out verifying exec in pod succeeded Full Stack Trace github.com/kubernetes-sigs/aws-efs-csi-driver/test/e2e.TestEFSCSI(0x408659?) /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/test/e2e/e2e_test.go:102 +0x311 testing.tRunner(0xc000502d00, 0x1da2eb8) /usr/local/go/src/testing/testing.go:1446 +0x10b created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1493 +0x35f [AfterEach] [efs-csi] EFS CSI /home/prow/go/src/github.com/kubernetes-sigs/aws-efs-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "efs-6831". �[1mSTEP�[0m: Found 5 events. Feb 6 18:55:15.781: INFO: At 2023-02-06 18:54:25 +0000 UTC - event for pvc-tester-zmzxl: {kubelet ip-172-20-107-56.us-west-2.compute.internal} FailedMount: Unable to attach or mount volumes: unmounted volumes=[volume1], unattached volumes=[volume1 default-token-9mvzp]: error processing PVC efs-6831/efs-6831: PVC is not bound Feb 6 18:55:15.781: INFO: At 2023-02-06 18:54:40 +0000 UTC - event for pvc-tester-zmzxl: {kubelet ip-172-20-107-56.us-west-2.compute.internal} Pulling: Pulling image "k8s.gcr.io/e2e-test-images/busybox:1.29-1" Feb 6 18:55:15.781: INFO: At 2023-02-06 18:54:41 +0000 UTC - event for pvc-tester-zmzxl: {kubelet ip-172-20-107-56.us-west-2.compute.internal} Pulled: Successfully pulled image "k8s.gcr.io/e2e-test-images/busybox:1.29-1" in 690.336725ms Feb 6 18:55:15.781: INFO: At 2023-02-06 18:54:41 +0000 UTC - event for pvc-tester-zmzxl: {kubelet ip-172-20-107-56.us-west-2.compute.internal} Created: Created container write-pod Feb 6 18:55:15.782: INFO: At 2023-02-06 18:54:41 +0000 UTC - event for pvc-tester-zmzxl: {kubelet ip-172-20-107-56.us-west-2.compute.internal} Started: Started container write-pod Feb 6 18:55:15.848: INFO: POD NODE PHASE GRACE CONDITIONS Feb 6 18:55:15.848: INFO: pvc-tester-zmzxl ip-172-20-107-56.us-west-2.compute.internal Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-02-06 18:54:25 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-02-06 18:54:41 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-02-06 18:54:41 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-02-06 18:54:25 +0000 UTC }] Feb 6 18:55:15.849: INFO: Feb 6 18:55:15.917: INFO: Logging node info for node ip-172-20-107-56.us-west-2.compute.internal Feb 6 18:55:15.984: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-107-56.us-west-2.compute.internal 73d868c1-0561-4bd0-8eb5-49367953c042 2130 0 2023-02-06 18:49:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2c kops.k8s.io/instancegroup:nodes-us-west-2c kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-107-56.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:c5.large topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2c] map[csi.volume.kubernetes.io/nodeid:{"efs.csi.aws.com":"i-048b7babafdb24269"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2023-02-06 18:49:34 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/instancegroup":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-02-06 18:49:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} } {kubelet Update v1 2023-02-06 18:54:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-aws-ebs":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-aws-ebs":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2c/i-048b7babafdb24269,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{25 0} {<nil>} 25 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{133003395072 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3862945792 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{25 0} {<nil>} 25 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{119703055367 0} {<nil>} 119703055367 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3758088192 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-02-06 18:49:43 +0000 UTC,LastTransitionTime:2023-02-06 18:49:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-06 18:54:44 +0000 UTC,LastTransitionTime:2023-02-06 18:49:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-06 18:54:44 +0000 UTC,LastTransitionTime:2023-02-06 18:49:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-06 18:54:44 +0000 UTC,LastTransitionTime:2023-02-06 18:49:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-06 18:54:44 +0000 UTC,LastTransitionTime:2023-02-06 18:49:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.107.56,},NodeAddress{Type:ExternalIP,Address:35.89.207.5,},NodeAddress{Type:Hostname,Address:ip-172-20-107-56.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-107-56.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-89-207-5.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec26fb1b06e6bc6a75c9924b4fc61b1e,SystemUUID:ec26fb1b-06e6-bc6a-75c9-924b4fc61b1e,BootID:fa669e77-47c4-4a4d-8068-4257b9fb8f3f,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.20.8,KubeProxyVersion:v1.20.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[607362164682.dkr.ecr.us-west-2.amazonaws.com/aws-efs-csi-driver@sha256:cfb4417dbd36e453d92b427bd06719934fa133d51451b867a25615d18b02421f 607362164682.dkr.ecr.us-west-2.amazonaws.com/aws-efs-csi-driver:26295],SizeBytes:501573953,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:0c867c82a0a8ce6d093595f9d2e4b10517d6c9c26323075de9d82d9f7d056bfc k8s.gcr.io/kube-proxy:v1.20.8],SizeBytes:52056682,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/external-provisioner@sha256:e677f72d499e09557e20ba9b5ade9fbbc70b73f658b95226963215eaa9fdb1ad public.ecr.aws/eks-distro/kubernetes-csi/external-provisioner:v3.3.0-eks-1-25-latest],SizeBytes:13992120,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/node-driver-registrar@sha256:9cd9ef74078997d4d05f5061b6a4948b54b591bb5152675f45a183c3a1cbbfd8 public.ecr.aws/eks-distro/kubernetes-csi/node-driver-registrar:v2.6.2-eks-1-25-latest],SizeBytes:6553584,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/livenessprobe@sha256:d790820d19a6253ee31418be4d1a9ae023d4a6b64c5591f8f031b4194828cc5b public.ecr.aws/eks-distro/kubernetes-csi/livenessprobe:v2.8.0-eks-1-25-latest],SizeBytes:6005708,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Feb 6 18:55:15.985: INFO: Logging kubelet events for node ip-172-20-107-56.us-west-2.compute.internal Feb 6 18:55:16.064: INFO: Logging pods the kubelet thinks is on node ip-172-20-107-56.us-west-2.compute.internal Feb 6 18:55:16.183: INFO: kube-proxy-ip-172-20-107-56.us-west-2.compute.internal started at 2023-02-06 18:49:14 +0000 UTC (0+1 container statuses recorded) Feb 6 18:55:16.183: INFO: Container kube-proxy ready: true, restart count 0 Feb 6 18:55:16.184: INFO: efs-csi-node-fk7vp started at 2023-02-06 18:54:44 +0000 UTC (0+3 container statuses recorded) Feb 6 18:55:16.184: INFO: Container csi-driver-registrar ready: true, restart count 0 Feb 6 18:55:16.184: INFO: Container efs-plugin ready: true, restart count 0 Feb 6 18:55:16.184: INFO: Container liveness-probe ready: true, restart count 0 Feb 6 18:55:16.184: INFO: efs-csi-controller-c584f665c-8wgrt started at 2023-02-06 18:50:05 +0000 UTC (0+3 container statuses recorded) Feb 6 18:55:16.184: INFO: Container csi-provisioner ready: true, restart count 0 Feb 6 18:55:16.184: INFO: Container efs-plugin ready: true, restart count 0 Feb 6 18:55:16.184: INFO: Container liveness-probe ready: true, restart count 0 Feb 6 18:55:16.184: INFO: pvc-tester-zmzxl started at 2023-02-06 18:54:25 +0000 UTC (0+1 container statuses recorded) Feb 6 18:55:16.184: INFO: Container write-pod ready: true, restart count 0 Feb 6 18:55:16.532: INFO: Latency metrics for node ip-172-20-107-56.us-west-2.compute.internal Feb 6 18:55:16.533: INFO: Logging node info for node ip-172-20-35-183.us-west-2.compute.internal Feb 6 18:55:16.600: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-35-183.us-west-2.compute.internal 1348c951-9ddb-4d2c-a6ab-09ca2aacd9f4 875 0 2023-02-06 18:48:25 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kops.k8s.io/instancegroup:master-us-west-2a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-35-183.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/control-plane: node-role.kubernetes.io/master: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:t3.medium topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[csi.volume.kubernetes.io/nodeid:{"efs.csi.aws.com":"i-0725700ff8e28d48d"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{protokube Update v1 2023-02-06 18:48:30 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/control-plane":{},"f:node-role.kubernetes.io/master":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-02-06 18:48:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} } {kops-controller Update v1 2023-02-06 18:48:57 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/instancegroup":{}}}} } {kubelet Update v1 2023-02-06 18:50:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-aws-ebs":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-aws-ebs":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-0725700ff8e28d48d,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{25 0} {<nil>} 25 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{66404147200 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051685376 0} {<nil>} 3956724Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{25 0} {<nil>} 25 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{59763732382 0} {<nil>} 59763732382 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946827776 0} {<nil>} 3854324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-02-06 18:48:42 +0000 UTC,LastTransitionTime:2023-02-06 18:48:42 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-06 18:50:46 +0000 UTC,LastTransitionTime:2023-02-06 18:48:21 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-06 18:50:46 +0000 UTC,LastTransitionTime:2023-02-06 18:48:21 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-06 18:50:46 +0000 UTC,LastTransitionTime:2023-02-06 18:48:21 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-06 18:50:46 +0000 UTC,LastTransitionTime:2023-02-06 18:48:52 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.35.183,},NodeAddress{Type:ExternalIP,Address:34.222.145.229,},NodeAddress{Type:Hostname,Address:ip-172-20-35-183.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-35-183.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-34-222-145-229.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec20586bb158fd4c929ecfb5adb0cce2,SystemUUID:ec20586b-b158-fd4c-929e-cfb5adb0cce2,BootID:c39134eb-d8bc-4ce1-bf49-554704d186b9,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.20.8,KubeProxyVersion:v1.20.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[607362164682.dkr.ecr.us-west-2.amazonaws.com/aws-efs-csi-driver@sha256:cfb4417dbd36e453d92b427bd06719934fa133d51451b867a25615d18b02421f 607362164682.dkr.ecr.us-west-2.amazonaws.com/aws-efs-csi-driver:26295],SizeBytes:501573953,},ContainerImage{Names:[k8s.gcr.io/etcdadm/etcd-manager@sha256:ebb73d3d4a99da609f9e01c556cd9f9aa7a0aecba8f5bc5588d7c45eb38e3a7e k8s.gcr.io/etcdadm/etcd-manager:3.0.20210430],SizeBytes:171082409,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:0c867c82a0a8ce6d093595f9d2e4b10517d6c9c26323075de9d82d9f7d056bfc k8s.gcr.io/kube-proxy:v1.20.8],SizeBytes:52056682,},ContainerImage{Names:[k8s.gcr.io/kops/dns-controller@sha256:f3724709f264bd47d2251f4ec5b16ec5482e8a2d65da006cd3165eb4da0bd3d1 k8s.gcr.io/kops/dns-controller:1.21.0],SizeBytes:40960953,},ContainerImage{Names:[k8s.gcr.io/kops/kops-controller@sha256:05b7d6511df0084aed954a009099402d2a7e7227adf0f410c4583204e6f76429 k8s.gcr.io/kops/kops-controller:1.21.0],SizeBytes:40618104,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:531ffd92bd954f5c27002ce11502771146e7c867c09a6e1755631953ff584df4 k8s.gcr.io/kube-apiserver:v1.20.8],SizeBytes:30462643,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:13509f0b36bbd4d2d142cf4c35d77f32ec3728975d96cf833b60b484effa8c43 k8s.gcr.io/kube-controller-manager:v1.20.8],SizeBytes:29554511,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:6fc53cbc3f035ba2b0ac9127e9dc5aa7a95b73f041f7cc14c36cdfc095b13080 k8s.gcr.io/kube-scheduler:v1.20.8],SizeBytes:14243733,},ContainerImage{Names:[k8s.gcr.io/kops/kube-apiserver-healthcheck@sha256:d772e49a0ae9dea319f26aaa40d58a123860b19da6378d29898eb30208359241 k8s.gcr.io/kops/kube-apiserver-healthcheck:1.21.0],SizeBytes:11771024,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/node-driver-registrar@sha256:9cd9ef74078997d4d05f5061b6a4948b54b591bb5152675f45a183c3a1cbbfd8 public.ecr.aws/eks-distro/kubernetes-csi/node-driver-registrar:v2.6.2-eks-1-25-latest],SizeBytes:6553584,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/livenessprobe@sha256:d790820d19a6253ee31418be4d1a9ae023d4a6b64c5591f8f031b4194828cc5b public.ecr.aws/eks-distro/kubernetes-csi/livenessprobe:v2.8.0-eks-1-25-latest],SizeBytes:6005708,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Feb 6 18:55:16.601: INFO: Logging kubelet events for node ip-172-20-35-183.us-west-2.compute.internal Feb 6 18:55:16.672: INFO: Logging pods the kubelet thinks is on node ip-172-20-35-183.us-west-2.compute.internal Feb 6 18:55:16.767: INFO: kube-apiserver-ip-172-20-35-183.us-west-2.compute.internal started at 2023-02-06 18:47:38 +0000 UTC (0+2 container statuses recorded) Feb 6 18:55:16.767: INFO: Container healthcheck ready: true, restart count 0 Feb 6 18:55:16.767: INFO: Container kube-apiserver ready: true, restart count 0 Feb 6 18:55:16.767: INFO: etcd-manager-events-ip-172-20-35-183.us-west-2.compute.internal started at 2023-02-06 18:47:38 +0000 UTC (0+1 container statuses recorded) Feb 6 18:55:16.767: INFO: Container etcd-manager ready: true, restart count 0 Feb 6 18:55:16.767: INFO: kops-controller-m8w87 started at 2023-02-06 18:48:53 +0000 UTC (0+1 container statuses recorded) Feb 6 18:55:16.767: INFO: Container kops-controller ready: true, restart count 0 Feb 6 18:55:16.767: INFO: efs-csi-node-97npp started at 2023-02-06 18:50:05 +0000 UTC (0+3 container statuses recorded) Feb 6 18:55:16.768: INFO: Container csi-driver-registrar ready: true, restart count 0 Feb 6 18:55:16.768: INFO: Container efs-plugin ready: true, restart count 0 Feb 6 18:55:16.768: INFO: Container liveness-probe ready: true, restart count 0 Feb 6 18:55:16.768: INFO: kube-controller-manager-ip-172-20-35-183.us-west-2.compute.internal started at 2023-02-06 18:47:38 +0000 UTC (0+1 container statuses recorded) Feb 6 18:55:16.768: INFO: Container kube-controller-manager ready: true, restart count 0 Feb 6 18:55:16.768: INFO: kube-proxy-ip-172-20-35-183.us-west-2.compute.internal started at 2023-02-06 18:47:38 +0000 UTC (0+1 container statuses recorded) Feb 6 18:55:16.768: INFO: Container kube-proxy ready: true, restart count 0 Feb 6 18:55:16.768: INFO: kube-scheduler-ip-172-20-35-183.us-west-2.compute.internal started at 2023-02-06 18:47:38 +0000 UTC (0+1 container statuses recorded) Feb 6 18:55:16.768: INFO: Container kube-scheduler ready: true, restart count 0 Feb 6 18:55:16.768: INFO: etcd-manager-main-ip-172-20-35-183.us-west-2.compute.internal started at 2023-02-06 18:47:38 +0000 UTC (0+1 container statuses recorded) Feb 6 18:55:16.768: INFO: Container etcd-manager ready: true, restart count 0 Feb 6 18:55:16.768: INFO: dns-controller-5d59c585d8-6rjvt started at 2023-02-06 18:48:53 +0000 UTC (0+1 container statuses recorded) Feb 6 18:55:16.768: INFO: Container dns-controller ready: true, restart count 0 Feb 6 18:55:17.212: INFO: Latency metrics for node ip-172-20-35-183.us-west-2.compute.internal Feb 6 18:55:17.212: INFO: Logging node info for node ip-172-20-39-190.us-west-2.compute.internal Feb 6 18:55:17.276: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-39-190.us-west-2.compute.internal 639b701f-454f-4006-9106-500e5ee5d0d2 2133 0 2023-02-06 18:49:29 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kops.k8s.io/instancegroup:nodes-us-west-2a kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-39-190.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:c5.large topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[csi.volume.kubernetes.io/nodeid:{"efs.csi.aws.com":"i-06d1c87be3fa9644f"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2023-02-06 18:49:29 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/instancegroup":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-02-06 18:49:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} } {kubelet Update v1 2023-02-06 18:50:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-aws-ebs":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-aws-ebs":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-06d1c87be3fa9644f,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{25 0} {<nil>} 25 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{133003395072 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892305920 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{25 0} {<nil>} 25 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{119703055367 0} {<nil>} 119703055367 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787448320 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-02-06 18:49:33 +0000 UTC,LastTransitionTime:2023-02-06 18:49:33 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-06 18:54:49 +0000 UTC,LastTransitionTime:2023-02-06 18:49:29 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-06 18:54:49 +0000 UTC,LastTransitionTime:2023-02-06 18:49:29 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-06 18:54:49 +0000 UTC,LastTransitionTime:2023-02-06 18:49:29 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-06 18:54:49 +0000 UTC,LastTransitionTime:2023-02-06 18:49:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.39.190,},NodeAddress{Type:ExternalIP,Address:52.40.251.97,},NodeAddress{Type:Hostname,Address:ip-172-20-39-190.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-39-190.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-52-40-251-97.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec28fe7c04520bffe074b028bac9b94b,SystemUUID:ec28fe7c-0452-0bff-e074-b028bac9b94b,BootID:70a79809-a9cf-45b1-90fc-67582ec7bb68,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.20.8,KubeProxyVersion:v1.20.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[607362164682.dkr.ecr.us-west-2.amazonaws.com/aws-efs-csi-driver@sha256:cfb4417dbd36e453d92b427bd06719934fa133d51451b867a25615d18b02421f 607362164682.dkr.ecr.us-west-2.amazonaws.com/aws-efs-csi-driver:26295],SizeBytes:501573953,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:702a992280fb7c3303e84a5801acbb4c9c7fcf48cffe0e9c8be3f0c60f74cf89 k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.4],SizeBytes:112029652,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:0c867c82a0a8ce6d093595f9d2e4b10517d6c9c26323075de9d82d9f7d056bfc k8s.gcr.io/kube-proxy:v1.20.8],SizeBytes:52056682,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:758db666ac7028534dba72e7e9bb1e57bb81b8196f976f7a5cc351ef8b3529e1 k8s.gcr.io/e2e-test-images/agnhost:2.32],SizeBytes:50002177,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler@sha256:67640771ad9fc56f109d5b01e020f0c858e7c890bb0eb15ba0ebd325df3285e7 k8s.gcr.io/cpa/cluster-proportional-autoscaler:1.8.3],SizeBytes:15191740,},ContainerImage{Names:[docker.io/coredns/coredns@sha256:642ff9910da6ea9a8624b0234eef52af9ca75ecbec474c5507cb096bdfbae4e5 docker.io/coredns/coredns:1.8.3],SizeBytes:12893350,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/node-driver-registrar@sha256:9cd9ef74078997d4d05f5061b6a4948b54b591bb5152675f45a183c3a1cbbfd8 public.ecr.aws/eks-distro/kubernetes-csi/node-driver-registrar:v2.6.2-eks-1-25-latest],SizeBytes:6553584,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/livenessprobe@sha256:d790820d19a6253ee31418be4d1a9ae023d4a6b64c5591f8f031b4194828cc5b public.ecr.aws/eks-distro/kubernetes-csi/livenessprobe:v2.8.0-eks-1-25-latest],SizeBytes:6005708,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Feb 6 18:55:17.277: INFO: Logging kubelet events for node ip-172-20-39-190.us-west-2.compute.internal Feb 6 18:55:17.347: INFO: Logging pods the kubelet thinks is on node ip-172-20-39-190.us-west-2.compute.internal Feb 6 18:55:17.418: INFO: kube-proxy-ip-172-20-39-190.us-west-2.compute.internal started at 2023-02-06 18:49:17 +0000 UTC (0+1 container statuses recorded) Feb 6 18:55:17.418: INFO: Container kube-proxy ready: true, restart count 0 Feb 6 18:55:17.418: INFO: coredns-autoscaler-6f594f4c58-lp27t started at 2023-02-06 18:49:40 +0000 UTC (0+1 container statuses recorded) Feb 6 18:55:17.418: INFO: Container autoscaler ready: true, restart count 0 Feb 6 18:55:17.418: INFO: coredns-8f5559c9b-2jrst started at 2023-02-06 18:49:40 +0000 UTC (0+1 container statuses recorded) Feb 6 18:55:17.418: INFO: Container coredns ready: true, restart count 0 Feb 6 18:55:17.418: INFO: efs-csi-node-zjlnx started at 2023-02-06 18:50:05 +0000 UTC (0+3 container statuses recorded) Feb 6 18:55:17.418: INFO: Container csi-driver-registrar ready: true, restart count 0 Feb 6 18:55:17.418: INFO: Container efs-plugin ready: true, restart count 0 Feb 6 18:55:17.418: INFO: Container liveness-probe ready: true, restart count 0 Feb 6 18:55:17.683: INFO: Latency metrics for node ip-172-20-39-190.us-west-2.compute.internal Feb 6 18:55:17.683: INFO: Logging node info for node ip-172-20-90-111.us-west-2.compute.internal Feb 6 18:55:17.758: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-90-111.us-west-2.compute.internal aa609e60-20bd-4f17-86a7-9393b747e3b8 2140 0 2023-02-06 18:49:31 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2b kops.k8s.io/instancegroup:nodes-us-west-2b kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-90-111.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:c5.large topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2b] map[csi.volume.kubernetes.io/nodeid:{"efs.csi.aws.com":"i-072b58f0331d07c6d"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2023-02-06 18:49:31 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/instancegroup":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-02-06 18:49:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} } {kubelet Update v1 2023-02-06 18:50:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-aws-ebs":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-aws-ebs":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2b/i-072b58f0331d07c6d,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{25 0} {<nil>} 25 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{133003395072 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3862945792 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{25 0} {<nil>} 25 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{119703055367 0} {<nil>} 119703055367 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3758088192 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-02-06 18:49:33 +0000 UTC,LastTransitionTime:2023-02-06 18:49:33 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-02-06 18:54:51 +0000 UTC,LastTransitionTime:2023-02-06 18:49:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-02-06 18:54:51 +0000 UTC,LastTransitionTime:2023-02-06 18:49:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-02-06 18:54:51 +0000 UTC,LastTransitionTime:2023-02-06 18:49:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-02-06 18:54:51 +0000 UTC,LastTransitionTime:2023-02-06 18:49:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.90.111,},NodeAddress{Type:ExternalIP,Address:34.217.38.7,},NodeAddress{Type:Hostname,Address:ip-172-20-90-111.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-90-111.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-34-217-38-7.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2f5f3c7e61d5016d297e6cfc8c06a1,SystemUUID:ec2f5f3c-7e61-d501-6d29-7e6cfc8c06a1,BootID:5b26bfd5-224a-456b-b547-604b3ea9faab,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.20.8,KubeProxyVersion:v1.20.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[607362164682.dkr.ecr.us-west-2.amazonaws.com/aws-efs-csi-driver@sha256:cfb4417dbd36e453d92b427bd06719934fa133d51451b867a25615d18b02421f 607362164682.dkr.ecr.us-west-2.amazonaws.com/aws-efs-csi-driver:26295],SizeBytes:501573953,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:702a992280fb7c3303e84a5801acbb4c9c7fcf48cffe0e9c8be3f0c60f74cf89 k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.4],SizeBytes:112029652,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:0c867c82a0a8ce6d093595f9d2e4b10517d6c9c26323075de9d82d9f7d056bfc k8s.gcr.io/kube-proxy:v1.20.8],SizeBytes:52056682,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/external-provisioner@sha256:e677f72d499e09557e20ba9b5ade9fbbc70b73f658b95226963215eaa9fdb1ad public.ecr.aws/eks-distro/kubernetes-csi/external-provisioner:v3.3.0-eks-1-25-latest],SizeBytes:13992120,},ContainerImage{Names:[docker.io/coredns/coredns@sha256:642ff9910da6ea9a8624b0234eef52af9ca75ecbec474c5507cb096bdfbae4e5 docker.io/coredns/coredns:1.8.3],SizeBytes:12893350,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/node-driver-registrar@sha256:9cd9ef74078997d4d05f5061b6a4948b54b591bb5152675f45a183c3a1cbbfd8 public.ecr.aws/eks-distro/kubernetes-csi/node-driver-registrar:v2.6.2-eks-1-25-latest],SizeBytes:6553584,},ContainerImage{Names:[public.ecr.aws/eks-distro/kubernetes-csi/livenessprobe@sha256:d790820d19a6253ee31418be4d1a9ae023d4a6b64c5591f8f031b4194828cc5b public.ecr.aws/eks-distro/kubernetes-csi/livenessprobe:v2.8.0-eks-1-25-latest],SizeBytes:6005708,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Feb 6 18:55:17.769: INFO: Logging kubelet events for node ip-172-20-90-111.us-west-2.compute.internal Feb 6 18:55:17.836: INFO: Logging pods the kubelet thinks is on node ip-172-20-90-111.us-west-2.compute.internal Feb 6 18:55:17.911: INFO: pod-ad877509-620b-43e8-8d83-fd46ee4cc5e3 started at 2023-02-06 18:55:08 +0000 UTC (0+1 container statuses recorded) Feb 6 18:55:17.911: INFO: Container write-pod ready: true, restart count 0 Feb 6 18:55:17.911: INFO: kube-proxy-ip-172-20-90-111.us-west-2.compute.internal started at 2023-02-06 18:49:19 +0000 UTC (0+1 container statuses recorded) Feb 6 18:55:17.911: INFO: Container kube-proxy ready: true, restart count 0 Feb 6 18:55:17.911: INFO: coredns-8f5559c9b-rdtwd started at 2023-02-06 18:49:42 +0000 UTC (0+1 container statuses recorded) Feb 6 18:55:17.911: INFO: Container coredns ready: true, restart count 0 Feb 6 18:55:17.912: INFO: efs-csi-node-zq654 started at 2023-02-06 18:50:05 +0000 UTC (0+3 container statuses recorded) Feb 6 18:55:17.912: INFO: Container csi-driver-registrar ready: true, restart count 0 Feb 6 18:55:17.912: INFO: Container efs-plugin ready: true, restart count 0 Feb 6 18:55:17.912: INFO: Container liveness-probe ready: true, restart count 0 Feb 6 18:55:17.912: INFO: efs-csi-controller-c584f665c-ktmqc started at 2023-02-06 18:50:05 +0000 UTC (0+3 container statuses recorded) Feb 6 18:55:17.912: INFO: Container csi-provisioner ready: true, restart count 0 Feb 6 18:55:17.912: INFO: Container efs-plugin ready: true, restart count 0 Feb 6 18:55:17.912: INFO: Container liveness-probe ready: true, restart count 0 Feb 6 18:55:18.205: INFO: Latency metrics for node ip-172-20-90-111.us-west-2.compute.internal Feb 6 18:55:18.205: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "efs-6831" for this suite.
Find succeeded mentions in log files | View test history on testgrid
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (block volmode)] volumeMode should fail in binding dynamic provisioned PV to PVC [Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] subPath should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] subPath should fail if subpath directory is outside the volume [Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] subPath should fail if subpath file is outside the volume [Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] subPath should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] subPath should support creating multiple subpath from same volumes [Slow]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] subPath should support existing directories when readOnly specified in the volumeSource
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] subPath should support existing directory
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] subPath should support existing single file [LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] subPath should support file as subpath [LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] subPath should support non-existent path
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] subPath should support readOnly directory specified in the volumeMount
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] subPath should support readOnly file specified in the volumeMount [LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] subPath should support restarting containers using directory as subpath [Slow]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] subPath should support restarting containers using file as subpath [Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] subPath should verify container cannot write to subpath readonly volumes [Slow]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] volumeIO should write files of various sizes, verify size, validate content [Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] volumes should allow exec of files on the volume
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] volumes should store data
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single volume from pods on different node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single volume from pods on the same node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (filesystem volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (block volmode)] volumeMode should fail to create pod by failing to mount volume [Slow]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (default fs)] volumes should allow exec of files on the volume
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (default fs)] volumes should store data
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] should mount different paths on same volume on same node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] should mount with option tls when encryptInTransit set true
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] should mount with option tls when encryptInTransit unset
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] should mount without option tls when encryptInTransit set false
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should concurrently access the single volume from pods on different node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should concurrently access the single volume from pods on the same node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with mount options
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with pvc data source
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with pvc data source in parallel [Slow]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (block volmode)] volumeMode should fail to use a volume in a pod with mismatched mode [Slow]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (block volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (block volmode)] volumes should store data
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with mount options
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with pvc data source
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with pvc data source in parallel [Slow]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] subPath should unmount if pod is force deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] subPath should unmount if pod is gracefully deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ext3)] volumes should allow exec of files on the volume
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ext3)] volumes should store data
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should concurrently access the single volume from pods on different node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should concurrently access the single volume from pods on the same node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ext4)] volumes should allow exec of files on the volume
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ext4)] volumes should store data
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (filesystem volmode)] volumeMode should fail to use a volume in a pod with mismatched mode [Slow]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning should provision storage with mount options
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning should provision storage with pvc data source
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning should provision storage with pvc data source in parallel [Slow]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should fail if subpath directory is outside the volume [Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should fail if subpath file is outside the volume [Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support creating multiple subpath from same volumes [Slow]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support existing directories when readOnly specified in the volumeSource
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support existing directory
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support existing single file [LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support file as subpath [LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support non-existent path
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support readOnly directory specified in the volumeMount
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support readOnly file specified in the volumeMount [LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support restarting containers using directory as subpath [Slow]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support restarting containers using file as subpath [Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should unmount if pod is force deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should unmount if pod is gracefully deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should verify container cannot write to subpath readonly volumes [Slow]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] volumes should allow exec of files on the volume
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] volumes should store data
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should concurrently access the single volume from pods on different node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should concurrently access the single volume from pods on the same node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (xfs)][Slow] volumes should allow exec of files on the volume
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Dynamic PV (xfs)][Slow] volumes should store data
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (default fs)] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (default fs)] subPath should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (default fs)] subPath should fail if subpath directory is outside the volume [Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (default fs)] subPath should fail if subpath file is outside the volume [Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (default fs)] subPath should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (default fs)] subPath should support creating multiple subpath from same volumes [Slow]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (default fs)] subPath should support existing directories when readOnly specified in the volumeSource
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (default fs)] subPath should support existing directory
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (default fs)] subPath should support existing single file [LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (default fs)] subPath should support file as subpath [LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (default fs)] subPath should support non-existent path
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (default fs)] subPath should support readOnly directory specified in the volumeMount
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (default fs)] subPath should support readOnly file specified in the volumeMount [LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (default fs)] subPath should support restarting containers using directory as subpath [Slow]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (default fs)] subPath should support restarting containers using file as subpath [Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (default fs)] subPath should unmount if pod is force deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (default fs)] subPath should unmount if pod is gracefully deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (default fs)] subPath should verify container cannot write to subpath readonly volumes [Slow]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (default fs)] volumeIO should write files of various sizes, verify size, validate content [Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (default fs)] volumes should allow exec of files on the volume
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (default fs)] volumes should store data
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (ext3)] volumes should allow exec of files on the volume
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (ext3)] volumes should store data
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (ext4)] volumes should allow exec of files on the volume
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (ext4)] volumes should store data
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (ntfs)][Feature:Windows] volumes should allow exec of files on the volume
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (ntfs)][Feature:Windows] volumes should store data
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (xfs)][Slow] volumes should allow exec of files on the volume
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Inline-volume (xfs)][Slow] volumes should store data
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should concurrently access the single volume from pods on different node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should concurrently access the single volume from pods on the same node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (block volmode)] volumeMode should fail to use a volume in a pod with mismatched mode [Slow]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (block volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (block volmode)] volumes should store data
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (default fs)] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (default fs)] subPath should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (default fs)] subPath should fail if subpath directory is outside the volume [Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (default fs)] subPath should fail if subpath file is outside the volume [Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (default fs)] subPath should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (default fs)] subPath should support creating multiple subpath from same volumes [Slow]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (default fs)] subPath should support existing directories when readOnly specified in the volumeSource
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (default fs)] subPath should support existing directory
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (default fs)] subPath should support existing single file [LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (default fs)] subPath should support file as subpath [LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (default fs)] subPath should support non-existent path
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (default fs)] subPath should support readOnly directory specified in the volumeMount
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (default fs)] subPath should support readOnly file specified in the volumeMount [LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (default fs)] subPath should support restarting containers using directory as subpath [Slow]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (default fs)] subPath should support restarting containers using file as subpath [Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (default fs)] subPath should unmount if pod is force deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (default fs)] subPath should unmount if pod is gracefully deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (default fs)] subPath should verify container cannot write to subpath readonly volumes [Slow]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (default fs)] volumeIO should write files of various sizes, verify size, validate content [Slow][LinuxOnly]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (ext3)] volumes should allow exec of files on the volume
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (ext3)] volumes should store data
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (ext4)] volumes should allow exec of files on the volume
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (ext4)] volumes should store data
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single volume from pods on different node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single volume from pods on the same node
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode should fail to use a volume in a pod with mismatched mode [Slow]
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (ntfs)][Feature:Windows] volumes should allow exec of files on the volume
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (ntfs)][Feature:Windows] volumes should store data
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (xfs)][Slow] volumes should allow exec of files on the volume
EFS CSI Suite [efs-csi] EFS CSI [Driver: efs.csi.aws.com] [Testpattern: Pre-provisioned PV (xfs)][Slow] volumes should store data