ci-gce-pd-csi-driver-latest-k8s-master-windows-2019 #1540532050916806656
Recent runs || View in Spyglass
Recent runs || View in Spyglass
... skipping 154 lines ... W0625 03:09:37.051] I0625 03:09:37.050934 6562 utils.go:18] cmd args=[make -C /go/src/sigs.k8s.io/gcp-compute-persistent-disk-csi-driver build-and-push-multi-arch GCE_PD_CSI_STAGING_VERSION=a0578d58-2680-44c3-9542-419d96384711 GCE_PD_CSI_STAGING_IMAGE=gcr.io/gce-cvm-upg-1-3-1-4-ctl-skew/gcp-persistent-disk-csi-driver] W0625 03:09:37.052] Makefile:48: gcp-pd-driver-windows only supports amd64. I0625 03:09:37.153] make: Entering directory '/go/src/sigs.k8s.io/gcp-compute-persistent-disk-csi-driver' I0625 03:09:37.153] # Ensure we use a builder that can leverage it (the default on linux will not) I0625 03:09:37.153] DOCKER_CLI_EXPERIMENTAL=enabled docker buildx rm multiarch-multiplatform-builder I0625 03:09:37.169] DOCKER_CLI_EXPERIMENTAL=enabled docker buildx create --use --name=multiarch-multiplatform-builder W0625 03:09:37.270] error: no builder "multiarch-multiplatform-builder" found W0625 03:09:37.270] make: [Makefile:134: init-buildx] Error 1 (ignored) W0625 03:09:37.341] Unable to find image 'multiarch/qemu-user-static:latest' locally I0625 03:09:37.442] multiarch-multiplatform-builder I0625 03:09:37.442] DOCKER_CLI_EXPERIMENTAL=enabled docker run --rm --privileged multiarch/qemu-user-static --reset --credential yes --persistent yes W0625 03:09:37.542] latest: Pulling from multiarch/qemu-user-static W0625 03:09:37.543] 19d511225f94: Pulling fs layer W0625 03:09:37.543] 6a33d6a40b9b: Pulling fs layer ... skipping 234 lines ... W0625 03:10:00.113] #11 7.128 Setting up libtinfo6:amd64 (6.1+20181013-2+deb10u2) ... W0625 03:10:00.113] #11 7.182 Selecting previously unselected package bash. W0625 03:10:00.114] #11 7.182 (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 3900 files and directories currently installed.) W0625 03:10:00.114] #11 7.192 Preparing to unpack .../archives/bash_5.0-4_amd64.deb ... W0625 03:10:00.115] #11 7.204 Unpacking bash (5.0-4) ... W0625 03:10:00.414] #11 7.486 Setting up bash (5.0-4) ... W0625 03:10:00.414] #11 7.514 update-alternatives: error: alternative path /usr/share/man/man7/bash-builtins.7.gz doesn't exist W0625 03:10:00.534] #11 7.588 Selecting previously unselected package libuuid1:amd64. W0625 03:10:00.535] #11 7.588 (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 3972 files and directories currently installed.) W0625 03:10:00.535] #11 7.597 Preparing to unpack .../libuuid1_2.33.1-0.1_amd64.deb ... W0625 03:10:00.535] #11 7.601 Unpacking libuuid1:amd64 (2.33.1-0.1) ... W0625 03:10:00.535] #11 7.644 Setting up libuuid1:amd64 (2.33.1-0.1) ... W0625 03:10:00.535] #11 7.694 Selecting previously unselected package libblkid1:amd64. ... skipping 495 lines ... W0625 03:11:36.805] #13 48.98 Setting up libtinfo6:arm64 (6.1+20181013-2+deb10u2) ... W0625 03:11:36.945] #13 49.26 Selecting previously unselected package bash. W0625 03:11:37.076] #13 49.26 (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 3897 files and directories currently installed.) W0625 03:11:37.076] #13 49.28 Preparing to unpack .../archives/bash_5.0-4_arm64.deb ... W0625 03:11:37.076] #13 49.39 Unpacking bash (5.0-4) ... W0625 03:11:38.429] #13 50.63 Setting up bash (5.0-4) ... W0625 03:11:38.580] #13 50.80 update-alternatives: error: alternative path /usr/share/man/man7/bash-builtins.7.gz doesn't exist W0625 03:11:39.749] #13 52.06 Selecting previously unselected package libuuid1:arm64. W0625 03:11:39.899] #13 52.06 (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 3969 files and directories currently installed.) W0625 03:11:39.899] #13 52.08 Preparing to unpack .../libuuid1_2.33.1-0.1_arm64.deb ... W0625 03:11:39.900] #13 52.10 Unpacking libuuid1:arm64 (2.33.1-0.1) ... W0625 03:11:40.201] #13 52.37 Setting up libuuid1:arm64 (2.33.1-0.1) ... W0625 03:11:40.337] #13 52.65 Selecting previously unselected package libblkid1:arm64. ... skipping 878 lines ... W0625 04:03:17.027] Trying to find master named 'e2e-test-prow-master' W0625 04:03:17.027] Looking for address 'e2e-test-prow-master-ip' W0625 04:03:18.170] Using master: e2e-test-prow-master (external IP: 34.136.177.176; internal IP: (not set)) I0625 04:03:18.271] Waiting up to 300 seconds for cluster initialization. I0625 04:03:18.271] I0625 04:03:18.271] This will continually check to see if the API for kubernetes is reachable. I0625 04:03:18.272] This may time out if there was some uncaught error during start up. I0625 04:03:18.272] I0625 04:04:20.864] ...................Kubernetes cluster created. I0625 04:04:21.171] Cluster "gce-cvm-upg-1-3-1-4-ctl-skew_e2e-test-prow" set. I0625 04:04:21.540] User "gce-cvm-upg-1-3-1-4-ctl-skew_e2e-test-prow" set. I0625 04:04:21.924] Context "gce-cvm-upg-1-3-1-4-ctl-skew_e2e-test-prow" created. I0625 04:04:22.267] Switched to context "gce-cvm-upg-1-3-1-4-ctl-skew_e2e-test-prow". ... skipping 47 lines ... I0625 04:11:24.650] e2e-test-prow-minion-group-82f5 Ready <none> 6m30s v1.25.0-alpha.1.135+11686e138694a6 I0625 04:11:24.650] e2e-test-prow-windows-node-group-qhph Ready <none> 41s v1.25.0-alpha.1.135+11686e138694a6 I0625 04:11:24.650] e2e-test-prow-windows-node-group-rn0p Ready <none> 23s v1.25.0-alpha.1.135+11686e138694a6 I0625 04:11:24.650] e2e-test-prow-windows-node-group-w48h Ready <none> 33s v1.25.0-alpha.1.135+11686e138694a6 W0625 04:11:24.815] Warning: v1 ComponentStatus is deprecated in v1.19+ I0625 04:11:24.916] Validate output: I0625 04:11:24.984] NAME STATUS MESSAGE ERROR I0625 04:11:24.985] etcd-0 Healthy {"health":"true","reason":""} I0625 04:11:24.985] etcd-1 Healthy {"health":"true","reason":""} I0625 04:11:24.985] scheduler Healthy ok I0625 04:11:24.985] controller-manager Healthy ok I0625 04:11:24.988] [0;32mCluster validation succeeded[0m W0625 04:11:25.089] Warning: v1 ComponentStatus is deprecated in v1.19+ ... skipping 98 lines ... I0625 04:13:23.270] GCE_PD_SA_DIR is /tmp/gcp-pd-driver-tmp196782566 I0625 04:13:23.270] PKGDIR is /go/src/sigs.k8s.io/gcp-compute-persistent-disk-csi-driver I0625 04:13:23.270] installing kustomize I0625 04:13:23.978] {Version:kustomize/v3.9.4 GitCommit:e41d94ddef8cca7af2709c4104b41c4d43cd236c BuildDate:2021-02-09T19:22:10Z GoOs:linux GoArch:amd64} W0625 04:13:24.079] + [[ true != true ]] W0625 04:13:24.079] + /tmp/gcp-pd-driver-tmp1125011335/kubernetes/cluster/kubectl.sh get namespace gce-pd-csi-driver -v=2 W0625 04:13:24.196] Error from server (NotFound): namespaces "gce-pd-csi-driver" not found W0625 04:13:24.200] + /tmp/gcp-pd-driver-tmp1125011335/kubernetes/cluster/kubectl.sh create namespace gce-pd-csi-driver -v=2 I0625 04:13:24.359] namespace/gce-pd-csi-driver created W0625 04:13:24.459] + [[ ! stable-master == *noauth* ]] W0625 04:13:24.460] + /tmp/gcp-pd-driver-tmp1125011335/kubernetes/cluster/kubectl.sh get secret cloud-sa -v=2 -n gce-pd-csi-driver W0625 04:13:24.519] Error from server (NotFound): secrets "cloud-sa" not found W0625 04:13:24.522] + /tmp/gcp-pd-driver-tmp1125011335/kubernetes/cluster/kubectl.sh create secret generic cloud-sa -v=2 --from-file=/tmp/gcp-pd-driver-tmp196782566/cloud-sa.json -n gce-pd-csi-driver I0625 04:13:24.689] secret/cloud-sa created W0625 04:13:24.790] + /tmp/gcp-pd-driver-tmp1125011335/kubernetes/cluster/kubectl.sh get clusterrolebinding -v=2 cluster-admin-binding W0625 04:13:24.843] Error from server (NotFound): clusterrolebindings.rbac.authorization.k8s.io "cluster-admin-binding" not found W0625 04:13:24.847] ++ gcloud config get-value account W0625 04:13:25.553] + /tmp/gcp-pd-driver-tmp1125011335/kubernetes/cluster/kubectl.sh create clusterrolebinding cluster-admin-binding -v=2 --clusterrole cluster-admin --user pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com I0625 04:13:25.700] clusterrolebinding.rbac.authorization.k8s.io/cluster-admin-binding created W0625 04:13:25.800] + /tmp/gcp-pd-driver-tmp1125011335/kubernetes/cluster/kubectl.sh version W0625 04:13:25.854] WARNING: This version information is deprecated and will be replaced with the output from kubectl version --short. Use --output=yaml|json to get the full version. W0625 04:13:25.857] + readonly tmp_spec=/tmp/gcp-compute-persistent-disk-csi-driver-specs-generated.yaml ... skipping 521 lines ... I0625 04:13:27.121] - args: I0625 04:13:27.121] - --v=5 I0625 04:13:27.121] - --csi-address=/csi/csi.sock I0625 04:13:27.122] - --http-endpoint=:22013 I0625 04:13:27.122] - --leader-election I0625 04:13:27.122] - --leader-election-namespace=$(PDCSI_NAMESPACE) I0625 04:13:27.122] - --handle-volume-inuse-error=false I0625 04:13:27.122] env: I0625 04:13:27.122] - name: PDCSI_NAMESPACE I0625 04:13:27.123] valueFrom: I0625 04:13:27.123] fieldRef: I0625 04:13:27.123] fieldPath: metadata.namespace I0625 04:13:27.123] image: k8s.gcr.io/sig-storage/csi-resizer:v1.4.0 ... skipping 384 lines ... W0625 04:26:37.462] Args: W0625 04:26:37.462] --v=5 W0625 04:26:37.462] --csi-address=/csi/csi.sock W0625 04:26:37.462] --http-endpoint=:22013 W0625 04:26:37.462] --leader-election W0625 04:26:37.462] --leader-election-namespace=$(PDCSI_NAMESPACE) W0625 04:26:37.463] --handle-volume-inuse-error=false W0625 04:26:37.463] State: Running W0625 04:26:37.463] Started: Sat, 25 Jun 2022 04:13:41 +0000 W0625 04:26:37.463] Ready: True W0625 04:26:37.463] Restart Count: 0 W0625 04:26:37.463] Liveness: http-get http://:http-endpoint/healthz/leader-election delay=10s timeout=10s period=20s #success=1 #failure=1 W0625 04:26:37.464] Environment: ... skipping 481 lines ... W0625 04:26:37.545] Normal Created 12m kubelet Created container csi-driver-registrar W0625 04:26:37.545] Normal Started 12m kubelet Started container csi-driver-registrar W0625 04:26:37.546] Normal Pulling 12m kubelet Pulling image "gcr.io/gce-cvm-upg-1-3-1-4-ctl-skew/gcp-persistent-disk-csi-driver:a0578d58-2680-44c3-9542-419d96384711" W0625 04:26:37.546] Normal Pulled 63s kubelet Successfully pulled image "gcr.io/gce-cvm-upg-1-3-1-4-ctl-skew/gcp-persistent-disk-csi-driver:a0578d58-2680-44c3-9542-419d96384711" in 11m33.9782042s W0625 04:26:37.546] Normal Created 62s kubelet Created container gce-pd-driver W0625 04:26:37.546] Normal Started 34s kubelet Started container gce-pd-driver W0625 04:26:37.546] Warning Unhealthy 27s kubelet Liveness probe failed: command "/csi-node-driver-registrar.exe --kubelet-registration-path=C:\\\\var\\\\lib\\\\kubelet\\\\plugins\\\\pd.csi.storage.gke.io\\\\csi.sock --mode=kubelet-registration-probe" timed out W0625 04:26:37.546] W0625 04:26:37.546] W0625 04:26:37.547] Name: csi-gce-pd-node-win-bjn6z W0625 04:26:37.547] Namespace: gce-pd-csi-driver W0625 04:26:37.547] Priority: 900001000 W0625 04:26:37.547] Priority Class Name: csi-gce-pd-node ... skipping 122 lines ... W0625 04:26:37.593] Normal Created 12m kubelet Created container csi-driver-registrar W0625 04:26:37.593] Normal Started 12m kubelet Started container csi-driver-registrar W0625 04:26:37.594] Normal Pulling 12m kubelet Pulling image "gcr.io/gce-cvm-upg-1-3-1-4-ctl-skew/gcp-persistent-disk-csi-driver:a0578d58-2680-44c3-9542-419d96384711" W0625 04:26:37.594] Normal Pulled 51s kubelet Successfully pulled image "gcr.io/gce-cvm-upg-1-3-1-4-ctl-skew/gcp-persistent-disk-csi-driver:a0578d58-2680-44c3-9542-419d96384711" in 11m44.5009659s W0625 04:26:37.594] Normal Created 51s kubelet Created container gce-pd-driver W0625 04:26:37.594] Normal Started 23s kubelet Started container gce-pd-driver W0625 04:26:37.595] Warning Unhealthy 17s kubelet Liveness probe failed: command "/csi-node-driver-registrar.exe --kubelet-registration-path=C:\\\\var\\\\lib\\\\kubelet\\\\plugins\\\\pd.csi.storage.gke.io\\\\csi.sock --mode=kubelet-registration-probe" timed out W0625 04:26:37.595] W0625 04:26:37.595] W0625 04:26:37.595] Name: csi-gce-pd-node-win-lztgg W0625 04:26:37.595] Namespace: gce-pd-csi-driver W0625 04:26:37.595] Priority: 900001000 W0625 04:26:37.595] Priority Class Name: csi-gce-pd-node ... skipping 527 lines ... I0625 04:26:43.884] I0625 04:26:43.884] [36m[1mS [SKIPPING] in Spec Setup (BeforeEach) [0.001 seconds][0m I0625 04:26:43.884] External Storage [Driver: csi-gcepd-sc-windows--no-volumesnapshotclass] I0625 04:26:43.884] [90mtest/e2e/storage/external/external.go:174[0m I0625 04:26:43.884] [Testpattern: Pre-provisioned PV (block volmode)] volumeMode I0625 04:26:43.884] [90mtest/e2e/storage/framework/testsuite.go:50[0m I0625 04:26:43.885] [36m[1mshould fail to create pod by failing to mount volume [Slow] [BeforeEach][0m I0625 04:26:43.885] [90mtest/e2e/storage/testsuites/volumemode.go:199[0m I0625 04:26:43.885] I0625 04:26:43.885] [36mDriver "csi-gcepd-sc-windows--no-volumesnapshotclass" does not support volume type "PreprovisionedPV" - skipping[0m I0625 04:26:43.885] I0625 04:26:43.886] test/e2e/storage/external/external.go:269 I0625 04:26:43.886] [90m------------------------------[0m ... skipping 130 lines ... I0625 04:29:23.089] Jun 25 04:26:43.822: INFO: Using claimSize:5Gi, test suite supported size:{ 1Mi}, driver(csi-gcepd-sc-windows--no-volumesnapshotclass) supported size:{ 1Mi} I0625 04:29:23.089] [1mSTEP[0m: creating a StorageClass provisioning-9106-e2e-sc4gwx8 I0625 04:29:23.089] [1mSTEP[0m: creating a claim I0625 04:29:23.090] Jun 25 04:26:43.826: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil I0625 04:29:23.090] [1mSTEP[0m: Creating pod pod-subpath-test-dynamicpv-2mn8 I0625 04:29:23.090] [1mSTEP[0m: Creating a pod to test subpath I0625 04:29:23.090] Jun 25 04:26:43.840: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-2mn8" in namespace "provisioning-9106" to be "Succeeded or Failed" I0625 04:29:23.102] Jun 25 04:26:43.846: INFO: Pod "pod-subpath-test-dynamicpv-2mn8": Phase="Pending", Reason="", readiness=false. Elapsed: 5.407606ms I0625 04:29:23.103] Jun 25 04:26:45.850: INFO: Pod "pod-subpath-test-dynamicpv-2mn8": Phase="Pending", Reason="", readiness=false. Elapsed: 2.009478484s I0625 04:29:23.103] Jun 25 04:26:47.851: INFO: Pod "pod-subpath-test-dynamicpv-2mn8": Phase="Pending", Reason="", readiness=false. Elapsed: 4.010473218s I0625 04:29:23.104] Jun 25 04:26:49.852: INFO: Pod "pod-subpath-test-dynamicpv-2mn8": Phase="Pending", Reason="", readiness=false. Elapsed: 6.011647088s I0625 04:29:23.104] Jun 25 04:26:51.851: INFO: Pod "pod-subpath-test-dynamicpv-2mn8": Phase="Pending", Reason="", readiness=false. Elapsed: 8.010531747s I0625 04:29:23.104] Jun 25 04:26:53.849: INFO: Pod "pod-subpath-test-dynamicpv-2mn8": Phase="Pending", Reason="", readiness=false. Elapsed: 10.009289474s ... skipping 52 lines ... I0625 04:29:23.146] Jun 25 04:28:39.852: INFO: Pod "pod-subpath-test-dynamicpv-2mn8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.011982566s I0625 04:29:23.154] Jun 25 04:28:41.851: INFO: Pod "pod-subpath-test-dynamicpv-2mn8": Phase="Running", Reason="", readiness=false. Elapsed: 1m58.010637444s I0625 04:29:23.155] Jun 25 04:28:43.859: INFO: Pod "pod-subpath-test-dynamicpv-2mn8": Phase="Running", Reason="", readiness=false. Elapsed: 2m0.018930911s I0625 04:29:23.155] Jun 25 04:28:45.851: INFO: Pod "pod-subpath-test-dynamicpv-2mn8": Phase="Running", Reason="", readiness=false. Elapsed: 2m2.010400153s I0625 04:29:23.155] Jun 25 04:28:47.851: INFO: Pod "pod-subpath-test-dynamicpv-2mn8": Phase="Succeeded", Reason="", readiness=false. Elapsed: 2m4.011272109s I0625 04:29:23.155] [1mSTEP[0m: Saw pod success I0625 04:29:23.156] Jun 25 04:28:47.851: INFO: Pod "pod-subpath-test-dynamicpv-2mn8" satisfied condition "Succeeded or Failed" I0625 04:29:23.156] Jun 25 04:28:47.855: INFO: Trying to get logs from node e2e-test-prow-windows-node-group-w48h pod pod-subpath-test-dynamicpv-2mn8 container test-container-volume-dynamicpv-2mn8: <nil> I0625 04:29:23.156] [1mSTEP[0m: delete the pod I0625 04:29:23.156] Jun 25 04:28:47.964: INFO: Waiting for pod pod-subpath-test-dynamicpv-2mn8 to disappear I0625 04:29:23.156] Jun 25 04:28:47.969: INFO: Pod pod-subpath-test-dynamicpv-2mn8 no longer exists I0625 04:29:23.157] [1mSTEP[0m: Deleting pod pod-subpath-test-dynamicpv-2mn8 I0625 04:29:23.157] Jun 25 04:28:47.969: INFO: Deleting pod "pod-subpath-test-dynamicpv-2mn8" in namespace "provisioning-9106" ... skipping 22 lines ... I0625 04:29:23.169] [90mtest/e2e/storage/external/external.go:174[0m I0625 04:29:23.170] [Testpattern: Dynamic PV (default fs)] subPath I0625 04:29:23.170] [90mtest/e2e/storage/framework/testsuite.go:50[0m I0625 04:29:23.170] should support existing directory I0625 04:29:23.170] [90mtest/e2e/storage/testsuites/subpath.go:207[0m I0625 04:29:23.170] [90m------------------------------[0m I0625 04:29:23.179] {"msg":"PASSED External Storage [Driver: csi-gcepd-sc-windows--no-volumesnapshotclass] [Testpattern: Dynamic PV (default fs)] subPath should support existing directory","total":-1,"completed":1,"skipped":242,"failed":0} I0625 04:29:23.179] I0625 04:29:23.458] [36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m I0625 04:29:23.459] [90m------------------------------[0m I0625 04:29:23.461] [BeforeEach] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] I0625 04:29:23.461] test/e2e/storage/framework/testsuite.go:51 I0625 04:29:23.461] Jun 25 04:29:23.456: INFO: Driver csi-gcepd-sc-windows--no-volumesnapshotclass doesn't support ext4 -- skipping ... skipping 176 lines ... I0625 04:30:04.221] [90mtest/e2e/storage/external/external.go:174[0m I0625 04:30:04.221] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] I0625 04:30:04.221] [90mtest/e2e/storage/framework/testsuite.go:50[0m I0625 04:30:04.221] should concurrently access the single read-only volume from pods on the same node I0625 04:30:04.221] [90mtest/e2e/storage/testsuites/multivolume.go:423[0m I0625 04:30:04.222] [90m------------------------------[0m I0625 04:30:04.222] {"msg":"PASSED External Storage [Driver: csi-gcepd-sc-windows--no-volumesnapshotclass] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node","total":-1,"completed":1,"skipped":5,"failed":0} I0625 04:30:04.222] I0625 04:31:44.234] [36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m I0625 04:31:44.235] [90m------------------------------[0m I0625 04:31:44.235] [BeforeEach] [Testpattern: Dynamic PV (default fs)] volumeIO I0625 04:31:44.235] test/e2e/storage/framework/testsuite.go:51 I0625 04:31:44.235] [BeforeEach] [Testpattern: Dynamic PV (default fs)] volumeIO ... skipping 148 lines ... I0625 04:31:44.265] [90mtest/e2e/storage/external/external.go:174[0m I0625 04:31:44.265] [Testpattern: Dynamic PV (default fs)] volumeIO I0625 04:31:44.266] [90mtest/e2e/storage/framework/testsuite.go:50[0m I0625 04:31:44.266] should write files of various sizes, verify size, validate content [Slow] I0625 04:31:44.266] [90mtest/e2e/storage/testsuites/volume_io.go:149[0m I0625 04:31:44.266] [90m------------------------------[0m I0625 04:31:44.266] {"msg":"PASSED External Storage [Driver: csi-gcepd-sc-windows--no-volumesnapshotclass] [Testpattern: Dynamic PV (default fs)] volumeIO should write files of various sizes, verify size, validate content [Slow]","total":-1,"completed":1,"skipped":532,"failed":0} I0625 04:31:44.267] I0625 04:31:46.321] [36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m I0625 04:31:46.321] [90m------------------------------[0m I0625 04:31:46.322] [BeforeEach] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral I0625 04:31:46.322] test/e2e/storage/framework/testsuite.go:51 I0625 04:31:46.322] [BeforeEach] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral ... skipping 372 lines ... I0625 04:32:35.627] [90mtest/e2e/storage/external/external.go:174[0m I0625 04:32:35.627] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] I0625 04:32:35.627] [90mtest/e2e/storage/framework/testsuite.go:50[0m I0625 04:32:35.628] should access to two volumes with the same volume mode and retain data across pod recreation on the same node I0625 04:32:35.628] [90mtest/e2e/storage/testsuites/multivolume.go:138[0m I0625 04:32:35.628] [90m------------------------------[0m I0625 04:32:35.628] {"msg":"PASSED External Storage [Driver: csi-gcepd-sc-windows--no-volumesnapshotclass] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node","total":-1,"completed":1,"skipped":206,"failed":0} I0625 04:32:35.628] I0625 04:32:35.628] [36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m I0625 04:32:35.629] [90m------------------------------[0m I0625 04:32:35.629] [BeforeEach] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] I0625 04:32:35.629] test/e2e/storage/framework/testsuite.go:51 I0625 04:32:35.629] Jun 25 04:32:35.589: INFO: Driver csi-gcepd-sc-windows--no-volumesnapshotclass doesn't support Block -- skipping ... skipping 156 lines ... I0625 04:33:21.668] [90mtest/e2e/storage/external/external.go:174[0m I0625 04:33:21.668] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral I0625 04:33:21.668] [90mtest/e2e/storage/framework/testsuite.go:50[0m I0625 04:33:21.668] should support two pods which have the same volume definition I0625 04:33:21.669] [90mtest/e2e/storage/testsuites/ephemeral.go:277[0m I0625 04:33:21.669] [90m------------------------------[0m I0625 04:33:21.669] {"msg":"PASSED External Storage [Driver: csi-gcepd-sc-windows--no-volumesnapshotclass] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should support two pods which have the same volume definition","total":-1,"completed":2,"skipped":378,"failed":0} I0625 04:33:21.669] I0625 04:33:53.675] [36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m I0625 04:33:53.676] [90m------------------------------[0m I0625 04:33:53.676] [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath I0625 04:33:53.676] test/e2e/storage/framework/testsuite.go:51 I0625 04:33:53.676] [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath ... skipping 9 lines ... I0625 04:33:53.678] Jun 25 04:31:46.420: INFO: Using claimSize:5Gi, test suite supported size:{ 1Mi}, driver(csi-gcepd-sc-windows--no-volumesnapshotclass) supported size:{ 1Mi} I0625 04:33:53.678] [1mSTEP[0m: creating a StorageClass provisioning-8136-e2e-scn9hgs I0625 04:33:53.678] [1mSTEP[0m: creating a claim I0625 04:33:53.678] Jun 25 04:31:46.424: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil I0625 04:33:53.678] [1mSTEP[0m: Creating pod pod-subpath-test-dynamicpv-9tzg I0625 04:33:53.679] [1mSTEP[0m: Creating a pod to test multi_subpath I0625 04:33:53.679] Jun 25 04:31:46.442: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-9tzg" in namespace "provisioning-8136" to be "Succeeded or Failed" I0625 04:33:53.679] Jun 25 04:31:46.446: INFO: Pod "pod-subpath-test-dynamicpv-9tzg": Phase="Pending", Reason="", readiness=false. Elapsed: 3.795031ms I0625 04:33:53.679] Jun 25 04:31:48.451: INFO: Pod "pod-subpath-test-dynamicpv-9tzg": Phase="Pending", Reason="", readiness=false. Elapsed: 2.008918324s I0625 04:33:53.680] Jun 25 04:31:50.451: INFO: Pod "pod-subpath-test-dynamicpv-9tzg": Phase="Pending", Reason="", readiness=false. Elapsed: 4.009638551s I0625 04:33:53.680] Jun 25 04:31:52.451: INFO: Pod "pod-subpath-test-dynamicpv-9tzg": Phase="Pending", Reason="", readiness=false. Elapsed: 6.008956953s I0625 04:33:53.680] Jun 25 04:31:54.450: INFO: Pod "pod-subpath-test-dynamicpv-9tzg": Phase="Pending", Reason="", readiness=false. Elapsed: 8.008187925s I0625 04:33:53.680] Jun 25 04:31:56.450: INFO: Pod "pod-subpath-test-dynamicpv-9tzg": Phase="Pending", Reason="", readiness=false. Elapsed: 10.007982917s ... skipping 36 lines ... I0625 04:33:53.688] Jun 25 04:33:10.450: INFO: Pod "pod-subpath-test-dynamicpv-9tzg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.008377358s I0625 04:33:53.689] Jun 25 04:33:12.452: INFO: Pod "pod-subpath-test-dynamicpv-9tzg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.009706034s I0625 04:33:53.689] Jun 25 04:33:14.450: INFO: Pod "pod-subpath-test-dynamicpv-9tzg": Phase="Running", Reason="", readiness=true. Elapsed: 1m28.00821212s I0625 04:33:53.689] Jun 25 04:33:16.450: INFO: Pod "pod-subpath-test-dynamicpv-9tzg": Phase="Running", Reason="", readiness=false. Elapsed: 1m30.008418749s I0625 04:33:53.689] Jun 25 04:33:18.452: INFO: Pod "pod-subpath-test-dynamicpv-9tzg": Phase="Succeeded", Reason="", readiness=false. Elapsed: 1m32.010010143s I0625 04:33:53.689] [1mSTEP[0m: Saw pod success I0625 04:33:53.689] Jun 25 04:33:18.452: INFO: Pod "pod-subpath-test-dynamicpv-9tzg" satisfied condition "Succeeded or Failed" I0625 04:33:53.689] Jun 25 04:33:18.455: INFO: Trying to get logs from node e2e-test-prow-windows-node-group-w48h pod pod-subpath-test-dynamicpv-9tzg container test-container-subpath-dynamicpv-9tzg: <nil> I0625 04:33:53.689] [1mSTEP[0m: delete the pod I0625 04:33:53.690] Jun 25 04:33:18.596: INFO: Waiting for pod pod-subpath-test-dynamicpv-9tzg to disappear I0625 04:33:53.690] Jun 25 04:33:18.600: INFO: Pod pod-subpath-test-dynamicpv-9tzg no longer exists I0625 04:33:53.690] [1mSTEP[0m: Deleting pod I0625 04:33:53.690] Jun 25 04:33:18.600: INFO: Deleting pod "pod-subpath-test-dynamicpv-9tzg" in namespace "provisioning-8136" ... skipping 20 lines ... I0625 04:33:53.693] [90mtest/e2e/storage/external/external.go:174[0m I0625 04:33:53.693] [Testpattern: Dynamic PV (default fs)] subPath I0625 04:33:53.693] [90mtest/e2e/storage/framework/testsuite.go:50[0m I0625 04:33:53.693] should support creating multiple subpath from same volumes [Slow] I0625 04:33:53.693] [90mtest/e2e/storage/testsuites/subpath.go:296[0m I0625 04:33:53.694] [90m------------------------------[0m I0625 04:33:53.694] {"msg":"PASSED External Storage [Driver: csi-gcepd-sc-windows--no-volumesnapshotclass] [Testpattern: Dynamic PV (default fs)] subPath should support creating multiple subpath from same volumes [Slow]","total":-1,"completed":2,"skipped":606,"failed":0} I0625 04:33:53.694] I0625 04:33:53.694] [36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m I0625 04:33:53.695] [90m------------------------------[0m I0625 04:33:53.695] [BeforeEach] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] I0625 04:33:53.695] test/e2e/storage/framework/testsuite.go:51 I0625 04:33:53.695] Jun 25 04:33:53.688: INFO: Driver "csi-gcepd-sc-windows--no-volumesnapshotclass" does not support volume type "PreprovisionedPV" - skipping ... skipping 266 lines ... I0625 04:34:23.570] Jun 25 04:31:26.267: INFO: Pod "pod-c154975f-8814-493d-b9cf-2d5f765940ce": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.008262727s I0625 04:34:23.570] Jun 25 04:31:28.266: INFO: Pod "pod-c154975f-8814-493d-b9cf-2d5f765940ce": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.008012458s I0625 04:34:23.570] Jun 25 04:31:30.266: INFO: Pod "pod-c154975f-8814-493d-b9cf-2d5f765940ce": Phase="Running", Reason="", readiness=true. Elapsed: 1m26.007479566s I0625 04:34:23.570] Jun 25 04:31:30.266: INFO: Pod "pod-c154975f-8814-493d-b9cf-2d5f765940ce" satisfied condition "running" I0625 04:34:23.571] [1mSTEP[0m: Deleting pod pod-c154975f-8814-493d-b9cf-2d5f765940ce in namespace provisioning-857 I0625 04:34:23.571] [1mSTEP[0m: checking the created volume is writable on node {Name: Selector:map[] Affinity:nil} I0625 04:34:23.571] Jun 25 04:31:30.283: INFO: Waiting up to 15m0s for pod "pvc-volume-tester-writer-9wjx5" in namespace "provisioning-857" to be "Succeeded or Failed" I0625 04:34:23.572] Jun 25 04:31:30.287: INFO: Pod "pvc-volume-tester-writer-9wjx5": Phase="Pending", Reason="", readiness=false. Elapsed: 4.203292ms I0625 04:34:23.572] Jun 25 04:31:32.291: INFO: Pod "pvc-volume-tester-writer-9wjx5": Phase="Pending", Reason="", readiness=false. Elapsed: 2.007804735s I0625 04:34:23.572] Jun 25 04:31:34.293: INFO: Pod "pvc-volume-tester-writer-9wjx5": Phase="Pending", Reason="", readiness=false. Elapsed: 4.01018027s I0625 04:34:23.572] Jun 25 04:31:36.292: INFO: Pod "pvc-volume-tester-writer-9wjx5": Phase="Pending", Reason="", readiness=false. Elapsed: 6.009109688s I0625 04:34:23.572] Jun 25 04:31:38.290: INFO: Pod "pvc-volume-tester-writer-9wjx5": Phase="Pending", Reason="", readiness=false. Elapsed: 8.007600761s I0625 04:34:23.573] Jun 25 04:31:40.292: INFO: Pod "pvc-volume-tester-writer-9wjx5": Phase="Pending", Reason="", readiness=false. Elapsed: 10.008679754s ... skipping 36 lines ... I0625 04:34:23.581] Jun 25 04:32:54.292: INFO: Pod "pvc-volume-tester-writer-9wjx5": Phase="Running", Reason="", readiness=true. Elapsed: 1m24.008954857s I0625 04:34:23.581] Jun 25 04:32:56.292: INFO: Pod "pvc-volume-tester-writer-9wjx5": Phase="Running", Reason="", readiness=true. Elapsed: 1m26.008930854s I0625 04:34:23.581] Jun 25 04:32:58.291: INFO: Pod "pvc-volume-tester-writer-9wjx5": Phase="Running", Reason="", readiness=false. Elapsed: 1m28.008520089s I0625 04:34:23.581] Jun 25 04:33:00.291: INFO: Pod "pvc-volume-tester-writer-9wjx5": Phase="Running", Reason="", readiness=false. Elapsed: 1m30.008409788s I0625 04:34:23.582] Jun 25 04:33:02.291: INFO: Pod "pvc-volume-tester-writer-9wjx5": Phase="Succeeded", Reason="", readiness=false. Elapsed: 1m32.007826379s I0625 04:34:23.582] [1mSTEP[0m: Saw pod success I0625 04:34:23.582] Jun 25 04:33:02.291: INFO: Pod "pvc-volume-tester-writer-9wjx5" satisfied condition "Succeeded or Failed" I0625 04:34:23.582] Jun 25 04:33:02.379: INFO: Pod pvc-volume-tester-writer-9wjx5 has the following logs: I0625 04:34:23.583] Jun 25 04:33:02.379: INFO: Deleting pod "pvc-volume-tester-writer-9wjx5" in namespace "provisioning-857" I0625 04:34:23.583] Jun 25 04:33:02.387: INFO: Wait up to 5m0s for pod "pvc-volume-tester-writer-9wjx5" to be fully deleted I0625 04:34:23.583] [1mSTEP[0m: checking the created volume has the correct mount options, is readable and retains data on the same node "e2e-test-prow-windows-node-group-qhph" I0625 04:34:23.583] Jun 25 04:33:02.405: INFO: Waiting up to 15m0s for pod "pvc-volume-tester-reader-n2lrt" in namespace "provisioning-857" to be "Succeeded or Failed" I0625 04:34:23.584] Jun 25 04:33:02.408: INFO: Pod "pvc-volume-tester-reader-n2lrt": Phase="Pending", Reason="", readiness=false. Elapsed: 2.980968ms I0625 04:34:23.584] Jun 25 04:33:04.412: INFO: Pod "pvc-volume-tester-reader-n2lrt": Phase="Pending", Reason="", readiness=false. Elapsed: 2.007475893s I0625 04:34:23.584] Jun 25 04:33:06.412: INFO: Pod "pvc-volume-tester-reader-n2lrt": Phase="Pending", Reason="", readiness=false. Elapsed: 4.007301759s I0625 04:34:23.584] Jun 25 04:33:08.413: INFO: Pod "pvc-volume-tester-reader-n2lrt": Phase="Pending", Reason="", readiness=false. Elapsed: 6.008226562s I0625 04:34:23.585] Jun 25 04:33:10.411: INFO: Pod "pvc-volume-tester-reader-n2lrt": Phase="Pending", Reason="", readiness=false. Elapsed: 8.006642622s I0625 04:34:23.585] Jun 25 04:33:12.414: INFO: Pod "pvc-volume-tester-reader-n2lrt": Phase="Pending", Reason="", readiness=false. Elapsed: 10.008823282s ... skipping 13 lines ... I0625 04:34:23.588] Jun 25 04:33:40.412: INFO: Pod "pvc-volume-tester-reader-n2lrt": Phase="Pending", Reason="", readiness=false. Elapsed: 38.006929258s I0625 04:34:23.588] Jun 25 04:33:42.411: INFO: Pod "pvc-volume-tester-reader-n2lrt": Phase="Pending", Reason="", readiness=false. Elapsed: 40.006634077s I0625 04:34:23.589] Jun 25 04:33:44.412: INFO: Pod "pvc-volume-tester-reader-n2lrt": Phase="Running", Reason="", readiness=true. Elapsed: 42.007035144s I0625 04:34:23.589] Jun 25 04:33:46.411: INFO: Pod "pvc-volume-tester-reader-n2lrt": Phase="Running", Reason="", readiness=false. Elapsed: 44.006679627s I0625 04:34:23.589] Jun 25 04:33:48.412: INFO: Pod "pvc-volume-tester-reader-n2lrt": Phase="Succeeded", Reason="", readiness=false. Elapsed: 46.007170058s I0625 04:34:23.589] [1mSTEP[0m: Saw pod success I0625 04:34:23.589] Jun 25 04:33:48.412: INFO: Pod "pvc-volume-tester-reader-n2lrt" satisfied condition "Succeeded or Failed" I0625 04:34:23.589] Jun 25 04:33:48.462: INFO: Pod pvc-volume-tester-reader-n2lrt has the following logs: hello world I0625 04:34:23.589] I0625 04:34:23.589] Jun 25 04:33:48.462: INFO: Deleting pod "pvc-volume-tester-reader-n2lrt" in namespace "provisioning-857" I0625 04:34:23.590] Jun 25 04:33:48.473: INFO: Wait up to 5m0s for pod "pvc-volume-tester-reader-n2lrt" to be fully deleted I0625 04:34:23.590] Jun 25 04:33:48.477: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-k9kmf] to have phase Bound I0625 04:34:23.590] Jun 25 04:33:48.480: INFO: PersistentVolumeClaim pvc-k9kmf found and phase=Bound (3.322147ms) ... skipping 23 lines ... I0625 04:34:23.594] [90mtest/e2e/storage/external/external.go:174[0m I0625 04:34:23.595] [Testpattern: Dynamic PV (default fs)] provisioning I0625 04:34:23.595] [90mtest/e2e/storage/framework/testsuite.go:50[0m I0625 04:34:23.595] should provision storage with mount options I0625 04:34:23.595] [90mtest/e2e/storage/testsuites/provisioning.go:187[0m I0625 04:34:23.595] [90m------------------------------[0m I0625 04:34:23.596] {"msg":"PASSED External Storage [Driver: csi-gcepd-sc-windows--no-volumesnapshotclass] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with mount options","total":-1,"completed":2,"skipped":22,"failed":0} I0625 04:34:23.596] I0625 04:34:23.596] [36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m I0625 04:34:23.596] [90m------------------------------[0m I0625 04:34:23.596] [BeforeEach] [Testpattern: Dynamic PV (ext4)] volumes I0625 04:34:23.597] test/e2e/storage/framework/testsuite.go:51 I0625 04:34:23.597] Jun 25 04:34:23.583: INFO: Driver csi-gcepd-sc-windows--no-volumesnapshotclass doesn't support ext4 -- skipping ... skipping 45 lines ... I0625 04:34:23.689] I0625 04:34:23.689] [36m[1mS [SKIPPING] in Spec Setup (BeforeEach) [0.001 seconds][0m I0625 04:34:23.689] External Storage [Driver: csi-gcepd-sc-windows--no-volumesnapshotclass] I0625 04:34:23.689] [90mtest/e2e/storage/external/external.go:174[0m I0625 04:34:23.689] [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode I0625 04:34:23.689] [90mtest/e2e/storage/framework/testsuite.go:50[0m I0625 04:34:23.690] [36m[1mshould fail to use a volume in a pod with mismatched mode [Slow] [BeforeEach][0m I0625 04:34:23.690] [90mtest/e2e/storage/testsuites/volumemode.go:299[0m I0625 04:34:23.690] I0625 04:34:23.690] [36mDriver "csi-gcepd-sc-windows--no-volumesnapshotclass" does not support volume type "PreprovisionedPV" - skipping[0m I0625 04:34:23.690] I0625 04:34:23.690] test/e2e/storage/external/external.go:269 I0625 04:34:23.690] [90m------------------------------[0m ... skipping 110 lines ... I0625 04:35:43.222] [90mtest/e2e/storage/external/external.go:174[0m I0625 04:35:43.223] [Testpattern: Dynamic PV (immediate binding)] topology I0625 04:35:43.223] [90mtest/e2e/storage/framework/testsuite.go:50[0m I0625 04:35:43.223] should provision a volume and schedule a pod with AllowedTopologies I0625 04:35:43.223] [90mtest/e2e/storage/testsuites/topology.go:166[0m I0625 04:35:43.223] [90m------------------------------[0m I0625 04:35:43.224] {"msg":"PASSED External Storage [Driver: csi-gcepd-sc-windows--no-volumesnapshotclass] [Testpattern: Dynamic PV (immediate binding)] topology should provision a volume and schedule a pod with AllowedTopologies","total":-1,"completed":3,"skipped":945,"failed":0} I0625 04:35:43.224] I0625 04:35:43.224] [36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m I0625 04:35:43.224] [90m------------------------------[0m I0625 04:35:43.224] [BeforeEach] [Testpattern: Pre-provisioned PV (ntfs)][Feature:Windows] volumes I0625 04:35:43.224] test/e2e/storage/framework/testsuite.go:51 I0625 04:35:43.225] Jun 25 04:35:43.215: INFO: Driver "csi-gcepd-sc-windows--no-volumesnapshotclass" does not support volume type "PreprovisionedPV" - skipping ... skipping 161 lines ... I0625 04:36:29.158] [90mtest/e2e/storage/external/external.go:174[0m I0625 04:36:29.158] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] volumeIO I0625 04:36:29.159] [90mtest/e2e/storage/framework/testsuite.go:50[0m I0625 04:36:29.159] should write files of various sizes, verify size, validate content [Slow] I0625 04:36:29.159] [90mtest/e2e/storage/testsuites/volume_io.go:149[0m I0625 04:36:29.159] [90m------------------------------[0m I0625 04:36:29.159] {"msg":"PASSED External Storage [Driver: csi-gcepd-sc-windows--no-volumesnapshotclass] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] volumeIO should write files of various sizes, verify size, validate content [Slow]","total":-1,"completed":3,"skipped":246,"failed":0} I0625 04:36:29.159] I0625 04:37:45.238] [36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m I0625 04:37:45.239] [90m------------------------------[0m I0625 04:37:45.239] [BeforeEach] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] I0625 04:37:45.239] test/e2e/storage/framework/testsuite.go:51 I0625 04:37:45.239] [BeforeEach] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] ... skipping 175 lines ... I0625 04:37:45.278] [90mtest/e2e/storage/external/external.go:174[0m I0625 04:37:45.278] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] I0625 04:37:45.278] [90mtest/e2e/storage/framework/testsuite.go:50[0m I0625 04:37:45.278] should concurrently access the single volume from pods on the same node I0625 04:37:45.278] [90mtest/e2e/storage/testsuites/multivolume.go:298[0m I0625 04:37:45.278] [90m------------------------------[0m I0625 04:37:45.279] {"msg":"PASSED External Storage [Driver: csi-gcepd-sc-windows--no-volumesnapshotclass] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single volume from pods on the same node","total":-1,"completed":4,"skipped":1130,"failed":0} I0625 04:37:45.279] I0625 04:37:48.690] [36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m I0625 04:37:48.691] [90m------------------------------[0m I0625 04:37:48.691] [BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning I0625 04:37:48.691] test/e2e/storage/framework/testsuite.go:51 I0625 04:37:48.691] [BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning ... skipping 224 lines ... I0625 04:37:48.742] [90mtest/e2e/storage/external/external.go:174[0m I0625 04:37:48.742] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning I0625 04:37:48.742] [90mtest/e2e/storage/framework/testsuite.go:50[0m I0625 04:37:48.742] should provision storage with pvc data source I0625 04:37:48.743] [90mtest/e2e/storage/testsuites/provisioning.go:428[0m I0625 04:37:48.743] [90m------------------------------[0m I0625 04:37:48.743] {"msg":"PASSED External Storage [Driver: csi-gcepd-sc-windows--no-volumesnapshotclass] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning should provision storage with pvc data source","total":-1,"completed":2,"skipped":246,"failed":0} I0625 04:37:48.743] I0625 04:37:51.510] [36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m I0625 04:37:51.511] [90m------------------------------[0m I0625 04:37:51.511] [BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] I0625 04:37:51.511] test/e2e/storage/framework/testsuite.go:51 I0625 04:37:51.511] [BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] ... skipping 268 lines ... I0625 04:37:51.574] [90mtest/e2e/storage/external/external.go:174[0m I0625 04:37:51.574] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] I0625 04:37:51.574] [90mtest/e2e/storage/framework/testsuite.go:50[0m I0625 04:37:51.575] should access to two volumes with the same volume mode and retain data across pod recreation on different node I0625 04:37:51.575] [90mtest/e2e/storage/testsuites/multivolume.go:168[0m I0625 04:37:51.575] [90m------------------------------[0m I0625 04:37:51.575] {"msg":"PASSED External Storage [Driver: csi-gcepd-sc-windows--no-volumesnapshotclass] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node","total":-1,"completed":3,"skipped":455,"failed":0} I0625 04:37:51.576] I0625 04:37:51.578] [36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m I0625 04:37:51.578] [90m------------------------------[0m I0625 04:37:51.579] [BeforeEach] [Testpattern: Dynamic PV (immediate binding)] topology I0625 04:37:51.579] test/e2e/storage/framework/testsuite.go:51 I0625 04:37:51.579] [BeforeEach] [Testpattern: Dynamic PV (immediate binding)] topology I0625 04:37:51.579] test/e2e/framework/framework.go:186 I0625 04:37:51.579] [1mSTEP[0m: Creating a kubernetes client I0625 04:37:51.580] Jun 25 04:37:51.537: INFO: >>> kubeConfig: /root/.kube/config I0625 04:37:51.580] [1mSTEP[0m: Building a namespace api object, basename topology I0625 04:37:51.580] [1mSTEP[0m: Waiting for a default service account to be provisioned in namespace I0625 04:37:51.580] [1mSTEP[0m: Waiting for kube-root-ca.crt to be provisioned in namespace I0625 04:37:51.581] [It] should fail to schedule a pod which has topologies that conflict with AllowedTopologies I0625 04:37:51.581] test/e2e/storage/testsuites/topology.go:194 I0625 04:37:51.581] Jun 25 04:37:51.565: INFO: found topology map[topology.gke.io/zone:us-central1-b] I0625 04:37:51.581] Jun 25 04:37:51.566: INFO: Not enough topologies in cluster -- skipping I0625 04:37:51.581] [1mSTEP[0m: Deleting pvc I0625 04:37:51.581] [1mSTEP[0m: Deleting sc I0625 04:37:51.582] [AfterEach] [Testpattern: Dynamic PV (immediate binding)] topology ... skipping 4 lines ... I0625 04:37:51.583] I0625 04:37:51.583] [36m[1mS [SKIPPING] [0.040 seconds][0m I0625 04:37:51.583] External Storage [Driver: csi-gcepd-sc-windows--no-volumesnapshotclass] I0625 04:37:51.583] [90mtest/e2e/storage/external/external.go:174[0m I0625 04:37:51.583] [Testpattern: Dynamic PV (immediate binding)] topology I0625 04:37:51.584] [90mtest/e2e/storage/framework/testsuite.go:50[0m I0625 04:37:51.584] [36m[1mshould fail to schedule a pod which has topologies that conflict with AllowedTopologies [It][0m I0625 04:37:51.584] [90mtest/e2e/storage/testsuites/topology.go:194[0m I0625 04:37:51.584] I0625 04:37:51.584] [36mNot enough topologies in cluster -- skipping[0m I0625 04:37:51.584] I0625 04:37:51.585] test/e2e/storage/testsuites/topology.go:201 I0625 04:37:51.585] [90m------------------------------[0m ... skipping 88 lines ... I0625 04:38:32.359] Jun 25 04:36:29.217: INFO: Using claimSize:5Gi, test suite supported size:{ 1Mi}, driver(csi-gcepd-sc-windows--no-volumesnapshotclass) supported size:{ 1Mi} I0625 04:38:32.359] [1mSTEP[0m: creating a StorageClass provisioning-4582-e2e-sctzmjx I0625 04:38:32.359] [1mSTEP[0m: creating a claim I0625 04:38:32.359] Jun 25 04:36:29.222: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil I0625 04:38:32.360] [1mSTEP[0m: Creating pod pod-subpath-test-dynamicpv-6t2l I0625 04:38:32.360] [1mSTEP[0m: Creating a pod to test multi_subpath I0625 04:38:32.360] Jun 25 04:36:29.236: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-6t2l" in namespace "provisioning-4582" to be "Succeeded or Failed" I0625 04:38:32.360] Jun 25 04:36:29.239: INFO: Pod "pod-subpath-test-dynamicpv-6t2l": Phase="Pending", Reason="", readiness=false. Elapsed: 2.875005ms I0625 04:38:32.360] Jun 25 04:36:31.242: INFO: Pod "pod-subpath-test-dynamicpv-6t2l": Phase="Pending", Reason="", readiness=false. Elapsed: 2.006431496s I0625 04:38:32.360] Jun 25 04:36:33.244: INFO: Pod "pod-subpath-test-dynamicpv-6t2l": Phase="Pending", Reason="", readiness=false. Elapsed: 4.007738107s I0625 04:38:32.361] Jun 25 04:36:35.242: INFO: Pod "pod-subpath-test-dynamicpv-6t2l": Phase="Pending", Reason="", readiness=false. Elapsed: 6.006653643s I0625 04:38:32.361] Jun 25 04:36:37.243: INFO: Pod "pod-subpath-test-dynamicpv-6t2l": Phase="Pending", Reason="", readiness=false. Elapsed: 8.007570224s I0625 04:38:32.361] Jun 25 04:36:39.242: INFO: Pod "pod-subpath-test-dynamicpv-6t2l": Phase="Pending", Reason="", readiness=false. Elapsed: 10.006552693s ... skipping 34 lines ... I0625 04:38:32.369] Jun 25 04:37:49.244: INFO: Pod "pod-subpath-test-dynamicpv-6t2l": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.008284086s I0625 04:38:32.369] Jun 25 04:37:51.242: INFO: Pod "pod-subpath-test-dynamicpv-6t2l": Phase="Running", Reason="", readiness=true. Elapsed: 1m22.006605406s I0625 04:38:32.369] Jun 25 04:37:53.243: INFO: Pod "pod-subpath-test-dynamicpv-6t2l": Phase="Running", Reason="", readiness=false. Elapsed: 1m24.007307638s I0625 04:38:32.370] Jun 25 04:37:55.242: INFO: Pod "pod-subpath-test-dynamicpv-6t2l": Phase="Running", Reason="", readiness=false. Elapsed: 1m26.006571831s I0625 04:38:32.370] Jun 25 04:37:57.244: INFO: Pod "pod-subpath-test-dynamicpv-6t2l": Phase="Succeeded", Reason="", readiness=false. Elapsed: 1m28.007886861s I0625 04:38:32.370] [1mSTEP[0m: Saw pod success I0625 04:38:32.370] Jun 25 04:37:57.244: INFO: Pod "pod-subpath-test-dynamicpv-6t2l" satisfied condition "Succeeded or Failed" I0625 04:38:32.370] Jun 25 04:37:57.246: INFO: Trying to get logs from node e2e-test-prow-windows-node-group-rn0p pod pod-subpath-test-dynamicpv-6t2l container test-container-subpath-dynamicpv-6t2l: <nil> I0625 04:38:32.370] [1mSTEP[0m: delete the pod I0625 04:38:32.370] Jun 25 04:37:57.291: INFO: Waiting for pod pod-subpath-test-dynamicpv-6t2l to disappear I0625 04:38:32.371] Jun 25 04:37:57.295: INFO: Pod pod-subpath-test-dynamicpv-6t2l no longer exists I0625 04:38:32.371] [1mSTEP[0m: Deleting pod I0625 04:38:32.371] Jun 25 04:37:57.295: INFO: Deleting pod "pod-subpath-test-dynamicpv-6t2l" in namespace "provisioning-4582" ... skipping 20 lines ... I0625 04:38:32.374] [90mtest/e2e/storage/external/external.go:174[0m I0625 04:38:32.374] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath I0625 04:38:32.374] [90mtest/e2e/storage/framework/testsuite.go:50[0m I0625 04:38:32.374] should support creating multiple subpath from same volumes [Slow] I0625 04:38:32.374] [90mtest/e2e/storage/testsuites/subpath.go:296[0m I0625 04:38:32.374] [90m------------------------------[0m I0625 04:38:32.375] {"msg":"PASSED External Storage [Driver: csi-gcepd-sc-windows--no-volumesnapshotclass] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support creating multiple subpath from same volumes [Slow]","total":-1,"completed":4,"skipped":295,"failed":0} I0625 04:38:32.375] I0625 04:38:32.434] [36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m I0625 04:38:32.434] [90m------------------------------[0m I0625 04:38:32.434] [BeforeEach] [Testpattern: Dynamic PV (delayed binding)] topology I0625 04:38:32.434] test/e2e/storage/framework/testsuite.go:51 I0625 04:38:32.434] [BeforeEach] [Testpattern: Dynamic PV (delayed binding)] topology I0625 04:38:32.434] test/e2e/framework/framework.go:186 I0625 04:38:32.435] [1mSTEP[0m: Creating a kubernetes client I0625 04:38:32.435] Jun 25 04:38:32.391: INFO: >>> kubeConfig: /root/.kube/config I0625 04:38:32.435] [1mSTEP[0m: Building a namespace api object, basename topology I0625 04:38:32.435] [1mSTEP[0m: Waiting for a default service account to be provisioned in namespace I0625 04:38:32.435] [1mSTEP[0m: Waiting for kube-root-ca.crt to be provisioned in namespace I0625 04:38:32.435] [It] should fail to schedule a pod which has topologies that conflict with AllowedTopologies I0625 04:38:32.435] test/e2e/storage/testsuites/topology.go:194 I0625 04:38:32.435] Jun 25 04:38:32.418: INFO: found topology map[topology.gke.io/zone:us-central1-b] I0625 04:38:32.436] Jun 25 04:38:32.419: INFO: Not enough topologies in cluster -- skipping I0625 04:38:32.436] [1mSTEP[0m: Deleting pvc I0625 04:38:32.436] [1mSTEP[0m: Deleting sc I0625 04:38:32.436] [AfterEach] [Testpattern: Dynamic PV (delayed binding)] topology ... skipping 4 lines ... I0625 04:38:32.436] I0625 04:38:32.436] [36m[1mS [SKIPPING] [0.042 seconds][0m I0625 04:38:32.437] External Storage [Driver: csi-gcepd-sc-windows--no-volumesnapshotclass] I0625 04:38:32.437] [90mtest/e2e/storage/external/external.go:174[0m I0625 04:38:32.437] [Testpattern: Dynamic PV (delayed binding)] topology I0625 04:38:32.437] [90mtest/e2e/storage/framework/testsuite.go:50[0m I0625 04:38:32.437] [36m[1mshould fail to schedule a pod which has topologies that conflict with AllowedTopologies [It][0m I0625 04:38:32.437] [90mtest/e2e/storage/testsuites/topology.go:194[0m I0625 04:38:32.437] I0625 04:38:32.437] [36mNot enough topologies in cluster -- skipping[0m I0625 04:38:32.437] I0625 04:38:32.437] test/e2e/storage/testsuites/topology.go:201 I0625 04:38:32.438] [90m------------------------------[0m ... skipping 15 lines ... I0625 04:40:00.011] [1mSTEP[0m: creating a StorageClass volume-3137-e2e-sc8xdrb I0625 04:40:00.011] [1mSTEP[0m: creating a claim I0625 04:40:00.011] Jun 25 04:37:48.759: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil I0625 04:40:00.011] Jun 25 04:37:48.768: INFO: generated pod command echo "ls -n /vol1" > /vol1/test-dynamicpv-mwhl.ps1; .\/vol1/test-dynamicpv-mwhl.ps1 I0625 04:40:00.012] [1mSTEP[0m: Creating pod exec-volume-test-dynamicpv-mwhl I0625 04:40:00.012] [1mSTEP[0m: Creating a pod to test exec-volume-test I0625 04:40:00.012] Jun 25 04:37:48.773: INFO: Waiting up to 5m0s for pod "exec-volume-test-dynamicpv-mwhl" in namespace "volume-3137" to be "Succeeded or Failed" I0625 04:40:00.012] Jun 25 04:37:48.779: INFO: Pod "exec-volume-test-dynamicpv-mwhl": Phase="Pending", Reason="", readiness=false. Elapsed: 5.580054ms I0625 04:40:00.012] Jun 25 04:37:50.783: INFO: Pod "exec-volume-test-dynamicpv-mwhl": Phase="Pending", Reason="", readiness=false. Elapsed: 2.010228772s I0625 04:40:00.012] Jun 25 04:37:52.783: INFO: Pod "exec-volume-test-dynamicpv-mwhl": Phase="Pending", Reason="", readiness=false. Elapsed: 4.009612112s I0625 04:40:00.012] Jun 25 04:37:54.784: INFO: Pod "exec-volume-test-dynamicpv-mwhl": Phase="Pending", Reason="", readiness=false. Elapsed: 6.010410451s I0625 04:40:00.013] Jun 25 04:37:56.785: INFO: Pod "exec-volume-test-dynamicpv-mwhl": Phase="Pending", Reason="", readiness=false. Elapsed: 8.01181895s I0625 04:40:00.013] Jun 25 04:37:58.784: INFO: Pod "exec-volume-test-dynamicpv-mwhl": Phase="Pending", Reason="", readiness=false. Elapsed: 10.011113738s ... skipping 38 lines ... I0625 04:40:00.023] Jun 25 04:39:16.783: INFO: Pod "exec-volume-test-dynamicpv-mwhl": Phase="Running", Reason="", readiness=true. Elapsed: 1m28.009901072s I0625 04:40:00.023] Jun 25 04:39:18.784: INFO: Pod "exec-volume-test-dynamicpv-mwhl": Phase="Running", Reason="", readiness=true. Elapsed: 1m30.010623008s I0625 04:40:00.024] Jun 25 04:39:20.784: INFO: Pod "exec-volume-test-dynamicpv-mwhl": Phase="Running", Reason="", readiness=true. Elapsed: 1m32.010544344s I0625 04:40:00.024] Jun 25 04:39:22.785: INFO: Pod "exec-volume-test-dynamicpv-mwhl": Phase="Running", Reason="", readiness=false. Elapsed: 1m34.011466545s I0625 04:40:00.024] Jun 25 04:39:24.784: INFO: Pod "exec-volume-test-dynamicpv-mwhl": Phase="Succeeded", Reason="", readiness=false. Elapsed: 1m36.011149035s I0625 04:40:00.024] [1mSTEP[0m: Saw pod success I0625 04:40:00.024] Jun 25 04:39:24.784: INFO: Pod "exec-volume-test-dynamicpv-mwhl" satisfied condition "Succeeded or Failed" I0625 04:40:00.025] Jun 25 04:39:24.788: INFO: Trying to get logs from node e2e-test-prow-windows-node-group-w48h pod exec-volume-test-dynamicpv-mwhl container exec-container-dynamicpv-mwhl: <nil> I0625 04:40:00.025] [1mSTEP[0m: delete the pod I0625 04:40:00.025] Jun 25 04:39:24.933: INFO: Waiting for pod exec-volume-test-dynamicpv-mwhl to disappear I0625 04:40:00.025] Jun 25 04:39:24.936: INFO: Pod exec-volume-test-dynamicpv-mwhl no longer exists I0625 04:40:00.026] [1mSTEP[0m: Deleting pod exec-volume-test-dynamicpv-mwhl I0625 04:40:00.026] Jun 25 04:39:24.937: INFO: Deleting pod "exec-volume-test-dynamicpv-mwhl" in namespace "volume-3137" ... skipping 20 lines ... I0625 04:40:00.030] [90mtest/e2e/storage/external/external.go:174[0m I0625 04:40:00.030] [Testpattern: Dynamic PV (default fs)] volumes I0625 04:40:00.030] [90mtest/e2e/storage/framework/testsuite.go:50[0m I0625 04:40:00.031] should allow exec of files on the volume I0625 04:40:00.031] [90mtest/e2e/storage/testsuites/volumes.go:198[0m I0625 04:40:00.031] [90m------------------------------[0m I0625 04:40:00.031] {"msg":"PASSED External Storage [Driver: csi-gcepd-sc-windows--no-volumesnapshotclass] [Testpattern: Dynamic PV (default fs)] volumes should allow exec of files on the volume","total":-1,"completed":3,"skipped":271,"failed":0} I0625 04:40:00.031] I0625 04:40:16.445] [36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m I0625 04:40:16.445] [90m------------------------------[0m I0625 04:40:16.445] [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath I0625 04:40:16.445] test/e2e/storage/framework/testsuite.go:51 I0625 04:40:16.445] [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath ... skipping 8 lines ... I0625 04:40:16.446] Jun 25 04:37:45.311: INFO: Creating resource for dynamic PV I0625 04:40:16.447] Jun 25 04:37:45.311: INFO: Using claimSize:5Gi, test suite supported size:{ 1Mi}, driver(csi-gcepd-sc-windows--no-volumesnapshotclass) supported size:{ 1Mi} I0625 04:40:16.447] [1mSTEP[0m: creating a StorageClass provisioning-5911-e2e-sc6xthq I0625 04:40:16.447] [1mSTEP[0m: creating a claim I0625 04:40:16.447] Jun 25 04:37:45.315: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil I0625 04:40:16.447] [1mSTEP[0m: Creating pod to format volume volume-prep-provisioning-5911 I0625 04:40:16.447] Jun 25 04:37:45.328: INFO: Waiting up to 5m0s for pod "volume-prep-provisioning-5911" in namespace "provisioning-5911" to be "Succeeded or Failed" I0625 04:40:16.447] Jun 25 04:37:45.333: INFO: Pod "volume-prep-provisioning-5911": Phase="Pending", Reason="", readiness=false. Elapsed: 4.968458ms I0625 04:40:16.448] Jun 25 04:37:47.336: INFO: Pod "volume-prep-provisioning-5911": Phase="Pending", Reason="", readiness=false. Elapsed: 2.008618248s I0625 04:40:16.448] Jun 25 04:37:49.336: INFO: Pod "volume-prep-provisioning-5911": Phase="Pending", Reason="", readiness=false. Elapsed: 4.008816439s I0625 04:40:16.448] Jun 25 04:37:51.337: INFO: Pod "volume-prep-provisioning-5911": Phase="Pending", Reason="", readiness=false. Elapsed: 6.009865199s I0625 04:40:16.448] Jun 25 04:37:53.337: INFO: Pod "volume-prep-provisioning-5911": Phase="Pending", Reason="", readiness=false. Elapsed: 8.009010348s I0625 04:40:16.448] Jun 25 04:37:55.336: INFO: Pod "volume-prep-provisioning-5911": Phase="Pending", Reason="", readiness=false. Elapsed: 10.008694813s ... skipping 19 lines ... I0625 04:40:16.451] Jun 25 04:38:35.336: INFO: Pod "volume-prep-provisioning-5911": Phase="Pending", Reason="", readiness=false. Elapsed: 50.008740837s I0625 04:40:16.452] Jun 25 04:38:37.337: INFO: Pod "volume-prep-provisioning-5911": Phase="Pending", Reason="", readiness=false. Elapsed: 52.009138552s I0625 04:40:16.452] Jun 25 04:38:39.337: INFO: Pod "volume-prep-provisioning-5911": Phase="Running", Reason="", readiness=true. Elapsed: 54.009007277s I0625 04:40:16.452] Jun 25 04:38:41.342: INFO: Pod "volume-prep-provisioning-5911": Phase="Running", Reason="", readiness=false. Elapsed: 56.014390057s I0625 04:40:16.452] Jun 25 04:38:43.336: INFO: Pod "volume-prep-provisioning-5911": Phase="Succeeded", Reason="", readiness=false. Elapsed: 58.00870723s I0625 04:40:16.452] [1mSTEP[0m: Saw pod success I0625 04:40:16.452] Jun 25 04:38:43.336: INFO: Pod "volume-prep-provisioning-5911" satisfied condition "Succeeded or Failed" I0625 04:40:16.452] Jun 25 04:38:43.336: INFO: Deleting pod "volume-prep-provisioning-5911" in namespace "provisioning-5911" I0625 04:40:16.453] Jun 25 04:38:43.348: INFO: Wait up to 5m0s for pod "volume-prep-provisioning-5911" to be fully deleted I0625 04:40:16.453] [1mSTEP[0m: Creating pod pod-subpath-test-dynamicpv-gwtd I0625 04:40:16.453] [1mSTEP[0m: Checking for subpath error in container status I0625 04:40:16.453] Jun 25 04:39:39.370: INFO: Deleting pod "pod-subpath-test-dynamicpv-gwtd" in namespace "provisioning-5911" I0625 04:40:16.453] Jun 25 04:39:39.377: INFO: Wait up to 5m0s for pod "pod-subpath-test-dynamicpv-gwtd" to be fully deleted I0625 04:40:16.453] [1mSTEP[0m: Deleting pod I0625 04:40:16.453] Jun 25 04:39:41.384: INFO: Deleting pod "pod-subpath-test-dynamicpv-gwtd" in namespace "provisioning-5911" I0625 04:40:16.453] [1mSTEP[0m: Deleting pvc I0625 04:40:16.453] Jun 25 04:39:41.393: INFO: Deleting PersistentVolumeClaim "csi-gcepd-sc-windows--no-volumesnapshotclasshs4cb" ... skipping 18 lines ... I0625 04:40:16.457] [90mtest/e2e/storage/external/external.go:174[0m I0625 04:40:16.457] [Testpattern: Dynamic PV (default fs)] subPath I0625 04:40:16.457] [90mtest/e2e/storage/framework/testsuite.go:50[0m I0625 04:40:16.457] should verify container cannot write to subpath readonly volumes [Slow] I0625 04:40:16.457] [90mtest/e2e/storage/testsuites/subpath.go:425[0m I0625 04:40:16.458] [90m------------------------------[0m I0625 04:40:16.458] {"msg":"PASSED External Storage [Driver: csi-gcepd-sc-windows--no-volumesnapshotclass] [Testpattern: Dynamic PV (default fs)] subPath should verify container cannot write to subpath readonly volumes [Slow]","total":-1,"completed":5,"skipped":1177,"failed":0} I0625 04:40:16.458] I0625 04:40:16.582] [36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m I0625 04:40:16.582] [90m------------------------------[0m I0625 04:40:16.583] [BeforeEach] [Testpattern: Dynamic PV (block volmode)] provisioning I0625 04:40:16.583] test/e2e/storage/framework/testsuite.go:51 I0625 04:40:16.583] Jun 25 04:40:16.579: INFO: Driver csi-gcepd-sc-windows--no-volumesnapshotclass doesn't support Block -- skipping ... skipping 178 lines ... I0625 04:41:59.084] [90mtest/e2e/storage/external/external.go:174[0m I0625 04:41:59.084] [Testpattern: Dynamic PV (default fs)] subPath I0625 04:41:59.084] [90mtest/e2e/storage/framework/testsuite.go:50[0m I0625 04:41:59.084] should support restarting containers using directory as subpath [Slow] I0625 04:41:59.084] [90mtest/e2e/storage/testsuites/subpath.go:322[0m I0625 04:41:59.084] [90m------------------------------[0m I0625 04:41:59.085] {"msg":"PASSED External Storage [Driver: csi-gcepd-sc-windows--no-volumesnapshotclass] [Testpattern: Dynamic PV (default fs)] subPath should support restarting containers using directory as subpath [Slow]","total":-1,"completed":5,"skipped":338,"failed":0} I0625 04:41:59.085] I0625 04:41:59.207] [36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m I0625 04:41:59.208] [90m------------------------------[0m I0625 04:41:59.208] [BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath I0625 04:41:59.208] test/e2e/storage/framework/testsuite.go:51 I0625 04:41:59.208] [BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath ... skipping 9 lines ... I0625 04:41:59.209] Jun 25 04:40:00.089: INFO: Using claimSize:5Gi, test suite supported size:{ 1Mi}, driver(csi-gcepd-sc-windows--no-volumesnapshotclass) supported size:{ 1Mi} I0625 04:41:59.209] [1mSTEP[0m: creating a StorageClass provisioning-7162-e2e-scg6zkn I0625 04:41:59.210] [1mSTEP[0m: creating a claim I0625 04:41:59.210] Jun 25 04:40:00.093: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil I0625 04:41:59.210] [1mSTEP[0m: Creating pod pod-subpath-test-dynamicpv-d67l I0625 04:41:59.210] [1mSTEP[0m: Creating a pod to test subpath I0625 04:41:59.210] Jun 25 04:40:00.108: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-d67l" in namespace "provisioning-7162" to be "Succeeded or Failed" I0625 04:41:59.210] Jun 25 04:40:00.111: INFO: Pod "pod-subpath-test-dynamicpv-d67l": Phase="Pending", Reason="", readiness=false. Elapsed: 3.318538ms I0625 04:41:59.211] Jun 25 04:40:02.115: INFO: Pod "pod-subpath-test-dynamicpv-d67l": Phase="Pending", Reason="", readiness=false. Elapsed: 2.006932633s I0625 04:41:59.211] Jun 25 04:40:04.116: INFO: Pod "pod-subpath-test-dynamicpv-d67l": Phase="Pending", Reason="", readiness=false. Elapsed: 4.008278299s I0625 04:41:59.211] Jun 25 04:40:06.115: INFO: Pod "pod-subpath-test-dynamicpv-d67l": Phase="Pending", Reason="", readiness=false. Elapsed: 6.006946134s I0625 04:41:59.211] Jun 25 04:40:08.116: INFO: Pod "pod-subpath-test-dynamicpv-d67l": Phase="Pending", Reason="", readiness=false. Elapsed: 8.007599946s I0625 04:41:59.211] Jun 25 04:40:10.115: INFO: Pod "pod-subpath-test-dynamicpv-d67l": Phase="Pending", Reason="", readiness=false. Elapsed: 10.00698041s ... skipping 32 lines ... I0625 04:41:59.218] Jun 25 04:41:16.117: INFO: Pod "pod-subpath-test-dynamicpv-d67l": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.009077269s I0625 04:41:59.218] Jun 25 04:41:18.116: INFO: Pod "pod-subpath-test-dynamicpv-d67l": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.007608163s I0625 04:41:59.218] Jun 25 04:41:20.117: INFO: Pod "pod-subpath-test-dynamicpv-d67l": Phase="Running", Reason="", readiness=false. Elapsed: 1m20.009305316s I0625 04:41:59.218] Jun 25 04:41:22.115: INFO: Pod "pod-subpath-test-dynamicpv-d67l": Phase="Running", Reason="", readiness=false. Elapsed: 1m22.00712046s I0625 04:41:59.219] Jun 25 04:41:24.117: INFO: Pod "pod-subpath-test-dynamicpv-d67l": Phase="Succeeded", Reason="", readiness=false. Elapsed: 1m24.008595512s I0625 04:41:59.219] [1mSTEP[0m: Saw pod success I0625 04:41:59.219] Jun 25 04:41:24.117: INFO: Pod "pod-subpath-test-dynamicpv-d67l" satisfied condition "Succeeded or Failed" I0625 04:41:59.219] Jun 25 04:41:24.120: INFO: Trying to get logs from node e2e-test-prow-windows-node-group-w48h pod pod-subpath-test-dynamicpv-d67l container test-container-volume-dynamicpv-d67l: <nil> I0625 04:41:59.219] [1mSTEP[0m: delete the pod I0625 04:41:59.220] Jun 25 04:41:24.147: INFO: Waiting for pod pod-subpath-test-dynamicpv-d67l to disappear I0625 04:41:59.220] Jun 25 04:41:24.149: INFO: Pod pod-subpath-test-dynamicpv-d67l no longer exists I0625 04:41:59.220] [1mSTEP[0m: Deleting pod pod-subpath-test-dynamicpv-d67l I0625 04:41:59.220] Jun 25 04:41:24.149: INFO: Deleting pod "pod-subpath-test-dynamicpv-d67l" in namespace "provisioning-7162" ... skipping 22 lines ... I0625 04:41:59.224] [90mtest/e2e/storage/external/external.go:174[0m I0625 04:41:59.224] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath I0625 04:41:59.225] [90mtest/e2e/storage/framework/testsuite.go:50[0m I0625 04:41:59.225] should support existing directory I0625 04:41:59.225] [90mtest/e2e/storage/testsuites/subpath.go:207[0m I0625 04:41:59.225] [90m------------------------------[0m I0625 04:41:59.225] {"msg":"PASSED External Storage [Driver: csi-gcepd-sc-windows--no-volumesnapshotclass] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support existing directory","total":-1,"completed":4,"skipped":312,"failed":0} I0625 04:41:59.225] I0625 04:43:50.486] [36mS[0m I0625 04:43:50.486] [90m------------------------------[0m I0625 04:43:50.487] [BeforeEach] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral I0625 04:43:50.487] test/e2e/storage/framework/testsuite.go:51 I0625 04:43:50.487] [BeforeEach] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral ... skipping 322 lines ... I0625 04:45:36.759] [90mtest/e2e/storage/external/external.go:174[0m I0625 04:45:36.759] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] volumes I0625 04:45:36.759] [90mtest/e2e/storage/framework/testsuite.go:50[0m I0625 04:45:36.759] should store data I0625 04:45:36.759] [90mtest/e2e/storage/testsuites/volumes.go:161[0m I0625 04:45:36.759] [90m------------------------------[0m I0625 04:45:36.759] {"msg":"PASSED External Storage [Driver: csi-gcepd-sc-windows--no-volumesnapshotclass] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] volumes should store data","total":-1,"completed":5,"skipped":313,"failed":0} I0625 04:45:36.760] I0625 04:45:52.304] [36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m I0625 04:45:52.304] [90m------------------------------[0m I0625 04:45:52.304] [BeforeEach] [Testpattern: Dynamic PV (default fs)] provisioning I0625 04:45:52.304] test/e2e/storage/framework/testsuite.go:51 I0625 04:45:52.304] [BeforeEach] [Testpattern: Dynamic PV (default fs)] provisioning ... skipping 153 lines ... I0625 04:45:52.343] [90mtest/e2e/storage/external/external.go:174[0m I0625 04:45:52.343] [Testpattern: Dynamic PV (default fs)] provisioning I0625 04:45:52.344] [90mtest/e2e/storage/framework/testsuite.go:50[0m I0625 04:45:52.344] should mount multiple PV pointing to the same storage on the same node I0625 04:45:52.344] [90mtest/e2e/storage/testsuites/provisioning.go:525[0m I0625 04:45:52.344] [90m------------------------------[0m I0625 04:45:52.344] {"msg":"PASSED External Storage [Driver: csi-gcepd-sc-windows--no-volumesnapshotclass] [Testpattern: Dynamic PV (default fs)] provisioning should mount multiple PV pointing to the same storage on the same node","total":-1,"completed":6,"skipped":350,"failed":0} I0625 04:45:52.344] I0625 04:46:07.709] [36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m I0625 04:46:07.709] [90m------------------------------[0m I0625 04:46:07.710] {"msg":"PASSED External Storage [Driver: csi-gcepd-sc-windows--no-volumesnapshotclass] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should support two pods which have the same volume definition","total":-1,"completed":6,"skipped":1421,"failed":0} I0625 04:46:07.710] [BeforeEach] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral I0625 04:46:07.710] test/e2e/storage/framework/testsuite.go:51 I0625 04:46:07.710] [BeforeEach] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral I0625 04:46:07.710] test/e2e/framework/framework.go:186 I0625 04:46:07.711] [1mSTEP[0m: Creating a kubernetes client I0625 04:46:07.711] Jun 25 04:43:50.487: INFO: >>> kubeConfig: /root/.kube/config ... skipping 88 lines ... I0625 04:46:07.725] [90mtest/e2e/storage/external/external.go:174[0m I0625 04:46:07.725] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral I0625 04:46:07.725] [90mtest/e2e/storage/framework/testsuite.go:50[0m I0625 04:46:07.725] should support multiple inline ephemeral volumes I0625 04:46:07.725] [90mtest/e2e/storage/testsuites/ephemeral.go:315[0m I0625 04:46:07.725] [90m------------------------------[0m I0625 04:46:07.726] {"msg":"PASSED External Storage [Driver: csi-gcepd-sc-windows--no-volumesnapshotclass] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should support multiple inline ephemeral volumes","total":-1,"completed":7,"skipped":1421,"failed":0} I0625 04:46:07.726] I0625 04:46:07.775] [36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m I0625 04:46:07.775] [90m------------------------------[0m I0625 04:46:07.776] [BeforeEach] [Testpattern: Dynamic PV (ext3)] volumes I0625 04:46:07.776] test/e2e/storage/framework/testsuite.go:51 I0625 04:46:07.776] Jun 25 04:46:07.774: INFO: Driver csi-gcepd-sc-windows--no-volumesnapshotclass doesn't support ext3 -- skipping ... skipping 157 lines ... I0625 04:47:16.196] [90mtest/e2e/storage/external/external.go:174[0m I0625 04:47:16.197] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral I0625 04:47:16.197] [90mtest/e2e/storage/framework/testsuite.go:50[0m I0625 04:47:16.197] should create read-only inline ephemeral volume I0625 04:47:16.197] [90mtest/e2e/storage/testsuites/ephemeral.go:175[0m I0625 04:47:16.197] [90m------------------------------[0m I0625 04:47:16.197] {"msg":"PASSED External Storage [Driver: csi-gcepd-sc-windows--no-volumesnapshotclass] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should create read-only inline ephemeral volume","total":-1,"completed":6,"skipped":373,"failed":0} I0625 04:47:16.197] I0625 04:47:16.233] [36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m I0625 04:47:16.233] [90m------------------------------[0m I0625 04:47:16.234] [BeforeEach] [Testpattern: Inline-volume (ntfs)][Feature:Windows] volumes I0625 04:47:16.234] test/e2e/storage/framework/testsuite.go:51 I0625 04:47:16.234] Jun 25 04:47:16.232: INFO: Driver "csi-gcepd-sc-windows--no-volumesnapshotclass" does not support volume type "InlineVolume" - skipping ... skipping 1206 lines ... I0625 04:47:27.809] [90mtest/e2e/storage/external/external.go:174[0m I0625 04:47:27.809] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning I0625 04:47:27.809] [90mtest/e2e/storage/framework/testsuite.go:50[0m I0625 04:47:27.809] should provision storage with pvc data source in parallel [Slow] I0625 04:47:27.809] [90mtest/e2e/storage/testsuites/provisioning.go:466[0m I0625 04:47:27.809] [90m------------------------------[0m I0625 04:47:27.809] {"msg":"PASSED External Storage [Driver: csi-gcepd-sc-windows--no-volumesnapshotclass] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning should provision storage with pvc data source in parallel [Slow]","total":-1,"completed":4,"skipped":544,"failed":0} I0625 04:47:27.809] I0625 04:47:27.810] [36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m I0625 04:47:27.810] [90m------------------------------[0m I0625 04:47:27.810] [BeforeEach] [Testpattern: Inline-volume (default fs)] subPath I0625 04:47:27.810] test/e2e/storage/framework/testsuite.go:51 I0625 04:47:27.810] Jun 25 04:47:27.732: INFO: Driver "csi-gcepd-sc-windows--no-volumesnapshotclass" does not support volume type "InlineVolume" - skipping ... skipping 51 lines ... I0625 04:47:49.518] Jun 25 04:45:52.362: INFO: Using claimSize:5Gi, test suite supported size:{ 1Mi}, driver(csi-gcepd-sc-windows--no-volumesnapshotclass) supported size:{ 1Mi} I0625 04:47:49.518] [1mSTEP[0m: creating a StorageClass provisioning-2795-e2e-sckd8sr I0625 04:47:49.519] [1mSTEP[0m: creating a claim I0625 04:47:49.519] Jun 25 04:45:52.366: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil I0625 04:47:49.519] [1mSTEP[0m: Creating pod pod-subpath-test-dynamicpv-z665 I0625 04:47:49.519] [1mSTEP[0m: Creating a pod to test subpath I0625 04:47:49.519] Jun 25 04:45:52.382: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-z665" in namespace "provisioning-2795" to be "Succeeded or Failed" I0625 04:47:49.519] Jun 25 04:45:52.385: INFO: Pod "pod-subpath-test-dynamicpv-z665": Phase="Pending", Reason="", readiness=false. Elapsed: 3.059736ms I0625 04:47:49.520] Jun 25 04:45:54.389: INFO: Pod "pod-subpath-test-dynamicpv-z665": Phase="Pending", Reason="", readiness=false. Elapsed: 2.006902903s I0625 04:47:49.520] Jun 25 04:45:56.389: INFO: Pod "pod-subpath-test-dynamicpv-z665": Phase="Pending", Reason="", readiness=false. Elapsed: 4.007619021s I0625 04:47:49.520] Jun 25 04:45:58.390: INFO: Pod "pod-subpath-test-dynamicpv-z665": Phase="Pending", Reason="", readiness=false. Elapsed: 6.00809488s I0625 04:47:49.520] Jun 25 04:46:00.391: INFO: Pod "pod-subpath-test-dynamicpv-z665": Phase="Pending", Reason="", readiness=false. Elapsed: 8.008771744s I0625 04:47:49.520] Jun 25 04:46:02.389: INFO: Pod "pod-subpath-test-dynamicpv-z665": Phase="Pending", Reason="", readiness=false. Elapsed: 10.006960975s ... skipping 31 lines ... I0625 04:47:49.526] Jun 25 04:47:06.389: INFO: Pod "pod-subpath-test-dynamicpv-z665": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.007000085s I0625 04:47:49.526] Jun 25 04:47:08.389: INFO: Pod "pod-subpath-test-dynamicpv-z665": Phase="Running", Reason="", readiness=true. Elapsed: 1m16.006799593s I0625 04:47:49.526] Jun 25 04:47:10.390: INFO: Pod "pod-subpath-test-dynamicpv-z665": Phase="Running", Reason="", readiness=false. Elapsed: 1m18.007950155s I0625 04:47:49.526] Jun 25 04:47:12.390: INFO: Pod "pod-subpath-test-dynamicpv-z665": Phase="Running", Reason="", readiness=false. Elapsed: 1m20.008001197s I0625 04:47:49.527] Jun 25 04:47:14.389: INFO: Pod "pod-subpath-test-dynamicpv-z665": Phase="Succeeded", Reason="", readiness=false. Elapsed: 1m22.007147529s I0625 04:47:49.527] [1mSTEP[0m: Saw pod success I0625 04:47:49.527] Jun 25 04:47:14.389: INFO: Pod "pod-subpath-test-dynamicpv-z665" satisfied condition "Succeeded or Failed" I0625 04:47:49.527] Jun 25 04:47:14.392: INFO: Trying to get logs from node e2e-test-prow-windows-node-group-qhph pod pod-subpath-test-dynamicpv-z665 container test-container-volume-dynamicpv-z665: <nil> I0625 04:47:49.527] [1mSTEP[0m: delete the pod I0625 04:47:49.527] Jun 25 04:47:14.438: INFO: Waiting for pod pod-subpath-test-dynamicpv-z665 to disappear I0625 04:47:49.527] Jun 25 04:47:14.440: INFO: Pod pod-subpath-test-dynamicpv-z665 no longer exists I0625 04:47:49.527] [1mSTEP[0m: Deleting pod pod-subpath-test-dynamicpv-z665 I0625 04:47:49.528] Jun 25 04:47:14.441: INFO: Deleting pod "pod-subpath-test-dynamicpv-z665" in namespace "provisioning-2795" ... skipping 22 lines ... I0625 04:47:49.530] [90mtest/e2e/storage/external/external.go:174[0m I0625 04:47:49.530] [Testpattern: Dynamic PV (default fs)] subPath I0625 04:47:49.531] [90mtest/e2e/storage/framework/testsuite.go:50[0m I0625 04:47:49.531] should support non-existent path I0625 04:47:49.531] [90mtest/e2e/storage/testsuites/subpath.go:196[0m I0625 04:47:49.531] [90m------------------------------[0m I0625 04:47:49.531] {"msg":"PASSED External Storage [Driver: csi-gcepd-sc-windows--no-volumesnapshotclass] [Testpattern: Dynamic PV (default fs)] subPath should support non-existent path","total":-1,"completed":7,"skipped":381,"failed":0} I0625 04:47:49.531] I0625 04:47:49.577] [36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m I0625 04:47:49.577] [90m------------------------------[0m I0625 04:47:49.577] [BeforeEach] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral I0625 04:47:49.577] test/e2e/storage/framework/testsuite.go:51 I0625 04:47:49.577] Jun 25 04:47:49.576: INFO: Driver "csi-gcepd-sc-windows--no-volumesnapshotclass" does not provide raw block - skipping ... skipping 323 lines ... I0625 04:49:06.688] [90mtest/e2e/storage/external/external.go:174[0m I0625 04:49:06.688] [Testpattern: Dynamic PV (default fs)] volumes I0625 04:49:06.688] [90mtest/e2e/storage/framework/testsuite.go:50[0m I0625 04:49:06.688] should store data I0625 04:49:06.688] [90mtest/e2e/storage/testsuites/volumes.go:161[0m I0625 04:49:06.688] [90m------------------------------[0m I0625 04:49:06.689] {"msg":"PASSED External Storage [Driver: csi-gcepd-sc-windows--no-volumesnapshotclass] [Testpattern: Dynamic PV (default fs)] volumes should store data","total":-1,"completed":8,"skipped":1601,"failed":0} I0625 04:49:06.689] I0625 04:49:06.708] [36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m I0625 04:49:06.709] [90m------------------------------[0m I0625 04:49:06.709] [BeforeEach] [Testpattern: Dynamic PV (block volmode)] volumeMode I0625 04:49:06.709] test/e2e/storage/framework/testsuite.go:51 I0625 04:49:06.709] [BeforeEach] [Testpattern: Dynamic PV (block volmode)] volumeMode I0625 04:49:06.710] test/e2e/framework/framework.go:186 I0625 04:49:06.710] [1mSTEP[0m: Creating a kubernetes client I0625 04:49:06.710] Jun 25 04:49:06.677: INFO: >>> kubeConfig: /root/.kube/config I0625 04:49:06.710] [1mSTEP[0m: Building a namespace api object, basename volumemode I0625 04:49:06.710] [1mSTEP[0m: Waiting for a default service account to be provisioned in namespace I0625 04:49:06.711] [1mSTEP[0m: Waiting for kube-root-ca.crt to be provisioned in namespace I0625 04:49:06.711] [It] should fail to use a volume in a pod with mismatched mode [Slow] I0625 04:49:06.711] test/e2e/storage/testsuites/volumemode.go:299 I0625 04:49:06.711] Jun 25 04:49:06.698: INFO: Driver "csi-gcepd-sc-windows--no-volumesnapshotclass" does not provide raw block - skipping I0625 04:49:06.711] [AfterEach] [Testpattern: Dynamic PV (block volmode)] volumeMode I0625 04:49:06.711] test/e2e/framework/framework.go:187 I0625 04:49:06.712] Jun 25 04:49:06.699: INFO: Waiting up to 3m0s for all (but 2) nodes to be ready I0625 04:49:06.712] [1mSTEP[0m: Destroying namespace "volumemode-5463" for this suite. I0625 04:49:06.712] I0625 04:49:06.712] I0625 04:49:06.712] [36m[1mS [SKIPPING] [0.030 seconds][0m I0625 04:49:06.712] External Storage [Driver: csi-gcepd-sc-windows--no-volumesnapshotclass] I0625 04:49:06.713] [90mtest/e2e/storage/external/external.go:174[0m I0625 04:49:06.713] [Testpattern: Dynamic PV (block volmode)] volumeMode I0625 04:49:06.713] [90mtest/e2e/storage/framework/testsuite.go:50[0m I0625 04:49:06.713] [36m[1mshould fail to use a volume in a pod with mismatched mode [Slow] [It][0m I0625 04:49:06.713] [90mtest/e2e/storage/testsuites/volumemode.go:299[0m I0625 04:49:06.713] I0625 04:49:06.714] [36mDriver "csi-gcepd-sc-windows--no-volumesnapshotclass" does not provide raw block - skipping[0m I0625 04:49:06.714] I0625 04:49:06.714] test/e2e/storage/testsuites/volumes.go:114 I0625 04:49:06.714] [90m------------------------------[0m ... skipping 115 lines ... I0625 04:49:46.546] [90mtest/e2e/storage/external/external.go:174[0m I0625 04:49:46.546] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral I0625 04:49:46.546] [90mtest/e2e/storage/framework/testsuite.go:50[0m I0625 04:49:46.547] should create read/write inline ephemeral volume I0625 04:49:46.547] [90mtest/e2e/storage/testsuites/ephemeral.go:196[0m I0625 04:49:46.547] [90m------------------------------[0m I0625 04:49:46.547] {"msg":"PASSED External Storage [Driver: csi-gcepd-sc-windows--no-volumesnapshotclass] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should create read/write inline ephemeral volume","total":-1,"completed":5,"skipped":568,"failed":0} I0625 04:49:46.547] I0625 04:50:34.181] [36mS[0m[36mS[0m[36mS[0m I0625 04:50:34.182] [90m------------------------------[0m I0625 04:50:34.182] [BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath I0625 04:50:34.182] test/e2e/storage/framework/testsuite.go:51 I0625 04:50:34.182] [BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath ... skipping 92 lines ... I0625 04:50:34.198] [90mtest/e2e/storage/external/external.go:174[0m I0625 04:50:34.198] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath I0625 04:50:34.198] [90mtest/e2e/storage/framework/testsuite.go:50[0m I0625 04:50:34.198] should support restarting containers using directory as subpath [Slow] I0625 04:50:34.198] [90mtest/e2e/storage/testsuites/subpath.go:322[0m I0625 04:50:34.199] [90m------------------------------[0m I0625 04:50:34.199] {"msg":"PASSED External Storage [Driver: csi-gcepd-sc-windows--no-volumesnapshotclass] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support restarting containers using directory as subpath [Slow]","total":-1,"completed":7,"skipped":772,"failed":0} I0625 04:50:34.199] I0625 04:50:34.284] [36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m I0625 04:50:34.285] [90m------------------------------[0m I0625 04:50:34.285] [BeforeEach] [Testpattern: Pre-provisioned PV (ext4)] volumes I0625 04:50:34.285] test/e2e/storage/framework/testsuite.go:51 I0625 04:50:34.285] Jun 25 04:50:34.283: INFO: Driver "csi-gcepd-sc-windows--no-volumesnapshotclass" does not support volume type "PreprovisionedPV" - skipping ... skipping 549 lines ... I0625 04:52:02.769] [90mtest/e2e/storage/external/external.go:174[0m I0625 04:52:02.769] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] I0625 04:52:02.770] [90mtest/e2e/storage/framework/testsuite.go:50[0m I0625 04:52:02.770] should access to two volumes with the same volume mode and retain data across pod recreation on different node I0625 04:52:02.770] [90mtest/e2e/storage/testsuites/multivolume.go:168[0m I0625 04:52:02.770] [90m------------------------------[0m I0625 04:52:02.771] {"msg":"PASSED External Storage [Driver: csi-gcepd-sc-windows--no-volumesnapshotclass] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node","total":-1,"completed":8,"skipped":618,"failed":0} I0625 04:52:02.771] I0625 04:52:26.034] [36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m I0625 04:52:26.035] [90m------------------------------[0m I0625 04:52:26.035] [BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath I0625 04:52:26.035] test/e2e/storage/framework/testsuite.go:51 I0625 04:52:26.035] [BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath ... skipping 8 lines ... I0625 04:52:26.036] Jun 25 04:49:06.899: INFO: Creating resource for dynamic PV I0625 04:52:26.036] Jun 25 04:49:06.899: INFO: Using claimSize:5Gi, test suite supported size:{ 1Mi}, driver(csi-gcepd-sc-windows--no-volumesnapshotclass) supported size:{ 1Mi} I0625 04:52:26.036] [1mSTEP[0m: creating a StorageClass provisioning-8239-e2e-sclzqgh I0625 04:52:26.036] [1mSTEP[0m: creating a claim I0625 04:52:26.037] Jun 25 04:49:06.903: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil I0625 04:52:26.037] [1mSTEP[0m: Creating pod to format volume volume-prep-provisioning-8239 I0625 04:52:26.037] Jun 25 04:49:06.917: INFO: Waiting up to 5m0s for pod "volume-prep-provisioning-8239" in namespace "provisioning-8239" to be "Succeeded or Failed" I0625 04:52:26.037] Jun 25 04:49:06.922: INFO: Pod "volume-prep-provisioning-8239": Phase="Pending", Reason="", readiness=false. Elapsed: 4.944693ms I0625 04:52:26.037] Jun 25 04:49:08.926: INFO: Pod "volume-prep-provisioning-8239": Phase="Pending", Reason="", readiness=false. Elapsed: 2.008909696s I0625 04:52:26.037] Jun 25 04:49:10.927: INFO: Pod "volume-prep-provisioning-8239": Phase="Pending", Reason="", readiness=false. Elapsed: 4.009568494s I0625 04:52:26.037] Jun 25 04:49:12.926: INFO: Pod "volume-prep-provisioning-8239": Phase="Pending", Reason="", readiness=false. Elapsed: 6.009012871s I0625 04:52:26.038] Jun 25 04:49:14.926: INFO: Pod "volume-prep-provisioning-8239": Phase="Pending", Reason="", readiness=false. Elapsed: 8.008469091s I0625 04:52:26.038] Jun 25 04:49:16.927: INFO: Pod "volume-prep-provisioning-8239": Phase="Pending", Reason="", readiness=false. Elapsed: 10.009451895s ... skipping 21 lines ... I0625 04:52:26.041] Jun 25 04:50:00.927: INFO: Pod "volume-prep-provisioning-8239": Phase="Pending", Reason="", readiness=false. Elapsed: 54.009779837s I0625 04:52:26.041] Jun 25 04:50:02.928: INFO: Pod "volume-prep-provisioning-8239": Phase="Running", Reason="", readiness=true. Elapsed: 56.010940521s I0625 04:52:26.042] Jun 25 04:50:04.927: INFO: Pod "volume-prep-provisioning-8239": Phase="Running", Reason="", readiness=false. Elapsed: 58.009878523s I0625 04:52:26.042] Jun 25 04:50:06.927: INFO: Pod "volume-prep-provisioning-8239": Phase="Running", Reason="", readiness=false. Elapsed: 1m0.01009209s I0625 04:52:26.042] Jun 25 04:50:08.927: INFO: Pod "volume-prep-provisioning-8239": Phase="Succeeded", Reason="", readiness=false. Elapsed: 1m2.009369532s I0625 04:52:26.042] [1mSTEP[0m: Saw pod success I0625 04:52:26.042] Jun 25 04:50:08.927: INFO: Pod "volume-prep-provisioning-8239" satisfied condition "Succeeded or Failed" I0625 04:52:26.042] Jun 25 04:50:08.927: INFO: Deleting pod "volume-prep-provisioning-8239" in namespace "provisioning-8239" I0625 04:52:26.042] Jun 25 04:50:08.940: INFO: Wait up to 5m0s for pod "volume-prep-provisioning-8239" to be fully deleted I0625 04:52:26.042] [1mSTEP[0m: Creating pod pod-subpath-test-dynamicpv-6f6f I0625 04:52:26.043] [1mSTEP[0m: Checking for subpath error in container status I0625 04:52:26.043] Jun 25 04:51:48.960: INFO: Deleting pod "pod-subpath-test-dynamicpv-6f6f" in namespace "provisioning-8239" I0625 04:52:26.043] Jun 25 04:51:48.966: INFO: Wait up to 5m0s for pod "pod-subpath-test-dynamicpv-6f6f" to be fully deleted I0625 04:52:26.043] [1mSTEP[0m: Deleting pod I0625 04:52:26.043] Jun 25 04:51:50.973: INFO: Deleting pod "pod-subpath-test-dynamicpv-6f6f" in namespace "provisioning-8239" I0625 04:52:26.043] [1mSTEP[0m: Deleting pvc I0625 04:52:26.043] Jun 25 04:51:50.982: INFO: Deleting PersistentVolumeClaim "csi-gcepd-sc-windows--no-volumesnapshotclassd4dq4" ... skipping 18 lines ... I0625 04:52:26.046] [90mtest/e2e/storage/external/external.go:174[0m I0625 04:52:26.046] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath I0625 04:52:26.046] [90mtest/e2e/storage/framework/testsuite.go:50[0m I0625 04:52:26.046] should verify container cannot write to subpath readonly volumes [Slow] I0625 04:52:26.046] [90mtest/e2e/storage/testsuites/subpath.go:425[0m I0625 04:52:26.046] [90m------------------------------[0m I0625 04:52:26.046] {"msg":"PASSED External Storage [Driver: csi-gcepd-sc-windows--no-volumesnapshotclass] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should verify container cannot write to subpath readonly volumes [Slow]","total":-1,"completed":9,"skipped":1770,"failed":0} I0625 04:52:26.046] I0625 04:52:52.892] [36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m I0625 04:52:52.893] [90m------------------------------[0m I0625 04:52:52.893] [BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] I0625 04:52:52.893] test/e2e/storage/framework/testsuite.go:51 I0625 04:52:52.893] [BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] ... skipping 149 lines ... I0625 04:52:52.927] [90mtest/e2e/storage/external/external.go:174[0m I0625 04:52:52.927] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] I0625 04:52:52.927] [90mtest/e2e/storage/framework/testsuite.go:50[0m I0625 04:52:52.928] should concurrently access the single read-only volume from pods on the same node I0625 04:52:52.928] [90mtest/e2e/storage/testsuites/multivolume.go:423[0m I0625 04:52:52.928] [90m------------------------------[0m I0625 04:52:52.928] {"msg":"PASSED External Storage [Driver: csi-gcepd-sc-windows--no-volumesnapshotclass] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node","total":-1,"completed":6,"skipped":571,"failed":0} I0625 04:52:52.928] I0625 04:52:52.928] [36mS[0m[36mS[0m[36mS[0m I0625 04:52:52.928] [90m------------------------------[0m I0625 04:52:52.928] [BeforeEach] [Testpattern: Pre-provisioned Snapshot (delete policy)] snapshottable[Feature:VolumeSnapshotDataSource] I0625 04:52:52.928] test/e2e/storage/framework/testsuite.go:51 I0625 04:52:52.929] Jun 25 04:52:52.897: INFO: Driver "csi-gcepd-sc-windows--no-volumesnapshotclass" does not support snapshots - skipping ... skipping 97 lines ... I0625 04:52:56.274] Jun 25 04:50:35.115: INFO: Using claimSize:5Gi, test suite supported size:{ 1Mi}, driver(csi-gcepd-sc-windows--no-volumesnapshotclass) supported size:{ 1Mi} I0625 04:52:56.274] [1mSTEP[0m: creating a StorageClass provisioning-6760-e2e-sch59f7 I0625 04:52:56.274] [1mSTEP[0m: creating a claim I0625 04:52:56.274] Jun 25 04:50:35.119: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil I0625 04:52:56.274] [1mSTEP[0m: Creating pod pod-subpath-test-dynamicpv-6nl5 I0625 04:52:56.275] [1mSTEP[0m: Creating a pod to test subpath I0625 04:52:56.275] Jun 25 04:50:35.133: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-6nl5" in namespace "provisioning-6760" to be "Succeeded or Failed" I0625 04:52:56.275] Jun 25 04:50:35.136: INFO: Pod "pod-subpath-test-dynamicpv-6nl5": Phase="Pending", Reason="", readiness=false. Elapsed: 2.980854ms I0625 04:52:56.275] Jun 25 04:50:37.140: INFO: Pod "pod-subpath-test-dynamicpv-6nl5": Phase="Pending", Reason="", readiness=false. Elapsed: 2.007184389s I0625 04:52:56.276] Jun 25 04:50:39.140: INFO: Pod "pod-subpath-test-dynamicpv-6nl5": Phase="Pending", Reason="", readiness=false. Elapsed: 4.007536565s I0625 04:52:56.276] Jun 25 04:50:41.141: INFO: Pod "pod-subpath-test-dynamicpv-6nl5": Phase="Pending", Reason="", readiness=false. Elapsed: 6.008120734s I0625 04:52:56.276] Jun 25 04:50:43.140: INFO: Pod "pod-subpath-test-dynamicpv-6nl5": Phase="Pending", Reason="", readiness=false. Elapsed: 8.006902558s I0625 04:52:56.276] Jun 25 04:50:45.142: INFO: Pod "pod-subpath-test-dynamicpv-6nl5": Phase="Pending", Reason="", readiness=false. Elapsed: 10.009216146s ... skipping 43 lines ... I0625 04:52:56.283] Jun 25 04:52:13.141: INFO: Pod "pod-subpath-test-dynamicpv-6nl5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.008607112s I0625 04:52:56.284] Jun 25 04:52:15.142: INFO: Pod "pod-subpath-test-dynamicpv-6nl5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.00890409s I0625 04:52:56.284] Jun 25 04:52:17.141: INFO: Pod "pod-subpath-test-dynamicpv-6nl5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.008535281s I0625 04:52:56.284] Jun 25 04:52:19.142: INFO: Pod "pod-subpath-test-dynamicpv-6nl5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.00889169s I0625 04:52:56.284] Jun 25 04:52:21.140: INFO: Pod "pod-subpath-test-dynamicpv-6nl5": Phase="Succeeded", Reason="", readiness=false. Elapsed: 1m46.007241556s I0625 04:52:56.284] [1mSTEP[0m: Saw pod success I0625 04:52:56.284] Jun 25 04:52:21.140: INFO: Pod "pod-subpath-test-dynamicpv-6nl5" satisfied condition "Succeeded or Failed" I0625 04:52:56.285] Jun 25 04:52:21.143: INFO: Trying to get logs from node e2e-test-prow-windows-node-group-w48h pod pod-subpath-test-dynamicpv-6nl5 container test-container-subpath-dynamicpv-6nl5: <nil> I0625 04:52:56.285] [1mSTEP[0m: delete the pod I0625 04:52:56.285] Jun 25 04:52:21.207: INFO: Waiting for pod pod-subpath-test-dynamicpv-6nl5 to disappear I0625 04:52:56.285] Jun 25 04:52:21.210: INFO: Pod pod-subpath-test-dynamicpv-6nl5 no longer exists I0625 04:52:56.285] [1mSTEP[0m: Deleting pod pod-subpath-test-dynamicpv-6nl5 I0625 04:52:56.285] Jun 25 04:52:21.210: INFO: Deleting pod "pod-subpath-test-dynamicpv-6nl5" in namespace "provisioning-6760" ... skipping 22 lines ... I0625 04:52:56.288] [90mtest/e2e/storage/external/external.go:174[0m I0625 04:52:56.288] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath I0625 04:52:56.288] [90mtest/e2e/storage/framework/testsuite.go:50[0m I0625 04:52:56.288] should support readOnly directory specified in the volumeMount I0625 04:52:56.288] [90mtest/e2e/storage/testsuites/subpath.go:367[0m I0625 04:52:56.288] [90m------------------------------[0m I0625 04:52:56.289] {"msg":"PASSED External Storage [Driver: csi-gcepd-sc-windows--no-volumesnapshotclass] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support readOnly directory specified in the volumeMount","total":-1,"completed":8,"skipped":1665,"failed":0} I0625 04:52:56.289] I0625 04:52:56.289] [36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m I0625 04:52:56.289] [90m------------------------------[0m I0625 04:52:56.289] [BeforeEach] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] I0625 04:52:56.289] test/e2e/storage/framework/testsuite.go:51 I0625 04:52:56.289] Jun 25 04:52:56.286: INFO: Driver "csi-gcepd-sc-windows--no-volumesnapshotclass" does not support volume type "PreprovisionedPV" - skipping ... skipping 99 lines ... I0625 04:54:42.938] [90mtest/e2e/storage/external/external.go:174[0m I0625 04:54:42.939] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral I0625 04:54:42.939] [90mtest/e2e/storage/framework/testsuite.go:50[0m I0625 04:54:42.939] should create read-only inline ephemeral volume I0625 04:54:42.939] [90mtest/e2e/storage/testsuites/ephemeral.go:175[0m I0625 04:54:42.939] [90m------------------------------[0m I0625 04:54:42.939] {"msg":"PASSED External Storage [Driver: csi-gcepd-sc-windows--no-volumesnapshotclass] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should create read-only inline ephemeral volume","total":-1,"completed":7,"skipped":1063,"failed":0} I0625 04:54:42.939] I0625 04:54:45.055] [36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m I0625 04:54:45.055] [90m------------------------------[0m I0625 04:54:45.056] [BeforeEach] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral I0625 04:54:45.056] test/e2e/storage/framework/testsuite.go:51 I0625 04:54:45.056] [BeforeEach] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral ... skipping 69 lines ... I0625 04:55:13.320] Jun 25 04:52:26.088: INFO: Using claimSize:5Gi, test suite supported size:{ 1Mi}, driver(csi-gcepd-sc-windows--no-volumesnapshotclass) supported size:{ 1Mi} I0625 04:55:13.320] [1mSTEP[0m: creating a StorageClass provisioning-7581-e2e-scwjl64 I0625 04:55:13.320] [1mSTEP[0m: creating a claim I0625 04:55:13.320] Jun 25 04:52:26.092: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil I0625 04:55:13.320] [1mSTEP[0m: Creating pod pod-subpath-test-dynamicpv-wd86 I0625 04:55:13.320] [1mSTEP[0m: Creating a pod to test subpath I0625 04:55:13.320] Jun 25 04:52:26.106: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-wd86" in namespace "provisioning-7581" to be "Succeeded or Failed" I0625 04:55:13.321] Jun 25 04:52:26.111: INFO: Pod "pod-subpath-test-dynamicpv-wd86": Phase="Pending", Reason="", readiness=false. Elapsed: 4.506681ms I0625 04:55:13.321] Jun 25 04:52:28.116: INFO: Pod "pod-subpath-test-dynamicpv-wd86": Phase="Pending", Reason="", readiness=false. Elapsed: 2.010158422s I0625 04:55:13.321] Jun 25 04:52:30.115: INFO: Pod "pod-subpath-test-dynamicpv-wd86": Phase="Pending", Reason="", readiness=false. Elapsed: 4.008745616s I0625 04:55:13.321] Jun 25 04:52:32.115: INFO: Pod "pod-subpath-test-dynamicpv-wd86": Phase="Pending", Reason="", readiness=false. Elapsed: 6.009003011s I0625 04:55:13.321] Jun 25 04:52:34.114: INFO: Pod "pod-subpath-test-dynamicpv-wd86": Phase="Pending", Reason="", readiness=false. Elapsed: 8.008322381s I0625 04:55:13.321] Jun 25 04:52:36.115: INFO: Pod "pod-subpath-test-dynamicpv-wd86": Phase="Pending", Reason="", readiness=false. Elapsed: 10.008455951s ... skipping 30 lines ... I0625 04:55:13.327] Jun 25 04:53:38.115: INFO: Pod "pod-subpath-test-dynamicpv-wd86": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.008555003s I0625 04:55:13.327] Jun 25 04:53:40.117: INFO: Pod "pod-subpath-test-dynamicpv-wd86": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.010639298s I0625 04:55:13.328] Jun 25 04:53:42.115: INFO: Pod "pod-subpath-test-dynamicpv-wd86": Phase="Running", Reason="", readiness=true. Elapsed: 1m16.009062466s I0625 04:55:13.328] Jun 25 04:53:44.116: INFO: Pod "pod-subpath-test-dynamicpv-wd86": Phase="Running", Reason="", readiness=false. Elapsed: 1m18.010138416s I0625 04:55:13.328] Jun 25 04:53:46.118: INFO: Pod "pod-subpath-test-dynamicpv-wd86": Phase="Succeeded", Reason="", readiness=false. Elapsed: 1m20.011792249s I0625 04:55:13.328] [1mSTEP[0m: Saw pod success I0625 04:55:13.329] Jun 25 04:53:46.118: INFO: Pod "pod-subpath-test-dynamicpv-wd86" satisfied condition "Succeeded or Failed" I0625 04:55:13.329] Jun 25 04:53:46.121: INFO: Trying to get logs from node e2e-test-prow-windows-node-group-rn0p pod pod-subpath-test-dynamicpv-wd86 container test-container-subpath-dynamicpv-wd86: <nil> I0625 04:55:13.329] [1mSTEP[0m: delete the pod I0625 04:55:13.329] Jun 25 04:53:46.175: INFO: Waiting for pod pod-subpath-test-dynamicpv-wd86 to disappear I0625 04:55:13.329] Jun 25 04:53:46.178: INFO: Pod pod-subpath-test-dynamicpv-wd86 no longer exists I0625 04:55:13.330] [1mSTEP[0m: Deleting pod pod-subpath-test-dynamicpv-wd86 I0625 04:55:13.330] Jun 25 04:53:46.178: INFO: Deleting pod "pod-subpath-test-dynamicpv-wd86" in namespace "provisioning-7581" I0625 04:55:13.330] [1mSTEP[0m: Creating pod pod-subpath-test-dynamicpv-wd86 I0625 04:55:13.330] [1mSTEP[0m: Creating a pod to test subpath I0625 04:55:13.331] Jun 25 04:53:46.192: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-wd86" in namespace "provisioning-7581" to be "Succeeded or Failed" I0625 04:55:13.331] Jun 25 04:53:46.196: INFO: Pod "pod-subpath-test-dynamicpv-wd86": Phase="Pending", Reason="", readiness=false. Elapsed: 3.761799ms I0625 04:55:13.331] Jun 25 04:53:48.200: INFO: Pod "pod-subpath-test-dynamicpv-wd86": Phase="Pending", Reason="", readiness=false. Elapsed: 2.007991833s I0625 04:55:13.331] Jun 25 04:53:50.200: INFO: Pod "pod-subpath-test-dynamicpv-wd86": Phase="Pending", Reason="", readiness=false. Elapsed: 4.007834048s I0625 04:55:13.332] Jun 25 04:53:52.201: INFO: Pod "pod-subpath-test-dynamicpv-wd86": Phase="Pending", Reason="", readiness=false. Elapsed: 6.008891669s I0625 04:55:13.332] Jun 25 04:53:54.199: INFO: Pod "pod-subpath-test-dynamicpv-wd86": Phase="Pending", Reason="", readiness=false. Elapsed: 8.007533594s I0625 04:55:13.332] Jun 25 04:53:56.200: INFO: Pod "pod-subpath-test-dynamicpv-wd86": Phase="Pending", Reason="", readiness=false. Elapsed: 10.008643765s ... skipping 16 lines ... I0625 04:55:13.337] Jun 25 04:54:30.200: INFO: Pod "pod-subpath-test-dynamicpv-wd86": Phase="Pending", Reason="", readiness=false. Elapsed: 44.008266477s I0625 04:55:13.337] Jun 25 04:54:32.201: INFO: Pod "pod-subpath-test-dynamicpv-wd86": Phase="Running", Reason="", readiness=true. Elapsed: 46.008790777s I0625 04:55:13.337] Jun 25 04:54:34.202: INFO: Pod "pod-subpath-test-dynamicpv-wd86": Phase="Running", Reason="", readiness=true. Elapsed: 48.009931163s I0625 04:55:13.338] Jun 25 04:54:36.200: INFO: Pod "pod-subpath-test-dynamicpv-wd86": Phase="Running", Reason="", readiness=false. Elapsed: 50.008172727s I0625 04:55:13.338] Jun 25 04:54:38.201: INFO: Pod "pod-subpath-test-dynamicpv-wd86": Phase="Succeeded", Reason="", readiness=false. Elapsed: 52.009448087s I0625 04:55:13.338] [1mSTEP[0m: Saw pod success I0625 04:55:13.338] Jun 25 04:54:38.201: INFO: Pod "pod-subpath-test-dynamicpv-wd86" satisfied condition "Succeeded or Failed" I0625 04:55:13.339] Jun 25 04:54:38.204: INFO: Trying to get logs from node e2e-test-prow-windows-node-group-rn0p pod pod-subpath-test-dynamicpv-wd86 container test-container-subpath-dynamicpv-wd86: <nil> I0625 04:55:13.339] [1mSTEP[0m: delete the pod I0625 04:55:13.339] Jun 25 04:54:38.229: INFO: Waiting for pod pod-subpath-test-dynamicpv-wd86 to disappear I0625 04:55:13.339] Jun 25 04:54:38.232: INFO: Pod pod-subpath-test-dynamicpv-wd86 no longer exists I0625 04:55:13.339] [1mSTEP[0m: Deleting pod pod-subpath-test-dynamicpv-wd86 I0625 04:55:13.340] Jun 25 04:54:38.232: INFO: Deleting pod "pod-subpath-test-dynamicpv-wd86" in namespace "provisioning-7581" ... skipping 22 lines ... I0625 04:55:13.344] [90mtest/e2e/storage/external/external.go:174[0m I0625 04:55:13.344] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath I0625 04:55:13.344] [90mtest/e2e/storage/framework/testsuite.go:50[0m I0625 04:55:13.345] should support existing directories when readOnly specified in the volumeSource I0625 04:55:13.345] [90mtest/e2e/storage/testsuites/subpath.go:397[0m I0625 04:55:13.345] [90m------------------------------[0m I0625 04:55:13.345] {"msg":"PASSED External Storage [Driver: csi-gcepd-sc-windows--no-volumesnapshotclass] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support existing directories when readOnly specified in the volumeSource","total":-1,"completed":10,"skipped":1798,"failed":0} I0625 04:55:13.346] I0625 04:55:18.289] [36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m I0625 04:55:18.290] [90m------------------------------[0m I0625 04:55:18.290] [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath I0625 04:55:18.290] test/e2e/storage/framework/testsuite.go:51 I0625 04:55:18.290] [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath ... skipping 9 lines ... I0625 04:55:18.292] Jun 25 04:52:02.762: INFO: Using claimSize:5Gi, test suite supported size:{ 1Mi}, driver(csi-gcepd-sc-windows--no-volumesnapshotclass) supported size:{ 1Mi} I0625 04:55:18.292] [1mSTEP[0m: creating a StorageClass provisioning-5725-e2e-sc4x72t I0625 04:55:18.293] [1mSTEP[0m: creating a claim I0625 04:55:18.293] Jun 25 04:52:02.766: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil I0625 04:55:18.293] [1mSTEP[0m: Creating pod pod-subpath-test-dynamicpv-twm8 I0625 04:55:18.293] [1mSTEP[0m: Creating a pod to test subpath I0625 04:55:18.293] Jun 25 04:52:02.780: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-twm8" in namespace "provisioning-5725" to be "Succeeded or Failed" I0625 04:55:18.294] Jun 25 04:52:02.785: INFO: Pod "pod-subpath-test-dynamicpv-twm8": Phase="Pending", Reason="", readiness=false. Elapsed: 4.582966ms I0625 04:55:18.294] Jun 25 04:52:04.789: INFO: Pod "pod-subpath-test-dynamicpv-twm8": Phase="Pending", Reason="", readiness=false. Elapsed: 2.008788269s I0625 04:55:18.294] Jun 25 04:52:06.791: INFO: Pod "pod-subpath-test-dynamicpv-twm8": Phase="Pending", Reason="", readiness=false. Elapsed: 4.010298423s I0625 04:55:18.295] Jun 25 04:52:08.791: INFO: Pod "pod-subpath-test-dynamicpv-twm8": Phase="Pending", Reason="", readiness=false. Elapsed: 6.010777229s I0625 04:55:18.295] Jun 25 04:52:10.790: INFO: Pod "pod-subpath-test-dynamicpv-twm8": Phase="Pending", Reason="", readiness=false. Elapsed: 8.009643384s I0625 04:55:18.295] Jun 25 04:52:12.789: INFO: Pod "pod-subpath-test-dynamicpv-twm8": Phase="Pending", Reason="", readiness=false. Elapsed: 10.008876881s ... skipping 33 lines ... I0625 04:55:18.305] Jun 25 04:53:20.789: INFO: Pod "pod-subpath-test-dynamicpv-twm8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.008906485s I0625 04:55:18.305] Jun 25 04:53:22.790: INFO: Pod "pod-subpath-test-dynamicpv-twm8": Phase="Running", Reason="", readiness=true. Elapsed: 1m20.009371754s I0625 04:55:18.305] Jun 25 04:53:24.790: INFO: Pod "pod-subpath-test-dynamicpv-twm8": Phase="Running", Reason="", readiness=false. Elapsed: 1m22.009678246s I0625 04:55:18.306] Jun 25 04:53:26.789: INFO: Pod "pod-subpath-test-dynamicpv-twm8": Phase="Running", Reason="", readiness=false. Elapsed: 1m24.008417656s I0625 04:55:18.306] Jun 25 04:53:28.791: INFO: Pod "pod-subpath-test-dynamicpv-twm8": Phase="Succeeded", Reason="", readiness=false. Elapsed: 1m26.010819186s I0625 04:55:18.306] [1mSTEP[0m: Saw pod success I0625 04:55:18.306] Jun 25 04:53:28.791: INFO: Pod "pod-subpath-test-dynamicpv-twm8" satisfied condition "Succeeded or Failed" I0625 04:55:18.307] Jun 25 04:53:28.794: INFO: Trying to get logs from node e2e-test-prow-windows-node-group-qhph pod pod-subpath-test-dynamicpv-twm8 container test-container-subpath-dynamicpv-twm8: <nil> I0625 04:55:18.307] [1mSTEP[0m: delete the pod I0625 04:55:18.307] Jun 25 04:53:29.160: INFO: Waiting for pod pod-subpath-test-dynamicpv-twm8 to disappear I0625 04:55:18.307] Jun 25 04:53:29.162: INFO: Pod pod-subpath-test-dynamicpv-twm8 no longer exists I0625 04:55:18.307] [1mSTEP[0m: Deleting pod pod-subpath-test-dynamicpv-twm8 I0625 04:55:18.308] Jun 25 04:53:29.163: INFO: Deleting pod "pod-subpath-test-dynamicpv-twm8" in namespace "provisioning-5725" I0625 04:55:18.308] [1mSTEP[0m: Creating pod pod-subpath-test-dynamicpv-twm8 I0625 04:55:18.308] [1mSTEP[0m: Creating a pod to test subpath I0625 04:55:18.308] Jun 25 04:53:29.175: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-twm8" in namespace "provisioning-5725" to be "Succeeded or Failed" I0625 04:55:18.309] Jun 25 04:53:29.179: INFO: Pod "pod-subpath-test-dynamicpv-twm8": Phase="Pending", Reason="", readiness=false. Elapsed: 3.316004ms I0625 04:55:18.309] Jun 25 04:53:31.183: INFO: Pod "pod-subpath-test-dynamicpv-twm8": Phase="Pending", Reason="", readiness=false. Elapsed: 2.007577089s I0625 04:55:18.309] Jun 25 04:53:33.184: INFO: Pod "pod-subpath-test-dynamicpv-twm8": Phase="Pending", Reason="", readiness=false. Elapsed: 4.008541541s I0625 04:55:18.309] Jun 25 04:53:35.184: INFO: Pod "pod-subpath-test-dynamicpv-twm8": Phase="Pending", Reason="", readiness=false. Elapsed: 6.008469332s I0625 04:55:18.310] Jun 25 04:53:37.183: INFO: Pod "pod-subpath-test-dynamicpv-twm8": Phase="Pending", Reason="", readiness=false. Elapsed: 8.007687651s I0625 04:55:18.310] Jun 25 04:53:39.183: INFO: Pod "pod-subpath-test-dynamicpv-twm8": Phase="Pending", Reason="", readiness=false. Elapsed: 10.007155919s ... skipping 27 lines ... I0625 04:55:18.318] Jun 25 04:54:35.183: INFO: Pod "pod-subpath-test-dynamicpv-twm8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.007352273s I0625 04:55:18.318] Jun 25 04:54:37.183: INFO: Pod "pod-subpath-test-dynamicpv-twm8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.007295837s I0625 04:55:18.318] Jun 25 04:54:39.183: INFO: Pod "pod-subpath-test-dynamicpv-twm8": Phase="Running", Reason="", readiness=true. Elapsed: 1m10.007438272s I0625 04:55:18.318] Jun 25 04:54:41.182: INFO: Pod "pod-subpath-test-dynamicpv-twm8": Phase="Running", Reason="", readiness=false. Elapsed: 1m12.006944662s I0625 04:55:18.318] Jun 25 04:54:43.183: INFO: Pod "pod-subpath-test-dynamicpv-twm8": Phase="Succeeded", Reason="", readiness=false. Elapsed: 1m14.007071331s I0625 04:55:18.319] [1mSTEP[0m: Saw pod success I0625 04:55:18.319] Jun 25 04:54:43.183: INFO: Pod "pod-subpath-test-dynamicpv-twm8" satisfied condition "Succeeded or Failed" I0625 04:55:18.319] Jun 25 04:54:43.186: INFO: Trying to get logs from node e2e-test-prow-windows-node-group-w48h pod pod-subpath-test-dynamicpv-twm8 container test-container-subpath-dynamicpv-twm8: <nil> I0625 04:55:18.319] [1mSTEP[0m: delete the pod I0625 04:55:18.320] Jun 25 04:54:43.206: INFO: Waiting for pod pod-subpath-test-dynamicpv-twm8 to disappear I0625 04:55:18.320] Jun 25 04:54:43.209: INFO: Pod pod-subpath-test-dynamicpv-twm8 no longer exists I0625 04:55:18.320] [1mSTEP[0m: Deleting pod pod-subpath-test-dynamicpv-twm8 I0625 04:55:18.320] Jun 25 04:54:43.209: INFO: Deleting pod "pod-subpath-test-dynamicpv-twm8" in namespace "provisioning-5725" ... skipping 22 lines ... I0625 04:55:18.324] [90mtest/e2e/storage/external/external.go:174[0m I0625 04:55:18.324] [Testpattern: Dynamic PV (default fs)] subPath I0625 04:55:18.324] [90mtest/e2e/storage/framework/testsuite.go:50[0m I0625 04:55:18.324] should support existing directories when readOnly specified in the volumeSource I0625 04:55:18.324] [90mtest/e2e/storage/testsuites/subpath.go:397[0m I0625 04:55:18.324] [90m------------------------------[0m I0625 04:55:18.325] {"msg":"PASSED External Storage [Driver: csi-gcepd-sc-windows--no-volumesnapshotclass] [Testpattern: Dynamic PV (default fs)] subPath should support existing directories when readOnly specified in the volumeSource","total":-1,"completed":9,"skipped":645,"failed":0} I0625 04:55:18.325] I0625 04:55:18.327] [36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m I0625 04:55:18.327] [90m------------------------------[0m I0625 04:55:18.327] [BeforeEach] [Testpattern: Dynamic Snapshot (retain policy)] snapshottable[Feature:VolumeSnapshotDataSource] I0625 04:55:18.327] test/e2e/storage/framework/testsuite.go:51 I0625 04:55:18.327] Jun 25 04:55:18.325: INFO: Driver "csi-gcepd-sc-windows--no-volumesnapshotclass" does not support snapshots - skipping ... skipping 325 lines ... I0625 04:56:55.368] [90mtest/e2e/storage/external/external.go:174[0m I0625 04:56:55.368] [Testpattern: Dynamic PV (default fs)] provisioning I0625 04:56:55.368] [90mtest/e2e/storage/framework/testsuite.go:50[0m I0625 04:56:55.368] should provision storage with pvc data source I0625 04:56:55.368] [90mtest/e2e/storage/testsuites/provisioning.go:428[0m I0625 04:56:55.369] [90m------------------------------[0m I0625 04:56:55.369] {"msg":"PASSED External Storage [Driver: csi-gcepd-sc-windows--no-volumesnapshotclass] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with pvc data source","total":-1,"completed":9,"skipped":1715,"failed":0} I0625 04:56:55.369] I0625 04:56:55.370] [36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m I0625 04:56:55.370] [90m------------------------------[0m I0625 04:56:55.370] [BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath I0625 04:56:55.370] test/e2e/storage/framework/testsuite.go:51 I0625 04:56:55.370] Jun 25 04:56:55.363: INFO: Driver "csi-gcepd-sc-windows--no-volumesnapshotclass" does not support volume type "PreprovisionedPV" - skipping ... skipping 127 lines ... I0625 04:57:03.658] Jun 25 04:55:18.507: INFO: Using claimSize:5Gi, test suite supported size:{ 1Mi}, driver(csi-gcepd-sc-windows--no-volumesnapshotclass) supported size:{ 1Mi} I0625 04:57:03.658] [1mSTEP[0m: creating a StorageClass provisioning-6499-e2e-sczqgrb I0625 04:57:03.658] [1mSTEP[0m: creating a claim I0625 04:57:03.658] Jun 25 04:55:18.512: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil I0625 04:57:03.658] [1mSTEP[0m: Creating pod pod-subpath-test-dynamicpv-zmtz I0625 04:57:03.658] [1mSTEP[0m: Creating a pod to test subpath I0625 04:57:03.659] Jun 25 04:55:18.533: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-zmtz" in namespace "provisioning-6499" to be "Succeeded or Failed" I0625 04:57:03.659] Jun 25 04:55:18.540: INFO: Pod "pod-subpath-test-dynamicpv-zmtz": Phase="Pending", Reason="", readiness=false. Elapsed: 7.16573ms I0625 04:57:03.659] Jun 25 04:55:20.544: INFO: Pod "pod-subpath-test-dynamicpv-zmtz": Phase="Pending", Reason="", readiness=false. Elapsed: 2.010845283s I0625 04:57:03.659] Jun 25 04:55:22.544: INFO: Pod "pod-subpath-test-dynamicpv-zmtz": Phase="Pending", Reason="", readiness=false. Elapsed: 4.010903527s I0625 04:57:03.659] Jun 25 04:55:24.544: INFO: Pod "pod-subpath-test-dynamicpv-zmtz": Phase="Pending", Reason="", readiness=false. Elapsed: 6.011071176s I0625 04:57:03.660] Jun 25 04:55:26.544: INFO: Pod "pod-subpath-test-dynamicpv-zmtz": Phase="Pending", Reason="", readiness=false. Elapsed: 8.011421543s I0625 04:57:03.660] Jun 25 04:55:28.545: INFO: Pod "pod-subpath-test-dynamicpv-zmtz": Phase="Pending", Reason="", readiness=false. Elapsed: 10.011926309s ... skipping 25 lines ... I0625 04:57:03.667] Jun 25 04:56:20.544: INFO: Pod "pod-subpath-test-dynamicpv-zmtz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.011071322s I0625 04:57:03.667] Jun 25 04:56:22.544: INFO: Pod "pod-subpath-test-dynamicpv-zmtz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.011090576s I0625 04:57:03.667] Jun 25 04:56:24.543: INFO: Pod "pod-subpath-test-dynamicpv-zmtz": Phase="Running", Reason="", readiness=true. Elapsed: 1m6.010804835s I0625 04:57:03.668] Jun 25 04:56:26.544: INFO: Pod "pod-subpath-test-dynamicpv-zmtz": Phase="Running", Reason="", readiness=false. Elapsed: 1m8.011240614s I0625 04:57:03.668] Jun 25 04:56:28.545: INFO: Pod "pod-subpath-test-dynamicpv-zmtz": Phase="Succeeded", Reason="", readiness=false. Elapsed: 1m10.011959912s I0625 04:57:03.668] [1mSTEP[0m: Saw pod success I0625 04:57:03.668] Jun 25 04:56:28.545: INFO: Pod "pod-subpath-test-dynamicpv-zmtz" satisfied condition "Succeeded or Failed" I0625 04:57:03.669] Jun 25 04:56:28.548: INFO: Trying to get logs from node e2e-test-prow-windows-node-group-qhph pod pod-subpath-test-dynamicpv-zmtz container test-container-subpath-dynamicpv-zmtz: <nil> I0625 04:57:03.669] [1mSTEP[0m: delete the pod I0625 04:57:03.669] Jun 25 04:56:28.581: INFO: Waiting for pod pod-subpath-test-dynamicpv-zmtz to disappear I0625 04:57:03.669] Jun 25 04:56:28.584: INFO: Pod pod-subpath-test-dynamicpv-zmtz no longer exists I0625 04:57:03.669] [1mSTEP[0m: Deleting pod pod-subpath-test-dynamicpv-zmtz I0625 04:57:03.669] Jun 25 04:56:28.584: INFO: Deleting pod "pod-subpath-test-dynamicpv-zmtz" in namespace "provisioning-6499" ... skipping 22 lines ... I0625 04:57:03.674] [90mtest/e2e/storage/external/external.go:174[0m I0625 04:57:03.674] [Testpattern: Dynamic PV (default fs)] subPath I0625 04:57:03.674] [90mtest/e2e/storage/framework/testsuite.go:50[0m I0625 04:57:03.674] should support readOnly directory specified in the volumeMount I0625 04:57:03.675] [90mtest/e2e/storage/testsuites/subpath.go:367[0m I0625 04:57:03.675] [90m------------------------------[0m I0625 04:57:03.675] {"msg":"PASSED External Storage [Driver: csi-gcepd-sc-windows--no-volumesnapshotclass] [Testpattern: Dynamic PV (default fs)] subPath should support readOnly directory specified in the volumeMount","total":-1,"completed":10,"skipped":819,"failed":0} I0625 04:57:03.675] I0625 04:57:03.733] [36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m I0625 04:57:03.733] [90m------------------------------[0m I0625 04:57:03.734] [BeforeEach] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] I0625 04:57:03.734] test/e2e/storage/framework/testsuite.go:51 I0625 04:57:03.734] Jun 25 04:57:03.732: INFO: Driver csi-gcepd-sc-windows--no-volumesnapshotclass doesn't support Block -- skipping ... skipping 219 lines ... I0625 04:58:24.746] [90mtest/e2e/storage/external/external.go:174[0m I0625 04:58:24.746] [Testpattern: Dynamic PV (delayed binding)] topology I0625 04:58:24.746] [90mtest/e2e/storage/framework/testsuite.go:50[0m I0625 04:58:24.746] should provision a volume and schedule a pod with AllowedTopologies I0625 04:58:24.746] [90mtest/e2e/storage/testsuites/topology.go:166[0m I0625 04:58:24.746] [90m------------------------------[0m I0625 04:58:24.747] {"msg":"PASSED External Storage [Driver: csi-gcepd-sc-windows--no-volumesnapshotclass] [Testpattern: Dynamic PV (delayed binding)] topology should provision a volume and schedule a pod with AllowedTopologies","total":-1,"completed":10,"skipped":1944,"failed":0} I0625 04:58:24.747] I0625 04:58:40.920] [36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m I0625 04:58:40.920] [90m------------------------------[0m I0625 04:58:40.920] [BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] I0625 04:58:40.920] test/e2e/storage/framework/testsuite.go:51 I0625 04:58:40.920] [BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] ... skipping 255 lines ... I0625 04:58:40.968] [90mtest/e2e/storage/external/external.go:174[0m I0625 04:58:40.968] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] I0625 04:58:40.968] [90mtest/e2e/storage/framework/testsuite.go:50[0m I0625 04:58:40.969] should access to two volumes with different volume mode and retain data across pod recreation on the same node I0625 04:58:40.969] [90mtest/e2e/storage/testsuites/multivolume.go:209[0m I0625 04:58:40.969] [90m------------------------------[0m I0625 04:58:40.969] {"msg":"PASSED External Storage [Driver: csi-gcepd-sc-windows--no-volumesnapshotclass] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node","total":-1,"completed":11,"skipped":1833,"failed":0} I0625 04:58:40.969] I0625 04:58:56.388] [36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m I0625 04:58:56.389] [90m------------------------------[0m I0625 04:58:56.389] [BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning I0625 04:58:56.389] test/e2e/storage/framework/testsuite.go:51 I0625 04:58:56.389] [BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning ... skipping 161 lines ... I0625 04:58:56.424] [90mtest/e2e/storage/external/external.go:174[0m I0625 04:58:56.425] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning I0625 04:58:56.425] [90mtest/e2e/storage/framework/testsuite.go:50[0m I0625 04:58:56.425] should mount multiple PV pointing to the same storage on the same node I0625 04:58:56.425] [90mtest/e2e/storage/testsuites/provisioning.go:525[0m I0625 04:58:56.425] [90m------------------------------[0m I0625 04:58:56.425] {"msg":"PASSED External Storage [Driver: csi-gcepd-sc-windows--no-volumesnapshotclass] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning should mount multiple PV pointing to the same storage on the same node","total":-1,"completed":8,"skipped":1174,"failed":0} I0625 04:58:56.425] I0625 04:58:56.460] [36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m I0625 04:58:56.461] [90m------------------------------[0m I0625 04:58:56.461] [BeforeEach] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] I0625 04:58:56.461] test/e2e/storage/framework/testsuite.go:51 I0625 04:58:56.461] [BeforeEach] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] ... skipping 41 lines ... I0625 05:00:44.252] Jun 25 04:58:41.017: INFO: Using claimSize:5Gi, test suite supported size:{ 1Mi}, driver(csi-gcepd-sc-windows--no-volumesnapshotclass) supported size:{ 1Mi} I0625 05:00:44.253] [1mSTEP[0m: creating a StorageClass provisioning-7645-e2e-scq27np I0625 05:00:44.253] [1mSTEP[0m: creating a claim I0625 05:00:44.253] Jun 25 04:58:41.025: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil I0625 05:00:44.253] [1mSTEP[0m: Creating pod pod-subpath-test-dynamicpv-tvr8 I0625 05:00:44.254] [1mSTEP[0m: Creating a pod to test subpath I0625 05:00:44.254] Jun 25 04:58:41.044: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-tvr8" in namespace "provisioning-7645" to be "Succeeded or Failed" I0625 05:00:44.254] Jun 25 04:58:41.048: INFO: Pod "pod-subpath-test-dynamicpv-tvr8": Phase="Pending", Reason="", readiness=false. Elapsed: 3.902527ms I0625 05:00:44.254] Jun 25 04:58:43.052: INFO: Pod "pod-subpath-test-dynamicpv-tvr8": Phase="Pending", Reason="", readiness=false. Elapsed: 2.007759416s I0625 05:00:44.254] Jun 25 04:58:45.052: INFO: Pod "pod-subpath-test-dynamicpv-tvr8": Phase="Pending", Reason="", readiness=false. Elapsed: 4.007745054s I0625 05:00:44.255] Jun 25 04:58:47.053: INFO: Pod "pod-subpath-test-dynamicpv-tvr8": Phase="Pending", Reason="", readiness=false. Elapsed: 6.00847493s I0625 05:00:44.255] Jun 25 04:58:49.056: INFO: Pod "pod-subpath-test-dynamicpv-tvr8": Phase="Pending", Reason="", readiness=false. Elapsed: 8.012065229s I0625 05:00:44.255] Jun 25 04:58:51.053: INFO: Pod "pod-subpath-test-dynamicpv-tvr8": Phase="Pending", Reason="", readiness=false. Elapsed: 10.009082568s ... skipping 34 lines ... I0625 05:00:44.263] Jun 25 05:00:01.053: INFO: Pod "pod-subpath-test-dynamicpv-tvr8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.008540328s I0625 05:00:44.263] Jun 25 05:00:03.053: INFO: Pod "pod-subpath-test-dynamicpv-tvr8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.009380142s I0625 05:00:44.264] Jun 25 05:00:05.053: INFO: Pod "pod-subpath-test-dynamicpv-tvr8": Phase="Running", Reason="", readiness=false. Elapsed: 1m24.008750608s I0625 05:00:44.264] Jun 25 05:00:07.052: INFO: Pod "pod-subpath-test-dynamicpv-tvr8": Phase="Running", Reason="", readiness=false. Elapsed: 1m26.00787279s I0625 05:00:44.264] Jun 25 05:00:09.052: INFO: Pod "pod-subpath-test-dynamicpv-tvr8": Phase="Succeeded", Reason="", readiness=false. Elapsed: 1m28.007785528s I0625 05:00:44.264] [1mSTEP[0m: Saw pod success I0625 05:00:44.264] Jun 25 05:00:09.052: INFO: Pod "pod-subpath-test-dynamicpv-tvr8" satisfied condition "Succeeded or Failed" I0625 05:00:44.265] Jun 25 05:00:09.055: INFO: Trying to get logs from node e2e-test-prow-windows-node-group-w48h pod pod-subpath-test-dynamicpv-tvr8 container test-container-volume-dynamicpv-tvr8: <nil> I0625 05:00:44.265] [1mSTEP[0m: delete the pod I0625 05:00:44.265] Jun 25 05:00:09.178: INFO: Waiting for pod pod-subpath-test-dynamicpv-tvr8 to disappear I0625 05:00:44.265] Jun 25 05:00:09.181: INFO: Pod pod-subpath-test-dynamicpv-tvr8 no longer exists I0625 05:00:44.266] [1mSTEP[0m: Deleting pod pod-subpath-test-dynamicpv-tvr8 I0625 05:00:44.266] Jun 25 05:00:09.181: INFO: Deleting pod "pod-subpath-test-dynamicpv-tvr8" in namespace "provisioning-7645" ... skipping 22 lines ... I0625 05:00:44.270] [90mtest/e2e/storage/external/external.go:174[0m I0625 05:00:44.270] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath I0625 05:00:44.271] [90mtest/e2e/storage/framework/testsuite.go:50[0m I0625 05:00:44.271] should support non-existent path I0625 05:00:44.271] [90mtest/e2e/storage/testsuites/subpath.go:196[0m I0625 05:00:44.271] [90m------------------------------[0m I0625 05:00:44.271] {"msg":"PASSED External Storage [Driver: csi-gcepd-sc-windows--no-volumesnapshotclass] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support non-existent path","total":-1,"completed":12,"skipped":1895,"failed":0} I0625 05:00:44.271] I0625 05:00:44.278] [36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m I0625 05:00:44.278] [90m------------------------------[0m I0625 05:00:44.278] [BeforeEach] [Testpattern: Pre-provisioned Snapshot (delete policy)] snapshottable[Feature:VolumeSnapshotDataSource] I0625 05:00:44.278] test/e2e/storage/framework/testsuite.go:51 I0625 05:00:44.278] Jun 25 05:00:44.276: INFO: Driver "csi-gcepd-sc-windows--no-volumesnapshotclass" does not support snapshots - skipping ... skipping 232 lines ... I0625 05:00:44.814] I0625 05:00:44.814] [36m[1mS [SKIPPING] in Spec Setup (BeforeEach) [0.001 seconds][0m I0625 05:00:44.814] External Storage [Driver: csi-gcepd-sc-windows--no-volumesnapshotclass] I0625 05:00:44.814] [90mtest/e2e/storage/external/external.go:174[0m I0625 05:00:44.815] [Testpattern: Pre-provisioned PV (block volmode)] volumeMode I0625 05:00:44.815] [90mtest/e2e/storage/framework/testsuite.go:50[0m I0625 05:00:44.815] [36m[1mshould fail to use a volume in a pod with mismatched mode [Slow] [BeforeEach][0m I0625 05:00:44.815] [90mtest/e2e/storage/testsuites/volumemode.go:299[0m I0625 05:00:44.815] I0625 05:00:44.816] [36mDriver "csi-gcepd-sc-windows--no-volumesnapshotclass" does not support volume type "PreprovisionedPV" - skipping[0m I0625 05:00:44.816] I0625 05:00:44.816] test/e2e/storage/external/external.go:269 I0625 05:00:44.816] [90m------------------------------[0m ... skipping 111 lines ... I0625 05:00:46.396] [90mtest/e2e/storage/external/external.go:174[0m I0625 05:00:46.397] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral I0625 05:00:46.397] [90mtest/e2e/storage/framework/testsuite.go:50[0m I0625 05:00:46.397] should create read/write inline ephemeral volume I0625 05:00:46.397] [90mtest/e2e/storage/testsuites/ephemeral.go:196[0m I0625 05:00:46.397] [90m------------------------------[0m I0625 05:00:46.398] {"msg":"PASSED External Storage [Driver: csi-gcepd-sc-windows--no-volumesnapshotclass] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should create read/write inline ephemeral volume","total":-1,"completed":11,"skipped":2038,"failed":0} I0625 05:00:46.398] I0625 05:00:46.425] [36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m I0625 05:00:46.425] [90m------------------------------[0m I0625 05:00:46.425] [BeforeEach] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] I0625 05:00:46.425] test/e2e/storage/framework/testsuite.go:51 I0625 05:00:46.426] Jun 25 05:00:46.423: INFO: Driver "csi-gcepd-sc-windows--no-volumesnapshotclass" does not support volume type "PreprovisionedPV" - skipping ... skipping 68 lines ... I0625 05:00:53.226] Jun 25 04:58:08.004: INFO: Pod "pod-0b5758d6-d1c2-4a1a-afe8-ec4e62cf9b83": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.0071765s I0625 05:00:53.227] Jun 25 04:58:10.004: INFO: Pod "pod-0b5758d6-d1c2-4a1a-afe8-ec4e62cf9b83": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.006479226s I0625 05:00:53.227] Jun 25 04:58:12.004: INFO: Pod "pod-0b5758d6-d1c2-4a1a-afe8-ec4e62cf9b83": Phase="Running", Reason="", readiness=true. Elapsed: 1m8.006524753s I0625 05:00:53.227] Jun 25 04:58:12.004: INFO: Pod "pod-0b5758d6-d1c2-4a1a-afe8-ec4e62cf9b83" satisfied condition "running" I0625 05:00:53.228] [1mSTEP[0m: Deleting pod pod-0b5758d6-d1c2-4a1a-afe8-ec4e62cf9b83 in namespace provisioning-2360 I0625 05:00:53.228] [1mSTEP[0m: checking the created volume is writable on node {Name: Selector:map[] Affinity:nil} I0625 05:00:53.228] Jun 25 04:58:12.022: INFO: Waiting up to 15m0s for pod "pvc-volume-tester-writer-k2kw2" in namespace "provisioning-2360" to be "Succeeded or Failed" I0625 05:00:53.228] Jun 25 04:58:12.025: INFO: Pod "pvc-volume-tester-writer-k2kw2": Phase="Pending", Reason="", readiness=false. Elapsed: 3.0934ms I0625 05:00:53.229] Jun 25 04:58:14.029: INFO: Pod "pvc-volume-tester-writer-k2kw2": Phase="Pending", Reason="", readiness=false. Elapsed: 2.007195241s I0625 05:00:53.229] Jun 25 04:58:16.029: INFO: Pod "pvc-volume-tester-writer-k2kw2": Phase="Pending", Reason="", readiness=false. Elapsed: 4.007304822s I0625 05:00:53.229] Jun 25 04:58:18.029: INFO: Pod "pvc-volume-tester-writer-k2kw2": Phase="Pending", Reason="", readiness=false. Elapsed: 6.006534927s I0625 05:00:53.230] Jun 25 04:58:20.029: INFO: Pod "pvc-volume-tester-writer-k2kw2": Phase="Pending", Reason="", readiness=false. Elapsed: 8.006433734s I0625 05:00:53.230] Jun 25 04:58:22.029: INFO: Pod "pvc-volume-tester-writer-k2kw2": Phase="Pending", Reason="", readiness=false. Elapsed: 10.006906775s ... skipping 30 lines ... I0625 05:00:53.238] Jun 25 04:59:24.030: INFO: Pod "pvc-volume-tester-writer-k2kw2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.008255558s I0625 05:00:53.238] Jun 25 04:59:26.030: INFO: Pod "pvc-volume-tester-writer-k2kw2": Phase="Running", Reason="", readiness=true. Elapsed: 1m14.007447732s I0625 05:00:53.239] Jun 25 04:59:28.029: INFO: Pod "pvc-volume-tester-writer-k2kw2": Phase="Running", Reason="", readiness=false. Elapsed: 1m16.006564589s I0625 05:00:53.239] Jun 25 04:59:30.029: INFO: Pod "pvc-volume-tester-writer-k2kw2": Phase="Running", Reason="", readiness=false. Elapsed: 1m18.00644367s I0625 05:00:53.239] Jun 25 04:59:32.030: INFO: Pod "pvc-volume-tester-writer-k2kw2": Phase="Succeeded", Reason="", readiness=false. Elapsed: 1m20.007639523s I0625 05:00:53.240] [1mSTEP[0m: Saw pod success I0625 05:00:53.240] Jun 25 04:59:32.030: INFO: Pod "pvc-volume-tester-writer-k2kw2" satisfied condition "Succeeded or Failed" I0625 05:00:53.240] Jun 25 04:59:32.059: INFO: Pod pvc-volume-tester-writer-k2kw2 has the following logs: I0625 05:00:53.240] Jun 25 04:59:32.059: INFO: Deleting pod "pvc-volume-tester-writer-k2kw2" in namespace "provisioning-2360" I0625 05:00:53.241] Jun 25 04:59:32.067: INFO: Wait up to 5m0s for pod "pvc-volume-tester-writer-k2kw2" to be fully deleted I0625 05:00:53.241] [1mSTEP[0m: checking the created volume has the correct mount options, is readable and retains data on the same node "e2e-test-prow-windows-node-group-rn0p" I0625 05:00:53.241] Jun 25 04:59:32.086: INFO: Waiting up to 15m0s for pod "pvc-volume-tester-reader-5vg6s" in namespace "provisioning-2360" to be "Succeeded or Failed" I0625 05:00:53.241] Jun 25 04:59:32.092: INFO: Pod "pvc-volume-tester-reader-5vg6s": Phase="Pending", Reason="", readiness=false. Elapsed: 6.182901ms I0625 05:00:53.242] Jun 25 04:59:34.096: INFO: Pod "pvc-volume-tester-reader-5vg6s": Phase="Pending", Reason="", readiness=false. Elapsed: 2.010049385s I0625 05:00:53.242] Jun 25 04:59:36.096: INFO: Pod "pvc-volume-tester-reader-5vg6s": Phase="Pending", Reason="", readiness=false. Elapsed: 4.010015752s I0625 05:00:53.242] Jun 25 04:59:38.096: INFO: Pod "pvc-volume-tester-reader-5vg6s": Phase="Pending", Reason="", readiness=false. Elapsed: 6.010596731s I0625 05:00:53.243] Jun 25 04:59:40.097: INFO: Pod "pvc-volume-tester-reader-5vg6s": Phase="Pending", Reason="", readiness=false. Elapsed: 8.011248136s I0625 05:00:53.243] Jun 25 04:59:42.096: INFO: Pod "pvc-volume-tester-reader-5vg6s": Phase="Pending", Reason="", readiness=false. Elapsed: 10.010157571s ... skipping 13 lines ... I0625 05:00:53.247] Jun 25 05:00:10.096: INFO: Pod "pvc-volume-tester-reader-5vg6s": Phase="Pending", Reason="", readiness=false. Elapsed: 38.010442929s I0625 05:00:53.248] Jun 25 05:00:12.097: INFO: Pod "pvc-volume-tester-reader-5vg6s": Phase="Running", Reason="", readiness=true. Elapsed: 40.011036516s I0625 05:00:53.248] Jun 25 05:00:14.096: INFO: Pod "pvc-volume-tester-reader-5vg6s": Phase="Running", Reason="", readiness=false. Elapsed: 42.009870722s I0625 05:00:53.248] Jun 25 05:00:16.096: INFO: Pod "pvc-volume-tester-reader-5vg6s": Phase="Running", Reason="", readiness=false. Elapsed: 44.010011995s I0625 05:00:53.249] Jun 25 05:00:18.098: INFO: Pod "pvc-volume-tester-reader-5vg6s": Phase="Succeeded", Reason="", readiness=false. Elapsed: 46.012162171s I0625 05:00:53.249] [1mSTEP[0m: Saw pod success I0625 05:00:53.249] Jun 25 05:00:18.098: INFO: Pod "pvc-volume-tester-reader-5vg6s" satisfied condition "Succeeded or Failed" I0625 05:00:53.249] Jun 25 05:00:18.119: INFO: Pod pvc-volume-tester-reader-5vg6s has the following logs: hello world I0625 05:00:53.249] I0625 05:00:53.249] Jun 25 05:00:18.119: INFO: Deleting pod "pvc-volume-tester-reader-5vg6s" in namespace "provisioning-2360" I0625 05:00:53.250] Jun 25 05:00:18.127: INFO: Wait up to 5m0s for pod "pvc-volume-tester-reader-5vg6s" to be fully deleted I0625 05:00:53.250] Jun 25 05:00:18.131: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-ql6hk] to have phase Bound I0625 05:00:53.250] Jun 25 05:00:18.134: INFO: PersistentVolumeClaim pvc-ql6hk found and phase=Bound (2.618922ms) ... skipping 23 lines ... I0625 05:00:53.254] [90mtest/e2e/storage/external/external.go:174[0m I0625 05:00:53.254] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning I0625 05:00:53.254] [90mtest/e2e/storage/framework/testsuite.go:50[0m I0625 05:00:53.254] should provision storage with mount options I0625 05:00:53.254] [90mtest/e2e/storage/testsuites/provisioning.go:187[0m I0625 05:00:53.255] [90m------------------------------[0m I0625 05:00:53.255] {"msg":"PASSED External Storage [Driver: csi-gcepd-sc-windows--no-volumesnapshotclass] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning should provision storage with mount options","total":-1,"completed":11,"skipped":1087,"failed":0} I0625 05:00:53.255] I0625 05:00:53.255] [36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m I0625 05:00:53.256] [90m------------------------------[0m I0625 05:00:53.256] [BeforeEach] [Testpattern: Pre-provisioned PV (ext3)] volumes I0625 05:00:53.256] test/e2e/storage/framework/testsuite.go:51 I0625 05:00:53.256] Jun 25 05:00:53.251: INFO: Driver "csi-gcepd-sc-windows--no-volumesnapshotclass" does not support volume type "PreprovisionedPV" - skipping ... skipping 515 lines ... I0625 05:03:28.169] [90mtest/e2e/storage/external/external.go:174[0m I0625 05:03:28.169] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] I0625 05:03:28.169] [90mtest/e2e/storage/framework/testsuite.go:50[0m I0625 05:03:28.170] should access to two volumes with different volume mode and retain data across pod recreation on different node I0625 05:03:28.170] [90mtest/e2e/storage/testsuites/multivolume.go:248[0m I0625 05:03:28.170] [90m------------------------------[0m I0625 05:03:28.170] {"msg":"PASSED External Storage [Driver: csi-gcepd-sc-windows--no-volumesnapshotclass] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node","total":-1,"completed":9,"skipped":1211,"failed":0} I0625 05:03:28.171] I0625 05:03:28.171] [36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m I0625 05:03:28.171] [90m------------------------------[0m I0625 05:03:28.171] [BeforeEach] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] I0625 05:03:28.172] test/e2e/storage/framework/testsuite.go:51 I0625 05:03:28.172] Jun 25 05:03:28.154: INFO: Driver csi-gcepd-sc-windows--no-volumesnapshotclass doesn't support Block -- skipping ... skipping 63 lines ... I0625 05:03:28.320] test/e2e/framework/framework.go:186 I0625 05:03:28.321] [1mSTEP[0m: Creating a kubernetes client I0625 05:03:28.321] Jun 25 05:03:28.283: INFO: >>> kubeConfig: /root/.kube/config I0625 05:03:28.321] [1mSTEP[0m: Building a namespace api object, basename volumemode I0625 05:03:28.321] [1mSTEP[0m: Waiting for a default service account to be provisioned in namespace I0625 05:03:28.321] [1mSTEP[0m: Waiting for kube-root-ca.crt to be provisioned in namespace I0625 05:03:28.322] [It] should fail to use a volume in a pod with mismatched mode [Slow] I0625 05:03:28.322] test/e2e/storage/testsuites/volumemode.go:299 I0625 05:03:28.322] Jun 25 05:03:28.310: INFO: Driver "csi-gcepd-sc-windows--no-volumesnapshotclass" does not provide raw block - skipping I0625 05:03:28.322] [AfterEach] [Testpattern: Dynamic PV (filesystem volmode)] volumeMode I0625 05:03:28.322] test/e2e/framework/framework.go:187 I0625 05:03:28.323] Jun 25 05:03:28.310: INFO: Waiting up to 3m0s for all (but 2) nodes to be ready I0625 05:03:28.323] [1mSTEP[0m: Destroying namespace "volumemode-9093" for this suite. I0625 05:03:28.323] I0625 05:03:28.323] I0625 05:03:28.323] [36m[1mS [SKIPPING] [0.036 seconds][0m I0625 05:03:28.323] External Storage [Driver: csi-gcepd-sc-windows--no-volumesnapshotclass] I0625 05:03:28.324] [90mtest/e2e/storage/external/external.go:174[0m I0625 05:03:28.324] [Testpattern: Dynamic PV (filesystem volmode)] volumeMode I0625 05:03:28.324] [90mtest/e2e/storage/framework/testsuite.go:50[0m I0625 05:03:28.324] [36m[1mshould fail to use a volume in a pod with mismatched mode [Slow] [It][0m I0625 05:03:28.324] [90mtest/e2e/storage/testsuites/volumemode.go:299[0m I0625 05:03:28.325] I0625 05:03:28.325] [36mDriver "csi-gcepd-sc-windows--no-volumesnapshotclass" does not provide raw block - skipping[0m I0625 05:03:28.325] I0625 05:03:28.325] test/e2e/storage/testsuites/volumes.go:114 I0625 05:03:28.325] [90m------------------------------[0m ... skipping 351 lines ... I0625 05:04:51.487] [90mtest/e2e/storage/external/external.go:174[0m I0625 05:04:51.487] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] I0625 05:04:51.487] [90mtest/e2e/storage/framework/testsuite.go:50[0m I0625 05:04:51.487] should access to two volumes with the same volume mode and retain data across pod recreation on the same node I0625 05:04:51.487] [90mtest/e2e/storage/testsuites/multivolume.go:138[0m I0625 05:04:51.487] [90m------------------------------[0m I0625 05:04:51.488] {"msg":"PASSED External Storage [Driver: csi-gcepd-sc-windows--no-volumesnapshotclass] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node","total":-1,"completed":12,"skipped":2089,"failed":0} I0625 05:04:51.488] Jun 25 05:04:51.432: INFO: Running AfterSuite actions on all nodes I0625 05:04:51.488] Jun 25 05:04:51.432: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage.glob..func19.2 I0625 05:04:51.488] Jun 25 05:04:51.432: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage.glob..func9.2 I0625 05:04:51.488] Jun 25 05:04:51.432: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage.glob..func8.2 I0625 05:04:51.488] Jun 25 05:04:51.432: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage/vsphere.glob..func17.3 I0625 05:04:51.488] Jun 25 05:04:51.432: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage/vsphere.glob..func9.2 I0625 05:04:51.489] Jun 25 05:04:51.432: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage/vsphere.glob..func4.2 I0625 05:04:51.489] Jun 25 05:04:51.432: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage/vsphere.glob..func1.3 I0625 05:04:51.489] I0625 05:06:20.361] I0625 05:06:20.362] {"msg":"PASSED External Storage [Driver: csi-gcepd-sc-windows--no-volumesnapshotclass] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] should concurrently access the single volume from pods on the same node","total":-1,"completed":13,"skipped":2385,"failed":0} I0625 05:06:20.362] [BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] volumes I0625 05:06:20.362] test/e2e/storage/framework/testsuite.go:51 I0625 05:06:20.363] [BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] volumes I0625 05:06:20.363] test/e2e/framework/framework.go:186 I0625 05:06:20.363] [1mSTEP[0m: Creating a kubernetes client I0625 05:06:20.363] Jun 25 05:03:07.960: INFO: >>> kubeConfig: /root/.kube/config ... skipping 7 lines ... I0625 05:06:20.364] [1mSTEP[0m: creating a StorageClass volume-7058-e2e-scmbhth I0625 05:06:20.364] [1mSTEP[0m: creating a claim I0625 05:06:20.364] Jun 25 05:03:07.998: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil I0625 05:06:20.364] Jun 25 05:03:08.009: INFO: generated pod command echo "ls -n /vol1" > /vol1/test-dynamicpv-lss4.ps1; .\/vol1/test-dynamicpv-lss4.ps1 I0625 05:06:20.364] [1mSTEP[0m: Creating pod exec-volume-test-dynamicpv-lss4 I0625 05:06:20.364] [1mSTEP[0m: Creating a pod to test exec-volume-test I0625 05:06:20.364] Jun 25 05:03:08.017: INFO: Waiting up to 5m0s for pod "exec-volume-test-dynamicpv-lss4" in namespace "volume-7058" to be "Succeeded or Failed" I0625 05:06:20.365] Jun 25 05:03:08.021: INFO: Pod "exec-volume-test-dynamicpv-lss4": Phase="Pending", Reason="", readiness=false. Elapsed: 4.525804ms I0625 05:06:20.365] Jun 25 05:03:10.026: INFO: Pod "exec-volume-test-dynamicpv-lss4": Phase="Pending", Reason="", readiness=false. Elapsed: 2.008979551s I0625 05:06:20.365] Jun 25 05:03:12.025: INFO: Pod "exec-volume-test-dynamicpv-lss4": Phase="Pending", Reason="", readiness=false. Elapsed: 4.008581678s I0625 05:06:20.365] Jun 25 05:03:14.027: INFO: Pod "exec-volume-test-dynamicpv-lss4": Phase="Pending", Reason="", readiness=false. Elapsed: 6.010044432s I0625 05:06:20.365] Jun 25 05:03:16.025: INFO: Pod "exec-volume-test-dynamicpv-lss4": Phase="Pending", Reason="", readiness=false. Elapsed: 8.008084196s I0625 05:06:20.365] Jun 25 05:03:18.026: INFO: Pod "exec-volume-test-dynamicpv-lss4": Phase="Pending", Reason="", readiness=false. Elapsed: 10.009527494s ... skipping 51 lines ... I0625 05:06:20.375] Jun 25 05:05:02.030: INFO: Pod "exec-volume-test-dynamicpv-lss4": Phase="Running", Reason="", readiness=false. Elapsed: 1m54.013201647s I0625 05:06:20.375] Jun 25 05:05:04.026: INFO: Pod "exec-volume-test-dynamicpv-lss4": Phase="Running", Reason="", readiness=false. Elapsed: 1m56.009015009s I0625 05:06:20.375] Jun 25 05:05:06.025: INFO: Pod "exec-volume-test-dynamicpv-lss4": Phase="Running", Reason="", readiness=false. Elapsed: 1m58.008128235s I0625 05:06:20.375] Jun 25 05:05:08.026: INFO: Pod "exec-volume-test-dynamicpv-lss4": Phase="Running", Reason="", readiness=false. Elapsed: 2m0.009331869s I0625 05:06:20.376] Jun 25 05:05:10.024: INFO: Pod "exec-volume-test-dynamicpv-lss4": Phase="Succeeded", Reason="", readiness=false. Elapsed: 2m2.007694382s I0625 05:06:20.376] [1mSTEP[0m: Saw pod success I0625 05:06:20.376] Jun 25 05:05:10.024: INFO: Pod "exec-volume-test-dynamicpv-lss4" satisfied condition "Succeeded or Failed" I0625 05:06:20.376] Jun 25 05:05:10.027: INFO: Trying to get logs from node e2e-test-prow-windows-node-group-w48h pod exec-volume-test-dynamicpv-lss4 container exec-container-dynamicpv-lss4: <nil> I0625 05:06:20.376] [1mSTEP[0m: delete the pod I0625 05:06:20.376] Jun 25 05:05:10.243: INFO: Waiting for pod exec-volume-test-dynamicpv-lss4 to disappear I0625 05:06:20.376] Jun 25 05:05:10.246: INFO: Pod exec-volume-test-dynamicpv-lss4 no longer exists I0625 05:06:20.376] [1mSTEP[0m: Deleting pod exec-volume-test-dynamicpv-lss4 I0625 05:06:20.377] Jun 25 05:05:10.246: INFO: Deleting pod "exec-volume-test-dynamicpv-lss4" in namespace "volume-7058" ... skipping 27 lines ... I0625 05:06:20.381] [90mtest/e2e/storage/external/external.go:174[0m I0625 05:06:20.381] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] volumes I0625 05:06:20.381] [90mtest/e2e/storage/framework/testsuite.go:50[0m I0625 05:06:20.381] should allow exec of files on the volume I0625 05:06:20.381] [90mtest/e2e/storage/testsuites/volumes.go:198[0m I0625 05:06:20.381] [90m------------------------------[0m I0625 05:06:20.381] {"msg":"PASSED External Storage [Driver: csi-gcepd-sc-windows--no-volumesnapshotclass] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] volumes should allow exec of files on the volume","total":-1,"completed":14,"skipped":2385,"failed":0} I0625 05:06:20.382] Jun 25 05:06:20.362: INFO: Running AfterSuite actions on all nodes I0625 05:06:20.382] Jun 25 05:06:20.362: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage.glob..func19.2 I0625 05:06:20.382] Jun 25 05:06:20.362: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage.glob..func9.2 I0625 05:06:20.382] Jun 25 05:06:20.362: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage.glob..func8.2 I0625 05:06:20.382] Jun 25 05:06:20.362: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage/vsphere.glob..func17.3 I0625 05:06:20.383] Jun 25 05:06:20.362: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage/vsphere.glob..func9.2 ... skipping 1021 lines ... I0625 05:09:10.889] [90mtest/e2e/storage/external/external.go:174[0m I0625 05:09:10.889] [Testpattern: Dynamic PV (default fs)] provisioning I0625 05:09:10.889] [90mtest/e2e/storage/framework/testsuite.go:50[0m I0625 05:09:10.889] should provision storage with pvc data source in parallel [Slow] I0625 05:09:10.889] [90mtest/e2e/storage/testsuites/provisioning.go:466[0m I0625 05:09:10.889] [90m------------------------------[0m I0625 05:09:10.890] {"msg":"PASSED External Storage [Driver: csi-gcepd-sc-windows--no-volumesnapshotclass] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with pvc data source in parallel [Slow]","total":-1,"completed":12,"skipped":1330,"failed":0} I0625 05:09:10.890] Jun 25 05:09:10.662: INFO: Running AfterSuite actions on all nodes I0625 05:09:10.890] Jun 25 05:09:10.662: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage.glob..func19.2 I0625 05:09:10.891] Jun 25 05:09:10.662: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage.glob..func9.2 I0625 05:09:10.891] Jun 25 05:09:10.662: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage.glob..func8.2 I0625 05:09:10.891] Jun 25 05:09:10.662: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage/vsphere.glob..func17.3 I0625 05:09:10.891] Jun 25 05:09:10.662: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage/vsphere.glob..func9.2 I0625 05:09:10.892] Jun 25 05:09:10.662: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage/vsphere.glob..func4.2 I0625 05:09:10.892] Jun 25 05:09:10.662: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage/vsphere.glob..func1.3 I0625 05:09:10.892] Jun 25 05:09:10.662: INFO: Running AfterSuite actions on node 1 I0625 05:09:10.892] Jun 25 05:09:10.662: INFO: Dumping logs locally to: /workspace/_artifacts/sc-windows/eb7b8829-f433-11ec-9e31-9224b4edca5e I0625 05:09:10.892] Jun 25 05:09:10.663: INFO: Error running cluster/log-dump/log-dump.sh: fork/exec ../../cluster/log-dump/log-dump.sh: no such file or directory I0625 05:09:10.893] I0625 05:09:10.893] I0625 05:09:10.893] [1m[32mRan 47 of 7311 Specs in 2547.539 seconds[0m I0625 05:09:10.893] [1m[32mSUCCESS![0m -- [32m[1m47 Passed[0m | [91m[1m0 Failed[0m | [33m[1m0 Pending[0m | [36m[1m7264 Skipped[0m I0625 05:09:10.893] I0625 05:09:10.893] I0625 05:09:10.893] Ginkgo ran 1 suite in 42m30.274902294s I0625 05:09:10.893] Test Suite Passed W0625 05:09:10.994] I0625 05:09:10.798199 6562 main.go:741] Copying kubernetes binaries to path=/workspace/_artifacts/pd-volumesnapshotclass/eb7b8829-f433-11ec-9e31-9224b4edca5e to run the tests W0625 05:09:10.995] I0625 05:09:10.798255 6562 main.go:796] copying /tmp/gcp-pd-driver-tmp1125011335/kubernetes/_output/dockerized/bin/linux/amd64/kubectl to /workspace/_artifacts/pd-volumesnapshotclass/eb7b8829-f433-11ec-9e31-9224b4edca5e/kubectl ... skipping 80 lines ... I0625 05:20:31.511] Jun 25 05:09:15.617: INFO: Using claimSize:5Gi, test suite supported size:{ 1Mi}, driver(csi-gcepd-sc-windows--pd-volumesnapshotclass) supported size:{ 1Mi} I0625 05:20:31.511] [1mSTEP[0m: creating a StorageClass snapshotting-3004-e2e-sc4rv95 I0625 05:20:31.511] [1mSTEP[0m: creating a claim I0625 05:20:31.511] Jun 25 05:09:15.621: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil I0625 05:20:31.512] [1mSTEP[0m: [init] starting a pod to use the claim I0625 05:20:31.512] [1mSTEP[0m: [init] check pod success I0625 05:20:31.512] Jun 25 05:09:15.638: INFO: Waiting up to 15m0s for pod "pvc-snapshottable-tester-rk9ff" in namespace "snapshotting-3004" to be "Succeeded or Failed" I0625 05:20:31.512] Jun 25 05:09:15.643: INFO: Pod "pvc-snapshottable-tester-rk9ff": Phase="Pending", Reason="", readiness=false. Elapsed: 4.575484ms I0625 05:20:31.512] Jun 25 05:09:17.647: INFO: Pod "pvc-snapshottable-tester-rk9ff": Phase="Pending", Reason="", readiness=false. Elapsed: 2.008791969s I0625 05:20:31.513] Jun 25 05:09:19.646: INFO: Pod "pvc-snapshottable-tester-rk9ff": Phase="Pending", Reason="", readiness=false. Elapsed: 4.008059944s I0625 05:20:31.513] Jun 25 05:09:21.646: INFO: Pod "pvc-snapshottable-tester-rk9ff": Phase="Pending", Reason="", readiness=false. Elapsed: 6.008346964s I0625 05:20:31.513] Jun 25 05:09:23.649: INFO: Pod "pvc-snapshottable-tester-rk9ff": Phase="Pending", Reason="", readiness=false. Elapsed: 8.011097491s I0625 05:20:31.513] Jun 25 05:09:25.647: INFO: Pod "pvc-snapshottable-tester-rk9ff": Phase="Pending", Reason="", readiness=false. Elapsed: 10.00857226s ... skipping 19 lines ... I0625 05:20:31.517] Jun 25 05:10:05.648: INFO: Pod "pvc-snapshottable-tester-rk9ff": Phase="Pending", Reason="", readiness=false. Elapsed: 50.009741119s I0625 05:20:31.517] Jun 25 05:10:07.646: INFO: Pod "pvc-snapshottable-tester-rk9ff": Phase="Pending", Reason="", readiness=false. Elapsed: 52.008040272s I0625 05:20:31.517] Jun 25 05:10:09.647: INFO: Pod "pvc-snapshottable-tester-rk9ff": Phase="Running", Reason="", readiness=true. Elapsed: 54.008683201s I0625 05:20:31.517] Jun 25 05:10:11.647: INFO: Pod "pvc-snapshottable-tester-rk9ff": Phase="Running", Reason="", readiness=false. Elapsed: 56.009115332s I0625 05:20:31.517] Jun 25 05:10:13.647: INFO: Pod "pvc-snapshottable-tester-rk9ff": Phase="Succeeded", Reason="", readiness=false. Elapsed: 58.009476349s I0625 05:20:31.517] [1mSTEP[0m: Saw pod success I0625 05:20:31.517] Jun 25 05:10:13.647: INFO: Pod "pvc-snapshottable-tester-rk9ff" satisfied condition "Succeeded or Failed" I0625 05:20:31.518] [1mSTEP[0m: [init] checking the claim I0625 05:20:31.518] Jun 25 05:10:13.651: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [csi-gcepd-sc-windows--pd-volumesnapshotclass8qbgm] to have phase Bound I0625 05:20:31.518] Jun 25 05:10:13.654: INFO: PersistentVolumeClaim csi-gcepd-sc-windows--pd-volumesnapshotclass8qbgm found and phase=Bound (2.809483ms) I0625 05:20:31.518] [1mSTEP[0m: [init] checking the PV I0625 05:20:31.518] [1mSTEP[0m: [init] deleting the pod I0625 05:20:31.518] Jun 25 05:10:13.687: INFO: Pod pvc-snapshottable-tester-rk9ff has the following logs: ... skipping 160 lines ... I0625 05:20:31.551] Jun 25 05:15:18.521: INFO: VolumeSnapshot snapshot-g5zks found but is not ready. I0625 05:20:31.551] Jun 25 05:15:20.527: INFO: VolumeSnapshot snapshot-g5zks found but is not ready. I0625 05:20:31.551] Jun 25 05:15:22.532: INFO: VolumeSnapshot snapshot-g5zks found but is not ready. I0625 05:20:31.551] Jun 25 05:15:24.539: INFO: VolumeSnapshot snapshot-g5zks found but is not ready. I0625 05:20:31.551] Jun 25 05:15:26.545: INFO: VolumeSnapshot snapshot-g5zks found but is not ready. I0625 05:20:31.551] Jun 25 05:15:28.552: INFO: VolumeSnapshot snapshot-g5zks found but is not ready. I0625 05:20:31.551] Jun 25 05:15:30.552: INFO: WaitUntil failed after reaching the timeout 5m0s I0625 05:20:31.551] Jun 25 05:15:30.552: INFO: Unexpected error: I0625 05:20:31.552] <*errors.errorString | 0xc003314d60>: { I0625 05:20:31.552] s: "VolumeSnapshot snapshot-g5zks is not ready within 5m0s", I0625 05:20:31.552] } I0625 05:20:31.552] Jun 25 05:15:30.552: FAIL: VolumeSnapshot snapshot-g5zks is not ready within 5m0s I0625 05:20:31.552] I0625 05:20:31.552] Full Stack Trace I0625 05:20:31.552] k8s.io/kubernetes/test/e2e/storage/utils.GetSnapshotContentFromSnapshot({0x7a661a0, 0xc003dca050?}, 0xc0024a5438) I0625 05:20:31.552] test/e2e/storage/utils/snapshot.go:86 +0x1ad I0625 05:20:31.552] k8s.io/kubernetes/test/e2e/storage/framework.CreateSnapshotResource({0x7f9c3cc20f08, 0xc000bd3600}, 0xc002b51620, {{0x7288d63, 0x28}, {0x0, 0x0}, {0x71c4fef, 0x9}, {0x0, ...}, ...}, ...) I0625 05:20:31.553] test/e2e/storage/framework/snapshot_resource.go:92 +0x246 ... skipping 71 lines ... I0625 05:20:31.566] Jun 25 05:20:05.854: INFO: PersistentVolume pvc-8719fcdf-b3c9-440f-a8ff-c3aaf1d53fa8 found and phase=Bound (4m35.288827634s) I0625 05:20:31.566] Jun 25 05:20:10.858: INFO: PersistentVolume pvc-8719fcdf-b3c9-440f-a8ff-c3aaf1d53fa8 found and phase=Bound (4m40.292616691s) I0625 05:20:31.566] Jun 25 05:20:15.863: INFO: PersistentVolume pvc-8719fcdf-b3c9-440f-a8ff-c3aaf1d53fa8 found and phase=Bound (4m45.297271171s) I0625 05:20:31.566] Jun 25 05:20:20.869: INFO: PersistentVolume pvc-8719fcdf-b3c9-440f-a8ff-c3aaf1d53fa8 found and phase=Bound (4m50.304161451s) I0625 05:20:31.566] Jun 25 05:20:25.874: INFO: PersistentVolume pvc-8719fcdf-b3c9-440f-a8ff-c3aaf1d53fa8 found and phase=Released (4m55.308622156s) I0625 05:20:31.566] [1mSTEP[0m: Deleting sc I0625 05:20:31.566] Jun 25 05:20:30.880: INFO: Unexpected error: I0625 05:20:31.566] <errors.aggregate | len:1, cap:1>: [ I0625 05:20:31.567] { I0625 05:20:31.567] msg: "persistent Volume pvc-8719fcdf-b3c9-440f-a8ff-c3aaf1d53fa8 not deleted by dynamic provisioner: PersistentVolume pvc-8719fcdf-b3c9-440f-a8ff-c3aaf1d53fa8 still exists within 5m0s", I0625 05:20:31.567] err: { I0625 05:20:31.567] s: "PersistentVolume pvc-8719fcdf-b3c9-440f-a8ff-c3aaf1d53fa8 still exists within 5m0s", I0625 05:20:31.567] }, I0625 05:20:31.567] }, I0625 05:20:31.567] ] I0625 05:20:31.567] Jun 25 05:20:30.880: FAIL: persistent Volume pvc-8719fcdf-b3c9-440f-a8ff-c3aaf1d53fa8 not deleted by dynamic provisioner: PersistentVolume pvc-8719fcdf-b3c9-440f-a8ff-c3aaf1d53fa8 still exists within 5m0s I0625 05:20:31.567] I0625 05:20:31.567] Full Stack Trace I0625 05:20:31.568] k8s.io/kubernetes/test/e2e/storage/testsuites.(*snapshottableTestSuite).DefineTests.func1.1.1() I0625 05:20:31.568] test/e2e/storage/testsuites/snapshottable.go:142 +0x3c I0625 05:20:31.568] k8s.io/kubernetes/test/e2e/storage/utils.TryFunc(0xc0020bb350?) I0625 05:20:31.568] test/e2e/storage/utils/utils.go:714 +0x6d ... skipping 160 lines ... I0625 05:20:31.623] [90mtest/e2e/storage/testsuites/snapshottable.go:278[0m I0625 05:20:31.624] I0625 05:20:31.624] [91mJun 25 05:15:30.552: VolumeSnapshot snapshot-g5zks is not ready within 5m0s[0m I0625 05:20:31.624] I0625 05:20:31.624] test/e2e/storage/utils/snapshot.go:86 I0625 05:20:31.624] [90m------------------------------[0m I0625 05:20:31.625] {"msg":"FAILED External Storage [Driver: csi-gcepd-sc-windows--pd-volumesnapshotclass] [Testpattern: Pre-provisioned Snapshot (retain policy)] snapshottable[Feature:VolumeSnapshotDataSource] volume snapshot controller should check snapshot fields, check restore correctly works after modifying source data, check deletion (persistent)","total":-1,"completed":0,"skipped":541,"failed":1,"failures":["External Storage [Driver: csi-gcepd-sc-windows--pd-volumesnapshotclass] [Testpattern: Pre-provisioned Snapshot (retain policy)] snapshottable[Feature:VolumeSnapshotDataSource] volume snapshot controller should check snapshot fields, check restore correctly works after modifying source data, check deletion (persistent)"]} I0625 05:20:31.625] I0625 05:20:31.871] [36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m I0625 05:20:31.872] [90m------------------------------[0m I0625 05:20:31.872] [BeforeEach] [Testpattern: Dynamic Snapshot (delete policy)] snapshottable[Feature:VolumeSnapshotDataSource] I0625 05:20:31.872] test/e2e/storage/framework/testsuite.go:51 I0625 05:20:31.873] [BeforeEach] [Testpattern: Dynamic Snapshot (delete policy)] snapshottable[Feature:VolumeSnapshotDataSource] ... skipping 164 lines ... I0625 05:21:04.006] Jun 25 05:09:15.156: INFO: Using claimSize:5Gi, test suite supported size:{ 1Mi}, driver(csi-gcepd-sc-windows--pd-volumesnapshotclass) supported size:{ 1Mi} I0625 05:21:04.006] [1mSTEP[0m: creating a StorageClass snapshotting-810-e2e-sc8mr9n I0625 05:21:04.006] [1mSTEP[0m: creating a claim I0625 05:21:04.007] Jun 25 05:09:15.161: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil I0625 05:21:04.007] [1mSTEP[0m: [init] starting a pod to use the claim I0625 05:21:04.007] [1mSTEP[0m: [init] check pod success I0625 05:21:04.007] Jun 25 05:09:15.178: INFO: Waiting up to 15m0s for pod "pvc-snapshottable-tester-r2hzs" in namespace "snapshotting-810" to be "Succeeded or Failed" I0625 05:21:04.007] Jun 25 05:09:15.181: INFO: Pod "pvc-snapshottable-tester-r2hzs": Phase="Pending", Reason="", readiness=false. Elapsed: 3.013088ms I0625 05:21:04.007] Jun 25 05:09:17.185: INFO: Pod "pvc-snapshottable-tester-r2hzs": Phase="Pending", Reason="", readiness=false. Elapsed: 2.006765494s I0625 05:21:04.007] Jun 25 05:09:19.185: INFO: Pod "pvc-snapshottable-tester-r2hzs": Phase="Pending", Reason="", readiness=false. Elapsed: 4.007124659s I0625 05:21:04.008] Jun 25 05:09:21.185: INFO: Pod "pvc-snapshottable-tester-r2hzs": Phase="Pending", Reason="", readiness=false. Elapsed: 6.007030525s I0625 05:21:04.008] Jun 25 05:09:23.185: INFO: Pod "pvc-snapshottable-tester-r2hzs": Phase="Pending", Reason="", readiness=false. Elapsed: 8.007339042s I0625 05:21:04.008] Jun 25 05:09:25.185: INFO: Pod "pvc-snapshottable-tester-r2hzs": Phase="Pending", Reason="", readiness=false. Elapsed: 10.006861448s ... skipping 29 lines ... I0625 05:21:04.013] Jun 25 05:10:25.187: INFO: Pod "pvc-snapshottable-tester-r2hzs": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.009254258s I0625 05:21:04.013] Jun 25 05:10:27.186: INFO: Pod "pvc-snapshottable-tester-r2hzs": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.008201464s I0625 05:21:04.013] Jun 25 05:10:29.185: INFO: Pod "pvc-snapshottable-tester-r2hzs": Phase="Running", Reason="", readiness=false. Elapsed: 1m14.00744997s I0625 05:21:04.013] Jun 25 05:10:31.187: INFO: Pod "pvc-snapshottable-tester-r2hzs": Phase="Running", Reason="", readiness=false. Elapsed: 1m16.008801805s I0625 05:21:04.014] Jun 25 05:10:33.186: INFO: Pod "pvc-snapshottable-tester-r2hzs": Phase="Succeeded", Reason="", readiness=false. Elapsed: 1m18.00849727s I0625 05:21:04.014] [1mSTEP[0m: Saw pod success I0625 05:21:04.014] Jun 25 05:10:33.186: INFO: Pod "pvc-snapshottable-tester-r2hzs" satisfied condition "Succeeded or Failed" I0625 05:21:04.014] [1mSTEP[0m: [init] checking the claim I0625 05:21:04.014] Jun 25 05:10:33.190: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [csi-gcepd-sc-windows--pd-volumesnapshotclassxgmqf] to have phase Bound I0625 05:21:04.014] Jun 25 05:10:33.195: INFO: PersistentVolumeClaim csi-gcepd-sc-windows--pd-volumesnapshotclassxgmqf found and phase=Bound (4.615839ms) I0625 05:21:04.014] [1mSTEP[0m: [init] checking the PV I0625 05:21:04.015] [1mSTEP[0m: [init] deleting the pod I0625 05:21:04.015] Jun 25 05:10:33.439: INFO: Pod pvc-snapshottable-tester-r2hzs has the following logs: ... skipping 166 lines ... I0625 05:21:04.040] Jun 25 05:15:50.322: INFO: VolumeSnapshot snapshot-mh7g9 found but is not ready. I0625 05:21:04.040] Jun 25 05:15:52.327: INFO: VolumeSnapshot snapshot-mh7g9 found but is not ready. I0625 05:21:04.041] Jun 25 05:15:54.332: INFO: VolumeSnapshot snapshot-mh7g9 found but is not ready. I0625 05:21:04.041] Jun 25 05:15:56.337: INFO: VolumeSnapshot snapshot-mh7g9 found but is not ready. I0625 05:21:04.041] Jun 25 05:15:58.342: INFO: VolumeSnapshot snapshot-mh7g9 found but is not ready. I0625 05:21:04.041] Jun 25 05:16:00.347: INFO: VolumeSnapshot snapshot-mh7g9 found but is not ready. I0625 05:21:04.041] Jun 25 05:16:02.348: INFO: WaitUntil failed after reaching the timeout 5m0s I0625 05:21:04.041] Jun 25 05:16:02.348: INFO: Unexpected error: I0625 05:21:04.041] <*errors.errorString | 0xc00313f800>: { I0625 05:21:04.041] s: "VolumeSnapshot snapshot-mh7g9 is not ready within 5m0s", I0625 05:21:04.041] } I0625 05:21:04.042] Jun 25 05:16:02.349: FAIL: VolumeSnapshot snapshot-mh7g9 is not ready within 5m0s I0625 05:21:04.042] I0625 05:21:04.042] Full Stack Trace I0625 05:21:04.042] k8s.io/kubernetes/test/e2e/storage/utils.GetSnapshotContentFromSnapshot({0x7a661a0, 0xc0030e21d0?}, 0xc001bd1a18) I0625 05:21:04.042] test/e2e/storage/utils/snapshot.go:86 +0x1ad I0625 05:21:04.042] k8s.io/kubernetes/test/e2e/storage/framework.CreateSnapshotResource({0x7fd2d4168258, 0xc000c87ce0}, 0xc0028d63c0, {{0x7288d3b, 0x28}, {0x0, 0x0}, {0x71c4fef, 0x9}, {0x0, ...}, ...}, ...) I0625 05:21:04.042] test/e2e/storage/framework/snapshot_resource.go:92 +0x246 ... skipping 71 lines ... I0625 05:21:04.053] Jun 25 05:20:37.624: INFO: PersistentVolume pvc-2f982778-320c-4f65-82a3-5a50a746c018 found and phase=Bound (4m35.263199738s) I0625 05:21:04.053] Jun 25 05:20:42.628: INFO: PersistentVolume pvc-2f982778-320c-4f65-82a3-5a50a746c018 found and phase=Bound (4m40.267292005s) I0625 05:21:04.053] Jun 25 05:20:47.632: INFO: PersistentVolume pvc-2f982778-320c-4f65-82a3-5a50a746c018 found and phase=Bound (4m45.270860654s) I0625 05:21:04.053] Jun 25 05:20:52.636: INFO: PersistentVolume pvc-2f982778-320c-4f65-82a3-5a50a746c018 found and phase=Bound (4m50.27528827s) I0625 05:21:04.053] Jun 25 05:20:57.642: INFO: PersistentVolume pvc-2f982778-320c-4f65-82a3-5a50a746c018 found and phase=Bound (4m55.281325511s) I0625 05:21:04.053] [1mSTEP[0m: Deleting sc I0625 05:21:04.053] Jun 25 05:21:02.648: INFO: Unexpected error: I0625 05:21:04.053] <errors.aggregate | len:1, cap:1>: [ I0625 05:21:04.053] { I0625 05:21:04.054] msg: "persistent Volume pvc-2f982778-320c-4f65-82a3-5a50a746c018 not deleted by dynamic provisioner: PersistentVolume pvc-2f982778-320c-4f65-82a3-5a50a746c018 still exists within 5m0s", I0625 05:21:04.054] err: { I0625 05:21:04.054] s: "PersistentVolume pvc-2f982778-320c-4f65-82a3-5a50a746c018 still exists within 5m0s", I0625 05:21:04.054] }, I0625 05:21:04.054] }, I0625 05:21:04.054] ] I0625 05:21:04.054] Jun 25 05:21:02.648: FAIL: persistent Volume pvc-2f982778-320c-4f65-82a3-5a50a746c018 not deleted by dynamic provisioner: PersistentVolume pvc-2f982778-320c-4f65-82a3-5a50a746c018 still exists within 5m0s I0625 05:21:04.054] I0625 05:21:04.054] Full Stack Trace I0625 05:21:04.055] k8s.io/kubernetes/test/e2e/storage/testsuites.(*snapshottableTestSuite).DefineTests.func1.1.1() I0625 05:21:04.055] test/e2e/storage/testsuites/snapshottable.go:142 +0x3c I0625 05:21:04.055] k8s.io/kubernetes/test/e2e/storage/utils.TryFunc(0xc003935e10?) I0625 05:21:04.055] test/e2e/storage/utils/utils.go:714 +0x6d ... skipping 20 lines ... I0625 05:21:04.058] Jun 25 05:21:02.652: INFO: At 2022-06-25 05:09:19 +0000 UTC - event for pvc-snapshottable-tester-r2hzs: {default-scheduler } Scheduled: Successfully assigned snapshotting-810/pvc-snapshottable-tester-r2hzs to e2e-test-prow-windows-node-group-qhph I0625 05:21:04.058] Jun 25 05:21:02.652: INFO: At 2022-06-25 05:09:23 +0000 UTC - event for pvc-snapshottable-tester-r2hzs: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-2f982778-320c-4f65-82a3-5a50a746c018" I0625 05:21:04.058] Jun 25 05:21:02.652: INFO: At 2022-06-25 05:10:23 +0000 UTC - event for pvc-snapshottable-tester-r2hzs: {kubelet e2e-test-prow-windows-node-group-qhph} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.39" already present on machine I0625 05:21:04.058] Jun 25 05:21:02.652: INFO: At 2022-06-25 05:10:23 +0000 UTC - event for pvc-snapshottable-tester-r2hzs: {kubelet e2e-test-prow-windows-node-group-qhph} Created: Created container volume-tester I0625 05:21:04.059] Jun 25 05:21:02.652: INFO: At 2022-06-25 05:10:26 +0000 UTC - event for pvc-snapshottable-tester-r2hzs: {kubelet e2e-test-prow-windows-node-group-qhph} Started: Started container volume-tester I0625 05:21:04.059] Jun 25 05:21:02.652: INFO: At 2022-06-25 05:11:01 +0000 UTC - event for snapshot-mh7g9: {snapshot-controller } CreatingSnapshot: Waiting for a snapshot snapshotting-810/snapshot-mh7g9 to be created by the CSI driver. I0625 05:21:04.059] Jun 25 05:21:02.652: INFO: At 2022-06-25 05:11:01 +0000 UTC - event for snapshot-mh7g9: {snapshot-controller } SnapshotFinalizerError: Failed to check and update snapshot: snapshot controller failed to update snapshotting-810/snapshot-mh7g9 on API server: volumesnapshots.snapshot.storage.k8s.io "snapshot-mh7g9" is forbidden: User "system:serviceaccount:kube-system:volume-snapshot-controller" cannot patch resource "volumesnapshots" in API group "snapshot.storage.k8s.io" in the namespace "snapshotting-810" I0625 05:21:04.059] Jun 25 05:21:02.655: INFO: POD NODE PHASE GRACE CONDITIONS I0625 05:21:04.060] Jun 25 05:21:02.655: INFO: I0625 05:21:04.060] Jun 25 05:21:02.659: INFO: I0625 05:21:04.060] Logging node info for node e2e-test-prow-master I0625 05:21:04.066] Jun 25 05:21:02.662: INFO: Node Info: &Node{ObjectMeta:{e2e-test-prow-master ffe70899-e3c7-4cfe-aac5-e1fdb6946f74 17384 0 2022-06-25 04:04:55 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-4 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-test-prow-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-4 topology.gke.io/zone:us-central1-b topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/gce-cvm-upg-1-3-1-4-ctl-skew/zones/us-central1-b/instances/e2e-test-prow-master"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-06-25 04:04:55 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-06-25 04:04:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-06-25 04:05:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}}}} } {kubectl-taint Update v1 2022-06-25 04:26:37 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}} } {kubelet Update v1 2022-06-25 05:20:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://gce-cvm-upg-1-3-1-4-ctl-skew/us-central1-b/e2e-test-prow-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node.kubernetes.io/os,Value:linux,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{16684785664 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{15735648256 0} {<nil>} 15366844Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{15016307073 0} {<nil>} 15016307073 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{15473504256 0} {<nil>} 15110844Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-25 04:04:55 +0000 UTC,LastTransitionTime:2022-06-25 04:04:55 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-25 05:20:04 +0000 UTC,LastTransitionTime:2022-06-25 04:04:55 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-25 05:20:04 +0000 UTC,LastTransitionTime:2022-06-25 04:04:55 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-25 05:20:04 +0000 UTC,LastTransitionTime:2022-06-25 04:04:55 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-25 05:20:04 +0000 UTC,LastTransitionTime:2022-06-25 04:05:06 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.2,},NodeAddress{Type:ExternalIP,Address:34.136.177.176,},NodeAddress{Type:InternalDNS,Address:e2e-test-prow-master.c.gce-cvm-upg-1-3-1-4-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:e2e-test-prow-master.c.gce-cvm-upg-1-3-1-4-ctl-skew.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:2b7c8b3124d31c7afd07570b62ec0ada,SystemUUID:2b7c8b31-24d3-1c7a-fd07-570b62ec0ada,BootID:7f258069-31f3-452d-8a1b-64635b818ccd,KernelVersion:5.4.129+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.25.0-alpha.1.135+11686e138694a6,KubeProxyVersion:v1.25.0-alpha.1.135+11686e138694a6,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.25.0-alpha.1.135_11686e138694a6],SizeBytes:127703532,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.25.0-alpha.1.135_11686e138694a6],SizeBytes:117520517,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:810aadac042cee96db99d94cec2436482b886774681b44bb141254edda5e3cdf gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.17],SizeBytes:84029209,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.25.0-alpha.1.135_11686e138694a6],SizeBytes:51079296,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/gce-cvm-upg-1-3-1-4-ctl-skew/gcp-persistent-disk-csi-driver@sha256:ed229e48b6fcd3cbf34509126b488087218f9c2438b96df6be4d1453234c266b gcr.io/gce-cvm-upg-1-3-1-4-ctl-skew/gcp-persistent-disk-csi-driver:a0578d58-2680-44c3-9542-419d96384711],SizeBytes:43159928,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:be60ef505fc80879eeb5d8bf3ad8bb1146b395afc2394584645e99431806c26c gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.12.0],SizeBytes:32705362,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:9870ed22905d03e3fa5cd2d57118784999fb581c49310f6cac0c3795bcdd7ee7 registry.k8s.io/kas-network-proxy/proxy-server:v0.0.32],SizeBytes:17930113,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} I0625 05:21:04.066] Jun 25 05:21:02.663: INFO: ... skipping 128 lines ... I0625 05:21:04.109] [90mtest/e2e/storage/testsuites/snapshottable.go:278[0m I0625 05:21:04.109] I0625 05:21:04.109] [91mJun 25 05:16:02.349: VolumeSnapshot snapshot-mh7g9 is not ready within 5m0s[0m I0625 05:21:04.109] I0625 05:21:04.110] test/e2e/storage/utils/snapshot.go:86 I0625 05:21:04.110] [90m------------------------------[0m I0625 05:21:04.111] {"msg":"FAILED External Storage [Driver: csi-gcepd-sc-windows--pd-volumesnapshotclass] [Testpattern: Pre-provisioned Snapshot (delete policy)] snapshottable[Feature:VolumeSnapshotDataSource] volume snapshot controller should check snapshot fields, check restore correctly works after modifying source data, check deletion (persistent)","total":-1,"completed":0,"skipped":166,"failed":1,"failures":["External Storage [Driver: csi-gcepd-sc-windows--pd-volumesnapshotclass] [Testpattern: Pre-provisioned Snapshot (delete policy)] snapshottable[Feature:VolumeSnapshotDataSource] volume snapshot controller should check snapshot fields, check restore correctly works after modifying source data, check deletion (persistent)"]} I0625 05:21:04.111] I0625 05:23:45.609] [36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m I0625 05:23:45.609] [90m------------------------------[0m I0625 05:23:45.609] [BeforeEach] [Testpattern: Dynamic PV (default fs)] provisioning I0625 05:23:45.609] test/e2e/storage/framework/testsuite.go:51 I0625 05:23:45.610] [BeforeEach] [Testpattern: Dynamic PV (default fs)] provisioning ... skipping 214 lines ... I0625 05:23:45.642] Jun 25 05:15:00.786: INFO: VolumeSnapshot snapshot-cv4dc found but is not ready. I0625 05:23:45.642] Jun 25 05:15:02.791: INFO: VolumeSnapshot snapshot-cv4dc found but is not ready. I0625 05:23:45.643] Jun 25 05:15:04.797: INFO: VolumeSnapshot snapshot-cv4dc found but is not ready. I0625 05:23:45.643] Jun 25 05:15:06.802: INFO: VolumeSnapshot snapshot-cv4dc found but is not ready. I0625 05:23:45.643] Jun 25 05:15:08.808: INFO: VolumeSnapshot snapshot-cv4dc found but is not ready. I0625 05:23:45.643] Jun 25 05:15:10.814: INFO: VolumeSnapshot snapshot-cv4dc found but is not ready. I0625 05:23:45.643] Jun 25 05:15:12.814: INFO: WaitUntil failed after reaching the timeout 5m0s I0625 05:23:45.643] Jun 25 05:15:12.814: INFO: Unexpected error: I0625 05:23:45.643] <*errors.errorString | 0xc000e81010>: { I0625 05:23:45.643] s: "VolumeSnapshot snapshot-cv4dc is not ready within 5m0s", I0625 05:23:45.643] } I0625 05:23:45.643] Jun 25 05:15:12.815: FAIL: VolumeSnapshot snapshot-cv4dc is not ready within 5m0s I0625 05:23:45.644] I0625 05:23:45.644] Full Stack Trace I0625 05:23:45.644] k8s.io/kubernetes/test/e2e/storage/utils.GetSnapshotContentFromSnapshot({0x7a661a0, 0xc00375f6d0?}, 0xc0036720c0) I0625 05:23:45.644] test/e2e/storage/utils/snapshot.go:86 +0x1ad I0625 05:23:45.644] k8s.io/kubernetes/test/e2e/storage/framework.CreateSnapshotResource({0x7faf340cdbf8, 0xc000d67760}, 0xc001eb0540, {{0x720b712, 0x17}, {0x0, 0x0}, {0x71c4fef, 0x9}, {0x0, ...}, ...}, ...) I0625 05:23:45.644] test/e2e/storage/framework/snapshot_resource.go:92 +0x246 ... skipping 251 lines ... I0625 05:23:45.690] Jun 25 05:23:04.847: INFO: Pod "pod-af5879b4-c263-452c-b0f7-5b1e90532cdd": Phase="Pending", Reason="", readiness=false. Elapsed: 7m52.010754144s I0625 05:23:45.690] Jun 25 05:23:06.846: INFO: Pod "pod-af5879b4-c263-452c-b0f7-5b1e90532cdd": Phase="Pending", Reason="", readiness=false. Elapsed: 7m54.009758813s I0625 05:23:45.690] Jun 25 05:23:08.846: INFO: Pod "pod-af5879b4-c263-452c-b0f7-5b1e90532cdd": Phase="Pending", Reason="", readiness=false. Elapsed: 7m56.009813546s I0625 05:23:45.691] Jun 25 05:23:10.849: INFO: Pod "pod-af5879b4-c263-452c-b0f7-5b1e90532cdd": Phase="Pending", Reason="", readiness=false. Elapsed: 7m58.012736248s I0625 05:23:45.691] Jun 25 05:23:12.846: INFO: Pod "pod-af5879b4-c263-452c-b0f7-5b1e90532cdd": Phase="Pending", Reason="", readiness=false. Elapsed: 8m0.008917744s I0625 05:23:45.691] Jun 25 05:23:12.848: INFO: Pod "pod-af5879b4-c263-452c-b0f7-5b1e90532cdd": Phase="Pending", Reason="", readiness=false. Elapsed: 8m0.011813673s I0625 05:23:45.691] Jun 25 05:23:12.849: INFO: Unexpected error: I0625 05:23:45.691] <*errors.errorString | 0xc0022705e0>: { I0625 05:23:45.691] s: "pod \"pod-af5879b4-c263-452c-b0f7-5b1e90532cdd\" is not Running: timed out while waiting for pod provisioning-8420/pod-af5879b4-c263-452c-b0f7-5b1e90532cdd to be running", I0625 05:23:45.691] } I0625 05:23:45.692] Jun 25 05:23:12.849: FAIL: pod "pod-af5879b4-c263-452c-b0f7-5b1e90532cdd" is not Running: timed out while waiting for pod provisioning-8420/pod-af5879b4-c263-452c-b0f7-5b1e90532cdd to be running I0625 05:23:45.692] I0625 05:23:45.692] Full Stack Trace I0625 05:23:45.692] k8s.io/kubernetes/test/e2e/storage/testsuites.StorageClassTest.TestDynamicProvisioning({{0x7ac14c8, 0xc0022ca300}, 0xc0039b2780, 0xc000b81500, 0xc000b816c0, 0xc000040300, {0x0, 0x0}, {0x0, 0x0, ...}, ...}) I0625 05:23:45.692] test/e2e/storage/testsuites/provisioning.go:631 +0x828 I0625 05:23:45.692] k8s.io/kubernetes/test/e2e/storage/testsuites.(*provisioningTestSuite).DefineTests.func4() I0625 05:23:45.692] test/e2e/storage/testsuites/provisioning.go:243 +0x618 ... skipping 45 lines ... I0625 05:23:45.700] Jun 25 05:23:44.993: INFO: At 2022-06-25 05:09:19 +0000 UTC - event for external-injector: {default-scheduler } Scheduled: Successfully assigned provisioning-8420/external-injector to e2e-test-prow-windows-node-group-w48h I0625 05:23:45.700] Jun 25 05:23:44.993: INFO: At 2022-06-25 05:09:23 +0000 UTC - event for external-injector: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-4bfbfc87-0aab-4c4c-a340-f81008d33875" I0625 05:23:45.700] Jun 25 05:23:44.993: INFO: At 2022-06-25 05:09:59 +0000 UTC - event for external-injector: {kubelet e2e-test-prow-windows-node-group-w48h} Created: Created container external-injector I0625 05:23:45.700] Jun 25 05:23:44.993: INFO: At 2022-06-25 05:09:59 +0000 UTC - event for external-injector: {kubelet e2e-test-prow-windows-node-group-w48h} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.39" already present on machine I0625 05:23:45.700] Jun 25 05:23:44.993: INFO: At 2022-06-25 05:10:02 +0000 UTC - event for external-injector: {kubelet e2e-test-prow-windows-node-group-w48h} Started: Started container external-injector I0625 05:23:45.701] Jun 25 05:23:44.993: INFO: At 2022-06-25 05:10:05 +0000 UTC - event for external-injector: {kubelet e2e-test-prow-windows-node-group-w48h} Killing: Stopping container external-injector I0625 05:23:45.701] Jun 25 05:23:44.993: INFO: At 2022-06-25 05:10:12 +0000 UTC - event for snapshot-cv4dc: {snapshot-controller } SnapshotFinalizerError: Failed to check and update snapshot: snapshot controller failed to update provisioning-8420/snapshot-cv4dc on API server: volumesnapshots.snapshot.storage.k8s.io "snapshot-cv4dc" is forbidden: User "system:serviceaccount:kube-system:volume-snapshot-controller" cannot patch resource "volumesnapshots" in API group "snapshot.storage.k8s.io" in the namespace "provisioning-8420" I0625 05:23:45.701] Jun 25 05:23:44.993: INFO: At 2022-06-25 05:10:12 +0000 UTC - event for snapshot-cv4dc: {snapshot-controller } CreatingSnapshot: Waiting for a snapshot provisioning-8420/snapshot-cv4dc to be created by the CSI driver. I0625 05:23:45.702] Jun 25 05:23:44.993: INFO: At 2022-06-25 05:15:12 +0000 UTC - event for pvc-m9vz5: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding I0625 05:23:45.702] Jun 25 05:23:44.993: INFO: At 2022-06-25 05:15:12 +0000 UTC - event for pvc-m9vz5: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "pd.csi.storage.gke.io" or manually created by system administrator I0625 05:23:45.702] Jun 25 05:23:44.993: INFO: At 2022-06-25 05:15:12 +0000 UTC - event for pvc-m9vz5: {pd.csi.storage.gke.io_e2e-test-prow-minion-group-82f5_4c40b180-252f-44fe-89ec-1323b3b31f9a } Provisioning: External provisioner is provisioning volume for claim "provisioning-8420/pvc-m9vz5" I0625 05:23:45.703] Jun 25 05:23:44.993: INFO: At 2022-06-25 05:15:12 +0000 UTC - event for pvc-m9vz5: {pd.csi.storage.gke.io_e2e-test-prow-minion-group-82f5_4c40b180-252f-44fe-89ec-1323b3b31f9a } ProvisioningFailed: failed to provision volume with StorageClass "provisioning-8420-e2e-sctbq2f": error getting handle for DataSource Type VolumeSnapshot by Name snapshot-cv4dc: snapshot snapshot-cv4dc is not Ready I0625 05:23:45.703] Jun 25 05:23:44.993: INFO: At 2022-06-25 05:23:12 +0000 UTC - event for snapshot-cv4dc: {snapshot-controller } SnapshotDeletePending: Snapshot is being used to restore a PVC I0625 05:23:45.703] Jun 25 05:23:44.993: INFO: At 2022-06-25 05:23:13 +0000 UTC - event for pod-af5879b4-c263-452c-b0f7-5b1e90532cdd: {default-scheduler } FailedScheduling: running PreBind plugin "VolumeBinding": binding volumes: failed to check provisioning pvc: could not find v1.PersistentVolumeClaim "provisioning-8420/pvc-m9vz5" I0625 05:23:45.703] Jun 25 05:23:44.993: INFO: At 2022-06-25 05:23:14 +0000 UTC - event for pod-af5879b4-c263-452c-b0f7-5b1e90532cdd: {default-scheduler } FailedScheduling: 0/5 nodes are available: 5 persistentvolumeclaim "pvc-m9vz5" not found. preemption: 0/5 nodes are available: 5 Preemption is not helpful for scheduling. I0625 05:23:45.704] Jun 25 05:23:44.996: INFO: POD NODE PHASE GRACE CONDITIONS I0625 05:23:45.704] Jun 25 05:23:44.996: INFO: pod-af5879b4-c263-452c-b0f7-5b1e90532cdd Pending [{PodScheduled False 0001-01-01 00:00:00 +0000 UTC 2022-06-25 05:23:13 +0000 UTC Unschedulable 0/5 nodes are available: 5 persistentvolumeclaim "pvc-m9vz5" not found. preemption: 0/5 nodes are available: 5 Preemption is not helpful for scheduling.}] I0625 05:23:45.704] Jun 25 05:23:44.996: INFO: I0625 05:23:45.704] Jun 25 05:23:45.004: INFO: I0625 05:23:45.704] Logging node info for node e2e-test-prow-master ... skipping 128 lines ... I0625 05:23:45.751] [90mtest/e2e/storage/testsuites/provisioning.go:208[0m I0625 05:23:45.751] I0625 05:23:45.752] [91mJun 25 05:15:12.815: VolumeSnapshot snapshot-cv4dc is not ready within 5m0s[0m I0625 05:23:45.752] I0625 05:23:45.752] test/e2e/storage/utils/snapshot.go:86 I0625 05:23:45.752] [90m------------------------------[0m I0625 05:23:45.752] {"msg":"FAILED External Storage [Driver: csi-gcepd-sc-windows--pd-volumesnapshotclass] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource]","total":-1,"completed":0,"skipped":195,"failed":1,"failures":["External Storage [Driver: csi-gcepd-sc-windows--pd-volumesnapshotclass] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource]"]} I0625 05:23:45.752] I0625 05:24:15.135] [36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m I0625 05:24:15.135] [90m------------------------------[0m I0625 05:24:15.135] [BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning I0625 05:24:15.136] test/e2e/storage/framework/testsuite.go:51 I0625 05:24:15.136] [BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning ... skipping 229 lines ... I0625 05:24:15.183] Jun 25 05:15:27.648: INFO: VolumeSnapshot snapshot-t8hqm found but is not ready. I0625 05:24:15.183] Jun 25 05:15:29.654: INFO: VolumeSnapshot snapshot-t8hqm found but is not ready. I0625 05:24:15.184] Jun 25 05:15:31.659: INFO: VolumeSnapshot snapshot-t8hqm found but is not ready. I0625 05:24:15.184] Jun 25 05:15:33.664: INFO: VolumeSnapshot snapshot-t8hqm found but is not ready. I0625 05:24:15.184] Jun 25 05:15:35.670: INFO: VolumeSnapshot snapshot-t8hqm found but is not ready. I0625 05:24:15.184] Jun 25 05:15:37.676: INFO: VolumeSnapshot snapshot-t8hqm found but is not ready. I0625 05:24:15.184] Jun 25 05:15:39.676: INFO: WaitUntil failed after reaching the timeout 5m0s I0625 05:24:15.185] Jun 25 05:15:39.677: INFO: Unexpected error: I0625 05:24:15.185] <*errors.errorString | 0xc00371b6c0>: { I0625 05:24:15.185] s: "VolumeSnapshot snapshot-t8hqm is not ready within 5m0s", I0625 05:24:15.185] } I0625 05:24:15.185] Jun 25 05:15:39.677: FAIL: VolumeSnapshot snapshot-t8hqm is not ready within 5m0s I0625 05:24:15.185] I0625 05:24:15.186] Full Stack Trace I0625 05:24:15.186] k8s.io/kubernetes/test/e2e/storage/utils.GetSnapshotContentFromSnapshot({0x7a661a0, 0xc0036b7ae8?}, 0xc003f24090) I0625 05:24:15.186] test/e2e/storage/utils/snapshot.go:86 +0x1ad I0625 05:24:15.186] k8s.io/kubernetes/test/e2e/storage/framework.CreateSnapshotResource({0x7f7e6c151c98, 0xc00068ba20}, 0xc003f12120, {{0x71e6c8c, 0x11}, {0x71e8f03, 0x11}, {0x71c4fef, 0x9}, {0x71ba6a1, ...}, ...}, ...) I0625 05:24:15.187] test/e2e/storage/framework/snapshot_resource.go:92 +0x246 ... skipping 251 lines ... I0625 05:24:15.237] Jun 25 05:23:31.705: INFO: Pod "pod-96c55e63-141c-465b-9080-02c897cc1d8d": Phase="Pending", Reason="", readiness=false. Elapsed: 7m52.008144438s I0625 05:24:15.238] Jun 25 05:23:33.704: INFO: Pod "pod-96c55e63-141c-465b-9080-02c897cc1d8d": Phase="Pending", Reason="", readiness=false. Elapsed: 7m54.007872913s I0625 05:24:15.238] Jun 25 05:23:35.705: INFO: Pod "pod-96c55e63-141c-465b-9080-02c897cc1d8d": Phase="Pending", Reason="", readiness=false. Elapsed: 7m56.008883587s I0625 05:24:15.238] Jun 25 05:23:37.703: INFO: Pod "pod-96c55e63-141c-465b-9080-02c897cc1d8d": Phase="Pending", Reason="", readiness=false. Elapsed: 7m58.006967046s I0625 05:24:15.238] Jun 25 05:23:39.704: INFO: Pod "pod-96c55e63-141c-465b-9080-02c897cc1d8d": Phase="Pending", Reason="", readiness=false. Elapsed: 8m0.00745747s I0625 05:24:15.239] Jun 25 05:23:39.707: INFO: Pod "pod-96c55e63-141c-465b-9080-02c897cc1d8d": Phase="Pending", Reason="", readiness=false. Elapsed: 8m0.010664643s I0625 05:24:15.239] Jun 25 05:23:39.707: INFO: Unexpected error: I0625 05:24:15.239] <*errors.errorString | 0xc003708000>: { I0625 05:24:15.239] s: "pod \"pod-96c55e63-141c-465b-9080-02c897cc1d8d\" is not Running: timed out while waiting for pod provisioning-819/pod-96c55e63-141c-465b-9080-02c897cc1d8d to be running", I0625 05:24:15.239] } I0625 05:24:15.240] Jun 25 05:23:39.708: FAIL: pod "pod-96c55e63-141c-465b-9080-02c897cc1d8d" is not Running: timed out while waiting for pod provisioning-819/pod-96c55e63-141c-465b-9080-02c897cc1d8d to be running I0625 05:24:15.240] I0625 05:24:15.240] Full Stack Trace I0625 05:24:15.240] k8s.io/kubernetes/test/e2e/storage/testsuites.StorageClassTest.TestDynamicProvisioning({{0x7ac14c8, 0xc002b54c00}, 0xc002d1bf80, 0xc003f42000, 0xc003f421c0, 0xc003f34480, {0x0, 0x0}, {0x0, 0x0, ...}, ...}) I0625 05:24:15.240] test/e2e/storage/testsuites/provisioning.go:631 +0x828 I0625 05:24:15.240] k8s.io/kubernetes/test/e2e/storage/testsuites.(*provisioningTestSuite).DefineTests.func4() I0625 05:24:15.240] test/e2e/storage/testsuites/provisioning.go:243 +0x618 ... skipping 46 lines ... I0625 05:24:15.249] Jun 25 05:24:11.857: INFO: At 2022-06-25 05:09:27 +0000 UTC - event for external-injector: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-70bb7aab-7e3e-49d0-9bea-dbda574a9e6e" I0625 05:24:15.250] Jun 25 05:24:11.857: INFO: At 2022-06-25 05:10:22 +0000 UTC - event for external-injector: {kubelet e2e-test-prow-windows-node-group-qhph} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.39" already present on machine I0625 05:24:15.250] Jun 25 05:24:11.857: INFO: At 2022-06-25 05:10:22 +0000 UTC - event for external-injector: {kubelet e2e-test-prow-windows-node-group-qhph} Created: Created container external-injector I0625 05:24:15.251] Jun 25 05:24:11.857: INFO: At 2022-06-25 05:10:26 +0000 UTC - event for external-injector: {kubelet e2e-test-prow-windows-node-group-qhph} Started: Started container external-injector I0625 05:24:15.251] Jun 25 05:24:11.857: INFO: At 2022-06-25 05:10:29 +0000 UTC - event for external-injector: {kubelet e2e-test-prow-windows-node-group-qhph} Killing: Stopping container external-injector I0625 05:24:15.251] Jun 25 05:24:11.857: INFO: At 2022-06-25 05:10:38 +0000 UTC - event for snapshot-t8hqm: {snapshot-controller } CreatingSnapshot: Waiting for a snapshot provisioning-819/snapshot-t8hqm to be created by the CSI driver. I0625 05:24:15.252] Jun 25 05:24:11.857: INFO: At 2022-06-25 05:10:38 +0000 UTC - event for snapshot-t8hqm: {snapshot-controller } SnapshotFinalizerError: Failed to check and update snapshot: snapshot controller failed to update provisioning-819/snapshot-t8hqm on API server: volumesnapshots.snapshot.storage.k8s.io "snapshot-t8hqm" is forbidden: User "system:serviceaccount:kube-system:volume-snapshot-controller" cannot patch resource "volumesnapshots" in API group "snapshot.storage.k8s.io" in the namespace "provisioning-819" I0625 05:24:15.252] Jun 25 05:24:11.857: INFO: At 2022-06-25 05:15:39 +0000 UTC - event for pvc-6gktg: {pd.csi.storage.gke.io_e2e-test-prow-minion-group-82f5_4c40b180-252f-44fe-89ec-1323b3b31f9a } ProvisioningFailed: failed to provision volume with StorageClass "provisioning-819-e2e-scwg2j9": error getting handle for DataSource Type VolumeSnapshot by Name snapshot-t8hqm: snapshot snapshot-t8hqm is not Ready I0625 05:24:15.253] Jun 25 05:24:11.857: INFO: At 2022-06-25 05:15:39 +0000 UTC - event for pvc-6gktg: {pd.csi.storage.gke.io_e2e-test-prow-minion-group-82f5_4c40b180-252f-44fe-89ec-1323b3b31f9a } Provisioning: External provisioner is provisioning volume for claim "provisioning-819/pvc-6gktg" I0625 05:24:15.253] Jun 25 05:24:11.857: INFO: At 2022-06-25 05:15:39 +0000 UTC - event for pvc-6gktg: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding I0625 05:24:15.254] Jun 25 05:24:11.857: INFO: At 2022-06-25 05:15:39 +0000 UTC - event for pvc-6gktg: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "pd.csi.storage.gke.io" or manually created by system administrator I0625 05:24:15.254] Jun 25 05:24:11.857: INFO: At 2022-06-25 05:23:40 +0000 UTC - event for pod-96c55e63-141c-465b-9080-02c897cc1d8d: {default-scheduler } FailedScheduling: running PreBind plugin "VolumeBinding": binding volumes: failed to check provisioning pvc: could not find v1.PersistentVolumeClaim "provisioning-819/pvc-6gktg" I0625 05:24:15.255] Jun 25 05:24:11.857: INFO: At 2022-06-25 05:23:41 +0000 UTC - event for pod-96c55e63-141c-465b-9080-02c897cc1d8d: {default-scheduler } FailedScheduling: 0/5 nodes are available: 5 persistentvolumeclaim "pvc-6gktg" not found. preemption: 0/5 nodes are available: 5 Preemption is not helpful for scheduling. I0625 05:24:15.255] Jun 25 05:24:11.860: INFO: POD NODE PHASE GRACE CONDITIONS I0625 05:24:15.256] Jun 25 05:24:11.860: INFO: pod-96c55e63-141c-465b-9080-02c897cc1d8d Pending [{PodScheduled False 0001-01-01 00:00:00 +0000 UTC 2022-06-25 05:23:40 +0000 UTC Unschedulable 0/5 nodes are available: 5 persistentvolumeclaim "pvc-6gktg" not found. preemption: 0/5 nodes are available: 5 Preemption is not helpful for scheduling.}] I0625 05:24:15.256] Jun 25 05:24:11.860: INFO: I0625 05:24:15.256] Jun 25 05:24:11.867: INFO: I0625 05:24:15.256] Logging node info for node e2e-test-prow-master ... skipping 130 lines ... I0625 05:24:15.310] [90mtest/e2e/storage/testsuites/provisioning.go:208[0m I0625 05:24:15.310] I0625 05:24:15.311] [91mJun 25 05:15:39.677: VolumeSnapshot snapshot-t8hqm is not ready within 5m0s[0m I0625 05:24:15.311] I0625 05:24:15.311] test/e2e/storage/utils/snapshot.go:86 I0625 05:24:15.311] [90m------------------------------[0m I0625 05:24:15.312] {"msg":"FAILED External Storage [Driver: csi-gcepd-sc-windows--pd-volumesnapshotclass] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource]","total":-1,"completed":0,"skipped":556,"failed":1,"failures":["External Storage [Driver: csi-gcepd-sc-windows--pd-volumesnapshotclass] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource]"]} I0625 05:24:15.312] I0625 05:24:15.329] [36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m I0625 05:24:15.329] [90m------------------------------[0m I0625 05:24:15.329] [BeforeEach] [Testpattern: Pre-provisioned Snapshot (delete policy)] snapshottable[Feature:VolumeSnapshotDataSource] I0625 05:24:15.329] test/e2e/storage/framework/testsuite.go:51 I0625 05:24:15.329] [BeforeEach] [Testpattern: Pre-provisioned Snapshot (delete policy)] snapshottable[Feature:VolumeSnapshotDataSource] ... skipping 82 lines ... I0625 05:37:22.774] [It] should check snapshot fields, check restore correctly works, check deletion (ephemeral) I0625 05:37:22.774] test/e2e/storage/testsuites/snapshottable.go:177 I0625 05:37:22.774] Jun 25 05:20:33.922: INFO: Creating resource for dynamic PV I0625 05:37:22.774] Jun 25 05:20:33.922: INFO: Using claimSize:5Gi, test suite supported size:{ 1Mi}, driver(csi-gcepd-sc-windows--pd-volumesnapshotclass) supported size:{ 1Mi} I0625 05:37:22.774] [1mSTEP[0m: creating a StorageClass snapshotting-9608-e2e-sc7fl82 I0625 05:37:22.774] [1mSTEP[0m: [init] starting a pod to use the claim I0625 05:37:22.775] Jun 25 05:20:33.937: INFO: Waiting up to 15m0s for pod "pvc-snapshottable-tester-dm9dk" in namespace "snapshotting-9608" to be "Succeeded or Failed" I0625 05:37:22.775] Jun 25 05:20:33.943: INFO: Pod "pvc-snapshottable-tester-dm9dk": Phase="Pending", Reason="", readiness=false. Elapsed: 5.75311ms I0625 05:37:22.775] Jun 25 05:20:35.948: INFO: Pod "pvc-snapshottable-tester-dm9dk": Phase="Pending", Reason="", readiness=false. Elapsed: 2.010139473s I0625 05:37:22.775] Jun 25 05:20:37.953: INFO: Pod "pvc-snapshottable-tester-dm9dk": Phase="Pending", Reason="", readiness=false. Elapsed: 4.015121616s I0625 05:37:22.775] Jun 25 05:20:39.947: INFO: Pod "pvc-snapshottable-tester-dm9dk": Phase="Pending", Reason="", readiness=false. Elapsed: 6.009510057s I0625 05:37:22.776] Jun 25 05:20:41.947: INFO: Pod "pvc-snapshottable-tester-dm9dk": Phase="Pending", Reason="", readiness=false. Elapsed: 8.009529012s I0625 05:37:22.776] Jun 25 05:20:43.948: INFO: Pod "pvc-snapshottable-tester-dm9dk": Phase="Pending", Reason="", readiness=false. Elapsed: 10.010590783s ... skipping 18 lines ... I0625 05:37:22.779] Jun 25 05:21:21.949: INFO: Pod "pvc-snapshottable-tester-dm9dk": Phase="Pending", Reason="", readiness=false. Elapsed: 48.011871374s I0625 05:37:22.779] Jun 25 05:21:23.948: INFO: Pod "pvc-snapshottable-tester-dm9dk": Phase="Pending", Reason="", readiness=false. Elapsed: 50.011004716s I0625 05:37:22.779] Jun 25 05:21:25.948: INFO: Pod "pvc-snapshottable-tester-dm9dk": Phase="Running", Reason="", readiness=true. Elapsed: 52.010074348s I0625 05:37:22.780] Jun 25 05:21:27.949: INFO: Pod "pvc-snapshottable-tester-dm9dk": Phase="Running", Reason="", readiness=false. Elapsed: 54.011155615s I0625 05:37:22.780] Jun 25 05:21:29.947: INFO: Pod "pvc-snapshottable-tester-dm9dk": Phase="Succeeded", Reason="", readiness=false. Elapsed: 56.00969755s I0625 05:37:22.780] [1mSTEP[0m: Saw pod success I0625 05:37:22.780] Jun 25 05:21:29.947: INFO: Pod "pvc-snapshottable-tester-dm9dk" satisfied condition "Succeeded or Failed" I0625 05:37:22.780] [1mSTEP[0m: [init] checking the claim I0625 05:37:22.780] [1mSTEP[0m: creating a SnapshotClass I0625 05:37:22.781] [1mSTEP[0m: creating a dynamic VolumeSnapshot I0625 05:37:22.781] Jun 25 05:21:29.964: INFO: Waiting up to 5m0s for VolumeSnapshot snapshot-dkmnc to become ready I0625 05:37:22.781] Jun 25 05:21:29.967: INFO: VolumeSnapshot snapshot-dkmnc found but is not ready. I0625 05:37:22.781] Jun 25 05:21:31.972: INFO: VolumeSnapshot snapshot-dkmnc found but is not ready. ... skipping 142 lines ... I0625 05:37:22.805] Jun 25 05:26:18.763: INFO: VolumeSnapshot snapshot-dkmnc found but is not ready. I0625 05:37:22.805] Jun 25 05:26:20.768: INFO: VolumeSnapshot snapshot-dkmnc found but is not ready. I0625 05:37:22.805] Jun 25 05:26:22.772: INFO: VolumeSnapshot snapshot-dkmnc found but is not ready. I0625 05:37:22.805] Jun 25 05:26:24.776: INFO: VolumeSnapshot snapshot-dkmnc found but is not ready. I0625 05:37:22.806] Jun 25 05:26:26.781: INFO: VolumeSnapshot snapshot-dkmnc found but is not ready. I0625 05:37:22.806] Jun 25 05:26:28.787: INFO: VolumeSnapshot snapshot-dkmnc found but is not ready. I0625 05:37:22.806] Jun 25 05:26:30.787: INFO: WaitUntil failed after reaching the timeout 5m0s I0625 05:37:22.806] Jun 25 05:26:30.787: INFO: Unexpected error: I0625 05:37:22.806] <*errors.errorString | 0xc0044b13a0>: { I0625 05:37:22.807] s: "VolumeSnapshot snapshot-dkmnc is not ready within 5m0s", I0625 05:37:22.807] } I0625 05:37:22.807] Jun 25 05:26:30.787: FAIL: VolumeSnapshot snapshot-dkmnc is not ready within 5m0s I0625 05:37:22.807] I0625 05:37:22.807] Full Stack Trace I0625 05:37:22.807] k8s.io/kubernetes/test/e2e/storage/utils.GetSnapshotContentFromSnapshot({0x7a661a0, 0xc0034bc1f8?}, 0xc002de5cf8) I0625 05:37:22.808] test/e2e/storage/utils/snapshot.go:86 +0x1ad I0625 05:37:22.808] k8s.io/kubernetes/test/e2e/storage/framework.CreateSnapshotResource({0x7f9c3cc20f08, 0xc000bd3600}, 0xc003418960, {{0x725c20b, 0x22}, {0x0, 0x0}, {0x7205442, 0x16}, {0x0, ...}, ...}, ...) I0625 05:37:22.808] test/e2e/storage/framework/snapshot_resource.go:92 +0x246 ... skipping 359 lines ... I0625 05:37:22.893] Jun 25 05:37:10.961: INFO: volumesnapshotcontents snapcontent-8f368068-758a-48c1-81c8-d066492ed74a has been found and is not deleted I0625 05:37:22.893] Jun 25 05:37:11.966: INFO: volumesnapshotcontents snapcontent-8f368068-758a-48c1-81c8-d066492ed74a has been found and is not deleted I0625 05:37:22.893] Jun 25 05:37:12.971: INFO: volumesnapshotcontents snapcontent-8f368068-758a-48c1-81c8-d066492ed74a has been found and is not deleted I0625 05:37:22.894] Jun 25 05:37:13.976: INFO: volumesnapshotcontents snapcontent-8f368068-758a-48c1-81c8-d066492ed74a has been found and is not deleted I0625 05:37:22.894] Jun 25 05:37:14.980: INFO: volumesnapshotcontents snapcontent-8f368068-758a-48c1-81c8-d066492ed74a has been found and is not deleted I0625 05:37:22.894] Jun 25 05:37:15.984: INFO: volumesnapshotcontents snapcontent-8f368068-758a-48c1-81c8-d066492ed74a has been found and is not deleted I0625 05:37:22.894] Jun 25 05:37:16.985: INFO: WaitUntil failed after reaching the timeout 30s I0625 05:37:22.895] [AfterEach] volume snapshot controller I0625 05:37:22.895] test/e2e/storage/testsuites/snapshottable.go:172 I0625 05:37:22.895] Jun 25 05:37:17.023: INFO: Pod restored-pvc-tester-8495z has the following logs: I0625 05:37:22.895] Jun 25 05:37:17.023: INFO: Deleting pod "restored-pvc-tester-8495z" in namespace "snapshotting-9608" I0625 05:37:22.895] Jun 25 05:37:17.029: INFO: Wait up to 5m0s for pod "restored-pvc-tester-8495z" to be fully deleted I0625 05:37:22.896] Jun 25 05:37:21.038: INFO: deleting snapshot "snapshotting-9608"/"snapshot-dkmnc" ... skipping 19 lines ... I0625 05:37:22.901] Jun 25 05:37:21.070: INFO: At 2022-06-25 05:21:21 +0000 UTC - event for pvc-snapshottable-tester-dm9dk: {kubelet e2e-test-prow-windows-node-group-qhph} Created: Created container volume-tester I0625 05:37:22.902] Jun 25 05:37:21.070: INFO: At 2022-06-25 05:21:24 +0000 UTC - event for pvc-snapshottable-tester-dm9dk: {kubelet e2e-test-prow-windows-node-group-qhph} Started: Started container volume-tester I0625 05:37:22.902] Jun 25 05:37:21.070: INFO: At 2022-06-25 05:21:30 +0000 UTC - event for snapshot-dkmnc: {snapshot-controller } CreatingSnapshot: Waiting for a snapshot snapshotting-9608/snapshot-dkmnc to be created by the CSI driver. I0625 05:37:22.902] Jun 25 05:37:21.070: INFO: At 2022-06-25 05:26:30 +0000 UTC - event for restored-pvc-tester-8495z: {default-scheduler } FailedScheduling: 0/5 nodes are available: 5 waiting for ephemeral volume controller to create the persistentvolumeclaim "restored-pvc-tester-8495z-my-volume". preemption: 0/5 nodes are available: 5 Preemption is not helpful for scheduling. I0625 05:37:22.903] Jun 25 05:37:21.070: INFO: At 2022-06-25 05:26:30 +0000 UTC - event for restored-pvc-tester-8495z-my-volume: {persistentvolume-controller } WaitForPodScheduled: waiting for pod restored-pvc-tester-8495z to be scheduled I0625 05:37:22.903] Jun 25 05:37:21.070: INFO: At 2022-06-25 05:26:32 +0000 UTC - event for restored-pvc-tester-8495z-my-volume: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "pd.csi.storage.gke.io" or manually created by system administrator I0625 05:37:22.904] Jun 25 05:37:21.070: INFO: At 2022-06-25 05:26:32 +0000 UTC - event for restored-pvc-tester-8495z-my-volume: {pd.csi.storage.gke.io_e2e-test-prow-minion-group-82f5_4c40b180-252f-44fe-89ec-1323b3b31f9a } ProvisioningFailed: failed to provision volume with StorageClass "snapshotting-9608-e2e-sc7fl82": error getting handle for DataSource Type VolumeSnapshot by Name snapshot-dkmnc: snapshot snapshot-dkmnc is not Ready I0625 05:37:22.904] Jun 25 05:37:21.070: INFO: At 2022-06-25 05:26:32 +0000 UTC - event for restored-pvc-tester-8495z-my-volume: {pd.csi.storage.gke.io_e2e-test-prow-minion-group-82f5_4c40b180-252f-44fe-89ec-1323b3b31f9a } Provisioning: External provisioner is provisioning volume for claim "snapshotting-9608/restored-pvc-tester-8495z-my-volume" I0625 05:37:22.904] Jun 25 05:37:21.070: INFO: At 2022-06-25 05:35:23 +0000 UTC - event for snapshot-dkmnc: {snapshot-controller } SnapshotCreated: Snapshot snapshotting-9608/snapshot-dkmnc was successfully created by the CSI driver. I0625 05:37:22.905] Jun 25 05:37:21.070: INFO: At 2022-06-25 05:35:23 +0000 UTC - event for snapshot-dkmnc: {snapshot-controller } SnapshotReady: Snapshot snapshotting-9608/snapshot-dkmnc is ready to use. I0625 05:37:22.905] Jun 25 05:37:21.070: INFO: At 2022-06-25 05:36:09 +0000 UTC - event for restored-pvc-tester-8495z-my-volume: {pd.csi.storage.gke.io_e2e-test-prow-minion-group-82f5_4c40b180-252f-44fe-89ec-1323b3b31f9a } ProvisioningSucceeded: Successfully provisioned volume pvc-6728e7da-9597-4607-88c2-47b75b825759 I0625 05:37:22.905] Jun 25 05:37:21.070: INFO: At 2022-06-25 05:36:10 +0000 UTC - event for restored-pvc-tester-8495z: {default-scheduler } Scheduled: Successfully assigned snapshotting-9608/restored-pvc-tester-8495z to e2e-test-prow-windows-node-group-qhph I0625 05:37:22.906] Jun 25 05:37:21.070: INFO: At 2022-06-25 05:36:14 +0000 UTC - event for restored-pvc-tester-8495z: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-6728e7da-9597-4607-88c2-47b75b825759" ... skipping 138 lines ... I0625 05:37:22.962] [90mtest/e2e/storage/testsuites/snapshottable.go:177[0m I0625 05:37:22.962] I0625 05:37:22.962] [91mJun 25 05:26:30.787: VolumeSnapshot snapshot-dkmnc is not ready within 5m0s[0m I0625 05:37:22.962] I0625 05:37:22.962] test/e2e/storage/utils/snapshot.go:86 I0625 05:37:22.962] [90m------------------------------[0m I0625 05:37:22.964] {"msg":"FAILED External Storage [Driver: csi-gcepd-sc-windows--pd-volumesnapshotclass] [Testpattern: Ephemeral Snapshot (retain policy)] snapshottable[Feature:VolumeSnapshotDataSource] volume snapshot controller should check snapshot fields, check restore correctly works, check deletion (ephemeral)","total":-1,"completed":0,"skipped":2604,"failed":2,"failures":["External Storage [Driver: csi-gcepd-sc-windows--pd-volumesnapshotclass] [Testpattern: Pre-provisioned Snapshot (retain policy)] snapshottable[Feature:VolumeSnapshotDataSource] volume snapshot controller should check snapshot fields, check restore correctly works after modifying source data, check deletion (persistent)","External Storage [Driver: csi-gcepd-sc-windows--pd-volumesnapshotclass] [Testpattern: Ephemeral Snapshot (retain policy)] snapshottable[Feature:VolumeSnapshotDataSource] volume snapshot controller should check snapshot fields, check restore correctly works, check deletion (ephemeral)"]} I0625 05:37:22.964] I0625 05:37:24.354] [36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m I0625 05:37:24.355] [90m------------------------------[0m I0625 05:37:24.355] Jun 25 05:37:24.353: INFO: Running AfterSuite actions on all nodes I0625 05:37:24.355] Jun 25 05:37:24.354: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage.glob..func19.2 I0625 05:37:24.355] Jun 25 05:37:24.354: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage.glob..func9.2 ... skipping 19 lines ... I0625 05:41:09.401] Jun 25 05:24:15.607: INFO: Using claimSize:5Gi, test suite supported size:{ 1Mi}, driver(csi-gcepd-sc-windows--pd-volumesnapshotclass) supported size:{ 1Mi} I0625 05:41:09.401] [1mSTEP[0m: creating a StorageClass snapshotting-6789-e2e-sc6rnl9 I0625 05:41:09.401] [1mSTEP[0m: creating a claim I0625 05:41:09.401] Jun 25 05:24:15.610: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil I0625 05:41:09.401] [1mSTEP[0m: [init] starting a pod to use the claim I0625 05:41:09.401] [1mSTEP[0m: [init] check pod success I0625 05:41:09.401] Jun 25 05:24:15.629: INFO: Waiting up to 15m0s for pod "pvc-snapshottable-tester-d8mqh" in namespace "snapshotting-6789" to be "Succeeded or Failed" I0625 05:41:09.402] Jun 25 05:24:15.635: INFO: Pod "pvc-snapshottable-tester-d8mqh": Phase="Pending", Reason="", readiness=false. Elapsed: 5.999004ms I0625 05:41:09.402] Jun 25 05:24:17.639: INFO: Pod "pvc-snapshottable-tester-d8mqh": Phase="Pending", Reason="", readiness=false. Elapsed: 2.010098858s I0625 05:41:09.402] Jun 25 05:24:19.642: INFO: Pod "pvc-snapshottable-tester-d8mqh": Phase="Pending", Reason="", readiness=false. Elapsed: 4.012510506s I0625 05:41:09.402] Jun 25 05:24:21.640: INFO: Pod "pvc-snapshottable-tester-d8mqh": Phase="Pending", Reason="", readiness=false. Elapsed: 6.010348619s I0625 05:41:09.402] Jun 25 05:24:23.639: INFO: Pod "pvc-snapshottable-tester-d8mqh": Phase="Pending", Reason="", readiness=false. Elapsed: 8.009832706s I0625 05:41:09.402] Jun 25 05:24:25.640: INFO: Pod "pvc-snapshottable-tester-d8mqh": Phase="Pending", Reason="", readiness=false. Elapsed: 10.010229897s ... skipping 17 lines ... I0625 05:41:09.405] Jun 25 05:25:01.640: INFO: Pod "pvc-snapshottable-tester-d8mqh": Phase="Pending", Reason="", readiness=false. Elapsed: 46.010260247s I0625 05:41:09.406] Jun 25 05:25:03.640: INFO: Pod "pvc-snapshottable-tester-d8mqh": Phase="Pending", Reason="", readiness=false. Elapsed: 48.01027588s I0625 05:41:09.406] Jun 25 05:25:05.639: INFO: Pod "pvc-snapshottable-tester-d8mqh": Phase="Running", Reason="", readiness=true. Elapsed: 50.010094455s I0625 05:41:09.406] Jun 25 05:25:07.679: INFO: Pod "pvc-snapshottable-tester-d8mqh": Phase="Running", Reason="", readiness=false. Elapsed: 52.049442523s I0625 05:41:09.406] Jun 25 05:25:09.640: INFO: Pod "pvc-snapshottable-tester-d8mqh": Phase="Succeeded", Reason="", readiness=false. Elapsed: 54.010380858s I0625 05:41:09.406] [1mSTEP[0m: Saw pod success I0625 05:41:09.406] Jun 25 05:25:09.640: INFO: Pod "pvc-snapshottable-tester-d8mqh" satisfied condition "Succeeded or Failed" I0625 05:41:09.407] [1mSTEP[0m: [init] checking the claim I0625 05:41:09.407] Jun 25 05:25:09.643: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [csi-gcepd-sc-windows--pd-volumesnapshotclass2t5hj] to have phase Bound I0625 05:41:09.407] Jun 25 05:25:09.645: INFO: PersistentVolumeClaim csi-gcepd-sc-windows--pd-volumesnapshotclass2t5hj found and phase=Bound (2.600633ms) I0625 05:41:09.407] [1mSTEP[0m: [init] checking the PV I0625 05:41:09.407] [1mSTEP[0m: [init] deleting the pod I0625 05:41:09.407] Jun 25 05:25:09.661: INFO: Pod pvc-snapshottable-tester-d8mqh has the following logs: ... skipping 159 lines ... I0625 05:41:09.428] Jun 25 05:30:12.503: INFO: VolumeSnapshot snapshot-zhk5f found but is not ready. I0625 05:41:09.428] Jun 25 05:30:14.507: INFO: VolumeSnapshot snapshot-zhk5f found but is not ready. I0625 05:41:09.428] Jun 25 05:30:16.513: INFO: VolumeSnapshot snapshot-zhk5f found but is not ready. I0625 05:41:09.428] Jun 25 05:30:18.518: INFO: VolumeSnapshot snapshot-zhk5f found but is not ready. I0625 05:41:09.428] Jun 25 05:30:20.522: INFO: VolumeSnapshot snapshot-zhk5f found but is not ready. I0625 05:41:09.428] Jun 25 05:30:22.526: INFO: VolumeSnapshot snapshot-zhk5f found but is not ready. I0625 05:41:09.428] Jun 25 05:30:24.527: INFO: WaitUntil failed after reaching the timeout 5m0s I0625 05:41:09.428] Jun 25 05:30:24.527: INFO: Unexpected error: I0625 05:41:09.429] <*errors.errorString | 0xc003efe950>: { I0625 05:41:09.429] s: "VolumeSnapshot snapshot-zhk5f is not ready within 5m0s", I0625 05:41:09.429] } I0625 05:41:09.429] Jun 25 05:30:24.528: FAIL: VolumeSnapshot snapshot-zhk5f is not ready within 5m0s I0625 05:41:09.429] I0625 05:41:09.429] Full Stack Trace I0625 05:41:09.429] k8s.io/kubernetes/test/e2e/storage/utils.GetSnapshotContentFromSnapshot({0x7a661a0, 0xc0040f3c90?}, 0xc0040f3eb0) I0625 05:41:09.429] test/e2e/storage/utils/snapshot.go:86 +0x1ad I0625 05:41:09.429] k8s.io/kubernetes/test/e2e/storage/framework.CreateSnapshotResource({0x7f7e6c151c98, 0xc00068ba20}, 0xc0021ba180, {{0x724c60b, 0x20}, {0x0, 0x0}, {0x71c4fef, 0x9}, {0x0, ...}, ...}, ...) I0625 05:41:09.430] test/e2e/storage/framework/snapshot_resource.go:92 +0x246 ... skipping 8 lines ... I0625 05:41:09.430] created by testing.(*T).Run I0625 05:41:09.431] /usr/local/go/src/testing/testing.go:1486 +0x35f I0625 05:41:09.431] [1mSTEP[0m: checking the snapshot I0625 05:41:09.431] [1mSTEP[0m: checking the SnapshotContent I0625 05:41:09.431] [1mSTEP[0m: Modifying source data test I0625 05:41:09.431] [1mSTEP[0m: modifying the data in the source PVC I0625 05:41:09.431] Jun 25 05:30:24.559: INFO: Waiting up to 15m0s for pod "pvc-snapshottable-data-tester-xf4nt" in namespace "snapshotting-6789" to be "Succeeded or Failed" I0625 05:41:09.431] Jun 25 05:30:24.567: INFO: Pod "pvc-snapshottable-data-tester-xf4nt": Phase="Pending", Reason="", readiness=false. Elapsed: 8.139452ms I0625 05:41:09.431] Jun 25 05:30:26.572: INFO: Pod "pvc-snapshottable-data-tester-xf4nt": Phase="Pending", Reason="", readiness=false. Elapsed: 2.013199472s I0625 05:41:09.432] Jun 25 05:30:28.571: INFO: Pod "pvc-snapshottable-data-tester-xf4nt": Phase="Pending", Reason="", readiness=false. Elapsed: 4.012679156s I0625 05:41:09.432] Jun 25 05:30:30.572: INFO: Pod "pvc-snapshottable-data-tester-xf4nt": Phase="Pending", Reason="", readiness=false. Elapsed: 6.013257491s I0625 05:41:09.432] Jun 25 05:30:32.571: INFO: Pod "pvc-snapshottable-data-tester-xf4nt": Phase="Pending", Reason="", readiness=false. Elapsed: 8.012483061s I0625 05:41:09.432] Jun 25 05:30:34.571: INFO: Pod "pvc-snapshottable-data-tester-xf4nt": Phase="Pending", Reason="", readiness=false. Elapsed: 10.012784351s ... skipping 10 lines ... I0625 05:41:09.434] Jun 25 05:30:56.572: INFO: Pod "pvc-snapshottable-data-tester-xf4nt": Phase="Pending", Reason="", readiness=false. Elapsed: 32.013103788s I0625 05:41:09.434] Jun 25 05:30:58.572: INFO: Pod "pvc-snapshottable-data-tester-xf4nt": Phase="Running", Reason="", readiness=true. Elapsed: 34.013903138s I0625 05:41:09.434] Jun 25 05:31:00.571: INFO: Pod "pvc-snapshottable-data-tester-xf4nt": Phase="Running", Reason="", readiness=false. Elapsed: 36.012626292s I0625 05:41:09.434] Jun 25 05:31:02.572: INFO: Pod "pvc-snapshottable-data-tester-xf4nt": Phase="Running", Reason="", readiness=false. Elapsed: 38.013350172s I0625 05:41:09.435] Jun 25 05:31:04.572: INFO: Pod "pvc-snapshottable-data-tester-xf4nt": Phase="Succeeded", Reason="", readiness=false. Elapsed: 40.013410191s I0625 05:41:09.435] [1mSTEP[0m: Saw pod success I0625 05:41:09.435] Jun 25 05:31:04.572: INFO: Pod "pvc-snapshottable-data-tester-xf4nt" satisfied condition "Succeeded or Failed" I0625 05:41:09.435] Jun 25 05:31:05.173: INFO: Pod pvc-snapshottable-data-tester-xf4nt has the following logs: I0625 05:41:09.435] Jun 25 05:31:05.173: INFO: Deleting pod "pvc-snapshottable-data-tester-xf4nt" in namespace "snapshotting-6789" I0625 05:41:09.435] Jun 25 05:31:05.182: INFO: Wait up to 5m0s for pod "pvc-snapshottable-data-tester-xf4nt" to be fully deleted I0625 05:41:09.435] [1mSTEP[0m: creating a pvc from the snapshot I0625 05:41:09.436] [1mSTEP[0m: starting a pod to use the snapshot I0625 05:41:09.436] Jun 25 05:31:05.199: INFO: Waiting up to 15m0s for pod "restored-pvc-tester-f5wt6" in namespace "snapshotting-6789" to be "running" ... skipping 322 lines ... I0625 05:41:09.492] Jun 25 05:40:57.588: INFO: volumesnapshotcontents snapcontent-3365aace-7504-4d2f-b2e8-a733f86df789 has been found and is not deleted I0625 05:41:09.492] Jun 25 05:40:58.592: INFO: volumesnapshotcontents snapcontent-3365aace-7504-4d2f-b2e8-a733f86df789 has been found and is not deleted I0625 05:41:09.492] Jun 25 05:40:59.597: INFO: volumesnapshotcontents snapcontent-3365aace-7504-4d2f-b2e8-a733f86df789 has been found and is not deleted I0625 05:41:09.492] Jun 25 05:41:00.602: INFO: volumesnapshotcontents snapcontent-3365aace-7504-4d2f-b2e8-a733f86df789 has been found and is not deleted I0625 05:41:09.492] Jun 25 05:41:01.606: INFO: volumesnapshotcontents snapcontent-3365aace-7504-4d2f-b2e8-a733f86df789 has been found and is not deleted I0625 05:41:09.493] Jun 25 05:41:02.612: INFO: volumesnapshotcontents snapcontent-3365aace-7504-4d2f-b2e8-a733f86df789 has been found and is not deleted I0625 05:41:09.493] Jun 25 05:41:03.612: INFO: WaitUntil failed after reaching the timeout 30s I0625 05:41:09.493] [AfterEach] volume snapshot controller I0625 05:41:09.493] test/e2e/storage/testsuites/snapshottable.go:172 I0625 05:41:09.493] Jun 25 05:41:03.616: INFO: Error getting logs for pod restored-pvc-tester-f5wt6: the server could not find the requested resource (get pods restored-pvc-tester-f5wt6) I0625 05:41:09.493] Jun 25 05:41:03.616: INFO: Deleting pod "restored-pvc-tester-f5wt6" in namespace "snapshotting-6789" I0625 05:41:09.493] Jun 25 05:41:03.620: INFO: deleting claim "snapshotting-6789"/"pvc-tnxgc" I0625 05:41:09.493] Jun 25 05:41:03.623: INFO: deleting snapshot "snapshotting-6789"/"snapshot-zhk5f" I0625 05:41:09.494] Jun 25 05:41:03.626: INFO: deleting snapshot class "snapshotting-6789v7h6l" I0625 05:41:09.494] Jun 25 05:41:03.635: INFO: Waiting up to 5m0s for volumesnapshotclasses snapshotting-6789v7h6l to be deleted I0625 05:41:09.494] Jun 25 05:41:03.640: INFO: volumesnapshotclasses snapshotting-6789v7h6l is not found and has been deleted ... skipping 22 lines ... I0625 05:41:09.498] Jun 25 05:41:08.674: INFO: At 2022-06-25 05:30:28 +0000 UTC - event for pvc-snapshottable-data-tester-xf4nt: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-9f6aee72-b058-4824-9df8-9f362e7b3af5" I0625 05:41:09.498] Jun 25 05:41:08.674: INFO: At 2022-06-25 05:30:54 +0000 UTC - event for pvc-snapshottable-data-tester-xf4nt: {kubelet e2e-test-prow-windows-node-group-rn0p} Created: Created container volume-tester I0625 05:41:09.499] Jun 25 05:41:08.674: INFO: At 2022-06-25 05:30:54 +0000 UTC - event for pvc-snapshottable-data-tester-xf4nt: {kubelet e2e-test-prow-windows-node-group-rn0p} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.39" already present on machine I0625 05:41:09.499] Jun 25 05:41:08.674: INFO: At 2022-06-25 05:30:57 +0000 UTC - event for pvc-snapshottable-data-tester-xf4nt: {kubelet e2e-test-prow-windows-node-group-rn0p} Started: Started container volume-tester I0625 05:41:09.499] Jun 25 05:41:08.674: INFO: At 2022-06-25 05:31:05 +0000 UTC - event for pvc-tnxgc: {pd.csi.storage.gke.io_e2e-test-prow-minion-group-82f5_4c40b180-252f-44fe-89ec-1323b3b31f9a } Provisioning: External provisioner is provisioning volume for claim "snapshotting-6789/pvc-tnxgc" I0625 05:41:09.500] Jun 25 05:41:08.674: INFO: At 2022-06-25 05:31:05 +0000 UTC - event for pvc-tnxgc: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "pd.csi.storage.gke.io" or manually created by system administrator I0625 05:41:09.500] Jun 25 05:41:08.674: INFO: At 2022-06-25 05:31:05 +0000 UTC - event for pvc-tnxgc: {pd.csi.storage.gke.io_e2e-test-prow-minion-group-82f5_4c40b180-252f-44fe-89ec-1323b3b31f9a } ProvisioningFailed: failed to provision volume with StorageClass "snapshotting-6789-e2e-sc6rnl9": error getting handle for DataSource Type VolumeSnapshot by Name snapshot-zhk5f: snapshot snapshot-zhk5f is not Ready I0625 05:41:09.501] Jun 25 05:41:08.674: INFO: At 2022-06-25 05:31:05 +0000 UTC - event for pvc-tnxgc: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding I0625 05:41:09.501] Jun 25 05:41:08.674: INFO: At 2022-06-25 05:35:23 +0000 UTC - event for snapshot-zhk5f: {snapshot-controller } SnapshotCreated: Snapshot snapshotting-6789/snapshot-zhk5f was successfully created by the CSI driver. I0625 05:41:09.501] Jun 25 05:41:08.674: INFO: At 2022-06-25 05:35:23 +0000 UTC - event for snapshot-zhk5f: {snapshot-controller } SnapshotReady: Snapshot snapshotting-6789/snapshot-zhk5f is ready to use. I0625 05:41:09.502] Jun 25 05:41:08.674: INFO: At 2022-06-25 05:39:58 +0000 UTC - event for pvc-tnxgc: {pd.csi.storage.gke.io_e2e-test-prow-minion-group-82f5_4c40b180-252f-44fe-89ec-1323b3b31f9a } ProvisioningSucceeded: Successfully provisioned volume pvc-0ceaccab-e8e8-457e-a7db-78af739a2807 I0625 05:41:09.502] Jun 25 05:41:08.674: INFO: At 2022-06-25 05:39:59 +0000 UTC - event for restored-pvc-tester-f5wt6: {default-scheduler } Scheduled: Successfully assigned snapshotting-6789/restored-pvc-tester-f5wt6 to e2e-test-prow-windows-node-group-w48h I0625 05:41:09.503] Jun 25 05:41:08.674: INFO: At 2022-06-25 05:40:03 +0000 UTC - event for restored-pvc-tester-f5wt6: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-0ceaccab-e8e8-457e-a7db-78af739a2807" ... skipping 153 lines ... I0625 05:45:32.347] [It] should check snapshot fields, check restore correctly works, check deletion (ephemeral) I0625 05:45:32.347] test/e2e/storage/testsuites/snapshottable.go:177 I0625 05:45:32.347] Jun 25 05:21:04.225: INFO: Creating resource for dynamic PV I0625 05:45:32.348] Jun 25 05:21:04.225: INFO: Using claimSize:5Gi, test suite supported size:{ 1Mi}, driver(csi-gcepd-sc-windows--pd-volumesnapshotclass) supported size:{ 1Mi} I0625 05:45:32.348] [1mSTEP[0m: creating a StorageClass snapshotting-6235-e2e-sc4hpfq I0625 05:45:32.348] [1mSTEP[0m: [init] starting a pod to use the claim I0625 05:45:32.348] Jun 25 05:21:04.236: INFO: Waiting up to 15m0s for pod "pvc-snapshottable-tester-8449j" in namespace "snapshotting-6235" to be "Succeeded or Failed" I0625 05:45:32.349] Jun 25 05:21:04.248: INFO: Pod "pvc-snapshottable-tester-8449j": Phase="Pending", Reason="", readiness=false. Elapsed: 11.091551ms I0625 05:45:32.349] Jun 25 05:21:06.252: INFO: Pod "pvc-snapshottable-tester-8449j": Phase="Pending", Reason="", readiness=false. Elapsed: 2.015419256s I0625 05:45:32.349] Jun 25 05:21:08.255: INFO: Pod "pvc-snapshottable-tester-8449j": Phase="Pending", Reason="", readiness=false. Elapsed: 4.018466854s I0625 05:45:32.349] Jun 25 05:21:10.253: INFO: Pod "pvc-snapshottable-tester-8449j": Phase="Pending", Reason="", readiness=false. Elapsed: 6.016247159s I0625 05:45:32.350] Jun 25 05:21:12.253: INFO: Pod "pvc-snapshottable-tester-8449j": Phase="Pending", Reason="", readiness=false. Elapsed: 8.016306493s I0625 05:45:32.350] Jun 25 05:21:14.254: INFO: Pod "pvc-snapshottable-tester-8449j": Phase="Pending", Reason="", readiness=false. Elapsed: 10.017475498s ... skipping 18 lines ... I0625 05:45:32.356] Jun 25 05:21:52.252: INFO: Pod "pvc-snapshottable-tester-8449j": Phase="Pending", Reason="", readiness=false. Elapsed: 48.015785134s I0625 05:45:32.356] Jun 25 05:21:54.253: INFO: Pod "pvc-snapshottable-tester-8449j": Phase="Running", Reason="", readiness=true. Elapsed: 50.016881002s I0625 05:45:32.356] Jun 25 05:21:56.252: INFO: Pod "pvc-snapshottable-tester-8449j": Phase="Running", Reason="", readiness=false. Elapsed: 52.015416634s I0625 05:45:32.356] Jun 25 05:21:58.251: INFO: Pod "pvc-snapshottable-tester-8449j": Phase="Running", Reason="", readiness=false. Elapsed: 54.014694915s I0625 05:45:32.357] Jun 25 05:22:00.252: INFO: Pod "pvc-snapshottable-tester-8449j": Phase="Succeeded", Reason="", readiness=false. Elapsed: 56.015457464s I0625 05:45:32.357] [1mSTEP[0m: Saw pod success I0625 05:45:32.357] Jun 25 05:22:00.252: INFO: Pod "pvc-snapshottable-tester-8449j" satisfied condition "Succeeded or Failed" I0625 05:45:32.357] [1mSTEP[0m: [init] checking the claim I0625 05:45:32.358] [1mSTEP[0m: creating a SnapshotClass I0625 05:45:32.358] [1mSTEP[0m: creating a dynamic VolumeSnapshot I0625 05:45:32.358] Jun 25 05:22:00.269: INFO: Waiting up to 5m0s for VolumeSnapshot snapshot-fkhvw to become ready I0625 05:45:32.358] Jun 25 05:22:00.272: INFO: VolumeSnapshot snapshot-fkhvw found but is not ready. I0625 05:45:32.358] Jun 25 05:22:02.276: INFO: VolumeSnapshot snapshot-fkhvw found but is not ready. ... skipping 142 lines ... I0625 05:45:32.387] Jun 25 05:26:49.047: INFO: VolumeSnapshot snapshot-fkhvw found but is not ready. I0625 05:45:32.388] Jun 25 05:26:51.053: INFO: VolumeSnapshot snapshot-fkhvw found but is not ready. I0625 05:45:32.388] Jun 25 05:26:53.058: INFO: VolumeSnapshot snapshot-fkhvw found but is not ready. I0625 05:45:32.388] Jun 25 05:26:55.064: INFO: VolumeSnapshot snapshot-fkhvw found but is not ready. I0625 05:45:32.388] Jun 25 05:26:57.069: INFO: VolumeSnapshot snapshot-fkhvw found but is not ready. I0625 05:45:32.388] Jun 25 05:26:59.075: INFO: VolumeSnapshot snapshot-fkhvw found but is not ready. I0625 05:45:32.389] Jun 25 05:27:01.076: INFO: WaitUntil failed after reaching the timeout 5m0s I0625 05:45:32.389] Jun 25 05:27:01.076: INFO: Unexpected error: I0625 05:45:32.389] <*errors.errorString | 0xc0044074e0>: { I0625 05:45:32.389] s: "VolumeSnapshot snapshot-fkhvw is not ready within 5m0s", I0625 05:45:32.389] } I0625 05:45:32.389] Jun 25 05:27:01.076: FAIL: VolumeSnapshot snapshot-fkhvw is not ready within 5m0s I0625 05:45:32.390] I0625 05:45:32.390] Full Stack Trace I0625 05:45:32.390] k8s.io/kubernetes/test/e2e/storage/utils.GetSnapshotContentFromSnapshot({0x7a661a0, 0xc001bd1de0?}, 0xc0026f4c28) I0625 05:45:32.390] test/e2e/storage/utils/snapshot.go:86 +0x1ad I0625 05:45:32.390] k8s.io/kubernetes/test/e2e/storage/framework.CreateSnapshotResource({0x7fd2d4168258, 0xc000c87ce0}, 0xc00366e480, {{0x725c1e9, 0x22}, {0x0, 0x0}, {0x7205442, 0x16}, {0x0, ...}, ...}, ...) I0625 05:45:32.391] test/e2e/storage/framework/snapshot_resource.go:92 +0x246 ... skipping 464 lines ... I0625 05:45:32.472] Jun 25 05:41:53.117: INFO: Pod "restored-pvc-tester-hdgzn": Phase="Pending", Reason="", readiness=false. Elapsed: 14m52.012381076s I0625 05:45:32.472] Jun 25 05:41:55.116: INFO: Pod "restored-pvc-tester-hdgzn": Phase="Pending", Reason="", readiness=false. Elapsed: 14m54.011358587s I0625 05:45:32.472] Jun 25 05:41:57.116: INFO: Pod "restored-pvc-tester-hdgzn": Phase="Pending", Reason="", readiness=false. Elapsed: 14m56.011209339s I0625 05:45:32.472] Jun 25 05:41:59.116: INFO: Pod "restored-pvc-tester-hdgzn": Phase="Pending", Reason="", readiness=false. Elapsed: 14m58.011036694s I0625 05:45:32.473] Jun 25 05:42:01.114: INFO: Pod "restored-pvc-tester-hdgzn": Phase="Pending", Reason="", readiness=false. Elapsed: 15m0.00980998s I0625 05:45:32.473] Jun 25 05:42:01.117: INFO: Pod "restored-pvc-tester-hdgzn": Phase="Pending", Reason="", readiness=false. Elapsed: 15m0.01291055s I0625 05:45:32.473] Jun 25 05:42:01.118: INFO: Unexpected error: I0625 05:45:32.473] <*pod.timeoutError | 0xc002af12f0>: { I0625 05:45:32.473] msg: "timed out while waiting for pod snapshotting-6235/restored-pvc-tester-hdgzn to be running", I0625 05:45:32.473] observedObjects: [ I0625 05:45:32.473] { I0625 05:45:32.473] TypeMeta: {Kind: "", APIVersion: ""}, I0625 05:45:32.474] ObjectMeta: { ... skipping 356 lines ... I0625 05:45:32.531] QOSClass: "BestEffort", I0625 05:45:32.531] EphemeralContainerStatuses: nil, I0625 05:45:32.531] }, I0625 05:45:32.531] }, I0625 05:45:32.531] ], I0625 05:45:32.531] } I0625 05:45:32.531] Jun 25 05:42:01.119: FAIL: timed out while waiting for pod snapshotting-6235/restored-pvc-tester-hdgzn to be running I0625 05:45:32.531] I0625 05:45:32.532] Full Stack Trace I0625 05:45:32.532] k8s.io/kubernetes/test/e2e/storage/testsuites.(*snapshottableTestSuite).DefineTests.func1.4.1() I0625 05:45:32.532] test/e2e/storage/testsuites/snapshottable.go:260 +0xf05 I0625 05:45:32.532] k8s.io/kubernetes/test/e2e.RunE2ETests(0x2590617?) I0625 05:45:32.532] test/e2e/e2e.go:130 +0x686 ... skipping 138 lines ... I0625 05:45:32.561] Jun 25 05:45:31.717: INFO: At 2022-06-25 05:21:09 +0000 UTC - event for pvc-snapshottable-tester-8449j-my-volume: {pd.csi.storage.gke.io_e2e-test-prow-minion-group-82f5_4c40b180-252f-44fe-89ec-1323b3b31f9a } ProvisioningSucceeded: Successfully provisioned volume pvc-568d6bdc-de0a-4ee8-a8ea-17f1ea61492e I0625 05:45:32.561] Jun 25 05:45:31.717: INFO: At 2022-06-25 05:21:14 +0000 UTC - event for pvc-snapshottable-tester-8449j: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-568d6bdc-de0a-4ee8-a8ea-17f1ea61492e" I0625 05:45:32.562] Jun 25 05:45:31.717: INFO: At 2022-06-25 05:21:49 +0000 UTC - event for pvc-snapshottable-tester-8449j: {kubelet e2e-test-prow-windows-node-group-w48h} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.39" already present on machine I0625 05:45:32.562] Jun 25 05:45:31.717: INFO: At 2022-06-25 05:21:50 +0000 UTC - event for pvc-snapshottable-tester-8449j: {kubelet e2e-test-prow-windows-node-group-w48h} Created: Created container volume-tester I0625 05:45:32.562] Jun 25 05:45:31.717: INFO: At 2022-06-25 05:21:52 +0000 UTC - event for pvc-snapshottable-tester-8449j: {kubelet e2e-test-prow-windows-node-group-w48h} Started: Started container volume-tester I0625 05:45:32.562] Jun 25 05:45:31.717: INFO: At 2022-06-25 05:22:00 +0000 UTC - event for snapshot-fkhvw: {snapshot-controller } CreatingSnapshot: Waiting for a snapshot snapshotting-6235/snapshot-fkhvw to be created by the CSI driver. I0625 05:45:32.563] Jun 25 05:45:31.717: INFO: At 2022-06-25 05:22:00 +0000 UTC - event for snapshot-fkhvw: {snapshot-controller } SnapshotFinalizerError: Failed to check and update snapshot: snapshot controller failed to update snapshotting-6235/snapshot-fkhvw on API server: volumesnapshots.snapshot.storage.k8s.io "snapshot-fkhvw" is forbidden: User "system:serviceaccount:kube-system:volume-snapshot-controller" cannot patch resource "volumesnapshots" in API group "snapshot.storage.k8s.io" in the namespace "snapshotting-6235" I0625 05:45:32.563] Jun 25 05:45:31.717: INFO: At 2022-06-25 05:27:01 +0000 UTC - event for restored-pvc-tester-hdgzn: {default-scheduler } FailedScheduling: 0/5 nodes are available: 5 waiting for ephemeral volume controller to create the persistentvolumeclaim "restored-pvc-tester-hdgzn-my-volume". preemption: 0/5 nodes are available: 5 Preemption is not helpful for scheduling. I0625 05:45:32.563] Jun 25 05:45:31.717: INFO: At 2022-06-25 05:27:01 +0000 UTC - event for restored-pvc-tester-hdgzn-my-volume: {persistentvolume-controller } WaitForPodScheduled: waiting for pod restored-pvc-tester-hdgzn to be scheduled I0625 05:45:32.564] Jun 25 05:45:31.717: INFO: At 2022-06-25 05:27:02 +0000 UTC - event for restored-pvc-tester-hdgzn-my-volume: {pd.csi.storage.gke.io_e2e-test-prow-minion-group-82f5_4c40b180-252f-44fe-89ec-1323b3b31f9a } ProvisioningFailed: failed to provision volume with StorageClass "snapshotting-6235-e2e-sc4hpfq": error getting handle for DataSource Type VolumeSnapshot by Name snapshot-fkhvw: snapshot snapshot-fkhvw is not Ready I0625 05:45:32.564] Jun 25 05:45:31.717: INFO: At 2022-06-25 05:27:02 +0000 UTC - event for restored-pvc-tester-hdgzn-my-volume: {pd.csi.storage.gke.io_e2e-test-prow-minion-group-82f5_4c40b180-252f-44fe-89ec-1323b3b31f9a } Provisioning: External provisioner is provisioning volume for claim "snapshotting-6235/restored-pvc-tester-hdgzn-my-volume" I0625 05:45:32.564] Jun 25 05:45:31.717: INFO: At 2022-06-25 05:27:02 +0000 UTC - event for restored-pvc-tester-hdgzn-my-volume: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "pd.csi.storage.gke.io" or manually created by system administrator I0625 05:45:32.565] Jun 25 05:45:31.717: INFO: At 2022-06-25 05:37:02 +0000 UTC - event for restored-pvc-tester-hdgzn: {default-scheduler } FailedScheduling: running PreBind plugin "VolumeBinding": binding volumes: timed out waiting for the condition I0625 05:45:32.565] Jun 25 05:45:31.717: INFO: At 2022-06-25 05:42:01 +0000 UTC - event for restored-pvc-tester-hdgzn: {default-scheduler } FailedScheduling: running PreBind plugin "VolumeBinding": binding volumes: pod does not exist any more: pod "restored-pvc-tester-hdgzn" not found I0625 05:45:32.565] Jun 25 05:45:31.717: INFO: At 2022-06-25 05:42:01 +0000 UTC - event for restored-pvc-tester-hdgzn-my-volume: {pd.csi.storage.gke.io_e2e-test-prow-minion-group-82f5_4c40b180-252f-44fe-89ec-1323b3b31f9a } ProvisioningFailed: failed to provision volume with StorageClass "snapshotting-6235-e2e-sc4hpfq": error getting handle for DataSource Type VolumeSnapshot by Name snapshot-fkhvw: snapshot snapshot-fkhvw is currently being deleted I0625 05:45:32.565] Jun 25 05:45:31.717: INFO: At 2022-06-25 05:42:01 +0000 UTC - event for snapshot-fkhvw: {snapshot-controller } SnapshotDeletePending: Snapshot is being used to restore a PVC I0625 05:45:32.565] Jun 25 05:45:31.720: INFO: POD NODE PHASE GRACE CONDITIONS I0625 05:45:32.566] Jun 25 05:45:31.720: INFO: I0625 05:45:32.566] Jun 25 05:45:31.725: INFO: I0625 05:45:32.566] Logging node info for node e2e-test-prow-master I0625 05:45:32.573] Jun 25 05:45:31.728: INFO: Node Info: &Node{ObjectMeta:{e2e-test-prow-master ffe70899-e3c7-4cfe-aac5-e1fdb6946f74 21561 0 2022-06-25 04:04:55 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-4 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-test-prow-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-4 topology.gke.io/zone:us-central1-b topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/gce-cvm-upg-1-3-1-4-ctl-skew/zones/us-central1-b/instances/e2e-test-prow-master"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-06-25 04:04:55 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-06-25 04:04:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-06-25 04:05:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}}}} } {kubectl-taint Update v1 2022-06-25 04:26:37 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}} } {kubelet Update v1 2022-06-25 05:40:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://gce-cvm-upg-1-3-1-4-ctl-skew/us-central1-b/e2e-test-prow-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node.kubernetes.io/os,Value:linux,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{16684785664 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{15735648256 0} {<nil>} 15366844Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{15016307073 0} {<nil>} 15016307073 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{15473504256 0} {<nil>} 15110844Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-25 04:04:55 +0000 UTC,LastTransitionTime:2022-06-25 04:04:55 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-25 05:40:29 +0000 UTC,LastTransitionTime:2022-06-25 04:04:55 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-25 05:40:29 +0000 UTC,LastTransitionTime:2022-06-25 04:04:55 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-25 05:40:29 +0000 UTC,LastTransitionTime:2022-06-25 04:04:55 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-25 05:40:29 +0000 UTC,LastTransitionTime:2022-06-25 04:05:06 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.2,},NodeAddress{Type:ExternalIP,Address:34.136.177.176,},NodeAddress{Type:InternalDNS,Address:e2e-test-prow-master.c.gce-cvm-upg-1-3-1-4-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:e2e-test-prow-master.c.gce-cvm-upg-1-3-1-4-ctl-skew.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:2b7c8b3124d31c7afd07570b62ec0ada,SystemUUID:2b7c8b31-24d3-1c7a-fd07-570b62ec0ada,BootID:7f258069-31f3-452d-8a1b-64635b818ccd,KernelVersion:5.4.129+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.25.0-alpha.1.135+11686e138694a6,KubeProxyVersion:v1.25.0-alpha.1.135+11686e138694a6,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.25.0-alpha.1.135_11686e138694a6],SizeBytes:127703532,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.25.0-alpha.1.135_11686e138694a6],SizeBytes:117520517,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:810aadac042cee96db99d94cec2436482b886774681b44bb141254edda5e3cdf gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.17],SizeBytes:84029209,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.25.0-alpha.1.135_11686e138694a6],SizeBytes:51079296,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/gce-cvm-upg-1-3-1-4-ctl-skew/gcp-persistent-disk-csi-driver@sha256:ed229e48b6fcd3cbf34509126b488087218f9c2438b96df6be4d1453234c266b gcr.io/gce-cvm-upg-1-3-1-4-ctl-skew/gcp-persistent-disk-csi-driver:a0578d58-2680-44c3-9542-419d96384711],SizeBytes:43159928,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:be60ef505fc80879eeb5d8bf3ad8bb1146b395afc2394584645e99431806c26c gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.12.0],SizeBytes:32705362,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:9870ed22905d03e3fa5cd2d57118784999fb581c49310f6cac0c3795bcdd7ee7 registry.k8s.io/kas-network-proxy/proxy-server:v0.0.32],SizeBytes:17930113,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} ... skipping 127 lines ... I0625 05:45:32.614] [90mtest/e2e/storage/testsuites/snapshottable.go:177[0m I0625 05:45:32.614] I0625 05:45:32.614] [91mJun 25 05:27:01.076: VolumeSnapshot snapshot-fkhvw is not ready within 5m0s[0m I0625 05:45:32.614] I0625 05:45:32.614] test/e2e/storage/utils/snapshot.go:86 I0625 05:45:32.614] [90m------------------------------[0m I0625 05:45:32.615] {"msg":"FAILED External Storage [Driver: csi-gcepd-sc-windows--pd-volumesnapshotclass] [Testpattern: Ephemeral Snapshot (delete policy)] snapshottable[Feature:VolumeSnapshotDataSource] volume snapshot controller should check snapshot fields, check restore correctly works, check deletion (ephemeral)","total":-1,"completed":0,"skipped":285,"failed":2,"failures":["External Storage [Driver: csi-gcepd-sc-windows--pd-volumesnapshotclass] [Testpattern: Pre-provisioned Snapshot (delete policy)] snapshottable[Feature:VolumeSnapshotDataSource] volume snapshot controller should check snapshot fields, check restore correctly works after modifying source data, check deletion (persistent)","External Storage [Driver: csi-gcepd-sc-windows--pd-volumesnapshotclass] [Testpattern: Ephemeral Snapshot (delete policy)] snapshottable[Feature:VolumeSnapshotDataSource] volume snapshot controller should check snapshot fields, check restore correctly works, check deletion (ephemeral)"]} I0625 05:45:32.615] Jun 25 05:45:32.345: INFO: Running AfterSuite actions on all nodes I0625 05:45:32.615] Jun 25 05:45:32.345: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage.glob..func19.2 I0625 05:45:32.615] Jun 25 05:45:32.345: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage.glob..func9.2 I0625 05:45:32.615] Jun 25 05:45:32.345: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage.glob..func8.2 I0625 05:45:32.616] Jun 25 05:45:32.345: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage/vsphere.glob..func17.3 I0625 05:45:32.616] Jun 25 05:45:32.345: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage/vsphere.glob..func9.2 ... skipping 16 lines ... I0625 05:48:39.159] Jun 25 05:23:47.893: INFO: Using claimSize:5Gi, test suite supported size:{ 1Mi}, driver(csi-gcepd-sc-windows--pd-volumesnapshotclass) supported size:{ 1Mi} I0625 05:48:39.159] [1mSTEP[0m: creating a StorageClass snapshotting-955-e2e-scmvll8 I0625 05:48:39.159] [1mSTEP[0m: creating a claim I0625 05:48:39.159] Jun 25 05:23:47.898: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil I0625 05:48:39.160] [1mSTEP[0m: [init] starting a pod to use the claim I0625 05:48:39.160] [1mSTEP[0m: [init] check pod success I0625 05:48:39.160] Jun 25 05:23:47.921: INFO: Waiting up to 15m0s for pod "pvc-snapshottable-tester-5bz5m" in namespace "snapshotting-955" to be "Succeeded or Failed" I0625 05:48:39.160] Jun 25 05:23:47.927: INFO: Pod "pvc-snapshottable-tester-5bz5m": Phase="Pending", Reason="", readiness=false. Elapsed: 6.684744ms I0625 05:48:39.161] Jun 25 05:23:49.934: INFO: Pod "pvc-snapshottable-tester-5bz5m": Phase="Pending", Reason="", readiness=false. Elapsed: 2.013481812s I0625 05:48:39.161] Jun 25 05:23:51.934: INFO: Pod "pvc-snapshottable-tester-5bz5m": Phase="Pending", Reason="", readiness=false. Elapsed: 4.012867054s I0625 05:48:39.161] Jun 25 05:23:53.935: INFO: Pod "pvc-snapshottable-tester-5bz5m": Phase="Pending", Reason="", readiness=false. Elapsed: 6.014261449s I0625 05:48:39.161] Jun 25 05:23:55.934: INFO: Pod "pvc-snapshottable-tester-5bz5m": Phase="Pending", Reason="", readiness=false. Elapsed: 8.013489138s I0625 05:48:39.162] Jun 25 05:23:57.935: INFO: Pod "pvc-snapshottable-tester-5bz5m": Phase="Pending", Reason="", readiness=false. Elapsed: 10.014841188s ... skipping 17 lines ... I0625 05:48:39.167] Jun 25 05:24:33.934: INFO: Pod "pvc-snapshottable-tester-5bz5m": Phase="Pending", Reason="", readiness=false. Elapsed: 46.013374042s I0625 05:48:39.167] Jun 25 05:24:35.934: INFO: Pod "pvc-snapshottable-tester-5bz5m": Phase="Pending", Reason="", readiness=false. Elapsed: 48.013223274s I0625 05:48:39.167] Jun 25 05:24:37.938: INFO: Pod "pvc-snapshottable-tester-5bz5m": Phase="Running", Reason="", readiness=true. Elapsed: 50.017442372s I0625 05:48:39.168] Jun 25 05:24:39.931: INFO: Pod "pvc-snapshottable-tester-5bz5m": Phase="Running", Reason="", readiness=false. Elapsed: 52.010845032s I0625 05:48:39.168] Jun 25 05:24:41.934: INFO: Pod "pvc-snapshottable-tester-5bz5m": Phase="Succeeded", Reason="", readiness=false. Elapsed: 54.013450166s I0625 05:48:39.168] [1mSTEP[0m: Saw pod success I0625 05:48:39.168] Jun 25 05:24:41.934: INFO: Pod "pvc-snapshottable-tester-5bz5m" satisfied condition "Succeeded or Failed" I0625 05:48:39.169] [1mSTEP[0m: [init] checking the claim I0625 05:48:39.169] Jun 25 05:24:41.937: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [csi-gcepd-sc-windows--pd-volumesnapshotclassbkqx6] to have phase Bound I0625 05:48:39.169] Jun 25 05:24:41.939: INFO: PersistentVolumeClaim csi-gcepd-sc-windows--pd-volumesnapshotclassbkqx6 found and phase=Bound (2.669252ms) I0625 05:48:39.169] [1mSTEP[0m: [init] checking the PV I0625 05:48:39.169] [1mSTEP[0m: [init] deleting the pod I0625 05:48:39.170] Jun 25 05:24:41.966: INFO: Pod pvc-snapshottable-tester-5bz5m has the following logs: ... skipping 161 lines ... I0625 05:48:39.201] Jun 25 05:29:48.814: INFO: VolumeSnapshot snapshot-b6f65 found but is not ready. I0625 05:48:39.202] Jun 25 05:29:50.819: INFO: VolumeSnapshot snapshot-b6f65 found but is not ready. I0625 05:48:39.202] Jun 25 05:29:52.823: INFO: VolumeSnapshot snapshot-b6f65 found but is not ready. I0625 05:48:39.202] Jun 25 05:29:54.828: INFO: VolumeSnapshot snapshot-b6f65 found but is not ready. I0625 05:48:39.202] Jun 25 05:29:56.832: INFO: VolumeSnapshot snapshot-b6f65 found but is not ready. I0625 05:48:39.202] Jun 25 05:29:58.838: INFO: VolumeSnapshot snapshot-b6f65 found but is not ready. I0625 05:48:39.202] Jun 25 05:30:00.839: INFO: WaitUntil failed after reaching the timeout 5m0s I0625 05:48:39.202] Jun 25 05:30:00.839: INFO: Unexpected error: I0625 05:48:39.202] <*errors.errorString | 0xc0044a9d30>: { I0625 05:48:39.202] s: "VolumeSnapshot snapshot-b6f65 is not ready within 5m0s", I0625 05:48:39.203] } I0625 05:48:39.203] Jun 25 05:30:00.839: FAIL: VolumeSnapshot snapshot-b6f65 is not ready within 5m0s I0625 05:48:39.203] I0625 05:48:39.203] Full Stack Trace I0625 05:48:39.203] k8s.io/kubernetes/test/e2e/storage/utils.GetSnapshotContentFromSnapshot({0x7a661a0, 0xc0037729a0?}, 0xc003b24088) I0625 05:48:39.203] test/e2e/storage/utils/snapshot.go:86 +0x1ad I0625 05:48:39.203] k8s.io/kubernetes/test/e2e/storage/framework.CreateSnapshotResource({0x7faf340cdbf8, 0xc000d67760}, 0xc003a51c80, {{0x724c5eb, 0x20}, {0x0, 0x0}, {0x71c4fef, 0x9}, {0x0, ...}, ...}, ...) I0625 05:48:39.203] test/e2e/storage/framework/snapshot_resource.go:92 +0x246 ... skipping 8 lines ... I0625 05:48:39.204] created by testing.(*T).Run I0625 05:48:39.204] /usr/local/go/src/testing/testing.go:1486 +0x35f I0625 05:48:39.204] [1mSTEP[0m: checking the snapshot I0625 05:48:39.204] [1mSTEP[0m: checking the SnapshotContent I0625 05:48:39.205] [1mSTEP[0m: Modifying source data test I0625 05:48:39.205] [1mSTEP[0m: modifying the data in the source PVC I0625 05:48:39.205] Jun 25 05:30:00.856: INFO: Waiting up to 15m0s for pod "pvc-snapshottable-data-tester-8cjnw" in namespace "snapshotting-955" to be "Succeeded or Failed" I0625 05:48:39.205] Jun 25 05:30:00.862: INFO: Pod "pvc-snapshottable-data-tester-8cjnw": Phase="Pending", Reason="", readiness=false. Elapsed: 5.426846ms I0625 05:48:39.205] Jun 25 05:30:02.866: INFO: Pod "pvc-snapshottable-data-tester-8cjnw": Phase="Pending", Reason="", readiness=false. Elapsed: 2.009142314s I0625 05:48:39.205] Jun 25 05:30:04.865: INFO: Pod "pvc-snapshottable-data-tester-8cjnw": Phase="Pending", Reason="", readiness=false. Elapsed: 4.008981197s I0625 05:48:39.205] Jun 25 05:30:06.866: INFO: Pod "pvc-snapshottable-data-tester-8cjnw": Phase="Pending", Reason="", readiness=false. Elapsed: 6.009184386s I0625 05:48:39.206] Jun 25 05:30:08.866: INFO: Pod "pvc-snapshottable-data-tester-8cjnw": Phase="Pending", Reason="", readiness=false. Elapsed: 8.009250514s I0625 05:48:39.206] Jun 25 05:30:10.865: INFO: Pod "pvc-snapshottable-data-tester-8cjnw": Phase="Pending", Reason="", readiness=false. Elapsed: 10.008800139s ... skipping 13 lines ... I0625 05:48:39.208] Jun 25 05:30:38.866: INFO: Pod "pvc-snapshottable-data-tester-8cjnw": Phase="Pending", Reason="", readiness=false. Elapsed: 38.00923377s I0625 05:48:39.208] Jun 25 05:30:40.867: INFO: Pod "pvc-snapshottable-data-tester-8cjnw": Phase="Pending", Reason="", readiness=false. Elapsed: 40.010739973s I0625 05:48:39.208] Jun 25 05:30:42.870: INFO: Pod "pvc-snapshottable-data-tester-8cjnw": Phase="Running", Reason="", readiness=true. Elapsed: 42.013256087s I0625 05:48:39.209] Jun 25 05:30:44.866: INFO: Pod "pvc-snapshottable-data-tester-8cjnw": Phase="Running", Reason="", readiness=false. Elapsed: 44.009497916s I0625 05:48:39.209] Jun 25 05:30:46.867: INFO: Pod "pvc-snapshottable-data-tester-8cjnw": Phase="Succeeded", Reason="", readiness=false. Elapsed: 46.010657969s I0625 05:48:39.209] [1mSTEP[0m: Saw pod success I0625 05:48:39.209] Jun 25 05:30:46.867: INFO: Pod "pvc-snapshottable-data-tester-8cjnw" satisfied condition "Succeeded or Failed" I0625 05:48:39.209] Jun 25 05:30:46.901: INFO: Pod pvc-snapshottable-data-tester-8cjnw has the following logs: I0625 05:48:39.209] Jun 25 05:30:46.901: INFO: Deleting pod "pvc-snapshottable-data-tester-8cjnw" in namespace "snapshotting-955" I0625 05:48:39.209] Jun 25 05:30:46.914: INFO: Wait up to 5m0s for pod "pvc-snapshottable-data-tester-8cjnw" to be fully deleted I0625 05:48:39.210] [1mSTEP[0m: creating a pvc from the snapshot I0625 05:48:39.210] [1mSTEP[0m: starting a pod to use the snapshot I0625 05:48:39.210] Jun 25 05:30:46.932: INFO: Waiting up to 15m0s for pod "restored-pvc-tester-v8dms" in namespace "snapshotting-955" to be "running" ... skipping 446 lines ... I0625 05:48:39.287] Jun 25 05:45:38.940: INFO: Pod "restored-pvc-tester-v8dms": Phase="Pending", Reason="", readiness=false. Elapsed: 14m52.008297897s I0625 05:48:39.287] Jun 25 05:45:40.939: INFO: Pod "restored-pvc-tester-v8dms": Phase="Pending", Reason="", readiness=false. Elapsed: 14m54.006737459s I0625 05:48:39.288] Jun 25 05:45:42.939: INFO: Pod "restored-pvc-tester-v8dms": Phase="Pending", Reason="", readiness=false. Elapsed: 14m56.00729454s I0625 05:48:39.288] Jun 25 05:45:44.939: INFO: Pod "restored-pvc-tester-v8dms": Phase="Pending", Reason="", readiness=false. Elapsed: 14m58.006949996s I0625 05:48:39.288] Jun 25 05:45:46.939: INFO: Pod "restored-pvc-tester-v8dms": Phase="Pending", Reason="", readiness=false. Elapsed: 15m0.006971062s I0625 05:48:39.288] Jun 25 05:45:46.942: INFO: Pod "restored-pvc-tester-v8dms": Phase="Pending", Reason="", readiness=false. Elapsed: 15m0.009986585s I0625 05:48:39.288] Jun 25 05:45:46.943: INFO: Unexpected error: I0625 05:48:39.288] <*pod.timeoutError | 0xc0025c9290>: { I0625 05:48:39.288] msg: "timed out while waiting for pod snapshotting-955/restored-pvc-tester-v8dms to be running", I0625 05:48:39.289] observedObjects: [ I0625 05:48:39.289] { I0625 05:48:39.289] TypeMeta: {Kind: "", APIVersion: ""}, I0625 05:48:39.289] ObjectMeta: { ... skipping 329 lines ... I0625 05:48:39.322] QOSClass: "BestEffort", I0625 05:48:39.322] EphemeralContainerStatuses: nil, I0625 05:48:39.322] }, I0625 05:48:39.323] }, I0625 05:48:39.323] ], I0625 05:48:39.323] } I0625 05:48:39.323] Jun 25 05:45:46.943: FAIL: timed out while waiting for pod snapshotting-955/restored-pvc-tester-v8dms to be running I0625 05:48:39.323] I0625 05:48:39.323] Full Stack Trace I0625 05:48:39.323] k8s.io/kubernetes/test/e2e/storage/testsuites.(*snapshottableTestSuite).DefineTests.func1.4.2() I0625 05:48:39.323] test/e2e/storage/testsuites/snapshottable.go:410 +0x16c5 I0625 05:48:39.323] k8s.io/kubernetes/test/e2e.RunE2ETests(0x2590617?) I0625 05:48:39.323] test/e2e/e2e.go:130 +0x686 ... skipping 118 lines ... I0625 05:48:39.343] Jun 25 05:48:38.435: INFO: At 2022-06-25 05:23:51 +0000 UTC - event for csi-gcepd-sc-windows--pd-volumesnapshotclassbkqx6: {pd.csi.storage.gke.io_e2e-test-prow-minion-group-82f5_4c40b180-252f-44fe-89ec-1323b3b31f9a } ProvisioningSucceeded: Successfully provisioned volume pvc-9f51fafd-e615-40a0-9ff8-b69bdb75c6e3 I0625 05:48:39.343] Jun 25 05:48:38.435: INFO: At 2022-06-25 05:23:51 +0000 UTC - event for pvc-snapshottable-tester-5bz5m: {default-scheduler } Scheduled: Successfully assigned snapshotting-955/pvc-snapshottable-tester-5bz5m to e2e-test-prow-windows-node-group-rn0p I0625 05:48:39.344] Jun 25 05:48:38.435: INFO: At 2022-06-25 05:23:56 +0000 UTC - event for pvc-snapshottable-tester-5bz5m: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-9f51fafd-e615-40a0-9ff8-b69bdb75c6e3" I0625 05:48:39.344] Jun 25 05:48:38.435: INFO: At 2022-06-25 05:24:33 +0000 UTC - event for pvc-snapshottable-tester-5bz5m: {kubelet e2e-test-prow-windows-node-group-rn0p} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.39" already present on machine I0625 05:48:39.344] Jun 25 05:48:38.435: INFO: At 2022-06-25 05:24:34 +0000 UTC - event for pvc-snapshottable-tester-5bz5m: {kubelet e2e-test-prow-windows-node-group-rn0p} Created: Created container volume-tester I0625 05:48:39.344] Jun 25 05:48:38.435: INFO: At 2022-06-25 05:24:36 +0000 UTC - event for pvc-snapshottable-tester-5bz5m: {kubelet e2e-test-prow-windows-node-group-rn0p} Started: Started container volume-tester I0625 05:48:39.345] Jun 25 05:48:38.435: INFO: At 2022-06-25 05:25:00 +0000 UTC - event for snapshot-b6f65: {snapshot-controller } SnapshotFinalizerError: Failed to check and update snapshot: snapshot controller failed to update snapshotting-955/snapshot-b6f65 on API server: volumesnapshots.snapshot.storage.k8s.io "snapshot-b6f65" is forbidden: User "system:serviceaccount:kube-system:volume-snapshot-controller" cannot patch resource "volumesnapshots" in API group "snapshot.storage.k8s.io" in the namespace "snapshotting-955" I0625 05:48:39.345] Jun 25 05:48:38.435: INFO: At 2022-06-25 05:25:00 +0000 UTC - event for snapshot-b6f65: {snapshot-controller } CreatingSnapshot: Waiting for a snapshot snapshotting-955/snapshot-b6f65 to be created by the CSI driver. I0625 05:48:39.345] Jun 25 05:48:38.435: INFO: At 2022-06-25 05:30:00 +0000 UTC - event for pvc-snapshottable-data-tester-8cjnw: {default-scheduler } Scheduled: Successfully assigned snapshotting-955/pvc-snapshottable-data-tester-8cjnw to e2e-test-prow-windows-node-group-w48h I0625 05:48:39.346] Jun 25 05:48:38.435: INFO: At 2022-06-25 05:30:05 +0000 UTC - event for pvc-snapshottable-data-tester-8cjnw: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-9f51fafd-e615-40a0-9ff8-b69bdb75c6e3" I0625 05:48:39.346] Jun 25 05:48:38.435: INFO: At 2022-06-25 05:30:36 +0000 UTC - event for pvc-snapshottable-data-tester-8cjnw: {kubelet e2e-test-prow-windows-node-group-w48h} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.39" already present on machine I0625 05:48:39.346] Jun 25 05:48:38.435: INFO: At 2022-06-25 05:30:37 +0000 UTC - event for pvc-snapshottable-data-tester-8cjnw: {kubelet e2e-test-prow-windows-node-group-w48h} Created: Created container volume-tester I0625 05:48:39.346] Jun 25 05:48:38.435: INFO: At 2022-06-25 05:30:41 +0000 UTC - event for pvc-snapshottable-data-tester-8cjnw: {kubelet e2e-test-prow-windows-node-group-w48h} Started: Started container volume-tester I0625 05:48:39.347] Jun 25 05:48:38.435: INFO: At 2022-06-25 05:30:46 +0000 UTC - event for pvc-r88ng: {pd.csi.storage.gke.io_e2e-test-prow-minion-group-82f5_4c40b180-252f-44fe-89ec-1323b3b31f9a } ProvisioningFailed: failed to provision volume with StorageClass "snapshotting-955-e2e-scmvll8": error getting handle for DataSource Type VolumeSnapshot by Name snapshot-b6f65: snapshot snapshot-b6f65 is not Ready I0625 05:48:39.347] Jun 25 05:48:38.435: INFO: At 2022-06-25 05:30:46 +0000 UTC - event for pvc-r88ng: {pd.csi.storage.gke.io_e2e-test-prow-minion-group-82f5_4c40b180-252f-44fe-89ec-1323b3b31f9a } Provisioning: External provisioner is provisioning volume for claim "snapshotting-955/pvc-r88ng" I0625 05:48:39.347] Jun 25 05:48:38.435: INFO: At 2022-06-25 05:30:46 +0000 UTC - event for pvc-r88ng: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "pd.csi.storage.gke.io" or manually created by system administrator I0625 05:48:39.348] Jun 25 05:48:38.435: INFO: At 2022-06-25 05:30:46 +0000 UTC - event for pvc-r88ng: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding I0625 05:48:39.348] Jun 25 05:48:38.435: INFO: At 2022-06-25 05:40:46 +0000 UTC - event for restored-pvc-tester-v8dms: {default-scheduler } FailedScheduling: running PreBind plugin "VolumeBinding": binding volumes: timed out waiting for the condition I0625 05:48:39.348] Jun 25 05:48:38.435: INFO: At 2022-06-25 05:45:46 +0000 UTC - event for snapshot-b6f65: {snapshot-controller } SnapshotDeletePending: Snapshot is being used to restore a PVC I0625 05:48:39.348] Jun 25 05:48:38.435: INFO: At 2022-06-25 05:45:47 +0000 UTC - event for restored-pvc-tester-v8dms: {default-scheduler } FailedScheduling: running PreBind plugin "VolumeBinding": binding volumes: pod does not exist any more: pod "restored-pvc-tester-v8dms" not found ... skipping 132 lines ... I0625 05:48:39.398] [90mtest/e2e/storage/testsuites/snapshottable.go:278[0m I0625 05:48:39.398] I0625 05:48:39.398] [91mJun 25 05:30:00.839: VolumeSnapshot snapshot-b6f65 is not ready within 5m0s[0m I0625 05:48:39.399] I0625 05:48:39.399] test/e2e/storage/utils/snapshot.go:86 I0625 05:48:39.399] [90m------------------------------[0m I0625 05:48:39.400] {"msg":"FAILED External Storage [Driver: csi-gcepd-sc-windows--pd-volumesnapshotclass] [Testpattern: Dynamic Snapshot (delete policy)] snapshottable[Feature:VolumeSnapshotDataSource] volume snapshot controller should check snapshot fields, check restore correctly works after modifying source data, check deletion (persistent)","total":-1,"completed":0,"skipped":2280,"failed":2,"failures":["External Storage [Driver: csi-gcepd-sc-windows--pd-volumesnapshotclass] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource]","External Storage [Driver: csi-gcepd-sc-windows--pd-volumesnapshotclass] [Testpattern: Dynamic Snapshot (delete policy)] snapshottable[Feature:VolumeSnapshotDataSource] volume snapshot controller should check snapshot fields, check restore correctly works after modifying source data, check deletion (persistent)"]} I0625 05:48:39.400] Jun 25 05:48:39.155: INFO: Running AfterSuite actions on all nodes I0625 05:48:39.400] Jun 25 05:48:39.155: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage.glob..func19.2 I0625 05:48:39.400] Jun 25 05:48:39.155: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage.glob..func9.2 I0625 05:48:39.401] Jun 25 05:48:39.155: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage.glob..func8.2 I0625 05:48:39.401] Jun 25 05:48:39.155: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage/vsphere.glob..func17.3 I0625 05:48:39.401] Jun 25 05:48:39.156: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage/vsphere.glob..func9.2 I0625 05:48:39.401] Jun 25 05:48:39.156: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage/vsphere.glob..func4.2 I0625 05:48:39.401] Jun 25 05:48:39.156: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage/vsphere.glob..func1.3 I0625 05:48:39.401] I0625 05:48:39.402] I0625 05:48:39.402] {"msg":"FAILED External Storage [Driver: csi-gcepd-sc-windows--pd-volumesnapshotclass] [Testpattern: Dynamic Snapshot (retain policy)] snapshottable[Feature:VolumeSnapshotDataSource] volume snapshot controller should check snapshot fields, check restore correctly works after modifying source data, check deletion (persistent)","total":-1,"completed":0,"skipped":818,"failed":2,"failures":["External Storage [Driver: csi-gcepd-sc-windows--pd-volumesnapshotclass] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource]","External Storage [Driver: csi-gcepd-sc-windows--pd-volumesnapshotclass] [Testpattern: Dynamic Snapshot (retain policy)] snapshottable[Feature:VolumeSnapshotDataSource] volume snapshot controller should check snapshot fields, check restore correctly works after modifying source data, check deletion (persistent)"]} I0625 05:48:39.403] Jun 25 05:41:09.398: INFO: Running AfterSuite actions on all nodes I0625 05:48:39.403] Jun 25 05:41:09.398: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage.glob..func19.2 I0625 05:48:39.403] Jun 25 05:41:09.398: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage.glob..func9.2 I0625 05:48:39.403] Jun 25 05:41:09.398: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage.glob..func8.2 I0625 05:48:39.403] Jun 25 05:41:09.398: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage/vsphere.glob..func17.3 I0625 05:48:39.404] Jun 25 05:41:09.398: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage/vsphere.glob..func9.2 I0625 05:48:39.404] Jun 25 05:41:09.398: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage/vsphere.glob..func4.2 I0625 05:48:39.404] Jun 25 05:41:09.398: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage/vsphere.glob..func1.3 I0625 05:48:39.404] Jun 25 05:48:39.397: INFO: Running AfterSuite actions on node 1 I0625 05:48:39.404] Jun 25 05:48:39.397: INFO: Dumping logs locally to: /workspace/_artifacts/pd-volumesnapshotclass/eb7b8829-f433-11ec-9e31-9224b4edca5e I0625 05:48:39.405] Jun 25 05:48:39.397: INFO: Error running cluster/log-dump/log-dump.sh: fork/exec ../../cluster/log-dump/log-dump.sh: no such file or directory I0625 05:48:39.405] I0625 05:48:39.407] I0625 05:48:39.407] I0625 05:48:39.407] [91m[1mSummarizing 8 Failures:[0m I0625 05:48:39.407] I0625 05:48:39.408] [91m[1m[Fail] [0m[90mExternal Storage [Driver: csi-gcepd-sc-windows--pd-volumesnapshotclass] [0m[0m[Testpattern: Pre-provisioned Snapshot (retain policy)] snapshottable[Feature:VolumeSnapshotDataSource] [0m[90mvolume snapshot controller [0m[0m [0m[91m[1m[It] should check snapshot fields, check restore correctly works after modifying source data, check deletion (persistent) [0m I0625 05:48:39.408] [37mtest/e2e/storage/utils/snapshot.go:86[0m I0625 05:48:39.408] I0625 05:48:39.408] [91m[1m[Fail] [0m[90mExternal Storage [Driver: csi-gcepd-sc-windows--pd-volumesnapshotclass] [0m[0m[Testpattern: Pre-provisioned Snapshot (delete policy)] snapshottable[Feature:VolumeSnapshotDataSource] [0m[90mvolume snapshot controller [0m[0m [0m[91m[1m[It] should check snapshot fields, check restore correctly works after modifying source data, check deletion (persistent) [0m I0625 05:48:39.408] [37mtest/e2e/storage/utils/snapshot.go:86[0m I0625 05:48:39.408] I0625 05:48:39.409] [91m[1m[Fail] [0m[90mExternal Storage [Driver: csi-gcepd-sc-windows--pd-volumesnapshotclass] [0m[0m[Testpattern: Dynamic PV (default fs)] provisioning [0m[91m[1m[It] should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource] [0m I0625 05:48:39.409] [37mtest/e2e/storage/utils/snapshot.go:86[0m I0625 05:48:39.409] I0625 05:48:39.409] [91m[1m[Fail] [0m[90mExternal Storage [Driver: csi-gcepd-sc-windows--pd-volumesnapshotclass] [0m[0m[Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning [0m[91m[1m[It] should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource] [0m I0625 05:48:39.409] [37mtest/e2e/storage/utils/snapshot.go:86[0m I0625 05:48:39.410] I0625 05:48:39.410] [91m[1m[Fail] [0m[90mExternal Storage [Driver: csi-gcepd-sc-windows--pd-volumesnapshotclass] [0m[0m[Testpattern: Ephemeral Snapshot (retain policy)] snapshottable[Feature:VolumeSnapshotDataSource] [0m[90mvolume snapshot controller [0m[0m [0m[91m[1m[It] should check snapshot fields, check restore correctly works, check deletion (ephemeral) [0m I0625 05:48:39.410] [37mtest/e2e/storage/utils/snapshot.go:86[0m I0625 05:48:39.410] I0625 05:48:39.411] [91m[1m[Fail] [0m[90mExternal Storage [Driver: csi-gcepd-sc-windows--pd-volumesnapshotclass] [0m[0m[Testpattern: Dynamic Snapshot (retain policy)] snapshottable[Feature:VolumeSnapshotDataSource] [0m[90mvolume snapshot controller [0m[0m [0m[91m[1m[It] should check snapshot fields, check restore correctly works after modifying source data, check deletion (persistent) [0m I0625 05:48:39.411] [37mtest/e2e/storage/utils/snapshot.go:86[0m I0625 05:48:39.411] I0625 05:48:39.411] [91m[1m[Fail] [0m[90mExternal Storage [Driver: csi-gcepd-sc-windows--pd-volumesnapshotclass] [0m[0m[Testpattern: Ephemeral Snapshot (delete policy)] snapshottable[Feature:VolumeSnapshotDataSource] [0m[90mvolume snapshot controller [0m[0m [0m[91m[1m[It] should check snapshot fields, check restore correctly works, check deletion (ephemeral) [0m I0625 05:48:39.411] [37mtest/e2e/storage/utils/snapshot.go:86[0m I0625 05:48:39.411] I0625 05:48:39.412] [91m[1m[Fail] [0m[90mExternal Storage [Driver: csi-gcepd-sc-windows--pd-volumesnapshotclass] [0m[0m[Testpattern: Dynamic Snapshot (delete policy)] snapshottable[Feature:VolumeSnapshotDataSource] [0m[90mvolume snapshot controller [0m[0m [0m[91m[1m[It] should check snapshot fields, check restore correctly works after modifying source data, check deletion (persistent) [0m I0625 05:48:39.412] [37mtest/e2e/storage/utils/snapshot.go:86[0m I0625 05:48:39.412] I0625 05:48:39.412] [1m[91mRan 8 of 7311 Specs in 2364.722 seconds[0m I0625 05:48:39.412] [1m[91mFAIL![0m -- [32m[1m0 Passed[0m | [91m[1m8 Failed[0m | [33m[1m0 Pending[0m | [36m[1m7303 Skipped[0m I0625 05:48:39.417] I0625 05:48:39.417] I0625 05:48:39.417] Ginkgo ran 1 suite in 39m27.388981975s I0625 05:48:39.417] Test Suite Failed I0625 05:48:39.447] PKGDIR is /go/src/sigs.k8s.io/gcp-compute-persistent-disk-csi-driver I0625 05:48:39.451] installing kustomize W0625 05:48:39.552] F0625 05:48:39.421785 173031 ginkgo.go:215] failed to run ginkgo tester: exit status 1 W0625 05:48:39.552] Error: exit status 255 W0625 05:48:39.552] I0625 05:48:39.444198 6562 utils.go:16] Deleting driver W0625 05:48:39.555] I0625 05:48:39.444217 6562 utils.go:17] cmd env=[KUBERNETES_SERVICE_PORT_HTTPS=443 GCE_SSH_PUBLIC_KEY_FILE=/etc/ssh-key-secret/ssh-public KUBERNETES_SERVICE_PORT=443 JOB_TYPE=periodic BOSKOS_METRICS_SERVICE_PORT=9090 JENKINS_GCE_SSH_PRIVATE_KEY_FILE=/etc/ssh-key-secret/ssh-private HOSTNAME=eb7b8829-f433-11ec-9e31-9224b4edca5e BOSKOS_PORT_80_TCP_ADDR=10.63.250.132 KUBE_GCE_ENABLE_IP_ALIASES=true CLOUDSDK_CORE_DISABLE_PROMPTS=1 BOSKOS_METRICS_SERVICE_HOST=10.63.252.110 PREPULL_YAML=/go/src/sigs.k8s.io/gcp-compute-persistent-disk-csi-driver/test/k8s-integration/prepull.yaml LOG_DUMP_SCRIPT_PATH=/workspace/log-dump.sh GCS_ARTIFACTS_DIR=gs://kubernetes-jenkins/logs/ci-gce-pd-csi-driver-latest-k8s-master-windows-2019/1540532050916806656/artifacts DOCKER_IN_DOCKER_IPV6_ENABLED=false PWD=/go/src/sigs.k8s.io/gcp-compute-persistent-disk-csi-driver BOSKOS_SERVICE_PORT=80 SOURCE_DATE_EPOCH=1655412664 BOSKOS_SERVICE_HOST=10.63.250.132 GOOGLE_APPLICATION_CREDENTIALS=/etc/service-account/service-account.json BUILD_NUMBER=1540532050916806656 NUM_WINDOWS_NODES=3 TEST_TMPDIR=/bazel-scratch/.cache/bazel DOCKER_IN_DOCKER_ENABLED=true HOME=/root ARTIFACTS=/workspace/_artifacts KUBERNETES_PORT_443_TCP=tcp://10.63.240.1:443 IMAGE=gcr.io/k8s-staging-test-infra/kubekins-e2e:v20220624-1a63fdd9f2-master BOSKOS_METRICS_PORT_9090_TCP_PORT=9090 KUBETEST_IN_DOCKER=true BAZEL_REMOTE_CACHE_ENABLED=false CLOUDSDK_CONFIG=/go/src/sigs.k8s.io/gcp-compute-persistent-disk-csi-driver/.config/gcloud BOOTSTRAP_MIGRATION=yes GCE_SSH_PRIVATE_KEY_FILE=/etc/ssh-key-secret/ssh-private PROW_JOB_ID=eb7b8829-f433-11ec-9e31-9224b4edca5e JOB_NAME=ci-gce-pd-csi-driver-latest-k8s-master-windows-2019 BOSKOS_SERVICE_PORT_DEFAULT=80 BOSKOS_PORT_80_TCP_PORT=80 WORKSPACE=/workspace BOSKOS_METRICS_PORT_9090_TCP_PROTO=tcp JENKINS_GCE_SSH_PUBLIC_KEY_FILE=/etc/ssh-key-secret/ssh-public BOSKOS_METRICS_SERVICE_PORT_METRICS=9090 BOSKOS_PORT=tcp://10.63.250.132:80 BOSKOS_PORT_80_TCP=tcp://10.63.250.132:80 BOSKOS_PORT_80_TCP_PROTO=tcp TERM=xterm NODE_NAME=eb7b8829-f433-11ec-9e31-9224b4edca5e USER=prow KUBE_BUILD_PLATFORMS=linux/amd64 windows/amd64 AWS_SSH_PRIVATE_KEY_FILE=/root/.ssh/kube_aws_rsa BOSKOS_METRICS_PORT_9090_TCP_ADDR=10.63.252.110 GOPROXY=https://proxy.golang.org SHLVL=2 USE_TEST_INFRA_LOG_DUMPING=true KUBERNETES_PORT_443_TCP_PROTO=tcp KUBERNETES_PORT_443_TCP_ADDR=10.63.240.1 JOB_SPEC={"type":"periodic","job":"ci-gce-pd-csi-driver-latest-k8s-master-windows-2019","buildid":"1540532050916806656","prowjobid":"eb7b8829-f433-11ec-9e31-9224b4edca5e","extra_refs":[{"org":"kubernetes-sigs","repo":"gcp-compute-persistent-disk-csi-driver","base_ref":"master","path_alias":"sigs.k8s.io/gcp-compute-persistent-disk-csi-driver"}]} KUBELET_TEST_ARGS=--feature-gates=KubeletPodResources=false BAZEL_VERSION=3.4.1 BOSKOS_METRICS_PORT=tcp://10.63.252.110:9090 E2E_GOOGLE_APPLICATION_CREDENTIALS=/etc/service-account/service-account.json BOSKOS_METRICS_PORT_9090_TCP=tcp://10.63.252.110:9090 KUBERNETES_SERVICE_HOST=10.63.240.1 KUBERNETES_NODE_PLATFORM=windows KUBERNETES_PORT=tcp://10.63.240.1:443 KUBERNETES_PORT_443_TCP_PORT=443 WINDOWS_ENABLE_DSR=true NUM_NODES=1 PATH=/go/bin:/go/bin:/usr/local/go/bin:/google-cloud-sdk/bin:/workspace:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin CI=true GOOGLE_APPLICATION_CREDENTIALS_DEPRECATED=Migrate to workload identity, contact sig-testing GO_TARBALL=go1.18.3.linux-amd64.tar.gz WINDOWS_NODE_OS_DISTRIBUTION=win2019 BUILD_ID=1540532050916806656 AWS_SSH_PUBLIC_KEY_FILE=/root/.ssh/kube_aws_rsa.pub OLDPWD=/workspace/test-infra GOPATH=/go _=/go/src/sigs.k8s.io/gcp-compute-persistent-disk-csi-driver/bin/k8s-integration-test PROJECT=gce-cvm-upg-1-3-1-4-ctl-skew GCE_PD_CSI_STAGING_VERSION=a0578d58-2680-44c3-9542-419d96384711 GCE_PD_CSI_STAGING_IMAGE=gcr.io/gce-cvm-upg-1-3-1-4-ctl-skew/gcp-persistent-disk-csi-driver GCE_PD_KUBECTL=/tmp/gcp-pd-driver-tmp1125011335/kubernetes/cluster/kubectl.sh MASTER_SIZE=n1-standard-4 KUBE_GCE_ZONE=us-central1-b KUBECONFIG=/root/.kube/config GOPATH=/go GCE_PD_DRIVER_VERSION=stable-master] W0625 05:48:39.556] I0625 05:48:39.444292 6562 utils.go:18] cmd args=[/go/src/sigs.k8s.io/gcp-compute-persistent-disk-csi-driver/deploy/kubernetes/delete-driver.sh] I0625 05:48:40.021] WARNING: pod log: csi-gce-pd-controller-b468c5784-xl4dn/csi-provisioner: context canceled I0625 05:48:40.022] WARNING: pod log: csi-gce-pd-controller-b468c5784-xl4dn/csi-attacher: context canceled I0625 05:48:40.022] WARNING: pod log: csi-gce-pd-controller-b468c5784-xl4dn/csi-resizer: context canceled ... skipping 120 lines ... W0625 05:55:09.340] Associated tags: W0625 05:55:09.340] - a0578d58-2680-44c3-9542-419d96384711 W0625 05:55:09.341] Tags: W0625 05:55:09.341] - gcr.io/gce-cvm-upg-1-3-1-4-ctl-skew/gcp-persistent-disk-csi-driver:a0578d58-2680-44c3-9542-419d96384711 W0625 05:55:09.520] Deleted [gcr.io/gce-cvm-upg-1-3-1-4-ctl-skew/gcp-persistent-disk-csi-driver:a0578d58-2680-44c3-9542-419d96384711]. W0625 05:55:09.901] Deleted [gcr.io/gce-cvm-upg-1-3-1-4-ctl-skew/gcp-persistent-disk-csi-driver@sha256:ed229e48b6fcd3cbf34509126b488087218f9c2438b96df6be4d1453234c266b]. W0625 05:55:10.943] F0625 05:55:10.942986 6562 main.go:196] Failed to run integration test: runCSITests failed: failed to run tests on e2e cluster: exit status 1 W0625 05:55:10.957] Traceback (most recent call last): W0625 05:55:10.957] File "/workspace/./test-infra/jenkins/../scenarios/execute.py", line 50, in <module> W0625 05:55:10.959] main(ARGS.env, ARGS.cmd + ARGS.args) W0625 05:55:10.959] File "/workspace/./test-infra/jenkins/../scenarios/execute.py", line 41, in main W0625 05:55:10.959] check(*cmd) W0625 05:55:10.960] File "/workspace/./test-infra/jenkins/../scenarios/execute.py", line 30, in check W0625 05:55:10.960] subprocess.check_call(cmd) W0625 05:55:10.960] File "/usr/lib/python2.7/subprocess.py", line 190, in check_call W0625 05:55:10.960] raise CalledProcessError(retcode, cmd) W0625 05:55:10.961] subprocess.CalledProcessError: Command '('test/run-windows-k8s-integration.sh',)' returned non-zero exit status 255 E0625 05:55:10.982] Command failed I0625 05:55:10.982] process 435 exited with code 1 after 167.6m E0625 05:55:10.983] FAIL: ci-gce-pd-csi-driver-latest-k8s-master-windows-2019 I0625 05:55:10.985] Call: gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json W0625 05:55:11.711] Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com] I0625 05:55:11.875] process 174656 exited with code 0 after 0.0m I0625 05:55:11.876] Call: gcloud config get-value account I0625 05:55:12.640] process 174670 exited with code 0 after 0.0m I0625 05:55:12.641] Will upload results to gs://kubernetes-jenkins/logs using pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com I0625 05:55:12.641] Upload result and artifacts... I0625 05:55:12.641] Gubernator results at https://gubernator.k8s.io/build/kubernetes-jenkins/logs/ci-gce-pd-csi-driver-latest-k8s-master-windows-2019/1540532050916806656 I0625 05:55:12.642] Call: gsutil ls gs://kubernetes-jenkins/logs/ci-gce-pd-csi-driver-latest-k8s-master-windows-2019/1540532050916806656/artifacts W0625 05:55:14.166] CommandException: One or more URLs matched no objects. E0625 05:55:14.594] Command failed I0625 05:55:14.594] process 174684 exited with code 1 after 0.0m W0625 05:55:14.595] Remote dir gs://kubernetes-jenkins/logs/ci-gce-pd-csi-driver-latest-k8s-master-windows-2019/1540532050916806656/artifacts not exist yet I0625 05:55:14.595] Call: gsutil -m -q -o GSUtil:use_magicfile=True cp -r -c -z log,txt,xml /workspace/_artifacts gs://kubernetes-jenkins/logs/ci-gce-pd-csi-driver-latest-k8s-master-windows-2019/1540532050916806656/artifacts I0625 05:55:19.547] process 174824 exited with code 0 after 0.1m W0625 05:55:19.548] metadata path /workspace/_artifacts/metadata.json does not exist W0625 05:55:19.548] metadata not found or invalid, init with empty metadata ... skipping 15 lines ...