This job view page is being replaced by Spyglass soon. Check out the new job view.
PRandyzhangx: fix: incorrect driver version in CSIDriver
ResultFAILURE
Tests 0 failed / 0 succeeded
Started2023-01-30 07:49
Elapsed1h6m
Revision38e7f23c91488819c3ba76b2df5a19d34fb4b380
Refs 1172

No Test Failures!


Error lines from build-log.txt

... skipping 806 lines ...
certificate.cert-manager.io "selfsigned-cert" deleted
# Create secret for AzureClusterIdentity
./hack/create-identity-secret.sh
make[2]: Entering directory '/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure'
make[2]: Nothing to be done for 'kubectl'.
make[2]: Leaving directory '/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure'
Error from server (NotFound): secrets "cluster-identity-secret" not found
secret/cluster-identity-secret created
secret/cluster-identity-secret labeled
# Create customized cloud provider configs
./hack/create-custom-cloud-provider-config.sh
make[2]: Entering directory '/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure'
make[2]: Nothing to be done for 'kubectl'.
... skipping 221 lines ...

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100 11345  100 11345    0     0   181k      0 --:--:-- --:--:-- --:--:--  181k
Downloading https://get.helm.sh/helm-v3.11.0-linux-amd64.tar.gz
Verifying checksum... Done.
Preparing to install helm into /usr/local/bin
helm installed into /usr/local/bin/helm
docker pull capzci.azurecr.io/azurefile-csi:e2e-96a2ca02f36f8e1cb5b590f772c52ba00ac89296 || make container-all push-manifest
Error response from daemon: manifest for capzci.azurecr.io/azurefile-csi:e2e-96a2ca02f36f8e1cb5b590f772c52ba00ac89296 not found: manifest unknown: manifest tagged by "e2e-96a2ca02f36f8e1cb5b590f772c52ba00ac89296" is not found
make[2]: Entering directory '/home/prow/go/src/sigs.k8s.io/azurefile-csi-driver'
CGO_ENABLED=0 GOOS=windows go build -a -ldflags "-X sigs.k8s.io/azurefile-csi-driver/pkg/azurefile.driverVersion=e2e-96a2ca02f36f8e1cb5b590f772c52ba00ac89296 -X sigs.k8s.io/azurefile-csi-driver/pkg/azurefile.gitCommit=96a2ca02f36f8e1cb5b590f772c52ba00ac89296 -X sigs.k8s.io/azurefile-csi-driver/pkg/azurefile.buildDate=2023-01-30T08:05:06Z -s -w -extldflags '-static'" -mod vendor -o _output/amd64/azurefileplugin.exe ./pkg/azurefileplugin
docker buildx rm container-builder || true
ERROR: no builder "container-builder" found
docker buildx create --use --name=container-builder
container-builder
# enable qemu for arm64 build
# https://github.com/docker/buildx/issues/464#issuecomment-741507760
docker run --privileged --rm tonistiigi/binfmt --uninstall qemu-aarch64
Unable to find image 'tonistiigi/binfmt:latest' locally
... skipping 2555 lines ...
          image: "mcr.microsoft.com/oss/kubernetes-csi/csi-resizer:v1.6.0"
          args:
            - "-csi-address=$(ADDRESS)"
            - "-v=2"
            - "-leader-election"
            - "--leader-election-namespace=kube-system"
            - '-handle-volume-inuse-error=false'
            - '-timeout=120s'
            - '-feature-gates=RecoverVolumeExpansionFailure=true'
          env:
            - name: ADDRESS
              value: /csi/csi.sock
          imagePullPolicy: IfNotPresent
... skipping 354 lines ...
Jan 30 08:22:24.204: INFO: PersistentVolumeClaim pvc-7t4rj found but phase is Pending instead of Bound.
Jan 30 08:22:26.314: INFO: PersistentVolumeClaim pvc-7t4rj found and phase=Bound (1m49.83035825s)
STEP: checking the PVC 01/30/23 08:22:26.314
STEP: validating provisioned PV 01/30/23 08:22:26.425
STEP: checking the PV 01/30/23 08:22:26.534
STEP: deploying the pod 01/30/23 08:22:26.534
STEP: checking that the pods command exits with no error 01/30/23 08:22:26.649
Jan 30 08:22:26.649: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-lwpmj" in namespace "azurefile-2540" to be "Succeeded or Failed"
Jan 30 08:22:26.758: INFO: Pod "azurefile-volume-tester-lwpmj": Phase="Pending", Reason="", readiness=false. Elapsed: 108.351177ms
Jan 30 08:22:28.868: INFO: Pod "azurefile-volume-tester-lwpmj": Phase="Pending", Reason="", readiness=false. Elapsed: 2.218781015s
Jan 30 08:22:30.868: INFO: Pod "azurefile-volume-tester-lwpmj": Phase="Pending", Reason="", readiness=false. Elapsed: 4.219273265s
Jan 30 08:22:32.876: INFO: Pod "azurefile-volume-tester-lwpmj": Phase="Pending", Reason="", readiness=false. Elapsed: 6.226830242s
Jan 30 08:22:34.867: INFO: Pod "azurefile-volume-tester-lwpmj": Phase="Pending", Reason="", readiness=false. Elapsed: 8.217711431s
Jan 30 08:22:36.874: INFO: Pod "azurefile-volume-tester-lwpmj": Phase="Pending", Reason="", readiness=false. Elapsed: 10.225139674s
... skipping 77 lines ...
Jan 30 08:25:12.873: INFO: Pod "azurefile-volume-tester-lwpmj": Phase="Running", Reason="", readiness=true. Elapsed: 2m46.224232526s
Jan 30 08:25:14.875: INFO: Pod "azurefile-volume-tester-lwpmj": Phase="Running", Reason="", readiness=true. Elapsed: 2m48.225611693s
Jan 30 08:25:16.875: INFO: Pod "azurefile-volume-tester-lwpmj": Phase="Running", Reason="", readiness=true. Elapsed: 2m50.226011683s
Jan 30 08:25:18.875: INFO: Pod "azurefile-volume-tester-lwpmj": Phase="Running", Reason="", readiness=false. Elapsed: 2m52.226081333s
Jan 30 08:25:20.875: INFO: Pod "azurefile-volume-tester-lwpmj": Phase="Succeeded", Reason="", readiness=false. Elapsed: 2m54.225676361s
STEP: Saw pod success 01/30/23 08:25:20.875
Jan 30 08:25:20.875: INFO: Pod "azurefile-volume-tester-lwpmj" satisfied condition "Succeeded or Failed"
Jan 30 08:25:20.875: INFO: deleting Pod "azurefile-2540"/"azurefile-volume-tester-lwpmj"
Jan 30 08:25:21.006: INFO: Pod azurefile-volume-tester-lwpmj has the following logs: hello world

STEP: Deleting pod azurefile-volume-tester-lwpmj in namespace azurefile-2540 01/30/23 08:25:21.006
Jan 30 08:25:21.231: INFO: deleting PVC "azurefile-2540"/"pvc-7t4rj"
Jan 30 08:25:21.231: INFO: Deleting PersistentVolumeClaim "pvc-7t4rj"
... skipping 79 lines ...
    Jan 30 08:22:24.204: INFO: PersistentVolumeClaim pvc-7t4rj found but phase is Pending instead of Bound.
    Jan 30 08:22:26.314: INFO: PersistentVolumeClaim pvc-7t4rj found and phase=Bound (1m49.83035825s)
    STEP: checking the PVC 01/30/23 08:22:26.314
    STEP: validating provisioned PV 01/30/23 08:22:26.425
    STEP: checking the PV 01/30/23 08:22:26.534
    STEP: deploying the pod 01/30/23 08:22:26.534
    STEP: checking that the pods command exits with no error 01/30/23 08:22:26.649
    Jan 30 08:22:26.649: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-lwpmj" in namespace "azurefile-2540" to be "Succeeded or Failed"
    Jan 30 08:22:26.758: INFO: Pod "azurefile-volume-tester-lwpmj": Phase="Pending", Reason="", readiness=false. Elapsed: 108.351177ms
    Jan 30 08:22:28.868: INFO: Pod "azurefile-volume-tester-lwpmj": Phase="Pending", Reason="", readiness=false. Elapsed: 2.218781015s
    Jan 30 08:22:30.868: INFO: Pod "azurefile-volume-tester-lwpmj": Phase="Pending", Reason="", readiness=false. Elapsed: 4.219273265s
    Jan 30 08:22:32.876: INFO: Pod "azurefile-volume-tester-lwpmj": Phase="Pending", Reason="", readiness=false. Elapsed: 6.226830242s
    Jan 30 08:22:34.867: INFO: Pod "azurefile-volume-tester-lwpmj": Phase="Pending", Reason="", readiness=false. Elapsed: 8.217711431s
    Jan 30 08:22:36.874: INFO: Pod "azurefile-volume-tester-lwpmj": Phase="Pending", Reason="", readiness=false. Elapsed: 10.225139674s
... skipping 77 lines ...
    Jan 30 08:25:12.873: INFO: Pod "azurefile-volume-tester-lwpmj": Phase="Running", Reason="", readiness=true. Elapsed: 2m46.224232526s
    Jan 30 08:25:14.875: INFO: Pod "azurefile-volume-tester-lwpmj": Phase="Running", Reason="", readiness=true. Elapsed: 2m48.225611693s
    Jan 30 08:25:16.875: INFO: Pod "azurefile-volume-tester-lwpmj": Phase="Running", Reason="", readiness=true. Elapsed: 2m50.226011683s
    Jan 30 08:25:18.875: INFO: Pod "azurefile-volume-tester-lwpmj": Phase="Running", Reason="", readiness=false. Elapsed: 2m52.226081333s
    Jan 30 08:25:20.875: INFO: Pod "azurefile-volume-tester-lwpmj": Phase="Succeeded", Reason="", readiness=false. Elapsed: 2m54.225676361s
    STEP: Saw pod success 01/30/23 08:25:20.875
    Jan 30 08:25:20.875: INFO: Pod "azurefile-volume-tester-lwpmj" satisfied condition "Succeeded or Failed"
    Jan 30 08:25:20.875: INFO: deleting Pod "azurefile-2540"/"azurefile-volume-tester-lwpmj"
    Jan 30 08:25:21.006: INFO: Pod azurefile-volume-tester-lwpmj has the following logs: hello world

    STEP: Deleting pod azurefile-volume-tester-lwpmj in namespace azurefile-2540 01/30/23 08:25:21.006
    Jan 30 08:25:21.231: INFO: deleting PVC "azurefile-2540"/"pvc-7t4rj"
    Jan 30 08:25:21.231: INFO: Deleting PersistentVolumeClaim "pvc-7t4rj"
... skipping 41 lines ...
Jan 30 08:25:54.201: INFO: PersistentVolumeClaim pvc-664k7 found but phase is Pending instead of Bound.
Jan 30 08:25:56.310: INFO: PersistentVolumeClaim pvc-664k7 found and phase=Bound (27.522853395s)
STEP: checking the PVC 01/30/23 08:25:56.31
STEP: validating provisioned PV 01/30/23 08:25:56.418
STEP: checking the PV 01/30/23 08:25:56.526
STEP: deploying the pod 01/30/23 08:25:56.526
STEP: checking that the pods command exits with no error 01/30/23 08:25:56.638
Jan 30 08:25:56.638: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-cs4vd" in namespace "azurefile-4728" to be "Succeeded or Failed"
Jan 30 08:25:56.750: INFO: Pod "azurefile-volume-tester-cs4vd": Phase="Pending", Reason="", readiness=false. Elapsed: 112.189308ms
Jan 30 08:25:58.860: INFO: Pod "azurefile-volume-tester-cs4vd": Phase="Pending", Reason="", readiness=false. Elapsed: 2.221866496s
Jan 30 08:26:00.867: INFO: Pod "azurefile-volume-tester-cs4vd": Phase="Pending", Reason="", readiness=false. Elapsed: 4.22914326s
Jan 30 08:26:02.866: INFO: Pod "azurefile-volume-tester-cs4vd": Phase="Pending", Reason="", readiness=false. Elapsed: 6.22805399s
Jan 30 08:26:04.868: INFO: Pod "azurefile-volume-tester-cs4vd": Phase="Pending", Reason="", readiness=false. Elapsed: 8.229622569s
Jan 30 08:26:06.867: INFO: Pod "azurefile-volume-tester-cs4vd": Phase="Pending", Reason="", readiness=false. Elapsed: 10.229082265s
Jan 30 08:26:08.868: INFO: Pod "azurefile-volume-tester-cs4vd": Phase="Running", Reason="", readiness=true. Elapsed: 12.229644414s
Jan 30 08:26:10.867: INFO: Pod "azurefile-volume-tester-cs4vd": Phase="Running", Reason="", readiness=true. Elapsed: 14.229372141s
Jan 30 08:26:12.865: INFO: Pod "azurefile-volume-tester-cs4vd": Phase="Running", Reason="", readiness=false. Elapsed: 16.227583372s
Jan 30 08:26:14.866: INFO: Pod "azurefile-volume-tester-cs4vd": Phase="Succeeded", Reason="", readiness=false. Elapsed: 18.228246335s
STEP: Saw pod success 01/30/23 08:26:14.866
Jan 30 08:26:14.866: INFO: Pod "azurefile-volume-tester-cs4vd" satisfied condition "Succeeded or Failed"
Jan 30 08:26:14.866: INFO: deleting Pod "azurefile-4728"/"azurefile-volume-tester-cs4vd"
Jan 30 08:26:14.982: INFO: Pod azurefile-volume-tester-cs4vd has the following logs: hello world

STEP: Deleting pod azurefile-volume-tester-cs4vd in namespace azurefile-4728 01/30/23 08:26:14.982
Jan 30 08:26:15.108: INFO: deleting PVC "azurefile-4728"/"pvc-664k7"
Jan 30 08:26:15.108: INFO: Deleting PersistentVolumeClaim "pvc-664k7"
... skipping 40 lines ...
    Jan 30 08:25:54.201: INFO: PersistentVolumeClaim pvc-664k7 found but phase is Pending instead of Bound.
    Jan 30 08:25:56.310: INFO: PersistentVolumeClaim pvc-664k7 found and phase=Bound (27.522853395s)
    STEP: checking the PVC 01/30/23 08:25:56.31
    STEP: validating provisioned PV 01/30/23 08:25:56.418
    STEP: checking the PV 01/30/23 08:25:56.526
    STEP: deploying the pod 01/30/23 08:25:56.526
    STEP: checking that the pods command exits with no error 01/30/23 08:25:56.638
    Jan 30 08:25:56.638: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-cs4vd" in namespace "azurefile-4728" to be "Succeeded or Failed"
    Jan 30 08:25:56.750: INFO: Pod "azurefile-volume-tester-cs4vd": Phase="Pending", Reason="", readiness=false. Elapsed: 112.189308ms
    Jan 30 08:25:58.860: INFO: Pod "azurefile-volume-tester-cs4vd": Phase="Pending", Reason="", readiness=false. Elapsed: 2.221866496s
    Jan 30 08:26:00.867: INFO: Pod "azurefile-volume-tester-cs4vd": Phase="Pending", Reason="", readiness=false. Elapsed: 4.22914326s
    Jan 30 08:26:02.866: INFO: Pod "azurefile-volume-tester-cs4vd": Phase="Pending", Reason="", readiness=false. Elapsed: 6.22805399s
    Jan 30 08:26:04.868: INFO: Pod "azurefile-volume-tester-cs4vd": Phase="Pending", Reason="", readiness=false. Elapsed: 8.229622569s
    Jan 30 08:26:06.867: INFO: Pod "azurefile-volume-tester-cs4vd": Phase="Pending", Reason="", readiness=false. Elapsed: 10.229082265s
    Jan 30 08:26:08.868: INFO: Pod "azurefile-volume-tester-cs4vd": Phase="Running", Reason="", readiness=true. Elapsed: 12.229644414s
    Jan 30 08:26:10.867: INFO: Pod "azurefile-volume-tester-cs4vd": Phase="Running", Reason="", readiness=true. Elapsed: 14.229372141s
    Jan 30 08:26:12.865: INFO: Pod "azurefile-volume-tester-cs4vd": Phase="Running", Reason="", readiness=false. Elapsed: 16.227583372s
    Jan 30 08:26:14.866: INFO: Pod "azurefile-volume-tester-cs4vd": Phase="Succeeded", Reason="", readiness=false. Elapsed: 18.228246335s
    STEP: Saw pod success 01/30/23 08:26:14.866
    Jan 30 08:26:14.866: INFO: Pod "azurefile-volume-tester-cs4vd" satisfied condition "Succeeded or Failed"
    Jan 30 08:26:14.866: INFO: deleting Pod "azurefile-4728"/"azurefile-volume-tester-cs4vd"
    Jan 30 08:26:14.982: INFO: Pod azurefile-volume-tester-cs4vd has the following logs: hello world

    STEP: Deleting pod azurefile-volume-tester-cs4vd in namespace azurefile-4728 01/30/23 08:26:14.982
    Jan 30 08:26:15.108: INFO: deleting PVC "azurefile-4728"/"pvc-664k7"
    Jan 30 08:26:15.108: INFO: Deleting PersistentVolumeClaim "pvc-664k7"
... skipping 203 lines ...
Jan 30 08:27:29.971: INFO: PersistentVolumeClaim pvc-gljzn found but phase is Pending instead of Bound.
Jan 30 08:27:32.079: INFO: PersistentVolumeClaim pvc-gljzn found and phase=Bound (33.857521635s)
STEP: checking the PVC 01/30/23 08:27:32.079
STEP: validating provisioned PV 01/30/23 08:27:32.188
STEP: checking the PV 01/30/23 08:27:32.296
STEP: deploying the pod 01/30/23 08:27:32.296
STEP: checking that the pods command exits with an error 01/30/23 08:27:32.409
Jan 30 08:27:32.409: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-lh7gp" in namespace "azurefile-2790" to be "Error status code"
Jan 30 08:27:32.518: INFO: Pod "azurefile-volume-tester-lh7gp": Phase="Pending", Reason="", readiness=false. Elapsed: 108.643665ms
Jan 30 08:27:34.627: INFO: Pod "azurefile-volume-tester-lh7gp": Phase="Pending", Reason="", readiness=false. Elapsed: 2.217753426s
Jan 30 08:27:36.634: INFO: Pod "azurefile-volume-tester-lh7gp": Phase="Pending", Reason="", readiness=false. Elapsed: 4.22459184s
Jan 30 08:27:38.634: INFO: Pod "azurefile-volume-tester-lh7gp": Phase="Pending", Reason="", readiness=false. Elapsed: 6.224564932s
Jan 30 08:27:40.637: INFO: Pod "azurefile-volume-tester-lh7gp": Phase="Running", Reason="", readiness=true. Elapsed: 8.227889975s
Jan 30 08:27:42.635: INFO: Pod "azurefile-volume-tester-lh7gp": Phase="Running", Reason="", readiness=true. Elapsed: 10.2261614s
Jan 30 08:27:44.636: INFO: Pod "azurefile-volume-tester-lh7gp": Phase="Running", Reason="", readiness=true. Elapsed: 12.227010786s
Jan 30 08:27:46.635: INFO: Pod "azurefile-volume-tester-lh7gp": Phase="Running", Reason="", readiness=false. Elapsed: 14.225476866s
Jan 30 08:27:48.633: INFO: Pod "azurefile-volume-tester-lh7gp": Phase="Failed", Reason="", readiness=false. Elapsed: 16.224136065s
STEP: Saw pod failure 01/30/23 08:27:48.634
Jan 30 08:27:48.634: INFO: Pod "azurefile-volume-tester-lh7gp" satisfied condition "Error status code"
STEP: checking that pod logs contain expected message 01/30/23 08:27:48.634
Jan 30 08:27:48.753: INFO: deleting Pod "azurefile-2790"/"azurefile-volume-tester-lh7gp"
Jan 30 08:27:48.864: INFO: Pod azurefile-volume-tester-lh7gp has the following logs: out-file : Access to the path 'C:\mnt\test-1\data' is denied.
At line:1 char:1
+ echo $null >> C:\mnt\test-1\data
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
... skipping 51 lines ...
    Jan 30 08:27:29.971: INFO: PersistentVolumeClaim pvc-gljzn found but phase is Pending instead of Bound.
    Jan 30 08:27:32.079: INFO: PersistentVolumeClaim pvc-gljzn found and phase=Bound (33.857521635s)
    STEP: checking the PVC 01/30/23 08:27:32.079
    STEP: validating provisioned PV 01/30/23 08:27:32.188
    STEP: checking the PV 01/30/23 08:27:32.296
    STEP: deploying the pod 01/30/23 08:27:32.296
    STEP: checking that the pods command exits with an error 01/30/23 08:27:32.409
    Jan 30 08:27:32.409: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-lh7gp" in namespace "azurefile-2790" to be "Error status code"
    Jan 30 08:27:32.518: INFO: Pod "azurefile-volume-tester-lh7gp": Phase="Pending", Reason="", readiness=false. Elapsed: 108.643665ms
    Jan 30 08:27:34.627: INFO: Pod "azurefile-volume-tester-lh7gp": Phase="Pending", Reason="", readiness=false. Elapsed: 2.217753426s
    Jan 30 08:27:36.634: INFO: Pod "azurefile-volume-tester-lh7gp": Phase="Pending", Reason="", readiness=false. Elapsed: 4.22459184s
    Jan 30 08:27:38.634: INFO: Pod "azurefile-volume-tester-lh7gp": Phase="Pending", Reason="", readiness=false. Elapsed: 6.224564932s
    Jan 30 08:27:40.637: INFO: Pod "azurefile-volume-tester-lh7gp": Phase="Running", Reason="", readiness=true. Elapsed: 8.227889975s
    Jan 30 08:27:42.635: INFO: Pod "azurefile-volume-tester-lh7gp": Phase="Running", Reason="", readiness=true. Elapsed: 10.2261614s
    Jan 30 08:27:44.636: INFO: Pod "azurefile-volume-tester-lh7gp": Phase="Running", Reason="", readiness=true. Elapsed: 12.227010786s
    Jan 30 08:27:46.635: INFO: Pod "azurefile-volume-tester-lh7gp": Phase="Running", Reason="", readiness=false. Elapsed: 14.225476866s
    Jan 30 08:27:48.633: INFO: Pod "azurefile-volume-tester-lh7gp": Phase="Failed", Reason="", readiness=false. Elapsed: 16.224136065s
    STEP: Saw pod failure 01/30/23 08:27:48.634
    Jan 30 08:27:48.634: INFO: Pod "azurefile-volume-tester-lh7gp" satisfied condition "Error status code"
    STEP: checking that pod logs contain expected message 01/30/23 08:27:48.634
    Jan 30 08:27:48.753: INFO: deleting Pod "azurefile-2790"/"azurefile-volume-tester-lh7gp"
    Jan 30 08:27:48.864: INFO: Pod azurefile-volume-tester-lh7gp has the following logs: out-file : Access to the path 'C:\mnt\test-1\data' is denied.
    At line:1 char:1
    + echo $null >> C:\mnt\test-1\data
    + ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
... skipping 362 lines ...
Jan 30 08:29:56.815: INFO: PersistentVolumeClaim pvc-cql2p found but phase is Pending instead of Bound.
Jan 30 08:29:58.924: INFO: PersistentVolumeClaim pvc-cql2p found and phase=Bound (31.751004612s)
STEP: checking the PVC 01/30/23 08:29:58.924
STEP: validating provisioned PV 01/30/23 08:29:59.032
STEP: checking the PV 01/30/23 08:29:59.14
STEP: deploying the pod 01/30/23 08:29:59.14
STEP: checking that the pods command exits with no error 01/30/23 08:29:59.254
Jan 30 08:29:59.254: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-4z4r5" in namespace "azurefile-4538" to be "Succeeded or Failed"
Jan 30 08:29:59.362: INFO: Pod "azurefile-volume-tester-4z4r5": Phase="Pending", Reason="", readiness=false. Elapsed: 107.781466ms
Jan 30 08:30:01.471: INFO: Pod "azurefile-volume-tester-4z4r5": Phase="Pending", Reason="", readiness=false. Elapsed: 2.216857858s
Jan 30 08:30:03.479: INFO: Pod "azurefile-volume-tester-4z4r5": Phase="Pending", Reason="", readiness=false. Elapsed: 4.224841073s
Jan 30 08:30:05.484: INFO: Pod "azurefile-volume-tester-4z4r5": Phase="Pending", Reason="", readiness=false. Elapsed: 6.229718248s
Jan 30 08:30:07.478: INFO: Pod "azurefile-volume-tester-4z4r5": Phase="Running", Reason="", readiness=true. Elapsed: 8.224480177s
Jan 30 08:30:09.478: INFO: Pod "azurefile-volume-tester-4z4r5": Phase="Running", Reason="", readiness=true. Elapsed: 10.224482687s
Jan 30 08:30:11.482: INFO: Pod "azurefile-volume-tester-4z4r5": Phase="Running", Reason="", readiness=true. Elapsed: 12.227752422s
Jan 30 08:30:13.481: INFO: Pod "azurefile-volume-tester-4z4r5": Phase="Running", Reason="", readiness=false. Elapsed: 14.227193071s
Jan 30 08:30:15.479: INFO: Pod "azurefile-volume-tester-4z4r5": Phase="Succeeded", Reason="", readiness=false. Elapsed: 16.225369348s
STEP: Saw pod success 01/30/23 08:30:15.479
Jan 30 08:30:15.479: INFO: Pod "azurefile-volume-tester-4z4r5" satisfied condition "Succeeded or Failed"
STEP: resizing the pvc 01/30/23 08:30:15.588
STEP: sleep 30s waiting for resize complete 01/30/23 08:30:15.701
STEP: checking the resizing result 01/30/23 08:30:45.718
STEP: checking the resizing PV result 01/30/23 08:30:45.827
STEP: checking the resizing azurefile result 01/30/23 08:30:45.935
Jan 30 08:30:46.979: INFO: deleting Pod "azurefile-4538"/"azurefile-volume-tester-4z4r5"
... skipping 47 lines ...
    Jan 30 08:29:56.815: INFO: PersistentVolumeClaim pvc-cql2p found but phase is Pending instead of Bound.
    Jan 30 08:29:58.924: INFO: PersistentVolumeClaim pvc-cql2p found and phase=Bound (31.751004612s)
    STEP: checking the PVC 01/30/23 08:29:58.924
    STEP: validating provisioned PV 01/30/23 08:29:59.032
    STEP: checking the PV 01/30/23 08:29:59.14
    STEP: deploying the pod 01/30/23 08:29:59.14
    STEP: checking that the pods command exits with no error 01/30/23 08:29:59.254
    Jan 30 08:29:59.254: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-4z4r5" in namespace "azurefile-4538" to be "Succeeded or Failed"
    Jan 30 08:29:59.362: INFO: Pod "azurefile-volume-tester-4z4r5": Phase="Pending", Reason="", readiness=false. Elapsed: 107.781466ms
    Jan 30 08:30:01.471: INFO: Pod "azurefile-volume-tester-4z4r5": Phase="Pending", Reason="", readiness=false. Elapsed: 2.216857858s
    Jan 30 08:30:03.479: INFO: Pod "azurefile-volume-tester-4z4r5": Phase="Pending", Reason="", readiness=false. Elapsed: 4.224841073s
    Jan 30 08:30:05.484: INFO: Pod "azurefile-volume-tester-4z4r5": Phase="Pending", Reason="", readiness=false. Elapsed: 6.229718248s
    Jan 30 08:30:07.478: INFO: Pod "azurefile-volume-tester-4z4r5": Phase="Running", Reason="", readiness=true. Elapsed: 8.224480177s
    Jan 30 08:30:09.478: INFO: Pod "azurefile-volume-tester-4z4r5": Phase="Running", Reason="", readiness=true. Elapsed: 10.224482687s
    Jan 30 08:30:11.482: INFO: Pod "azurefile-volume-tester-4z4r5": Phase="Running", Reason="", readiness=true. Elapsed: 12.227752422s
    Jan 30 08:30:13.481: INFO: Pod "azurefile-volume-tester-4z4r5": Phase="Running", Reason="", readiness=false. Elapsed: 14.227193071s
    Jan 30 08:30:15.479: INFO: Pod "azurefile-volume-tester-4z4r5": Phase="Succeeded", Reason="", readiness=false. Elapsed: 16.225369348s
    STEP: Saw pod success 01/30/23 08:30:15.479
    Jan 30 08:30:15.479: INFO: Pod "azurefile-volume-tester-4z4r5" satisfied condition "Succeeded or Failed"
    STEP: resizing the pvc 01/30/23 08:30:15.588
    STEP: sleep 30s waiting for resize complete 01/30/23 08:30:15.701
    STEP: checking the resizing result 01/30/23 08:30:45.718
    STEP: checking the resizing PV result 01/30/23 08:30:45.827
    STEP: checking the resizing azurefile result 01/30/23 08:30:45.935
    Jan 30 08:30:46.979: INFO: deleting Pod "azurefile-4538"/"azurefile-volume-tester-4z4r5"
... skipping 361 lines ...
Jan 30 08:31:20.774: INFO: PersistentVolumeClaim pvc-hlg9k found but phase is Pending instead of Bound.
Jan 30 08:31:22.883: INFO: PersistentVolumeClaim pvc-hlg9k found and phase=Bound (2.217161499s)
STEP: checking the PVC 01/30/23 08:31:22.883
STEP: validating provisioned PV 01/30/23 08:31:22.992
STEP: checking the PV 01/30/23 08:31:23.1
STEP: deploying the pod 01/30/23 08:31:23.101
STEP: checking that the pods command exits with no error 01/30/23 08:31:23.213
Jan 30 08:31:23.213: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-68rdv" in namespace "azurefile-7726" to be "Succeeded or Failed"
Jan 30 08:31:23.328: INFO: Pod "azurefile-volume-tester-68rdv": Phase="Pending", Reason="", readiness=false. Elapsed: 115.57569ms
Jan 30 08:31:25.446: INFO: Pod "azurefile-volume-tester-68rdv": Phase="Pending", Reason="", readiness=false. Elapsed: 2.233419767s
Jan 30 08:31:27.446: INFO: Pod "azurefile-volume-tester-68rdv": Phase="Pending", Reason="", readiness=false. Elapsed: 4.232865643s
Jan 30 08:31:29.447: INFO: Pod "azurefile-volume-tester-68rdv": Phase="Pending", Reason="", readiness=false. Elapsed: 6.233935977s
Jan 30 08:31:31.446: INFO: Pod "azurefile-volume-tester-68rdv": Phase="Pending", Reason="", readiness=false. Elapsed: 8.233246656s
Jan 30 08:31:33.446: INFO: Pod "azurefile-volume-tester-68rdv": Phase="Pending", Reason="", readiness=false. Elapsed: 10.232787825s
Jan 30 08:31:35.444: INFO: Pod "azurefile-volume-tester-68rdv": Phase="Running", Reason="", readiness=true. Elapsed: 12.231025673s
Jan 30 08:31:37.445: INFO: Pod "azurefile-volume-tester-68rdv": Phase="Running", Reason="", readiness=true. Elapsed: 14.231726164s
Jan 30 08:31:39.445: INFO: Pod "azurefile-volume-tester-68rdv": Phase="Running", Reason="", readiness=true. Elapsed: 16.232031895s
Jan 30 08:31:41.445: INFO: Pod "azurefile-volume-tester-68rdv": Phase="Running", Reason="", readiness=false. Elapsed: 18.232018269s
Jan 30 08:31:43.444: INFO: Pod "azurefile-volume-tester-68rdv": Phase="Succeeded", Reason="", readiness=false. Elapsed: 20.231496266s
STEP: Saw pod success 01/30/23 08:31:43.444
Jan 30 08:31:43.445: INFO: Pod "azurefile-volume-tester-68rdv" satisfied condition "Succeeded or Failed"
Jan 30 08:31:43.445: INFO: deleting Pod "azurefile-7726"/"azurefile-volume-tester-68rdv"
Jan 30 08:31:43.561: INFO: Pod azurefile-volume-tester-68rdv has the following logs: hello world

STEP: Deleting pod azurefile-volume-tester-68rdv in namespace azurefile-7726 01/30/23 08:31:43.561
Jan 30 08:31:43.688: INFO: deleting PVC "azurefile-7726"/"pvc-hlg9k"
Jan 30 08:31:43.688: INFO: Deleting PersistentVolumeClaim "pvc-hlg9k"
... skipping 122 lines ...
    Jan 30 08:31:20.774: INFO: PersistentVolumeClaim pvc-hlg9k found but phase is Pending instead of Bound.
    Jan 30 08:31:22.883: INFO: PersistentVolumeClaim pvc-hlg9k found and phase=Bound (2.217161499s)
    STEP: checking the PVC 01/30/23 08:31:22.883
    STEP: validating provisioned PV 01/30/23 08:31:22.992
    STEP: checking the PV 01/30/23 08:31:23.1
    STEP: deploying the pod 01/30/23 08:31:23.101
    STEP: checking that the pods command exits with no error 01/30/23 08:31:23.213
    Jan 30 08:31:23.213: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-68rdv" in namespace "azurefile-7726" to be "Succeeded or Failed"
    Jan 30 08:31:23.328: INFO: Pod "azurefile-volume-tester-68rdv": Phase="Pending", Reason="", readiness=false. Elapsed: 115.57569ms
    Jan 30 08:31:25.446: INFO: Pod "azurefile-volume-tester-68rdv": Phase="Pending", Reason="", readiness=false. Elapsed: 2.233419767s
    Jan 30 08:31:27.446: INFO: Pod "azurefile-volume-tester-68rdv": Phase="Pending", Reason="", readiness=false. Elapsed: 4.232865643s
    Jan 30 08:31:29.447: INFO: Pod "azurefile-volume-tester-68rdv": Phase="Pending", Reason="", readiness=false. Elapsed: 6.233935977s
    Jan 30 08:31:31.446: INFO: Pod "azurefile-volume-tester-68rdv": Phase="Pending", Reason="", readiness=false. Elapsed: 8.233246656s
    Jan 30 08:31:33.446: INFO: Pod "azurefile-volume-tester-68rdv": Phase="Pending", Reason="", readiness=false. Elapsed: 10.232787825s
    Jan 30 08:31:35.444: INFO: Pod "azurefile-volume-tester-68rdv": Phase="Running", Reason="", readiness=true. Elapsed: 12.231025673s
    Jan 30 08:31:37.445: INFO: Pod "azurefile-volume-tester-68rdv": Phase="Running", Reason="", readiness=true. Elapsed: 14.231726164s
    Jan 30 08:31:39.445: INFO: Pod "azurefile-volume-tester-68rdv": Phase="Running", Reason="", readiness=true. Elapsed: 16.232031895s
    Jan 30 08:31:41.445: INFO: Pod "azurefile-volume-tester-68rdv": Phase="Running", Reason="", readiness=false. Elapsed: 18.232018269s
    Jan 30 08:31:43.444: INFO: Pod "azurefile-volume-tester-68rdv": Phase="Succeeded", Reason="", readiness=false. Elapsed: 20.231496266s
    STEP: Saw pod success 01/30/23 08:31:43.444
    Jan 30 08:31:43.445: INFO: Pod "azurefile-volume-tester-68rdv" satisfied condition "Succeeded or Failed"
    Jan 30 08:31:43.445: INFO: deleting Pod "azurefile-7726"/"azurefile-volume-tester-68rdv"
    Jan 30 08:31:43.561: INFO: Pod azurefile-volume-tester-68rdv has the following logs: hello world

    STEP: Deleting pod azurefile-volume-tester-68rdv in namespace azurefile-7726 01/30/23 08:31:43.561
    Jan 30 08:31:43.688: INFO: deleting PVC "azurefile-7726"/"pvc-hlg9k"
    Jan 30 08:31:43.688: INFO: Deleting PersistentVolumeClaim "pvc-hlg9k"
... skipping 92 lines ...
check the driver pods if restarts ...
======================================================================================
2023/01/30 08:31:50 Check successfully
Jan 30 08:31:50.698: INFO: >>> kubeConfig: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig
2023/01/30 08:31:50 run script: test/utils/get_storage_account_secret_name.sh
2023/01/30 08:31:51 got output: azure-storage-account-f614364cca2934d1f8f84e3-secret
, error: <nil>
2023/01/30 08:31:51 got storage account secret name: azure-storage-account-f614364cca2934d1f8f84e3-secret
STEP: setting up the StorageClass 01/30/23 08:31:51.136
STEP: creating a StorageClass  01/30/23 08:31:51.137
STEP: setting up the PVC and PV 01/30/23 08:31:51.25
STEP: creating a PVC 01/30/23 08:31:51.25
STEP: waiting for PVC to be in phase "Bound" 01/30/23 08:31:51.364
Jan 30 08:31:51.364: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-knk8f] to have phase Bound
Jan 30 08:31:51.471: INFO: PersistentVolumeClaim pvc-knk8f found and phase=Bound (107.155897ms)
STEP: checking the PVC 01/30/23 08:31:51.471
STEP: validating provisioned PV 01/30/23 08:31:51.579
STEP: checking the PV 01/30/23 08:31:51.687
STEP: deploying the pod 01/30/23 08:31:51.687
STEP: checking that the pods command exits with no error 01/30/23 08:31:51.798
Jan 30 08:31:51.798: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-dhgzd" in namespace "azurefile-1387" to be "Succeeded or Failed"
Jan 30 08:31:51.905: INFO: Pod "azurefile-volume-tester-dhgzd": Phase="Pending", Reason="", readiness=false. Elapsed: 107.557196ms
Jan 30 08:31:54.015: INFO: Pod "azurefile-volume-tester-dhgzd": Phase="Pending", Reason="", readiness=false. Elapsed: 2.21724241s
Jan 30 08:31:56.023: INFO: Pod "azurefile-volume-tester-dhgzd": Phase="Pending", Reason="", readiness=false. Elapsed: 4.22487741s
Jan 30 08:31:58.022: INFO: Pod "azurefile-volume-tester-dhgzd": Phase="Pending", Reason="", readiness=false. Elapsed: 6.223844185s
Jan 30 08:32:00.021: INFO: Pod "azurefile-volume-tester-dhgzd": Phase="Running", Reason="", readiness=true. Elapsed: 8.223556886s
Jan 30 08:32:02.021: INFO: Pod "azurefile-volume-tester-dhgzd": Phase="Running", Reason="", readiness=true. Elapsed: 10.223692597s
Jan 30 08:32:04.023: INFO: Pod "azurefile-volume-tester-dhgzd": Phase="Running", Reason="", readiness=true. Elapsed: 12.225321842s
Jan 30 08:32:06.022: INFO: Pod "azurefile-volume-tester-dhgzd": Phase="Running", Reason="", readiness=false. Elapsed: 14.224328647s
Jan 30 08:32:08.023: INFO: Pod "azurefile-volume-tester-dhgzd": Phase="Succeeded", Reason="", readiness=false. Elapsed: 16.224969058s
STEP: Saw pod success 01/30/23 08:32:08.023
Jan 30 08:32:08.023: INFO: Pod "azurefile-volume-tester-dhgzd" satisfied condition "Succeeded or Failed"
Jan 30 08:32:08.023: INFO: deleting Pod "azurefile-1387"/"azurefile-volume-tester-dhgzd"
Jan 30 08:32:08.140: INFO: Pod azurefile-volume-tester-dhgzd has the following logs: hello world

STEP: Deleting pod azurefile-volume-tester-dhgzd in namespace azurefile-1387 01/30/23 08:32:08.14
Jan 30 08:32:08.268: INFO: deleting PVC "azurefile-1387"/"pvc-knk8f"
Jan 30 08:32:08.268: INFO: Deleting PersistentVolumeClaim "pvc-knk8f"
... skipping 26 lines ...
    Jan 30 08:31:51.364: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-knk8f] to have phase Bound
    Jan 30 08:31:51.471: INFO: PersistentVolumeClaim pvc-knk8f found and phase=Bound (107.155897ms)
    STEP: checking the PVC 01/30/23 08:31:51.471
    STEP: validating provisioned PV 01/30/23 08:31:51.579
    STEP: checking the PV 01/30/23 08:31:51.687
    STEP: deploying the pod 01/30/23 08:31:51.687
    STEP: checking that the pods command exits with no error 01/30/23 08:31:51.798
    Jan 30 08:31:51.798: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-dhgzd" in namespace "azurefile-1387" to be "Succeeded or Failed"
    Jan 30 08:31:51.905: INFO: Pod "azurefile-volume-tester-dhgzd": Phase="Pending", Reason="", readiness=false. Elapsed: 107.557196ms
    Jan 30 08:31:54.015: INFO: Pod "azurefile-volume-tester-dhgzd": Phase="Pending", Reason="", readiness=false. Elapsed: 2.21724241s
    Jan 30 08:31:56.023: INFO: Pod "azurefile-volume-tester-dhgzd": Phase="Pending", Reason="", readiness=false. Elapsed: 4.22487741s
    Jan 30 08:31:58.022: INFO: Pod "azurefile-volume-tester-dhgzd": Phase="Pending", Reason="", readiness=false. Elapsed: 6.223844185s
    Jan 30 08:32:00.021: INFO: Pod "azurefile-volume-tester-dhgzd": Phase="Running", Reason="", readiness=true. Elapsed: 8.223556886s
    Jan 30 08:32:02.021: INFO: Pod "azurefile-volume-tester-dhgzd": Phase="Running", Reason="", readiness=true. Elapsed: 10.223692597s
    Jan 30 08:32:04.023: INFO: Pod "azurefile-volume-tester-dhgzd": Phase="Running", Reason="", readiness=true. Elapsed: 12.225321842s
    Jan 30 08:32:06.022: INFO: Pod "azurefile-volume-tester-dhgzd": Phase="Running", Reason="", readiness=false. Elapsed: 14.224328647s
    Jan 30 08:32:08.023: INFO: Pod "azurefile-volume-tester-dhgzd": Phase="Succeeded", Reason="", readiness=false. Elapsed: 16.224969058s
    STEP: Saw pod success 01/30/23 08:32:08.023
    Jan 30 08:32:08.023: INFO: Pod "azurefile-volume-tester-dhgzd" satisfied condition "Succeeded or Failed"
    Jan 30 08:32:08.023: INFO: deleting Pod "azurefile-1387"/"azurefile-volume-tester-dhgzd"
    Jan 30 08:32:08.140: INFO: Pod azurefile-volume-tester-dhgzd has the following logs: hello world

    STEP: Deleting pod azurefile-volume-tester-dhgzd in namespace azurefile-1387 01/30/23 08:32:08.14
    Jan 30 08:32:08.268: INFO: deleting PVC "azurefile-1387"/"pvc-knk8f"
    Jan 30 08:32:08.268: INFO: Deleting PersistentVolumeClaim "pvc-knk8f"
... skipping 37 lines ...
Jan 30 08:32:29.780: INFO: PersistentVolumeClaim pvc-w2pq7 found but phase is Pending instead of Bound.
Jan 30 08:32:31.892: INFO: PersistentVolumeClaim pvc-w2pq7 found and phase=Bound (21.204095973s)
STEP: checking the PVC 01/30/23 08:32:31.892
STEP: validating provisioned PV 01/30/23 08:32:32
STEP: checking the PV 01/30/23 08:32:32.108
STEP: deploying the pod 01/30/23 08:32:32.108
STEP: checking that the pods command exits with no error 01/30/23 08:32:32.221
Jan 30 08:32:32.221: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-l4nh9" in namespace "azurefile-4547" to be "Succeeded or Failed"
Jan 30 08:32:32.330: INFO: Pod "azurefile-volume-tester-l4nh9": Phase="Pending", Reason="", readiness=false. Elapsed: 108.403424ms
Jan 30 08:32:34.441: INFO: Pod "azurefile-volume-tester-l4nh9": Phase="Pending", Reason="", readiness=false. Elapsed: 2.219225807s
Jan 30 08:32:36.439: INFO: Pod "azurefile-volume-tester-l4nh9": Phase="Pending", Reason="", readiness=false. Elapsed: 4.21810222s
Jan 30 08:32:38.447: INFO: Pod "azurefile-volume-tester-l4nh9": Phase="Pending", Reason="", readiness=false. Elapsed: 6.226130504s
Jan 30 08:32:40.446: INFO: Pod "azurefile-volume-tester-l4nh9": Phase="Pending", Reason="", readiness=false. Elapsed: 8.225061804s
Jan 30 08:32:42.447: INFO: Pod "azurefile-volume-tester-l4nh9": Phase="Running", Reason="", readiness=true. Elapsed: 10.226147698s
Jan 30 08:32:44.447: INFO: Pod "azurefile-volume-tester-l4nh9": Phase="Running", Reason="", readiness=true. Elapsed: 12.225978262s
Jan 30 08:32:46.446: INFO: Pod "azurefile-volume-tester-l4nh9": Phase="Running", Reason="", readiness=true. Elapsed: 14.22485547s
Jan 30 08:32:48.446: INFO: Pod "azurefile-volume-tester-l4nh9": Phase="Running", Reason="", readiness=false. Elapsed: 16.224252076s
Jan 30 08:32:50.446: INFO: Pod "azurefile-volume-tester-l4nh9": Phase="Succeeded", Reason="", readiness=false. Elapsed: 18.224668398s
STEP: Saw pod success 01/30/23 08:32:50.446
Jan 30 08:32:50.446: INFO: Pod "azurefile-volume-tester-l4nh9" satisfied condition "Succeeded or Failed"
Jan 30 08:32:50.446: INFO: deleting Pod "azurefile-4547"/"azurefile-volume-tester-l4nh9"
Jan 30 08:32:50.564: INFO: Pod azurefile-volume-tester-l4nh9 has the following logs: hello world

STEP: Deleting pod azurefile-volume-tester-l4nh9 in namespace azurefile-4547 01/30/23 08:32:50.564
Jan 30 08:32:50.786: INFO: deleting PVC "azurefile-4547"/"pvc-w2pq7"
Jan 30 08:32:50.786: INFO: Deleting PersistentVolumeClaim "pvc-w2pq7"
... skipping 36 lines ...
    Jan 30 08:32:29.780: INFO: PersistentVolumeClaim pvc-w2pq7 found but phase is Pending instead of Bound.
    Jan 30 08:32:31.892: INFO: PersistentVolumeClaim pvc-w2pq7 found and phase=Bound (21.204095973s)
    STEP: checking the PVC 01/30/23 08:32:31.892
    STEP: validating provisioned PV 01/30/23 08:32:32
    STEP: checking the PV 01/30/23 08:32:32.108
    STEP: deploying the pod 01/30/23 08:32:32.108
    STEP: checking that the pods command exits with no error 01/30/23 08:32:32.221
    Jan 30 08:32:32.221: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-l4nh9" in namespace "azurefile-4547" to be "Succeeded or Failed"
    Jan 30 08:32:32.330: INFO: Pod "azurefile-volume-tester-l4nh9": Phase="Pending", Reason="", readiness=false. Elapsed: 108.403424ms
    Jan 30 08:32:34.441: INFO: Pod "azurefile-volume-tester-l4nh9": Phase="Pending", Reason="", readiness=false. Elapsed: 2.219225807s
    Jan 30 08:32:36.439: INFO: Pod "azurefile-volume-tester-l4nh9": Phase="Pending", Reason="", readiness=false. Elapsed: 4.21810222s
    Jan 30 08:32:38.447: INFO: Pod "azurefile-volume-tester-l4nh9": Phase="Pending", Reason="", readiness=false. Elapsed: 6.226130504s
    Jan 30 08:32:40.446: INFO: Pod "azurefile-volume-tester-l4nh9": Phase="Pending", Reason="", readiness=false. Elapsed: 8.225061804s
    Jan 30 08:32:42.447: INFO: Pod "azurefile-volume-tester-l4nh9": Phase="Running", Reason="", readiness=true. Elapsed: 10.226147698s
    Jan 30 08:32:44.447: INFO: Pod "azurefile-volume-tester-l4nh9": Phase="Running", Reason="", readiness=true. Elapsed: 12.225978262s
    Jan 30 08:32:46.446: INFO: Pod "azurefile-volume-tester-l4nh9": Phase="Running", Reason="", readiness=true. Elapsed: 14.22485547s
    Jan 30 08:32:48.446: INFO: Pod "azurefile-volume-tester-l4nh9": Phase="Running", Reason="", readiness=false. Elapsed: 16.224252076s
    Jan 30 08:32:50.446: INFO: Pod "azurefile-volume-tester-l4nh9": Phase="Succeeded", Reason="", readiness=false. Elapsed: 18.224668398s
    STEP: Saw pod success 01/30/23 08:32:50.446
    Jan 30 08:32:50.446: INFO: Pod "azurefile-volume-tester-l4nh9" satisfied condition "Succeeded or Failed"
    Jan 30 08:32:50.446: INFO: deleting Pod "azurefile-4547"/"azurefile-volume-tester-l4nh9"
    Jan 30 08:32:50.564: INFO: Pod azurefile-volume-tester-l4nh9 has the following logs: hello world

    STEP: Deleting pod azurefile-volume-tester-l4nh9 in namespace azurefile-4547 01/30/23 08:32:50.564
    Jan 30 08:32:50.786: INFO: deleting PVC "azurefile-4547"/"pvc-w2pq7"
    Jan 30 08:32:50.786: INFO: Deleting PersistentVolumeClaim "pvc-w2pq7"
... skipping 37 lines ...
Jan 30 08:33:12.295: INFO: PersistentVolumeClaim pvc-2ckr6 found but phase is Pending instead of Bound.
Jan 30 08:33:14.406: INFO: PersistentVolumeClaim pvc-2ckr6 found and phase=Bound (21.199997067s)
STEP: checking the PVC 01/30/23 08:33:14.406
STEP: validating provisioned PV 01/30/23 08:33:14.514
STEP: checking the PV 01/30/23 08:33:14.622
STEP: deploying the pod 01/30/23 08:33:14.622
STEP: checking that the pods command exits with no error 01/30/23 08:33:14.733
Jan 30 08:33:14.734: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-pdq7k" in namespace "azurefile-7051" to be "Succeeded or Failed"
Jan 30 08:33:14.841: INFO: Pod "azurefile-volume-tester-pdq7k": Phase="Pending", Reason="", readiness=false. Elapsed: 107.439977ms
Jan 30 08:33:16.950: INFO: Pod "azurefile-volume-tester-pdq7k": Phase="Pending", Reason="", readiness=false. Elapsed: 2.216045115s
Jan 30 08:33:18.957: INFO: Pod "azurefile-volume-tester-pdq7k": Phase="Pending", Reason="", readiness=false. Elapsed: 4.223648306s
Jan 30 08:33:20.958: INFO: Pod "azurefile-volume-tester-pdq7k": Phase="Pending", Reason="", readiness=false. Elapsed: 6.224561801s
Jan 30 08:33:22.958: INFO: Pod "azurefile-volume-tester-pdq7k": Phase="Running", Reason="", readiness=true. Elapsed: 8.224350856s
Jan 30 08:33:24.958: INFO: Pod "azurefile-volume-tester-pdq7k": Phase="Running", Reason="", readiness=true. Elapsed: 10.224811621s
Jan 30 08:33:26.958: INFO: Pod "azurefile-volume-tester-pdq7k": Phase="Running", Reason="", readiness=true. Elapsed: 12.22434533s
Jan 30 08:33:28.957: INFO: Pod "azurefile-volume-tester-pdq7k": Phase="Running", Reason="", readiness=false. Elapsed: 14.223067923s
Jan 30 08:33:30.958: INFO: Pod "azurefile-volume-tester-pdq7k": Phase="Succeeded", Reason="", readiness=false. Elapsed: 16.224338776s
STEP: Saw pod success 01/30/23 08:33:30.958
Jan 30 08:33:30.958: INFO: Pod "azurefile-volume-tester-pdq7k" satisfied condition "Succeeded or Failed"
Jan 30 08:33:30.958: INFO: deleting Pod "azurefile-7051"/"azurefile-volume-tester-pdq7k"
Jan 30 08:33:31.075: INFO: Pod azurefile-volume-tester-pdq7k has the following logs: hello world

STEP: Deleting pod azurefile-volume-tester-pdq7k in namespace azurefile-7051 01/30/23 08:33:31.075
Jan 30 08:33:31.297: INFO: deleting PVC "azurefile-7051"/"pvc-2ckr6"
Jan 30 08:33:31.297: INFO: Deleting PersistentVolumeClaim "pvc-2ckr6"
... skipping 36 lines ...
    Jan 30 08:33:12.295: INFO: PersistentVolumeClaim pvc-2ckr6 found but phase is Pending instead of Bound.
    Jan 30 08:33:14.406: INFO: PersistentVolumeClaim pvc-2ckr6 found and phase=Bound (21.199997067s)
    STEP: checking the PVC 01/30/23 08:33:14.406
    STEP: validating provisioned PV 01/30/23 08:33:14.514
    STEP: checking the PV 01/30/23 08:33:14.622
    STEP: deploying the pod 01/30/23 08:33:14.622
    STEP: checking that the pods command exits with no error 01/30/23 08:33:14.733
    Jan 30 08:33:14.734: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-pdq7k" in namespace "azurefile-7051" to be "Succeeded or Failed"
    Jan 30 08:33:14.841: INFO: Pod "azurefile-volume-tester-pdq7k": Phase="Pending", Reason="", readiness=false. Elapsed: 107.439977ms
    Jan 30 08:33:16.950: INFO: Pod "azurefile-volume-tester-pdq7k": Phase="Pending", Reason="", readiness=false. Elapsed: 2.216045115s
    Jan 30 08:33:18.957: INFO: Pod "azurefile-volume-tester-pdq7k": Phase="Pending", Reason="", readiness=false. Elapsed: 4.223648306s
    Jan 30 08:33:20.958: INFO: Pod "azurefile-volume-tester-pdq7k": Phase="Pending", Reason="", readiness=false. Elapsed: 6.224561801s
    Jan 30 08:33:22.958: INFO: Pod "azurefile-volume-tester-pdq7k": Phase="Running", Reason="", readiness=true. Elapsed: 8.224350856s
    Jan 30 08:33:24.958: INFO: Pod "azurefile-volume-tester-pdq7k": Phase="Running", Reason="", readiness=true. Elapsed: 10.224811621s
    Jan 30 08:33:26.958: INFO: Pod "azurefile-volume-tester-pdq7k": Phase="Running", Reason="", readiness=true. Elapsed: 12.22434533s
    Jan 30 08:33:28.957: INFO: Pod "azurefile-volume-tester-pdq7k": Phase="Running", Reason="", readiness=false. Elapsed: 14.223067923s
    Jan 30 08:33:30.958: INFO: Pod "azurefile-volume-tester-pdq7k": Phase="Succeeded", Reason="", readiness=false. Elapsed: 16.224338776s
    STEP: Saw pod success 01/30/23 08:33:30.958
    Jan 30 08:33:30.958: INFO: Pod "azurefile-volume-tester-pdq7k" satisfied condition "Succeeded or Failed"
    Jan 30 08:33:30.958: INFO: deleting Pod "azurefile-7051"/"azurefile-volume-tester-pdq7k"
    Jan 30 08:33:31.075: INFO: Pod azurefile-volume-tester-pdq7k has the following logs: hello world

    STEP: Deleting pod azurefile-volume-tester-pdq7k in namespace azurefile-7051 01/30/23 08:33:31.075
    Jan 30 08:33:31.297: INFO: deleting PVC "azurefile-7051"/"pvc-2ckr6"
    Jan 30 08:33:31.297: INFO: Deleting PersistentVolumeClaim "pvc-2ckr6"
... skipping 31 lines ...
I0130 08:33:41.827206   41777 testsuites.go:627] 0/1 replicas in the StatefulSet are ready
I0130 08:33:43.825797   41777 testsuites.go:627] 1/1 replicas in the StatefulSet are ready
STEP: checking that the pod is running 01/30/23 08:33:43.941
STEP: check pod exec 01/30/23 08:33:44.057
Jan 30 08:33:44.057: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=azurefile-9183 exec azurefile-volume-tester-n8m2l-0 -- cmd /c type C:\mnt\test-1\data.txt'
Jan 30 08:33:45.275: INFO: rc: 1
Jan 30 08:33:45.275: INFO: Error waiting for output "hello world\r\n" in pod "azurefile-volume-tester-n8m2l-0": error running /usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=azurefile-9183 exec azurefile-volume-tester-n8m2l-0 -- cmd /c type C:\mnt\test-1\data.txt:
Command stdout:

stderr:
The system cannot find the file specified.
command terminated with exit code 1

error:
exit status 1.
Jan 30 08:33:47.276: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=azurefile-9183 exec azurefile-volume-tester-n8m2l-0 -- cmd /c type C:\mnt\test-1\data.txt'
Jan 30 08:33:48.470: INFO: stderr: ""
Jan 30 08:33:48.470: INFO: stdout: "hello world\r\n"
STEP: deleting the pod for statefulset 01/30/23 08:33:48.47
Jan 30 08:33:48.471: INFO: Deleting pod "azurefile-volume-tester-n8m2l-0" in namespace "azurefile-9183"
... skipping 124 lines ...
Jan 30 08:35:51.045: INFO: stdout: "hello world\r\n"
Jan 30 08:35:51.045: INFO: The stdout did not contain output "hello world\r\nhello world\r\n" in pod "azurefile-volume-tester-n8m2l-0", found: "hello world\r\n".
Jan 30 08:35:51.045: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=azurefile-9183 exec azurefile-volume-tester-n8m2l-0 -- cmd /c type C:\mnt\test-1\data.txt'
Jan 30 08:35:52.185: INFO: stderr: ""
Jan 30 08:35:52.185: INFO: stdout: "hello world\r\n"
Jan 30 08:35:52.185: INFO: The stdout did not contain output "hello world\r\nhello world\r\n" in pod "azurefile-volume-tester-n8m2l-0", found: "hello world\r\n".
Jan 30 08:35:52.185: INFO: Unexpected error: Failed to find "hello world\r\nhello world\r\n" in at least one pod's output.: 
    <errors.aggregate | len:1, cap:1>: [
        <*errors.errorString | 0xc000375730>{
            s: "timed out waiting for the condition",
        },
    ]
Jan 30 08:35:52.185: FAIL: Failed to find "hello world\r\nhello world\r\n" in at least one pod's output.: timed out waiting for the condition

Full Stack Trace
sigs.k8s.io/azurefile-csi-driver/test/e2e/testsuites.pollForStringInPodsExec({0xc000bb3780, 0xe}, {0xc000a6dde0, 0x1, 0x7f569c42aa00?}, {0xc000893590, 0x3, 0x3}, {0xc000a48480, 0x1a})
	/home/prow/go/src/sigs.k8s.io/azurefile-csi-driver/test/e2e/testsuites/testsuites.go:1011 +0x25e
sigs.k8s.io/azurefile-csi-driver/test/e2e/testsuites.(*TestStatefulset).PollForStringInPodsExec(...)
	/home/prow/go/src/sigs.k8s.io/azurefile-csi-driver/test/e2e/testsuites/testsuites.go:589
... skipping 4 lines ...
Jan 30 08:35:52.185: INFO: deleting StatefulSet "azurefile-9183"/"azurefile-volume-tester-n8m2l"
Jan 30 08:35:52.312: INFO: Pod azurefile-volume-tester-n8m2l-0 has the following logs: 
Jan 30 08:35:52.423: INFO: deleting StorageClass azurefile-9183-file.csi.azure.com-dynamic-sc-dwpv5
STEP: dump namespace information after failure 01/30/23 08:35:52.534
STEP: Destroying namespace "azurefile-9183" for this suite. 01/30/23 08:35:52.534
------------------------------
• [FAILED] [140.688 seconds]
Dynamic Provisioning
/home/prow/go/src/sigs.k8s.io/azurefile-csi-driver/test/e2e/dynamic_provisioning_test.go:43
  [It] should create a statefulset object, write and read to it, delete the pod and write and read to it again [file.csi.azure.com]
  /home/prow/go/src/sigs.k8s.io/azurefile-csi-driver/test/e2e/dynamic_provisioning_test.go:832

  Begin Captured GinkgoWriter Output >>
... skipping 15 lines ...
    I0130 08:33:41.827206   41777 testsuites.go:627] 0/1 replicas in the StatefulSet are ready
    I0130 08:33:43.825797   41777 testsuites.go:627] 1/1 replicas in the StatefulSet are ready
    STEP: checking that the pod is running 01/30/23 08:33:43.941
    STEP: check pod exec 01/30/23 08:33:44.057
    Jan 30 08:33:44.057: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=azurefile-9183 exec azurefile-volume-tester-n8m2l-0 -- cmd /c type C:\mnt\test-1\data.txt'
    Jan 30 08:33:45.275: INFO: rc: 1
    Jan 30 08:33:45.275: INFO: Error waiting for output "hello world\r\n" in pod "azurefile-volume-tester-n8m2l-0": error running /usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=azurefile-9183 exec azurefile-volume-tester-n8m2l-0 -- cmd /c type C:\mnt\test-1\data.txt:
    Command stdout:

    stderr:
    The system cannot find the file specified.
    command terminated with exit code 1

    error:
    exit status 1.
    Jan 30 08:33:47.276: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=azurefile-9183 exec azurefile-volume-tester-n8m2l-0 -- cmd /c type C:\mnt\test-1\data.txt'
    Jan 30 08:33:48.470: INFO: stderr: ""
    Jan 30 08:33:48.470: INFO: stdout: "hello world\r\n"
    STEP: deleting the pod for statefulset 01/30/23 08:33:48.47
    Jan 30 08:33:48.471: INFO: Deleting pod "azurefile-volume-tester-n8m2l-0" in namespace "azurefile-9183"
... skipping 124 lines ...
    Jan 30 08:35:51.045: INFO: stdout: "hello world\r\n"
    Jan 30 08:35:51.045: INFO: The stdout did not contain output "hello world\r\nhello world\r\n" in pod "azurefile-volume-tester-n8m2l-0", found: "hello world\r\n".
    Jan 30 08:35:51.045: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=azurefile-9183 exec azurefile-volume-tester-n8m2l-0 -- cmd /c type C:\mnt\test-1\data.txt'
    Jan 30 08:35:52.185: INFO: stderr: ""
    Jan 30 08:35:52.185: INFO: stdout: "hello world\r\n"
    Jan 30 08:35:52.185: INFO: The stdout did not contain output "hello world\r\nhello world\r\n" in pod "azurefile-volume-tester-n8m2l-0", found: "hello world\r\n".
    Jan 30 08:35:52.185: INFO: Unexpected error: Failed to find "hello world\r\nhello world\r\n" in at least one pod's output.: 
        <errors.aggregate | len:1, cap:1>: [
            <*errors.errorString | 0xc000375730>{
                s: "timed out waiting for the condition",
            },
        ]
    Jan 30 08:35:52.185: FAIL: Failed to find "hello world\r\nhello world\r\n" in at least one pod's output.: timed out waiting for the condition

    Full Stack Trace
    sigs.k8s.io/azurefile-csi-driver/test/e2e/testsuites.pollForStringInPodsExec({0xc000bb3780, 0xe}, {0xc000a6dde0, 0x1, 0x7f569c42aa00?}, {0xc000893590, 0x3, 0x3}, {0xc000a48480, 0x1a})
    	/home/prow/go/src/sigs.k8s.io/azurefile-csi-driver/test/e2e/testsuites/testsuites.go:1011 +0x25e
    sigs.k8s.io/azurefile-csi-driver/test/e2e/testsuites.(*TestStatefulset).PollForStringInPodsExec(...)
    	/home/prow/go/src/sigs.k8s.io/azurefile-csi-driver/test/e2e/testsuites/testsuites.go:589
... skipping 5 lines ...
    Jan 30 08:35:52.312: INFO: Pod azurefile-volume-tester-n8m2l-0 has the following logs: 
    Jan 30 08:35:52.423: INFO: deleting StorageClass azurefile-9183-file.csi.azure.com-dynamic-sc-dwpv5
    STEP: dump namespace information after failure 01/30/23 08:35:52.534
    STEP: Destroying namespace "azurefile-9183" for this suite. 01/30/23 08:35:52.534
  << End Captured GinkgoWriter Output

  Jan 30 08:35:52.185: Failed to find "hello world\r\nhello world\r\n" in at least one pod's output.: timed out waiting for the condition
  In [It] at: /home/prow/go/src/sigs.k8s.io/azurefile-csi-driver/test/e2e/testsuites/testsuites.go:1011

  There were additional failures detected after the initial failure:
    [PANICKED]
    Test Panicked
    In [DeferCleanup (Each)] at: /usr/local/go/src/runtime/panic.go:260

    runtime error: invalid memory address or nil pointer dereference

    Full Stack Trace
      k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo.func1()
      	/home/prow/go/src/sigs.k8s.io/azurefile-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:274 +0x5c
      k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo(0xc00010e1e0)
      	/home/prow/go/src/sigs.k8s.io/azurefile-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:271 +0x179
... skipping 33 lines ...
Jan 30 08:36:01.033: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 30, 8, 35, 56, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 30, 8, 35, 56, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 30, 8, 35, 56, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 30, 8, 35, 56, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azurefile-volume-tester-nqghh-7fc89bf56b\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 30 08:36:03.030: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 30, 8, 35, 56, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 30, 8, 35, 56, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 30, 8, 35, 56, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 30, 8, 35, 56, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azurefile-volume-tester-nqghh-7fc89bf56b\" is progressing."}}, CollisionCount:(*int32)(nil)}
STEP: checking that the pod is running 01/30/23 08:36:05.256
STEP: check pod exec 01/30/23 08:36:06.48
Jan 30 08:36:06.481: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=azurefile-8154 exec azurefile-volume-tester-nqghh-7fc89bf56b-25bdr -- cmd /c type C:\mnt\test-1\data.txt'
Jan 30 08:36:07.663: INFO: rc: 1
Jan 30 08:36:07.663: INFO: Error waiting for output "hello world\r\n" in pod "azurefile-volume-tester-nqghh-7fc89bf56b-25bdr": error running /usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=azurefile-8154 exec azurefile-volume-tester-nqghh-7fc89bf56b-25bdr -- cmd /c type C:\mnt\test-1\data.txt:
Command stdout:

stderr:
The system cannot find the file specified.
command terminated with exit code 1

error:
exit status 1.
Jan 30 08:36:09.663: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=azurefile-8154 exec azurefile-volume-tester-nqghh-7fc89bf56b-25bdr -- cmd /c type C:\mnt\test-1\data.txt'
Jan 30 08:36:10.854: INFO: stderr: ""
Jan 30 08:36:10.854: INFO: stdout: "hello world\r\n"
STEP: delete volume capz-e7g6lu#f1702085db7074cc1afb52f#pvc-15853679-f2d3-4592-8e22-10bb31b16335###azurefile-8154 first, make sure pod could still be terminated 01/30/23 08:36:10.854
STEP: check whether capz-e7g6lu#f1702085db7074cc1afb52f#pvc-15853679-f2d3-4592-8e22-10bb31b16335###azurefile-8154 exists 01/30/23 08:36:11.943
STEP: ValidateVolumeCapabilities capz-e7g6lu#f1702085db7074cc1afb52f#pvc-15853679-f2d3-4592-8e22-10bb31b16335###azurefile-8154 returned with error: rpc error: code = NotFound desc = the requested volume(capz-e7g6lu#f1702085db7074cc1afb52f#pvc-15853679-f2d3-4592-8e22-10bb31b16335###azurefile-8154) does not exist. 01/30/23 08:36:12.704
STEP: deleting the pod for deployment 01/30/23 08:36:12.704
Jan 30 08:36:12.704: INFO: Deleting pod "azurefile-volume-tester-nqghh-7fc89bf56b-25bdr" in namespace "azurefile-8154"
Jan 30 08:36:12.825: INFO: Waiting for pod "azurefile-volume-tester-nqghh-7fc89bf56b-25bdr" in namespace "azurefile-8154" to be fully deleted
Jan 30 08:36:15.049: INFO: deleting Deployment "azurefile-8154"/"azurefile-volume-tester-nqghh"
Jan 30 08:36:15.156: INFO: Error getting logs for pod azurefile-volume-tester-nqghh-7fc89bf56b-25bdr: the server could not find the requested resource (get pods azurefile-volume-tester-nqghh-7fc89bf56b-25bdr)
Jan 30 08:36:15.267: INFO: deleting PVC "azurefile-8154"/"pvc-v6mbs"
Jan 30 08:36:15.267: INFO: Deleting PersistentVolumeClaim "pvc-v6mbs"
STEP: waiting for claim's PV "pvc-15853679-f2d3-4592-8e22-10bb31b16335" to be deleted 01/30/23 08:36:15.601
Jan 30 08:36:15.601: INFO: Waiting up to 10m0s for PersistentVolume pvc-15853679-f2d3-4592-8e22-10bb31b16335 to get deleted
Jan 30 08:36:15.708: INFO: PersistentVolume pvc-15853679-f2d3-4592-8e22-10bb31b16335 found and phase=Bound (107.244136ms)
Jan 30 08:36:20.817: INFO: PersistentVolume pvc-15853679-f2d3-4592-8e22-10bb31b16335 found and phase=Bound (5.216317624s)
... skipping 34 lines ...
    Jan 30 08:36:01.033: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 30, 8, 35, 56, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 30, 8, 35, 56, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 30, 8, 35, 56, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 30, 8, 35, 56, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azurefile-volume-tester-nqghh-7fc89bf56b\" is progressing."}}, CollisionCount:(*int32)(nil)}
    Jan 30 08:36:03.030: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 30, 8, 35, 56, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 30, 8, 35, 56, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 30, 8, 35, 56, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 30, 8, 35, 56, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azurefile-volume-tester-nqghh-7fc89bf56b\" is progressing."}}, CollisionCount:(*int32)(nil)}
    STEP: checking that the pod is running 01/30/23 08:36:05.256
    STEP: check pod exec 01/30/23 08:36:06.48
    Jan 30 08:36:06.481: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=azurefile-8154 exec azurefile-volume-tester-nqghh-7fc89bf56b-25bdr -- cmd /c type C:\mnt\test-1\data.txt'
    Jan 30 08:36:07.663: INFO: rc: 1
    Jan 30 08:36:07.663: INFO: Error waiting for output "hello world\r\n" in pod "azurefile-volume-tester-nqghh-7fc89bf56b-25bdr": error running /usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=azurefile-8154 exec azurefile-volume-tester-nqghh-7fc89bf56b-25bdr -- cmd /c type C:\mnt\test-1\data.txt:
    Command stdout:

    stderr:
    The system cannot find the file specified.
    command terminated with exit code 1

    error:
    exit status 1.
    Jan 30 08:36:09.663: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=azurefile-8154 exec azurefile-volume-tester-nqghh-7fc89bf56b-25bdr -- cmd /c type C:\mnt\test-1\data.txt'
    Jan 30 08:36:10.854: INFO: stderr: ""
    Jan 30 08:36:10.854: INFO: stdout: "hello world\r\n"
    STEP: delete volume capz-e7g6lu#f1702085db7074cc1afb52f#pvc-15853679-f2d3-4592-8e22-10bb31b16335###azurefile-8154 first, make sure pod could still be terminated 01/30/23 08:36:10.854
    STEP: check whether capz-e7g6lu#f1702085db7074cc1afb52f#pvc-15853679-f2d3-4592-8e22-10bb31b16335###azurefile-8154 exists 01/30/23 08:36:11.943
    STEP: ValidateVolumeCapabilities capz-e7g6lu#f1702085db7074cc1afb52f#pvc-15853679-f2d3-4592-8e22-10bb31b16335###azurefile-8154 returned with error: rpc error: code = NotFound desc = the requested volume(capz-e7g6lu#f1702085db7074cc1afb52f#pvc-15853679-f2d3-4592-8e22-10bb31b16335###azurefile-8154) does not exist. 01/30/23 08:36:12.704
    STEP: deleting the pod for deployment 01/30/23 08:36:12.704
    Jan 30 08:36:12.704: INFO: Deleting pod "azurefile-volume-tester-nqghh-7fc89bf56b-25bdr" in namespace "azurefile-8154"
    Jan 30 08:36:12.825: INFO: Waiting for pod "azurefile-volume-tester-nqghh-7fc89bf56b-25bdr" in namespace "azurefile-8154" to be fully deleted
    Jan 30 08:36:15.049: INFO: deleting Deployment "azurefile-8154"/"azurefile-volume-tester-nqghh"
    Jan 30 08:36:15.156: INFO: Error getting logs for pod azurefile-volume-tester-nqghh-7fc89bf56b-25bdr: the server could not find the requested resource (get pods azurefile-volume-tester-nqghh-7fc89bf56b-25bdr)
    Jan 30 08:36:15.267: INFO: deleting PVC "azurefile-8154"/"pvc-v6mbs"
    Jan 30 08:36:15.267: INFO: Deleting PersistentVolumeClaim "pvc-v6mbs"
    STEP: waiting for claim's PV "pvc-15853679-f2d3-4592-8e22-10bb31b16335" to be deleted 01/30/23 08:36:15.601
    Jan 30 08:36:15.601: INFO: Waiting up to 10m0s for PersistentVolume pvc-15853679-f2d3-4592-8e22-10bb31b16335 to get deleted
    Jan 30 08:36:15.708: INFO: PersistentVolume pvc-15853679-f2d3-4592-8e22-10bb31b16335 found and phase=Bound (107.244136ms)
    Jan 30 08:36:20.817: INFO: PersistentVolume pvc-15853679-f2d3-4592-8e22-10bb31b16335 found and phase=Bound (5.216317624s)
... skipping 50 lines ...
check the driver pods if restarts ...
======================================================================================
2023/01/30 08:36:29 Check successfully
Jan 30 08:36:29.218: INFO: >>> kubeConfig: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig
2023/01/30 08:36:29 run script: test/utils/get_storage_account_secret_name.sh
2023/01/30 08:36:29 got output: azure-storage-account-f614364cca2934d1f8f84e3-secret
, error: <nil>
2023/01/30 08:36:29 got storage account secret name: azure-storage-account-f614364cca2934d1f8f84e3-secret
STEP: Successfully provisioned AzureFile volume: "capz-e7g6lu#f614364cca2934d1f8f84e3#csi-inline-smb-volume##csi-inline-smb-volume#azurefile-9371"
 01/30/23 08:36:31.652
STEP: deploying the pod 01/30/23 08:36:31.652
STEP: checking that the pods command exits with no error 01/30/23 08:36:31.764
Jan 30 08:36:31.764: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-rhkml" in namespace "azurefile-9371" to be "Succeeded or Failed"
Jan 30 08:36:31.872: INFO: Pod "azurefile-volume-tester-rhkml": Phase="Pending", Reason="", readiness=false. Elapsed: 107.875344ms
Jan 30 08:36:33.981: INFO: Pod "azurefile-volume-tester-rhkml": Phase="Pending", Reason="", readiness=false. Elapsed: 2.217204571s
Jan 30 08:36:35.988: INFO: Pod "azurefile-volume-tester-rhkml": Phase="Pending", Reason="", readiness=false. Elapsed: 4.224344577s
Jan 30 08:36:37.988: INFO: Pod "azurefile-volume-tester-rhkml": Phase="Pending", Reason="", readiness=false. Elapsed: 6.223679903s
Jan 30 08:36:39.988: INFO: Pod "azurefile-volume-tester-rhkml": Phase="Running", Reason="", readiness=true. Elapsed: 8.223808521s
Jan 30 08:36:41.989: INFO: Pod "azurefile-volume-tester-rhkml": Phase="Running", Reason="", readiness=true. Elapsed: 10.225303383s
Jan 30 08:36:43.989: INFO: Pod "azurefile-volume-tester-rhkml": Phase="Running", Reason="", readiness=true. Elapsed: 12.224437321s
Jan 30 08:36:45.987: INFO: Pod "azurefile-volume-tester-rhkml": Phase="Running", Reason="", readiness=false. Elapsed: 14.223354868s
Jan 30 08:36:47.988: INFO: Pod "azurefile-volume-tester-rhkml": Phase="Succeeded", Reason="", readiness=false. Elapsed: 16.223702113s
STEP: Saw pod success 01/30/23 08:36:47.988
Jan 30 08:36:47.988: INFO: Pod "azurefile-volume-tester-rhkml" satisfied condition "Succeeded or Failed"
Jan 30 08:36:47.988: INFO: deleting Pod "azurefile-9371"/"azurefile-volume-tester-rhkml"
Jan 30 08:36:48.107: INFO: Pod azurefile-volume-tester-rhkml has the following logs: hello world

STEP: Deleting pod azurefile-volume-tester-rhkml in namespace azurefile-9371 01/30/23 08:36:48.107
STEP: Destroying namespace "azurefile-9371" for this suite. 01/30/23 08:36:48.232
------------------------------
... skipping 10 lines ...
    STEP: Waiting for a default service account to be provisioned in namespace 01/30/23 08:36:28.121
    STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 01/30/23 08:36:28.336
    Jan 30 08:36:29.218: INFO: >>> kubeConfig: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig
    STEP: Successfully provisioned AzureFile volume: "capz-e7g6lu#f614364cca2934d1f8f84e3#csi-inline-smb-volume##csi-inline-smb-volume#azurefile-9371"
     01/30/23 08:36:31.652
    STEP: deploying the pod 01/30/23 08:36:31.652
    STEP: checking that the pods command exits with no error 01/30/23 08:36:31.764
    Jan 30 08:36:31.764: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-rhkml" in namespace "azurefile-9371" to be "Succeeded or Failed"
    Jan 30 08:36:31.872: INFO: Pod "azurefile-volume-tester-rhkml": Phase="Pending", Reason="", readiness=false. Elapsed: 107.875344ms
    Jan 30 08:36:33.981: INFO: Pod "azurefile-volume-tester-rhkml": Phase="Pending", Reason="", readiness=false. Elapsed: 2.217204571s
    Jan 30 08:36:35.988: INFO: Pod "azurefile-volume-tester-rhkml": Phase="Pending", Reason="", readiness=false. Elapsed: 4.224344577s
    Jan 30 08:36:37.988: INFO: Pod "azurefile-volume-tester-rhkml": Phase="Pending", Reason="", readiness=false. Elapsed: 6.223679903s
    Jan 30 08:36:39.988: INFO: Pod "azurefile-volume-tester-rhkml": Phase="Running", Reason="", readiness=true. Elapsed: 8.223808521s
    Jan 30 08:36:41.989: INFO: Pod "azurefile-volume-tester-rhkml": Phase="Running", Reason="", readiness=true. Elapsed: 10.225303383s
    Jan 30 08:36:43.989: INFO: Pod "azurefile-volume-tester-rhkml": Phase="Running", Reason="", readiness=true. Elapsed: 12.224437321s
    Jan 30 08:36:45.987: INFO: Pod "azurefile-volume-tester-rhkml": Phase="Running", Reason="", readiness=false. Elapsed: 14.223354868s
    Jan 30 08:36:47.988: INFO: Pod "azurefile-volume-tester-rhkml": Phase="Succeeded", Reason="", readiness=false. Elapsed: 16.223702113s
    STEP: Saw pod success 01/30/23 08:36:47.988
    Jan 30 08:36:47.988: INFO: Pod "azurefile-volume-tester-rhkml" satisfied condition "Succeeded or Failed"
    Jan 30 08:36:47.988: INFO: deleting Pod "azurefile-9371"/"azurefile-volume-tester-rhkml"
    Jan 30 08:36:48.107: INFO: Pod azurefile-volume-tester-rhkml has the following logs: hello world

    STEP: Deleting pod azurefile-volume-tester-rhkml in namespace azurefile-9371 01/30/23 08:36:48.107
    STEP: Destroying namespace "azurefile-9371" for this suite. 01/30/23 08:36:48.232
  << End Captured GinkgoWriter Output
... skipping 231 lines ...

Streaming logs below:
I0130 08:19:35.907852       1 azurefile.go:299] driver userAgent: file.csi.azure.com/e2e-96a2ca02f36f8e1cb5b590f772c52ba00ac89296 e2e-test
I0130 08:19:35.907956       1 azure.go:65] set QPS(25.000000) and QPS Burst(50) for driver kubeClient
I0130 08:19:35.908278       1 azure.go:80] reading cloud config from secret kube-system/azure-cloud-provider
I0130 08:19:35.964924       1 round_trippers.go:553] GET https://10.96.0.1:443/api/v1/namespaces/kube-system/secrets/azure-cloud-provider 404 Not Found in 56 milliseconds
I0130 08:19:35.965216       1 azure.go:87] InitializeCloudFromSecret: failed to get cloud config from secret kube-system/azure-cloud-provider: failed to get secret kube-system/azure-cloud-provider: secrets "azure-cloud-provider" not found
I0130 08:19:35.965226       1 azure.go:92] could not read cloud config from secret kube-system/azure-cloud-provider
I0130 08:19:35.965232       1 azure.go:102] use default AZURE_CREDENTIAL_FILE env var: /etc/kubernetes/azure.json
I0130 08:19:35.965280       1 azure.go:110] read cloud config from file: /etc/kubernetes/azure.json successfully
I0130 08:19:35.966213       1 azure_auth.go:253] Using AzurePublicCloud environment
I0130 08:19:35.966253       1 azure_auth.go:138] azure: using client_id+client_secret to retrieve access token
I0130 08:19:35.966321       1 azure_diskclient.go:68] Azure DisksClient using API version: 2022-03-02
I0130 08:19:35.966374       1 azure_blobclient.go:67] Azure BlobClient using API version: 2021-09-01
I0130 08:19:35.966456       1 azure.go:1010] attach/detach disk operation rate limit QPS: 6.000000, Bucket: 10
I0130 08:19:35.966470       1 azure.go:140] disable UseInstanceMetadata for controller server
I0130 08:19:35.966475       1 azure.go:143] starting controller server...
I0130 08:19:35.966490       1 azurefile.go:304] cloud: AzurePublicCloud, location: westeurope, rg: capz-e7g6lu, VnetName: capz-e7g6lu-vnet, VnetResourceGroup: capz-e7g6lu, SubnetName: node-subnet
I0130 08:19:35.970139       1 mount_linux.go:287] 'umount /tmp/kubelet-detect-safe-umount1860059089' failed with: exit status 32, output: umount: /tmp/kubelet-detect-safe-umount1860059089: must be superuser to unmount.
I0130 08:19:35.970162       1 mount_linux.go:289] Detected umount with unsafe 'not mounted' behavior
I0130 08:19:35.970219       1 driver.go:93] Enabling controller service capability: CREATE_DELETE_VOLUME
I0130 08:19:35.970225       1 driver.go:93] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME
I0130 08:19:35.970229       1 driver.go:93] Enabling controller service capability: CREATE_DELETE_SNAPSHOT
I0130 08:19:35.970233       1 driver.go:93] Enabling controller service capability: EXPAND_VOLUME
I0130 08:19:35.970236       1 driver.go:93] Enabling controller service capability: SINGLE_NODE_MULTI_WRITER
... skipping 447 lines ...
Pragma: no-cache
Content-Type: application/json; charset=utf-8
X-Ms-Request-Id: 7658578c-01ba-4474-8fb6-1a1d50fbd5cb
X-Ms-Routing-Request-Id: WESTEUROPE:20230130T082036Z:7658578c-01ba-4474-8fb6-1a1d50fbd5cb
Strict-Transport-Security: max-age=31536000; includeSubDomains
I0130 08:20:36.587907       1 util.go:124] Send.sendRequest got response with ContentLength 250, StatusCode 404 and responseBody length 250
I0130 08:20:36.587976       1 azure_privatednsclient.go:215] Received error in privatednszone.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/capz-e7g6lu/providers/Microsoft.Network/privateDnsZones/privatelink.file.core.windows.net, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Network/privateDnsZones/privatelink.file.core.windows.net' under resource group 'capz-e7g6lu' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I0130 08:20:36.588146       1 azure_metrics.go:115] "Observed Request Latency" latency_seconds=0.019923872 request="private_dns_zones_get" resource_group="capz-e7g6lu" subscription_id="0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e" source="" error_code="ResourceNotFound"
I0130 08:20:36.588166       1 azure_storageaccount.go:239] get private dns zone privatelink.file.core.windows.net returned with Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Network/privateDnsZones/privatelink.file.core.windows.net' under resource group 'capz-e7g6lu' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I0130 08:20:36.588186       1 azure_storageaccount.go:464] Creating private dns zone(privatelink.file.core.windows.net) in resourceGroup (capz-e7g6lu)
(2023-01-30T08:20:36.5883000Z) INFO: REQUEST: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/capz-e7g6lu/providers/Microsoft.Network/privateDnsZones/privatelink.file.core.windows.net?api-version=2018-09-01
User-Agent: Go/go1.19.5 (amd64-linux) go-autorest/v14.2.1 file.csi.azure.com/e2e-96a2ca02f36f8e1cb5b590f772c52ba00ac89296 e2e-test
Authorization: **REDACTED**
Content-Type: application/json; charset=utf-8
(2023-01-30T08:20:36.5883519Z) INFO: REQUEST: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/capz-e7g6lu/providers/Microsoft.Network/privateDnsZones/privatelink.file.core.windows.net?api-version=2018-09-01
... skipping 140 lines ...
X-Ms-Failure-Cause: gateway
X-Content-Type-Options: nosniff
Date: Mon, 30 Jan 2023 08:21:07 GMT
Content-Length: 296
Cache-Control: no-cache
I0130 08:21:08.299935       1 util.go:124] Send.sendRequest got response with ContentLength 296, StatusCode 404 and responseBody length 296
I0130 08:21:08.299950       1 azure_virtualnetworklinksclient.go:212] Received error in virtualnetworklink.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/capz-e7g6lu/providers/Microsoft.Network/privateDnsZones/privatelink.file.core.windows.net/virtualNetworkLinks/capz-e7g6lu-vnet-vnetlink, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Network/privateDnsZones/privatelink.file.core.windows.net/virtualNetworkLinks/capz-e7g6lu-vnet-vnetlink' under resource group 'capz-e7g6lu' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I0130 08:21:08.300036       1 azure_metrics.go:115] "Observed Request Latency" latency_seconds=0.054038339 request="virtual_network_links_get" resource_group="capz-e7g6lu" subscription_id="0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e" source="" error_code="ResourceNotFound"
I0130 08:21:08.300054       1 azure_storageaccount.go:249] get virtual link for vnet(capz-e7g6lu-vnet) and DNS Zone(privatelink.file.core.windows.net) returned with Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Network/privateDnsZones/privatelink.file.core.windows.net/virtualNetworkLinks/capz-e7g6lu-vnet-vnetlink' under resource group 'capz-e7g6lu' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I0130 08:21:08.300060       1 azure_storageaccount.go:478] Creating virtual link for vnet(capz-e7g6lu-vnet-vnetlink) and DNS Zone(privatelink.file.core.windows.net) in resourceGroup(capz-e7g6lu)
(2023-01-30T08:21:08.3001522Z) INFO: REQUEST: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/capz-e7g6lu/providers/Microsoft.Network/privateDnsZones/privatelink.file.core.windows.net/virtualNetworkLinks/capz-e7g6lu-vnet-vnetlink?api-version=2020-06-01
User-Agent: Go/go1.19.5 (amd64-linux) go-autorest/v14.2.1 file.csi.azure.com/e2e-96a2ca02f36f8e1cb5b590f772c52ba00ac89296 e2e-test
Authorization: **REDACTED**
Content-Type: application/json; charset=utf-8
(2023-01-30T08:21:08.3001892Z) INFO: REQUEST: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/capz-e7g6lu/providers/Microsoft.Network/privateDnsZones/privatelink.file.core.windows.net/virtualNetworkLinks/capz-e7g6lu-vnet-vnetlink?api-version=2020-06-01
... skipping 4538 lines ...

Streaming logs below:
I0130 08:20:02.652830    6916 azurefile.go:299] driver userAgent: file.csi.azure.com/e2e-96a2ca02f36f8e1cb5b590f772c52ba00ac89296 e2e-test
I0130 08:20:02.662335    6916 azure.go:65] set QPS(25.000000) and QPS Burst(50) for driver kubeClient
I0130 08:20:02.667332    6916 azure.go:80] reading cloud config from secret kube-system/azure-cloud-provider
I0130 08:20:02.684831    6916 round_trippers.go:553] GET https://10.96.0.1:443/api/v1/namespaces/kube-system/secrets/azure-cloud-provider 404 Not Found in 15 milliseconds
I0130 08:20:02.686327    6916 azure.go:87] InitializeCloudFromSecret: failed to get cloud config from secret kube-system/azure-cloud-provider: failed to get secret kube-system/azure-cloud-provider: secrets "azure-cloud-provider" not found
I0130 08:20:02.686327    6916 azure.go:92] could not read cloud config from secret kube-system/azure-cloud-provider
I0130 08:20:02.686327    6916 azure.go:102] use default AZURE_CREDENTIAL_FILE env var: C:\k\azure.json
I0130 08:20:02.686327    6916 azure.go:110] read cloud config from file: C:\k\azure.json successfully
I0130 08:20:02.688339    6916 azure_auth.go:253] Using AzurePublicCloud environment
I0130 08:20:02.688825    6916 azure_auth.go:138] azure: using client_id+client_secret to retrieve access token
I0130 08:20:02.689834    6916 azure_diskclient.go:68] Azure DisksClient using API version: 2022-03-02
... skipping 1255 lines ...
I0130 08:33:52.678262    6916 utils.go:77] GRPC request: {}
I0130 08:33:52.678262    6916 utils.go:83] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":2}}}]}
I0130 08:33:52.679265    6916 utils.go:76] GRPC call: /csi.v1.Node/NodePublishVolume
I0130 08:33:52.679265    6916 utils.go:77] GRPC request: {"staging_target_path":"\\var\\lib\\kubelet\\plugins\\kubernetes.io\\csi\\pv\\pvc-7ae1f71e-cff5-4e0d-a92b-5670aa3c6a10\\globalmount","target_path":"c:\\var\\lib\\kubelet\\pods\\61cdbb43-0725-4152-a9c8-7a67afd78fd2\\volumes\\kubernetes.io~csi\\pvc-7ae1f71e-cff5-4e0d-a92b-5670aa3c6a10\\mount","volume_capability":{"AccessType":{"Mount":{}},"access_mode":{"mode":7}},"volume_context":{"csi.storage.k8s.io/ephemeral":"false","csi.storage.k8s.io/pod.name":"azurefile-volume-tester-n8m2l-0","csi.storage.k8s.io/pod.namespace":"azurefile-9183","csi.storage.k8s.io/pod.uid":"61cdbb43-0725-4152-a9c8-7a67afd78fd2","csi.storage.k8s.io/pv/name":"pvc-7ae1f71e-cff5-4e0d-a92b-5670aa3c6a10","csi.storage.k8s.io/pvc/name":"pvc-azurefile-volume-tester-n8m2l-0","csi.storage.k8s.io/pvc/namespace":"azurefile-9183","csi.storage.k8s.io/serviceAccount.name":"default","secretnamespace":"azurefile-9183","skuName":"Standard_LRS","storage.kubernetes.io/csiProvisionerIdentity":"1675066776049-8081-file.csi.azure.com"},"volume_id":"capz-e7g6lu#f614364cca2934d1f8f84e3#pvc-7ae1f71e-cff5-4e0d-a92b-5670aa3c6a10###azurefile-9183"}
I0130 08:33:52.679265    6916 safe_mounter_windows.go:155] IsLikelyNotMountPoint: c:\var\lib\kubelet\pods\61cdbb43-0725-4152-a9c8-7a67afd78fd2\volumes\kubernetes.io~csi\pvc-7ae1f71e-cff5-4e0d-a92b-5670aa3c6a10\mount
I0130 08:33:52.679265    6916 safe_mounter_windows.go:212] Exists path: c:\var\lib\kubelet\pods\61cdbb43-0725-4152-a9c8-7a67afd78fd2\volumes\kubernetes.io~csi\pvc-7ae1f71e-cff5-4e0d-a92b-5670aa3c6a10\mount
W0130 08:33:52.719633    6916 nodeserver.go:529] ReadDir c:\var\lib\kubelet\pods\61cdbb43-0725-4152-a9c8-7a67afd78fd2\volumes\kubernetes.io~csi\pvc-7ae1f71e-cff5-4e0d-a92b-5670aa3c6a10\mount failed with open c:\var\lib\kubelet\pods\61cdbb43-0725-4152-a9c8-7a67afd78fd2\volumes\kubernetes.io~csi\pvc-7ae1f71e-cff5-4e0d-a92b-5670aa3c6a10\mount: Access is denied., unmount this directory
I0130 08:33:52.720635    6916 safe_mounter_windows.go:139] Unmount: c:\var\lib\kubelet\pods\61cdbb43-0725-4152-a9c8-7a67afd78fd2\volumes\kubernetes.io~csi\pvc-7ae1f71e-cff5-4e0d-a92b-5670aa3c6a10\mount
I0130 08:33:52.720635    6916 safe_mounter_windows.go:125] Remove directory: c:\var\lib\kubelet\pods\61cdbb43-0725-4152-a9c8-7a67afd78fd2\volumes\kubernetes.io~csi\pvc-7ae1f71e-cff5-4e0d-a92b-5670aa3c6a10\mount
E0130 08:33:52.721640    6916 utils.go:81] GRPC error: rpc error: code = Internal desc = Could not mount target c:\var\lib\kubelet\pods\61cdbb43-0725-4152-a9c8-7a67afd78fd2\volumes\kubernetes.io~csi\pvc-7ae1f71e-cff5-4e0d-a92b-5670aa3c6a10\mount: open c:\var\lib\kubelet\pods\61cdbb43-0725-4152-a9c8-7a67afd78fd2\volumes\kubernetes.io~csi\pvc-7ae1f71e-cff5-4e0d-a92b-5670aa3c6a10\mount: Access is denied.
I0130 08:34:04.590182    6916 utils.go:76] GRPC call: /csi.v1.Node/NodeGetCapabilities
I0130 08:34:04.590182    6916 utils.go:77] GRPC request: {}
I0130 08:34:04.590182    6916 utils.go:83] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":2}}}]}
I0130 08:34:04.591183    6916 utils.go:76] GRPC call: /csi.v1.Node/NodeGetVolumeStats
I0130 08:34:04.591183    6916 utils.go:77] GRPC request: {"volume_id":"capz-e7g6lu#f614364cca2934d1f8f84e3#pvc-7ae1f71e-cff5-4e0d-a92b-5670aa3c6a10###azurefile-9183","volume_path":"c:\\var\\lib\\kubelet\\pods\\61cdbb43-0725-4152-a9c8-7a67afd78fd2\\volumes\\kubernetes.io~csi\\pvc-7ae1f71e-cff5-4e0d-a92b-5670aa3c6a10\\mount"}
I0130 08:34:04.591698    6916 utils.go:83] GRPC response: {"usage":[{"available":120752549888,"total":136912564224,"unit":1,"used":16160014336},{"unit":2}]}
... skipping 117 lines ...
I0130 08:36:31.857655    6916 utils.go:76] GRPC call: /csi.v1.Node/NodeGetCapabilities
I0130 08:36:31.857655    6916 utils.go:77] GRPC request: {}
I0130 08:36:31.857655    6916 utils.go:83] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":2}}}]}
I0130 08:36:31.858667    6916 utils.go:76] GRPC call: /csi.v1.Node/NodePublishVolume
I0130 08:36:31.859163    6916 utils.go:77] GRPC request: {"target_path":"c:\\var\\lib\\kubelet\\pods\\48f10738-08cd-431f-b3b8-b76694def1cb\\volumes\\kubernetes.io~csi\\test-volume-1\\mount","volume_capability":{"AccessType":{"Mount":{}},"access_mode":{"mode":7}},"volume_context":{"csi.storage.k8s.io/ephemeral":"true","csi.storage.k8s.io/pod.name":"azurefile-volume-tester-rhkml","csi.storage.k8s.io/pod.namespace":"azurefile-9371","csi.storage.k8s.io/pod.uid":"48f10738-08cd-431f-b3b8-b76694def1cb","csi.storage.k8s.io/serviceAccount.name":"default","mountOptions":"dir_mode=0755,file_mode=0721,cache=singleclient","secretName":"azure-storage-account-f614364cca2934d1f8f84e3-secret","server":"","shareName":"csi-inline-smb-volume"},"volume_id":"csi-462904507f5e8d794899b5c83665caaf2c5fe5bec11af91d8bbbd6f072bbf855"}
I0130 08:36:31.859163    6916 nodeserver.go:68] NodePublishVolume: ephemeral volume(csi-462904507f5e8d794899b5c83665caaf2c5fe5bec11af91d8bbbd6f072bbf855) mount on c:\var\lib\kubelet\pods\48f10738-08cd-431f-b3b8-b76694def1cb\volumes\kubernetes.io~csi\test-volume-1\mount, VolumeContext: map[csi.storage.k8s.io/ephemeral:true csi.storage.k8s.io/pod.name:azurefile-volume-tester-rhkml csi.storage.k8s.io/pod.namespace:azurefile-9371 csi.storage.k8s.io/pod.uid:48f10738-08cd-431f-b3b8-b76694def1cb csi.storage.k8s.io/serviceAccount.name:default getaccountkeyfromsecret:true mountOptions:dir_mode=0755,file_mode=0721,cache=singleclient secretName:azure-storage-account-f614364cca2934d1f8f84e3-secret secretnamespace:azurefile-9371 server: shareName:csi-inline-smb-volume storageaccount:]
W0130 08:36:31.859163    6916 azurefile.go:595] parsing volumeID(csi-462904507f5e8d794899b5c83665caaf2c5fe5bec11af91d8bbbd6f072bbf855) return with error: error parsing volume id: "csi-462904507f5e8d794899b5c83665caaf2c5fe5bec11af91d8bbbd6f072bbf855", should at least contain two #
I0130 08:36:31.861657    6916 round_trippers.go:553] GET https://10.96.0.1:443/api/v1/namespaces/azurefile-9371/secrets/azure-storage-account-f614364cca2934d1f8f84e3-secret 200 OK in 2 milliseconds
I0130 08:36:31.862165    6916 nodeserver.go:302] cifsMountPath(c:\var\lib\kubelet\pods\48f10738-08cd-431f-b3b8-b76694def1cb\volumes\kubernetes.io~csi\test-volume-1\mount) fstype() volumeID(csi-462904507f5e8d794899b5c83665caaf2c5fe5bec11af91d8bbbd6f072bbf855) context(map[csi.storage.k8s.io/ephemeral:true csi.storage.k8s.io/pod.name:azurefile-volume-tester-rhkml csi.storage.k8s.io/pod.namespace:azurefile-9371 csi.storage.k8s.io/pod.uid:48f10738-08cd-431f-b3b8-b76694def1cb csi.storage.k8s.io/serviceAccount.name:default getaccountkeyfromsecret:true mountOptions:dir_mode=0755,file_mode=0721,cache=singleclient secretName:azure-storage-account-f614364cca2934d1f8f84e3-secret secretnamespace:azurefile-9371 server: shareName:csi-inline-smb-volume storageaccount:]) mountflags([]) mountOptions([AZURE\f614364cca2934d1f8f84e3]) volumeMountGroup()
I0130 08:36:31.862165    6916 safe_mounter_windows.go:155] IsLikelyNotMountPoint: c:\var\lib\kubelet\pods\48f10738-08cd-431f-b3b8-b76694def1cb\volumes\kubernetes.io~csi\test-volume-1\mount
I0130 08:36:31.862165    6916 safe_mounter_windows.go:212] Exists path: c:\var\lib\kubelet\pods\48f10738-08cd-431f-b3b8-b76694def1cb\volumes\kubernetes.io~csi\test-volume-1\mount
I0130 08:36:31.863163    6916 safe_mounter_windows.go:212] Exists path: c:\var\lib\kubelet\pods\48f10738-08cd-431f-b3b8-b76694def1cb\volumes\kubernetes.io~csi\test-volume-1\mount
I0130 08:36:31.863668    6916 azure_common_windows.go:52] Removing path: c:\var\lib\kubelet\pods\48f10738-08cd-431f-b3b8-b76694def1cb\volumes\kubernetes.io~csi\test-volume-1\mount
... skipping 34 lines ...

Streaming logs below:
I0130 08:20:02.443482    3396 azurefile.go:299] driver userAgent: file.csi.azure.com/e2e-96a2ca02f36f8e1cb5b590f772c52ba00ac89296 e2e-test
I0130 08:20:02.444663    3396 azure.go:65] set QPS(25.000000) and QPS Burst(50) for driver kubeClient
I0130 08:20:02.451816    3396 azure.go:80] reading cloud config from secret kube-system/azure-cloud-provider
I0130 08:20:02.472609    3396 round_trippers.go:553] GET https://10.96.0.1:443/api/v1/namespaces/kube-system/secrets/azure-cloud-provider 404 Not Found in 14 milliseconds
I0130 08:20:02.474060    3396 azure.go:87] InitializeCloudFromSecret: failed to get cloud config from secret kube-system/azure-cloud-provider: failed to get secret kube-system/azure-cloud-provider: secrets "azure-cloud-provider" not found
I0130 08:20:02.474060    3396 azure.go:92] could not read cloud config from secret kube-system/azure-cloud-provider
I0130 08:20:02.474060    3396 azure.go:102] use default AZURE_CREDENTIAL_FILE env var: C:\k\azure.json
I0130 08:20:02.474238    3396 azure.go:110] read cloud config from file: C:\k\azure.json successfully
I0130 08:20:02.475454    3396 azure_auth.go:253] Using AzurePublicCloud environment
I0130 08:20:02.476530    3396 azure_auth.go:138] azure: using client_id+client_secret to retrieve access token
I0130 08:20:02.478714    3396 azure_diskclient.go:68] Azure DisksClient using API version: 2022-03-02
... skipping 547 lines ...
# HELP go_gc_heap_objects_objects Number of objects, live or unswept, occupying heap memory.
# TYPE go_gc_heap_objects_objects gauge
go_gc_heap_objects_objects 53862
# HELP go_gc_heap_tiny_allocs_objects_total Count of small allocations that are packed together into blocks. These allocations are counted separately from other allocations because each individual allocation is not tracked by the runtime, only their block. Each block is already accounted for in allocs-by-size and frees-by-size.
# TYPE go_gc_heap_tiny_allocs_objects_total counter
go_gc_heap_tiny_allocs_objects_total 17549
# HELP go_gc_limiter_last_enabled_gc_cycle GC cycle the last time the GC CPU limiter was enabled. This metric is useful for diagnosing the root cause of an out-of-memory error, because the limiter trades memory for CPU time when the GC's CPU time gets too high. This is most likely to occur with use of SetMemoryLimit. The first GC cycle is cycle 1, so a value of 0 indicates that it was never enabled.
# TYPE go_gc_limiter_last_enabled_gc_cycle gauge
go_gc_limiter_last_enabled_gc_cycle 0
# HELP go_gc_pauses_seconds Distribution individual GC-related stop-the-world pause latencies.
# TYPE go_gc_pauses_seconds histogram
go_gc_pauses_seconds_bucket{le="9.999999999999999e-10"} 0
go_gc_pauses_seconds_bucket{le="9.999999999999999e-09"} 0
... skipping 341 lines ...
Jan 30 08:38:05.325: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-lfzcd] to have phase Bound
Jan 30 08:38:05.433: INFO: PersistentVolumeClaim pvc-lfzcd found and phase=Bound (107.823712ms)
STEP: checking the PVC 01/30/23 08:38:05.433
STEP: validating provisioned PV 01/30/23 08:38:05.541
STEP: checking the PV 01/30/23 08:38:05.649
STEP: deploying the pod 01/30/23 08:38:05.649
STEP: checking that the pods command exits with an error 01/30/23 08:38:05.761
Jan 30 08:38:05.761: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-dt8kq" in namespace "azurefile-60" to be "Error status code"
Jan 30 08:38:05.869: INFO: Pod "azurefile-volume-tester-dt8kq": Phase="Pending", Reason="", readiness=false. Elapsed: 107.799343ms
Jan 30 08:38:07.978: INFO: Pod "azurefile-volume-tester-dt8kq": Phase="Pending", Reason="", readiness=false. Elapsed: 2.217355507s
Jan 30 08:38:09.984: INFO: Pod "azurefile-volume-tester-dt8kq": Phase="Pending", Reason="", readiness=false. Elapsed: 4.223424105s
Jan 30 08:38:11.985: INFO: Pod "azurefile-volume-tester-dt8kq": Phase="Pending", Reason="", readiness=false. Elapsed: 6.224021836s
Jan 30 08:38:13.985: INFO: Pod "azurefile-volume-tester-dt8kq": Phase="Running", Reason="", readiness=true. Elapsed: 8.224130942s
Jan 30 08:38:15.985: INFO: Pod "azurefile-volume-tester-dt8kq": Phase="Running", Reason="", readiness=true. Elapsed: 10.224496739s
Jan 30 08:38:17.986: INFO: Pod "azurefile-volume-tester-dt8kq": Phase="Running", Reason="", readiness=true. Elapsed: 12.224577661s
Jan 30 08:38:19.986: INFO: Pod "azurefile-volume-tester-dt8kq": Phase="Running", Reason="", readiness=false. Elapsed: 14.225175471s
Jan 30 08:38:21.985: INFO: Pod "azurefile-volume-tester-dt8kq": Phase="Failed", Reason="", readiness=false. Elapsed: 16.224470752s
STEP: Saw pod failure 01/30/23 08:38:21.985
Jan 30 08:38:21.986: INFO: Pod "azurefile-volume-tester-dt8kq" satisfied condition "Error status code"
STEP: checking that pod logs contain expected message 01/30/23 08:38:21.986
Jan 30 08:38:22.105: INFO: deleting Pod "azurefile-60"/"azurefile-volume-tester-dt8kq"
Jan 30 08:38:22.217: INFO: Pod azurefile-volume-tester-dt8kq has the following logs: Out-File : Access to the path 'C:\mnt\test-1\data.txt' is denied.
At line:1 char:22
+ ... cho 'hello world' | Out-File -FilePath C:\mnt\test-1\data.txt; Get-Co ...
+                         ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
... skipping 48 lines ...
    Jan 30 08:38:05.325: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-lfzcd] to have phase Bound
    Jan 30 08:38:05.433: INFO: PersistentVolumeClaim pvc-lfzcd found and phase=Bound (107.823712ms)
    STEP: checking the PVC 01/30/23 08:38:05.433
    STEP: validating provisioned PV 01/30/23 08:38:05.541
    STEP: checking the PV 01/30/23 08:38:05.649
    STEP: deploying the pod 01/30/23 08:38:05.649
    STEP: checking that the pods command exits with an error 01/30/23 08:38:05.761
    Jan 30 08:38:05.761: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-dt8kq" in namespace "azurefile-60" to be "Error status code"
    Jan 30 08:38:05.869: INFO: Pod "azurefile-volume-tester-dt8kq": Phase="Pending", Reason="", readiness=false. Elapsed: 107.799343ms
    Jan 30 08:38:07.978: INFO: Pod "azurefile-volume-tester-dt8kq": Phase="Pending", Reason="", readiness=false. Elapsed: 2.217355507s
    Jan 30 08:38:09.984: INFO: Pod "azurefile-volume-tester-dt8kq": Phase="Pending", Reason="", readiness=false. Elapsed: 4.223424105s
    Jan 30 08:38:11.985: INFO: Pod "azurefile-volume-tester-dt8kq": Phase="Pending", Reason="", readiness=false. Elapsed: 6.224021836s
    Jan 30 08:38:13.985: INFO: Pod "azurefile-volume-tester-dt8kq": Phase="Running", Reason="", readiness=true. Elapsed: 8.224130942s
    Jan 30 08:38:15.985: INFO: Pod "azurefile-volume-tester-dt8kq": Phase="Running", Reason="", readiness=true. Elapsed: 10.224496739s
    Jan 30 08:38:17.986: INFO: Pod "azurefile-volume-tester-dt8kq": Phase="Running", Reason="", readiness=true. Elapsed: 12.224577661s
    Jan 30 08:38:19.986: INFO: Pod "azurefile-volume-tester-dt8kq": Phase="Running", Reason="", readiness=false. Elapsed: 14.225175471s
    Jan 30 08:38:21.985: INFO: Pod "azurefile-volume-tester-dt8kq": Phase="Failed", Reason="", readiness=false. Elapsed: 16.224470752s
    STEP: Saw pod failure 01/30/23 08:38:21.985
    Jan 30 08:38:21.986: INFO: Pod "azurefile-volume-tester-dt8kq" satisfied condition "Error status code"
    STEP: checking that pod logs contain expected message 01/30/23 08:38:21.986
    Jan 30 08:38:22.105: INFO: deleting Pod "azurefile-60"/"azurefile-volume-tester-dt8kq"
    Jan 30 08:38:22.217: INFO: Pod azurefile-volume-tester-dt8kq has the following logs: Out-File : Access to the path 'C:\mnt\test-1\data.txt' is denied.
    At line:1 char:22
    + ... cho 'hello world' | Out-File -FilePath C:\mnt\test-1\data.txt; Get-Co ...
    +                         ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
... skipping 49 lines ...
Jan 30 08:38:27.349: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-x6dgf] to have phase Bound
Jan 30 08:38:27.458: INFO: PersistentVolumeClaim pvc-x6dgf found and phase=Bound (108.950105ms)
STEP: checking the PVC 01/30/23 08:38:27.458
STEP: validating provisioned PV 01/30/23 08:38:27.565
STEP: checking the PV 01/30/23 08:38:27.674
STEP: deploying the pod 01/30/23 08:38:27.674
STEP: checking that the pods command exits with no error 01/30/23 08:38:27.786
Jan 30 08:38:27.787: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-l49kl" in namespace "azurefile-1181" to be "Succeeded or Failed"
Jan 30 08:38:27.894: INFO: Pod "azurefile-volume-tester-l49kl": Phase="Pending", Reason="", readiness=false. Elapsed: 107.810986ms
Jan 30 08:38:30.005: INFO: Pod "azurefile-volume-tester-l49kl": Phase="Pending", Reason="", readiness=false. Elapsed: 2.218083573s
Jan 30 08:38:32.010: INFO: Pod "azurefile-volume-tester-l49kl": Phase="Pending", Reason="", readiness=false. Elapsed: 4.223254824s
Jan 30 08:38:34.011: INFO: Pod "azurefile-volume-tester-l49kl": Phase="Pending", Reason="", readiness=false. Elapsed: 6.224919902s
Jan 30 08:38:36.010: INFO: Pod "azurefile-volume-tester-l49kl": Phase="Running", Reason="", readiness=true. Elapsed: 8.223531306s
Jan 30 08:38:38.012: INFO: Pod "azurefile-volume-tester-l49kl": Phase="Running", Reason="", readiness=true. Elapsed: 10.225080377s
Jan 30 08:38:40.014: INFO: Pod "azurefile-volume-tester-l49kl": Phase="Running", Reason="", readiness=true. Elapsed: 12.227440016s
Jan 30 08:38:42.010: INFO: Pod "azurefile-volume-tester-l49kl": Phase="Running", Reason="", readiness=false. Elapsed: 14.223519079s
Jan 30 08:38:44.011: INFO: Pod "azurefile-volume-tester-l49kl": Phase="Succeeded", Reason="", readiness=false. Elapsed: 16.224922023s
STEP: Saw pod success 01/30/23 08:38:44.011
Jan 30 08:38:44.012: INFO: Pod "azurefile-volume-tester-l49kl" satisfied condition "Succeeded or Failed"
STEP: setting up the PV 01/30/23 08:38:44.012
STEP: creating a PV 01/30/23 08:38:44.012
STEP: setting up the PVC 01/30/23 08:38:44.122
STEP: creating a PVC 01/30/23 08:38:44.122
STEP: waiting for PVC to be in phase "Bound" 01/30/23 08:38:44.233
Jan 30 08:38:44.233: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-jg294] to have phase Bound
Jan 30 08:38:44.340: INFO: PersistentVolumeClaim pvc-jg294 found and phase=Bound (107.43935ms)
STEP: checking the PVC 01/30/23 08:38:44.34
STEP: validating provisioned PV 01/30/23 08:38:44.45
STEP: checking the PV 01/30/23 08:38:44.558
STEP: deploying the pod 01/30/23 08:38:44.558
STEP: checking that the pods command exits with no error 01/30/23 08:38:44.669
Jan 30 08:38:44.669: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-l5wk6" in namespace "azurefile-1181" to be "Succeeded or Failed"
Jan 30 08:38:44.776: INFO: Pod "azurefile-volume-tester-l5wk6": Phase="Pending", Reason="", readiness=false. Elapsed: 107.48376ms
Jan 30 08:38:46.892: INFO: Pod "azurefile-volume-tester-l5wk6": Phase="Pending", Reason="", readiness=false. Elapsed: 2.223212426s
Jan 30 08:38:48.893: INFO: Pod "azurefile-volume-tester-l5wk6": Phase="Pending", Reason="", readiness=false. Elapsed: 4.223793952s
Jan 30 08:38:50.893: INFO: Pod "azurefile-volume-tester-l5wk6": Phase="Running", Reason="", readiness=true. Elapsed: 6.224639877s
Jan 30 08:38:52.894: INFO: Pod "azurefile-volume-tester-l5wk6": Phase="Running", Reason="", readiness=true. Elapsed: 8.225453292s
Jan 30 08:38:54.894: INFO: Pod "azurefile-volume-tester-l5wk6": Phase="Running", Reason="", readiness=true. Elapsed: 10.224824509s
Jan 30 08:38:56.893: INFO: Pod "azurefile-volume-tester-l5wk6": Phase="Running", Reason="", readiness=false. Elapsed: 12.224016035s
Jan 30 08:38:58.893: INFO: Pod "azurefile-volume-tester-l5wk6": Phase="Succeeded", Reason="", readiness=false. Elapsed: 14.224429366s
STEP: Saw pod success 01/30/23 08:38:58.893
Jan 30 08:38:58.893: INFO: Pod "azurefile-volume-tester-l5wk6" satisfied condition "Succeeded or Failed"
STEP: setting up the PV 01/30/23 08:38:58.893
STEP: creating a PV 01/30/23 08:38:58.894
STEP: setting up the PVC 01/30/23 08:38:59.014
STEP: creating a PVC 01/30/23 08:38:59.014
STEP: waiting for PVC to be in phase "Bound" 01/30/23 08:38:59.128
Jan 30 08:38:59.128: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-2wgwg] to have phase Bound
Jan 30 08:38:59.237: INFO: PersistentVolumeClaim pvc-2wgwg found and phase=Bound (109.11934ms)
STEP: checking the PVC 01/30/23 08:38:59.237
STEP: validating provisioned PV 01/30/23 08:38:59.346
STEP: checking the PV 01/30/23 08:38:59.455
STEP: deploying the pod 01/30/23 08:38:59.455
STEP: checking that the pods command exits with no error 01/30/23 08:38:59.569
Jan 30 08:38:59.569: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-w886w" in namespace "azurefile-1181" to be "Succeeded or Failed"
Jan 30 08:38:59.678: INFO: Pod "azurefile-volume-tester-w886w": Phase="Pending", Reason="", readiness=false. Elapsed: 108.702503ms
Jan 30 08:39:01.794: INFO: Pod "azurefile-volume-tester-w886w": Phase="Pending", Reason="", readiness=false. Elapsed: 2.224871137s
Jan 30 08:39:03.796: INFO: Pod "azurefile-volume-tester-w886w": Phase="Pending", Reason="", readiness=false. Elapsed: 4.226865245s
Jan 30 08:39:05.795: INFO: Pod "azurefile-volume-tester-w886w": Phase="Running", Reason="", readiness=true. Elapsed: 6.225446773s
Jan 30 08:39:07.795: INFO: Pod "azurefile-volume-tester-w886w": Phase="Running", Reason="", readiness=true. Elapsed: 8.225881979s
Jan 30 08:39:09.796: INFO: Pod "azurefile-volume-tester-w886w": Phase="Running", Reason="", readiness=true. Elapsed: 10.226554583s
Jan 30 08:39:11.796: INFO: Pod "azurefile-volume-tester-w886w": Phase="Running", Reason="", readiness=false. Elapsed: 12.22677218s
Jan 30 08:39:13.796: INFO: Pod "azurefile-volume-tester-w886w": Phase="Succeeded", Reason="", readiness=false. Elapsed: 14.226850083s
STEP: Saw pod success 01/30/23 08:39:13.796
Jan 30 08:39:13.796: INFO: Pod "azurefile-volume-tester-w886w" satisfied condition "Succeeded or Failed"
STEP: setting up the PV 01/30/23 08:39:13.796
STEP: creating a PV 01/30/23 08:39:13.796
STEP: setting up the PVC 01/30/23 08:39:13.91
STEP: creating a PVC 01/30/23 08:39:13.911
STEP: waiting for PVC to be in phase "Bound" 01/30/23 08:39:14.025
Jan 30 08:39:14.025: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-6h5f2] to have phase Bound
Jan 30 08:39:14.134: INFO: PersistentVolumeClaim pvc-6h5f2 found and phase=Bound (108.893221ms)
STEP: checking the PVC 01/30/23 08:39:14.134
STEP: validating provisioned PV 01/30/23 08:39:14.243
STEP: checking the PV 01/30/23 08:39:14.351
STEP: deploying the pod 01/30/23 08:39:14.351
STEP: checking that the pods command exits with no error 01/30/23 08:39:14.467
Jan 30 08:39:14.467: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-7svqt" in namespace "azurefile-1181" to be "Succeeded or Failed"
Jan 30 08:39:14.576: INFO: Pod "azurefile-volume-tester-7svqt": Phase="Pending", Reason="", readiness=false. Elapsed: 109.752548ms
Jan 30 08:39:16.693: INFO: Pod "azurefile-volume-tester-7svqt": Phase="Pending", Reason="", readiness=false. Elapsed: 2.226498873s
Jan 30 08:39:18.695: INFO: Pod "azurefile-volume-tester-7svqt": Phase="Pending", Reason="", readiness=false. Elapsed: 4.22832032s
Jan 30 08:39:20.693: INFO: Pod "azurefile-volume-tester-7svqt": Phase="Running", Reason="", readiness=true. Elapsed: 6.226500943s
Jan 30 08:39:22.694: INFO: Pod "azurefile-volume-tester-7svqt": Phase="Running", Reason="", readiness=true. Elapsed: 8.227094254s
Jan 30 08:39:24.693: INFO: Pod "azurefile-volume-tester-7svqt": Phase="Running", Reason="", readiness=true. Elapsed: 10.22678101s
Jan 30 08:39:26.704: INFO: Pod "azurefile-volume-tester-7svqt": Phase="Running", Reason="", readiness=false. Elapsed: 12.237235712s
Jan 30 08:39:28.694: INFO: Pod "azurefile-volume-tester-7svqt": Phase="Succeeded", Reason="", readiness=false. Elapsed: 14.227585085s
STEP: Saw pod success 01/30/23 08:39:28.694
Jan 30 08:39:28.695: INFO: Pod "azurefile-volume-tester-7svqt" satisfied condition "Succeeded or Failed"
STEP: setting up the PV 01/30/23 08:39:28.695
STEP: creating a PV 01/30/23 08:39:28.695
STEP: setting up the PVC 01/30/23 08:39:28.808
STEP: creating a PVC 01/30/23 08:39:28.808
STEP: waiting for PVC to be in phase "Bound" 01/30/23 08:39:28.919
Jan 30 08:39:28.919: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-fglvn] to have phase Bound
Jan 30 08:39:29.028: INFO: PersistentVolumeClaim pvc-fglvn found and phase=Bound (109.025642ms)
STEP: checking the PVC 01/30/23 08:39:29.028
STEP: validating provisioned PV 01/30/23 08:39:29.137
STEP: checking the PV 01/30/23 08:39:29.246
STEP: deploying the pod 01/30/23 08:39:29.246
STEP: checking that the pods command exits with no error 01/30/23 08:39:29.366
Jan 30 08:39:29.366: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-hwmtm" in namespace "azurefile-1181" to be "Succeeded or Failed"
Jan 30 08:39:29.475: INFO: Pod "azurefile-volume-tester-hwmtm": Phase="Pending", Reason="", readiness=false. Elapsed: 108.27302ms
Jan 30 08:39:31.591: INFO: Pod "azurefile-volume-tester-hwmtm": Phase="Pending", Reason="", readiness=false. Elapsed: 2.224346754s
Jan 30 08:39:33.593: INFO: Pod "azurefile-volume-tester-hwmtm": Phase="Pending", Reason="", readiness=false. Elapsed: 4.22613006s
Jan 30 08:39:35.593: INFO: Pod "azurefile-volume-tester-hwmtm": Phase="Running", Reason="", readiness=true. Elapsed: 6.226404332s
Jan 30 08:39:37.598: INFO: Pod "azurefile-volume-tester-hwmtm": Phase="Running", Reason="", readiness=true. Elapsed: 8.231123976s
Jan 30 08:39:39.593: INFO: Pod "azurefile-volume-tester-hwmtm": Phase="Running", Reason="", readiness=true. Elapsed: 10.226259301s
Jan 30 08:39:41.593: INFO: Pod "azurefile-volume-tester-hwmtm": Phase="Running", Reason="", readiness=false. Elapsed: 12.226661865s
Jan 30 08:39:43.592: INFO: Pod "azurefile-volume-tester-hwmtm": Phase="Succeeded", Reason="", readiness=false. Elapsed: 14.225764345s
STEP: Saw pod success 01/30/23 08:39:43.592
Jan 30 08:39:43.592: INFO: Pod "azurefile-volume-tester-hwmtm" satisfied condition "Succeeded or Failed"
STEP: setting up the PV 01/30/23 08:39:43.592
STEP: creating a PV 01/30/23 08:39:43.592
STEP: setting up the PVC 01/30/23 08:39:43.705
STEP: creating a PVC 01/30/23 08:39:43.706
STEP: waiting for PVC to be in phase "Bound" 01/30/23 08:39:43.817
Jan 30 08:39:43.817: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-zj5th] to have phase Bound
Jan 30 08:39:43.926: INFO: PersistentVolumeClaim pvc-zj5th found and phase=Bound (108.620998ms)
STEP: checking the PVC 01/30/23 08:39:43.926
STEP: validating provisioned PV 01/30/23 08:39:44.035
STEP: checking the PV 01/30/23 08:39:44.144
STEP: deploying the pod 01/30/23 08:39:44.144
STEP: checking that the pods command exits with no error 01/30/23 08:39:44.262
Jan 30 08:39:44.262: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-s94gk" in namespace "azurefile-1181" to be "Succeeded or Failed"
Jan 30 08:39:44.371: INFO: Pod "azurefile-volume-tester-s94gk": Phase="Pending", Reason="", readiness=false. Elapsed: 108.53811ms
Jan 30 08:39:46.487: INFO: Pod "azurefile-volume-tester-s94gk": Phase="Pending", Reason="", readiness=false. Elapsed: 2.224629837s
Jan 30 08:39:48.488: INFO: Pod "azurefile-volume-tester-s94gk": Phase="Pending", Reason="", readiness=false. Elapsed: 4.225779573s
Jan 30 08:39:50.488: INFO: Pod "azurefile-volume-tester-s94gk": Phase="Running", Reason="", readiness=true. Elapsed: 6.225660706s
Jan 30 08:39:52.488: INFO: Pod "azurefile-volume-tester-s94gk": Phase="Running", Reason="", readiness=true. Elapsed: 8.225788663s
Jan 30 08:39:54.489: INFO: Pod "azurefile-volume-tester-s94gk": Phase="Running", Reason="", readiness=true. Elapsed: 10.22685747s
Jan 30 08:39:56.488: INFO: Pod "azurefile-volume-tester-s94gk": Phase="Running", Reason="", readiness=false. Elapsed: 12.225527199s
Jan 30 08:39:58.488: INFO: Pod "azurefile-volume-tester-s94gk": Phase="Succeeded", Reason="", readiness=false. Elapsed: 14.225822599s
STEP: Saw pod success 01/30/23 08:39:58.488
Jan 30 08:39:58.488: INFO: Pod "azurefile-volume-tester-s94gk" satisfied condition "Succeeded or Failed"
Jan 30 08:39:58.488: INFO: deleting Pod "azurefile-1181"/"azurefile-volume-tester-s94gk"
Jan 30 08:39:58.612: INFO: Pod azurefile-volume-tester-s94gk has the following logs: hello world

STEP: Deleting pod azurefile-volume-tester-s94gk in namespace azurefile-1181 01/30/23 08:39:58.612
Jan 30 08:39:58.744: INFO: deleting PVC "azurefile-1181"/"pvc-zj5th"
Jan 30 08:39:58.744: INFO: Deleting PersistentVolumeClaim "pvc-zj5th"
... skipping 94 lines ...
    Jan 30 08:38:27.349: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-x6dgf] to have phase Bound
    Jan 30 08:38:27.458: INFO: PersistentVolumeClaim pvc-x6dgf found and phase=Bound (108.950105ms)
    STEP: checking the PVC 01/30/23 08:38:27.458
    STEP: validating provisioned PV 01/30/23 08:38:27.565
    STEP: checking the PV 01/30/23 08:38:27.674
    STEP: deploying the pod 01/30/23 08:38:27.674
    STEP: checking that the pods command exits with no error 01/30/23 08:38:27.786
    Jan 30 08:38:27.787: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-l49kl" in namespace "azurefile-1181" to be "Succeeded or Failed"
    Jan 30 08:38:27.894: INFO: Pod "azurefile-volume-tester-l49kl": Phase="Pending", Reason="", readiness=false. Elapsed: 107.810986ms
    Jan 30 08:38:30.005: INFO: Pod "azurefile-volume-tester-l49kl": Phase="Pending", Reason="", readiness=false. Elapsed: 2.218083573s
    Jan 30 08:38:32.010: INFO: Pod "azurefile-volume-tester-l49kl": Phase="Pending", Reason="", readiness=false. Elapsed: 4.223254824s
    Jan 30 08:38:34.011: INFO: Pod "azurefile-volume-tester-l49kl": Phase="Pending", Reason="", readiness=false. Elapsed: 6.224919902s
    Jan 30 08:38:36.010: INFO: Pod "azurefile-volume-tester-l49kl": Phase="Running", Reason="", readiness=true. Elapsed: 8.223531306s
    Jan 30 08:38:38.012: INFO: Pod "azurefile-volume-tester-l49kl": Phase="Running", Reason="", readiness=true. Elapsed: 10.225080377s
    Jan 30 08:38:40.014: INFO: Pod "azurefile-volume-tester-l49kl": Phase="Running", Reason="", readiness=true. Elapsed: 12.227440016s
    Jan 30 08:38:42.010: INFO: Pod "azurefile-volume-tester-l49kl": Phase="Running", Reason="", readiness=false. Elapsed: 14.223519079s
    Jan 30 08:38:44.011: INFO: Pod "azurefile-volume-tester-l49kl": Phase="Succeeded", Reason="", readiness=false. Elapsed: 16.224922023s
    STEP: Saw pod success 01/30/23 08:38:44.011
    Jan 30 08:38:44.012: INFO: Pod "azurefile-volume-tester-l49kl" satisfied condition "Succeeded or Failed"
    STEP: setting up the PV 01/30/23 08:38:44.012
    STEP: creating a PV 01/30/23 08:38:44.012
    STEP: setting up the PVC 01/30/23 08:38:44.122
    STEP: creating a PVC 01/30/23 08:38:44.122
    STEP: waiting for PVC to be in phase "Bound" 01/30/23 08:38:44.233
    Jan 30 08:38:44.233: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-jg294] to have phase Bound
    Jan 30 08:38:44.340: INFO: PersistentVolumeClaim pvc-jg294 found and phase=Bound (107.43935ms)
    STEP: checking the PVC 01/30/23 08:38:44.34
    STEP: validating provisioned PV 01/30/23 08:38:44.45
    STEP: checking the PV 01/30/23 08:38:44.558
    STEP: deploying the pod 01/30/23 08:38:44.558
    STEP: checking that the pods command exits with no error 01/30/23 08:38:44.669
    Jan 30 08:38:44.669: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-l5wk6" in namespace "azurefile-1181" to be "Succeeded or Failed"
    Jan 30 08:38:44.776: INFO: Pod "azurefile-volume-tester-l5wk6": Phase="Pending", Reason="", readiness=false. Elapsed: 107.48376ms
    Jan 30 08:38:46.892: INFO: Pod "azurefile-volume-tester-l5wk6": Phase="Pending", Reason="", readiness=false. Elapsed: 2.223212426s
    Jan 30 08:38:48.893: INFO: Pod "azurefile-volume-tester-l5wk6": Phase="Pending", Reason="", readiness=false. Elapsed: 4.223793952s
    Jan 30 08:38:50.893: INFO: Pod "azurefile-volume-tester-l5wk6": Phase="Running", Reason="", readiness=true. Elapsed: 6.224639877s
    Jan 30 08:38:52.894: INFO: Pod "azurefile-volume-tester-l5wk6": Phase="Running", Reason="", readiness=true. Elapsed: 8.225453292s
    Jan 30 08:38:54.894: INFO: Pod "azurefile-volume-tester-l5wk6": Phase="Running", Reason="", readiness=true. Elapsed: 10.224824509s
    Jan 30 08:38:56.893: INFO: Pod "azurefile-volume-tester-l5wk6": Phase="Running", Reason="", readiness=false. Elapsed: 12.224016035s
    Jan 30 08:38:58.893: INFO: Pod "azurefile-volume-tester-l5wk6": Phase="Succeeded", Reason="", readiness=false. Elapsed: 14.224429366s
    STEP: Saw pod success 01/30/23 08:38:58.893
    Jan 30 08:38:58.893: INFO: Pod "azurefile-volume-tester-l5wk6" satisfied condition "Succeeded or Failed"
    STEP: setting up the PV 01/30/23 08:38:58.893
    STEP: creating a PV 01/30/23 08:38:58.894
    STEP: setting up the PVC 01/30/23 08:38:59.014
    STEP: creating a PVC 01/30/23 08:38:59.014
    STEP: waiting for PVC to be in phase "Bound" 01/30/23 08:38:59.128
    Jan 30 08:38:59.128: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-2wgwg] to have phase Bound
    Jan 30 08:38:59.237: INFO: PersistentVolumeClaim pvc-2wgwg found and phase=Bound (109.11934ms)
    STEP: checking the PVC 01/30/23 08:38:59.237
    STEP: validating provisioned PV 01/30/23 08:38:59.346
    STEP: checking the PV 01/30/23 08:38:59.455
    STEP: deploying the pod 01/30/23 08:38:59.455
    STEP: checking that the pods command exits with no error 01/30/23 08:38:59.569
    Jan 30 08:38:59.569: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-w886w" in namespace "azurefile-1181" to be "Succeeded or Failed"
    Jan 30 08:38:59.678: INFO: Pod "azurefile-volume-tester-w886w": Phase="Pending", Reason="", readiness=false. Elapsed: 108.702503ms
    Jan 30 08:39:01.794: INFO: Pod "azurefile-volume-tester-w886w": Phase="Pending", Reason="", readiness=false. Elapsed: 2.224871137s
    Jan 30 08:39:03.796: INFO: Pod "azurefile-volume-tester-w886w": Phase="Pending", Reason="", readiness=false. Elapsed: 4.226865245s
    Jan 30 08:39:05.795: INFO: Pod "azurefile-volume-tester-w886w": Phase="Running", Reason="", readiness=true. Elapsed: 6.225446773s
    Jan 30 08:39:07.795: INFO: Pod "azurefile-volume-tester-w886w": Phase="Running", Reason="", readiness=true. Elapsed: 8.225881979s
    Jan 30 08:39:09.796: INFO: Pod "azurefile-volume-tester-w886w": Phase="Running", Reason="", readiness=true. Elapsed: 10.226554583s
    Jan 30 08:39:11.796: INFO: Pod "azurefile-volume-tester-w886w": Phase="Running", Reason="", readiness=false. Elapsed: 12.22677218s
    Jan 30 08:39:13.796: INFO: Pod "azurefile-volume-tester-w886w": Phase="Succeeded", Reason="", readiness=false. Elapsed: 14.226850083s
    STEP: Saw pod success 01/30/23 08:39:13.796
    Jan 30 08:39:13.796: INFO: Pod "azurefile-volume-tester-w886w" satisfied condition "Succeeded or Failed"
    STEP: setting up the PV 01/30/23 08:39:13.796
    STEP: creating a PV 01/30/23 08:39:13.796
    STEP: setting up the PVC 01/30/23 08:39:13.91
    STEP: creating a PVC 01/30/23 08:39:13.911
    STEP: waiting for PVC to be in phase "Bound" 01/30/23 08:39:14.025
    Jan 30 08:39:14.025: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-6h5f2] to have phase Bound
    Jan 30 08:39:14.134: INFO: PersistentVolumeClaim pvc-6h5f2 found and phase=Bound (108.893221ms)
    STEP: checking the PVC 01/30/23 08:39:14.134
    STEP: validating provisioned PV 01/30/23 08:39:14.243
    STEP: checking the PV 01/30/23 08:39:14.351
    STEP: deploying the pod 01/30/23 08:39:14.351
    STEP: checking that the pods command exits with no error 01/30/23 08:39:14.467
    Jan 30 08:39:14.467: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-7svqt" in namespace "azurefile-1181" to be "Succeeded or Failed"
    Jan 30 08:39:14.576: INFO: Pod "azurefile-volume-tester-7svqt": Phase="Pending", Reason="", readiness=false. Elapsed: 109.752548ms
    Jan 30 08:39:16.693: INFO: Pod "azurefile-volume-tester-7svqt": Phase="Pending", Reason="", readiness=false. Elapsed: 2.226498873s
    Jan 30 08:39:18.695: INFO: Pod "azurefile-volume-tester-7svqt": Phase="Pending", Reason="", readiness=false. Elapsed: 4.22832032s
    Jan 30 08:39:20.693: INFO: Pod "azurefile-volume-tester-7svqt": Phase="Running", Reason="", readiness=true. Elapsed: 6.226500943s
    Jan 30 08:39:22.694: INFO: Pod "azurefile-volume-tester-7svqt": Phase="Running", Reason="", readiness=true. Elapsed: 8.227094254s
    Jan 30 08:39:24.693: INFO: Pod "azurefile-volume-tester-7svqt": Phase="Running", Reason="", readiness=true. Elapsed: 10.22678101s
    Jan 30 08:39:26.704: INFO: Pod "azurefile-volume-tester-7svqt": Phase="Running", Reason="", readiness=false. Elapsed: 12.237235712s
    Jan 30 08:39:28.694: INFO: Pod "azurefile-volume-tester-7svqt": Phase="Succeeded", Reason="", readiness=false. Elapsed: 14.227585085s
    STEP: Saw pod success 01/30/23 08:39:28.694
    Jan 30 08:39:28.695: INFO: Pod "azurefile-volume-tester-7svqt" satisfied condition "Succeeded or Failed"
    STEP: setting up the PV 01/30/23 08:39:28.695
    STEP: creating a PV 01/30/23 08:39:28.695
    STEP: setting up the PVC 01/30/23 08:39:28.808
    STEP: creating a PVC 01/30/23 08:39:28.808
    STEP: waiting for PVC to be in phase "Bound" 01/30/23 08:39:28.919
    Jan 30 08:39:28.919: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-fglvn] to have phase Bound
    Jan 30 08:39:29.028: INFO: PersistentVolumeClaim pvc-fglvn found and phase=Bound (109.025642ms)
    STEP: checking the PVC 01/30/23 08:39:29.028
    STEP: validating provisioned PV 01/30/23 08:39:29.137
    STEP: checking the PV 01/30/23 08:39:29.246
    STEP: deploying the pod 01/30/23 08:39:29.246
    STEP: checking that the pods command exits with no error 01/30/23 08:39:29.366
    Jan 30 08:39:29.366: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-hwmtm" in namespace "azurefile-1181" to be "Succeeded or Failed"
    Jan 30 08:39:29.475: INFO: Pod "azurefile-volume-tester-hwmtm": Phase="Pending", Reason="", readiness=false. Elapsed: 108.27302ms
    Jan 30 08:39:31.591: INFO: Pod "azurefile-volume-tester-hwmtm": Phase="Pending", Reason="", readiness=false. Elapsed: 2.224346754s
    Jan 30 08:39:33.593: INFO: Pod "azurefile-volume-tester-hwmtm": Phase="Pending", Reason="", readiness=false. Elapsed: 4.22613006s
    Jan 30 08:39:35.593: INFO: Pod "azurefile-volume-tester-hwmtm": Phase="Running", Reason="", readiness=true. Elapsed: 6.226404332s
    Jan 30 08:39:37.598: INFO: Pod "azurefile-volume-tester-hwmtm": Phase="Running", Reason="", readiness=true. Elapsed: 8.231123976s
    Jan 30 08:39:39.593: INFO: Pod "azurefile-volume-tester-hwmtm": Phase="Running", Reason="", readiness=true. Elapsed: 10.226259301s
    Jan 30 08:39:41.593: INFO: Pod "azurefile-volume-tester-hwmtm": Phase="Running", Reason="", readiness=false. Elapsed: 12.226661865s
    Jan 30 08:39:43.592: INFO: Pod "azurefile-volume-tester-hwmtm": Phase="Succeeded", Reason="", readiness=false. Elapsed: 14.225764345s
    STEP: Saw pod success 01/30/23 08:39:43.592
    Jan 30 08:39:43.592: INFO: Pod "azurefile-volume-tester-hwmtm" satisfied condition "Succeeded or Failed"
    STEP: setting up the PV 01/30/23 08:39:43.592
    STEP: creating a PV 01/30/23 08:39:43.592
    STEP: setting up the PVC 01/30/23 08:39:43.705
    STEP: creating a PVC 01/30/23 08:39:43.706
    STEP: waiting for PVC to be in phase "Bound" 01/30/23 08:39:43.817
    Jan 30 08:39:43.817: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-zj5th] to have phase Bound
    Jan 30 08:39:43.926: INFO: PersistentVolumeClaim pvc-zj5th found and phase=Bound (108.620998ms)
    STEP: checking the PVC 01/30/23 08:39:43.926
    STEP: validating provisioned PV 01/30/23 08:39:44.035
    STEP: checking the PV 01/30/23 08:39:44.144
    STEP: deploying the pod 01/30/23 08:39:44.144
    STEP: checking that the pods command exits with no error 01/30/23 08:39:44.262
    Jan 30 08:39:44.262: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-s94gk" in namespace "azurefile-1181" to be "Succeeded or Failed"
    Jan 30 08:39:44.371: INFO: Pod "azurefile-volume-tester-s94gk": Phase="Pending", Reason="", readiness=false. Elapsed: 108.53811ms
    Jan 30 08:39:46.487: INFO: Pod "azurefile-volume-tester-s94gk": Phase="Pending", Reason="", readiness=false. Elapsed: 2.224629837s
    Jan 30 08:39:48.488: INFO: Pod "azurefile-volume-tester-s94gk": Phase="Pending", Reason="", readiness=false. Elapsed: 4.225779573s
    Jan 30 08:39:50.488: INFO: Pod "azurefile-volume-tester-s94gk": Phase="Running", Reason="", readiness=true. Elapsed: 6.225660706s
    Jan 30 08:39:52.488: INFO: Pod "azurefile-volume-tester-s94gk": Phase="Running", Reason="", readiness=true. Elapsed: 8.225788663s
    Jan 30 08:39:54.489: INFO: Pod "azurefile-volume-tester-s94gk": Phase="Running", Reason="", readiness=true. Elapsed: 10.22685747s
    Jan 30 08:39:56.488: INFO: Pod "azurefile-volume-tester-s94gk": Phase="Running", Reason="", readiness=false. Elapsed: 12.225527199s
    Jan 30 08:39:58.488: INFO: Pod "azurefile-volume-tester-s94gk": Phase="Succeeded", Reason="", readiness=false. Elapsed: 14.225822599s
    STEP: Saw pod success 01/30/23 08:39:58.488
    Jan 30 08:39:58.488: INFO: Pod "azurefile-volume-tester-s94gk" satisfied condition "Succeeded or Failed"
    Jan 30 08:39:58.488: INFO: deleting Pod "azurefile-1181"/"azurefile-volume-tester-s94gk"
    Jan 30 08:39:58.612: INFO: Pod azurefile-volume-tester-s94gk has the following logs: hello world

    STEP: Deleting pod azurefile-volume-tester-s94gk in namespace azurefile-1181 01/30/23 08:39:58.612
    Jan 30 08:39:58.744: INFO: deleting PVC "azurefile-1181"/"pvc-zj5th"
    Jan 30 08:39:58.744: INFO: Deleting PersistentVolumeClaim "pvc-zj5th"
... skipping 174 lines ...
Jan 30 08:40:12.900: INFO: PersistentVolumeClaim pvc-6kzml found but phase is Pending instead of Bound.
Jan 30 08:40:15.009: INFO: PersistentVolumeClaim pvc-6kzml found and phase=Bound (2.218132249s)
STEP: checking the PVC 01/30/23 08:40:15.009
STEP: validating provisioned PV 01/30/23 08:40:15.118
STEP: checking the PV 01/30/23 08:40:15.228
STEP: deploying the pod 01/30/23 08:40:15.228
STEP: checking that the pods command exits with no error 01/30/23 08:40:15.341
Jan 30 08:40:15.341: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-kjfz8" in namespace "azurefile-1040" to be "Succeeded or Failed"
Jan 30 08:40:15.449: INFO: Pod "azurefile-volume-tester-kjfz8": Phase="Pending", Reason="", readiness=false. Elapsed: 108.55921ms
Jan 30 08:40:17.558: INFO: Pod "azurefile-volume-tester-kjfz8": Phase="Pending", Reason="", readiness=false. Elapsed: 2.217623656s
Jan 30 08:40:19.568: INFO: Pod "azurefile-volume-tester-kjfz8": Phase="Pending", Reason="", readiness=false. Elapsed: 4.226861144s
Jan 30 08:40:21.566: INFO: Pod "azurefile-volume-tester-kjfz8": Phase="Pending", Reason="", readiness=false. Elapsed: 6.225336536s
Jan 30 08:40:23.567: INFO: Pod "azurefile-volume-tester-kjfz8": Phase="Running", Reason="", readiness=true. Elapsed: 8.226671633s
Jan 30 08:40:25.568: INFO: Pod "azurefile-volume-tester-kjfz8": Phase="Running", Reason="", readiness=true. Elapsed: 10.226992955s
Jan 30 08:40:27.566: INFO: Pod "azurefile-volume-tester-kjfz8": Phase="Running", Reason="", readiness=true. Elapsed: 12.225689625s
Jan 30 08:40:29.568: INFO: Pod "azurefile-volume-tester-kjfz8": Phase="Running", Reason="", readiness=false. Elapsed: 14.226969349s
Jan 30 08:40:31.566: INFO: Pod "azurefile-volume-tester-kjfz8": Phase="Succeeded", Reason="", readiness=false. Elapsed: 16.225567262s
STEP: Saw pod success 01/30/23 08:40:31.566
Jan 30 08:40:31.567: INFO: Pod "azurefile-volume-tester-kjfz8" satisfied condition "Succeeded or Failed"
Jan 30 08:40:31.567: INFO: deleting Pod "azurefile-1040"/"azurefile-volume-tester-kjfz8"
Jan 30 08:40:31.684: INFO: Pod azurefile-volume-tester-kjfz8 has the following logs: hello world

STEP: Deleting pod azurefile-volume-tester-kjfz8 in namespace azurefile-1040 01/30/23 08:40:31.684
Jan 30 08:40:31.811: INFO: deleting PVC "azurefile-1040"/"pvc-6kzml"
Jan 30 08:40:31.811: INFO: Deleting PersistentVolumeClaim "pvc-6kzml"
... skipping 27 lines ...
    Jan 30 08:40:12.900: INFO: PersistentVolumeClaim pvc-6kzml found but phase is Pending instead of Bound.
    Jan 30 08:40:15.009: INFO: PersistentVolumeClaim pvc-6kzml found and phase=Bound (2.218132249s)
    STEP: checking the PVC 01/30/23 08:40:15.009
    STEP: validating provisioned PV 01/30/23 08:40:15.118
    STEP: checking the PV 01/30/23 08:40:15.228
    STEP: deploying the pod 01/30/23 08:40:15.228
    STEP: checking that the pods command exits with no error 01/30/23 08:40:15.341
    Jan 30 08:40:15.341: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-kjfz8" in namespace "azurefile-1040" to be "Succeeded or Failed"
    Jan 30 08:40:15.449: INFO: Pod "azurefile-volume-tester-kjfz8": Phase="Pending", Reason="", readiness=false. Elapsed: 108.55921ms
    Jan 30 08:40:17.558: INFO: Pod "azurefile-volume-tester-kjfz8": Phase="Pending", Reason="", readiness=false. Elapsed: 2.217623656s
    Jan 30 08:40:19.568: INFO: Pod "azurefile-volume-tester-kjfz8": Phase="Pending", Reason="", readiness=false. Elapsed: 4.226861144s
    Jan 30 08:40:21.566: INFO: Pod "azurefile-volume-tester-kjfz8": Phase="Pending", Reason="", readiness=false. Elapsed: 6.225336536s
    Jan 30 08:40:23.567: INFO: Pod "azurefile-volume-tester-kjfz8": Phase="Running", Reason="", readiness=true. Elapsed: 8.226671633s
    Jan 30 08:40:25.568: INFO: Pod "azurefile-volume-tester-kjfz8": Phase="Running", Reason="", readiness=true. Elapsed: 10.226992955s
    Jan 30 08:40:27.566: INFO: Pod "azurefile-volume-tester-kjfz8": Phase="Running", Reason="", readiness=true. Elapsed: 12.225689625s
    Jan 30 08:40:29.568: INFO: Pod "azurefile-volume-tester-kjfz8": Phase="Running", Reason="", readiness=false. Elapsed: 14.226969349s
    Jan 30 08:40:31.566: INFO: Pod "azurefile-volume-tester-kjfz8": Phase="Succeeded", Reason="", readiness=false. Elapsed: 16.225567262s
    STEP: Saw pod success 01/30/23 08:40:31.566
    Jan 30 08:40:31.567: INFO: Pod "azurefile-volume-tester-kjfz8" satisfied condition "Succeeded or Failed"
    Jan 30 08:40:31.567: INFO: deleting Pod "azurefile-1040"/"azurefile-volume-tester-kjfz8"
    Jan 30 08:40:31.684: INFO: Pod azurefile-volume-tester-kjfz8 has the following logs: hello world

    STEP: Deleting pod azurefile-volume-tester-kjfz8 in namespace azurefile-1040 01/30/23 08:40:31.684
    Jan 30 08:40:31.811: INFO: deleting PVC "azurefile-1040"/"pvc-6kzml"
    Jan 30 08:40:31.811: INFO: Deleting PersistentVolumeClaim "pvc-6kzml"
... skipping 27 lines ...
Jan 30 08:40:35.860: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-mdhx4] to have phase Bound
Jan 30 08:40:35.968: INFO: PersistentVolumeClaim pvc-mdhx4 found and phase=Bound (108.389301ms)
STEP: checking the PVC 01/30/23 08:40:35.968
STEP: validating provisioned PV 01/30/23 08:40:36.077
STEP: checking the PV 01/30/23 08:40:36.186
STEP: deploying the pod 01/30/23 08:40:36.186
STEP: checking that the pods command exits with no error 01/30/23 08:40:36.298
Jan 30 08:40:36.298: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-w7w59" in namespace "azurefile-6443" to be "Succeeded or Failed"
Jan 30 08:40:36.408: INFO: Pod "azurefile-volume-tester-w7w59": Phase="Pending", Reason="", readiness=false. Elapsed: 110.048127ms
Jan 30 08:40:38.519: INFO: Pod "azurefile-volume-tester-w7w59": Phase="Pending", Reason="", readiness=false. Elapsed: 2.220994214s
Jan 30 08:40:40.527: INFO: Pod "azurefile-volume-tester-w7w59": Phase="Pending", Reason="", readiness=false. Elapsed: 4.228985715s
Jan 30 08:40:42.526: INFO: Pod "azurefile-volume-tester-w7w59": Phase="Pending", Reason="", readiness=false. Elapsed: 6.228454054s
Jan 30 08:40:44.526: INFO: Pod "azurefile-volume-tester-w7w59": Phase="Running", Reason="", readiness=true. Elapsed: 8.228211326s
Jan 30 08:40:46.525: INFO: Pod "azurefile-volume-tester-w7w59": Phase="Running", Reason="", readiness=true. Elapsed: 10.226843958s
Jan 30 08:40:48.525: INFO: Pod "azurefile-volume-tester-w7w59": Phase="Running", Reason="", readiness=true. Elapsed: 12.227595519s
Jan 30 08:40:50.524: INFO: Pod "azurefile-volume-tester-w7w59": Phase="Running", Reason="", readiness=false. Elapsed: 14.226511169s
Jan 30 08:40:52.525: INFO: Pod "azurefile-volume-tester-w7w59": Phase="Succeeded", Reason="", readiness=false. Elapsed: 16.226943572s
STEP: Saw pod success 01/30/23 08:40:52.525
Jan 30 08:40:52.525: INFO: Pod "azurefile-volume-tester-w7w59" satisfied condition "Succeeded or Failed"
Jan 30 08:40:52.525: INFO: deleting Pod "azurefile-6443"/"azurefile-volume-tester-w7w59"
Jan 30 08:40:52.647: INFO: Pod azurefile-volume-tester-w7w59 has the following logs: hello world

STEP: Deleting pod azurefile-volume-tester-w7w59 in namespace azurefile-6443 01/30/23 08:40:52.647
Jan 30 08:40:52.774: INFO: deleting PVC "azurefile-6443"/"pvc-mdhx4"
Jan 30 08:40:52.774: INFO: Deleting PersistentVolumeClaim "pvc-mdhx4"
... skipping 31 lines ...
    Jan 30 08:40:35.860: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-mdhx4] to have phase Bound
    Jan 30 08:40:35.968: INFO: PersistentVolumeClaim pvc-mdhx4 found and phase=Bound (108.389301ms)
    STEP: checking the PVC 01/30/23 08:40:35.968
    STEP: validating provisioned PV 01/30/23 08:40:36.077
    STEP: checking the PV 01/30/23 08:40:36.186
    STEP: deploying the pod 01/30/23 08:40:36.186
    STEP: checking that the pods command exits with no error 01/30/23 08:40:36.298
    Jan 30 08:40:36.298: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-w7w59" in namespace "azurefile-6443" to be "Succeeded or Failed"
    Jan 30 08:40:36.408: INFO: Pod "azurefile-volume-tester-w7w59": Phase="Pending", Reason="", readiness=false. Elapsed: 110.048127ms
    Jan 30 08:40:38.519: INFO: Pod "azurefile-volume-tester-w7w59": Phase="Pending", Reason="", readiness=false. Elapsed: 2.220994214s
    Jan 30 08:40:40.527: INFO: Pod "azurefile-volume-tester-w7w59": Phase="Pending", Reason="", readiness=false. Elapsed: 4.228985715s
    Jan 30 08:40:42.526: INFO: Pod "azurefile-volume-tester-w7w59": Phase="Pending", Reason="", readiness=false. Elapsed: 6.228454054s
    Jan 30 08:40:44.526: INFO: Pod "azurefile-volume-tester-w7w59": Phase="Running", Reason="", readiness=true. Elapsed: 8.228211326s
    Jan 30 08:40:46.525: INFO: Pod "azurefile-volume-tester-w7w59": Phase="Running", Reason="", readiness=true. Elapsed: 10.226843958s
    Jan 30 08:40:48.525: INFO: Pod "azurefile-volume-tester-w7w59": Phase="Running", Reason="", readiness=true. Elapsed: 12.227595519s
    Jan 30 08:40:50.524: INFO: Pod "azurefile-volume-tester-w7w59": Phase="Running", Reason="", readiness=false. Elapsed: 14.226511169s
    Jan 30 08:40:52.525: INFO: Pod "azurefile-volume-tester-w7w59": Phase="Succeeded", Reason="", readiness=false. Elapsed: 16.226943572s
    STEP: Saw pod success 01/30/23 08:40:52.525
    Jan 30 08:40:52.525: INFO: Pod "azurefile-volume-tester-w7w59" satisfied condition "Succeeded or Failed"
    Jan 30 08:40:52.525: INFO: deleting Pod "azurefile-6443"/"azurefile-volume-tester-w7w59"
    Jan 30 08:40:52.647: INFO: Pod azurefile-volume-tester-w7w59 has the following logs: hello world

    STEP: Deleting pod azurefile-volume-tester-w7w59 in namespace azurefile-6443 01/30/23 08:40:52.647
    Jan 30 08:40:52.774: INFO: deleting PVC "azurefile-6443"/"pvc-mdhx4"
    Jan 30 08:40:52.774: INFO: Deleting PersistentVolumeClaim "pvc-mdhx4"
... skipping 77 lines ...

Streaming logs below:
I0130 08:19:35.907852       1 azurefile.go:299] driver userAgent: file.csi.azure.com/e2e-96a2ca02f36f8e1cb5b590f772c52ba00ac89296 e2e-test
I0130 08:19:35.907956       1 azure.go:65] set QPS(25.000000) and QPS Burst(50) for driver kubeClient
I0130 08:19:35.908278       1 azure.go:80] reading cloud config from secret kube-system/azure-cloud-provider
I0130 08:19:35.964924       1 round_trippers.go:553] GET https://10.96.0.1:443/api/v1/namespaces/kube-system/secrets/azure-cloud-provider 404 Not Found in 56 milliseconds
I0130 08:19:35.965216       1 azure.go:87] InitializeCloudFromSecret: failed to get cloud config from secret kube-system/azure-cloud-provider: failed to get secret kube-system/azure-cloud-provider: secrets "azure-cloud-provider" not found
I0130 08:19:35.965226       1 azure.go:92] could not read cloud config from secret kube-system/azure-cloud-provider
I0130 08:19:35.965232       1 azure.go:102] use default AZURE_CREDENTIAL_FILE env var: /etc/kubernetes/azure.json
I0130 08:19:35.965280       1 azure.go:110] read cloud config from file: /etc/kubernetes/azure.json successfully
I0130 08:19:35.966213       1 azure_auth.go:253] Using AzurePublicCloud environment
I0130 08:19:35.966253       1 azure_auth.go:138] azure: using client_id+client_secret to retrieve access token
I0130 08:19:35.966321       1 azure_diskclient.go:68] Azure DisksClient using API version: 2022-03-02
I0130 08:19:35.966374       1 azure_blobclient.go:67] Azure BlobClient using API version: 2021-09-01
I0130 08:19:35.966456       1 azure.go:1010] attach/detach disk operation rate limit QPS: 6.000000, Bucket: 10
I0130 08:19:35.966470       1 azure.go:140] disable UseInstanceMetadata for controller server
I0130 08:19:35.966475       1 azure.go:143] starting controller server...
I0130 08:19:35.966490       1 azurefile.go:304] cloud: AzurePublicCloud, location: westeurope, rg: capz-e7g6lu, VnetName: capz-e7g6lu-vnet, VnetResourceGroup: capz-e7g6lu, SubnetName: node-subnet
I0130 08:19:35.970139       1 mount_linux.go:287] 'umount /tmp/kubelet-detect-safe-umount1860059089' failed with: exit status 32, output: umount: /tmp/kubelet-detect-safe-umount1860059089: must be superuser to unmount.
I0130 08:19:35.970162       1 mount_linux.go:289] Detected umount with unsafe 'not mounted' behavior
I0130 08:19:35.970219       1 driver.go:93] Enabling controller service capability: CREATE_DELETE_VOLUME
I0130 08:19:35.970225       1 driver.go:93] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME
I0130 08:19:35.970229       1 driver.go:93] Enabling controller service capability: CREATE_DELETE_SNAPSHOT
I0130 08:19:35.970233       1 driver.go:93] Enabling controller service capability: EXPAND_VOLUME
I0130 08:19:35.970236       1 driver.go:93] Enabling controller service capability: SINGLE_NODE_MULTI_WRITER
... skipping 447 lines ...
Pragma: no-cache
Content-Type: application/json; charset=utf-8
X-Ms-Request-Id: 7658578c-01ba-4474-8fb6-1a1d50fbd5cb
X-Ms-Routing-Request-Id: WESTEUROPE:20230130T082036Z:7658578c-01ba-4474-8fb6-1a1d50fbd5cb
Strict-Transport-Security: max-age=31536000; includeSubDomains
I0130 08:20:36.587907       1 util.go:124] Send.sendRequest got response with ContentLength 250, StatusCode 404 and responseBody length 250
I0130 08:20:36.587976       1 azure_privatednsclient.go:215] Received error in privatednszone.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/capz-e7g6lu/providers/Microsoft.Network/privateDnsZones/privatelink.file.core.windows.net, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Network/privateDnsZones/privatelink.file.core.windows.net' under resource group 'capz-e7g6lu' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I0130 08:20:36.588146       1 azure_metrics.go:115] "Observed Request Latency" latency_seconds=0.019923872 request="private_dns_zones_get" resource_group="capz-e7g6lu" subscription_id="0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e" source="" error_code="ResourceNotFound"
I0130 08:20:36.588166       1 azure_storageaccount.go:239] get private dns zone privatelink.file.core.windows.net returned with Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Network/privateDnsZones/privatelink.file.core.windows.net' under resource group 'capz-e7g6lu' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I0130 08:20:36.588186       1 azure_storageaccount.go:464] Creating private dns zone(privatelink.file.core.windows.net) in resourceGroup (capz-e7g6lu)
(2023-01-30T08:20:36.5883000Z) INFO: REQUEST: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/capz-e7g6lu/providers/Microsoft.Network/privateDnsZones/privatelink.file.core.windows.net?api-version=2018-09-01
User-Agent: Go/go1.19.5 (amd64-linux) go-autorest/v14.2.1 file.csi.azure.com/e2e-96a2ca02f36f8e1cb5b590f772c52ba00ac89296 e2e-test
Authorization: **REDACTED**
Content-Type: application/json; charset=utf-8
(2023-01-30T08:20:36.5883519Z) INFO: REQUEST: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/capz-e7g6lu/providers/Microsoft.Network/privateDnsZones/privatelink.file.core.windows.net?api-version=2018-09-01
... skipping 140 lines ...
X-Ms-Failure-Cause: gateway
X-Content-Type-Options: nosniff
Date: Mon, 30 Jan 2023 08:21:07 GMT
Content-Length: 296
Cache-Control: no-cache
I0130 08:21:08.299935       1 util.go:124] Send.sendRequest got response with ContentLength 296, StatusCode 404 and responseBody length 296
I0130 08:21:08.299950       1 azure_virtualnetworklinksclient.go:212] Received error in virtualnetworklink.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/capz-e7g6lu/providers/Microsoft.Network/privateDnsZones/privatelink.file.core.windows.net/virtualNetworkLinks/capz-e7g6lu-vnet-vnetlink, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Network/privateDnsZones/privatelink.file.core.windows.net/virtualNetworkLinks/capz-e7g6lu-vnet-vnetlink' under resource group 'capz-e7g6lu' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I0130 08:21:08.300036       1 azure_metrics.go:115] "Observed Request Latency" latency_seconds=0.054038339 request="virtual_network_links_get" resource_group="capz-e7g6lu" subscription_id="0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e" source="" error_code="ResourceNotFound"
I0130 08:21:08.300054       1 azure_storageaccount.go:249] get virtual link for vnet(capz-e7g6lu-vnet) and DNS Zone(privatelink.file.core.windows.net) returned with Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Network/privateDnsZones/privatelink.file.core.windows.net/virtualNetworkLinks/capz-e7g6lu-vnet-vnetlink' under resource group 'capz-e7g6lu' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I0130 08:21:08.300060       1 azure_storageaccount.go:478] Creating virtual link for vnet(capz-e7g6lu-vnet-vnetlink) and DNS Zone(privatelink.file.core.windows.net) in resourceGroup(capz-e7g6lu)
(2023-01-30T08:21:08.3001522Z) INFO: REQUEST: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/capz-e7g6lu/providers/Microsoft.Network/privateDnsZones/privatelink.file.core.windows.net/virtualNetworkLinks/capz-e7g6lu-vnet-vnetlink?api-version=2020-06-01
User-Agent: Go/go1.19.5 (amd64-linux) go-autorest/v14.2.1 file.csi.azure.com/e2e-96a2ca02f36f8e1cb5b590f772c52ba00ac89296 e2e-test
Authorization: **REDACTED**
Content-Type: application/json; charset=utf-8
(2023-01-30T08:21:08.3001892Z) INFO: REQUEST: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/capz-e7g6lu/providers/Microsoft.Network/privateDnsZones/privatelink.file.core.windows.net/virtualNetworkLinks/capz-e7g6lu-vnet-vnetlink?api-version=2020-06-01
... skipping 4956 lines ...
Platform: linux/amd64

Streaming logs below:
I0130 08:37:47.420404       1 azurefile.go:299] driver userAgent: file.csi.azure.com/v1.25.0
I0130 08:37:47.420496       1 azure.go:65] set QPS(25.000000) and QPS Burst(50) for driver kubeClient
I0130 08:37:47.420757       1 azure.go:80] reading cloud config from secret kube-system/azure-cloud-provider
I0130 08:37:47.431855       1 azure.go:87] InitializeCloudFromSecret: failed to get cloud config from secret kube-system/azure-cloud-provider: failed to get secret kube-system/azure-cloud-provider: secrets "azure-cloud-provider" not found
I0130 08:37:47.431874       1 azure.go:92] could not read cloud config from secret kube-system/azure-cloud-provider
I0130 08:37:47.431880       1 azure.go:102] use default AZURE_CREDENTIAL_FILE env var: /etc/kubernetes/azure.json
I0130 08:37:47.431899       1 azure.go:110] read cloud config from file: /etc/kubernetes/azure.json successfully
I0130 08:37:47.432342       1 azure_auth.go:253] Using AzurePublicCloud environment
I0130 08:37:47.432376       1 azure_auth.go:138] azure: using client_id+client_secret to retrieve access token
I0130 08:37:47.432433       1 azure_diskclient.go:68] Azure DisksClient using API version: 2022-03-02
... skipping 42 lines ...
Git Commit: f25f97e4b05828ce0962ffc15bfce693e0a731b6
Go Version: go1.19.4
Platform: windows/amd64

Streaming logs below:
I0130 08:37:49.547326    6352 azurefile.go:299] driver userAgent: file.csi.azure.com/v1.25.0
W0130 08:37:49.549839    6352 azure.go:73] get kubeconfig(C:\\k\\config) failed with error: CreateFile C:\\k\\config: The system cannot find the file specified.
I0130 08:37:49.550822    6352 azure.go:92] could not read cloud config from secret kube-system/azure-cloud-provider
I0130 08:37:49.550859    6352 azure.go:102] use default AZURE_CREDENTIAL_FILE env var: C:\k\azure.json
I0130 08:37:49.551077    6352 azure.go:110] read cloud config from file: C:\k\azure.json successfully
I0130 08:37:49.551940    6352 azure_auth.go:253] Using AzurePublicCloud environment
I0130 08:37:49.552564    6352 azure_auth.go:138] azure: using client_id+client_secret to retrieve access token
I0130 08:37:49.554546    6352 azure_diskclient.go:68] Azure DisksClient using API version: 2022-03-02
... skipping 40 lines ...
Git Commit: f25f97e4b05828ce0962ffc15bfce693e0a731b6
Go Version: go1.19.4
Platform: windows/amd64

Streaming logs below:
I0130 08:37:49.546255    8300 azurefile.go:299] driver userAgent: file.csi.azure.com/v1.25.0
W0130 08:37:49.547257    8300 azure.go:73] get kubeconfig(C:\\k\\config) failed with error: CreateFile C:\\k\\config: The system cannot find the file specified.
I0130 08:37:49.547756    8300 azure.go:92] could not read cloud config from secret kube-system/azure-cloud-provider
I0130 08:37:49.547756    8300 azure.go:102] use default AZURE_CREDENTIAL_FILE env var: C:\k\azure.json
I0130 08:37:49.547756    8300 azure.go:110] read cloud config from file: C:\k\azure.json successfully
I0130 08:37:49.549247    8300 azure_auth.go:253] Using AzurePublicCloud environment
I0130 08:37:49.549758    8300 azure_auth.go:138] azure: using client_id+client_secret to retrieve access token
I0130 08:37:49.551251    8300 azure_diskclient.go:68] Azure DisksClient using API version: 2022-03-02
... skipping 41 lines ...
I0130 08:37:50.165269    8300 utils.go:83] GRPC response: {"name":"file.csi.azure.com","vendor_version":"v1.25.0"}
I0130 08:37:52.129774    8300 utils.go:76] GRPC call: /csi.v1.Node/NodeGetInfo
I0130 08:37:52.129774    8300 utils.go:77] GRPC request: {}
I0130 08:37:52.130276    8300 utils.go:83] GRPC response: {"node_id":"capz-e7g6-zssl6"}
I0130 08:38:05.991422    8300 utils.go:76] GRPC call: /csi.v1.Node/NodeStageVolume
I0130 08:38:05.991422    8300 utils.go:77] GRPC request: {"staging_target_path":"\\var\\lib\\kubelet\\plugins\\kubernetes.io\\csi\\pv\\azurefile-60-file.csi.azure.com-preprovsioned-pv-2q4s7\\globalmount","volume_capability":{"AccessType":{"Mount":{}},"access_mode":{"mode":7}},"volume_id":"capz-e7g6lu#f614364cca2934d1f8f84e3#pre-provisioned-readonly##pre-provisioned-readonly#azurefile-60"}
W0130 08:38:05.992912    8300 azurefile.go:668] GetStorageAccountFromSecret(azure-storage-account-f614364cca2934d1f8f84e3-secret, azurefile-60) failed with error: could not get account key from secret(azure-storage-account-f614364cca2934d1f8f84e3-secret): KubeClient is nil
I0130 08:38:05.992912    8300 azurefile.go:670] use cluster identity to get account key from (0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e, capz-e7g6lu, f614364cca2934d1f8f84e3)
I0130 08:38:06.538419    8300 nodeserver.go:302] cifsMountPath(\var\lib\kubelet\plugins\kubernetes.io\csi\pv\azurefile-60-file.csi.azure.com-preprovsioned-pv-2q4s7\globalmount) fstype() volumeID(capz-e7g6lu#f614364cca2934d1f8f84e3#pre-provisioned-readonly##pre-provisioned-readonly#azurefile-60) context(map[]) mountflags([]) mountOptions([AZURE\f614364cca2934d1f8f84e3]) volumeMountGroup()
I0130 08:38:06.538419    8300 safe_mounter_windows.go:155] IsLikelyNotMountPoint: \var\lib\kubelet\plugins\kubernetes.io\csi\pv\azurefile-60-file.csi.azure.com-preprovsioned-pv-2q4s7\globalmount
I0130 08:38:06.538419    8300 safe_mounter_windows.go:212] Exists path: \var\lib\kubelet\plugins\kubernetes.io\csi\pv\azurefile-60-file.csi.azure.com-preprovsioned-pv-2q4s7\globalmount
I0130 08:38:06.541414    8300 safe_mounter_windows.go:212] Exists path: \var\lib\kubelet\plugins\kubernetes.io\csi\pv\azurefile-60-file.csi.azure.com-preprovsioned-pv-2q4s7\globalmount
I0130 08:38:06.542413    8300 azure_common_windows.go:52] Removing path: \var\lib\kubelet\plugins\kubernetes.io\csi\pv\azurefile-60-file.csi.azure.com-preprovsioned-pv-2q4s7\globalmount
... skipping 341 lines ...
I0130 08:40:51.143626    8300 nodeserver.go:393] NodeUnstageVolume: CleanupMountPoint volume capz-e7g6lu#f614364cca2934d1f8f84e3#pre-provisioned-provided-credentials##pre-provisioned-provided-credentials#azurefile-6443 on \var\lib\kubelet\plugins\kubernetes.io\csi\pv\azurefile-6443-file.csi.azure.com-preprovsioned-pv-8j798\proxy-mount
I0130 08:40:51.143626    8300 safe_mounter_windows.go:125] Remove directory: \var\lib\kubelet\plugins\kubernetes.io\csi\pv\azurefile-6443-file.csi.azure.com-preprovsioned-pv-8j798\proxy-mount
I0130 08:40:51.144123    8300 nodeserver.go:397] NodeUnstageVolume: unmount volume capz-e7g6lu#f614364cca2934d1f8f84e3#pre-provisioned-provided-credentials##pre-provisioned-provided-credentials#azurefile-6443 on \var\lib\kubelet\plugins\kubernetes.io\csi\pv\azurefile-6443-file.csi.azure.com-preprovsioned-pv-8j798\globalmount successfully
I0130 08:40:51.144123    8300 utils.go:83] GRPC response: {}
I0130 08:40:58.033889    8300 utils.go:76] GRPC call: /csi.v1.Node/NodeStageVolume
I0130 08:40:58.033889    8300 utils.go:77] GRPC request: {"staging_target_path":"\\var\\lib\\kubelet\\plugins\\kubernetes.io\\csi\\pv\\pvc-f40694eb-67e4-4a91-a26e-6cf65fe397d1\\globalmount","volume_capability":{"AccessType":{"Mount":{"mount_flags":["dir_mode=0777","file_mode=0777","mfsymlinks","cache=strict","nosharesock","actimeo=30"]}},"access_mode":{"mode":5}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-f40694eb-67e4-4a91-a26e-6cf65fe397d1","csi.storage.k8s.io/pvc/name":"pvc-azurefile","csi.storage.k8s.io/pvc/namespace":"default","secretnamespace":"default","skuName":"Premium_LRS","storage.kubernetes.io/csiProvisionerIdentity":"1675066776049-8081-file.csi.azure.com"},"volume_id":"capz-e7g6lu#f2c6d0e932a494dc4b4ce63#pvc-f40694eb-67e4-4a91-a26e-6cf65fe397d1###default"}
W0130 08:40:58.034894    8300 azurefile.go:668] GetStorageAccountFromSecret(azure-storage-account-f2c6d0e932a494dc4b4ce63-secret, default) failed with error: could not get account key from secret(azure-storage-account-f2c6d0e932a494dc4b4ce63-secret): KubeClient is nil
I0130 08:40:58.034894    8300 azurefile.go:670] use cluster identity to get account key from (0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e, capz-e7g6lu, f2c6d0e932a494dc4b4ce63)
I0130 08:40:58.239543    8300 nodeserver.go:302] cifsMountPath(\var\lib\kubelet\plugins\kubernetes.io\csi\pv\pvc-f40694eb-67e4-4a91-a26e-6cf65fe397d1\globalmount) fstype() volumeID(capz-e7g6lu#f2c6d0e932a494dc4b4ce63#pvc-f40694eb-67e4-4a91-a26e-6cf65fe397d1###default) context(map[csi.storage.k8s.io/pv/name:pvc-f40694eb-67e4-4a91-a26e-6cf65fe397d1 csi.storage.k8s.io/pvc/name:pvc-azurefile csi.storage.k8s.io/pvc/namespace:default secretnamespace:default skuName:Premium_LRS storage.kubernetes.io/csiProvisionerIdentity:1675066776049-8081-file.csi.azure.com]) mountflags([dir_mode=0777 file_mode=0777 mfsymlinks cache=strict nosharesock actimeo=30]) mountOptions([AZURE\f2c6d0e932a494dc4b4ce63]) volumeMountGroup()
I0130 08:40:58.239543    8300 safe_mounter_windows.go:155] IsLikelyNotMountPoint: \var\lib\kubelet\plugins\kubernetes.io\csi\pv\pvc-f40694eb-67e4-4a91-a26e-6cf65fe397d1\globalmount
I0130 08:40:58.239543    8300 safe_mounter_windows.go:212] Exists path: \var\lib\kubelet\plugins\kubernetes.io\csi\pv\pvc-f40694eb-67e4-4a91-a26e-6cf65fe397d1\globalmount
I0130 08:40:58.241039    8300 safe_mounter_windows.go:212] Exists path: \var\lib\kubelet\plugins\kubernetes.io\csi\pv\pvc-f40694eb-67e4-4a91-a26e-6cf65fe397d1\globalmount
I0130 08:40:58.241545    8300 azure_common_windows.go:52] Removing path: \var\lib\kubelet\plugins\kubernetes.io\csi\pv\pvc-f40694eb-67e4-4a91-a26e-6cf65fe397d1\globalmount
... skipping 460 lines ...
# HELP go_gc_heap_objects_objects Number of objects, live or unswept, occupying heap memory.
# TYPE go_gc_heap_objects_objects gauge
go_gc_heap_objects_objects 48806
# HELP go_gc_heap_tiny_allocs_objects_total Count of small allocations that are packed together into blocks. These allocations are counted separately from other allocations because each individual allocation is not tracked by the runtime, only their block. Each block is already accounted for in allocs-by-size and frees-by-size.
# TYPE go_gc_heap_tiny_allocs_objects_total counter
go_gc_heap_tiny_allocs_objects_total 19573
# HELP go_gc_limiter_last_enabled_gc_cycle GC cycle the last time the GC CPU limiter was enabled. This metric is useful for diagnosing the root cause of an out-of-memory error, because the limiter trades memory for CPU time when the GC's CPU time gets too high. This is most likely to occur with use of SetMemoryLimit. The first GC cycle is cycle 1, so a value of 0 indicates that it was never enabled.
# TYPE go_gc_limiter_last_enabled_gc_cycle gauge
go_gc_limiter_last_enabled_gc_cycle 0
# HELP go_gc_pauses_seconds Distribution individual GC-related stop-the-world pause latencies.
# TYPE go_gc_pauses_seconds histogram
go_gc_pauses_seconds_bucket{le="9.999999999999999e-10"} 0
go_gc_pauses_seconds_bucket{le="9.999999999999999e-09"} 0
... skipping 252 lines ...
    STEP: GetAccountNumByResourceGroup(capz-e7g6lu) returns 9 accounts 01/30/23 08:41:46.018
  << End Captured GinkgoWriter Output
------------------------------


Summarizing 1 Failure:
  [FAIL] Dynamic Provisioning [It] should create a statefulset object, write and read to it, delete the pod and write and read to it again [file.csi.azure.com]
  /home/prow/go/src/sigs.k8s.io/azurefile-csi-driver/test/e2e/testsuites/testsuites.go:1011

Ran 22 of 38 Specs in 1986.240 seconds
FAIL! -- 21 Passed | 1 Failed | 0 Pending | 16 Skipped
You're using deprecated Ginkgo functionality:
=============================================
  Support for custom reporters has been removed in V2.  Please read the documentation linked to below for Ginkgo's new behavior and for a migration path:
  Learn more at: https://onsi.github.io/ginkgo/MIGRATING_TO_V2#removed-custom-reporters

To silence deprecations that can be silenced set the following environment variable:
  ACK_GINKGO_DEPRECATIONS=2.4.0

--- FAIL: TestE2E (1986.24s)
FAIL
FAIL	sigs.k8s.io/azurefile-csi-driver/test/e2e	1986.346s
FAIL
make: *** [Makefile:85: e2e-test] Error 1
NAME                              STATUS   ROLES                  AGE   VERSION                          INTERNAL-IP   EXTERNAL-IP   OS-IMAGE                         KERNEL-VERSION     CONTAINER-RUNTIME
capz-e7g6-vf7kt                   Ready    <none>                 37m   v1.23.17-rc.0.5+a3ccd27a5da633   10.1.0.4      <none>        Windows Server 2019 Datacenter   10.0.17763.3887    containerd://1.6.15
capz-e7g6-zssl6                   Ready    <none>                 37m   v1.23.17-rc.0.5+a3ccd27a5da633   10.1.0.5      <none>        Windows Server 2019 Datacenter   10.0.17763.3887    containerd://1.6.15
capz-e7g6lu-control-plane-rfw9w   Ready    control-plane,master   40m   v1.23.17-rc.0.5+a3ccd27a5da633   10.0.0.4      <none>        Ubuntu 18.04.6 LTS               5.4.0-1100-azure   containerd://1.6.15
NAMESPACE          NAME                                                      READY   STATUS        RESTARTS      AGE     IP                NODE                              NOMINATED NODE   READINESS GATES
azurefile-9183     azurefile-volume-tester-n8m2l-0                           0/1     Terminating   0             7m57s   <none>            capz-e7g6-zssl6                   <none>           <none>
... skipping 37 lines ...

  Jan 30 08:45:34.607: INFO: Collecting logs for Windows node capz-e7g6-vf7kt in cluster capz-e7g6lu in namespace default

  Jan 30 08:47:13.231: INFO: Attempting to copy file /c:/crashdumps.tar on node capz-e7g6-vf7kt to /logs/artifacts/clusters/capz-e7g6lu/machines/capz-e7g6lu-md-win-687c8f465d-p8kp5/crashdumps.tar
  Jan 30 08:47:16.807: INFO: Collecting boot logs for AzureMachine capz-e7g6lu-md-win-vf7kt

Failed to get logs for Machine capz-e7g6lu-md-win-687c8f465d-p8kp5, Cluster default/capz-e7g6lu: running command "$p = 'c:\localdumps' ; if (Test-Path $p) { tar.exe -cvzf c:\crashdumps.tar $p *>&1 | %{ Write-Output "$_"} } else { Write-Host "No crash dumps found at $p" }": Process exited with status 1
  Jan 30 08:47:18.222: INFO: Collecting logs for Windows node capz-e7g6-zssl6 in cluster capz-e7g6lu in namespace default

  Jan 30 08:49:09.073: INFO: Attempting to copy file /c:/crashdumps.tar on node capz-e7g6-zssl6 to /logs/artifacts/clusters/capz-e7g6lu/machines/capz-e7g6lu-md-win-687c8f465d-qzhrn/crashdumps.tar
  Jan 30 08:49:12.711: INFO: Collecting boot logs for AzureMachine capz-e7g6lu-md-win-zssl6

Failed to get logs for Machine capz-e7g6lu-md-win-687c8f465d-qzhrn, Cluster default/capz-e7g6lu: running command "$p = 'c:\localdumps' ; if (Test-Path $p) { tar.exe -cvzf c:\crashdumps.tar $p *>&1 | %{ Write-Output "$_"} } else { Write-Host "No crash dumps found at $p" }": Process exited with status 1
  Jan 30 08:49:14.186: INFO: Dumping workload cluster default/capz-e7g6lu kube-system pod logs
  Jan 30 08:49:15.302: INFO: Describing Pod azurefile-9183/azurefile-volume-tester-n8m2l-0
  Jan 30 08:49:15.302: INFO: Creating log watcher for controller azurefile-9183/azurefile-volume-tester-n8m2l-0, container volume-tester
  Jan 30 08:49:15.530: INFO: Creating log watcher for controller calico-apiserver/calico-apiserver-6d868c9f7-2rcbs, container calico-apiserver
  Jan 30 08:49:15.530: INFO: Describing Pod calico-apiserver/calico-apiserver-6d868c9f7-2rcbs
  Jan 30 08:49:15.826: INFO: Describing Pod calico-apiserver/calico-apiserver-6d868c9f7-psxx5
... skipping 73 lines ...