This job view page is being replaced by Spyglass soon. Check out the new job view.
PRandyzhangx: cleanup: refine csi-proxy v1beta interface
ResultFAILURE
Tests 1 failed / 33 succeeded
Started2021-07-26 02:05
Elapsed1h5m
Revision98b5afed7ee040a4ba5b84724591015e15c9b437
Refs 952
job-versionv1.23.0-alpha.0.29+3a863643c36bab
kubetest-version
revisionv1.23.0-alpha.0.29+3a863643c36bab

Test Failures


kubetest DumpClusterLogs 1m48s

error running log collection script /root/tmp834005565/log-dump.sh: error during bash -c /root/tmp834005565/log-dump.sh: exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 33 Passed Tests

Show 31 Skipped Tests

Error lines from build-log.txt

... skipping 72 lines ...

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100 11248  100 11248    0     0   207k      0 --:--:-- --:--:-- --:--:--  207k
Downloading https://get.helm.sh/helm-v3.6.3-linux-amd64.tar.gz
Verifying checksum... Done.
Preparing to install helm into /usr/local/bin
helm installed into /usr/local/bin/helm
docker pull k8sprow.azurecr.io/azuredisk-csi:v1.6.0-1b49ab8b970ae0881d6446c453ac6c621f4b0f06 || make container-all push-manifest
Error response from daemon: manifest for k8sprow.azurecr.io/azuredisk-csi:v1.6.0-1b49ab8b970ae0881d6446c453ac6c621f4b0f06 not found: manifest unknown: manifest tagged by "v1.6.0-1b49ab8b970ae0881d6446c453ac6c621f4b0f06" is not found
make[2]: Entering directory '/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver'
CGO_ENABLED=0 GOOS=windows go build -a -ldflags "-X sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk.driverVersion=v1.6.0-1b49ab8b970ae0881d6446c453ac6c621f4b0f06 -X sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk.gitCommit=1b49ab8b970ae0881d6446c453ac6c621f4b0f06 -X sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk.buildDate=2021-07-26T02:11:13Z -extldflags "-static""  -mod vendor -o _output/amd64/azurediskplugin.exe ./pkg/azurediskplugin
docker buildx rm container-builder || true
error: no builder "container-builder" found
docker buildx create --use --name=container-builder
container-builder
# enable qemu for arm64 build
# https://github.com/docker/buildx/issues/464#issuecomment-741507760
docker run --privileged --rm tonistiigi/binfmt --uninstall qemu-aarch64
Unable to find image 'tonistiigi/binfmt:latest' locally
... skipping 1555 lines ...
                    type: string
                type: object
              volumeSnapshotClassName:
                description: 'volumeSnapshotClassName is the name of the VolumeSnapshotClass
                  requested by the VolumeSnapshot. If not specified, the default snapshot
                  class will be used if one exists. If not specified, and there is
                  no default snapshot class, dynamic snapshot creation will fail.
                  Empty string is not allowed for this field. TODO(xiangqian): a webhook
                  validation on empty string. More info: https://kubernetes.io/docs/concepts/storage/volume-snapshot-classes'
                type: string
            required:
            - source
            type: object
... skipping 22 lines ...
                  pre-existing snapshot, this field will be filled with the "creation_time"
                  value returned from the CSI "ListSnapshots" gRPC call if the driver
                  supports it. If not specified, it indicates that the creation time
                  of the snapshot is unknown.
                format: date-time
                type: string
              error:
                description: error is the last observed error during snapshot creation,
                  if any. This field could be helpful to upper level controllers(i.e.,
                  application controller) to decide whether they should continue on
                  waiting for the snapshot to be created based on the type of error
                  reported.
                properties:
                  message:
                    description: 'message is a string detailing the encountered error
                      during snapshot creation if specified. NOTE: message may be
                      logged, and it should not contain sensitive information.'
                    type: string
                  time:
                    description: time is the timestamp when the error was encountered.
                    format: date-time
                    type: string
                type: object
              readyToUse:
                description: readyToUse indicates if a snapshot is ready to be used
                  to restore a volume. In dynamic snapshot creation case, this field
... skipping 10 lines ...
                  in bytes. In dynamic snapshot creation case, this field will be
                  filled in with the "size_bytes" value returned from CSI "CreateSnapshotRequest"
                  gRPC call. For a pre-existing snapshot, this field will be filled
                  with the "size_bytes" value returned from the CSI "ListSnapshots"
                  gRPC call if the driver supports it. When restoring a volume from
                  this snapshot, the size of the volume MUST NOT be smaller than the
                  restoreSize if it is specified, otherwise the restoration will fail.
                  If not specified, it indicates that the size is unknown.
                pattern: ^(\+|-)?(([0-9]+(\.[0-9]*)?)|(\.[0-9]+))(([KMGTPE]i)|[numkMGTPE]|([eE](\+|-)?(([0-9]+(\.[0-9]*)?)|(\.[0-9]+))))?$
                x-kubernetes-int-or-string: true
            type: object
        required:
        - spec
... skipping 265 lines ...
                  supports it. If not specified, it indicates the creation time is
                  unknown. The format of this field is a Unix nanoseconds time encoded
                  as an int64. On Unix, the command `date +%s%N` returns the current
                  time in nanoseconds since 1970-01-01 00:00:00 UTC.
                format: int64
                type: integer
              error:
                description: error is the latest observed error during snapshot creation,
                  if any.
                properties:
                  message:
                    description: 'message is a string detailing the encountered error
                      during snapshot creation if specified. NOTE: message may be
                      logged, and it should not contain sensitive information.'
                    type: string
                  time:
                    description: time is the timestamp when the error was encountered.
                    format: date-time
                    type: string
                type: object
              readyToUse:
                description: readyToUse indicates if a snapshot is ready to be used
                  to restore a volume. In dynamic snapshot creation case, this field
... skipping 9 lines ...
                  in bytes. In dynamic snapshot creation case, this field will be
                  filled in with the "size_bytes" value returned from CSI "CreateSnapshotRequest"
                  gRPC call. For a pre-existing snapshot, this field will be filled
                  with the "size_bytes" value returned from the CSI "ListSnapshots"
                  gRPC call if the driver supports it. When restoring a volume from
                  this snapshot, the size of the volume MUST NOT be smaller than the
                  restoreSize if it is specified, otherwise the restoration will fail.
                  If not specified, it indicates that the size is unknown.
                format: int64
                minimum: 0
                type: integer
              snapshotHandle:
                description: snapshotHandle is the CSI "snapshot_id" of a snapshot
                  on the underlying storage system. If not specified, it indicates
                  that dynamic snapshot creation has either failed or it is still
                  in progress.
                type: string
            type: object
        required:
        - spec
        type: object
... skipping 841 lines ...
        - name: csi-resizer
          image: "mcr.microsoft.com/oss/kubernetes-csi/csi-resizer:v1.1.0"
          args:
            - "-csi-address=$(ADDRESS)"
            - "-v=2"
            - "-leader-election"
            - '-handle-volume-inuse-error=true'
          env:
            - name: ADDRESS
              value: /csi/csi.sock
          volumeMounts:
            - name: socket-dir
              mountPath: /csi
... skipping 176 lines ...
Go Version: go1.16.6
Platform: linux/amd64
Topology Key: topology.disk.csi.azure.com/zone

Streaming logs below:
STEP: Building a namespace api object, basename azuredisk
E0726 02:19:00.020482   14012 azure_config.go:45] Failed to get cloud-config from secret: failed to get secret /: resource name may not be empty
W0726 02:19:00.021460   14012 azuredisk.go:207] DisableAvailabilitySetNodes for controller is set as false while current VMType is vmss
I0726 02:19:00.025866   14012 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME
I0726 02:19:00.025896   14012 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME
I0726 02:19:00.025901   14012 driver.go:81] Enabling controller service capability: CREATE_DELETE_SNAPSHOT
I0726 02:19:00.025904   14012 driver.go:81] Enabling controller service capability: LIST_SNAPSHOTS
I0726 02:19:00.025908   14012 driver.go:81] Enabling controller service capability: CLONE_VOLUME
... skipping 13 lines ...
STEP: setting up the StorageClass
STEP: creating a StorageClass 
STEP: setting up the PVC and PV
STEP: creating a PVC
STEP: setting up the pod
STEP: deploying the pod
STEP: checking that the pod's command exits with no error
Jul 26 02:19:02.021: INFO: Waiting up to 15m0s for pod "azuredisk-volume-tester-dwlcf" in namespace "azuredisk-8081" to be "Succeeded or Failed"
Jul 26 02:19:02.078: INFO: Pod "azuredisk-volume-tester-dwlcf": Phase="Pending", Reason="", readiness=false. Elapsed: 57.441232ms
Jul 26 02:19:04.140: INFO: Pod "azuredisk-volume-tester-dwlcf": Phase="Pending", Reason="", readiness=false. Elapsed: 2.118621097s
Jul 26 02:19:06.199: INFO: Pod "azuredisk-volume-tester-dwlcf": Phase="Pending", Reason="", readiness=false. Elapsed: 4.177672266s
Jul 26 02:19:08.258: INFO: Pod "azuredisk-volume-tester-dwlcf": Phase="Pending", Reason="", readiness=false. Elapsed: 6.236612873s
Jul 26 02:19:10.318: INFO: Pod "azuredisk-volume-tester-dwlcf": Phase="Pending", Reason="", readiness=false. Elapsed: 8.296875222s
Jul 26 02:19:12.378: INFO: Pod "azuredisk-volume-tester-dwlcf": Phase="Pending", Reason="", readiness=false. Elapsed: 10.357081143s
... skipping 6 lines ...
Jul 26 02:19:26.797: INFO: Pod "azuredisk-volume-tester-dwlcf": Phase="Pending", Reason="", readiness=false. Elapsed: 24.775973096s
Jul 26 02:19:28.857: INFO: Pod "azuredisk-volume-tester-dwlcf": Phase="Pending", Reason="", readiness=false. Elapsed: 26.835700875s
Jul 26 02:19:30.916: INFO: Pod "azuredisk-volume-tester-dwlcf": Phase="Pending", Reason="", readiness=false. Elapsed: 28.89494962s
Jul 26 02:19:32.976: INFO: Pod "azuredisk-volume-tester-dwlcf": Phase="Pending", Reason="", readiness=false. Elapsed: 30.954574677s
Jul 26 02:19:35.037: INFO: Pod "azuredisk-volume-tester-dwlcf": Phase="Succeeded", Reason="", readiness=false. Elapsed: 33.016183103s
STEP: Saw pod success
Jul 26 02:19:35.037: INFO: Pod "azuredisk-volume-tester-dwlcf" satisfied condition "Succeeded or Failed"
Jul 26 02:19:35.037: INFO: deleting Pod "azuredisk-8081"/"azuredisk-volume-tester-dwlcf"
Jul 26 02:19:35.170: INFO: Pod azuredisk-volume-tester-dwlcf has the following logs: hello world

STEP: Deleting pod azuredisk-volume-tester-dwlcf in namespace azuredisk-8081
STEP: validating provisioned PV
STEP: checking the PV
... skipping 46 lines ...
Jul 26 02:20:19.786: INFO: PersistentVolumeClaim pvc-mfbpp found but phase is Pending instead of Bound.
Jul 26 02:20:21.842: INFO: PersistentVolumeClaim pvc-mfbpp found and phase=Bound (4.179949108s)
STEP: checking the PVC
STEP: validating provisioned PV
STEP: checking the PV
STEP: deploying the pod
STEP: checking that the pods command exits with no error
Jul 26 02:20:22.012: INFO: Waiting up to 15m0s for pod "azuredisk-volume-tester-xvzdc" in namespace "azuredisk-1318" to be "Succeeded or Failed"
Jul 26 02:20:22.068: INFO: Pod "azuredisk-volume-tester-xvzdc": Phase="Pending", Reason="", readiness=false. Elapsed: 55.214803ms
Jul 26 02:20:24.125: INFO: Pod "azuredisk-volume-tester-xvzdc": Phase="Pending", Reason="", readiness=false. Elapsed: 2.112414957s
Jul 26 02:20:26.183: INFO: Pod "azuredisk-volume-tester-xvzdc": Phase="Pending", Reason="", readiness=false. Elapsed: 4.170614326s
Jul 26 02:20:28.240: INFO: Pod "azuredisk-volume-tester-xvzdc": Phase="Pending", Reason="", readiness=false. Elapsed: 6.227865998s
Jul 26 02:20:30.299: INFO: Pod "azuredisk-volume-tester-xvzdc": Phase="Pending", Reason="", readiness=false. Elapsed: 8.28603345s
Jul 26 02:20:32.355: INFO: Pod "azuredisk-volume-tester-xvzdc": Phase="Pending", Reason="", readiness=false. Elapsed: 10.34249029s
Jul 26 02:20:34.412: INFO: Pod "azuredisk-volume-tester-xvzdc": Phase="Pending", Reason="", readiness=false. Elapsed: 12.399284044s
Jul 26 02:20:36.468: INFO: Pod "azuredisk-volume-tester-xvzdc": Phase="Pending", Reason="", readiness=false. Elapsed: 14.455492152s
Jul 26 02:20:38.525: INFO: Pod "azuredisk-volume-tester-xvzdc": Phase="Pending", Reason="", readiness=false. Elapsed: 16.512594629s
Jul 26 02:20:40.582: INFO: Pod "azuredisk-volume-tester-xvzdc": Phase="Pending", Reason="", readiness=false. Elapsed: 18.569972946s
Jul 26 02:20:42.640: INFO: Pod "azuredisk-volume-tester-xvzdc": Phase="Pending", Reason="", readiness=false. Elapsed: 20.627236025s
Jul 26 02:20:44.697: INFO: Pod "azuredisk-volume-tester-xvzdc": Phase="Succeeded", Reason="", readiness=false. Elapsed: 22.684260792s
STEP: Saw pod success
Jul 26 02:20:44.697: INFO: Pod "azuredisk-volume-tester-xvzdc" satisfied condition "Succeeded or Failed"
Jul 26 02:20:44.697: INFO: deleting Pod "azuredisk-1318"/"azuredisk-volume-tester-xvzdc"
Jul 26 02:20:44.807: INFO: Pod azuredisk-volume-tester-xvzdc has the following logs: hello world

STEP: Deleting pod azuredisk-volume-tester-xvzdc in namespace azuredisk-1318
Jul 26 02:20:44.872: INFO: deleting PVC "azuredisk-1318"/"pvc-mfbpp"
Jul 26 02:20:44.872: INFO: Deleting PersistentVolumeClaim "pvc-mfbpp"
... skipping 33 lines ...
STEP: setting up the StorageClass
STEP: creating a StorageClass 
STEP: setting up the PVC and PV
STEP: creating a PVC
STEP: setting up the pod
STEP: deploying the pod
STEP: checking that the pod's command exits with no error
Jul 26 02:21:07.050: INFO: Waiting up to 15m0s for pod "azuredisk-volume-tester-b4vtz" in namespace "azuredisk-694" to be "Succeeded or Failed"
Jul 26 02:21:07.106: INFO: Pod "azuredisk-volume-tester-b4vtz": Phase="Pending", Reason="", readiness=false. Elapsed: 55.945579ms
Jul 26 02:21:09.164: INFO: Pod "azuredisk-volume-tester-b4vtz": Phase="Pending", Reason="", readiness=false. Elapsed: 2.114484778s
Jul 26 02:21:11.221: INFO: Pod "azuredisk-volume-tester-b4vtz": Phase="Pending", Reason="", readiness=false. Elapsed: 4.171324704s
Jul 26 02:21:13.278: INFO: Pod "azuredisk-volume-tester-b4vtz": Phase="Pending", Reason="", readiness=false. Elapsed: 6.22789912s
Jul 26 02:21:15.335: INFO: Pod "azuredisk-volume-tester-b4vtz": Phase="Pending", Reason="", readiness=false. Elapsed: 8.285497284s
Jul 26 02:21:17.393: INFO: Pod "azuredisk-volume-tester-b4vtz": Phase="Pending", Reason="", readiness=false. Elapsed: 10.3429423s
... skipping 33 lines ...
Jul 26 02:22:27.346: INFO: Pod "azuredisk-volume-tester-b4vtz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.296565484s
Jul 26 02:22:29.403: INFO: Pod "azuredisk-volume-tester-b4vtz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.353106079s
Jul 26 02:22:31.460: INFO: Pod "azuredisk-volume-tester-b4vtz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.410446421s
Jul 26 02:22:33.516: INFO: Pod "azuredisk-volume-tester-b4vtz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.466051731s
Jul 26 02:22:35.573: INFO: Pod "azuredisk-volume-tester-b4vtz": Phase="Succeeded", Reason="", readiness=false. Elapsed: 1m28.523172068s
STEP: Saw pod success
Jul 26 02:22:35.573: INFO: Pod "azuredisk-volume-tester-b4vtz" satisfied condition "Succeeded or Failed"
Jul 26 02:22:35.573: INFO: deleting Pod "azuredisk-694"/"azuredisk-volume-tester-b4vtz"
Jul 26 02:22:35.680: INFO: Pod azuredisk-volume-tester-b4vtz has the following logs: hello world

STEP: Deleting pod azuredisk-volume-tester-b4vtz in namespace azuredisk-694
STEP: validating provisioned PV
STEP: checking the PV
... skipping 41 lines ...
STEP: setting up the PVC and PV
STEP: creating a PVC
STEP: setting up the pod
STEP: deploying the pod
STEP: checking that the pod has 'FailedMount' event
Jul 26 02:23:40.321: INFO: deleting Pod "azuredisk-3274"/"azuredisk-volume-tester-x2r4k"
Jul 26 02:23:40.381: INFO: Error getting logs for pod azuredisk-volume-tester-x2r4k: the server rejected our request for an unknown reason (get pods azuredisk-volume-tester-x2r4k)
STEP: Deleting pod azuredisk-volume-tester-x2r4k in namespace azuredisk-3274
STEP: validating provisioned PV
STEP: checking the PV
Jul 26 02:23:40.560: INFO: deleting PVC "azuredisk-3274"/"pvc-rnwpx"
Jul 26 02:23:40.560: INFO: Deleting PersistentVolumeClaim "pvc-rnwpx"
STEP: waiting for claim's PV "pvc-6f4c29a1-b748-4d4a-bfdc-4a0b12f24030" to be deleted
... skipping 37 lines ...
STEP: setting up the StorageClass
STEP: creating a StorageClass 
STEP: setting up the PVC and PV
STEP: creating a PVC
STEP: setting up the pod
STEP: deploying the pod
STEP: checking that the pod's command exits with no error
Jul 26 02:24:28.087: INFO: Waiting up to 15m0s for pod "azuredisk-volume-tester-kv2cq" in namespace "azuredisk-495" to be "Succeeded or Failed"
Jul 26 02:24:28.144: INFO: Pod "azuredisk-volume-tester-kv2cq": Phase="Pending", Reason="", readiness=false. Elapsed: 57.42086ms
Jul 26 02:24:30.204: INFO: Pod "azuredisk-volume-tester-kv2cq": Phase="Pending", Reason="", readiness=false. Elapsed: 2.11700158s
Jul 26 02:24:32.263: INFO: Pod "azuredisk-volume-tester-kv2cq": Phase="Pending", Reason="", readiness=false. Elapsed: 4.176171901s
Jul 26 02:24:34.321: INFO: Pod "azuredisk-volume-tester-kv2cq": Phase="Pending", Reason="", readiness=false. Elapsed: 6.23445569s
Jul 26 02:24:36.380: INFO: Pod "azuredisk-volume-tester-kv2cq": Phase="Pending", Reason="", readiness=false. Elapsed: 8.293364312s
Jul 26 02:24:38.440: INFO: Pod "azuredisk-volume-tester-kv2cq": Phase="Pending", Reason="", readiness=false. Elapsed: 10.353383377s
... skipping 3 lines ...
Jul 26 02:24:46.676: INFO: Pod "azuredisk-volume-tester-kv2cq": Phase="Pending", Reason="", readiness=false. Elapsed: 18.589491067s
Jul 26 02:24:48.737: INFO: Pod "azuredisk-volume-tester-kv2cq": Phase="Pending", Reason="", readiness=false. Elapsed: 20.649890672s
Jul 26 02:24:50.796: INFO: Pod "azuredisk-volume-tester-kv2cq": Phase="Pending", Reason="", readiness=false. Elapsed: 22.709498225s
Jul 26 02:24:52.855: INFO: Pod "azuredisk-volume-tester-kv2cq": Phase="Pending", Reason="", readiness=false. Elapsed: 24.768480827s
Jul 26 02:24:54.917: INFO: Pod "azuredisk-volume-tester-kv2cq": Phase="Succeeded", Reason="", readiness=false. Elapsed: 26.830156398s
STEP: Saw pod success
Jul 26 02:24:54.917: INFO: Pod "azuredisk-volume-tester-kv2cq" satisfied condition "Succeeded or Failed"
Jul 26 02:24:54.917: INFO: deleting Pod "azuredisk-495"/"azuredisk-volume-tester-kv2cq"
Jul 26 02:24:54.981: INFO: Pod azuredisk-volume-tester-kv2cq has the following logs: e2e-test

STEP: Deleting pod azuredisk-volume-tester-kv2cq in namespace azuredisk-495
STEP: validating provisioned PV
STEP: checking the PV
... skipping 35 lines ...
STEP: setting up the StorageClass
STEP: creating a StorageClass 
STEP: setting up the PVC and PV
STEP: creating a PVC
STEP: setting up the pod
STEP: deploying the pod
STEP: checking that the pod's command exits with an error
Jul 26 02:25:17.253: INFO: Waiting up to 10m0s for pod "azuredisk-volume-tester-lv7nh" in namespace "azuredisk-9947" to be "Error status code"
Jul 26 02:25:17.313: INFO: Pod "azuredisk-volume-tester-lv7nh": Phase="Pending", Reason="", readiness=false. Elapsed: 59.753078ms
Jul 26 02:25:19.372: INFO: Pod "azuredisk-volume-tester-lv7nh": Phase="Pending", Reason="", readiness=false. Elapsed: 2.119321074s
Jul 26 02:25:21.430: INFO: Pod "azuredisk-volume-tester-lv7nh": Phase="Pending", Reason="", readiness=false. Elapsed: 4.17738499s
Jul 26 02:25:23.490: INFO: Pod "azuredisk-volume-tester-lv7nh": Phase="Pending", Reason="", readiness=false. Elapsed: 6.236796898s
Jul 26 02:25:25.548: INFO: Pod "azuredisk-volume-tester-lv7nh": Phase="Pending", Reason="", readiness=false. Elapsed: 8.295295594s
Jul 26 02:25:27.608: INFO: Pod "azuredisk-volume-tester-lv7nh": Phase="Pending", Reason="", readiness=false. Elapsed: 10.354600597s
... skipping 23 lines ...
Jul 26 02:26:17.054: INFO: Pod "azuredisk-volume-tester-lv7nh": Phase="Pending", Reason="", readiness=false. Elapsed: 59.801195281s
Jul 26 02:26:19.113: INFO: Pod "azuredisk-volume-tester-lv7nh": Phase="Pending", Reason="", readiness=false. Elapsed: 1m1.860440233s
Jul 26 02:26:21.173: INFO: Pod "azuredisk-volume-tester-lv7nh": Phase="Pending", Reason="", readiness=false. Elapsed: 1m3.920246598s
Jul 26 02:26:23.231: INFO: Pod "azuredisk-volume-tester-lv7nh": Phase="Pending", Reason="", readiness=false. Elapsed: 1m5.978392882s
Jul 26 02:26:25.292: INFO: Pod "azuredisk-volume-tester-lv7nh": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.03898643s
Jul 26 02:26:27.352: INFO: Pod "azuredisk-volume-tester-lv7nh": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.099263094s
Jul 26 02:26:29.412: INFO: Pod "azuredisk-volume-tester-lv7nh": Phase="Failed", Reason="", readiness=false. Elapsed: 1m12.158754379s
STEP: Saw pod failure
Jul 26 02:26:29.412: INFO: Pod "azuredisk-volume-tester-lv7nh" satisfied condition "Error status code"
STEP: checking that pod logs contain expected message
Jul 26 02:26:29.529: INFO: deleting Pod "azuredisk-9947"/"azuredisk-volume-tester-lv7nh"
Jul 26 02:26:29.591: INFO: Pod azuredisk-volume-tester-lv7nh has the following logs: touch: /mnt/test-1/data: Read-only file system

STEP: Deleting pod azuredisk-volume-tester-lv7nh in namespace azuredisk-9947
STEP: validating provisioned PV
... skipping 340 lines ...
STEP: setting up the StorageClass
STEP: creating a StorageClass 
STEP: setting up the PVC and PV
STEP: creating a PVC
STEP: setting up the pod
STEP: deploying the pod
STEP: checking that the pod's command exits with no error
Jul 26 02:35:12.852: INFO: Waiting up to 15m0s for pod "azuredisk-volume-tester-msw6c" in namespace "azuredisk-3721" to be "Succeeded or Failed"
Jul 26 02:35:12.910: INFO: Pod "azuredisk-volume-tester-msw6c": Phase="Pending", Reason="", readiness=false. Elapsed: 57.698725ms
Jul 26 02:35:14.969: INFO: Pod "azuredisk-volume-tester-msw6c": Phase="Pending", Reason="", readiness=false. Elapsed: 2.116243588s
Jul 26 02:35:17.029: INFO: Pod "azuredisk-volume-tester-msw6c": Phase="Pending", Reason="", readiness=false. Elapsed: 4.176365475s
Jul 26 02:35:19.089: INFO: Pod "azuredisk-volume-tester-msw6c": Phase="Pending", Reason="", readiness=false. Elapsed: 6.236307892s
Jul 26 02:35:21.146: INFO: Pod "azuredisk-volume-tester-msw6c": Phase="Pending", Reason="", readiness=false. Elapsed: 8.293943748s
Jul 26 02:35:23.208: INFO: Pod "azuredisk-volume-tester-msw6c": Phase="Pending", Reason="", readiness=false. Elapsed: 10.355892143s
Jul 26 02:35:25.267: INFO: Pod "azuredisk-volume-tester-msw6c": Phase="Pending", Reason="", readiness=false. Elapsed: 12.414675657s
Jul 26 02:35:27.327: INFO: Pod "azuredisk-volume-tester-msw6c": Phase="Pending", Reason="", readiness=false. Elapsed: 14.47493533s
Jul 26 02:35:29.390: INFO: Pod "azuredisk-volume-tester-msw6c": Phase="Pending", Reason="", readiness=false. Elapsed: 16.537677226s
Jul 26 02:35:31.450: INFO: Pod "azuredisk-volume-tester-msw6c": Phase="Pending", Reason="", readiness=false. Elapsed: 18.597277289s
Jul 26 02:35:33.509: INFO: Pod "azuredisk-volume-tester-msw6c": Phase="Pending", Reason="", readiness=false. Elapsed: 20.656576672s
Jul 26 02:35:35.566: INFO: Pod "azuredisk-volume-tester-msw6c": Phase="Succeeded", Reason="", readiness=false. Elapsed: 22.713775068s
STEP: Saw pod success
Jul 26 02:35:35.566: INFO: Pod "azuredisk-volume-tester-msw6c" satisfied condition "Succeeded or Failed"
STEP: cloning existing volume
STEP: setting up the PVC and PV
STEP: creating a PVC
STEP: setting up the pod
STEP: deploying a second pod with cloned volume
STEP: checking that the pod's command exits with no error
Jul 26 02:35:35.803: INFO: Waiting up to 15m0s for pod "azuredisk-volume-tester-hg4w2" in namespace "azuredisk-3721" to be "Succeeded or Failed"
Jul 26 02:35:35.860: INFO: Pod "azuredisk-volume-tester-hg4w2": Phase="Pending", Reason="", readiness=false. Elapsed: 56.904906ms
Jul 26 02:35:37.920: INFO: Pod "azuredisk-volume-tester-hg4w2": Phase="Pending", Reason="", readiness=false. Elapsed: 2.117590545s
Jul 26 02:35:39.981: INFO: Pod "azuredisk-volume-tester-hg4w2": Phase="Pending", Reason="", readiness=false. Elapsed: 4.178342547s
Jul 26 02:35:42.042: INFO: Pod "azuredisk-volume-tester-hg4w2": Phase="Pending", Reason="", readiness=false. Elapsed: 6.238835268s
Jul 26 02:35:44.101: INFO: Pod "azuredisk-volume-tester-hg4w2": Phase="Pending", Reason="", readiness=false. Elapsed: 8.298727313s
Jul 26 02:35:46.159: INFO: Pod "azuredisk-volume-tester-hg4w2": Phase="Pending", Reason="", readiness=false. Elapsed: 10.356660946s
Jul 26 02:35:48.219: INFO: Pod "azuredisk-volume-tester-hg4w2": Phase="Pending", Reason="", readiness=false. Elapsed: 12.416167943s
Jul 26 02:35:50.279: INFO: Pod "azuredisk-volume-tester-hg4w2": Phase="Pending", Reason="", readiness=false. Elapsed: 14.475994229s
Jul 26 02:35:52.338: INFO: Pod "azuredisk-volume-tester-hg4w2": Phase="Pending", Reason="", readiness=false. Elapsed: 16.534808794s
Jul 26 02:35:54.396: INFO: Pod "azuredisk-volume-tester-hg4w2": Phase="Pending", Reason="", readiness=false. Elapsed: 18.593632691s
Jul 26 02:35:56.466: INFO: Pod "azuredisk-volume-tester-hg4w2": Phase="Pending", Reason="", readiness=false. Elapsed: 20.663337134s
Jul 26 02:35:58.524: INFO: Pod "azuredisk-volume-tester-hg4w2": Phase="Succeeded", Reason="", readiness=false. Elapsed: 22.721412506s
STEP: Saw pod success
Jul 26 02:35:58.524: INFO: Pod "azuredisk-volume-tester-hg4w2" satisfied condition "Succeeded or Failed"
Jul 26 02:35:58.524: INFO: deleting Pod "azuredisk-3721"/"azuredisk-volume-tester-hg4w2"
Jul 26 02:35:58.635: INFO: Pod azuredisk-volume-tester-hg4w2 has the following logs: hello world

STEP: Deleting pod azuredisk-volume-tester-hg4w2 in namespace azuredisk-3721
STEP: validating provisioned PV
STEP: checking the PV
... skipping 53 lines ...
STEP: setting up the StorageClass
STEP: creating a StorageClass 
STEP: setting up the PVC and PV
STEP: creating a PVC
STEP: setting up the pod
STEP: deploying the pod
STEP: checking that the pod's command exits with no error
Jul 26 02:36:51.650: INFO: Waiting up to 15m0s for pod "azuredisk-volume-tester-q5pcv" in namespace "azuredisk-2888" to be "Succeeded or Failed"
Jul 26 02:36:51.705: INFO: Pod "azuredisk-volume-tester-q5pcv": Phase="Pending", Reason="", readiness=false. Elapsed: 54.65246ms
Jul 26 02:36:53.762: INFO: Pod "azuredisk-volume-tester-q5pcv": Phase="Pending", Reason="", readiness=false. Elapsed: 2.111713138s
Jul 26 02:36:55.817: INFO: Pod "azuredisk-volume-tester-q5pcv": Phase="Pending", Reason="", readiness=false. Elapsed: 4.166944486s
Jul 26 02:36:57.875: INFO: Pod "azuredisk-volume-tester-q5pcv": Phase="Pending", Reason="", readiness=false. Elapsed: 6.224654124s
Jul 26 02:36:59.931: INFO: Pod "azuredisk-volume-tester-q5pcv": Phase="Pending", Reason="", readiness=false. Elapsed: 8.28143398s
Jul 26 02:37:01.988: INFO: Pod "azuredisk-volume-tester-q5pcv": Phase="Pending", Reason="", readiness=false. Elapsed: 10.338254257s
Jul 26 02:37:04.045: INFO: Pod "azuredisk-volume-tester-q5pcv": Phase="Pending", Reason="", readiness=false. Elapsed: 12.395290154s
Jul 26 02:37:06.102: INFO: Pod "azuredisk-volume-tester-q5pcv": Phase="Pending", Reason="", readiness=false. Elapsed: 14.451815706s
Jul 26 02:37:08.159: INFO: Pod "azuredisk-volume-tester-q5pcv": Phase="Pending", Reason="", readiness=false. Elapsed: 16.50883993s
Jul 26 02:37:10.215: INFO: Pod "azuredisk-volume-tester-q5pcv": Phase="Pending", Reason="", readiness=false. Elapsed: 18.565377105s
Jul 26 02:37:12.276: INFO: Pod "azuredisk-volume-tester-q5pcv": Phase="Pending", Reason="", readiness=false. Elapsed: 20.625733895s
Jul 26 02:37:14.333: INFO: Pod "azuredisk-volume-tester-q5pcv": Phase="Succeeded", Reason="", readiness=false. Elapsed: 22.682928864s
STEP: Saw pod success
Jul 26 02:37:14.333: INFO: Pod "azuredisk-volume-tester-q5pcv" satisfied condition "Succeeded or Failed"
STEP: cloning existing volume
STEP: setting up the PVC and PV
STEP: creating a PVC
STEP: setting up the pod
STEP: deploying a second pod with cloned volume
STEP: checking that the pod's command exits with no error
Jul 26 02:37:14.571: INFO: Waiting up to 15m0s for pod "azuredisk-volume-tester-k7kx5" in namespace "azuredisk-2888" to be "Succeeded or Failed"
Jul 26 02:37:14.626: INFO: Pod "azuredisk-volume-tester-k7kx5": Phase="Pending", Reason="", readiness=false. Elapsed: 54.89133ms
Jul 26 02:37:16.682: INFO: Pod "azuredisk-volume-tester-k7kx5": Phase="Pending", Reason="", readiness=false. Elapsed: 2.110452932s
Jul 26 02:37:18.739: INFO: Pod "azuredisk-volume-tester-k7kx5": Phase="Pending", Reason="", readiness=false. Elapsed: 4.167738287s
Jul 26 02:37:20.796: INFO: Pod "azuredisk-volume-tester-k7kx5": Phase="Pending", Reason="", readiness=false. Elapsed: 6.225040795s
Jul 26 02:37:22.853: INFO: Pod "azuredisk-volume-tester-k7kx5": Phase="Pending", Reason="", readiness=false. Elapsed: 8.282058469s
Jul 26 02:37:24.909: INFO: Pod "azuredisk-volume-tester-k7kx5": Phase="Pending", Reason="", readiness=false. Elapsed: 10.338259977s
... skipping 9 lines ...
Jul 26 02:37:45.478: INFO: Pod "azuredisk-volume-tester-k7kx5": Phase="Pending", Reason="", readiness=false. Elapsed: 30.906726378s
Jul 26 02:37:47.535: INFO: Pod "azuredisk-volume-tester-k7kx5": Phase="Pending", Reason="", readiness=false. Elapsed: 32.964165202s
Jul 26 02:37:49.592: INFO: Pod "azuredisk-volume-tester-k7kx5": Phase="Pending", Reason="", readiness=false. Elapsed: 35.021065692s
Jul 26 02:37:51.649: INFO: Pod "azuredisk-volume-tester-k7kx5": Phase="Pending", Reason="", readiness=false. Elapsed: 37.07754522s
Jul 26 02:37:53.706: INFO: Pod "azuredisk-volume-tester-k7kx5": Phase="Succeeded", Reason="", readiness=false. Elapsed: 39.135255252s
STEP: Saw pod success
Jul 26 02:37:53.706: INFO: Pod "azuredisk-volume-tester-k7kx5" satisfied condition "Succeeded or Failed"
Jul 26 02:37:53.706: INFO: deleting Pod "azuredisk-2888"/"azuredisk-volume-tester-k7kx5"
Jul 26 02:37:53.765: INFO: Pod azuredisk-volume-tester-k7kx5 has the following logs: 20.0G

STEP: Deleting pod azuredisk-volume-tester-k7kx5 in namespace azuredisk-2888
STEP: validating provisioned PV
STEP: checking the PV
... skipping 63 lines ...
STEP: setting up the StorageClass
STEP: creating a StorageClass 
STEP: setting up the PVC and PV
STEP: creating a PVC
STEP: setting up the pod
STEP: deploying the pod
STEP: checking that the pod's command exits with no error
Jul 26 02:38:47.031: INFO: Waiting up to 15m0s for pod "azuredisk-volume-tester-jbkxt" in namespace "azuredisk-8510" to be "Succeeded or Failed"
Jul 26 02:38:47.086: INFO: Pod "azuredisk-volume-tester-jbkxt": Phase="Pending", Reason="", readiness=false. Elapsed: 54.845714ms
Jul 26 02:38:49.142: INFO: Pod "azuredisk-volume-tester-jbkxt": Phase="Pending", Reason="", readiness=false. Elapsed: 2.111444669s
Jul 26 02:38:51.199: INFO: Pod "azuredisk-volume-tester-jbkxt": Phase="Pending", Reason="", readiness=false. Elapsed: 4.168608928s
Jul 26 02:38:53.259: INFO: Pod "azuredisk-volume-tester-jbkxt": Phase="Pending", Reason="", readiness=false. Elapsed: 6.228454984s
Jul 26 02:38:55.320: INFO: Pod "azuredisk-volume-tester-jbkxt": Phase="Pending", Reason="", readiness=false. Elapsed: 8.288789421s
Jul 26 02:38:57.379: INFO: Pod "azuredisk-volume-tester-jbkxt": Phase="Pending", Reason="", readiness=false. Elapsed: 10.3476932s
... skipping 9 lines ...
Jul 26 02:39:17.977: INFO: Pod "azuredisk-volume-tester-jbkxt": Phase="Pending", Reason="", readiness=false. Elapsed: 30.945729379s
Jul 26 02:39:20.036: INFO: Pod "azuredisk-volume-tester-jbkxt": Phase="Pending", Reason="", readiness=false. Elapsed: 33.004969187s
Jul 26 02:39:22.095: INFO: Pod "azuredisk-volume-tester-jbkxt": Phase="Pending", Reason="", readiness=false. Elapsed: 35.063985115s
Jul 26 02:39:24.154: INFO: Pod "azuredisk-volume-tester-jbkxt": Phase="Pending", Reason="", readiness=false. Elapsed: 37.123323786s
Jul 26 02:39:26.214: INFO: Pod "azuredisk-volume-tester-jbkxt": Phase="Succeeded", Reason="", readiness=false. Elapsed: 39.183564355s
STEP: Saw pod success
Jul 26 02:39:26.214: INFO: Pod "azuredisk-volume-tester-jbkxt" satisfied condition "Succeeded or Failed"
Jul 26 02:39:26.214: INFO: deleting Pod "azuredisk-8510"/"azuredisk-volume-tester-jbkxt"
Jul 26 02:39:26.277: INFO: Pod azuredisk-volume-tester-jbkxt has the following logs: hello world
hello world
hello world

STEP: Deleting pod azuredisk-volume-tester-jbkxt in namespace azuredisk-8510
... skipping 71 lines ...
STEP: setting up the StorageClass
STEP: creating a StorageClass 
STEP: setting up the PVC and PV
STEP: creating a PVC
STEP: setting up the pod
STEP: deploying the pod
STEP: checking that the pod's command exits with no error
Jul 26 02:40:35.165: INFO: Waiting up to 15m0s for pod "azuredisk-volume-tester-vz7nm" in namespace "azuredisk-5561" to be "Succeeded or Failed"
Jul 26 02:40:35.223: INFO: Pod "azuredisk-volume-tester-vz7nm": Phase="Pending", Reason="", readiness=false. Elapsed: 57.724301ms
Jul 26 02:40:37.281: INFO: Pod "azuredisk-volume-tester-vz7nm": Phase="Pending", Reason="", readiness=false. Elapsed: 2.115814765s
Jul 26 02:40:39.341: INFO: Pod "azuredisk-volume-tester-vz7nm": Phase="Pending", Reason="", readiness=false. Elapsed: 4.176159968s
Jul 26 02:40:41.400: INFO: Pod "azuredisk-volume-tester-vz7nm": Phase="Pending", Reason="", readiness=false. Elapsed: 6.234922279s
Jul 26 02:40:43.459: INFO: Pod "azuredisk-volume-tester-vz7nm": Phase="Pending", Reason="", readiness=false. Elapsed: 8.293498424s
Jul 26 02:40:45.517: INFO: Pod "azuredisk-volume-tester-vz7nm": Phase="Pending", Reason="", readiness=false. Elapsed: 10.351560515s
... skipping 9 lines ...
Jul 26 02:41:06.116: INFO: Pod "azuredisk-volume-tester-vz7nm": Phase="Pending", Reason="", readiness=false. Elapsed: 30.950731856s
Jul 26 02:41:08.175: INFO: Pod "azuredisk-volume-tester-vz7nm": Phase="Pending", Reason="", readiness=false. Elapsed: 33.010135968s
Jul 26 02:41:10.235: INFO: Pod "azuredisk-volume-tester-vz7nm": Phase="Pending", Reason="", readiness=false. Elapsed: 35.070472265s
Jul 26 02:41:12.295: INFO: Pod "azuredisk-volume-tester-vz7nm": Phase="Pending", Reason="", readiness=false. Elapsed: 37.129613233s
Jul 26 02:41:14.365: INFO: Pod "azuredisk-volume-tester-vz7nm": Phase="Succeeded", Reason="", readiness=false. Elapsed: 39.199645374s
STEP: Saw pod success
Jul 26 02:41:14.365: INFO: Pod "azuredisk-volume-tester-vz7nm" satisfied condition "Succeeded or Failed"
Jul 26 02:41:14.365: INFO: deleting Pod "azuredisk-5561"/"azuredisk-volume-tester-vz7nm"
Jul 26 02:41:14.476: INFO: Pod azuredisk-volume-tester-vz7nm has the following logs: 100+0 records in
100+0 records out
104857600 bytes (100.0MB) copied, 0.082174 seconds, 1.2GB/s
hello world

... skipping 53 lines ...
Jul 26 02:42:07.639: INFO: >>> kubeConfig: /root/tmp834005565/kubeconfig/kubeconfig.westus2.json
STEP: setting up the StorageClass
STEP: creating a StorageClass 
STEP: setting up the PVC and PV
STEP: creating a PVC
STEP: deploying the pod
STEP: checking that the pod's command exits with no error
Jul 26 02:42:07.819: INFO: Waiting up to 15m0s for pod "azuredisk-volume-tester-klzpv" in namespace "azuredisk-4376" to be "Succeeded or Failed"
Jul 26 02:42:07.877: INFO: Pod "azuredisk-volume-tester-klzpv": Phase="Pending", Reason="", readiness=false. Elapsed: 57.264884ms
Jul 26 02:42:09.937: INFO: Pod "azuredisk-volume-tester-klzpv": Phase="Pending", Reason="", readiness=false. Elapsed: 2.117396503s
Jul 26 02:42:11.997: INFO: Pod "azuredisk-volume-tester-klzpv": Phase="Pending", Reason="", readiness=false. Elapsed: 4.1775186s
Jul 26 02:42:14.056: INFO: Pod "azuredisk-volume-tester-klzpv": Phase="Pending", Reason="", readiness=false. Elapsed: 6.236949575s
Jul 26 02:42:16.116: INFO: Pod "azuredisk-volume-tester-klzpv": Phase="Pending", Reason="", readiness=false. Elapsed: 8.296798984s
Jul 26 02:42:18.176: INFO: Pod "azuredisk-volume-tester-klzpv": Phase="Pending", Reason="", readiness=false. Elapsed: 10.357159603s
Jul 26 02:42:20.236: INFO: Pod "azuredisk-volume-tester-klzpv": Phase="Pending", Reason="", readiness=false. Elapsed: 12.416762457s
Jul 26 02:42:22.299: INFO: Pod "azuredisk-volume-tester-klzpv": Phase="Pending", Reason="", readiness=false. Elapsed: 14.479284616s
Jul 26 02:42:24.359: INFO: Pod "azuredisk-volume-tester-klzpv": Phase="Pending", Reason="", readiness=false. Elapsed: 16.53924335s
Jul 26 02:42:26.418: INFO: Pod "azuredisk-volume-tester-klzpv": Phase="Pending", Reason="", readiness=false. Elapsed: 18.598190837s
Jul 26 02:42:28.479: INFO: Pod "azuredisk-volume-tester-klzpv": Phase="Pending", Reason="", readiness=false. Elapsed: 20.659251741s
Jul 26 02:42:30.537: INFO: Pod "azuredisk-volume-tester-klzpv": Phase="Succeeded", Reason="", readiness=false. Elapsed: 22.717413837s
STEP: Saw pod success
Jul 26 02:42:30.537: INFO: Pod "azuredisk-volume-tester-klzpv" satisfied condition "Succeeded or Failed"
STEP: Checking Prow test resource group
2021/07/26 02:42:30 Running in Prow, converting AZURE_CREDENTIALS to AZURE_CREDENTIAL_FILE
2021/07/26 02:42:30 Reading credentials file /etc/azure-cred/credentials
STEP: Prow test resource group: kubetest-nnvuhiyw
STEP: Creating external resource group: azuredisk-csi-driver-test-1f56cf52-edbb-11eb-9a0b-6215e7e98ebc
STEP: creating volume snapshot class with external rg azuredisk-csi-driver-test-1f56cf52-edbb-11eb-9a0b-6215e7e98ebc
... skipping 5 lines ...
STEP: setting up the StorageClass
STEP: creating a StorageClass 
STEP: setting up the PVC and PV
STEP: creating a PVC
STEP: setting up the pod
STEP: deploying a pod with a volume restored from the snapshot
STEP: checking that the pod's command exits with no error
Jul 26 02:42:47.110: INFO: Waiting up to 15m0s for pod "azuredisk-volume-tester-scl55" in namespace "azuredisk-4376" to be "Succeeded or Failed"
Jul 26 02:42:47.168: INFO: Pod "azuredisk-volume-tester-scl55": Phase="Pending", Reason="", readiness=false. Elapsed: 58.216474ms
Jul 26 02:42:49.228: INFO: Pod "azuredisk-volume-tester-scl55": Phase="Pending", Reason="", readiness=false. Elapsed: 2.118083557s
Jul 26 02:42:51.287: INFO: Pod "azuredisk-volume-tester-scl55": Phase="Pending", Reason="", readiness=false. Elapsed: 4.177164886s
Jul 26 02:42:53.347: INFO: Pod "azuredisk-volume-tester-scl55": Phase="Pending", Reason="", readiness=false. Elapsed: 6.236934421s
Jul 26 02:42:55.407: INFO: Pod "azuredisk-volume-tester-scl55": Phase="Pending", Reason="", readiness=false. Elapsed: 8.296472097s
Jul 26 02:42:57.467: INFO: Pod "azuredisk-volume-tester-scl55": Phase="Pending", Reason="", readiness=false. Elapsed: 10.356971629s
Jul 26 02:42:59.527: INFO: Pod "azuredisk-volume-tester-scl55": Phase="Pending", Reason="", readiness=false. Elapsed: 12.416836945s
Jul 26 02:43:01.587: INFO: Pod "azuredisk-volume-tester-scl55": Phase="Pending", Reason="", readiness=false. Elapsed: 14.476882404s
Jul 26 02:43:03.648: INFO: Pod "azuredisk-volume-tester-scl55": Phase="Pending", Reason="", readiness=false. Elapsed: 16.537261728s
Jul 26 02:43:05.707: INFO: Pod "azuredisk-volume-tester-scl55": Phase="Pending", Reason="", readiness=false. Elapsed: 18.597063892s
Jul 26 02:43:07.766: INFO: Pod "azuredisk-volume-tester-scl55": Phase="Pending", Reason="", readiness=false. Elapsed: 20.655657033s
Jul 26 02:43:09.825: INFO: Pod "azuredisk-volume-tester-scl55": Phase="Succeeded", Reason="", readiness=false. Elapsed: 22.715016586s
STEP: Saw pod success
Jul 26 02:43:09.825: INFO: Pod "azuredisk-volume-tester-scl55" satisfied condition "Succeeded or Failed"
Jul 26 02:43:09.825: INFO: deleting Pod "azuredisk-4376"/"azuredisk-volume-tester-scl55"
Jul 26 02:43:09.934: INFO: Pod azuredisk-volume-tester-scl55 has the following logs: hello world

STEP: Deleting pod azuredisk-volume-tester-scl55 in namespace azuredisk-4376
STEP: validating provisioned PV
STEP: checking the PV
... skipping 56 lines ...
Jul 26 02:44:49.346: INFO: >>> kubeConfig: /root/tmp834005565/kubeconfig/kubeconfig.westus2.json
STEP: setting up the StorageClass
STEP: creating a StorageClass 
STEP: setting up the PVC and PV
STEP: creating a PVC
STEP: deploying the pod
STEP: checking that the pod's command exits with no error
Jul 26 02:44:49.530: INFO: Waiting up to 15m0s for pod "azuredisk-volume-tester-sr7c5" in namespace "azuredisk-1577" to be "Succeeded or Failed"
Jul 26 02:44:49.587: INFO: Pod "azuredisk-volume-tester-sr7c5": Phase="Pending", Reason="", readiness=false. Elapsed: 57.287247ms
Jul 26 02:44:51.646: INFO: Pod "azuredisk-volume-tester-sr7c5": Phase="Pending", Reason="", readiness=false. Elapsed: 2.116279785s
Jul 26 02:44:53.705: INFO: Pod "azuredisk-volume-tester-sr7c5": Phase="Pending", Reason="", readiness=false. Elapsed: 4.175116349s
Jul 26 02:44:55.764: INFO: Pod "azuredisk-volume-tester-sr7c5": Phase="Pending", Reason="", readiness=false. Elapsed: 6.234158956s
Jul 26 02:44:57.825: INFO: Pod "azuredisk-volume-tester-sr7c5": Phase="Pending", Reason="", readiness=false. Elapsed: 8.294927547s
Jul 26 02:44:59.884: INFO: Pod "azuredisk-volume-tester-sr7c5": Phase="Pending", Reason="", readiness=false. Elapsed: 10.353832482s
... skipping 2 lines ...
Jul 26 02:45:06.066: INFO: Pod "azuredisk-volume-tester-sr7c5": Phase="Pending", Reason="", readiness=false. Elapsed: 16.536026102s
Jul 26 02:45:08.127: INFO: Pod "azuredisk-volume-tester-sr7c5": Phase="Pending", Reason="", readiness=false. Elapsed: 18.597238418s
Jul 26 02:45:10.188: INFO: Pod "azuredisk-volume-tester-sr7c5": Phase="Pending", Reason="", readiness=false. Elapsed: 20.657426384s
Jul 26 02:45:12.248: INFO: Pod "azuredisk-volume-tester-sr7c5": Phase="Pending", Reason="", readiness=false. Elapsed: 22.717424502s
Jul 26 02:45:14.307: INFO: Pod "azuredisk-volume-tester-sr7c5": Phase="Succeeded", Reason="", readiness=false. Elapsed: 24.776578217s
STEP: Saw pod success
Jul 26 02:45:14.307: INFO: Pod "azuredisk-volume-tester-sr7c5" satisfied condition "Succeeded or Failed"
STEP: Checking Prow test resource group
2021/07/26 02:45:14 Running in Prow, converting AZURE_CREDENTIALS to AZURE_CREDENTIAL_FILE
2021/07/26 02:45:14 Reading credentials file /etc/azure-cred/credentials
STEP: Prow test resource group: kubetest-nnvuhiyw
STEP: Creating external resource group: azuredisk-csi-driver-test-80f41c26-edbb-11eb-9a0b-6215e7e98ebc
STEP: creating volume snapshot class with external rg azuredisk-csi-driver-test-80f41c26-edbb-11eb-9a0b-6215e7e98ebc
STEP: setting up the VolumeSnapshotClass
STEP: creating a VolumeSnapshotClass
STEP: taking snapshots
STEP: creating a VolumeSnapshot for pvc-fvg9s
STEP: deploying a new pod to overwrite pv data
STEP: checking that the pod's command exits with no error
Jul 26 02:45:15.435: INFO: Waiting up to 15m0s for pod "azuredisk-volume-tester-7d4nz" in namespace "azuredisk-1577" to be "Succeeded or Failed"
Jul 26 02:45:15.502: INFO: Pod "azuredisk-volume-tester-7d4nz": Phase="Pending", Reason="", readiness=false. Elapsed: 67.071162ms
Jul 26 02:45:17.563: INFO: Pod "azuredisk-volume-tester-7d4nz": Phase="Pending", Reason="", readiness=false. Elapsed: 2.127770166s
Jul 26 02:45:19.624: INFO: Pod "azuredisk-volume-tester-7d4nz": Phase="Pending", Reason="", readiness=false. Elapsed: 4.188438041s
Jul 26 02:45:21.683: INFO: Pod "azuredisk-volume-tester-7d4nz": Phase="Pending", Reason="", readiness=false. Elapsed: 6.247854844s
Jul 26 02:45:23.742: INFO: Pod "azuredisk-volume-tester-7d4nz": Phase="Pending", Reason="", readiness=false. Elapsed: 8.307201981s
Jul 26 02:45:25.804: INFO: Pod "azuredisk-volume-tester-7d4nz": Phase="Pending", Reason="", readiness=false. Elapsed: 10.368741504s
... skipping 8 lines ...
Jul 26 02:45:44.338: INFO: Pod "azuredisk-volume-tester-7d4nz": Phase="Pending", Reason="", readiness=false. Elapsed: 28.902878426s
Jul 26 02:45:46.403: INFO: Pod "azuredisk-volume-tester-7d4nz": Phase="Pending", Reason="", readiness=false. Elapsed: 30.96728234s
Jul 26 02:45:48.462: INFO: Pod "azuredisk-volume-tester-7d4nz": Phase="Pending", Reason="", readiness=false. Elapsed: 33.027001108s
Jul 26 02:45:50.522: INFO: Pod "azuredisk-volume-tester-7d4nz": Phase="Pending", Reason="", readiness=false. Elapsed: 35.086314939s
Jul 26 02:45:52.581: INFO: Pod "azuredisk-volume-tester-7d4nz": Phase="Succeeded", Reason="", readiness=false. Elapsed: 37.146084301s
STEP: Saw pod success
Jul 26 02:45:52.581: INFO: Pod "azuredisk-volume-tester-7d4nz" satisfied condition "Succeeded or Failed"
STEP: waiting for VolumeSnapshot to be ready to use - volume-snapshot-8lf95
STEP: setting up the StorageClass
STEP: creating a StorageClass 
STEP: setting up the PVC and PV
STEP: creating a PVC
STEP: setting up the pod
STEP: deploying a pod with a volume restored from the snapshot
STEP: checking that the pod's command exits with no error
Jul 26 02:46:07.829: INFO: Waiting up to 15m0s for pod "azuredisk-volume-tester-g2ks6" in namespace "azuredisk-1577" to be "Succeeded or Failed"
Jul 26 02:46:07.886: INFO: Pod "azuredisk-volume-tester-g2ks6": Phase="Pending", Reason="", readiness=false. Elapsed: 57.202118ms
Jul 26 02:46:09.944: INFO: Pod "azuredisk-volume-tester-g2ks6": Phase="Pending", Reason="", readiness=false. Elapsed: 2.115171448s
Jul 26 02:46:12.004: INFO: Pod "azuredisk-volume-tester-g2ks6": Phase="Pending", Reason="", readiness=false. Elapsed: 4.175492225s
Jul 26 02:46:14.065: INFO: Pod "azuredisk-volume-tester-g2ks6": Phase="Pending", Reason="", readiness=false. Elapsed: 6.236611448s
Jul 26 02:46:16.126: INFO: Pod "azuredisk-volume-tester-g2ks6": Phase="Pending", Reason="", readiness=false. Elapsed: 8.297113485s
Jul 26 02:46:18.185: INFO: Pod "azuredisk-volume-tester-g2ks6": Phase="Pending", Reason="", readiness=false. Elapsed: 10.356606131s
Jul 26 02:46:20.247: INFO: Pod "azuredisk-volume-tester-g2ks6": Phase="Pending", Reason="", readiness=false. Elapsed: 12.418128366s
Jul 26 02:46:22.309: INFO: Pod "azuredisk-volume-tester-g2ks6": Phase="Pending", Reason="", readiness=false. Elapsed: 14.480395345s
Jul 26 02:46:24.367: INFO: Pod "azuredisk-volume-tester-g2ks6": Phase="Pending", Reason="", readiness=false. Elapsed: 16.538114892s
Jul 26 02:46:26.426: INFO: Pod "azuredisk-volume-tester-g2ks6": Phase="Pending", Reason="", readiness=false. Elapsed: 18.59704725s
Jul 26 02:46:28.485: INFO: Pod "azuredisk-volume-tester-g2ks6": Phase="Pending", Reason="", readiness=false. Elapsed: 20.656490942s
Jul 26 02:46:30.544: INFO: Pod "azuredisk-volume-tester-g2ks6": Phase="Succeeded", Reason="", readiness=false. Elapsed: 22.715827904s
STEP: Saw pod success
Jul 26 02:46:30.545: INFO: Pod "azuredisk-volume-tester-g2ks6" satisfied condition "Succeeded or Failed"
Jul 26 02:46:30.545: INFO: deleting Pod "azuredisk-1577"/"azuredisk-volume-tester-g2ks6"
Jul 26 02:46:30.657: INFO: Pod azuredisk-volume-tester-g2ks6 has the following logs: hello world

STEP: Deleting pod azuredisk-volume-tester-g2ks6 in namespace azuredisk-1577
STEP: validating provisioned PV
STEP: checking the PV
... skipping 67 lines ...
STEP: creating a PVC
STEP: setting up the StorageClass
STEP: creating a StorageClass 
STEP: setting up the PVC and PV
STEP: creating a PVC
STEP: deploying the pod
STEP: checking that the pod's command exits with no error
Jul 26 02:48:11.039: INFO: Waiting up to 15m0s for pod "azuredisk-volume-tester-d65wb" in namespace "azuredisk-953" to be "Succeeded or Failed"
Jul 26 02:48:11.096: INFO: Pod "azuredisk-volume-tester-d65wb": Phase="Pending", Reason="", readiness=false. Elapsed: 56.953633ms
Jul 26 02:48:13.156: INFO: Pod "azuredisk-volume-tester-d65wb": Phase="Pending", Reason="", readiness=false. Elapsed: 2.117054926s
Jul 26 02:48:15.215: INFO: Pod "azuredisk-volume-tester-d65wb": Phase="Pending", Reason="", readiness=false. Elapsed: 4.175859889s
Jul 26 02:48:17.275: INFO: Pod "azuredisk-volume-tester-d65wb": Phase="Pending", Reason="", readiness=false. Elapsed: 6.23562419s
Jul 26 02:48:19.336: INFO: Pod "azuredisk-volume-tester-d65wb": Phase="Pending", Reason="", readiness=false. Elapsed: 8.296426977s
Jul 26 02:48:21.394: INFO: Pod "azuredisk-volume-tester-d65wb": Phase="Pending", Reason="", readiness=false. Elapsed: 10.355360195s
... skipping 9 lines ...
Jul 26 02:48:41.984: INFO: Pod "azuredisk-volume-tester-d65wb": Phase="Pending", Reason="", readiness=false. Elapsed: 30.944738498s
Jul 26 02:48:44.041: INFO: Pod "azuredisk-volume-tester-d65wb": Phase="Pending", Reason="", readiness=false. Elapsed: 33.002025587s
Jul 26 02:48:46.098: INFO: Pod "azuredisk-volume-tester-d65wb": Phase="Pending", Reason="", readiness=false. Elapsed: 35.058846337s
Jul 26 02:48:48.160: INFO: Pod "azuredisk-volume-tester-d65wb": Phase="Pending", Reason="", readiness=false. Elapsed: 37.120909634s
Jul 26 02:48:50.216: INFO: Pod "azuredisk-volume-tester-d65wb": Phase="Succeeded", Reason="", readiness=false. Elapsed: 39.177350883s
STEP: Saw pod success
Jul 26 02:48:50.217: INFO: Pod "azuredisk-volume-tester-d65wb" satisfied condition "Succeeded or Failed"
Jul 26 02:48:50.217: INFO: deleting Pod "azuredisk-953"/"azuredisk-volume-tester-d65wb"
Jul 26 02:48:50.284: INFO: Pod azuredisk-volume-tester-d65wb has the following logs: hello world

STEP: Deleting pod azuredisk-volume-tester-d65wb in namespace azuredisk-953
STEP: validating provisioned PV
STEP: checking the PV
... skipping 460 lines ...
Go Version: go1.16.6
Platform: linux/amd64
Topology Key: topology.disk.csi.azure.com/zone

Streaming logs below:
I0726 02:18:53.212196       1 azure.go:62] reading cloud config from secret
E0726 02:18:53.237575       1 azure_config.go:45] Failed to get cloud-config from secret: failed to get secret kube-system/azure-cloud-provider: secrets "azure-cloud-provider" not found
I0726 02:18:53.237601       1 azure.go:65] InitializeCloudFromSecret failed with error: InitializeCloudFromSecret: failed to get cloud config from secret kube-system/azure-cloud-provider: failed to get secret kube-system/azure-cloud-provider: secrets "azure-cloud-provider" not found
I0726 02:18:53.237608       1 azure.go:70] could not read cloud config from secret
I0726 02:18:53.237618       1 azure.go:81] use default AZURE_CREDENTIAL_FILE env var: /etc/kubernetes/azure.json
I0726 02:18:53.237642       1 azure.go:92] read cloud config from file: /etc/kubernetes/azure.json successfully
I0726 02:18:53.238339       1 azure_auth.go:234] Using AzurePublicCloud environment
I0726 02:18:53.238386       1 azure_auth.go:119] azure: using client_id+client_secret to retrieve access token
I0726 02:18:53.238409       1 azure.go:678] Azure cloudprovider using try backoff: retries=6, exponent=1.500000, duration=5, jitter=1.000000
... skipping 83 lines ...
I0726 02:18:54.325953       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerGetCapabilities
I0726 02:18:54.325967       1 utils.go:96] GRPC request: {}
I0726 02:18:54.326005       1 utils.go:102] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":9}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":10}}}]}
I0726 02:19:02.008641       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I0726 02:19:02.008711       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}],"requisite":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}]},"capacity_range":{"required_bytes":1073741824000},"name":"pvc-ace30453-eb7d-464a-aab4-8bbbbe73b3ae","parameters":{"csi.storage.k8s.io/pv/name":"pvc-ace30453-eb7d-464a-aab4-8bbbbe73b3ae","csi.storage.k8s.io/pvc/name":"pvc-8spxj","csi.storage.k8s.io/pvc/namespace":"azuredisk-8081","networkAccessPolicy":"AllowAll","skuName":"StandardSSD_ZRS"},"volume_capabilities":[{"AccessType":{"Mount":{"mount_flags":["barrier=1","acl"]}},"access_mode":{"mode":1}}]}
I0726 02:19:02.009354       1 controllerserver.go:253] diskZone(westus2-2) is reset as empty since disk(pvc-ace30453-eb7d-464a-aab4-8bbbbe73b3ae) is ZRS(StandardSSD_ZRS)
I0726 02:19:02.662076       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-ace30453-eb7d-464a-aab4-8bbbbe73b3ae, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-ace30453-eb7d-464a-aab4-8bbbbe73b3ae' under resource group 'kubetest-nnvuhiyw' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I0726 02:19:02.662214       1 controllerserver.go:290] begin to create azure disk(pvc-ace30453-eb7d-464a-aab4-8bbbbe73b3ae) account type(StandardSSD_ZRS) rg(kubetest-nnvuhiyw) location() size(1000) diskZone() maxShares(0)
I0726 02:19:02.662254       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-ace30453-eb7d-464a-aab4-8bbbbe73b3ae StorageAccountType:StandardSSD_ZRS Size:1000
I0726 02:19:05.054585       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-ace30453-eb7d-464a-aab4-8bbbbe73b3ae StorageAccountType:StandardSSD_ZRS Size:1000
I0726 02:19:05.054624       1 controllerserver.go:366] create azure disk(pvc-ace30453-eb7d-464a-aab4-8bbbbe73b3ae) account type(StandardSSD_ZRS) rg(kubetest-nnvuhiyw) location() size(1000) tags(map[kubernetes.io-created-for-pv-name:pvc-ace30453-eb7d-464a-aab4-8bbbbe73b3ae kubernetes.io-created-for-pvc-name:pvc-8spxj kubernetes.io-created-for-pvc-namespace:azuredisk-8081]) successfully
I0726 02:19:05.054659       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-1"}},{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2"}},{"segments":{"topology.disk.csi.azure.com/zone":"westus2-3"}},{"segments":{"topology.disk.csi.azure.com/zone":""}}],"capacity_bytes":1073741824000,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-ace30453-eb7d-464a-aab4-8bbbbe73b3ae","csi.storage.k8s.io/pvc/name":"pvc-8spxj","csi.storage.k8s.io/pvc/namespace":"azuredisk-8081","networkAccessPolicy":"AllowAll","requestedsizegib":"1000","skuName":"StandardSSD_ZRS"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-ace30453-eb7d-464a-aab4-8bbbbe73b3ae"}}
I0726 02:19:06.051877       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 2 lines ...
I0726 02:19:06.086112       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:19:06.181084       1 controllerserver.go:479] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-ace30453-eb7d-464a-aab4-8bbbbe73b3ae" to node "k8s-agentpool-31268889-vmss000001"
I0726 02:19:06.181274       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:19:06.181321       1 azure_controller_common.go:233] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-ace30453-eb7d-464a-aab4-8bbbbe73b3ae" lun 0 to node "k8s-agentpool-31268889-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-ace30453-eb7d-464a-aab4-8bbbbe73b3ae:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-ace30453-eb7d-464a-aab4-8bbbbe73b3ae  true false 0})]
I0726 02:19:06.181390       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:19:06.181454       1 azure_controller_vmss.go:120] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-ace30453-eb7d-464a-aab4-8bbbbe73b3ae:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-ace30453-eb7d-464a-aab4-8bbbbe73b3ae  true false 0})])
I0726 02:19:16.700552       1 azure_controller_vmss.go:132] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-ace30453-eb7d-464a-aab4-8bbbbe73b3ae:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-ace30453-eb7d-464a-aab4-8bbbbe73b3ae  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I0726 02:19:16.700651       1 controllerserver.go:483] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-ace30453-eb7d-464a-aab4-8bbbbe73b3ae" attached to node "k8s-agentpool-31268889-vmss000001".
I0726 02:19:16.700682       1 controllerserver.go:503] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-ace30453-eb7d-464a-aab4-8bbbbe73b3ae" to node "k8s-agentpool-31268889-vmss000001" successfully
I0726 02:19:16.700723       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
I0726 02:19:43.756050       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerUnpublishVolume
I0726 02:19:43.756069       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool-31268889-vmss000001","volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-ace30453-eb7d-464a-aab4-8bbbbe73b3ae"}
I0726 02:19:43.756206       1 controllerserver.go:535] Trying to detach volume /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-ace30453-eb7d-464a-aab4-8bbbbe73b3ae from node k8s-agentpool-31268889-vmss000001
... skipping 12 lines ...
I0726 02:20:06.414459       1 controllerserver.go:407] deleting azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-ace30453-eb7d-464a-aab4-8bbbbe73b3ae)
I0726 02:20:11.625085       1 azure_managedDiskController.go:288] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-ace30453-eb7d-464a-aab4-8bbbbe73b3ae
I0726 02:20:11.625122       1 controllerserver.go:409] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-ace30453-eb7d-464a-aab4-8bbbbe73b3ae) returned with <nil>
I0726 02:20:11.625155       1 utils.go:102] GRPC response: {}
I0726 02:20:17.644637       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I0726 02:20:17.644741       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-1","topology.kubernetes.io/zone":"westus2-1"}},{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}],"requisite":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-1","topology.kubernetes.io/zone":"westus2-1"}},{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}]},"capacity_range":{"required_bytes":10737418240},"name":"pvc-4ec0f1ef-4f7a-4326-95bd-9f4a3af0a6eb","parameters":{"csi.storage.k8s.io/pv/name":"pvc-4ec0f1ef-4f7a-4326-95bd-9f4a3af0a6eb","csi.storage.k8s.io/pvc/name":"pvc-mfbpp","csi.storage.k8s.io/pvc/namespace":"azuredisk-1318","networkAccessPolicy":"DenyAll","skuName":"Standard_LRS"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":1}}]}
I0726 02:20:17.665007       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-4ec0f1ef-4f7a-4326-95bd-9f4a3af0a6eb, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-4ec0f1ef-4f7a-4326-95bd-9f4a3af0a6eb' under resource group 'kubetest-nnvuhiyw' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I0726 02:20:17.665067       1 controllerserver.go:290] begin to create azure disk(pvc-4ec0f1ef-4f7a-4326-95bd-9f4a3af0a6eb) account type(Standard_LRS) rg(kubetest-nnvuhiyw) location() size(10) diskZone(westus2-1) maxShares(0)
I0726 02:20:17.665089       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-4ec0f1ef-4f7a-4326-95bd-9f4a3af0a6eb StorageAccountType:Standard_LRS Size:10
I0726 02:20:19.965514       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-4ec0f1ef-4f7a-4326-95bd-9f4a3af0a6eb StorageAccountType:Standard_LRS Size:10
I0726 02:20:19.965555       1 controllerserver.go:366] create azure disk(pvc-4ec0f1ef-4f7a-4326-95bd-9f4a3af0a6eb) account type(Standard_LRS) rg(kubetest-nnvuhiyw) location() size(10) tags(map[kubernetes.io-created-for-pv-name:pvc-4ec0f1ef-4f7a-4326-95bd-9f4a3af0a6eb kubernetes.io-created-for-pvc-name:pvc-mfbpp kubernetes.io-created-for-pvc-namespace:azuredisk-1318]) successfully
I0726 02:20:19.965607       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-1"}}],"capacity_bytes":10737418240,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-4ec0f1ef-4f7a-4326-95bd-9f4a3af0a6eb","csi.storage.k8s.io/pvc/name":"pvc-mfbpp","csi.storage.k8s.io/pvc/namespace":"azuredisk-1318","networkAccessPolicy":"DenyAll","requestedsizegib":"10","skuName":"Standard_LRS"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-4ec0f1ef-4f7a-4326-95bd-9f4a3af0a6eb"}}
I0726 02:20:22.088904       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 2 lines ...
I0726 02:20:22.113187       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:20:22.113214       1 controllerserver.go:479] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-4ec0f1ef-4f7a-4326-95bd-9f4a3af0a6eb" to node "k8s-agentpool-31268889-vmss000000"
I0726 02:20:22.113237       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:20:22.113259       1 azure_controller_common.go:233] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-4ec0f1ef-4f7a-4326-95bd-9f4a3af0a6eb" lun 0 to node "k8s-agentpool-31268889-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-4ec0f1ef-4f7a-4326-95bd-9f4a3af0a6eb:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-4ec0f1ef-4f7a-4326-95bd-9f4a3af0a6eb  true false 0})]
I0726 02:20:22.113299       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:20:22.113322       1 azure_controller_vmss.go:120] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-4ec0f1ef-4f7a-4326-95bd-9f4a3af0a6eb:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-4ec0f1ef-4f7a-4326-95bd-9f4a3af0a6eb  true false 0})])
I0726 02:20:32.362172       1 azure_controller_vmss.go:132] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-4ec0f1ef-4f7a-4326-95bd-9f4a3af0a6eb:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-4ec0f1ef-4f7a-4326-95bd-9f4a3af0a6eb  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I0726 02:20:32.362253       1 controllerserver.go:483] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-4ec0f1ef-4f7a-4326-95bd-9f4a3af0a6eb" attached to node "k8s-agentpool-31268889-vmss000000".
I0726 02:20:32.362288       1 controllerserver.go:503] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-4ec0f1ef-4f7a-4326-95bd-9f4a3af0a6eb" to node "k8s-agentpool-31268889-vmss000000" successfully
I0726 02:20:32.362338       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
I0726 02:20:43.756996       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerUnpublishVolume
I0726 02:20:43.757010       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool-31268889-vmss000000","volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-4ec0f1ef-4f7a-4326-95bd-9f4a3af0a6eb"}
I0726 02:20:43.757131       1 controllerserver.go:535] Trying to detach volume /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-4ec0f1ef-4f7a-4326-95bd-9f4a3af0a6eb from node k8s-agentpool-31268889-vmss000000
... skipping 12 lines ...
I0726 02:20:59.928422       1 controllerserver.go:407] deleting azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-4ec0f1ef-4f7a-4326-95bd-9f4a3af0a6eb)
I0726 02:21:05.120467       1 azure_managedDiskController.go:288] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-4ec0f1ef-4f7a-4326-95bd-9f4a3af0a6eb
I0726 02:21:05.120509       1 controllerserver.go:409] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-4ec0f1ef-4f7a-4326-95bd-9f4a3af0a6eb) returned with <nil>
I0726 02:21:05.120535       1 utils.go:102] GRPC response: {}
I0726 02:21:07.032180       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I0726 02:21:07.032257       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}],"requisite":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}]},"capacity_range":{"required_bytes":1099511627776},"name":"pvc-1f999711-7175-433f-baf5-381d480e97d2","parameters":{"csi.storage.k8s.io/pv/name":"pvc-1f999711-7175-433f-baf5-381d480e97d2","csi.storage.k8s.io/pvc/name":"pvc-7vrlc","csi.storage.k8s.io/pvc/namespace":"azuredisk-694","enableBursting":"true","perfProfile":"Basic","skuName":"Premium_LRS"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":1}}]}
I0726 02:21:07.052693       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-1f999711-7175-433f-baf5-381d480e97d2, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-1f999711-7175-433f-baf5-381d480e97d2' under resource group 'kubetest-nnvuhiyw' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I0726 02:21:07.052789       1 controllerserver.go:290] begin to create azure disk(pvc-1f999711-7175-433f-baf5-381d480e97d2) account type(Premium_LRS) rg(kubetest-nnvuhiyw) location() size(1024) diskZone(westus2-2) maxShares(0)
I0726 02:21:07.052826       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-1f999711-7175-433f-baf5-381d480e97d2 StorageAccountType:Premium_LRS Size:1024
I0726 02:21:09.339274       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-1f999711-7175-433f-baf5-381d480e97d2 StorageAccountType:Premium_LRS Size:1024
I0726 02:21:09.339335       1 controllerserver.go:366] create azure disk(pvc-1f999711-7175-433f-baf5-381d480e97d2) account type(Premium_LRS) rg(kubetest-nnvuhiyw) location() size(1024) tags(map[kubernetes.io-created-for-pv-name:pvc-1f999711-7175-433f-baf5-381d480e97d2 kubernetes.io-created-for-pvc-name:pvc-7vrlc kubernetes.io-created-for-pvc-namespace:azuredisk-694]) successfully
I0726 02:21:09.339376       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2"}}],"capacity_bytes":1099511627776,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-1f999711-7175-433f-baf5-381d480e97d2","csi.storage.k8s.io/pvc/name":"pvc-7vrlc","csi.storage.k8s.io/pvc/namespace":"azuredisk-694","enableBursting":"true","perfProfile":"Basic","requestedsizegib":"1024","skuName":"Premium_LRS"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-1f999711-7175-433f-baf5-381d480e97d2"}}
I0726 02:21:10.071436       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 2 lines ...
I0726 02:21:10.092533       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:21:10.092581       1 controllerserver.go:479] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-1f999711-7175-433f-baf5-381d480e97d2" to node "k8s-agentpool-31268889-vmss000001"
I0726 02:21:10.092628       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:21:10.092670       1 azure_controller_common.go:233] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-1f999711-7175-433f-baf5-381d480e97d2" lun 0 to node "k8s-agentpool-31268889-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-1f999711-7175-433f-baf5-381d480e97d2:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-1f999711-7175-433f-baf5-381d480e97d2  true false 0})]
I0726 02:21:10.092762       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:21:10.092839       1 azure_controller_vmss.go:120] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-1f999711-7175-433f-baf5-381d480e97d2:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-1f999711-7175-433f-baf5-381d480e97d2  true false 0})])
I0726 02:21:20.382506       1 azure_controller_vmss.go:132] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-1f999711-7175-433f-baf5-381d480e97d2:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-1f999711-7175-433f-baf5-381d480e97d2  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I0726 02:21:20.382611       1 controllerserver.go:483] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-1f999711-7175-433f-baf5-381d480e97d2" attached to node "k8s-agentpool-31268889-vmss000001".
I0726 02:21:20.382853       1 controllerserver.go:503] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-1f999711-7175-433f-baf5-381d480e97d2" to node "k8s-agentpool-31268889-vmss000001" successfully
I0726 02:21:20.382930       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
I0726 02:21:20.393105       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
I0726 02:21:20.393416       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool-31268889-vmss000001","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":1}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-1f999711-7175-433f-baf5-381d480e97d2","csi.storage.k8s.io/pvc/name":"pvc-7vrlc","csi.storage.k8s.io/pvc/namespace":"azuredisk-694","enableBursting":"true","perfProfile":"Basic","requestedsizegib":"1024","skuName":"Premium_LRS","storage.kubernetes.io/csiProvisionerIdentity":"1627265933331-8081-disk.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-1f999711-7175-433f-baf5-381d480e97d2"}
I0726 02:21:20.415133       1 controllerserver.go:458] GetDiskLun returned: <nil>. Initiating attaching volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-1f999711-7175-433f-baf5-381d480e97d2" to node "k8s-agentpool-31268889-vmss000001".
... skipping 33 lines ...
I0726 02:23:12.093519       1 azure_managedDiskController.go:288] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-1f999711-7175-433f-baf5-381d480e97d2
I0726 02:23:12.093557       1 controllerserver.go:409] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-1f999711-7175-433f-baf5-381d480e97d2) returned with <nil>
I0726 02:23:12.093582       1 utils.go:102] GRPC response: {}
I0726 02:23:18.190726       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I0726 02:23:18.190750       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}],"requisite":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}]},"capacity_range":{"required_bytes":10737418240},"name":"pvc-6f4c29a1-b748-4d4a-bfdc-4a0b12f24030","parameters":{"csi.storage.k8s.io/pv/name":"pvc-6f4c29a1-b748-4d4a-bfdc-4a0b12f24030","csi.storage.k8s.io/pvc/name":"pvc-rnwpx","csi.storage.k8s.io/pvc/namespace":"azuredisk-3274","skuName":"StandardSSD_ZRS"},"volume_capabilities":[{"AccessType":{"Mount":{"mount_flags":["invalid","mount","options"]}},"access_mode":{"mode":1}}]}
I0726 02:23:18.190981       1 controllerserver.go:253] diskZone(westus2-2) is reset as empty since disk(pvc-6f4c29a1-b748-4d4a-bfdc-4a0b12f24030) is ZRS(StandardSSD_ZRS)
I0726 02:23:18.211951       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-6f4c29a1-b748-4d4a-bfdc-4a0b12f24030, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-6f4c29a1-b748-4d4a-bfdc-4a0b12f24030' under resource group 'kubetest-nnvuhiyw' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I0726 02:23:18.212053       1 controllerserver.go:290] begin to create azure disk(pvc-6f4c29a1-b748-4d4a-bfdc-4a0b12f24030) account type(StandardSSD_ZRS) rg(kubetest-nnvuhiyw) location() size(10) diskZone() maxShares(0)
I0726 02:23:18.212093       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-6f4c29a1-b748-4d4a-bfdc-4a0b12f24030 StorageAccountType:StandardSSD_ZRS Size:10
I0726 02:23:20.596054       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-6f4c29a1-b748-4d4a-bfdc-4a0b12f24030 StorageAccountType:StandardSSD_ZRS Size:10
I0726 02:23:20.596119       1 controllerserver.go:366] create azure disk(pvc-6f4c29a1-b748-4d4a-bfdc-4a0b12f24030) account type(StandardSSD_ZRS) rg(kubetest-nnvuhiyw) location() size(10) tags(map[kubernetes.io-created-for-pv-name:pvc-6f4c29a1-b748-4d4a-bfdc-4a0b12f24030 kubernetes.io-created-for-pvc-name:pvc-rnwpx kubernetes.io-created-for-pvc-namespace:azuredisk-3274]) successfully
I0726 02:23:20.596322       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-1"}},{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2"}},{"segments":{"topology.disk.csi.azure.com/zone":"westus2-3"}},{"segments":{"topology.disk.csi.azure.com/zone":""}}],"capacity_bytes":10737418240,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-6f4c29a1-b748-4d4a-bfdc-4a0b12f24030","csi.storage.k8s.io/pvc/name":"pvc-rnwpx","csi.storage.k8s.io/pvc/namespace":"azuredisk-3274","requestedsizegib":"10","skuName":"StandardSSD_ZRS"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-6f4c29a1-b748-4d4a-bfdc-4a0b12f24030"}}
I0726 02:23:21.279636       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 3 lines ...
I0726 02:23:21.301828       1 azure_vmss.go:186] Couldn't find VMSS VM with nodeName k8s-agentpool-31268889-vmss000001, refreshing the cache
I0726 02:23:21.372331       1 controllerserver.go:479] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-6f4c29a1-b748-4d4a-bfdc-4a0b12f24030" to node "k8s-agentpool-31268889-vmss000001"
I0726 02:23:21.372376       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:23:21.372405       1 azure_controller_common.go:233] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-6f4c29a1-b748-4d4a-bfdc-4a0b12f24030" lun 0 to node "k8s-agentpool-31268889-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-6f4c29a1-b748-4d4a-bfdc-4a0b12f24030:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-6f4c29a1-b748-4d4a-bfdc-4a0b12f24030  true false 0})]
I0726 02:23:21.372448       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:23:21.372474       1 azure_controller_vmss.go:120] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-6f4c29a1-b748-4d4a-bfdc-4a0b12f24030:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-6f4c29a1-b748-4d4a-bfdc-4a0b12f24030  true false 0})])
I0726 02:23:31.621187       1 azure_controller_vmss.go:132] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-6f4c29a1-b748-4d4a-bfdc-4a0b12f24030:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-6f4c29a1-b748-4d4a-bfdc-4a0b12f24030  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I0726 02:23:31.621528       1 controllerserver.go:483] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-6f4c29a1-b748-4d4a-bfdc-4a0b12f24030" attached to node "k8s-agentpool-31268889-vmss000001".
I0726 02:23:31.621577       1 controllerserver.go:503] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-6f4c29a1-b748-4d4a-bfdc-4a0b12f24030" to node "k8s-agentpool-31268889-vmss000001" successfully
I0726 02:23:31.621739       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
I0726 02:23:53.879966       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerUnpublishVolume
I0726 02:23:53.879989       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool-31268889-vmss000001","volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-6f4c29a1-b748-4d4a-bfdc-4a0b12f24030"}
I0726 02:23:53.880106       1 controllerserver.go:535] Trying to detach volume /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-6f4c29a1-b748-4d4a-bfdc-4a0b12f24030 from node k8s-agentpool-31268889-vmss000001
... skipping 26 lines ...
I0726 02:24:21.689352       1 azure_managedDiskController.go:288] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-6f4c29a1-b748-4d4a-bfdc-4a0b12f24030
I0726 02:24:21.689381       1 controllerserver.go:409] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-6f4c29a1-b748-4d4a-bfdc-4a0b12f24030) returned with <nil>
I0726 02:24:21.689402       1 utils.go:102] GRPC response: {}
I0726 02:24:28.071870       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I0726 02:24:28.071892       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}],"requisite":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}]},"capacity_range":{"required_bytes":10737418240},"name":"pvc-a72d876b-b928-495b-901d-ce351979cf73","parameters":{"csi.storage.k8s.io/pv/name":"pvc-a72d876b-b928-495b-901d-ce351979cf73","csi.storage.k8s.io/pvc/name":"pvc-w62nx","csi.storage.k8s.io/pvc/namespace":"azuredisk-495","skuName":"StandardSSD_ZRS"},"volume_capabilities":[{"AccessType":{"Block":{}},"access_mode":{"mode":1}}]}
I0726 02:24:28.072134       1 controllerserver.go:253] diskZone(westus2-2) is reset as empty since disk(pvc-a72d876b-b928-495b-901d-ce351979cf73) is ZRS(StandardSSD_ZRS)
I0726 02:24:28.093626       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-a72d876b-b928-495b-901d-ce351979cf73, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-a72d876b-b928-495b-901d-ce351979cf73' under resource group 'kubetest-nnvuhiyw' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I0726 02:24:28.093677       1 controllerserver.go:290] begin to create azure disk(pvc-a72d876b-b928-495b-901d-ce351979cf73) account type(StandardSSD_ZRS) rg(kubetest-nnvuhiyw) location() size(10) diskZone() maxShares(0)
I0726 02:24:28.093697       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-a72d876b-b928-495b-901d-ce351979cf73 StorageAccountType:StandardSSD_ZRS Size:10
I0726 02:24:30.473284       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-a72d876b-b928-495b-901d-ce351979cf73 StorageAccountType:StandardSSD_ZRS Size:10
I0726 02:24:30.473338       1 controllerserver.go:366] create azure disk(pvc-a72d876b-b928-495b-901d-ce351979cf73) account type(StandardSSD_ZRS) rg(kubetest-nnvuhiyw) location() size(10) tags(map[kubernetes.io-created-for-pv-name:pvc-a72d876b-b928-495b-901d-ce351979cf73 kubernetes.io-created-for-pvc-name:pvc-w62nx kubernetes.io-created-for-pvc-namespace:azuredisk-495]) successfully
I0726 02:24:30.473368       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-1"}},{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2"}},{"segments":{"topology.disk.csi.azure.com/zone":"westus2-3"}},{"segments":{"topology.disk.csi.azure.com/zone":""}}],"capacity_bytes":10737418240,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-a72d876b-b928-495b-901d-ce351979cf73","csi.storage.k8s.io/pvc/name":"pvc-w62nx","csi.storage.k8s.io/pvc/namespace":"azuredisk-495","requestedsizegib":"10","skuName":"StandardSSD_ZRS"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-a72d876b-b928-495b-901d-ce351979cf73"}}
I0726 02:24:31.136929       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 3 lines ...
I0726 02:24:31.181111       1 azure_vmss.go:186] Couldn't find VMSS VM with nodeName k8s-agentpool-31268889-vmss000001, refreshing the cache
I0726 02:24:31.238769       1 controllerserver.go:479] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-a72d876b-b928-495b-901d-ce351979cf73" to node "k8s-agentpool-31268889-vmss000001"
I0726 02:24:31.238827       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:24:31.239019       1 azure_controller_common.go:233] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-a72d876b-b928-495b-901d-ce351979cf73" lun 0 to node "k8s-agentpool-31268889-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-a72d876b-b928-495b-901d-ce351979cf73:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-a72d876b-b928-495b-901d-ce351979cf73  true false 0})]
I0726 02:24:31.239063       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:24:31.239210       1 azure_controller_vmss.go:120] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-a72d876b-b928-495b-901d-ce351979cf73:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-a72d876b-b928-495b-901d-ce351979cf73  true false 0})])
I0726 02:24:46.518372       1 azure_controller_vmss.go:132] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-a72d876b-b928-495b-901d-ce351979cf73:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-a72d876b-b928-495b-901d-ce351979cf73  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I0726 02:24:46.518441       1 controllerserver.go:483] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-a72d876b-b928-495b-901d-ce351979cf73" attached to node "k8s-agentpool-31268889-vmss000001".
I0726 02:24:46.518462       1 controllerserver.go:503] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-a72d876b-b928-495b-901d-ce351979cf73" to node "k8s-agentpool-31268889-vmss000001" successfully
I0726 02:24:46.518487       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
I0726 02:24:46.526424       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
I0726 02:24:46.526439       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool-31268889-vmss000001","volume_capability":{"AccessType":{"Block":{}},"access_mode":{"mode":1}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-a72d876b-b928-495b-901d-ce351979cf73","csi.storage.k8s.io/pvc/name":"pvc-w62nx","csi.storage.k8s.io/pvc/namespace":"azuredisk-495","requestedsizegib":"10","skuName":"StandardSSD_ZRS","storage.kubernetes.io/csiProvisionerIdentity":"1627265933331-8081-disk.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-a72d876b-b928-495b-901d-ce351979cf73"}
I0726 02:24:46.548210       1 controllerserver.go:458] GetDiskLun returned: <nil>. Initiating attaching volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-a72d876b-b928-495b-901d-ce351979cf73" to node "k8s-agentpool-31268889-vmss000001".
... skipping 20 lines ...
I0726 02:25:15.373419       1 azure_managedDiskController.go:288] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-a72d876b-b928-495b-901d-ce351979cf73
I0726 02:25:15.373443       1 controllerserver.go:409] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-a72d876b-b928-495b-901d-ce351979cf73) returned with <nil>
I0726 02:25:15.373461       1 utils.go:102] GRPC response: {}
I0726 02:25:17.239619       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I0726 02:25:17.239705       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}],"requisite":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}]},"capacity_range":{"required_bytes":10737418240},"name":"pvc-5485e2ca-a453-45e6-b6dc-45a2194e4672","parameters":{"csi.storage.k8s.io/pv/name":"pvc-5485e2ca-a453-45e6-b6dc-45a2194e4672","csi.storage.k8s.io/pvc/name":"pvc-jmnfq","csi.storage.k8s.io/pvc/namespace":"azuredisk-9947","skuName":"Premium_ZRS"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":1}}]}
I0726 02:25:17.239974       1 controllerserver.go:253] diskZone(westus2-2) is reset as empty since disk(pvc-5485e2ca-a453-45e6-b6dc-45a2194e4672) is ZRS(Premium_ZRS)
I0726 02:25:17.261375       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-5485e2ca-a453-45e6-b6dc-45a2194e4672, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-5485e2ca-a453-45e6-b6dc-45a2194e4672' under resource group 'kubetest-nnvuhiyw' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I0726 02:25:17.261459       1 controllerserver.go:290] begin to create azure disk(pvc-5485e2ca-a453-45e6-b6dc-45a2194e4672) account type(Premium_ZRS) rg(kubetest-nnvuhiyw) location() size(10) diskZone() maxShares(0)
I0726 02:25:17.261630       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-5485e2ca-a453-45e6-b6dc-45a2194e4672 StorageAccountType:Premium_ZRS Size:10
I0726 02:25:19.517399       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-5485e2ca-a453-45e6-b6dc-45a2194e4672 StorageAccountType:Premium_ZRS Size:10
I0726 02:25:19.517464       1 controllerserver.go:366] create azure disk(pvc-5485e2ca-a453-45e6-b6dc-45a2194e4672) account type(Premium_ZRS) rg(kubetest-nnvuhiyw) location() size(10) tags(map[kubernetes.io-created-for-pv-name:pvc-5485e2ca-a453-45e6-b6dc-45a2194e4672 kubernetes.io-created-for-pvc-name:pvc-jmnfq kubernetes.io-created-for-pvc-namespace:azuredisk-9947]) successfully
I0726 02:25:19.517506       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-1"}},{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2"}},{"segments":{"topology.disk.csi.azure.com/zone":"westus2-3"}},{"segments":{"topology.disk.csi.azure.com/zone":""}}],"capacity_bytes":10737418240,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-5485e2ca-a453-45e6-b6dc-45a2194e4672","csi.storage.k8s.io/pvc/name":"pvc-jmnfq","csi.storage.k8s.io/pvc/namespace":"azuredisk-9947","requestedsizegib":"10","skuName":"Premium_ZRS"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-5485e2ca-a453-45e6-b6dc-45a2194e4672"}}
I0726 02:25:20.310293       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 3 lines ...
I0726 02:25:20.332420       1 azure_vmss.go:186] Couldn't find VMSS VM with nodeName k8s-agentpool-31268889-vmss000001, refreshing the cache
I0726 02:25:20.397849       1 controllerserver.go:479] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-5485e2ca-a453-45e6-b6dc-45a2194e4672" to node "k8s-agentpool-31268889-vmss000001"
I0726 02:25:20.397888       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:25:20.397910       1 azure_controller_common.go:233] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-5485e2ca-a453-45e6-b6dc-45a2194e4672" lun 0 to node "k8s-agentpool-31268889-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-5485e2ca-a453-45e6-b6dc-45a2194e4672:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-5485e2ca-a453-45e6-b6dc-45a2194e4672  true false 0})]
I0726 02:25:20.398059       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:25:20.398150       1 azure_controller_vmss.go:120] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-5485e2ca-a453-45e6-b6dc-45a2194e4672:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-5485e2ca-a453-45e6-b6dc-45a2194e4672  true false 0})])
I0726 02:25:55.726619       1 azure_controller_vmss.go:132] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-5485e2ca-a453-45e6-b6dc-45a2194e4672:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-5485e2ca-a453-45e6-b6dc-45a2194e4672  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I0726 02:25:55.726734       1 controllerserver.go:483] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-5485e2ca-a453-45e6-b6dc-45a2194e4672" attached to node "k8s-agentpool-31268889-vmss000001".
I0726 02:25:55.726769       1 controllerserver.go:503] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-5485e2ca-a453-45e6-b6dc-45a2194e4672" to node "k8s-agentpool-31268889-vmss000001" successfully
I0726 02:25:55.726802       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
I0726 02:25:55.739726       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
I0726 02:25:55.739775       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool-31268889-vmss000001","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":1}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-5485e2ca-a453-45e6-b6dc-45a2194e4672","csi.storage.k8s.io/pvc/name":"pvc-jmnfq","csi.storage.k8s.io/pvc/namespace":"azuredisk-9947","requestedsizegib":"10","skuName":"Premium_ZRS","storage.kubernetes.io/csiProvisionerIdentity":"1627265933331-8081-disk.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-5485e2ca-a453-45e6-b6dc-45a2194e4672"}
I0726 02:25:55.771780       1 controllerserver.go:458] GetDiskLun returned: <nil>. Initiating attaching volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-5485e2ca-a453-45e6-b6dc-45a2194e4672" to node "k8s-agentpool-31268889-vmss000001".
... skipping 20 lines ...
I0726 02:27:06.004371       1 azure_managedDiskController.go:288] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-5485e2ca-a453-45e6-b6dc-45a2194e4672
I0726 02:27:06.004401       1 controllerserver.go:409] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-5485e2ca-a453-45e6-b6dc-45a2194e4672) returned with <nil>
I0726 02:27:06.004424       1 utils.go:102] GRPC response: {}
I0726 02:27:12.101257       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I0726 02:27:12.101280       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}],"requisite":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}]},"capacity_range":{"required_bytes":10737418240},"name":"pvc-d1bfa541-db9f-493a-ae31-41b666523cf8","parameters":{"csi.storage.k8s.io/pv/name":"pvc-d1bfa541-db9f-493a-ae31-41b666523cf8","csi.storage.k8s.io/pvc/name":"pvc-kkl2n","csi.storage.k8s.io/pvc/namespace":"azuredisk-5541","skuName":"StandardSSD_ZRS"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":1}}]}
I0726 02:27:12.101587       1 controllerserver.go:253] diskZone(westus2-2) is reset as empty since disk(pvc-d1bfa541-db9f-493a-ae31-41b666523cf8) is ZRS(StandardSSD_ZRS)
I0726 02:27:12.120670       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-d1bfa541-db9f-493a-ae31-41b666523cf8, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-d1bfa541-db9f-493a-ae31-41b666523cf8' under resource group 'kubetest-nnvuhiyw' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I0726 02:27:12.120752       1 controllerserver.go:290] begin to create azure disk(pvc-d1bfa541-db9f-493a-ae31-41b666523cf8) account type(StandardSSD_ZRS) rg(kubetest-nnvuhiyw) location() size(10) diskZone() maxShares(0)
I0726 02:27:12.120780       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-d1bfa541-db9f-493a-ae31-41b666523cf8 StorageAccountType:StandardSSD_ZRS Size:10
I0726 02:27:14.419833       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-d1bfa541-db9f-493a-ae31-41b666523cf8 StorageAccountType:StandardSSD_ZRS Size:10
I0726 02:27:14.419867       1 controllerserver.go:366] create azure disk(pvc-d1bfa541-db9f-493a-ae31-41b666523cf8) account type(StandardSSD_ZRS) rg(kubetest-nnvuhiyw) location() size(10) tags(map[kubernetes.io-created-for-pv-name:pvc-d1bfa541-db9f-493a-ae31-41b666523cf8 kubernetes.io-created-for-pvc-name:pvc-kkl2n kubernetes.io-created-for-pvc-namespace:azuredisk-5541]) successfully
I0726 02:27:14.419928       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-1"}},{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2"}},{"segments":{"topology.disk.csi.azure.com/zone":"westus2-3"}},{"segments":{"topology.disk.csi.azure.com/zone":""}}],"capacity_bytes":10737418240,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-d1bfa541-db9f-493a-ae31-41b666523cf8","csi.storage.k8s.io/pvc/name":"pvc-kkl2n","csi.storage.k8s.io/pvc/namespace":"azuredisk-5541","requestedsizegib":"10","skuName":"StandardSSD_ZRS"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-d1bfa541-db9f-493a-ae31-41b666523cf8"}}
I0726 02:27:15.157135       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 3 lines ...
I0726 02:27:15.196834       1 azure_vmss.go:186] Couldn't find VMSS VM with nodeName k8s-agentpool-31268889-vmss000001, refreshing the cache
I0726 02:27:15.262639       1 controllerserver.go:479] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-d1bfa541-db9f-493a-ae31-41b666523cf8" to node "k8s-agentpool-31268889-vmss000001"
I0726 02:27:15.262700       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:27:15.262851       1 azure_controller_common.go:233] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-d1bfa541-db9f-493a-ae31-41b666523cf8" lun 0 to node "k8s-agentpool-31268889-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-d1bfa541-db9f-493a-ae31-41b666523cf8:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-d1bfa541-db9f-493a-ae31-41b666523cf8  true false 0})]
I0726 02:27:15.262906       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:27:15.262991       1 azure_controller_vmss.go:120] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-d1bfa541-db9f-493a-ae31-41b666523cf8:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-d1bfa541-db9f-493a-ae31-41b666523cf8  true false 0})])
I0726 02:27:25.555611       1 azure_controller_vmss.go:132] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-d1bfa541-db9f-493a-ae31-41b666523cf8:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-d1bfa541-db9f-493a-ae31-41b666523cf8  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I0726 02:27:25.555673       1 controllerserver.go:483] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-d1bfa541-db9f-493a-ae31-41b666523cf8" attached to node "k8s-agentpool-31268889-vmss000001".
I0726 02:27:25.555693       1 controllerserver.go:503] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-d1bfa541-db9f-493a-ae31-41b666523cf8" to node "k8s-agentpool-31268889-vmss000001" successfully
I0726 02:27:25.555724       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
I0726 02:27:25.562614       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
I0726 02:27:25.562640       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool-31268889-vmss000001","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":1}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-d1bfa541-db9f-493a-ae31-41b666523cf8","csi.storage.k8s.io/pvc/name":"pvc-kkl2n","csi.storage.k8s.io/pvc/namespace":"azuredisk-5541","requestedsizegib":"10","skuName":"StandardSSD_ZRS","storage.kubernetes.io/csiProvisionerIdentity":"1627265933331-8081-disk.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-d1bfa541-db9f-493a-ae31-41b666523cf8"}
I0726 02:27:25.583658       1 controllerserver.go:458] GetDiskLun returned: <nil>. Initiating attaching volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-d1bfa541-db9f-493a-ae31-41b666523cf8" to node "k8s-agentpool-31268889-vmss000001".
... skipping 2 lines ...
I0726 02:27:25.648775       1 azure_controller_common.go:425] azureDisk - find disk: lun 0 name "pvc-d1bfa541-db9f-493a-ae31-41b666523cf8" uri "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-d1bfa541-db9f-493a-ae31-41b666523cf8"
I0726 02:27:25.648829       1 controllerserver.go:473] Attach operation is successful. volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-d1bfa541-db9f-493a-ae31-41b666523cf8" is already attached to node "k8s-agentpool-31268889-vmss000001" at lun 0.
I0726 02:27:25.648866       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
I0726 02:27:36.385356       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I0726 02:27:36.385385       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}],"requisite":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}]},"capacity_range":{"required_bytes":10737418240},"name":"pvc-bb0f7ac6-99ef-4a6e-8d15-43dad1eb7a46","parameters":{"csi.storage.k8s.io/pv/name":"pvc-bb0f7ac6-99ef-4a6e-8d15-43dad1eb7a46","csi.storage.k8s.io/pvc/name":"pvc-wnz5p","csi.storage.k8s.io/pvc/namespace":"azuredisk-5541","skuName":"StandardSSD_ZRS"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":1}}]}
I0726 02:27:36.385665       1 controllerserver.go:253] diskZone(westus2-2) is reset as empty since disk(pvc-bb0f7ac6-99ef-4a6e-8d15-43dad1eb7a46) is ZRS(StandardSSD_ZRS)
I0726 02:27:36.405695       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-bb0f7ac6-99ef-4a6e-8d15-43dad1eb7a46, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-bb0f7ac6-99ef-4a6e-8d15-43dad1eb7a46' under resource group 'kubetest-nnvuhiyw' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I0726 02:27:36.405757       1 controllerserver.go:290] begin to create azure disk(pvc-bb0f7ac6-99ef-4a6e-8d15-43dad1eb7a46) account type(StandardSSD_ZRS) rg(kubetest-nnvuhiyw) location() size(10) diskZone() maxShares(0)
I0726 02:27:36.405779       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-bb0f7ac6-99ef-4a6e-8d15-43dad1eb7a46 StorageAccountType:StandardSSD_ZRS Size:10
I0726 02:27:38.660775       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-bb0f7ac6-99ef-4a6e-8d15-43dad1eb7a46 StorageAccountType:StandardSSD_ZRS Size:10
I0726 02:27:38.660826       1 controllerserver.go:366] create azure disk(pvc-bb0f7ac6-99ef-4a6e-8d15-43dad1eb7a46) account type(StandardSSD_ZRS) rg(kubetest-nnvuhiyw) location() size(10) tags(map[kubernetes.io-created-for-pv-name:pvc-bb0f7ac6-99ef-4a6e-8d15-43dad1eb7a46 kubernetes.io-created-for-pvc-name:pvc-wnz5p kubernetes.io-created-for-pvc-namespace:azuredisk-5541]) successfully
I0726 02:27:38.660859       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-1"}},{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2"}},{"segments":{"topology.disk.csi.azure.com/zone":"westus2-3"}},{"segments":{"topology.disk.csi.azure.com/zone":""}}],"capacity_bytes":10737418240,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-bb0f7ac6-99ef-4a6e-8d15-43dad1eb7a46","csi.storage.k8s.io/pvc/name":"pvc-wnz5p","csi.storage.k8s.io/pvc/namespace":"azuredisk-5541","requestedsizegib":"10","skuName":"StandardSSD_ZRS"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-bb0f7ac6-99ef-4a6e-8d15-43dad1eb7a46"}}
I0726 02:27:39.457054       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 2 lines ...
I0726 02:27:39.480605       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:27:39.480931       1 controllerserver.go:479] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-bb0f7ac6-99ef-4a6e-8d15-43dad1eb7a46" to node "k8s-agentpool-31268889-vmss000001"
I0726 02:27:39.481115       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:27:39.481299       1 azure_controller_common.go:233] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-bb0f7ac6-99ef-4a6e-8d15-43dad1eb7a46" lun 1 to node "k8s-agentpool-31268889-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-bb0f7ac6-99ef-4a6e-8d15-43dad1eb7a46:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-bb0f7ac6-99ef-4a6e-8d15-43dad1eb7a46  true false 1})]
I0726 02:27:39.481349       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:27:39.481390       1 azure_controller_vmss.go:120] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-bb0f7ac6-99ef-4a6e-8d15-43dad1eb7a46:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-bb0f7ac6-99ef-4a6e-8d15-43dad1eb7a46  true false 1})])
I0726 02:27:49.728128       1 azure_controller_vmss.go:132] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-bb0f7ac6-99ef-4a6e-8d15-43dad1eb7a46:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-bb0f7ac6-99ef-4a6e-8d15-43dad1eb7a46  true false 1})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I0726 02:27:49.728231       1 controllerserver.go:483] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-bb0f7ac6-99ef-4a6e-8d15-43dad1eb7a46" attached to node "k8s-agentpool-31268889-vmss000001".
I0726 02:27:49.728266       1 controllerserver.go:503] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-bb0f7ac6-99ef-4a6e-8d15-43dad1eb7a46" to node "k8s-agentpool-31268889-vmss000001" successfully
I0726 02:27:49.728307       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"1"}}
I0726 02:27:55.030967       1 azure_vmss.go:282] Couldn't find VMSS VM with scaleSetName "k8s-agentpool-31268889-vmss" and instanceID "1", refreshing the cache
I0726 02:28:00.672351       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I0726 02:28:00.672373       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-1","topology.kubernetes.io/zone":"westus2-1"}}],"requisite":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-1","topology.kubernetes.io/zone":"westus2-1"}}]},"capacity_range":{"required_bytes":10737418240},"name":"pvc-089de5f1-5d21-4353-ac9e-c49f0d1df80a","parameters":{"csi.storage.k8s.io/pv/name":"pvc-089de5f1-5d21-4353-ac9e-c49f0d1df80a","csi.storage.k8s.io/pvc/name":"pvc-8w84q","csi.storage.k8s.io/pvc/namespace":"azuredisk-5541","skuName":"StandardSSD_ZRS"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":1}}]}
I0726 02:28:00.672672       1 controllerserver.go:253] diskZone(westus2-1) is reset as empty since disk(pvc-089de5f1-5d21-4353-ac9e-c49f0d1df80a) is ZRS(StandardSSD_ZRS)
I0726 02:28:00.692191       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-089de5f1-5d21-4353-ac9e-c49f0d1df80a, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-089de5f1-5d21-4353-ac9e-c49f0d1df80a' under resource group 'kubetest-nnvuhiyw' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I0726 02:28:00.692285       1 controllerserver.go:290] begin to create azure disk(pvc-089de5f1-5d21-4353-ac9e-c49f0d1df80a) account type(StandardSSD_ZRS) rg(kubetest-nnvuhiyw) location() size(10) diskZone() maxShares(0)
I0726 02:28:00.692328       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-089de5f1-5d21-4353-ac9e-c49f0d1df80a StorageAccountType:StandardSSD_ZRS Size:10
I0726 02:28:02.958285       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-089de5f1-5d21-4353-ac9e-c49f0d1df80a StorageAccountType:StandardSSD_ZRS Size:10
I0726 02:28:02.958355       1 controllerserver.go:366] create azure disk(pvc-089de5f1-5d21-4353-ac9e-c49f0d1df80a) account type(StandardSSD_ZRS) rg(kubetest-nnvuhiyw) location() size(10) tags(map[kubernetes.io-created-for-pv-name:pvc-089de5f1-5d21-4353-ac9e-c49f0d1df80a kubernetes.io-created-for-pvc-name:pvc-8w84q kubernetes.io-created-for-pvc-namespace:azuredisk-5541]) successfully
I0726 02:28:02.958394       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-1"}},{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2"}},{"segments":{"topology.disk.csi.azure.com/zone":"westus2-3"}},{"segments":{"topology.disk.csi.azure.com/zone":""}}],"capacity_bytes":10737418240,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-089de5f1-5d21-4353-ac9e-c49f0d1df80a","csi.storage.k8s.io/pvc/name":"pvc-8w84q","csi.storage.k8s.io/pvc/namespace":"azuredisk-5541","requestedsizegib":"10","skuName":"StandardSSD_ZRS"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-089de5f1-5d21-4353-ac9e-c49f0d1df80a"}}
I0726 02:28:03.737559       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 2 lines ...
I0726 02:28:03.758662       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:28:03.758695       1 controllerserver.go:479] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-089de5f1-5d21-4353-ac9e-c49f0d1df80a" to node "k8s-agentpool-31268889-vmss000000"
I0726 02:28:03.758723       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:28:03.758756       1 azure_controller_common.go:233] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-089de5f1-5d21-4353-ac9e-c49f0d1df80a" lun 0 to node "k8s-agentpool-31268889-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-089de5f1-5d21-4353-ac9e-c49f0d1df80a:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-089de5f1-5d21-4353-ac9e-c49f0d1df80a  true false 0})]
I0726 02:28:03.758783       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:28:03.758811       1 azure_controller_vmss.go:120] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-089de5f1-5d21-4353-ac9e-c49f0d1df80a:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-089de5f1-5d21-4353-ac9e-c49f0d1df80a  true false 0})])
I0726 02:28:14.000505       1 azure_controller_vmss.go:132] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-089de5f1-5d21-4353-ac9e-c49f0d1df80a:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-089de5f1-5d21-4353-ac9e-c49f0d1df80a  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I0726 02:28:14.000617       1 controllerserver.go:483] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-089de5f1-5d21-4353-ac9e-c49f0d1df80a" attached to node "k8s-agentpool-31268889-vmss000000".
I0726 02:28:14.000652       1 controllerserver.go:503] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-089de5f1-5d21-4353-ac9e-c49f0d1df80a" to node "k8s-agentpool-31268889-vmss000000" successfully
I0726 02:28:14.000726       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
I0726 02:28:14.013011       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
I0726 02:28:14.013032       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool-31268889-vmss000000","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":1}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-089de5f1-5d21-4353-ac9e-c49f0d1df80a","csi.storage.k8s.io/pvc/name":"pvc-8w84q","csi.storage.k8s.io/pvc/namespace":"azuredisk-5541","requestedsizegib":"10","skuName":"StandardSSD_ZRS","storage.kubernetes.io/csiProvisionerIdentity":"1627265933331-8081-disk.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-089de5f1-5d21-4353-ac9e-c49f0d1df80a"}
I0726 02:28:14.037350       1 controllerserver.go:458] GetDiskLun returned: <nil>. Initiating attaching volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-089de5f1-5d21-4353-ac9e-c49f0d1df80a" to node "k8s-agentpool-31268889-vmss000000".
... skipping 41 lines ...
I0726 02:30:29.550318       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
E0726 02:30:29.550346       1 azure_controller_vmss.go:173] detach azure disk on node(k8s-agentpool-31268889-vmss000001): disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-bb0f7ac6-99ef-4a6e-8d15-43dad1eb7a46:pvc-bb0f7ac6-99ef-4a6e-8d15-43dad1eb7a46]) not found
I0726 02:30:29.550359       1 azure_controller_vmss.go:203] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - detach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-bb0f7ac6-99ef-4a6e-8d15-43dad1eb7a46:pvc-bb0f7ac6-99ef-4a6e-8d15-43dad1eb7a46])
I0726 02:30:30.519464       1 utils.go:95] GRPC call: /csi.v1.Controller/DeleteVolume
I0726 02:30:30.519495       1 utils.go:96] GRPC request: {"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-bb0f7ac6-99ef-4a6e-8d15-43dad1eb7a46"}
I0726 02:30:30.519599       1 controllerserver.go:407] deleting azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-bb0f7ac6-99ef-4a6e-8d15-43dad1eb7a46)
I0726 02:30:30.519617       1 controllerserver.go:409] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-bb0f7ac6-99ef-4a6e-8d15-43dad1eb7a46) returned with failed to delete disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-bb0f7ac6-99ef-4a6e-8d15-43dad1eb7a46) since it's in attaching or detaching state
E0726 02:30:30.519646       1 utils.go:100] GRPC error: failed to delete disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-bb0f7ac6-99ef-4a6e-8d15-43dad1eb7a46) since it's in attaching or detaching state
I0726 02:30:34.772553       1 azure_controller_vmss.go:215] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - detach disk(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-bb0f7ac6-99ef-4a6e-8d15-43dad1eb7a46:pvc-bb0f7ac6-99ef-4a6e-8d15-43dad1eb7a46]) returned with <nil>
I0726 02:30:34.772635       1 azure_controller_common.go:337] azureDisk - detach disk(pvc-bb0f7ac6-99ef-4a6e-8d15-43dad1eb7a46, /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-bb0f7ac6-99ef-4a6e-8d15-43dad1eb7a46) succeeded
I0726 02:30:34.772659       1 controllerserver.go:544] detach volume /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-bb0f7ac6-99ef-4a6e-8d15-43dad1eb7a46 from node k8s-agentpool-31268889-vmss000001 successfully
I0726 02:30:34.772702       1 utils.go:102] GRPC response: {}
I0726 02:30:46.521347       1 utils.go:95] GRPC call: /csi.v1.Controller/DeleteVolume
I0726 02:30:46.521367       1 utils.go:96] GRPC request: {"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-bb0f7ac6-99ef-4a6e-8d15-43dad1eb7a46"}
... skipping 19 lines ...
I0726 02:31:50.521918       1 controllerserver.go:407] deleting azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-d1bfa541-db9f-493a-ae31-41b666523cf8)
I0726 02:31:55.705618       1 azure_managedDiskController.go:288] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-d1bfa541-db9f-493a-ae31-41b666523cf8
I0726 02:31:55.705658       1 controllerserver.go:409] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-d1bfa541-db9f-493a-ae31-41b666523cf8) returned with <nil>
I0726 02:31:55.705682       1 utils.go:102] GRPC response: {}
I0726 02:32:00.747045       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I0726 02:32:00.747068       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}],"requisite":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}]},"capacity_range":{"required_bytes":10737418240},"name":"pvc-921cf98e-aae4-4c18-95ef-7dee83a4612a","parameters":{"csi.storage.k8s.io/pv/name":"pvc-921cf98e-aae4-4c18-95ef-7dee83a4612a","csi.storage.k8s.io/pvc/name":"pvc-rddms","csi.storage.k8s.io/pvc/namespace":"azuredisk-5356","skuName":"StandardSSD_LRS"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":1}}]}
I0726 02:32:00.768879       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-921cf98e-aae4-4c18-95ef-7dee83a4612a, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-921cf98e-aae4-4c18-95ef-7dee83a4612a' under resource group 'kubetest-nnvuhiyw' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I0726 02:32:00.769143       1 controllerserver.go:290] begin to create azure disk(pvc-921cf98e-aae4-4c18-95ef-7dee83a4612a) account type(StandardSSD_LRS) rg(kubetest-nnvuhiyw) location() size(10) diskZone(westus2-2) maxShares(0)
I0726 02:32:00.769317       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-921cf98e-aae4-4c18-95ef-7dee83a4612a StorageAccountType:StandardSSD_LRS Size:10
I0726 02:32:03.125772       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-921cf98e-aae4-4c18-95ef-7dee83a4612a StorageAccountType:StandardSSD_LRS Size:10
I0726 02:32:03.125810       1 controllerserver.go:366] create azure disk(pvc-921cf98e-aae4-4c18-95ef-7dee83a4612a) account type(StandardSSD_LRS) rg(kubetest-nnvuhiyw) location() size(10) tags(map[kubernetes.io-created-for-pv-name:pvc-921cf98e-aae4-4c18-95ef-7dee83a4612a kubernetes.io-created-for-pvc-name:pvc-rddms kubernetes.io-created-for-pvc-namespace:azuredisk-5356]) successfully
I0726 02:32:03.125836       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2"}}],"capacity_bytes":10737418240,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-921cf98e-aae4-4c18-95ef-7dee83a4612a","csi.storage.k8s.io/pvc/name":"pvc-rddms","csi.storage.k8s.io/pvc/namespace":"azuredisk-5356","requestedsizegib":"10","skuName":"StandardSSD_LRS"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-921cf98e-aae4-4c18-95ef-7dee83a4612a"}}
I0726 02:32:03.867717       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 3 lines ...
I0726 02:32:03.888807       1 azure_vmss.go:186] Couldn't find VMSS VM with nodeName k8s-agentpool-31268889-vmss000001, refreshing the cache
I0726 02:32:03.955919       1 controllerserver.go:479] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-921cf98e-aae4-4c18-95ef-7dee83a4612a" to node "k8s-agentpool-31268889-vmss000001"
I0726 02:32:03.955962       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:32:03.955996       1 azure_controller_common.go:233] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-921cf98e-aae4-4c18-95ef-7dee83a4612a" lun 0 to node "k8s-agentpool-31268889-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-921cf98e-aae4-4c18-95ef-7dee83a4612a:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-921cf98e-aae4-4c18-95ef-7dee83a4612a  true false 0})]
I0726 02:32:03.956020       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:32:03.956049       1 azure_controller_vmss.go:120] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-921cf98e-aae4-4c18-95ef-7dee83a4612a:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-921cf98e-aae4-4c18-95ef-7dee83a4612a  true false 0})])
I0726 02:32:14.212776       1 azure_controller_vmss.go:132] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-921cf98e-aae4-4c18-95ef-7dee83a4612a:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-921cf98e-aae4-4c18-95ef-7dee83a4612a  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I0726 02:32:14.212858       1 controllerserver.go:483] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-921cf98e-aae4-4c18-95ef-7dee83a4612a" attached to node "k8s-agentpool-31268889-vmss000001".
I0726 02:32:14.212884       1 controllerserver.go:503] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-921cf98e-aae4-4c18-95ef-7dee83a4612a" to node "k8s-agentpool-31268889-vmss000001" successfully
I0726 02:32:14.212917       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
I0726 02:32:55.370314       1 azure_vmss.go:282] Couldn't find VMSS VM with scaleSetName "k8s-agentpool-31268889-vmss" and instanceID "1", refreshing the cache
I0726 02:33:44.350983       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerUnpublishVolume
I0726 02:33:44.350999       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool-31268889-vmss000001","volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-921cf98e-aae4-4c18-95ef-7dee83a4612a"}
... skipping 16 lines ...
I0726 02:33:59.729877       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
E0726 02:33:59.729904       1 azure_controller_vmss.go:173] detach azure disk on node(k8s-agentpool-31268889-vmss000001): disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-921cf98e-aae4-4c18-95ef-7dee83a4612a:pvc-921cf98e-aae4-4c18-95ef-7dee83a4612a]) not found
I0726 02:33:59.729924       1 azure_controller_vmss.go:203] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - detach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-921cf98e-aae4-4c18-95ef-7dee83a4612a:pvc-921cf98e-aae4-4c18-95ef-7dee83a4612a])
I0726 02:34:00.522392       1 utils.go:95] GRPC call: /csi.v1.Controller/DeleteVolume
I0726 02:34:00.522406       1 utils.go:96] GRPC request: {"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-921cf98e-aae4-4c18-95ef-7dee83a4612a"}
I0726 02:34:00.522475       1 controllerserver.go:407] deleting azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-921cf98e-aae4-4c18-95ef-7dee83a4612a)
I0726 02:34:00.522488       1 controllerserver.go:409] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-921cf98e-aae4-4c18-95ef-7dee83a4612a) returned with failed to delete disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-921cf98e-aae4-4c18-95ef-7dee83a4612a) since it's in attaching or detaching state
E0726 02:34:00.522503       1 utils.go:100] GRPC error: failed to delete disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-921cf98e-aae4-4c18-95ef-7dee83a4612a) since it's in attaching or detaching state
I0726 02:34:04.905673       1 azure_controller_vmss.go:215] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - detach disk(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-921cf98e-aae4-4c18-95ef-7dee83a4612a:pvc-921cf98e-aae4-4c18-95ef-7dee83a4612a]) returned with <nil>
I0726 02:34:04.905764       1 azure_controller_common.go:337] azureDisk - detach disk(pvc-921cf98e-aae4-4c18-95ef-7dee83a4612a, /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-921cf98e-aae4-4c18-95ef-7dee83a4612a) succeeded
I0726 02:34:04.905824       1 controllerserver.go:544] detach volume /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-921cf98e-aae4-4c18-95ef-7dee83a4612a from node k8s-agentpool-31268889-vmss000001 successfully
I0726 02:34:04.905905       1 utils.go:102] GRPC response: {}
I0726 02:34:32.523477       1 utils.go:95] GRPC call: /csi.v1.Controller/DeleteVolume
I0726 02:34:32.523498       1 utils.go:96] GRPC request: {"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-921cf98e-aae4-4c18-95ef-7dee83a4612a"}
I0726 02:34:32.523624       1 controllerserver.go:407] deleting azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-921cf98e-aae4-4c18-95ef-7dee83a4612a)
I0726 02:34:37.673966       1 azure_managedDiskController.go:288] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-921cf98e-aae4-4c18-95ef-7dee83a4612a
I0726 02:34:37.673994       1 controllerserver.go:409] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-921cf98e-aae4-4c18-95ef-7dee83a4612a) returned with <nil>
I0726 02:34:37.674012       1 utils.go:102] GRPC response: {}
I0726 02:34:44.300906       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I0726 02:34:44.301139       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2"}},{"segments":{"topology.disk.csi.azure.com/zone":"westus2-1"}}],"requisite":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-1"}},{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2"}}]},"capacity_range":{"required_bytes":10737418240},"name":"pvc-486c4820-a5f5-441f-8431-5f2737f0d3a5","parameters":{"csi.storage.k8s.io/pv/name":"pvc-486c4820-a5f5-441f-8431-5f2737f0d3a5","csi.storage.k8s.io/pvc/name":"pvc-gs8cs","csi.storage.k8s.io/pvc/namespace":"azuredisk-3090"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":1}}]}
I0726 02:34:44.322128       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-486c4820-a5f5-441f-8431-5f2737f0d3a5, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-486c4820-a5f5-441f-8431-5f2737f0d3a5' under resource group 'kubetest-nnvuhiyw' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I0726 02:34:44.322303       1 controllerserver.go:290] begin to create azure disk(pvc-486c4820-a5f5-441f-8431-5f2737f0d3a5) account type(StandardSSD_LRS) rg(kubetest-nnvuhiyw) location() size(10) diskZone(westus2-2) maxShares(0)
I0726 02:34:44.322348       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-486c4820-a5f5-441f-8431-5f2737f0d3a5 StorageAccountType:StandardSSD_LRS Size:10
I0726 02:34:46.620124       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-486c4820-a5f5-441f-8431-5f2737f0d3a5 StorageAccountType:StandardSSD_LRS Size:10
I0726 02:34:46.620192       1 controllerserver.go:366] create azure disk(pvc-486c4820-a5f5-441f-8431-5f2737f0d3a5) account type(StandardSSD_LRS) rg(kubetest-nnvuhiyw) location() size(10) tags(map[kubernetes.io-created-for-pv-name:pvc-486c4820-a5f5-441f-8431-5f2737f0d3a5 kubernetes.io-created-for-pvc-name:pvc-gs8cs kubernetes.io-created-for-pvc-namespace:azuredisk-3090]) successfully
I0726 02:34:46.620232       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2"}}],"capacity_bytes":10737418240,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-486c4820-a5f5-441f-8431-5f2737f0d3a5","csi.storage.k8s.io/pvc/name":"pvc-gs8cs","csi.storage.k8s.io/pvc/namespace":"azuredisk-3090","requestedsizegib":"10"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-486c4820-a5f5-441f-8431-5f2737f0d3a5"}}
I0726 02:34:48.665765       1 utils.go:95] GRPC call: /csi.v1.Controller/DeleteVolume
I0726 02:34:48.665788       1 utils.go:96] GRPC request: {"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-486c4820-a5f5-441f-8431-5f2737f0d3a5"}
I0726 02:34:48.666072       1 controllerserver.go:407] deleting azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-486c4820-a5f5-441f-8431-5f2737f0d3a5)
I0726 02:34:53.836583       1 azure_managedDiskController.go:288] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-486c4820-a5f5-441f-8431-5f2737f0d3a5
I0726 02:34:53.836608       1 controllerserver.go:409] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-486c4820-a5f5-441f-8431-5f2737f0d3a5) returned with <nil>
I0726 02:34:53.836627       1 utils.go:102] GRPC response: {}
I0726 02:35:00.524552       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I0726 02:35:00.524571       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2"}},{"segments":{"topology.disk.csi.azure.com/zone":"westus2-1"}}],"requisite":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-1"}},{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2"}}]},"capacity_range":{"required_bytes":10737418240},"name":"pvc-661dae45-68b1-4306-9204-93be2a9b59da","parameters":{"csi.storage.k8s.io/pv/name":"pvc-661dae45-68b1-4306-9204-93be2a9b59da","csi.storage.k8s.io/pvc/name":"pvc-8mvfg","csi.storage.k8s.io/pvc/namespace":"azuredisk-4078"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":1}}]}
I0726 02:35:00.548450       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-661dae45-68b1-4306-9204-93be2a9b59da, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-661dae45-68b1-4306-9204-93be2a9b59da' under resource group 'kubetest-nnvuhiyw' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I0726 02:35:00.548505       1 controllerserver.go:290] begin to create azure disk(pvc-661dae45-68b1-4306-9204-93be2a9b59da) account type(StandardSSD_LRS) rg(kubetest-nnvuhiyw) location() size(10) diskZone(westus2-2) maxShares(0)
I0726 02:35:00.548527       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-661dae45-68b1-4306-9204-93be2a9b59da StorageAccountType:StandardSSD_LRS Size:10
I0726 02:35:02.839602       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-661dae45-68b1-4306-9204-93be2a9b59da StorageAccountType:StandardSSD_LRS Size:10
I0726 02:35:02.839669       1 controllerserver.go:366] create azure disk(pvc-661dae45-68b1-4306-9204-93be2a9b59da) account type(StandardSSD_LRS) rg(kubetest-nnvuhiyw) location() size(10) tags(map[kubernetes.io-created-for-pv-name:pvc-661dae45-68b1-4306-9204-93be2a9b59da kubernetes.io-created-for-pvc-name:pvc-8mvfg kubernetes.io-created-for-pvc-namespace:azuredisk-4078]) successfully
I0726 02:35:02.839707       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2"}}],"capacity_bytes":10737418240,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-661dae45-68b1-4306-9204-93be2a9b59da","csi.storage.k8s.io/pvc/name":"pvc-8mvfg","csi.storage.k8s.io/pvc/namespace":"azuredisk-4078","requestedsizegib":"10"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-661dae45-68b1-4306-9204-93be2a9b59da"}}
I0726 02:35:12.836877       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I0726 02:35:12.836899       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}],"requisite":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}]},"capacity_range":{"required_bytes":10737418240},"name":"pvc-6e772f38-df3d-4467-8b4b-d95e50063b28","parameters":{"csi.storage.k8s.io/pv/name":"pvc-6e772f38-df3d-4467-8b4b-d95e50063b28","csi.storage.k8s.io/pvc/name":"pvc-st5v4","csi.storage.k8s.io/pvc/namespace":"azuredisk-3721","networkAccessPolicy":"DenyAll","skuName":"StandardSSD_ZRS"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":1}}]}
I0726 02:35:12.837053       1 controllerserver.go:253] diskZone(westus2-2) is reset as empty since disk(pvc-6e772f38-df3d-4467-8b4b-d95e50063b28) is ZRS(StandardSSD_ZRS)
I0726 02:35:12.857430       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-6e772f38-df3d-4467-8b4b-d95e50063b28, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-6e772f38-df3d-4467-8b4b-d95e50063b28' under resource group 'kubetest-nnvuhiyw' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I0726 02:35:12.857481       1 controllerserver.go:290] begin to create azure disk(pvc-6e772f38-df3d-4467-8b4b-d95e50063b28) account type(StandardSSD_ZRS) rg(kubetest-nnvuhiyw) location() size(10) diskZone() maxShares(0)
I0726 02:35:12.857499       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-6e772f38-df3d-4467-8b4b-d95e50063b28 StorageAccountType:StandardSSD_ZRS Size:10
I0726 02:35:15.108053       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-6e772f38-df3d-4467-8b4b-d95e50063b28 StorageAccountType:StandardSSD_ZRS Size:10
I0726 02:35:15.108200       1 controllerserver.go:366] create azure disk(pvc-6e772f38-df3d-4467-8b4b-d95e50063b28) account type(StandardSSD_ZRS) rg(kubetest-nnvuhiyw) location() size(10) tags(map[kubernetes.io-created-for-pv-name:pvc-6e772f38-df3d-4467-8b4b-d95e50063b28 kubernetes.io-created-for-pvc-name:pvc-st5v4 kubernetes.io-created-for-pvc-namespace:azuredisk-3721]) successfully
I0726 02:35:15.108301       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-1"}},{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2"}},{"segments":{"topology.disk.csi.azure.com/zone":"westus2-3"}},{"segments":{"topology.disk.csi.azure.com/zone":""}}],"capacity_bytes":10737418240,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-6e772f38-df3d-4467-8b4b-d95e50063b28","csi.storage.k8s.io/pvc/name":"pvc-st5v4","csi.storage.k8s.io/pvc/namespace":"azuredisk-3721","networkAccessPolicy":"DenyAll","requestedsizegib":"10","skuName":"StandardSSD_ZRS"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-6e772f38-df3d-4467-8b4b-d95e50063b28"}}
I0726 02:35:15.926409       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 3 lines ...
I0726 02:35:15.948363       1 azure_vmss.go:186] Couldn't find VMSS VM with nodeName k8s-agentpool-31268889-vmss000001, refreshing the cache
I0726 02:35:16.036233       1 controllerserver.go:479] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-6e772f38-df3d-4467-8b4b-d95e50063b28" to node "k8s-agentpool-31268889-vmss000001"
I0726 02:35:16.036308       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:35:16.036351       1 azure_controller_common.go:233] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-6e772f38-df3d-4467-8b4b-d95e50063b28" lun 0 to node "k8s-agentpool-31268889-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-6e772f38-df3d-4467-8b4b-d95e50063b28:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-6e772f38-df3d-4467-8b4b-d95e50063b28  true false 0})]
I0726 02:35:16.036393       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:35:16.036429       1 azure_controller_vmss.go:120] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-6e772f38-df3d-4467-8b4b-d95e50063b28:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-6e772f38-df3d-4467-8b4b-d95e50063b28  true false 0})])
I0726 02:35:26.372334       1 azure_controller_vmss.go:132] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-6e772f38-df3d-4467-8b4b-d95e50063b28:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-6e772f38-df3d-4467-8b4b-d95e50063b28  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I0726 02:35:26.372397       1 controllerserver.go:483] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-6e772f38-df3d-4467-8b4b-d95e50063b28" attached to node "k8s-agentpool-31268889-vmss000001".
I0726 02:35:26.372417       1 controllerserver.go:503] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-6e772f38-df3d-4467-8b4b-d95e50063b28" to node "k8s-agentpool-31268889-vmss000001" successfully
I0726 02:35:26.372439       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
I0726 02:35:35.798453       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I0726 02:35:35.798477       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}],"requisite":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}]},"capacity_range":{"required_bytes":10737418240},"name":"pvc-ec8818a8-2b67-4fe0-9bee-ffee88b978f0","parameters":{"csi.storage.k8s.io/pv/name":"pvc-ec8818a8-2b67-4fe0-9bee-ffee88b978f0","csi.storage.k8s.io/pvc/name":"pvc-gj29b","csi.storage.k8s.io/pvc/namespace":"azuredisk-3721","networkAccessPolicy":"DenyAll","skuName":"StandardSSD_ZRS"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":1}}],"volume_content_source":{"Type":{"Volume":{"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-6e772f38-df3d-4467-8b4b-d95e50063b28"}}}}
I0726 02:35:35.798914       1 controllerserver.go:253] diskZone(westus2-2) is reset as empty since disk(pvc-ec8818a8-2b67-4fe0-9bee-ffee88b978f0) is ZRS(StandardSSD_ZRS)
I0726 02:35:35.820088       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-ec8818a8-2b67-4fe0-9bee-ffee88b978f0, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-ec8818a8-2b67-4fe0-9bee-ffee88b978f0' under resource group 'kubetest-nnvuhiyw' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I0726 02:35:35.820197       1 controllerserver.go:290] begin to create azure disk(pvc-ec8818a8-2b67-4fe0-9bee-ffee88b978f0) account type(StandardSSD_ZRS) rg(kubetest-nnvuhiyw) location() size(10) diskZone() maxShares(0)
I0726 02:35:35.841674       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-ec8818a8-2b67-4fe0-9bee-ffee88b978f0 StorageAccountType:StandardSSD_ZRS Size:10
I0726 02:35:38.131851       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-ec8818a8-2b67-4fe0-9bee-ffee88b978f0 StorageAccountType:StandardSSD_ZRS Size:10
I0726 02:35:38.131909       1 controllerserver.go:366] create azure disk(pvc-ec8818a8-2b67-4fe0-9bee-ffee88b978f0) account type(StandardSSD_ZRS) rg(kubetest-nnvuhiyw) location() size(10) tags(map[kubernetes.io-created-for-pv-name:pvc-ec8818a8-2b67-4fe0-9bee-ffee88b978f0 kubernetes.io-created-for-pvc-name:pvc-gj29b kubernetes.io-created-for-pvc-namespace:azuredisk-3721]) successfully
I0726 02:35:38.131946       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-1"}},{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2"}},{"segments":{"topology.disk.csi.azure.com/zone":"westus2-3"}},{"segments":{"topology.disk.csi.azure.com/zone":""}}],"capacity_bytes":10737418240,"content_source":{"Type":{"Volume":{"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-6e772f38-df3d-4467-8b4b-d95e50063b28"}}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-ec8818a8-2b67-4fe0-9bee-ffee88b978f0","csi.storage.k8s.io/pvc/name":"pvc-gj29b","csi.storage.k8s.io/pvc/namespace":"azuredisk-3721","networkAccessPolicy":"DenyAll","requestedsizegib":"10","skuName":"StandardSSD_ZRS"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-ec8818a8-2b67-4fe0-9bee-ffee88b978f0"}}
I0726 02:35:38.897545       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 7 lines ...
I0726 02:35:38.984377       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:35:38.984429       1 azure_controller_vmss.go:120] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-ec8818a8-2b67-4fe0-9bee-ffee88b978f0:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-ec8818a8-2b67-4fe0-9bee-ffee88b978f0  true false 1})])
I0726 02:35:44.511858       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerUnpublishVolume
I0726 02:35:44.511879       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool-31268889-vmss000001","volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-6e772f38-df3d-4467-8b4b-d95e50063b28"}
I0726 02:35:44.512017       1 controllerserver.go:535] Trying to detach volume /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-6e772f38-df3d-4467-8b4b-d95e50063b28 from node k8s-agentpool-31268889-vmss000001
I0726 02:35:44.512034       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:35:49.253752       1 azure_controller_vmss.go:132] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-ec8818a8-2b67-4fe0-9bee-ffee88b978f0:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-ec8818a8-2b67-4fe0-9bee-ffee88b978f0  true false 1})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I0726 02:35:49.253858       1 controllerserver.go:483] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-ec8818a8-2b67-4fe0-9bee-ffee88b978f0" attached to node "k8s-agentpool-31268889-vmss000001".
I0726 02:35:49.253891       1 controllerserver.go:503] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-ec8818a8-2b67-4fe0-9bee-ffee88b978f0" to node "k8s-agentpool-31268889-vmss000001" successfully
I0726 02:35:49.253992       1 azure_controller_common.go:317] Trying to detach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-6e772f38-df3d-4467-8b4b-d95e50063b28" from node "k8s-agentpool-31268889-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-6e772f38-df3d-4467-8b4b-d95e50063b28:pvc-6e772f38-df3d-4467-8b4b-d95e50063b28]
I0726 02:35:49.253925       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"1"}}
I0726 02:35:49.254028       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:35:49.254057       1 azure_vmss.go:186] Couldn't find VMSS VM with nodeName k8s-agentpool-31268889-vmss000001, refreshing the cache
... skipping 41 lines ...
I0726 02:36:44.939063       1 azure_managedDiskController.go:288] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-6e772f38-df3d-4467-8b4b-d95e50063b28
I0726 02:36:44.939093       1 controllerserver.go:409] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-6e772f38-df3d-4467-8b4b-d95e50063b28) returned with <nil>
I0726 02:36:44.939114       1 utils.go:102] GRPC response: {}
I0726 02:36:51.635628       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I0726 02:36:51.635780       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}],"requisite":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}]},"capacity_range":{"required_bytes":10737418240},"name":"pvc-a8878277-17f6-4cdf-863d-b589e8c6477d","parameters":{"csi.storage.k8s.io/pv/name":"pvc-a8878277-17f6-4cdf-863d-b589e8c6477d","csi.storage.k8s.io/pvc/name":"pvc-9dzls","csi.storage.k8s.io/pvc/namespace":"azuredisk-2888","fsType":"xfs","networkAccessPolicy":"DenyAll","skuName":"StandardSSD_ZRS"},"volume_capabilities":[{"AccessType":{"Mount":{"fs_type":"xfs"}},"access_mode":{"mode":1}}]}
I0726 02:36:51.636012       1 controllerserver.go:253] diskZone(westus2-2) is reset as empty since disk(pvc-a8878277-17f6-4cdf-863d-b589e8c6477d) is ZRS(StandardSSD_ZRS)
I0726 02:36:51.659237       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-a8878277-17f6-4cdf-863d-b589e8c6477d, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-a8878277-17f6-4cdf-863d-b589e8c6477d' under resource group 'kubetest-nnvuhiyw' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I0726 02:36:51.659377       1 controllerserver.go:290] begin to create azure disk(pvc-a8878277-17f6-4cdf-863d-b589e8c6477d) account type(StandardSSD_ZRS) rg(kubetest-nnvuhiyw) location() size(10) diskZone() maxShares(0)
I0726 02:36:51.659402       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-a8878277-17f6-4cdf-863d-b589e8c6477d StorageAccountType:StandardSSD_ZRS Size:10
I0726 02:36:53.962939       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-a8878277-17f6-4cdf-863d-b589e8c6477d StorageAccountType:StandardSSD_ZRS Size:10
I0726 02:36:53.963009       1 controllerserver.go:366] create azure disk(pvc-a8878277-17f6-4cdf-863d-b589e8c6477d) account type(StandardSSD_ZRS) rg(kubetest-nnvuhiyw) location() size(10) tags(map[kubernetes.io-created-for-pv-name:pvc-a8878277-17f6-4cdf-863d-b589e8c6477d kubernetes.io-created-for-pvc-name:pvc-9dzls kubernetes.io-created-for-pvc-namespace:azuredisk-2888]) successfully
I0726 02:36:53.963236       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-1"}},{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2"}},{"segments":{"topology.disk.csi.azure.com/zone":"westus2-3"}},{"segments":{"topology.disk.csi.azure.com/zone":""}}],"capacity_bytes":10737418240,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-a8878277-17f6-4cdf-863d-b589e8c6477d","csi.storage.k8s.io/pvc/name":"pvc-9dzls","csi.storage.k8s.io/pvc/namespace":"azuredisk-2888","fsType":"xfs","networkAccessPolicy":"DenyAll","requestedsizegib":"10","skuName":"StandardSSD_ZRS"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-a8878277-17f6-4cdf-863d-b589e8c6477d"}}
I0726 02:36:54.754845       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 3 lines ...
I0726 02:36:54.777079       1 azure_vmss.go:186] Couldn't find VMSS VM with nodeName k8s-agentpool-31268889-vmss000001, refreshing the cache
I0726 02:36:54.867810       1 controllerserver.go:479] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-a8878277-17f6-4cdf-863d-b589e8c6477d" to node "k8s-agentpool-31268889-vmss000001"
I0726 02:36:54.867871       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:36:54.867912       1 azure_controller_common.go:233] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-a8878277-17f6-4cdf-863d-b589e8c6477d" lun 0 to node "k8s-agentpool-31268889-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-a8878277-17f6-4cdf-863d-b589e8c6477d:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-a8878277-17f6-4cdf-863d-b589e8c6477d  true false 0})]
I0726 02:36:54.867951       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:36:54.867987       1 azure_controller_vmss.go:120] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-a8878277-17f6-4cdf-863d-b589e8c6477d:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-a8878277-17f6-4cdf-863d-b589e8c6477d  true false 0})])
I0726 02:37:05.120261       1 azure_controller_vmss.go:132] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-a8878277-17f6-4cdf-863d-b589e8c6477d:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-a8878277-17f6-4cdf-863d-b589e8c6477d  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I0726 02:37:05.120359       1 controllerserver.go:483] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-a8878277-17f6-4cdf-863d-b589e8c6477d" attached to node "k8s-agentpool-31268889-vmss000001".
I0726 02:37:05.120392       1 controllerserver.go:503] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-a8878277-17f6-4cdf-863d-b589e8c6477d" to node "k8s-agentpool-31268889-vmss000001" successfully
I0726 02:37:05.120437       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
I0726 02:37:05.135944       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
I0726 02:37:05.135964       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool-31268889-vmss000001","volume_capability":{"AccessType":{"Mount":{"fs_type":"xfs"}},"access_mode":{"mode":1}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-a8878277-17f6-4cdf-863d-b589e8c6477d","csi.storage.k8s.io/pvc/name":"pvc-9dzls","csi.storage.k8s.io/pvc/namespace":"azuredisk-2888","fsType":"xfs","networkAccessPolicy":"DenyAll","requestedsizegib":"10","skuName":"StandardSSD_ZRS","storage.kubernetes.io/csiProvisionerIdentity":"1627265933331-8081-disk.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-a8878277-17f6-4cdf-863d-b589e8c6477d"}
I0726 02:37:05.158196       1 controllerserver.go:458] GetDiskLun returned: <nil>. Initiating attaching volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-a8878277-17f6-4cdf-863d-b589e8c6477d" to node "k8s-agentpool-31268889-vmss000001".
... skipping 10 lines ...
I0726 02:37:14.558443       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:37:14.558461       1 azure_controller_vmss.go:164] azureDisk - detach disk: name "pvc-a8878277-17f6-4cdf-863d-b589e8c6477d" uri "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-a8878277-17f6-4cdf-863d-b589e8c6477d"
I0726 02:37:14.558478       1 azure_controller_vmss.go:203] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - detach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-a8878277-17f6-4cdf-863d-b589e8c6477d:pvc-a8878277-17f6-4cdf-863d-b589e8c6477d])
I0726 02:37:14.579551       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I0726 02:37:14.579575       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}],"requisite":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}]},"capacity_range":{"required_bytes":21474836480},"name":"pvc-9488dcff-2cd1-4712-910e-e6085042952b","parameters":{"csi.storage.k8s.io/pv/name":"pvc-9488dcff-2cd1-4712-910e-e6085042952b","csi.storage.k8s.io/pvc/name":"pvc-7bk6m","csi.storage.k8s.io/pvc/namespace":"azuredisk-2888","fsType":"xfs","networkAccessPolicy":"DenyAll","skuName":"StandardSSD_ZRS"},"volume_capabilities":[{"AccessType":{"Mount":{"fs_type":"xfs"}},"access_mode":{"mode":1}}],"volume_content_source":{"Type":{"Volume":{"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-a8878277-17f6-4cdf-863d-b589e8c6477d"}}}}
I0726 02:37:14.579806       1 controllerserver.go:253] diskZone(westus2-2) is reset as empty since disk(pvc-9488dcff-2cd1-4712-910e-e6085042952b) is ZRS(StandardSSD_ZRS)
I0726 02:37:14.627775       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-9488dcff-2cd1-4712-910e-e6085042952b, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-9488dcff-2cd1-4712-910e-e6085042952b' under resource group 'kubetest-nnvuhiyw' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I0726 02:37:14.627875       1 controllerserver.go:290] begin to create azure disk(pvc-9488dcff-2cd1-4712-910e-e6085042952b) account type(StandardSSD_ZRS) rg(kubetest-nnvuhiyw) location() size(20) diskZone() maxShares(0)
I0726 02:37:14.650084       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-9488dcff-2cd1-4712-910e-e6085042952b StorageAccountType:StandardSSD_ZRS Size:20
I0726 02:37:16.952226       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-9488dcff-2cd1-4712-910e-e6085042952b StorageAccountType:StandardSSD_ZRS Size:20
I0726 02:37:16.952275       1 controllerserver.go:366] create azure disk(pvc-9488dcff-2cd1-4712-910e-e6085042952b) account type(StandardSSD_ZRS) rg(kubetest-nnvuhiyw) location() size(20) tags(map[kubernetes.io-created-for-pv-name:pvc-9488dcff-2cd1-4712-910e-e6085042952b kubernetes.io-created-for-pvc-name:pvc-7bk6m kubernetes.io-created-for-pvc-namespace:azuredisk-2888]) successfully
I0726 02:37:16.952448       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-1"}},{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2"}},{"segments":{"topology.disk.csi.azure.com/zone":"westus2-3"}},{"segments":{"topology.disk.csi.azure.com/zone":""}}],"capacity_bytes":21474836480,"content_source":{"Type":{"Volume":{"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-a8878277-17f6-4cdf-863d-b589e8c6477d"}}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-9488dcff-2cd1-4712-910e-e6085042952b","csi.storage.k8s.io/pvc/name":"pvc-7bk6m","csi.storage.k8s.io/pvc/namespace":"azuredisk-2888","fsType":"xfs","networkAccessPolicy":"DenyAll","requestedsizegib":"20","resizeRequired":"true","skuName":"StandardSSD_ZRS"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-9488dcff-2cd1-4712-910e-e6085042952b"}}
I0726 02:37:17.664512       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 11 lines ...
I0726 02:37:29.787412       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool-31268889-vmss000001","volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-a8878277-17f6-4cdf-863d-b589e8c6477d"}
I0726 02:37:29.787675       1 controllerserver.go:535] Trying to detach volume /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-a8878277-17f6-4cdf-863d-b589e8c6477d from node k8s-agentpool-31268889-vmss000001
I0726 02:37:29.787690       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:37:29.839004       1 azure_controller_common.go:233] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-9488dcff-2cd1-4712-910e-e6085042952b" lun 0 to node "k8s-agentpool-31268889-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-9488dcff-2cd1-4712-910e-e6085042952b:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-9488dcff-2cd1-4712-910e-e6085042952b  true false 0})]
I0726 02:37:29.839046       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:37:29.839075       1 azure_controller_vmss.go:120] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-9488dcff-2cd1-4712-910e-e6085042952b:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-9488dcff-2cd1-4712-910e-e6085042952b  true false 0})])
I0726 02:37:40.341918       1 azure_controller_vmss.go:132] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-9488dcff-2cd1-4712-910e-e6085042952b:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-9488dcff-2cd1-4712-910e-e6085042952b  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I0726 02:37:40.342197       1 azure_controller_common.go:317] Trying to detach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-a8878277-17f6-4cdf-863d-b589e8c6477d" from node "k8s-agentpool-31268889-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-a8878277-17f6-4cdf-863d-b589e8c6477d:pvc-a8878277-17f6-4cdf-863d-b589e8c6477d]
I0726 02:37:40.342372       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:37:40.342536       1 azure_vmss.go:186] Couldn't find VMSS VM with nodeName k8s-agentpool-31268889-vmss000001, refreshing the cache
I0726 02:37:40.342217       1 controllerserver.go:483] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-9488dcff-2cd1-4712-910e-e6085042952b" attached to node "k8s-agentpool-31268889-vmss000001".
I0726 02:37:40.342628       1 controllerserver.go:503] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-9488dcff-2cd1-4712-910e-e6085042952b" to node "k8s-agentpool-31268889-vmss000001" successfully
I0726 02:37:40.342665       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
... skipping 54 lines ...
I0726 02:38:47.027598       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I0726 02:38:47.027612       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}],"requisite":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}]},"capacity_range":{"required_bytes":10737418240},"name":"pvc-db70a427-8ff8-4b98-b3c6-0e8085669f86","parameters":{"csi.storage.k8s.io/pv/name":"pvc-db70a427-8ff8-4b98-b3c6-0e8085669f86","csi.storage.k8s.io/pvc/name":"pvc-lsghm","csi.storage.k8s.io/pvc/namespace":"azuredisk-8510","skuName":"StandardSSD_ZRS"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":1}}]}
I0726 02:38:47.027914       1 controllerserver.go:253] diskZone(westus2-2) is reset as empty since disk(pvc-db70a427-8ff8-4b98-b3c6-0e8085669f86) is ZRS(StandardSSD_ZRS)
I0726 02:38:47.038374       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I0726 02:38:47.038395       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}],"requisite":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}]},"capacity_range":{"required_bytes":10737418240},"name":"pvc-07f1de60-2337-4da2-b4dd-6b9bfa66b56a","parameters":{"csi.storage.k8s.io/pv/name":"pvc-07f1de60-2337-4da2-b4dd-6b9bfa66b56a","csi.storage.k8s.io/pvc/name":"pvc-54g5t","csi.storage.k8s.io/pvc/namespace":"azuredisk-8510","skuName":"StandardSSD_ZRS"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":1}}]}
I0726 02:38:47.038582       1 controllerserver.go:253] diskZone(westus2-2) is reset as empty since disk(pvc-07f1de60-2337-4da2-b4dd-6b9bfa66b56a) is ZRS(StandardSSD_ZRS)
I0726 02:38:47.039646       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-fa22ce9f-e7d1-4099-85ca-faf564cf7b3b, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-fa22ce9f-e7d1-4099-85ca-faf564cf7b3b' under resource group 'kubetest-nnvuhiyw' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I0726 02:38:47.039711       1 controllerserver.go:290] begin to create azure disk(pvc-fa22ce9f-e7d1-4099-85ca-faf564cf7b3b) account type(StandardSSD_ZRS) rg(kubetest-nnvuhiyw) location() size(10) diskZone() maxShares(0)
I0726 02:38:47.039730       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-fa22ce9f-e7d1-4099-85ca-faf564cf7b3b StorageAccountType:StandardSSD_ZRS Size:10
I0726 02:38:47.054970       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-db70a427-8ff8-4b98-b3c6-0e8085669f86, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-db70a427-8ff8-4b98-b3c6-0e8085669f86' under resource group 'kubetest-nnvuhiyw' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I0726 02:38:47.055016       1 controllerserver.go:290] begin to create azure disk(pvc-db70a427-8ff8-4b98-b3c6-0e8085669f86) account type(StandardSSD_ZRS) rg(kubetest-nnvuhiyw) location() size(10) diskZone() maxShares(0)
I0726 02:38:47.055035       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-db70a427-8ff8-4b98-b3c6-0e8085669f86 StorageAccountType:StandardSSD_ZRS Size:10
I0726 02:38:47.110189       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-07f1de60-2337-4da2-b4dd-6b9bfa66b56a, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-07f1de60-2337-4da2-b4dd-6b9bfa66b56a' under resource group 'kubetest-nnvuhiyw' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I0726 02:38:47.110267       1 controllerserver.go:290] begin to create azure disk(pvc-07f1de60-2337-4da2-b4dd-6b9bfa66b56a) account type(StandardSSD_ZRS) rg(kubetest-nnvuhiyw) location() size(10) diskZone() maxShares(0)
I0726 02:38:47.110302       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-07f1de60-2337-4da2-b4dd-6b9bfa66b56a StorageAccountType:StandardSSD_ZRS Size:10
I0726 02:38:49.381115       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-db70a427-8ff8-4b98-b3c6-0e8085669f86 StorageAccountType:StandardSSD_ZRS Size:10
I0726 02:38:49.381176       1 controllerserver.go:366] create azure disk(pvc-db70a427-8ff8-4b98-b3c6-0e8085669f86) account type(StandardSSD_ZRS) rg(kubetest-nnvuhiyw) location() size(10) tags(map[kubernetes.io-created-for-pv-name:pvc-db70a427-8ff8-4b98-b3c6-0e8085669f86 kubernetes.io-created-for-pvc-name:pvc-lsghm kubernetes.io-created-for-pvc-namespace:azuredisk-8510]) successfully
I0726 02:38:49.381210       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-1"}},{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2"}},{"segments":{"topology.disk.csi.azure.com/zone":"westus2-3"}},{"segments":{"topology.disk.csi.azure.com/zone":""}}],"capacity_bytes":10737418240,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-db70a427-8ff8-4b98-b3c6-0e8085669f86","csi.storage.k8s.io/pvc/name":"pvc-lsghm","csi.storage.k8s.io/pvc/namespace":"azuredisk-8510","requestedsizegib":"10","skuName":"StandardSSD_ZRS"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-db70a427-8ff8-4b98-b3c6-0e8085669f86"}}
I0726 02:38:49.476072       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-fa22ce9f-e7d1-4099-85ca-faf564cf7b3b StorageAccountType:StandardSSD_ZRS Size:10
... skipping 19 lines ...
I0726 02:38:50.311805       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:38:50.311885       1 controllerserver.go:479] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-fa22ce9f-e7d1-4099-85ca-faf564cf7b3b" to node "k8s-agentpool-31268889-vmss000001"
I0726 02:38:50.311957       1 controllerserver.go:479] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-db70a427-8ff8-4b98-b3c6-0e8085669f86" to node "k8s-agentpool-31268889-vmss000001"
I0726 02:38:50.311831       1 azure_controller_common.go:233] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-07f1de60-2337-4da2-b4dd-6b9bfa66b56a" lun 0 to node "k8s-agentpool-31268889-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-07f1de60-2337-4da2-b4dd-6b9bfa66b56a:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-07f1de60-2337-4da2-b4dd-6b9bfa66b56a  true false 0})]
I0726 02:38:50.312198       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:38:50.312227       1 azure_controller_vmss.go:120] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-07f1de60-2337-4da2-b4dd-6b9bfa66b56a:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-07f1de60-2337-4da2-b4dd-6b9bfa66b56a  true false 0})])
I0726 02:39:05.873680       1 azure_controller_vmss.go:132] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-07f1de60-2337-4da2-b4dd-6b9bfa66b56a:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-07f1de60-2337-4da2-b4dd-6b9bfa66b56a  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I0726 02:39:05.873779       1 controllerserver.go:483] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-07f1de60-2337-4da2-b4dd-6b9bfa66b56a" attached to node "k8s-agentpool-31268889-vmss000001".
I0726 02:39:05.873807       1 controllerserver.go:503] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-07f1de60-2337-4da2-b4dd-6b9bfa66b56a" to node "k8s-agentpool-31268889-vmss000001" successfully
I0726 02:39:05.873833       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
I0726 02:39:05.873867       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:39:05.873891       1 azure_vmss.go:186] Couldn't find VMSS VM with nodeName k8s-agentpool-31268889-vmss000001, refreshing the cache
I0726 02:39:05.883133       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 3 lines ...
I0726 02:39:05.946083       1 azure_controller_common.go:233] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-fa22ce9f-e7d1-4099-85ca-faf564cf7b3b" lun 2 to node "k8s-agentpool-31268889-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-db70a427-8ff8-4b98-b3c6-0e8085669f86:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-db70a427-8ff8-4b98-b3c6-0e8085669f86  true false 1}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-fa22ce9f-e7d1-4099-85ca-faf564cf7b3b:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-fa22ce9f-e7d1-4099-85ca-faf564cf7b3b  true false 2})]
I0726 02:39:05.946123       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:39:05.946152       1 azure_controller_vmss.go:120] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-db70a427-8ff8-4b98-b3c6-0e8085669f86:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-db70a427-8ff8-4b98-b3c6-0e8085669f86  true false 1}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-fa22ce9f-e7d1-4099-85ca-faf564cf7b3b:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-fa22ce9f-e7d1-4099-85ca-faf564cf7b3b  true false 2})])
I0726 02:39:05.946173       1 azure_controller_common.go:425] azureDisk - find disk: lun 0 name "pvc-07f1de60-2337-4da2-b4dd-6b9bfa66b56a" uri "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-07f1de60-2337-4da2-b4dd-6b9bfa66b56a"
I0726 02:39:05.946197       1 controllerserver.go:473] Attach operation is successful. volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-07f1de60-2337-4da2-b4dd-6b9bfa66b56a" is already attached to node "k8s-agentpool-31268889-vmss000001" at lun 0.
I0726 02:39:05.946217       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
I0726 02:39:21.276065       1 azure_controller_vmss.go:132] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-db70a427-8ff8-4b98-b3c6-0e8085669f86:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-db70a427-8ff8-4b98-b3c6-0e8085669f86  true false 1}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-fa22ce9f-e7d1-4099-85ca-faf564cf7b3b:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-fa22ce9f-e7d1-4099-85ca-faf564cf7b3b  true false 2})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I0726 02:39:21.276171       1 controllerserver.go:483] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-fa22ce9f-e7d1-4099-85ca-faf564cf7b3b" attached to node "k8s-agentpool-31268889-vmss000001".
I0726 02:39:21.276205       1 controllerserver.go:503] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-fa22ce9f-e7d1-4099-85ca-faf564cf7b3b" to node "k8s-agentpool-31268889-vmss000001" successfully
I0726 02:39:21.276248       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"2"}}
I0726 02:39:21.276383       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:39:21.276420       1 azure_vmss.go:186] Couldn't find VMSS VM with nodeName k8s-agentpool-31268889-vmss000001, refreshing the cache
I0726 02:39:21.341413       1 azure_controller_common.go:233] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-db70a427-8ff8-4b98-b3c6-0e8085669f86" lun 1 to node "k8s-agentpool-31268889-vmss000001", diskMap: map[]
... skipping 68 lines ...
I0726 02:40:35.155060       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I0726 02:40:35.155085       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}],"requisite":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}]},"capacity_range":{"required_bytes":10737418240},"name":"pvc-91236be9-6ec6-44ec-8101-2916dc0a36b5","parameters":{"csi.storage.k8s.io/pv/name":"pvc-91236be9-6ec6-44ec-8101-2916dc0a36b5","csi.storage.k8s.io/pvc/name":"pvc-sq5md","csi.storage.k8s.io/pvc/namespace":"azuredisk-5561","skuName":"StandardSSD_ZRS"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":1}}]}
I0726 02:40:35.155634       1 controllerserver.go:253] diskZone(westus2-2) is reset as empty since disk(pvc-91236be9-6ec6-44ec-8101-2916dc0a36b5) is ZRS(StandardSSD_ZRS)
I0726 02:40:35.164824       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I0726 02:40:35.164850       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}],"requisite":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}]},"capacity_range":{"required_bytes":10737418240},"name":"pvc-7a1dbc87-3a7c-4889-8df0-1b7f88c4fd6f","parameters":{"csi.storage.k8s.io/pv/name":"pvc-7a1dbc87-3a7c-4889-8df0-1b7f88c4fd6f","csi.storage.k8s.io/pvc/name":"pvc-tb522","csi.storage.k8s.io/pvc/namespace":"azuredisk-5561","skuName":"StandardSSD_ZRS"},"volume_capabilities":[{"AccessType":{"Block":{}},"access_mode":{"mode":1}}]}
I0726 02:40:35.165163       1 controllerserver.go:253] diskZone(westus2-2) is reset as empty since disk(pvc-7a1dbc87-3a7c-4889-8df0-1b7f88c4fd6f) is ZRS(StandardSSD_ZRS)
I0726 02:40:35.175196       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-91236be9-6ec6-44ec-8101-2916dc0a36b5, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-91236be9-6ec6-44ec-8101-2916dc0a36b5' under resource group 'kubetest-nnvuhiyw' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I0726 02:40:35.175235       1 controllerserver.go:290] begin to create azure disk(pvc-91236be9-6ec6-44ec-8101-2916dc0a36b5) account type(StandardSSD_ZRS) rg(kubetest-nnvuhiyw) location() size(10) diskZone() maxShares(0)
I0726 02:40:35.175254       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-91236be9-6ec6-44ec-8101-2916dc0a36b5 StorageAccountType:StandardSSD_ZRS Size:10
I0726 02:40:35.184540       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-7a1dbc87-3a7c-4889-8df0-1b7f88c4fd6f, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-7a1dbc87-3a7c-4889-8df0-1b7f88c4fd6f' under resource group 'kubetest-nnvuhiyw' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I0726 02:40:35.184621       1 controllerserver.go:290] begin to create azure disk(pvc-7a1dbc87-3a7c-4889-8df0-1b7f88c4fd6f) account type(StandardSSD_ZRS) rg(kubetest-nnvuhiyw) location() size(10) diskZone() maxShares(0)
I0726 02:40:35.184640       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-7a1dbc87-3a7c-4889-8df0-1b7f88c4fd6f StorageAccountType:StandardSSD_ZRS Size:10
I0726 02:40:37.483078       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-91236be9-6ec6-44ec-8101-2916dc0a36b5 StorageAccountType:StandardSSD_ZRS Size:10
I0726 02:40:37.483190       1 controllerserver.go:366] create azure disk(pvc-91236be9-6ec6-44ec-8101-2916dc0a36b5) account type(StandardSSD_ZRS) rg(kubetest-nnvuhiyw) location() size(10) tags(map[kubernetes.io-created-for-pv-name:pvc-91236be9-6ec6-44ec-8101-2916dc0a36b5 kubernetes.io-created-for-pvc-name:pvc-sq5md kubernetes.io-created-for-pvc-namespace:azuredisk-5561]) successfully
I0726 02:40:37.483276       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-1"}},{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2"}},{"segments":{"topology.disk.csi.azure.com/zone":"westus2-3"}},{"segments":{"topology.disk.csi.azure.com/zone":""}}],"capacity_bytes":10737418240,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-91236be9-6ec6-44ec-8101-2916dc0a36b5","csi.storage.k8s.io/pvc/name":"pvc-sq5md","csi.storage.k8s.io/pvc/namespace":"azuredisk-5561","requestedsizegib":"10","skuName":"StandardSSD_ZRS"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-91236be9-6ec6-44ec-8101-2916dc0a36b5"}}
I0726 02:40:37.501253       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-7a1dbc87-3a7c-4889-8df0-1b7f88c4fd6f StorageAccountType:StandardSSD_ZRS Size:10
... skipping 11 lines ...
I0726 02:40:38.341866       1 controllerserver.go:479] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-7a1dbc87-3a7c-4889-8df0-1b7f88c4fd6f" to node "k8s-agentpool-31268889-vmss000001"
I0726 02:40:38.341917       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:40:38.342003       1 azure_controller_common.go:233] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-7a1dbc87-3a7c-4889-8df0-1b7f88c4fd6f" lun 0 to node "k8s-agentpool-31268889-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-7a1dbc87-3a7c-4889-8df0-1b7f88c4fd6f:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-7a1dbc87-3a7c-4889-8df0-1b7f88c4fd6f  true false 0})]
I0726 02:40:38.342039       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:40:38.342102       1 azure_controller_vmss.go:120] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-7a1dbc87-3a7c-4889-8df0-1b7f88c4fd6f:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-7a1dbc87-3a7c-4889-8df0-1b7f88c4fd6f  true false 0})])
I0726 02:40:38.342320       1 controllerserver.go:479] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-91236be9-6ec6-44ec-8101-2916dc0a36b5" to node "k8s-agentpool-31268889-vmss000001"
I0726 02:40:48.555762       1 azure_controller_vmss.go:132] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-7a1dbc87-3a7c-4889-8df0-1b7f88c4fd6f:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-7a1dbc87-3a7c-4889-8df0-1b7f88c4fd6f  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I0726 02:40:48.555837       1 controllerserver.go:483] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-7a1dbc87-3a7c-4889-8df0-1b7f88c4fd6f" attached to node "k8s-agentpool-31268889-vmss000001".
I0726 02:40:48.555859       1 controllerserver.go:503] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-7a1dbc87-3a7c-4889-8df0-1b7f88c4fd6f" to node "k8s-agentpool-31268889-vmss000001" successfully
I0726 02:40:48.555896       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
I0726 02:40:48.555996       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:40:48.556019       1 azure_vmss.go:186] Couldn't find VMSS VM with nodeName k8s-agentpool-31268889-vmss000001, refreshing the cache
I0726 02:40:48.563431       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 3 lines ...
I0726 02:40:48.614623       1 azure_controller_common.go:233] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-91236be9-6ec6-44ec-8101-2916dc0a36b5" lun 1 to node "k8s-agentpool-31268889-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-91236be9-6ec6-44ec-8101-2916dc0a36b5:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-91236be9-6ec6-44ec-8101-2916dc0a36b5  true false 1})]
I0726 02:40:48.614693       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:40:48.614747       1 azure_controller_vmss.go:120] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-91236be9-6ec6-44ec-8101-2916dc0a36b5:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-91236be9-6ec6-44ec-8101-2916dc0a36b5  true false 1})])
I0726 02:40:48.614951       1 azure_controller_common.go:425] azureDisk - find disk: lun 0 name "pvc-7a1dbc87-3a7c-4889-8df0-1b7f88c4fd6f" uri "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-7a1dbc87-3a7c-4889-8df0-1b7f88c4fd6f"
I0726 02:40:48.615154       1 controllerserver.go:473] Attach operation is successful. volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-7a1dbc87-3a7c-4889-8df0-1b7f88c4fd6f" is already attached to node "k8s-agentpool-31268889-vmss000001" at lun 0.
I0726 02:40:48.615181       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
I0726 02:40:58.824621       1 azure_controller_vmss.go:132] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-91236be9-6ec6-44ec-8101-2916dc0a36b5:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-91236be9-6ec6-44ec-8101-2916dc0a36b5  true false 1})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I0726 02:40:58.824689       1 controllerserver.go:483] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-91236be9-6ec6-44ec-8101-2916dc0a36b5" attached to node "k8s-agentpool-31268889-vmss000001".
I0726 02:40:58.824710       1 controllerserver.go:503] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-91236be9-6ec6-44ec-8101-2916dc0a36b5" to node "k8s-agentpool-31268889-vmss000001" successfully
I0726 02:40:58.824733       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"1"}}
I0726 02:40:58.836610       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
I0726 02:40:58.836768       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool-31268889-vmss000001","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":1}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-91236be9-6ec6-44ec-8101-2916dc0a36b5","csi.storage.k8s.io/pvc/name":"pvc-sq5md","csi.storage.k8s.io/pvc/namespace":"azuredisk-5561","requestedsizegib":"10","skuName":"StandardSSD_ZRS","storage.kubernetes.io/csiProvisionerIdentity":"1627265933331-8081-disk.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-91236be9-6ec6-44ec-8101-2916dc0a36b5"}
I0726 02:40:58.857925       1 controllerserver.go:458] GetDiskLun returned: <nil>. Initiating attaching volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-91236be9-6ec6-44ec-8101-2916dc0a36b5" to node "k8s-agentpool-31268889-vmss000001".
... skipping 52 lines ...
I0726 02:42:00.700245       1 azure_managedDiskController.go:288] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-91236be9-6ec6-44ec-8101-2916dc0a36b5
I0726 02:42:00.700283       1 controllerserver.go:409] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-91236be9-6ec6-44ec-8101-2916dc0a36b5) returned with <nil>
I0726 02:42:00.700307       1 utils.go:102] GRPC response: {}
I0726 02:42:07.807713       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I0726 02:42:07.807748       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}],"requisite":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}]},"capacity_range":{"required_bytes":10737418240},"name":"pvc-06d2cf38-8d40-43a0-960b-45cb954b40e8","parameters":{"csi.storage.k8s.io/pv/name":"pvc-06d2cf38-8d40-43a0-960b-45cb954b40e8","csi.storage.k8s.io/pvc/name":"pvc-dv25f","csi.storage.k8s.io/pvc/namespace":"azuredisk-4376","skuName":"StandardSSD_ZRS"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":1}}]}
I0726 02:42:07.808198       1 controllerserver.go:253] diskZone(westus2-2) is reset as empty since disk(pvc-06d2cf38-8d40-43a0-960b-45cb954b40e8) is ZRS(StandardSSD_ZRS)
I0726 02:42:07.829292       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-06d2cf38-8d40-43a0-960b-45cb954b40e8, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-06d2cf38-8d40-43a0-960b-45cb954b40e8' under resource group 'kubetest-nnvuhiyw' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I0726 02:42:07.829382       1 controllerserver.go:290] begin to create azure disk(pvc-06d2cf38-8d40-43a0-960b-45cb954b40e8) account type(StandardSSD_ZRS) rg(kubetest-nnvuhiyw) location() size(10) diskZone() maxShares(0)
I0726 02:42:07.829425       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-06d2cf38-8d40-43a0-960b-45cb954b40e8 StorageAccountType:StandardSSD_ZRS Size:10
I0726 02:42:10.135046       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-06d2cf38-8d40-43a0-960b-45cb954b40e8 StorageAccountType:StandardSSD_ZRS Size:10
I0726 02:42:10.135581       1 controllerserver.go:366] create azure disk(pvc-06d2cf38-8d40-43a0-960b-45cb954b40e8) account type(StandardSSD_ZRS) rg(kubetest-nnvuhiyw) location() size(10) tags(map[kubernetes.io-created-for-pv-name:pvc-06d2cf38-8d40-43a0-960b-45cb954b40e8 kubernetes.io-created-for-pvc-name:pvc-dv25f kubernetes.io-created-for-pvc-namespace:azuredisk-4376]) successfully
I0726 02:42:10.135664       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-1"}},{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2"}},{"segments":{"topology.disk.csi.azure.com/zone":"westus2-3"}},{"segments":{"topology.disk.csi.azure.com/zone":""}}],"capacity_bytes":10737418240,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-06d2cf38-8d40-43a0-960b-45cb954b40e8","csi.storage.k8s.io/pvc/name":"pvc-dv25f","csi.storage.k8s.io/pvc/namespace":"azuredisk-4376","requestedsizegib":"10","skuName":"StandardSSD_ZRS"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-06d2cf38-8d40-43a0-960b-45cb954b40e8"}}
I0726 02:42:10.865048       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 3 lines ...
I0726 02:42:10.885059       1 azure_vmss.go:186] Couldn't find VMSS VM with nodeName k8s-agentpool-31268889-vmss000001, refreshing the cache
I0726 02:42:10.950180       1 controllerserver.go:479] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-06d2cf38-8d40-43a0-960b-45cb954b40e8" to node "k8s-agentpool-31268889-vmss000001"
I0726 02:42:10.950225       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:42:10.950252       1 azure_controller_common.go:233] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-06d2cf38-8d40-43a0-960b-45cb954b40e8" lun 0 to node "k8s-agentpool-31268889-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-06d2cf38-8d40-43a0-960b-45cb954b40e8:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-06d2cf38-8d40-43a0-960b-45cb954b40e8  true false 0})]
I0726 02:42:10.950274       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:42:10.950293       1 azure_controller_vmss.go:120] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-06d2cf38-8d40-43a0-960b-45cb954b40e8:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-06d2cf38-8d40-43a0-960b-45cb954b40e8  true false 0})])
I0726 02:42:21.184942       1 azure_controller_vmss.go:132] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-06d2cf38-8d40-43a0-960b-45cb954b40e8:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-06d2cf38-8d40-43a0-960b-45cb954b40e8  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I0726 02:42:21.185005       1 controllerserver.go:483] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-06d2cf38-8d40-43a0-960b-45cb954b40e8" attached to node "k8s-agentpool-31268889-vmss000001".
I0726 02:42:21.185042       1 controllerserver.go:503] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-06d2cf38-8d40-43a0-960b-45cb954b40e8" to node "k8s-agentpool-31268889-vmss000001" successfully
I0726 02:42:21.185064       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
I0726 02:42:21.192741       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
I0726 02:42:21.192759       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool-31268889-vmss000001","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":1}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-06d2cf38-8d40-43a0-960b-45cb954b40e8","csi.storage.k8s.io/pvc/name":"pvc-dv25f","csi.storage.k8s.io/pvc/namespace":"azuredisk-4376","requestedsizegib":"10","skuName":"StandardSSD_ZRS","storage.kubernetes.io/csiProvisionerIdentity":"1627265933331-8081-disk.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-06d2cf38-8d40-43a0-960b-45cb954b40e8"}
I0726 02:42:21.214244       1 controllerserver.go:458] GetDiskLun returned: <nil>. Initiating attaching volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-06d2cf38-8d40-43a0-960b-45cb954b40e8" to node "k8s-agentpool-31268889-vmss000001".
... skipping 18 lines ...
I0726 02:42:34.896053       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:42:34.896147       1 azure_controller_vmss.go:164] azureDisk - detach disk: name "pvc-06d2cf38-8d40-43a0-960b-45cb954b40e8" uri "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-06d2cf38-8d40-43a0-960b-45cb954b40e8"
I0726 02:42:34.896169       1 azure_controller_vmss.go:203] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - detach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-06d2cf38-8d40-43a0-960b-45cb954b40e8:pvc-06d2cf38-8d40-43a0-960b-45cb954b40e8])
I0726 02:42:47.109526       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I0726 02:42:47.109551       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}],"requisite":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}]},"capacity_range":{"required_bytes":10737418240},"name":"pvc-75993b1a-2bb0-44e0-a1c5-fbd197fd6d4b","parameters":{"csi.storage.k8s.io/pv/name":"pvc-75993b1a-2bb0-44e0-a1c5-fbd197fd6d4b","csi.storage.k8s.io/pvc/name":"pvc-z75c2","csi.storage.k8s.io/pvc/namespace":"azuredisk-4376","skuName":"StandardSSD_ZRS"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":1}}],"volume_content_source":{"Type":{"Snapshot":{"snapshot_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/azuredisk-csi-driver-test-1f56cf52-edbb-11eb-9a0b-6215e7e98ebc/providers/Microsoft.Compute/snapshots/snapshot-a6d49af3-cad1-4680-b8b3-2616adf2c294"}}}}
I0726 02:42:47.109854       1 controllerserver.go:253] diskZone(westus2-2) is reset as empty since disk(pvc-75993b1a-2bb0-44e0-a1c5-fbd197fd6d4b) is ZRS(StandardSSD_ZRS)
I0726 02:42:47.129748       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-75993b1a-2bb0-44e0-a1c5-fbd197fd6d4b, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-75993b1a-2bb0-44e0-a1c5-fbd197fd6d4b' under resource group 'kubetest-nnvuhiyw' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I0726 02:42:47.129997       1 controllerserver.go:290] begin to create azure disk(pvc-75993b1a-2bb0-44e0-a1c5-fbd197fd6d4b) account type(StandardSSD_ZRS) rg(kubetest-nnvuhiyw) location() size(10) diskZone() maxShares(0)
I0726 02:42:47.130033       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-75993b1a-2bb0-44e0-a1c5-fbd197fd6d4b StorageAccountType:StandardSSD_ZRS Size:10
I0726 02:42:49.421254       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-75993b1a-2bb0-44e0-a1c5-fbd197fd6d4b StorageAccountType:StandardSSD_ZRS Size:10
I0726 02:42:49.421322       1 controllerserver.go:366] create azure disk(pvc-75993b1a-2bb0-44e0-a1c5-fbd197fd6d4b) account type(StandardSSD_ZRS) rg(kubetest-nnvuhiyw) location() size(10) tags(map[kubernetes.io-created-for-pv-name:pvc-75993b1a-2bb0-44e0-a1c5-fbd197fd6d4b kubernetes.io-created-for-pvc-name:pvc-z75c2 kubernetes.io-created-for-pvc-namespace:azuredisk-4376]) successfully
I0726 02:42:49.421364       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-1"}},{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2"}},{"segments":{"topology.disk.csi.azure.com/zone":"westus2-3"}},{"segments":{"topology.disk.csi.azure.com/zone":""}}],"capacity_bytes":10737418240,"content_source":{"Type":{"Snapshot":{"snapshot_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/azuredisk-csi-driver-test-1f56cf52-edbb-11eb-9a0b-6215e7e98ebc/providers/Microsoft.Compute/snapshots/snapshot-a6d49af3-cad1-4680-b8b3-2616adf2c294"}}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-75993b1a-2bb0-44e0-a1c5-fbd197fd6d4b","csi.storage.k8s.io/pvc/name":"pvc-z75c2","csi.storage.k8s.io/pvc/namespace":"azuredisk-4376","requestedsizegib":"10","skuName":"StandardSSD_ZRS"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-75993b1a-2bb0-44e0-a1c5-fbd197fd6d4b"}}
I0726 02:42:50.116526       1 azure_controller_vmss.go:215] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - detach disk(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-06d2cf38-8d40-43a0-960b-45cb954b40e8:pvc-06d2cf38-8d40-43a0-960b-45cb954b40e8]) returned with <nil>
... skipping 7 lines ...
I0726 02:42:50.169199       1 azure_vmss.go:186] Couldn't find VMSS VM with nodeName k8s-agentpool-31268889-vmss000001, refreshing the cache
I0726 02:42:50.232934       1 controllerserver.go:479] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-75993b1a-2bb0-44e0-a1c5-fbd197fd6d4b" to node "k8s-agentpool-31268889-vmss000001"
I0726 02:42:50.232996       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:42:50.233039       1 azure_controller_common.go:233] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-75993b1a-2bb0-44e0-a1c5-fbd197fd6d4b" lun 0 to node "k8s-agentpool-31268889-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-75993b1a-2bb0-44e0-a1c5-fbd197fd6d4b:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-75993b1a-2bb0-44e0-a1c5-fbd197fd6d4b  true false 0})]
I0726 02:42:50.233086       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:42:50.233125       1 azure_controller_vmss.go:120] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-75993b1a-2bb0-44e0-a1c5-fbd197fd6d4b:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-75993b1a-2bb0-44e0-a1c5-fbd197fd6d4b  true false 0})])
I0726 02:43:00.501090       1 azure_controller_vmss.go:132] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-75993b1a-2bb0-44e0-a1c5-fbd197fd6d4b:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-75993b1a-2bb0-44e0-a1c5-fbd197fd6d4b  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I0726 02:43:00.501228       1 controllerserver.go:483] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-75993b1a-2bb0-44e0-a1c5-fbd197fd6d4b" attached to node "k8s-agentpool-31268889-vmss000001".
I0726 02:43:00.501248       1 controllerserver.go:503] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-75993b1a-2bb0-44e0-a1c5-fbd197fd6d4b" to node "k8s-agentpool-31268889-vmss000001" successfully
I0726 02:43:00.501268       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
I0726 02:43:00.512128       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
I0726 02:43:00.512150       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool-31268889-vmss000001","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":1}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-75993b1a-2bb0-44e0-a1c5-fbd197fd6d4b","csi.storage.k8s.io/pvc/name":"pvc-z75c2","csi.storage.k8s.io/pvc/namespace":"azuredisk-4376","requestedsizegib":"10","skuName":"StandardSSD_ZRS","storage.kubernetes.io/csiProvisionerIdentity":"1627265933331-8081-disk.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-75993b1a-2bb0-44e0-a1c5-fbd197fd6d4b"}
I0726 02:43:00.532254       1 controllerserver.go:458] GetDiskLun returned: <nil>. Initiating attaching volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-75993b1a-2bb0-44e0-a1c5-fbd197fd6d4b" to node "k8s-agentpool-31268889-vmss000001".
... skipping 44 lines ...
I0726 02:44:42.709959       1 azure_managedDiskController.go:288] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-06d2cf38-8d40-43a0-960b-45cb954b40e8
I0726 02:44:42.709985       1 controllerserver.go:409] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-06d2cf38-8d40-43a0-960b-45cb954b40e8) returned with <nil>
I0726 02:44:42.710172       1 utils.go:102] GRPC response: {}
I0726 02:44:49.516929       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I0726 02:44:49.516949       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}],"requisite":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}]},"capacity_range":{"required_bytes":10737418240},"name":"pvc-7f25c968-6a99-43f0-8c55-22298000d877","parameters":{"csi.storage.k8s.io/pv/name":"pvc-7f25c968-6a99-43f0-8c55-22298000d877","csi.storage.k8s.io/pvc/name":"pvc-fvg9s","csi.storage.k8s.io/pvc/namespace":"azuredisk-1577","skuName":"StandardSSD_ZRS"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":1}}]}
I0726 02:44:49.517138       1 controllerserver.go:253] diskZone(westus2-2) is reset as empty since disk(pvc-7f25c968-6a99-43f0-8c55-22298000d877) is ZRS(StandardSSD_ZRS)
I0726 02:44:49.537355       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-7f25c968-6a99-43f0-8c55-22298000d877, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-7f25c968-6a99-43f0-8c55-22298000d877' under resource group 'kubetest-nnvuhiyw' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I0726 02:44:49.537456       1 controllerserver.go:290] begin to create azure disk(pvc-7f25c968-6a99-43f0-8c55-22298000d877) account type(StandardSSD_ZRS) rg(kubetest-nnvuhiyw) location() size(10) diskZone() maxShares(0)
I0726 02:44:49.537491       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-7f25c968-6a99-43f0-8c55-22298000d877 StorageAccountType:StandardSSD_ZRS Size:10
I0726 02:44:51.806457       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-7f25c968-6a99-43f0-8c55-22298000d877 StorageAccountType:StandardSSD_ZRS Size:10
I0726 02:44:51.806520       1 controllerserver.go:366] create azure disk(pvc-7f25c968-6a99-43f0-8c55-22298000d877) account type(StandardSSD_ZRS) rg(kubetest-nnvuhiyw) location() size(10) tags(map[kubernetes.io-created-for-pv-name:pvc-7f25c968-6a99-43f0-8c55-22298000d877 kubernetes.io-created-for-pvc-name:pvc-fvg9s kubernetes.io-created-for-pvc-namespace:azuredisk-1577]) successfully
I0726 02:44:51.806557       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-1"}},{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2"}},{"segments":{"topology.disk.csi.azure.com/zone":"westus2-3"}},{"segments":{"topology.disk.csi.azure.com/zone":""}}],"capacity_bytes":10737418240,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-7f25c968-6a99-43f0-8c55-22298000d877","csi.storage.k8s.io/pvc/name":"pvc-fvg9s","csi.storage.k8s.io/pvc/namespace":"azuredisk-1577","requestedsizegib":"10","skuName":"StandardSSD_ZRS"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-7f25c968-6a99-43f0-8c55-22298000d877"}}
I0726 02:44:52.621268       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 3 lines ...
I0726 02:44:52.644336       1 azure_vmss.go:186] Couldn't find VMSS VM with nodeName k8s-agentpool-31268889-vmss000001, refreshing the cache
I0726 02:44:52.710502       1 controllerserver.go:479] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-7f25c968-6a99-43f0-8c55-22298000d877" to node "k8s-agentpool-31268889-vmss000001"
I0726 02:44:52.710615       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:44:52.710679       1 azure_controller_common.go:233] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-7f25c968-6a99-43f0-8c55-22298000d877" lun 0 to node "k8s-agentpool-31268889-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-7f25c968-6a99-43f0-8c55-22298000d877:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-7f25c968-6a99-43f0-8c55-22298000d877  true false 0})]
I0726 02:44:52.710716       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:44:52.710771       1 azure_controller_vmss.go:120] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-7f25c968-6a99-43f0-8c55-22298000d877:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-7f25c968-6a99-43f0-8c55-22298000d877  true false 0})])
I0726 02:45:02.949358       1 azure_controller_vmss.go:132] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-7f25c968-6a99-43f0-8c55-22298000d877:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-7f25c968-6a99-43f0-8c55-22298000d877  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I0726 02:45:02.949663       1 controllerserver.go:483] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-7f25c968-6a99-43f0-8c55-22298000d877" attached to node "k8s-agentpool-31268889-vmss000001".
I0726 02:45:02.949702       1 controllerserver.go:503] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-7f25c968-6a99-43f0-8c55-22298000d877" to node "k8s-agentpool-31268889-vmss000001" successfully
I0726 02:45:02.949766       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
I0726 02:45:02.957158       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
I0726 02:45:02.957176       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool-31268889-vmss000001","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":1}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-7f25c968-6a99-43f0-8c55-22298000d877","csi.storage.k8s.io/pvc/name":"pvc-fvg9s","csi.storage.k8s.io/pvc/namespace":"azuredisk-1577","requestedsizegib":"10","skuName":"StandardSSD_ZRS","storage.kubernetes.io/csiProvisionerIdentity":"1627265933331-8081-disk.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-7f25c968-6a99-43f0-8c55-22298000d877"}
I0726 02:45:02.977998       1 controllerserver.go:458] GetDiskLun returned: <nil>. Initiating attaching volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-7f25c968-6a99-43f0-8c55-22298000d877" to node "k8s-agentpool-31268889-vmss000001".
... skipping 29 lines ...
I0726 02:45:30.322631       1 azure_vmss.go:186] Couldn't find VMSS VM with nodeName k8s-agentpool-31268889-vmss000001, refreshing the cache
I0726 02:45:30.386237       1 controllerserver.go:479] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-7f25c968-6a99-43f0-8c55-22298000d877" to node "k8s-agentpool-31268889-vmss000001"
I0726 02:45:30.386294       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:45:30.386336       1 azure_controller_common.go:233] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-7f25c968-6a99-43f0-8c55-22298000d877" lun 0 to node "k8s-agentpool-31268889-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-7f25c968-6a99-43f0-8c55-22298000d877:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-7f25c968-6a99-43f0-8c55-22298000d877  true false 0})]
I0726 02:45:30.386389       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:45:30.386426       1 azure_controller_vmss.go:120] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-7f25c968-6a99-43f0-8c55-22298000d877:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-7f25c968-6a99-43f0-8c55-22298000d877  true false 0})])
I0726 02:45:40.655763       1 azure_controller_vmss.go:132] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-7f25c968-6a99-43f0-8c55-22298000d877:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-7f25c968-6a99-43f0-8c55-22298000d877  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I0726 02:45:40.655851       1 controllerserver.go:483] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-7f25c968-6a99-43f0-8c55-22298000d877" attached to node "k8s-agentpool-31268889-vmss000001".
I0726 02:45:40.655882       1 controllerserver.go:503] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-7f25c968-6a99-43f0-8c55-22298000d877" to node "k8s-agentpool-31268889-vmss000001" successfully
I0726 02:45:40.655917       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
I0726 02:45:54.999538       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerUnpublishVolume
I0726 02:45:54.999584       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool-31268889-vmss000001","volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-7f25c968-6a99-43f0-8c55-22298000d877"}
I0726 02:45:54.999714       1 controllerserver.go:535] Trying to detach volume /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-7f25c968-6a99-43f0-8c55-22298000d877 from node k8s-agentpool-31268889-vmss000001
... skipping 3 lines ...
I0726 02:45:55.115248       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:45:55.115288       1 azure_controller_vmss.go:164] azureDisk - detach disk: name "pvc-7f25c968-6a99-43f0-8c55-22298000d877" uri "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-7f25c968-6a99-43f0-8c55-22298000d877"
I0726 02:45:55.115317       1 azure_controller_vmss.go:203] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - detach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-7f25c968-6a99-43f0-8c55-22298000d877:pvc-7f25c968-6a99-43f0-8c55-22298000d877])
I0726 02:46:07.824959       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I0726 02:46:07.824980       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}],"requisite":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}]},"capacity_range":{"required_bytes":10737418240},"name":"pvc-41a304b4-8a85-442e-a0b6-1cd84c08ec83","parameters":{"csi.storage.k8s.io/pv/name":"pvc-41a304b4-8a85-442e-a0b6-1cd84c08ec83","csi.storage.k8s.io/pvc/name":"pvc-d7gnf","csi.storage.k8s.io/pvc/namespace":"azuredisk-1577","skuName":"StandardSSD_ZRS"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":1}}],"volume_content_source":{"Type":{"Snapshot":{"snapshot_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/azuredisk-csi-driver-test-80f41c26-edbb-11eb-9a0b-6215e7e98ebc/providers/Microsoft.Compute/snapshots/snapshot-a4d43336-6ec4-48b2-a4e4-f597632fd11f"}}}}
I0726 02:46:07.825366       1 controllerserver.go:253] diskZone(westus2-2) is reset as empty since disk(pvc-41a304b4-8a85-442e-a0b6-1cd84c08ec83) is ZRS(StandardSSD_ZRS)
I0726 02:46:07.843555       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-41a304b4-8a85-442e-a0b6-1cd84c08ec83, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-41a304b4-8a85-442e-a0b6-1cd84c08ec83' under resource group 'kubetest-nnvuhiyw' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I0726 02:46:07.843614       1 controllerserver.go:290] begin to create azure disk(pvc-41a304b4-8a85-442e-a0b6-1cd84c08ec83) account type(StandardSSD_ZRS) rg(kubetest-nnvuhiyw) location() size(10) diskZone() maxShares(0)
I0726 02:46:07.843637       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-41a304b4-8a85-442e-a0b6-1cd84c08ec83 StorageAccountType:StandardSSD_ZRS Size:10
I0726 02:46:10.101475       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-41a304b4-8a85-442e-a0b6-1cd84c08ec83 StorageAccountType:StandardSSD_ZRS Size:10
I0726 02:46:10.101543       1 controllerserver.go:366] create azure disk(pvc-41a304b4-8a85-442e-a0b6-1cd84c08ec83) account type(StandardSSD_ZRS) rg(kubetest-nnvuhiyw) location() size(10) tags(map[kubernetes.io-created-for-pv-name:pvc-41a304b4-8a85-442e-a0b6-1cd84c08ec83 kubernetes.io-created-for-pvc-name:pvc-d7gnf kubernetes.io-created-for-pvc-namespace:azuredisk-1577]) successfully
I0726 02:46:10.101582       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-1"}},{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2"}},{"segments":{"topology.disk.csi.azure.com/zone":"westus2-3"}},{"segments":{"topology.disk.csi.azure.com/zone":""}}],"capacity_bytes":10737418240,"content_source":{"Type":{"Snapshot":{"snapshot_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/azuredisk-csi-driver-test-80f41c26-edbb-11eb-9a0b-6215e7e98ebc/providers/Microsoft.Compute/snapshots/snapshot-a4d43336-6ec4-48b2-a4e4-f597632fd11f"}}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-41a304b4-8a85-442e-a0b6-1cd84c08ec83","csi.storage.k8s.io/pvc/name":"pvc-d7gnf","csi.storage.k8s.io/pvc/namespace":"azuredisk-1577","requestedsizegib":"10","skuName":"StandardSSD_ZRS"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-41a304b4-8a85-442e-a0b6-1cd84c08ec83"}}
I0726 02:46:10.334822       1 azure_controller_vmss.go:215] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - detach disk(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-7f25c968-6a99-43f0-8c55-22298000d877:pvc-7f25c968-6a99-43f0-8c55-22298000d877]) returned with <nil>
... skipping 7 lines ...
I0726 02:46:10.902251       1 azure_vmss.go:186] Couldn't find VMSS VM with nodeName k8s-agentpool-31268889-vmss000001, refreshing the cache
I0726 02:46:10.961717       1 controllerserver.go:479] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-41a304b4-8a85-442e-a0b6-1cd84c08ec83" to node "k8s-agentpool-31268889-vmss000001"
I0726 02:46:10.961758       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:46:10.961781       1 azure_controller_common.go:233] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-41a304b4-8a85-442e-a0b6-1cd84c08ec83" lun 0 to node "k8s-agentpool-31268889-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-41a304b4-8a85-442e-a0b6-1cd84c08ec83:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-41a304b4-8a85-442e-a0b6-1cd84c08ec83  true false 0})]
I0726 02:46:10.961808       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:46:10.961825       1 azure_controller_vmss.go:120] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-41a304b4-8a85-442e-a0b6-1cd84c08ec83:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-41a304b4-8a85-442e-a0b6-1cd84c08ec83  true false 0})])
I0726 02:46:21.169652       1 azure_controller_vmss.go:132] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-41a304b4-8a85-442e-a0b6-1cd84c08ec83:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-41a304b4-8a85-442e-a0b6-1cd84c08ec83  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I0726 02:46:21.169741       1 controllerserver.go:483] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-41a304b4-8a85-442e-a0b6-1cd84c08ec83" attached to node "k8s-agentpool-31268889-vmss000001".
I0726 02:46:21.169773       1 controllerserver.go:503] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-41a304b4-8a85-442e-a0b6-1cd84c08ec83" to node "k8s-agentpool-31268889-vmss000001" successfully
I0726 02:46:21.169820       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
I0726 02:46:35.063209       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerUnpublishVolume
I0726 02:46:35.063233       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool-31268889-vmss000001","volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-41a304b4-8a85-442e-a0b6-1cd84c08ec83"}
I0726 02:46:35.063362       1 controllerserver.go:535] Trying to detach volume /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-41a304b4-8a85-442e-a0b6-1cd84c08ec83 from node k8s-agentpool-31268889-vmss000001
... skipping 36 lines ...
I0726 02:47:58.820281       1 controllerserver.go:407] deleting azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-7f25c968-6a99-43f0-8c55-22298000d877)
I0726 02:48:03.968908       1 azure_managedDiskController.go:288] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-7f25c968-6a99-43f0-8c55-22298000d877
I0726 02:48:03.968955       1 controllerserver.go:409] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-7f25c968-6a99-43f0-8c55-22298000d877) returned with <nil>
I0726 02:48:03.968980       1 utils.go:102] GRPC response: {}
I0726 02:48:11.024637       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I0726 02:48:11.024796       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}],"requisite":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}]},"capacity_range":{"required_bytes":10737418240},"name":"pvc-b1795e63-2c1c-4af9-9219-a500231b334b","parameters":{"csi.storage.k8s.io/pv/name":"pvc-b1795e63-2c1c-4af9-9219-a500231b334b","csi.storage.k8s.io/pvc/name":"pvc-m9l5k","csi.storage.k8s.io/pvc/namespace":"azuredisk-953","skuName":"Standard_LRS"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":1}}]}
I0726 02:48:11.045163       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-b1795e63-2c1c-4af9-9219-a500231b334b, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-b1795e63-2c1c-4af9-9219-a500231b334b' under resource group 'kubetest-nnvuhiyw' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I0726 02:48:11.045454       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I0726 02:48:11.045551       1 controllerserver.go:290] begin to create azure disk(pvc-b1795e63-2c1c-4af9-9219-a500231b334b) account type(Standard_LRS) rg(kubetest-nnvuhiyw) location() size(10) diskZone(westus2-2) maxShares(0)
I0726 02:48:11.045630       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-b1795e63-2c1c-4af9-9219-a500231b334b StorageAccountType:Standard_LRS Size:10
I0726 02:48:11.045577       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}],"requisite":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}]},"capacity_range":{"required_bytes":10737418240},"name":"pvc-1b14da6d-e662-4e18-a1bb-c63cb499986a","parameters":{"csi.storage.k8s.io/pv/name":"pvc-1b14da6d-e662-4e18-a1bb-c63cb499986a","csi.storage.k8s.io/pvc/name":"pvc-fj9wm","csi.storage.k8s.io/pvc/namespace":"azuredisk-953","skuName":"Premium_LRS"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":1}}]}
I0726 02:48:11.060154       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I0726 02:48:11.060172       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}],"requisite":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}]},"capacity_range":{"required_bytes":10737418240},"name":"pvc-c6eaa895-d244-4aaa-97de-f34fbd02bcf0","parameters":{"csi.storage.k8s.io/pv/name":"pvc-c6eaa895-d244-4aaa-97de-f34fbd02bcf0","csi.storage.k8s.io/pvc/name":"pvc-rgjcg","csi.storage.k8s.io/pvc/namespace":"azuredisk-953","skuName":"StandardSSD_LRS"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":1}}]}
I0726 02:48:11.206179       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-1b14da6d-e662-4e18-a1bb-c63cb499986a, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-1b14da6d-e662-4e18-a1bb-c63cb499986a' under resource group 'kubetest-nnvuhiyw' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I0726 02:48:11.206514       1 controllerserver.go:290] begin to create azure disk(pvc-1b14da6d-e662-4e18-a1bb-c63cb499986a) account type(Premium_LRS) rg(kubetest-nnvuhiyw) location() size(10) diskZone(westus2-2) maxShares(0)
I0726 02:48:11.206926       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-1b14da6d-e662-4e18-a1bb-c63cb499986a StorageAccountType:Premium_LRS Size:10
I0726 02:48:11.238585       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-c6eaa895-d244-4aaa-97de-f34fbd02bcf0, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-c6eaa895-d244-4aaa-97de-f34fbd02bcf0' under resource group 'kubetest-nnvuhiyw' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I0726 02:48:11.238644       1 controllerserver.go:290] begin to create azure disk(pvc-c6eaa895-d244-4aaa-97de-f34fbd02bcf0) account type(StandardSSD_LRS) rg(kubetest-nnvuhiyw) location() size(10) diskZone(westus2-2) maxShares(0)
I0726 02:48:11.238791       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-c6eaa895-d244-4aaa-97de-f34fbd02bcf0 StorageAccountType:StandardSSD_LRS Size:10
I0726 02:48:13.355947       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-b1795e63-2c1c-4af9-9219-a500231b334b StorageAccountType:Standard_LRS Size:10
I0726 02:48:13.355997       1 controllerserver.go:366] create azure disk(pvc-b1795e63-2c1c-4af9-9219-a500231b334b) account type(Standard_LRS) rg(kubetest-nnvuhiyw) location() size(10) tags(map[kubernetes.io-created-for-pv-name:pvc-b1795e63-2c1c-4af9-9219-a500231b334b kubernetes.io-created-for-pvc-name:pvc-m9l5k kubernetes.io-created-for-pvc-namespace:azuredisk-953]) successfully
I0726 02:48:13.356027       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2"}}],"capacity_bytes":10737418240,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-b1795e63-2c1c-4af9-9219-a500231b334b","csi.storage.k8s.io/pvc/name":"pvc-m9l5k","csi.storage.k8s.io/pvc/namespace":"azuredisk-953","requestedsizegib":"10","skuName":"Standard_LRS"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-b1795e63-2c1c-4af9-9219-a500231b334b"}}
I0726 02:48:13.554629       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-c6eaa895-d244-4aaa-97de-f34fbd02bcf0 StorageAccountType:StandardSSD_LRS Size:10
... skipping 19 lines ...
I0726 02:48:14.312761       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:48:14.312834       1 azure_controller_common.go:233] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-b1795e63-2c1c-4af9-9219-a500231b334b" lun 0 to node "k8s-agentpool-31268889-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-b1795e63-2c1c-4af9-9219-a500231b334b:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-b1795e63-2c1c-4af9-9219-a500231b334b  true false 0})]
I0726 02:48:14.312867       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:48:14.312921       1 azure_controller_vmss.go:120] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-b1795e63-2c1c-4af9-9219-a500231b334b:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-b1795e63-2c1c-4af9-9219-a500231b334b  true false 0})])
I0726 02:48:14.313264       1 controllerserver.go:479] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-1b14da6d-e662-4e18-a1bb-c63cb499986a" to node "k8s-agentpool-31268889-vmss000001"
I0726 02:48:14.313303       1 controllerserver.go:479] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-c6eaa895-d244-4aaa-97de-f34fbd02bcf0" to node "k8s-agentpool-31268889-vmss000001"
I0726 02:48:24.804474       1 azure_controller_vmss.go:132] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-b1795e63-2c1c-4af9-9219-a500231b334b:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-b1795e63-2c1c-4af9-9219-a500231b334b  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I0726 02:48:24.804568       1 controllerserver.go:483] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-b1795e63-2c1c-4af9-9219-a500231b334b" attached to node "k8s-agentpool-31268889-vmss000001".
I0726 02:48:24.804591       1 controllerserver.go:503] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-b1795e63-2c1c-4af9-9219-a500231b334b" to node "k8s-agentpool-31268889-vmss000001" successfully
I0726 02:48:24.804617       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
I0726 02:48:24.806287       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:48:24.806317       1 azure_vmss.go:186] Couldn't find VMSS VM with nodeName k8s-agentpool-31268889-vmss000001, refreshing the cache
I0726 02:48:24.873289       1 azure_controller_common.go:233] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-1b14da6d-e662-4e18-a1bb-c63cb499986a" lun 2 to node "k8s-agentpool-31268889-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-1b14da6d-e662-4e18-a1bb-c63cb499986a:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-1b14da6d-e662-4e18-a1bb-c63cb499986a  true false 2}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-c6eaa895-d244-4aaa-97de-f34fbd02bcf0:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-c6eaa895-d244-4aaa-97de-f34fbd02bcf0  true false 1})]
I0726 02:48:24.873334       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:48:24.873391       1 azure_controller_vmss.go:120] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-1b14da6d-e662-4e18-a1bb-c63cb499986a:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-1b14da6d-e662-4e18-a1bb-c63cb499986a  true false 2}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-c6eaa895-d244-4aaa-97de-f34fbd02bcf0:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-c6eaa895-d244-4aaa-97de-f34fbd02bcf0  true false 1})])
I0726 02:48:35.368059       1 azure_controller_vmss.go:132] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-1b14da6d-e662-4e18-a1bb-c63cb499986a:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-1b14da6d-e662-4e18-a1bb-c63cb499986a  true false 2}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-c6eaa895-d244-4aaa-97de-f34fbd02bcf0:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-c6eaa895-d244-4aaa-97de-f34fbd02bcf0  true false 1})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I0726 02:48:35.368491       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:48:35.368531       1 azure_vmss.go:186] Couldn't find VMSS VM with nodeName k8s-agentpool-31268889-vmss000001, refreshing the cache
I0726 02:48:35.368837       1 controllerserver.go:483] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-1b14da6d-e662-4e18-a1bb-c63cb499986a" attached to node "k8s-agentpool-31268889-vmss000001".
I0726 02:48:35.368887       1 controllerserver.go:503] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-1b14da6d-e662-4e18-a1bb-c63cb499986a" to node "k8s-agentpool-31268889-vmss000001" successfully
I0726 02:48:35.368958       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"2"}}
I0726 02:48:35.380632       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 84 lines ...
I0726 02:50:02.027348       1 controllerserver.go:407] deleting azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-b1795e63-2c1c-4af9-9219-a500231b334b)
I0726 02:50:07.171716       1 azure_managedDiskController.go:288] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-b1795e63-2c1c-4af9-9219-a500231b334b
I0726 02:50:07.171763       1 controllerserver.go:409] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-b1795e63-2c1c-4af9-9219-a500231b334b) returned with <nil>
I0726 02:50:07.171829       1 utils.go:102] GRPC response: {}
I0726 02:50:13.938451       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I0726 02:50:13.938585       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}],"requisite":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}]},"capacity_range":{"required_bytes":10737418240},"name":"pvc-0b526ed1-8134-4920-b2d6-c239fb92a6a2","parameters":{"csi.storage.k8s.io/pv/name":"pvc-0b526ed1-8134-4920-b2d6-c239fb92a6a2","csi.storage.k8s.io/pvc/name":"pvc-azuredisk-volume-tester-jgkm6-0","csi.storage.k8s.io/pvc/namespace":"azuredisk-3033","skuName":"StandardSSD_LRS"},"volume_capabilities":[{"AccessType":{"Mount":{"mount_flags":["barrier=1","acl"]}},"access_mode":{"mode":1}}]}
I0726 02:50:13.958473       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-0b526ed1-8134-4920-b2d6-c239fb92a6a2, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-0b526ed1-8134-4920-b2d6-c239fb92a6a2' under resource group 'kubetest-nnvuhiyw' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I0726 02:50:13.958667       1 controllerserver.go:290] begin to create azure disk(pvc-0b526ed1-8134-4920-b2d6-c239fb92a6a2) account type(StandardSSD_LRS) rg(kubetest-nnvuhiyw) location() size(10) diskZone(westus2-2) maxShares(0)
I0726 02:50:13.958700       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-0b526ed1-8134-4920-b2d6-c239fb92a6a2 StorageAccountType:StandardSSD_LRS Size:10
I0726 02:50:16.300502       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-0b526ed1-8134-4920-b2d6-c239fb92a6a2 StorageAccountType:StandardSSD_LRS Size:10
I0726 02:50:16.300548       1 controllerserver.go:366] create azure disk(pvc-0b526ed1-8134-4920-b2d6-c239fb92a6a2) account type(StandardSSD_LRS) rg(kubetest-nnvuhiyw) location() size(10) tags(map[kubernetes.io-created-for-pv-name:pvc-0b526ed1-8134-4920-b2d6-c239fb92a6a2 kubernetes.io-created-for-pvc-name:pvc-azuredisk-volume-tester-jgkm6-0 kubernetes.io-created-for-pvc-namespace:azuredisk-3033]) successfully
I0726 02:50:16.300584       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2"}}],"capacity_bytes":10737418240,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-0b526ed1-8134-4920-b2d6-c239fb92a6a2","csi.storage.k8s.io/pvc/name":"pvc-azuredisk-volume-tester-jgkm6-0","csi.storage.k8s.io/pvc/namespace":"azuredisk-3033","requestedsizegib":"10","skuName":"StandardSSD_LRS"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-0b526ed1-8134-4920-b2d6-c239fb92a6a2"}}
I0726 02:50:17.010694       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 3 lines ...
I0726 02:50:17.032098       1 azure_vmss.go:186] Couldn't find VMSS VM with nodeName k8s-agentpool-31268889-vmss000001, refreshing the cache
I0726 02:50:17.105643       1 controllerserver.go:479] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-0b526ed1-8134-4920-b2d6-c239fb92a6a2" to node "k8s-agentpool-31268889-vmss000001"
I0726 02:50:17.105787       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:50:17.105816       1 azure_controller_common.go:233] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-0b526ed1-8134-4920-b2d6-c239fb92a6a2" lun 0 to node "k8s-agentpool-31268889-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-0b526ed1-8134-4920-b2d6-c239fb92a6a2:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-0b526ed1-8134-4920-b2d6-c239fb92a6a2  true false 0})]
I0726 02:50:17.105863       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:50:17.105888       1 azure_controller_vmss.go:120] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-0b526ed1-8134-4920-b2d6-c239fb92a6a2:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-0b526ed1-8134-4920-b2d6-c239fb92a6a2  true false 0})])
I0726 02:50:27.333786       1 azure_controller_vmss.go:132] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-0b526ed1-8134-4920-b2d6-c239fb92a6a2:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-0b526ed1-8134-4920-b2d6-c239fb92a6a2  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I0726 02:50:27.333878       1 controllerserver.go:483] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-0b526ed1-8134-4920-b2d6-c239fb92a6a2" attached to node "k8s-agentpool-31268889-vmss000001".
I0726 02:50:27.334262       1 controllerserver.go:503] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-0b526ed1-8134-4920-b2d6-c239fb92a6a2" to node "k8s-agentpool-31268889-vmss000001" successfully
I0726 02:50:27.334314       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
I0726 02:50:56.323553       1 azure_vmss.go:282] Couldn't find VMSS VM with scaleSetName "k8s-agentpool-31268889-vmss" and instanceID "1", refreshing the cache
I0726 02:51:15.296394       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerUnpublishVolume
I0726 02:51:15.296417       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool-31268889-vmss000001","volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-0b526ed1-8134-4920-b2d6-c239fb92a6a2"}
... skipping 21 lines ...
I0726 02:53:09.350253       1 azure_vmss.go:186] Couldn't find VMSS VM with nodeName k8s-agentpool-31268889-vmss000001, refreshing the cache
I0726 02:53:09.434721       1 controllerserver.go:479] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-0b526ed1-8134-4920-b2d6-c239fb92a6a2" to node "k8s-agentpool-31268889-vmss000001"
I0726 02:53:09.434764       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:53:09.434793       1 azure_controller_common.go:233] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-0b526ed1-8134-4920-b2d6-c239fb92a6a2" lun 0 to node "k8s-agentpool-31268889-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-0b526ed1-8134-4920-b2d6-c239fb92a6a2:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-0b526ed1-8134-4920-b2d6-c239fb92a6a2  true false 0})]
I0726 02:53:09.434822       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:53:09.434845       1 azure_controller_vmss.go:120] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-0b526ed1-8134-4920-b2d6-c239fb92a6a2:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-0b526ed1-8134-4920-b2d6-c239fb92a6a2  true false 0})])
I0726 02:53:19.701283       1 azure_controller_vmss.go:132] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-0b526ed1-8134-4920-b2d6-c239fb92a6a2:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-0b526ed1-8134-4920-b2d6-c239fb92a6a2  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I0726 02:53:19.701339       1 controllerserver.go:483] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-0b526ed1-8134-4920-b2d6-c239fb92a6a2" attached to node "k8s-agentpool-31268889-vmss000001".
I0726 02:53:19.701353       1 controllerserver.go:503] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-0b526ed1-8134-4920-b2d6-c239fb92a6a2" to node "k8s-agentpool-31268889-vmss000001" successfully
I0726 02:53:19.701367       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
I0726 02:53:19.707993       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
I0726 02:53:19.708010       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool-31268889-vmss000001","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4","mount_flags":["barrier=1","acl"]}},"access_mode":{"mode":1}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-0b526ed1-8134-4920-b2d6-c239fb92a6a2","csi.storage.k8s.io/pvc/name":"pvc-azuredisk-volume-tester-jgkm6-0","csi.storage.k8s.io/pvc/namespace":"azuredisk-3033","requestedsizegib":"10","skuName":"StandardSSD_LRS","storage.kubernetes.io/csiProvisionerIdentity":"1627265933331-8081-disk.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-0b526ed1-8134-4920-b2d6-c239fb92a6a2"}
I0726 02:53:19.734925       1 controllerserver.go:458] GetDiskLun returned: <nil>. Initiating attaching volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-0b526ed1-8134-4920-b2d6-c239fb92a6a2" to node "k8s-agentpool-31268889-vmss000001".
... skipping 2 lines ...
I0726 02:53:19.795379       1 azure_controller_common.go:425] azureDisk - find disk: lun 0 name "pvc-0b526ed1-8134-4920-b2d6-c239fb92a6a2" uri "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-0b526ed1-8134-4920-b2d6-c239fb92a6a2"
I0726 02:53:19.795453       1 controllerserver.go:473] Attach operation is successful. volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-0b526ed1-8134-4920-b2d6-c239fb92a6a2" is already attached to node "k8s-agentpool-31268889-vmss000001" at lun 0.
I0726 02:53:19.795474       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
I0726 02:53:41.553026       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I0726 02:53:41.553045       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}],"requisite":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}]},"capacity_range":{"required_bytes":10737418240},"name":"pvc-193cfbf1-b619-46b4-a36a-31ccb1fa9b3f","parameters":{"csi.storage.k8s.io/pv/name":"pvc-193cfbf1-b619-46b4-a36a-31ccb1fa9b3f","csi.storage.k8s.io/pvc/name":"pvc-s8k24","csi.storage.k8s.io/pvc/namespace":"azuredisk-2546","skuName":"StandardSSD_ZRS","tags":"disk=test"},"volume_capabilities":[{"AccessType":{"Mount":{"mount_flags":["barrier=1","acl"]}},"access_mode":{"mode":1}}]}
I0726 02:53:41.553335       1 controllerserver.go:253] diskZone(westus2-2) is reset as empty since disk(pvc-193cfbf1-b619-46b4-a36a-31ccb1fa9b3f) is ZRS(StandardSSD_ZRS)
I0726 02:53:41.578135       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-193cfbf1-b619-46b4-a36a-31ccb1fa9b3f, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-193cfbf1-b619-46b4-a36a-31ccb1fa9b3f' under resource group 'kubetest-nnvuhiyw' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I0726 02:53:41.578339       1 controllerserver.go:290] begin to create azure disk(pvc-193cfbf1-b619-46b4-a36a-31ccb1fa9b3f) account type(StandardSSD_ZRS) rg(kubetest-nnvuhiyw) location() size(10) diskZone() maxShares(0)
I0726 02:53:41.578421       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-193cfbf1-b619-46b4-a36a-31ccb1fa9b3f StorageAccountType:StandardSSD_ZRS Size:10
I0726 02:53:43.885678       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-193cfbf1-b619-46b4-a36a-31ccb1fa9b3f StorageAccountType:StandardSSD_ZRS Size:10
I0726 02:53:43.885717       1 controllerserver.go:366] create azure disk(pvc-193cfbf1-b619-46b4-a36a-31ccb1fa9b3f) account type(StandardSSD_ZRS) rg(kubetest-nnvuhiyw) location() size(10) tags(map[disk:test kubernetes.io-created-for-pv-name:pvc-193cfbf1-b619-46b4-a36a-31ccb1fa9b3f kubernetes.io-created-for-pvc-name:pvc-s8k24 kubernetes.io-created-for-pvc-namespace:azuredisk-2546]) successfully
I0726 02:53:43.885904       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-1"}},{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2"}},{"segments":{"topology.disk.csi.azure.com/zone":"westus2-3"}},{"segments":{"topology.disk.csi.azure.com/zone":""}}],"capacity_bytes":10737418240,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-193cfbf1-b619-46b4-a36a-31ccb1fa9b3f","csi.storage.k8s.io/pvc/name":"pvc-s8k24","csi.storage.k8s.io/pvc/namespace":"azuredisk-2546","requestedsizegib":"10","skuName":"StandardSSD_ZRS","tags":"disk=test"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-193cfbf1-b619-46b4-a36a-31ccb1fa9b3f"}}
I0726 02:53:44.633734       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 2 lines ...
I0726 02:53:44.655387       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:53:44.655418       1 controllerserver.go:479] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-193cfbf1-b619-46b4-a36a-31ccb1fa9b3f" to node "k8s-agentpool-31268889-vmss000001"
I0726 02:53:44.655442       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:53:44.655520       1 azure_controller_common.go:233] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-193cfbf1-b619-46b4-a36a-31ccb1fa9b3f" lun 1 to node "k8s-agentpool-31268889-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-193cfbf1-b619-46b4-a36a-31ccb1fa9b3f:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-193cfbf1-b619-46b4-a36a-31ccb1fa9b3f  true false 1})]
I0726 02:53:44.655605       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:53:44.655689       1 azure_controller_vmss.go:120] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-193cfbf1-b619-46b4-a36a-31ccb1fa9b3f:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-193cfbf1-b619-46b4-a36a-31ccb1fa9b3f  true false 1})])
I0726 02:53:54.913527       1 azure_controller_vmss.go:132] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-193cfbf1-b619-46b4-a36a-31ccb1fa9b3f:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-193cfbf1-b619-46b4-a36a-31ccb1fa9b3f  true false 1})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I0726 02:53:54.913589       1 controllerserver.go:483] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-193cfbf1-b619-46b4-a36a-31ccb1fa9b3f" attached to node "k8s-agentpool-31268889-vmss000001".
I0726 02:53:54.913824       1 controllerserver.go:503] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-193cfbf1-b619-46b4-a36a-31ccb1fa9b3f" to node "k8s-agentpool-31268889-vmss000001" successfully
I0726 02:53:54.913853       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"1"}}
I0726 02:53:56.502216       1 azure_vmss.go:282] Couldn't find VMSS VM with scaleSetName "k8s-agentpool-31268889-vmss" and instanceID "1", refreshing the cache
I0726 02:54:15.353297       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerUnpublishVolume
I0726 02:54:15.353324       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool-31268889-vmss000001","volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-0b526ed1-8134-4920-b2d6-c239fb92a6a2"}
... skipping 32 lines ...
I0726 02:55:13.961527       1 azure_managedDiskController.go:288] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-193cfbf1-b619-46b4-a36a-31ccb1fa9b3f
I0726 02:55:13.961566       1 controllerserver.go:409] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-193cfbf1-b619-46b4-a36a-31ccb1fa9b3f) returned with <nil>
I0726 02:55:13.961590       1 utils.go:102] GRPC response: {}
I0726 02:55:18.920664       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I0726 02:55:18.920697       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}],"requisite":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}]},"capacity_range":{"required_bytes":10737418240},"name":"pvc-03c3e9aa-5255-4251-8642-f0b8d0000170","parameters":{"csi.storage.k8s.io/pv/name":"pvc-03c3e9aa-5255-4251-8642-f0b8d0000170","csi.storage.k8s.io/pvc/name":"pvc-9pf9m","csi.storage.k8s.io/pvc/namespace":"azuredisk-9843","skuName":"StandardSSD_ZRS"},"volume_capabilities":[{"AccessType":{"Mount":{"mount_flags":["barrier=1","acl"]}},"access_mode":{"mode":1}}]}
I0726 02:55:18.921322       1 controllerserver.go:253] diskZone(westus2-2) is reset as empty since disk(pvc-03c3e9aa-5255-4251-8642-f0b8d0000170) is ZRS(StandardSSD_ZRS)
I0726 02:55:18.950706       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-03c3e9aa-5255-4251-8642-f0b8d0000170, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-03c3e9aa-5255-4251-8642-f0b8d0000170' under resource group 'kubetest-nnvuhiyw' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I0726 02:55:18.950776       1 controllerserver.go:290] begin to create azure disk(pvc-03c3e9aa-5255-4251-8642-f0b8d0000170) account type(StandardSSD_ZRS) rg(kubetest-nnvuhiyw) location() size(10) diskZone() maxShares(0)
I0726 02:55:18.950929       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-03c3e9aa-5255-4251-8642-f0b8d0000170 StorageAccountType:StandardSSD_ZRS Size:10
I0726 02:55:21.222547       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-03c3e9aa-5255-4251-8642-f0b8d0000170 StorageAccountType:StandardSSD_ZRS Size:10
I0726 02:55:21.222860       1 controllerserver.go:366] create azure disk(pvc-03c3e9aa-5255-4251-8642-f0b8d0000170) account type(StandardSSD_ZRS) rg(kubetest-nnvuhiyw) location() size(10) tags(map[kubernetes.io-created-for-pv-name:pvc-03c3e9aa-5255-4251-8642-f0b8d0000170 kubernetes.io-created-for-pvc-name:pvc-9pf9m kubernetes.io-created-for-pvc-namespace:azuredisk-9843]) successfully
I0726 02:55:21.222915       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-1"}},{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2"}},{"segments":{"topology.disk.csi.azure.com/zone":"westus2-3"}},{"segments":{"topology.disk.csi.azure.com/zone":""}}],"capacity_bytes":10737418240,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-03c3e9aa-5255-4251-8642-f0b8d0000170","csi.storage.k8s.io/pvc/name":"pvc-9pf9m","csi.storage.k8s.io/pvc/namespace":"azuredisk-9843","requestedsizegib":"10","skuName":"StandardSSD_ZRS"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-03c3e9aa-5255-4251-8642-f0b8d0000170"}}
I0726 02:55:21.978676       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 3 lines ...
I0726 02:55:22.000171       1 azure_vmss.go:186] Couldn't find VMSS VM with nodeName k8s-agentpool-31268889-vmss000001, refreshing the cache
I0726 02:55:22.072259       1 controllerserver.go:479] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-03c3e9aa-5255-4251-8642-f0b8d0000170" to node "k8s-agentpool-31268889-vmss000001"
I0726 02:55:22.072300       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:55:22.072353       1 azure_controller_common.go:233] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-03c3e9aa-5255-4251-8642-f0b8d0000170" lun 0 to node "k8s-agentpool-31268889-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-03c3e9aa-5255-4251-8642-f0b8d0000170:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-03c3e9aa-5255-4251-8642-f0b8d0000170  true false 0})]
I0726 02:55:22.072433       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:55:22.072458       1 azure_controller_vmss.go:120] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-03c3e9aa-5255-4251-8642-f0b8d0000170:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-03c3e9aa-5255-4251-8642-f0b8d0000170  true false 0})])
I0726 02:55:32.324196       1 azure_controller_vmss.go:132] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-03c3e9aa-5255-4251-8642-f0b8d0000170:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-03c3e9aa-5255-4251-8642-f0b8d0000170  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I0726 02:55:32.324380       1 controllerserver.go:483] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-03c3e9aa-5255-4251-8642-f0b8d0000170" attached to node "k8s-agentpool-31268889-vmss000001".
I0726 02:55:32.324449       1 controllerserver.go:503] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-03c3e9aa-5255-4251-8642-f0b8d0000170" to node "k8s-agentpool-31268889-vmss000001" successfully
I0726 02:55:32.324504       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
I0726 02:55:32.333881       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
I0726 02:55:32.333983       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool-31268889-vmss000001","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4","mount_flags":["barrier=1","acl"]}},"access_mode":{"mode":1}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-03c3e9aa-5255-4251-8642-f0b8d0000170","csi.storage.k8s.io/pvc/name":"pvc-9pf9m","csi.storage.k8s.io/pvc/namespace":"azuredisk-9843","requestedsizegib":"10","skuName":"StandardSSD_ZRS","storage.kubernetes.io/csiProvisionerIdentity":"1627265933331-8081-disk.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-03c3e9aa-5255-4251-8642-f0b8d0000170"}
I0726 02:55:32.355936       1 controllerserver.go:458] GetDiskLun returned: <nil>. Initiating attaching volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-03c3e9aa-5255-4251-8642-f0b8d0000170" to node "k8s-agentpool-31268889-vmss000001".
... skipping 19 lines ...
I0726 02:56:32.497987       1 controllerserver.go:407] deleting azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-03c3e9aa-5255-4251-8642-f0b8d0000170)
I0726 02:56:37.697200       1 azure_managedDiskController.go:288] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-03c3e9aa-5255-4251-8642-f0b8d0000170
I0726 02:56:37.697224       1 controllerserver.go:409] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-03c3e9aa-5255-4251-8642-f0b8d0000170) returned with <nil>
I0726 02:56:37.697243       1 utils.go:102] GRPC response: {}
I0726 02:56:41.372762       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I0726 02:56:41.373226       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}],"requisite":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}]},"capacity_range":{"required_bytes":10737418240},"name":"pvc-ed963a1c-c07e-46d0-8da8-9d352faf500c","parameters":{"csi.storage.k8s.io/pv/name":"pvc-ed963a1c-c07e-46d0-8da8-9d352faf500c","csi.storage.k8s.io/pvc/name":"pvc-azuredisk-volume-tester-kvswz-0","csi.storage.k8s.io/pvc/namespace":"azuredisk-1515","skuName":"StandardSSD_LRS"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":1}}]}
I0726 02:56:41.394909       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-ed963a1c-c07e-46d0-8da8-9d352faf500c, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-ed963a1c-c07e-46d0-8da8-9d352faf500c' under resource group 'kubetest-nnvuhiyw' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I0726 02:56:41.395016       1 controllerserver.go:290] begin to create azure disk(pvc-ed963a1c-c07e-46d0-8da8-9d352faf500c) account type(StandardSSD_LRS) rg(kubetest-nnvuhiyw) location() size(10) diskZone(westus2-2) maxShares(0)
I0726 02:56:41.395395       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-ed963a1c-c07e-46d0-8da8-9d352faf500c StorageAccountType:StandardSSD_LRS Size:10
I0726 02:56:43.668820       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-ed963a1c-c07e-46d0-8da8-9d352faf500c StorageAccountType:StandardSSD_LRS Size:10
I0726 02:56:43.668888       1 controllerserver.go:366] create azure disk(pvc-ed963a1c-c07e-46d0-8da8-9d352faf500c) account type(StandardSSD_LRS) rg(kubetest-nnvuhiyw) location() size(10) tags(map[kubernetes.io-created-for-pv-name:pvc-ed963a1c-c07e-46d0-8da8-9d352faf500c kubernetes.io-created-for-pvc-name:pvc-azuredisk-volume-tester-kvswz-0 kubernetes.io-created-for-pvc-namespace:azuredisk-1515]) successfully
I0726 02:56:43.668928       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2"}}],"capacity_bytes":10737418240,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-ed963a1c-c07e-46d0-8da8-9d352faf500c","csi.storage.k8s.io/pvc/name":"pvc-azuredisk-volume-tester-kvswz-0","csi.storage.k8s.io/pvc/namespace":"azuredisk-1515","requestedsizegib":"10","skuName":"StandardSSD_LRS"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-ed963a1c-c07e-46d0-8da8-9d352faf500c"}}
I0726 02:56:44.432859       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 3 lines ...
I0726 02:56:44.454028       1 azure_vmss.go:186] Couldn't find VMSS VM with nodeName k8s-agentpool-31268889-vmss000001, refreshing the cache
I0726 02:56:44.524470       1 controllerserver.go:479] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-ed963a1c-c07e-46d0-8da8-9d352faf500c" to node "k8s-agentpool-31268889-vmss000001"
I0726 02:56:44.524509       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:56:44.524534       1 azure_controller_common.go:233] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-ed963a1c-c07e-46d0-8da8-9d352faf500c" lun 0 to node "k8s-agentpool-31268889-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-ed963a1c-c07e-46d0-8da8-9d352faf500c:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-ed963a1c-c07e-46d0-8da8-9d352faf500c  true false 0})]
I0726 02:56:44.524561       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:56:44.524583       1 azure_controller_vmss.go:120] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-ed963a1c-c07e-46d0-8da8-9d352faf500c:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-ed963a1c-c07e-46d0-8da8-9d352faf500c  true false 0})])
I0726 02:56:54.755061       1 azure_controller_vmss.go:132] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-ed963a1c-c07e-46d0-8da8-9d352faf500c:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-ed963a1c-c07e-46d0-8da8-9d352faf500c  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I0726 02:56:54.755152       1 controllerserver.go:483] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-ed963a1c-c07e-46d0-8da8-9d352faf500c" attached to node "k8s-agentpool-31268889-vmss000001".
I0726 02:56:54.755184       1 controllerserver.go:503] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-ed963a1c-c07e-46d0-8da8-9d352faf500c" to node "k8s-agentpool-31268889-vmss000001" successfully
I0726 02:56:54.755229       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
I0726 02:56:54.763373       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
I0726 02:56:54.763390       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool-31268889-vmss000001","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":1}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-ed963a1c-c07e-46d0-8da8-9d352faf500c","csi.storage.k8s.io/pvc/name":"pvc-azuredisk-volume-tester-kvswz-0","csi.storage.k8s.io/pvc/namespace":"azuredisk-1515","requestedsizegib":"10","skuName":"StandardSSD_LRS","storage.kubernetes.io/csiProvisionerIdentity":"1627265933331-8081-disk.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-ed963a1c-c07e-46d0-8da8-9d352faf500c"}
I0726 02:56:54.784771       1 controllerserver.go:458] GetDiskLun returned: <nil>. Initiating attaching volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-ed963a1c-c07e-46d0-8da8-9d352faf500c" to node "k8s-agentpool-31268889-vmss000001".
... skipping 34 lines ...
I0726 02:58:06.132889       1 azure_vmss.go:186] Couldn't find VMSS VM with nodeName k8s-agentpool-31268889-vmss000001, refreshing the cache
I0726 02:58:06.185974       1 controllerserver.go:479] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-ed963a1c-c07e-46d0-8da8-9d352faf500c" to node "k8s-agentpool-31268889-vmss000001"
I0726 02:58:06.186027       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:58:06.186060       1 azure_controller_common.go:233] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-ed963a1c-c07e-46d0-8da8-9d352faf500c" lun 0 to node "k8s-agentpool-31268889-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-ed963a1c-c07e-46d0-8da8-9d352faf500c:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-ed963a1c-c07e-46d0-8da8-9d352faf500c  true false 0})]
I0726 02:58:06.186094       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:58:06.186123       1 azure_controller_vmss.go:120] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-ed963a1c-c07e-46d0-8da8-9d352faf500c:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-ed963a1c-c07e-46d0-8da8-9d352faf500c  true false 0})])
I0726 02:58:16.422796       1 azure_controller_vmss.go:132] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-ed963a1c-c07e-46d0-8da8-9d352faf500c:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-ed963a1c-c07e-46d0-8da8-9d352faf500c  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I0726 02:58:16.422887       1 controllerserver.go:483] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-ed963a1c-c07e-46d0-8da8-9d352faf500c" attached to node "k8s-agentpool-31268889-vmss000001".
I0726 02:58:16.422922       1 controllerserver.go:503] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-ed963a1c-c07e-46d0-8da8-9d352faf500c" to node "k8s-agentpool-31268889-vmss000001" successfully
I0726 02:58:16.422958       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
I0726 02:58:28.855219       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I0726 02:58:28.855244       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-1","topology.kubernetes.io/zone":"westus2-1"}},{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}],"requisite":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-1","topology.kubernetes.io/zone":"westus2-1"}},{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}]},"capacity_range":{"required_bytes":10737418240},"name":"pvc-ac4d94b5-3325-4f14-b2d7-367e5bdb4c22","parameters":{"csi.storage.k8s.io/pv/name":"pvc-ac4d94b5-3325-4f14-b2d7-367e5bdb4c22","csi.storage.k8s.io/pvc/name":"pvc-8g2w9","csi.storage.k8s.io/pvc/namespace":"azuredisk-8582","skuName":"StandardSSD_ZRS"},"volume_capabilities":[{"AccessType":{"Mount":{"mount_flags":["barrier=1","acl"]}},"access_mode":{"mode":1}}]}
I0726 02:58:28.855519       1 controllerserver.go:253] diskZone(westus2-1) is reset as empty since disk(pvc-ac4d94b5-3325-4f14-b2d7-367e5bdb4c22) is ZRS(StandardSSD_ZRS)
I0726 02:58:28.876699       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-ac4d94b5-3325-4f14-b2d7-367e5bdb4c22, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-ac4d94b5-3325-4f14-b2d7-367e5bdb4c22' under resource group 'kubetest-nnvuhiyw' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I0726 02:58:28.876771       1 controllerserver.go:290] begin to create azure disk(pvc-ac4d94b5-3325-4f14-b2d7-367e5bdb4c22) account type(StandardSSD_ZRS) rg(kubetest-nnvuhiyw) location() size(10) diskZone() maxShares(0)
I0726 02:58:28.876794       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-ac4d94b5-3325-4f14-b2d7-367e5bdb4c22 StorageAccountType:StandardSSD_ZRS Size:10
I0726 02:58:31.156371       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-ac4d94b5-3325-4f14-b2d7-367e5bdb4c22 StorageAccountType:StandardSSD_ZRS Size:10
I0726 02:58:31.156447       1 controllerserver.go:366] create azure disk(pvc-ac4d94b5-3325-4f14-b2d7-367e5bdb4c22) account type(StandardSSD_ZRS) rg(kubetest-nnvuhiyw) location() size(10) tags(map[kubernetes.io-created-for-pv-name:pvc-ac4d94b5-3325-4f14-b2d7-367e5bdb4c22 kubernetes.io-created-for-pvc-name:pvc-8g2w9 kubernetes.io-created-for-pvc-namespace:azuredisk-8582]) successfully
I0726 02:58:31.156480       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-1"}},{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2"}},{"segments":{"topology.disk.csi.azure.com/zone":"westus2-3"}},{"segments":{"topology.disk.csi.azure.com/zone":""}}],"capacity_bytes":10737418240,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-ac4d94b5-3325-4f14-b2d7-367e5bdb4c22","csi.storage.k8s.io/pvc/name":"pvc-8g2w9","csi.storage.k8s.io/pvc/namespace":"azuredisk-8582","requestedsizegib":"10","skuName":"StandardSSD_ZRS"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-ac4d94b5-3325-4f14-b2d7-367e5bdb4c22"}}
I0726 02:58:33.413060       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 3 lines ...
I0726 02:58:33.452198       1 azure_vmss.go:186] Couldn't find VMSS VM with nodeName k8s-agentpool-31268889-vmss000001, refreshing the cache
I0726 02:58:33.520964       1 controllerserver.go:479] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-ac4d94b5-3325-4f14-b2d7-367e5bdb4c22" to node "k8s-agentpool-31268889-vmss000001"
I0726 02:58:33.521022       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:58:33.521064       1 azure_controller_common.go:233] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-ac4d94b5-3325-4f14-b2d7-367e5bdb4c22" lun 1 to node "k8s-agentpool-31268889-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-ac4d94b5-3325-4f14-b2d7-367e5bdb4c22:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-ac4d94b5-3325-4f14-b2d7-367e5bdb4c22  true false 1})]
I0726 02:58:33.521106       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 02:58:33.521179       1 azure_controller_vmss.go:120] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-ac4d94b5-3325-4f14-b2d7-367e5bdb4c22:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-ac4d94b5-3325-4f14-b2d7-367e5bdb4c22  true false 1})])
I0726 02:58:43.766230       1 azure_controller_vmss.go:132] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-ac4d94b5-3325-4f14-b2d7-367e5bdb4c22:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-ac4d94b5-3325-4f14-b2d7-367e5bdb4c22  true false 1})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I0726 02:58:43.766307       1 controllerserver.go:483] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-ac4d94b5-3325-4f14-b2d7-367e5bdb4c22" attached to node "k8s-agentpool-31268889-vmss000001".
I0726 02:58:43.766331       1 controllerserver.go:503] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-ac4d94b5-3325-4f14-b2d7-367e5bdb4c22" to node "k8s-agentpool-31268889-vmss000001" successfully
I0726 02:58:43.766357       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"1"}}
I0726 02:58:43.774487       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
I0726 02:58:43.774505       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool-31268889-vmss000001","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4","mount_flags":["barrier=1","acl"]}},"access_mode":{"mode":1}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-ac4d94b5-3325-4f14-b2d7-367e5bdb4c22","csi.storage.k8s.io/pvc/name":"pvc-8g2w9","csi.storage.k8s.io/pvc/namespace":"azuredisk-8582","requestedsizegib":"10","skuName":"StandardSSD_ZRS","storage.kubernetes.io/csiProvisionerIdentity":"1627265933331-8081-disk.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-ac4d94b5-3325-4f14-b2d7-367e5bdb4c22"}
I0726 02:58:43.795063       1 controllerserver.go:458] GetDiskLun returned: <nil>. Initiating attaching volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-ac4d94b5-3325-4f14-b2d7-367e5bdb4c22" to node "k8s-agentpool-31268889-vmss000001".
... skipping 51 lines ...
I0726 03:00:46.520460       1 controllerserver.go:407] deleting azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-ac4d94b5-3325-4f14-b2d7-367e5bdb4c22)
I0726 03:00:51.684234       1 azure_managedDiskController.go:288] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-ac4d94b5-3325-4f14-b2d7-367e5bdb4c22
I0726 03:00:51.684274       1 controllerserver.go:409] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-ac4d94b5-3325-4f14-b2d7-367e5bdb4c22) returned with <nil>
I0726 03:00:51.684301       1 utils.go:102] GRPC response: {}
I0726 03:00:58.890528       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I0726 03:00:58.890546       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}},{"segments":{"topology.disk.csi.azure.com/zone":"westus2-1","topology.kubernetes.io/zone":"westus2-1"}}],"requisite":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-1","topology.kubernetes.io/zone":"westus2-1"}},{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}]},"capacity_range":{"required_bytes":10737418240},"name":"pvc-2392d42a-598a-417f-b0c0-4dc900a7899e","parameters":{"csi.storage.k8s.io/pv/name":"pvc-2392d42a-598a-417f-b0c0-4dc900a7899e","csi.storage.k8s.io/pvc/name":"pvc-azuredisk","csi.storage.k8s.io/pvc/namespace":"default","skuname":"StandardSSD_LRS"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":1}}]}
I0726 03:00:58.910052       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-2392d42a-598a-417f-b0c0-4dc900a7899e, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-2392d42a-598a-417f-b0c0-4dc900a7899e' under resource group 'kubetest-nnvuhiyw' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I0726 03:00:58.910135       1 controllerserver.go:290] begin to create azure disk(pvc-2392d42a-598a-417f-b0c0-4dc900a7899e) account type(StandardSSD_LRS) rg(kubetest-nnvuhiyw) location() size(10) diskZone(westus2-2) maxShares(0)
I0726 03:00:58.910162       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-2392d42a-598a-417f-b0c0-4dc900a7899e StorageAccountType:StandardSSD_LRS Size:10
I0726 03:01:01.191241       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-2392d42a-598a-417f-b0c0-4dc900a7899e StorageAccountType:StandardSSD_LRS Size:10
I0726 03:01:01.191306       1 controllerserver.go:366] create azure disk(pvc-2392d42a-598a-417f-b0c0-4dc900a7899e) account type(StandardSSD_LRS) rg(kubetest-nnvuhiyw) location() size(10) tags(map[kubernetes.io-created-for-pv-name:pvc-2392d42a-598a-417f-b0c0-4dc900a7899e kubernetes.io-created-for-pvc-name:pvc-azuredisk kubernetes.io-created-for-pvc-namespace:default]) successfully
I0726 03:01:01.191347       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2"}}],"capacity_bytes":10737418240,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-2392d42a-598a-417f-b0c0-4dc900a7899e","csi.storage.k8s.io/pvc/name":"pvc-azuredisk","csi.storage.k8s.io/pvc/namespace":"default","requestedsizegib":"10","skuname":"StandardSSD_LRS"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-2392d42a-598a-417f-b0c0-4dc900a7899e"}}
I0726 03:01:05.349923       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 3 lines ...
I0726 03:01:05.376566       1 azure_vmss.go:186] Couldn't find VMSS VM with nodeName k8s-agentpool-31268889-vmss000001, refreshing the cache
I0726 03:01:05.484306       1 controllerserver.go:479] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-2392d42a-598a-417f-b0c0-4dc900a7899e" to node "k8s-agentpool-31268889-vmss000001"
I0726 03:01:05.484351       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 03:01:05.484620       1 azure_controller_common.go:233] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-2392d42a-598a-417f-b0c0-4dc900a7899e" lun 0 to node "k8s-agentpool-31268889-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-2392d42a-598a-417f-b0c0-4dc900a7899e:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-2392d42a-598a-417f-b0c0-4dc900a7899e  true false 0})]
I0726 03:01:05.484648       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 03:01:05.484735       1 azure_controller_vmss.go:120] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-2392d42a-598a-417f-b0c0-4dc900a7899e:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-2392d42a-598a-417f-b0c0-4dc900a7899e  true false 0})])
I0726 03:01:15.726317       1 azure_controller_vmss.go:132] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-2392d42a-598a-417f-b0c0-4dc900a7899e:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-2392d42a-598a-417f-b0c0-4dc900a7899e  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I0726 03:01:15.726399       1 controllerserver.go:483] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-2392d42a-598a-417f-b0c0-4dc900a7899e" attached to node "k8s-agentpool-31268889-vmss000001".
I0726 03:01:15.726426       1 controllerserver.go:503] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-2392d42a-598a-417f-b0c0-4dc900a7899e" to node "k8s-agentpool-31268889-vmss000001" successfully
I0726 03:01:15.726457       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
I0726 03:01:15.732790       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
I0726 03:01:15.732807       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool-31268889-vmss000001","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":1}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-2392d42a-598a-417f-b0c0-4dc900a7899e","csi.storage.k8s.io/pvc/name":"pvc-azuredisk","csi.storage.k8s.io/pvc/namespace":"default","requestedsizegib":"10","skuname":"StandardSSD_LRS","storage.kubernetes.io/csiProvisionerIdentity":"1627265933331-8081-disk.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-2392d42a-598a-417f-b0c0-4dc900a7899e"}
I0726 03:01:15.759607       1 controllerserver.go:458] GetDiskLun returned: <nil>. Initiating attaching volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-2392d42a-598a-417f-b0c0-4dc900a7899e" to node "k8s-agentpool-31268889-vmss000001".
I0726 03:01:15.759891       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 03:01:15.796243       1 azure_vmss.go:186] Couldn't find VMSS VM with nodeName k8s-agentpool-31268889-vmss000001, refreshing the cache
I0726 03:01:15.864401       1 azure_controller_common.go:425] azureDisk - find disk: lun 0 name "pvc-2392d42a-598a-417f-b0c0-4dc900a7899e" uri "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-2392d42a-598a-417f-b0c0-4dc900a7899e"
I0726 03:01:15.864436       1 controllerserver.go:473] Attach operation is successful. volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-2392d42a-598a-417f-b0c0-4dc900a7899e" is already attached to node "k8s-agentpool-31268889-vmss000001" at lun 0.
I0726 03:01:15.864457       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
I0726 03:01:28.205553       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I0726 03:01:28.205584       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}},{"segments":{"topology.disk.csi.azure.com/zone":"westus2-1","topology.kubernetes.io/zone":"westus2-1"}}],"requisite":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-1","topology.kubernetes.io/zone":"westus2-1"}},{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2","topology.kubernetes.io/zone":"westus2-2"}}]},"capacity_range":{"required_bytes":10737418240},"name":"pvc-10745267-4c03-4cb2-abff-a4c43550c2d7","parameters":{"csi.storage.k8s.io/pv/name":"pvc-10745267-4c03-4cb2-abff-a4c43550c2d7","csi.storage.k8s.io/pvc/name":"persistent-storage-statefulset-azuredisk-0","csi.storage.k8s.io/pvc/namespace":"default","skuname":"StandardSSD_LRS"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":1}}]}
I0726 03:01:28.227973       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-10745267-4c03-4cb2-abff-a4c43550c2d7, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-10745267-4c03-4cb2-abff-a4c43550c2d7' under resource group 'kubetest-nnvuhiyw' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I0726 03:01:28.228033       1 controllerserver.go:290] begin to create azure disk(pvc-10745267-4c03-4cb2-abff-a4c43550c2d7) account type(StandardSSD_LRS) rg(kubetest-nnvuhiyw) location() size(10) diskZone(westus2-2) maxShares(0)
I0726 03:01:28.228057       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-10745267-4c03-4cb2-abff-a4c43550c2d7 StorageAccountType:StandardSSD_LRS Size:10
I0726 03:01:30.492109       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-10745267-4c03-4cb2-abff-a4c43550c2d7 StorageAccountType:StandardSSD_LRS Size:10
I0726 03:01:30.492163       1 controllerserver.go:366] create azure disk(pvc-10745267-4c03-4cb2-abff-a4c43550c2d7) account type(StandardSSD_LRS) rg(kubetest-nnvuhiyw) location() size(10) tags(map[kubernetes.io-created-for-pv-name:pvc-10745267-4c03-4cb2-abff-a4c43550c2d7 kubernetes.io-created-for-pvc-name:persistent-storage-statefulset-azuredisk-0 kubernetes.io-created-for-pvc-namespace:default]) successfully
I0726 03:01:30.492189       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.disk.csi.azure.com/zone":"westus2-2"}}],"capacity_bytes":10737418240,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-10745267-4c03-4cb2-abff-a4c43550c2d7","csi.storage.k8s.io/pvc/name":"persistent-storage-statefulset-azuredisk-0","csi.storage.k8s.io/pvc/namespace":"default","requestedsizegib":"10","skuname":"StandardSSD_LRS"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-10745267-4c03-4cb2-abff-a4c43550c2d7"}}
I0726 03:01:33.330512       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 2 lines ...
I0726 03:01:33.352807       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 03:01:33.352839       1 controllerserver.go:479] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-10745267-4c03-4cb2-abff-a4c43550c2d7" to node "k8s-agentpool-31268889-vmss000001"
I0726 03:01:33.352860       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 03:01:33.352880       1 azure_controller_common.go:233] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-10745267-4c03-4cb2-abff-a4c43550c2d7" lun 1 to node "k8s-agentpool-31268889-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-10745267-4c03-4cb2-abff-a4c43550c2d7:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-10745267-4c03-4cb2-abff-a4c43550c2d7  true false 1})]
I0726 03:01:33.352902       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool-31268889-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I0726 03:01:33.352923       1 azure_controller_vmss.go:120] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-10745267-4c03-4cb2-abff-a4c43550c2d7:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-10745267-4c03-4cb2-abff-a4c43550c2d7  true false 1})])
I0726 03:01:43.604962       1 azure_controller_vmss.go:132] azureDisk - update(kubetest-nnvuhiyw): vm(k8s-agentpool-31268889-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-nnvuhiyw/providers/microsoft.compute/disks/pvc-10745267-4c03-4cb2-abff-a4c43550c2d7:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-10745267-4c03-4cb2-abff-a4c43550c2d7  true false 1})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I0726 03:01:43.605111       1 controllerserver.go:483] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-10745267-4c03-4cb2-abff-a4c43550c2d7" attached to node "k8s-agentpool-31268889-vmss000001".
I0726 03:01:43.605191       1 controllerserver.go:503] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-10745267-4c03-4cb2-abff-a4c43550c2d7" to node "k8s-agentpool-31268889-vmss000001" successfully
I0726 03:01:43.605273       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"1"}}
I0726 03:01:43.613751       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
I0726 03:01:43.613771       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool-31268889-vmss000001","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":1}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-10745267-4c03-4cb2-abff-a4c43550c2d7","csi.storage.k8s.io/pvc/name":"persistent-storage-statefulset-azuredisk-0","csi.storage.k8s.io/pvc/namespace":"default","requestedsizegib":"10","skuname":"StandardSSD_LRS","storage.kubernetes.io/csiProvisionerIdentity":"1627265933331-8081-disk.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-10745267-4c03-4cb2-abff-a4c43550c2d7"}
I0726 03:01:43.635508       1 controllerserver.go:458] GetDiskLun returned: <nil>. Initiating attaching volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-10745267-4c03-4cb2-abff-a4c43550c2d7" to node "k8s-agentpool-31268889-vmss000001".
... skipping 16 lines ...
Go Version: go1.16.6
Platform: linux/amd64
Topology Key: topology.disk.csi.azure.com/zone

Streaming logs below:
I0726 02:18:56.541031       1 azure.go:62] reading cloud config from secret
E0726 02:18:56.575125       1 azure_config.go:45] Failed to get cloud-config from secret: failed to get secret kube-system/azure-cloud-provider: secrets "azure-cloud-provider" not found
I0726 02:18:56.575164       1 azure.go:65] InitializeCloudFromSecret failed with error: InitializeCloudFromSecret: failed to get cloud config from secret kube-system/azure-cloud-provider: failed to get secret kube-system/azure-cloud-provider: secrets "azure-cloud-provider" not found
I0726 02:18:56.575173       1 azure.go:70] could not read cloud config from secret
I0726 02:18:56.575184       1 azure.go:81] use default AZURE_CREDENTIAL_FILE env var: /etc/kubernetes/azure.json
I0726 02:18:56.575219       1 azure.go:92] read cloud config from file: /etc/kubernetes/azure.json successfully
I0726 02:18:56.576122       1 azure_auth.go:234] Using AzurePublicCloud environment
I0726 02:18:56.576187       1 azure_auth.go:119] azure: using client_id+client_secret to retrieve access token
I0726 02:18:56.576210       1 azure.go:678] Azure cloudprovider using try backoff: retries=6, exponent=1.500000, duration=5, jitter=1.000000
... skipping 98 lines ...
Go Version: go1.16.6
Platform: linux/amd64
Topology Key: topology.disk.csi.azure.com/zone

Streaming logs below:
I0726 02:18:50.951603       1 azure.go:62] reading cloud config from secret
E0726 02:18:51.036210       1 azure_config.go:45] Failed to get cloud-config from secret: failed to get secret kube-system/azure-cloud-provider: secrets "azure-cloud-provider" not found
I0726 02:18:51.036280       1 azure.go:65] InitializeCloudFromSecret failed with error: InitializeCloudFromSecret: failed to get cloud config from secret kube-system/azure-cloud-provider: failed to get secret kube-system/azure-cloud-provider: secrets "azure-cloud-provider" not found
I0726 02:18:51.036297       1 azure.go:70] could not read cloud config from secret
I0726 02:18:51.036310       1 azure.go:81] use default AZURE_CREDENTIAL_FILE env var: /etc/kubernetes/azure.json
I0726 02:18:51.036356       1 azure.go:92] read cloud config from file: /etc/kubernetes/azure.json successfully
I0726 02:18:51.038976       1 azure_auth.go:234] Using AzurePublicCloud environment
I0726 02:18:51.039041       1 azure_auth.go:119] azure: using client_id+client_secret to retrieve access token
I0726 02:18:51.039069       1 azure.go:678] Azure cloudprovider using try backoff: retries=6, exponent=1.500000, duration=5, jitter=1.000000
... skipping 136 lines ...
I0726 02:23:38.800885       1 mount_linux.go:446] Attempting to determine if disk "/dev/disk/azure/scsi1/lun0" is formatted using blkid with args: ([-p -s TYPE -s PTTYPE -o export /dev/disk/azure/scsi1/lun0])
I0726 02:23:38.816179       1 mount_linux.go:449] Output: ""
I0726 02:23:38.816206       1 mount_linux.go:408] Disk "/dev/disk/azure/scsi1/lun0" appears to be unformatted, attempting to format as type: "ext4" with options: [-F -m0 /dev/disk/azure/scsi1/lun0]
I0726 02:23:39.513919       1 mount_linux.go:418] Disk successfully formatted (mkfs): ext4 - /dev/disk/azure/scsi1/lun0 /var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-6f4c29a1-b748-4d4a-bfdc-4a0b12f24030/globalmount
I0726 02:23:39.513948       1 mount_linux.go:436] Attempting to mount disk /dev/disk/azure/scsi1/lun0 in ext4 format at /var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-6f4c29a1-b748-4d4a-bfdc-4a0b12f24030/globalmount
I0726 02:23:39.513992       1 mount_linux.go:175] Mounting cmd (mount) with arguments (-t ext4 -o invalid,mount,options,defaults /dev/disk/azure/scsi1/lun0 /var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-6f4c29a1-b748-4d4a-bfdc-4a0b12f24030/globalmount)
E0726 02:23:39.531091       1 mount_linux.go:179] Mount failed: exit status 32
Mounting command: mount
Mounting arguments: -t ext4 -o invalid,mount,options,defaults /dev/disk/azure/scsi1/lun0 /var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-6f4c29a1-b748-4d4a-bfdc-4a0b12f24030/globalmount
Output: mount: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-6f4c29a1-b748-4d4a-bfdc-4a0b12f24030/globalmount: wrong fs type, bad option, bad superblock on /dev/sdc, missing codepage or helper program, or other error.

E0726 02:23:39.531188       1 utils.go:100] GRPC error: rpc error: code = Internal desc = could not format "/dev/disk/azure/scsi1/lun0"(lun: "0"), and mount it at "/var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-6f4c29a1-b748-4d4a-bfdc-4a0b12f24030/globalmount"
I0726 02:23:40.076114       1 utils.go:95] GRPC call: /csi.v1.Node/NodeStageVolume
I0726 02:23:40.076140       1 utils.go:96] GRPC request: {"publish_context":{"LUN":"0"},"staging_target_path":"/var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-6f4c29a1-b748-4d4a-bfdc-4a0b12f24030/globalmount","volume_capability":{"AccessType":{"Mount":{"mount_flags":["invalid","mount","options"]}},"access_mode":{"mode":1}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-6f4c29a1-b748-4d4a-bfdc-4a0b12f24030","csi.storage.k8s.io/pvc/name":"pvc-rnwpx","csi.storage.k8s.io/pvc/namespace":"azuredisk-3274","requestedsizegib":"10","skuName":"StandardSSD_ZRS","storage.kubernetes.io/csiProvisionerIdentity":"1627265933331-8081-disk.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-6f4c29a1-b748-4d4a-bfdc-4a0b12f24030"}
I0726 02:23:41.865992       1 azure_common_linux.go:175] azureDisk - found /dev/disk/azure/scsi1/lun0 by sdc under /dev/disk/azure/scsi1/
I0726 02:23:41.866044       1 nodeserver.go:108] NodeStageVolume: perf optimization is disabled for /dev/disk/azure/scsi1/lun0. perfProfile none accountType StandardSSD_ZRS
I0726 02:23:41.866070       1 nodeserver.go:149] NodeStageVolume: formatting /dev/disk/azure/scsi1/lun0 and mounting at /var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-6f4c29a1-b748-4d4a-bfdc-4a0b12f24030/globalmount with mount options([invalid mount options])
I0726 02:23:41.866102       1 mount_linux.go:446] Attempting to determine if disk "/dev/disk/azure/scsi1/lun0" is formatted using blkid with args: ([-p -s TYPE -s PTTYPE -o export /dev/disk/azure/scsi1/lun0])
I0726 02:23:41.876464       1 mount_linux.go:449] Output: "DEVNAME=/dev/disk/azure/scsi1/lun0\nTYPE=ext4\n"
I0726 02:23:41.876489       1 mount_linux.go:340] Checking for issues with fsck on disk: /dev/disk/azure/scsi1/lun0
I0726 02:23:41.890963       1 mount_linux.go:436] Attempting to mount disk /dev/disk/azure/scsi1/lun0 in ext4 format at /var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-6f4c29a1-b748-4d4a-bfdc-4a0b12f24030/globalmount
I0726 02:23:41.891030       1 mount_linux.go:175] Mounting cmd (mount) with arguments (-t ext4 -o invalid,mount,options,defaults /dev/disk/azure/scsi1/lun0 /var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-6f4c29a1-b748-4d4a-bfdc-4a0b12f24030/globalmount)
E0726 02:23:41.930402       1 mount_linux.go:179] Mount failed: exit status 32
Mounting command: mount
Mounting arguments: -t ext4 -o invalid,mount,options,defaults /dev/disk/azure/scsi1/lun0 /var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-6f4c29a1-b748-4d4a-bfdc-4a0b12f24030/globalmount
Output: mount: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-6f4c29a1-b748-4d4a-bfdc-4a0b12f24030/globalmount: wrong fs type, bad option, bad superblock on /dev/sdc, missing codepage or helper program, or other error.

E0726 02:23:41.930456       1 utils.go:100] GRPC error: rpc error: code = Internal desc = could not format "/dev/disk/azure/scsi1/lun0"(lun: "0"), and mount it at "/var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-6f4c29a1-b748-4d4a-bfdc-4a0b12f24030/globalmount"
I0726 02:23:43.035954       1 utils.go:95] GRPC call: /csi.v1.Node/NodeStageVolume
I0726 02:23:43.035981       1 utils.go:96] GRPC request: {"publish_context":{"LUN":"0"},"staging_target_path":"/var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-6f4c29a1-b748-4d4a-bfdc-4a0b12f24030/globalmount","volume_capability":{"AccessType":{"Mount":{"mount_flags":["invalid","mount","options"]}},"access_mode":{"mode":1}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-6f4c29a1-b748-4d4a-bfdc-4a0b12f24030","csi.storage.k8s.io/pvc/name":"pvc-rnwpx","csi.storage.k8s.io/pvc/namespace":"azuredisk-3274","requestedsizegib":"10","skuName":"StandardSSD_ZRS","storage.kubernetes.io/csiProvisionerIdentity":"1627265933331-8081-disk.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-6f4c29a1-b748-4d4a-bfdc-4a0b12f24030"}
I0726 02:23:44.812530       1 azure_common_linux.go:175] azureDisk - found /dev/disk/azure/scsi1/lun0 by sdc under /dev/disk/azure/scsi1/
I0726 02:23:44.812558       1 nodeserver.go:108] NodeStageVolume: perf optimization is disabled for /dev/disk/azure/scsi1/lun0. perfProfile none accountType StandardSSD_ZRS
I0726 02:23:44.812584       1 nodeserver.go:149] NodeStageVolume: formatting /dev/disk/azure/scsi1/lun0 and mounting at /var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-6f4c29a1-b748-4d4a-bfdc-4a0b12f24030/globalmount with mount options([invalid mount options])
I0726 02:23:44.812632       1 mount_linux.go:446] Attempting to determine if disk "/dev/disk/azure/scsi1/lun0" is formatted using blkid with args: ([-p -s TYPE -s PTTYPE -o export /dev/disk/azure/scsi1/lun0])
I0726 02:23:44.820223       1 mount_linux.go:449] Output: "DEVNAME=/dev/disk/azure/scsi1/lun0\nTYPE=ext4\n"
I0726 02:23:44.820252       1 mount_linux.go:340] Checking for issues with fsck on disk: /dev/disk/azure/scsi1/lun0
I0726 02:23:44.839003       1 mount_linux.go:436] Attempting to mount disk /dev/disk/azure/scsi1/lun0 in ext4 format at /var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-6f4c29a1-b748-4d4a-bfdc-4a0b12f24030/globalmount
I0726 02:23:44.839045       1 mount_linux.go:175] Mounting cmd (mount) with arguments (-t ext4 -o invalid,mount,options,defaults /dev/disk/azure/scsi1/lun0 /var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-6f4c29a1-b748-4d4a-bfdc-4a0b12f24030/globalmount)
E0726 02:23:44.853034       1 mount_linux.go:179] Mount failed: exit status 32
Mounting command: mount
Mounting arguments: -t ext4 -o invalid,mount,options,defaults /dev/disk/azure/scsi1/lun0 /var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-6f4c29a1-b748-4d4a-bfdc-4a0b12f24030/globalmount
Output: mount: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-6f4c29a1-b748-4d4a-bfdc-4a0b12f24030/globalmount: wrong fs type, bad option, bad superblock on /dev/sdc, missing codepage or helper program, or other error.

E0726 02:23:44.853083       1 utils.go:100] GRPC error: rpc error: code = Internal desc = could not format "/dev/disk/azure/scsi1/lun0"(lun: "0"), and mount it at "/var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-6f4c29a1-b748-4d4a-bfdc-4a0b12f24030/globalmount"
I0726 02:24:46.868285       1 utils.go:95] GRPC call: /csi.v1.Node/NodeStageVolume
I0726 02:24:46.868311       1 utils.go:96] GRPC request: {"publish_context":{"LUN":"0"},"staging_target_path":"/var/lib/kubelet/plugins/kubernetes.io/csi/volumeDevices/staging/pvc-a72d876b-b928-495b-901d-ce351979cf73","volume_capability":{"AccessType":{"Block":{}},"access_mode":{"mode":1}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-a72d876b-b928-495b-901d-ce351979cf73","csi.storage.k8s.io/pvc/name":"pvc-w62nx","csi.storage.k8s.io/pvc/namespace":"azuredisk-495","requestedsizegib":"10","skuName":"StandardSSD_ZRS","storage.kubernetes.io/csiProvisionerIdentity":"1627265933331-8081-disk.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-nnvuhiyw/providers/Microsoft.Compute/disks/pvc-a72d876b-b928-495b-901d-ce351979cf73"}
I0726 02:24:48.650100       1 azure_common_linux.go:175] azureDisk - found /dev/disk/azure/scsi1/lun0 by sdc under /dev/disk/azure/scsi1/
I0726 02:24:48.650129       1 nodeserver.go:108] NodeStageVolume: perf optimization is disabled for /dev/disk/azure/scsi1/lun0. perfProfile none accountType StandardSSD_ZRS
I0726 02:24:48.650140       1 utils.go:102] GRPC response: {}
I0726 02:24:48.663215       1 utils.go:95] GRPC call: /csi.v1.Node/NodePublishVolume
... skipping 1111 lines ...
Go Version: go1.16.6
Platform: linux/amd64
Topology Key: topology.disk.csi.azure.com/zone

Streaming logs below:
I0726 02:18:48.318836       1 azure.go:62] reading cloud config from secret
E0726 02:18:48.341929       1 azure_config.go:45] Failed to get cloud-config from secret: failed to get secret kube-system/azure-cloud-provider: secrets "azure-cloud-provider" not found
I0726 02:18:48.341992       1 azure.go:65] InitializeCloudFromSecret failed with error: InitializeCloudFromSecret: failed to get cloud config from secret kube-system/azure-cloud-provider: failed to get secret kube-system/azure-cloud-provider: secrets "azure-cloud-provider" not found
I0726 02:18:48.341999       1 azure.go:70] could not read cloud config from secret
I0726 02:18:48.342011       1 azure.go:81] use default AZURE_CREDENTIAL_FILE env var: /etc/kubernetes/azure.json
I0726 02:18:48.342039       1 azure.go:92] read cloud config from file: /etc/kubernetes/azure.json successfully
I0726 02:18:48.342834       1 azure_auth.go:234] Using AzurePublicCloud environment
I0726 02:18:48.342890       1 azure_auth.go:119] azure: using client_id+client_secret to retrieve access token
I0726 02:18:48.342914       1 azure.go:678] Azure cloudprovider using try backoff: retries=6, exponent=1.500000, duration=5, jitter=1.000000
... skipping 139 lines ...
Go Version: go1.16.6
Platform: linux/amd64
Topology Key: topology.disk.csi.azure.com/zone

Streaming logs below:
I0726 02:18:47.326550       1 azure.go:62] reading cloud config from secret
E0726 02:18:47.359110       1 azure_config.go:45] Failed to get cloud-config from secret: failed to get secret kube-system/azure-cloud-provider: secrets "azure-cloud-provider" not found
I0726 02:18:47.359336       1 azure.go:65] InitializeCloudFromSecret failed with error: InitializeCloudFromSecret: failed to get cloud config from secret kube-system/azure-cloud-provider: failed to get secret kube-system/azure-cloud-provider: secrets "azure-cloud-provider" not found
I0726 02:18:47.359478       1 azure.go:70] could not read cloud config from secret
I0726 02:18:47.359929       1 azure.go:81] use default AZURE_CREDENTIAL_FILE env var: /etc/kubernetes/azure.json
I0726 02:18:47.359983       1 azure.go:92] read cloud config from file: /etc/kubernetes/azure.json successfully
I0726 02:18:47.361778       1 azure_auth.go:234] Using AzurePublicCloud environment
I0726 02:18:47.361848       1 azure_auth.go:119] azure: using client_id+client_secret to retrieve access token
I0726 02:18:47.361888       1 azure.go:678] Azure cloudprovider using try backoff: retries=6, exponent=1.500000, duration=5, jitter=1.000000
... skipping 444 lines ...
cloudprovider_azure_op_duration_seconds_bucket{request="azuredisk_csi_driver_controller_unpublish_volume",resource_group="kubetest-nnvuhiyw",source="disk.csi.azure.com",subscription_id="0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e",le="300"} 49
cloudprovider_azure_op_duration_seconds_bucket{request="azuredisk_csi_driver_controller_unpublish_volume",resource_group="kubetest-nnvuhiyw",source="disk.csi.azure.com",subscription_id="0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e",le="600"} 49
cloudprovider_azure_op_duration_seconds_bucket{request="azuredisk_csi_driver_controller_unpublish_volume",resource_group="kubetest-nnvuhiyw",source="disk.csi.azure.com",subscription_id="0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e",le="1200"} 49
cloudprovider_azure_op_duration_seconds_bucket{request="azuredisk_csi_driver_controller_unpublish_volume",resource_group="kubetest-nnvuhiyw",source="disk.csi.azure.com",subscription_id="0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e",le="+Inf"} 49
cloudprovider_azure_op_duration_seconds_sum{request="azuredisk_csi_driver_controller_unpublish_volume",resource_group="kubetest-nnvuhiyw",source="disk.csi.azure.com",subscription_id="0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e"} 730.521084338
cloudprovider_azure_op_duration_seconds_count{request="azuredisk_csi_driver_controller_unpublish_volume",resource_group="kubetest-nnvuhiyw",source="disk.csi.azure.com",subscription_id="0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e"} 49
# HELP cloudprovider_azure_op_failure_count [ALPHA] Number of failed Azure service operations
# TYPE cloudprovider_azure_op_failure_count counter
cloudprovider_azure_op_failure_count{request="azuredisk_csi_driver_controller_delete_volume",resource_group="kubetest-nnvuhiyw",source="disk.csi.azure.com",subscription_id="0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e"} 2
# HELP go_gc_duration_seconds A summary of the pause duration of garbage collection cycles.
# TYPE go_gc_duration_seconds summary
go_gc_duration_seconds{quantile="0"} 2.4801e-05
go_gc_duration_seconds{quantile="0.25"} 5.2903e-05
... skipping 193 lines ...
Uninstalled Azure Disk CSI driver successfully.
2021/07/26 03:02:44 ===================================================

JUnit report was created: /logs/artifacts/junit_01.xml

Ran 22 of 53 Specs in 3095.147 seconds
SUCCESS! -- 22 Passed | 0 Failed | 0 Pending | 31 Skipped
--- PASS: TestE2E (3095.15s)
PASS
ok  	sigs.k8s.io/azuredisk-csi-driver/test/e2e	3095.199s
2021/07/26 03:02:45 process.go:155: Step 'make e2e-test' finished in 53m1.15220446s
2021/07/26 03:02:45 aksengine_helpers.go:425: downloading /root/tmp834005565/log-dump.sh from https://raw.githubusercontent.com/kubernetes-sigs/cloud-provider-azure/master/hack/log-dump/log-dump.sh
2021/07/26 03:02:45 util.go:68: curl https://raw.githubusercontent.com/kubernetes-sigs/cloud-provider-azure/master/hack/log-dump/log-dump.sh
... skipping 41 lines ...
ssh key file /root/.ssh/id_rsa does not exist. Exiting.
2021/07/26 03:04:34 process.go:155: Step 'bash -c /root/tmp834005565/win-ci-logs-collector.sh kubetest-nnvuhiyw.westus2.cloudapp.azure.com /root/tmp834005565 /root/.ssh/id_rsa' finished in 3.803576ms
2021/07/26 03:04:34 aksengine.go:1141: Deleting resource group: kubetest-nnvuhiyw.
2021/07/26 03:10:08 process.go:96: Saved XML output to /logs/artifacts/junit_runner.xml.
2021/07/26 03:10:08 process.go:153: Running: bash -c . hack/lib/version.sh && KUBE_ROOT=. kube::version::get_version_vars && echo "${KUBE_GIT_VERSION-}"
2021/07/26 03:10:08 process.go:155: Step 'bash -c . hack/lib/version.sh && KUBE_ROOT=. kube::version::get_version_vars && echo "${KUBE_GIT_VERSION-}"' finished in 229.677304ms
2021/07/26 03:10:08 main.go:327: Something went wrong: encountered 1 errors: [error running log collection script /root/tmp834005565/log-dump.sh: error during bash -c /root/tmp834005565/log-dump.sh: exit status 1]
+ EXIT_VALUE=1
+ set +o xtrace
Cleaning up after docker in docker.
================================================================================
Cleaning up after docker
830e2969a4e7
... skipping 4 lines ...