This job view page is being replaced by Spyglass soon. Check out the new job view.
PRandyzhangx: fix: get MaxDataDiskCount error on Windows
ResultFAILURE
Tests 1 failed / 11 succeeded
Started2021-10-02 01:37
Elapsed48m49s
Revision6780504021b408dd5f74e0dc20775adb735a9533
Refs 1039
job-versionv1.23.0-alpha.3.102+e380ce57143fe8
kubetest-version
revisionv1.23.0-alpha.3.102+e380ce57143fe8

Test Failures


kubetest Test 33m54s

error during make e2e-test: exit status 2
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 11 Passed Tests

Error lines from build-log.txt

... skipping 222 lines ...

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100 11248  100 11248    0     0   186k      0 --:--:-- --:--:-- --:--:--  186k
Downloading https://get.helm.sh/helm-v3.7.0-linux-amd64.tar.gz
Verifying checksum... Done.
Preparing to install helm into /usr/local/bin
helm installed into /usr/local/bin/helm
docker pull k8sprow.azurecr.io/azuredisk-csi:v1.8.0-30279da837c543c1cc083aa2b7b1e62b5b25f83a || make container-all push-manifest
Error response from daemon: manifest for k8sprow.azurecr.io/azuredisk-csi:v1.8.0-30279da837c543c1cc083aa2b7b1e62b5b25f83a not found: manifest unknown: manifest tagged by "v1.8.0-30279da837c543c1cc083aa2b7b1e62b5b25f83a" is not found
make[2]: Entering directory '/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver'
CGO_ENABLED=0 GOOS=windows go build -a -ldflags "-X sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk.driverVersion=v1.8.0-30279da837c543c1cc083aa2b7b1e62b5b25f83a -X sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk.gitCommit=30279da837c543c1cc083aa2b7b1e62b5b25f83a -X sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk.buildDate=2021-10-02T01:44:53Z -extldflags "-static""  -mod vendor -o _output/amd64/azurediskplugin.exe ./pkg/azurediskplugin
docker buildx rm container-builder || true
error: no builder "container-builder" found
docker buildx create --use --name=container-builder
container-builder
# enable qemu for arm64 build
# https://github.com/docker/buildx/issues/464#issuecomment-741507760
docker run --privileged --rm tonistiigi/binfmt --uninstall qemu-aarch64
Unable to find image 'tonistiigi/binfmt:latest' locally
... skipping 1772 lines ...
                    type: string
                type: object
                oneOf:
                - required: ["persistentVolumeClaimName"]
                - required: ["volumeSnapshotContentName"]
              volumeSnapshotClassName:
                description: 'VolumeSnapshotClassName is the name of the VolumeSnapshotClass requested by the VolumeSnapshot. VolumeSnapshotClassName may be left nil to indicate that the default SnapshotClass should be used. A given cluster may have multiple default Volume SnapshotClasses: one default per CSI Driver. If a VolumeSnapshot does not specify a SnapshotClass, VolumeSnapshotSource will be checked to figure out what the associated CSI Driver is, and the default VolumeSnapshotClass associated with that CSI Driver will be used. If more than one VolumeSnapshotClass exist for a given CSI Driver and more than one have been marked as default, CreateSnapshot will fail and generate an event. Empty string is not allowed for this field.'
                type: string
            required:
            - source
            type: object
          status:
            description: status represents the current information of a snapshot. Consumers must verify binding between VolumeSnapshot and VolumeSnapshotContent objects is successful (by validating that both VolumeSnapshot and VolumeSnapshotContent point at each other) before using this object.
... skipping 2 lines ...
                description: 'boundVolumeSnapshotContentName is the name of the VolumeSnapshotContent object to which this VolumeSnapshot object intends to bind to. If not specified, it indicates that the VolumeSnapshot object has not been successfully bound to a VolumeSnapshotContent object yet. NOTE: To avoid possible security issues, consumers must verify binding between VolumeSnapshot and VolumeSnapshotContent objects is successful (by validating that both VolumeSnapshot and VolumeSnapshotContent point at each other) before using this object.'
                type: string
              creationTime:
                description: creationTime is the timestamp when the point-in-time snapshot is taken by the underlying storage system. In dynamic snapshot creation case, this field will be filled in by the snapshot controller with the "creation_time" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "creation_time" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it. If not specified, it may indicate that the creation time of the snapshot is unknown.
                format: date-time
                type: string
              error:
                description: error is the last observed error during snapshot creation, if any. This field could be helpful to upper level controllers(i.e., application controller) to decide whether they should continue on waiting for the snapshot to be created based on the type of error reported. The snapshot controller will keep retrying when an error occurrs during the snapshot creation. Upon success, this error field will be cleared.
                properties:
                  message:
                    description: 'message is a string detailing the encountered error during snapshot creation if specified. NOTE: message may be logged, and it should not contain sensitive information.'
                    type: string
                  time:
                    description: time is the timestamp when the error was encountered.
                    format: date-time
                    type: string
                type: object
              readyToUse:
                description: readyToUse indicates if the snapshot is ready to be used to restore a volume. In dynamic snapshot creation case, this field will be filled in by the snapshot controller with the "ready_to_use" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "ready_to_use" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it, otherwise, this field will be set to "True". If not specified, it means the readiness of a snapshot is unknown.
                type: boolean
              restoreSize:
                type: string
                description: restoreSize represents the minimum size of volume required to create a volume from this snapshot. In dynamic snapshot creation case, this field will be filled in by the snapshot controller with the "size_bytes" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "size_bytes" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it. When restoring a volume from this snapshot, the size of the volume MUST NOT be smaller than the restoreSize if it is specified, otherwise the restoration will fail. If not specified, it indicates that the size is unknown.
                pattern: ^(\+|-)?(([0-9]+(\.[0-9]*)?)|(\.[0-9]+))(([KMGTPE]i)|[numkMGTPE]|([eE](\+|-)?(([0-9]+(\.[0-9]*)?)|(\.[0-9]+))))?$
                x-kubernetes-int-or-string: true
            type: object
        required:
        - spec
        type: object
... skipping 60 lines ...
                    type: string
                  volumeSnapshotContentName:
                    description: volumeSnapshotContentName specifies the name of a pre-existing VolumeSnapshotContent object representing an existing volume snapshot. This field should be set if the snapshot already exists and only needs a representation in Kubernetes. This field is immutable.
                    type: string
                type: object
              volumeSnapshotClassName:
                description: 'VolumeSnapshotClassName is the name of the VolumeSnapshotClass requested by the VolumeSnapshot. VolumeSnapshotClassName may be left nil to indicate that the default SnapshotClass should be used. A given cluster may have multiple default Volume SnapshotClasses: one default per CSI Driver. If a VolumeSnapshot does not specify a SnapshotClass, VolumeSnapshotSource will be checked to figure out what the associated CSI Driver is, and the default VolumeSnapshotClass associated with that CSI Driver will be used. If more than one VolumeSnapshotClass exist for a given CSI Driver and more than one have been marked as default, CreateSnapshot will fail and generate an event. Empty string is not allowed for this field.'
                type: string
            required:
            - source
            type: object
          status:
            description: status represents the current information of a snapshot. Consumers must verify binding between VolumeSnapshot and VolumeSnapshotContent objects is successful (by validating that both VolumeSnapshot and VolumeSnapshotContent point at each other) before using this object.
... skipping 2 lines ...
                description: 'boundVolumeSnapshotContentName is the name of the VolumeSnapshotContent object to which this VolumeSnapshot object intends to bind to. If not specified, it indicates that the VolumeSnapshot object has not been successfully bound to a VolumeSnapshotContent object yet. NOTE: To avoid possible security issues, consumers must verify binding between VolumeSnapshot and VolumeSnapshotContent objects is successful (by validating that both VolumeSnapshot and VolumeSnapshotContent point at each other) before using this object.'
                type: string
              creationTime:
                description: creationTime is the timestamp when the point-in-time snapshot is taken by the underlying storage system. In dynamic snapshot creation case, this field will be filled in by the snapshot controller with the "creation_time" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "creation_time" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it. If not specified, it may indicate that the creation time of the snapshot is unknown.
                format: date-time
                type: string
              error:
                description: error is the last observed error during snapshot creation, if any. This field could be helpful to upper level controllers(i.e., application controller) to decide whether they should continue on waiting for the snapshot to be created based on the type of error reported. The snapshot controller will keep retrying when an error occurrs during the snapshot creation. Upon success, this error field will be cleared.
                properties:
                  message:
                    description: 'message is a string detailing the encountered error during snapshot creation if specified. NOTE: message may be logged, and it should not contain sensitive information.'
                    type: string
                  time:
                    description: time is the timestamp when the error was encountered.
                    format: date-time
                    type: string
                type: object
              readyToUse:
                description: readyToUse indicates if the snapshot is ready to be used to restore a volume. In dynamic snapshot creation case, this field will be filled in by the snapshot controller with the "ready_to_use" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "ready_to_use" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it, otherwise, this field will be set to "True". If not specified, it means the readiness of a snapshot is unknown.
                type: boolean
              restoreSize:
                type: string
                description: restoreSize represents the minimum size of volume required to create a volume from this snapshot. In dynamic snapshot creation case, this field will be filled in by the snapshot controller with the "size_bytes" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "size_bytes" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it. When restoring a volume from this snapshot, the size of the volume MUST NOT be smaller than the restoreSize if it is specified, otherwise the restoration will fail. If not specified, it indicates that the size is unknown.
                pattern: ^(\+|-)?(([0-9]+(\.[0-9]*)?)|(\.[0-9]+))(([KMGTPE]i)|[numkMGTPE]|([eE](\+|-)?(([0-9]+(\.[0-9]*)?)|(\.[0-9]+))))?$
                x-kubernetes-int-or-string: true
            type: object
        required:
        - spec
        type: object
... skipping 248 lines ...
            description: status represents the current information of a snapshot.
            properties:
              creationTime:
                description: creationTime is the timestamp when the point-in-time snapshot is taken by the underlying storage system. In dynamic snapshot creation case, this field will be filled in by the CSI snapshotter sidecar with the "creation_time" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "creation_time" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it. If not specified, it indicates the creation time is unknown. The format of this field is a Unix nanoseconds time encoded as an int64. On Unix, the command `date +%s%N` returns the current time in nanoseconds since 1970-01-01 00:00:00 UTC.
                format: int64
                type: integer
              error:
                description: error is the last observed error during snapshot creation, if any. Upon success after retry, this error field will be cleared.
                properties:
                  message:
                    description: 'message is a string detailing the encountered error during snapshot creation if specified. NOTE: message may be logged, and it should not contain sensitive information.'
                    type: string
                  time:
                    description: time is the timestamp when the error was encountered.
                    format: date-time
                    type: string
                type: object
              readyToUse:
                description: readyToUse indicates if a snapshot is ready to be used to restore a volume. In dynamic snapshot creation case, this field will be filled in by the CSI snapshotter sidecar with the "ready_to_use" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "ready_to_use" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it, otherwise, this field will be set to "True". If not specified, it means the readiness of a snapshot is unknown.
                type: boolean
              restoreSize:
                description: restoreSize represents the complete size of the snapshot in bytes. In dynamic snapshot creation case, this field will be filled in by the CSI snapshotter sidecar with the "size_bytes" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "size_bytes" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it. When restoring a volume from this snapshot, the size of the volume MUST NOT be smaller than the restoreSize if it is specified, otherwise the restoration will fail. If not specified, it indicates that the size is unknown.
                format: int64
                minimum: 0
                type: integer
              snapshotHandle:
                description: snapshotHandle is the CSI "snapshot_id" of a snapshot on the underlying storage system. If not specified, it indicates that dynamic snapshot creation has either failed or it is still in progress.
                type: string
            type: object
        required:
        - spec
        type: object
    served: true
... skipping 108 lines ...
            description: status represents the current information of a snapshot.
            properties:
              creationTime:
                description: creationTime is the timestamp when the point-in-time snapshot is taken by the underlying storage system. In dynamic snapshot creation case, this field will be filled in by the CSI snapshotter sidecar with the "creation_time" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "creation_time" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it. If not specified, it indicates the creation time is unknown. The format of this field is a Unix nanoseconds time encoded as an int64. On Unix, the command `date +%s%N` returns the current time in nanoseconds since 1970-01-01 00:00:00 UTC.
                format: int64
                type: integer
              error:
                description: error is the last observed error during snapshot creation, if any. Upon success after retry, this error field will be cleared.
                properties:
                  message:
                    description: 'message is a string detailing the encountered error during snapshot creation if specified. NOTE: message may be logged, and it should not contain sensitive information.'
                    type: string
                  time:
                    description: time is the timestamp when the error was encountered.
                    format: date-time
                    type: string
                type: object
              readyToUse:
                description: readyToUse indicates if a snapshot is ready to be used to restore a volume. In dynamic snapshot creation case, this field will be filled in by the CSI snapshotter sidecar with the "ready_to_use" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "ready_to_use" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it, otherwise, this field will be set to "True". If not specified, it means the readiness of a snapshot is unknown.
                type: boolean
              restoreSize:
                description: restoreSize represents the complete size of the snapshot in bytes. In dynamic snapshot creation case, this field will be filled in by the CSI snapshotter sidecar with the "size_bytes" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "size_bytes" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it. When restoring a volume from this snapshot, the size of the volume MUST NOT be smaller than the restoreSize if it is specified, otherwise the restoration will fail. If not specified, it indicates that the size is unknown.
                format: int64
                minimum: 0
                type: integer
              snapshotHandle:
                description: snapshotHandle is the CSI "snapshot_id" of a snapshot on the underlying storage system. If not specified, it indicates that dynamic snapshot creation has either failed or it is still in progress.
                type: string
            type: object
        required:
        - spec
        type: object
    served: true
... skipping 850 lines ...
        - name: csi-resizer
          image: "mcr.microsoft.com/oss/kubernetes-csi/csi-resizer:v1.3.0"
          args:
            - "-csi-address=$(ADDRESS)"
            - "-v=2"
            - "-leader-election"
            - '-handle-volume-inuse-error=true'
          env:
            - name: ADDRESS
              value: /csi/csi.sock
          volumeMounts:
            - name: socket-dir
              mountPath: /csi
... skipping 598 lines ...
Oct  2 01:55:29.770: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.comlx257] to have phase Bound
Oct  2 01:55:29.881: INFO: PersistentVolumeClaim test.csi.azure.comlx257 found but phase is Pending instead of Bound.
Oct  2 01:55:31.992: INFO: PersistentVolumeClaim test.csi.azure.comlx257 found but phase is Pending instead of Bound.
Oct  2 01:55:34.104: INFO: PersistentVolumeClaim test.csi.azure.comlx257 found and phase=Bound (4.3333203s)
STEP: Creating pod pod-subpath-test-dynamicpv-rjq6
STEP: Creating a pod to test subpath
Oct  2 01:55:34.440: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-rjq6" in namespace "provisioning-6477" to be "Succeeded or Failed"
Oct  2 01:55:34.551: INFO: Pod "pod-subpath-test-dynamicpv-rjq6": Phase="Pending", Reason="", readiness=false. Elapsed: 111.0765ms
Oct  2 01:55:36.663: INFO: Pod "pod-subpath-test-dynamicpv-rjq6": Phase="Pending", Reason="", readiness=false. Elapsed: 2.222982001s
Oct  2 01:55:38.775: INFO: Pod "pod-subpath-test-dynamicpv-rjq6": Phase="Pending", Reason="", readiness=false. Elapsed: 4.335070265s
Oct  2 01:55:40.887: INFO: Pod "pod-subpath-test-dynamicpv-rjq6": Phase="Pending", Reason="", readiness=false. Elapsed: 6.44757627s
Oct  2 01:55:42.999: INFO: Pod "pod-subpath-test-dynamicpv-rjq6": Phase="Pending", Reason="", readiness=false. Elapsed: 8.559397135s
Oct  2 01:55:45.112: INFO: Pod "pod-subpath-test-dynamicpv-rjq6": Phase="Pending", Reason="", readiness=false. Elapsed: 10.672351898s
... skipping 11 lines ...
Oct  2 01:56:10.462: INFO: Pod "pod-subpath-test-dynamicpv-rjq6": Phase="Pending", Reason="", readiness=false. Elapsed: 36.022218976s
Oct  2 01:56:12.574: INFO: Pod "pod-subpath-test-dynamicpv-rjq6": Phase="Pending", Reason="", readiness=false. Elapsed: 38.133750567s
Oct  2 01:56:14.687: INFO: Pod "pod-subpath-test-dynamicpv-rjq6": Phase="Pending", Reason="", readiness=false. Elapsed: 40.247385888s
Oct  2 01:56:16.800: INFO: Pod "pod-subpath-test-dynamicpv-rjq6": Phase="Pending", Reason="", readiness=false. Elapsed: 42.359882641s
Oct  2 01:56:18.920: INFO: Pod "pod-subpath-test-dynamicpv-rjq6": Phase="Succeeded", Reason="", readiness=false. Elapsed: 44.480429342s
STEP: Saw pod success
Oct  2 01:56:18.920: INFO: Pod "pod-subpath-test-dynamicpv-rjq6" satisfied condition "Succeeded or Failed"
Oct  2 01:56:19.033: INFO: Trying to get logs from node k8s-agentpool1-49352361-vmss000000 pod pod-subpath-test-dynamicpv-rjq6 container test-container-volume-dynamicpv-rjq6: <nil>
STEP: delete the pod
Oct  2 01:56:19.311: INFO: Waiting for pod pod-subpath-test-dynamicpv-rjq6 to disappear
Oct  2 01:56:19.422: INFO: Pod pod-subpath-test-dynamicpv-rjq6 no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-rjq6
Oct  2 01:56:19.422: INFO: Deleting pod "pod-subpath-test-dynamicpv-rjq6" in namespace "provisioning-6477"
... skipping 23 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should support existing directory
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:205
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath should support existing directory","total":16,"completed":1,"skipped":27,"failed":0}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct  2 01:57:01.405: INFO: Driver "test.csi.azure.com" does not support volume expansion - skipping
... skipping 80 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should be able to unmount after the subpath directory is deleted [LinuxOnly]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:445
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]","total":19,"completed":1,"skipped":231,"failed":0}

SSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (ext3)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct  2 01:57:19.121: INFO: Driver test.csi.azure.com doesn't support ext3 -- skipping
... skipping 40 lines ...
Oct  2 01:55:30.415: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.comm77q4] to have phase Bound
Oct  2 01:55:30.525: INFO: PersistentVolumeClaim test.csi.azure.comm77q4 found but phase is Pending instead of Bound.
Oct  2 01:55:32.638: INFO: PersistentVolumeClaim test.csi.azure.comm77q4 found but phase is Pending instead of Bound.
Oct  2 01:55:34.750: INFO: PersistentVolumeClaim test.csi.azure.comm77q4 found and phase=Bound (4.334549111s)
STEP: Creating pod pod-subpath-test-dynamicpv-nkpg
STEP: Creating a pod to test subpath
Oct  2 01:55:35.094: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-nkpg" in namespace "provisioning-2392" to be "Succeeded or Failed"
Oct  2 01:55:35.205: INFO: Pod "pod-subpath-test-dynamicpv-nkpg": Phase="Pending", Reason="", readiness=false. Elapsed: 111.338601ms
Oct  2 01:55:37.317: INFO: Pod "pod-subpath-test-dynamicpv-nkpg": Phase="Pending", Reason="", readiness=false. Elapsed: 2.223612494s
Oct  2 01:55:39.430: INFO: Pod "pod-subpath-test-dynamicpv-nkpg": Phase="Pending", Reason="", readiness=false. Elapsed: 4.336532047s
Oct  2 01:55:41.543: INFO: Pod "pod-subpath-test-dynamicpv-nkpg": Phase="Pending", Reason="", readiness=false. Elapsed: 6.449166511s
Oct  2 01:55:43.654: INFO: Pod "pod-subpath-test-dynamicpv-nkpg": Phase="Pending", Reason="", readiness=false. Elapsed: 8.560427176s
Oct  2 01:55:45.766: INFO: Pod "pod-subpath-test-dynamicpv-nkpg": Phase="Pending", Reason="", readiness=false. Elapsed: 10.671912555s
... skipping 8 lines ...
Oct  2 01:56:04.783: INFO: Pod "pod-subpath-test-dynamicpv-nkpg": Phase="Pending", Reason="", readiness=false. Elapsed: 29.689272939s
Oct  2 01:56:06.895: INFO: Pod "pod-subpath-test-dynamicpv-nkpg": Phase="Pending", Reason="", readiness=false. Elapsed: 31.801399485s
Oct  2 01:56:09.008: INFO: Pod "pod-subpath-test-dynamicpv-nkpg": Phase="Pending", Reason="", readiness=false. Elapsed: 33.914527936s
Oct  2 01:56:11.121: INFO: Pod "pod-subpath-test-dynamicpv-nkpg": Phase="Pending", Reason="", readiness=false. Elapsed: 36.026863877s
Oct  2 01:56:13.234: INFO: Pod "pod-subpath-test-dynamicpv-nkpg": Phase="Succeeded", Reason="", readiness=false. Elapsed: 38.139871831s
STEP: Saw pod success
Oct  2 01:56:13.234: INFO: Pod "pod-subpath-test-dynamicpv-nkpg" satisfied condition "Succeeded or Failed"
Oct  2 01:56:13.345: INFO: Trying to get logs from node k8s-agentpool1-49352361-vmss000001 pod pod-subpath-test-dynamicpv-nkpg container test-container-subpath-dynamicpv-nkpg: <nil>
STEP: delete the pod
Oct  2 01:56:13.584: INFO: Waiting for pod pod-subpath-test-dynamicpv-nkpg to disappear
Oct  2 01:56:13.694: INFO: Pod pod-subpath-test-dynamicpv-nkpg no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-nkpg
Oct  2 01:56:13.694: INFO: Deleting pod "pod-subpath-test-dynamicpv-nkpg" in namespace "provisioning-2392"
... skipping 29 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should support existing single file [LinuxOnly]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:219
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath should support existing single file [LinuxOnly]","total":9,"completed":1,"skipped":454,"failed":0}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy 
  (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with same fsgroup skips ownership changes to the volume contents
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/fsgroupchangepolicy.go:208
... skipping 99 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with same fsgroup skips ownership changes to the volume contents
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/fsgroupchangepolicy.go:208
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with same fsgroup skips ownership changes to the volume contents","total":15,"completed":1,"skipped":389,"failed":0}

SSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct  2 01:57:34.249: INFO: Driver "test.csi.azure.com" does not support volume type "InlineVolume" - skipping
... skipping 125 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should create read-only inline ephemeral volume
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/ephemeral.go:149
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should create read-only inline ephemeral volume","total":18,"completed":1,"skipped":372,"failed":0}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct  2 01:59:00.338: INFO: Driver test.csi.azure.com doesn't support ntfs -- skipping
... skipping 40 lines ...
Oct  2 01:55:29.537: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.comk252f] to have phase Bound
Oct  2 01:55:29.659: INFO: PersistentVolumeClaim test.csi.azure.comk252f found but phase is Pending instead of Bound.
Oct  2 01:55:31.771: INFO: PersistentVolumeClaim test.csi.azure.comk252f found but phase is Pending instead of Bound.
Oct  2 01:55:33.882: INFO: PersistentVolumeClaim test.csi.azure.comk252f found and phase=Bound (4.345299973s)
STEP: Creating pod pod-subpath-test-dynamicpv-mg9m
STEP: Creating a pod to test subpath
Oct  2 01:55:34.216: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-mg9m" in namespace "provisioning-9161" to be "Succeeded or Failed"
Oct  2 01:55:34.328: INFO: Pod "pod-subpath-test-dynamicpv-mg9m": Phase="Pending", Reason="", readiness=false. Elapsed: 111.750388ms
Oct  2 01:55:36.438: INFO: Pod "pod-subpath-test-dynamicpv-mg9m": Phase="Pending", Reason="", readiness=false. Elapsed: 2.22240479s
Oct  2 01:55:38.553: INFO: Pod "pod-subpath-test-dynamicpv-mg9m": Phase="Pending", Reason="", readiness=false. Elapsed: 4.337460427s
Oct  2 01:55:40.665: INFO: Pod "pod-subpath-test-dynamicpv-mg9m": Phase="Pending", Reason="", readiness=false. Elapsed: 6.449172279s
Oct  2 01:55:42.776: INFO: Pod "pod-subpath-test-dynamicpv-mg9m": Phase="Pending", Reason="", readiness=false. Elapsed: 8.560290855s
Oct  2 01:55:44.888: INFO: Pod "pod-subpath-test-dynamicpv-mg9m": Phase="Pending", Reason="", readiness=false. Elapsed: 10.672539324s
... skipping 8 lines ...
Oct  2 01:56:03.908: INFO: Pod "pod-subpath-test-dynamicpv-mg9m": Phase="Pending", Reason="", readiness=false. Elapsed: 29.692342262s
Oct  2 01:56:06.020: INFO: Pod "pod-subpath-test-dynamicpv-mg9m": Phase="Pending", Reason="", readiness=false. Elapsed: 31.803669875s
Oct  2 01:56:08.131: INFO: Pod "pod-subpath-test-dynamicpv-mg9m": Phase="Pending", Reason="", readiness=false. Elapsed: 33.914764309s
Oct  2 01:56:10.243: INFO: Pod "pod-subpath-test-dynamicpv-mg9m": Phase="Pending", Reason="", readiness=false. Elapsed: 36.027412073s
Oct  2 01:56:12.355: INFO: Pod "pod-subpath-test-dynamicpv-mg9m": Phase="Succeeded", Reason="", readiness=false. Elapsed: 38.138673774s
STEP: Saw pod success
Oct  2 01:56:12.355: INFO: Pod "pod-subpath-test-dynamicpv-mg9m" satisfied condition "Succeeded or Failed"
Oct  2 01:56:12.465: INFO: Trying to get logs from node k8s-agentpool1-49352361-vmss000001 pod pod-subpath-test-dynamicpv-mg9m container test-container-subpath-dynamicpv-mg9m: <nil>
STEP: delete the pod
Oct  2 01:56:13.080: INFO: Waiting for pod pod-subpath-test-dynamicpv-mg9m to disappear
Oct  2 01:56:13.190: INFO: Pod pod-subpath-test-dynamicpv-mg9m no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-mg9m
Oct  2 01:56:13.190: INFO: Deleting pod "pod-subpath-test-dynamicpv-mg9m" in namespace "provisioning-9161"
... skipping 66 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should support readOnly file specified in the volumeMount [LinuxOnly]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:380
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath should support readOnly file specified in the volumeMount [LinuxOnly]","total":14,"completed":1,"skipped":97,"failed":0}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct  2 02:00:34.893: INFO: Driver "test.csi.azure.com" does not support volume type "InlineVolume" - skipping
... skipping 58 lines ...
Oct  2 01:57:19.929: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.com4l926] to have phase Bound
Oct  2 01:57:20.040: INFO: PersistentVolumeClaim test.csi.azure.com4l926 found but phase is Pending instead of Bound.
Oct  2 01:57:22.151: INFO: PersistentVolumeClaim test.csi.azure.com4l926 found but phase is Pending instead of Bound.
Oct  2 01:57:24.262: INFO: PersistentVolumeClaim test.csi.azure.com4l926 found and phase=Bound (4.332975186s)
STEP: Creating pod pod-subpath-test-dynamicpv-2knj
STEP: Creating a pod to test atomic-volume-subpath
Oct  2 01:57:24.596: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-2knj" in namespace "provisioning-3620" to be "Succeeded or Failed"
Oct  2 01:57:24.707: INFO: Pod "pod-subpath-test-dynamicpv-2knj": Phase="Pending", Reason="", readiness=false. Elapsed: 110.271059ms
Oct  2 01:57:26.824: INFO: Pod "pod-subpath-test-dynamicpv-2knj": Phase="Pending", Reason="", readiness=false. Elapsed: 2.22793036s
Oct  2 01:57:28.937: INFO: Pod "pod-subpath-test-dynamicpv-2knj": Phase="Pending", Reason="", readiness=false. Elapsed: 4.340199901s
Oct  2 01:57:31.050: INFO: Pod "pod-subpath-test-dynamicpv-2knj": Phase="Pending", Reason="", readiness=false. Elapsed: 6.453289311s
Oct  2 01:57:33.162: INFO: Pod "pod-subpath-test-dynamicpv-2knj": Phase="Pending", Reason="", readiness=false. Elapsed: 8.565489764s
Oct  2 01:57:35.274: INFO: Pod "pod-subpath-test-dynamicpv-2knj": Phase="Pending", Reason="", readiness=false. Elapsed: 10.676968215s
... skipping 65 lines ...
Oct  2 01:59:54.688: INFO: Pod "pod-subpath-test-dynamicpv-2knj": Phase="Running", Reason="", readiness=true. Elapsed: 2m30.091553717s
Oct  2 01:59:56.799: INFO: Pod "pod-subpath-test-dynamicpv-2knj": Phase="Running", Reason="", readiness=true. Elapsed: 2m32.202519521s
Oct  2 01:59:58.910: INFO: Pod "pod-subpath-test-dynamicpv-2knj": Phase="Running", Reason="", readiness=true. Elapsed: 2m34.31375573s
Oct  2 02:00:01.021: INFO: Pod "pod-subpath-test-dynamicpv-2knj": Phase="Running", Reason="", readiness=true. Elapsed: 2m36.424446s
Oct  2 02:00:03.132: INFO: Pod "pod-subpath-test-dynamicpv-2knj": Phase="Succeeded", Reason="", readiness=false. Elapsed: 2m38.535718681s
STEP: Saw pod success
Oct  2 02:00:03.132: INFO: Pod "pod-subpath-test-dynamicpv-2knj" satisfied condition "Succeeded or Failed"
Oct  2 02:00:03.242: INFO: Trying to get logs from node k8s-agentpool1-49352361-vmss000001 pod pod-subpath-test-dynamicpv-2knj container test-container-subpath-dynamicpv-2knj: <nil>
STEP: delete the pod
Oct  2 02:00:04.025: INFO: Waiting for pod pod-subpath-test-dynamicpv-2knj to disappear
Oct  2 02:00:04.135: INFO: Pod pod-subpath-test-dynamicpv-2knj no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-2knj
Oct  2 02:00:04.135: INFO: Deleting pod "pod-subpath-test-dynamicpv-2knj" in namespace "provisioning-3620"
... skipping 29 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should support file as subpath [LinuxOnly]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:230
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath should support file as subpath [LinuxOnly]","total":19,"completed":2,"skipped":255,"failed":0}

SSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct  2 02:01:16.589: INFO: Driver test.csi.azure.com doesn't support ext4 -- skipping
... skipping 98 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (filesystem volmode)] volumeLimits
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should support volume limits [Serial]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumelimits.go:123
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (filesystem volmode)] volumeLimits should support volume limits [Serial]","total":14,"completed":1,"skipped":55,"failed":0}

SSSSSSSSSSSSSS
------------------------------
External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy 
  (Always)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/fsgroupchangepolicy.go:208
... skipping 94 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    (Always)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/fsgroupchangepolicy.go:208
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents","total":15,"completed":2,"skipped":459,"failed":0}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct  2 02:02:37.786: INFO: Driver test.csi.azure.com doesn't support ntfs -- skipping
... skipping 35 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct  2 02:02:38.759: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "volumelimits-9668" for this suite.

•
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (filesystem volmode)] volumeLimits should verify that all csinodes have volume limits","total":15,"completed":3,"skipped":604,"failed":0}

SSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct  2 02:02:39.004: INFO: Driver test.csi.azure.com doesn't support ntfs -- skipping
... skipping 20 lines ...
[BeforeEach] [Testpattern: Dynamic PV (immediate binding)] topology
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct  2 02:02:39.098: INFO: >>> kubeConfig: /root/tmp1996108316/kubeconfig/kubeconfig.westeurope.json
STEP: Building a namespace api object, basename topology
STEP: Waiting for a default service account to be provisioned in namespace
[It] should fail to schedule a pod which has topologies that conflict with AllowedTopologies
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192
Oct  2 02:02:39.656: INFO: Driver didn't provide topology keys -- skipping
[AfterEach] [Testpattern: Dynamic PV (immediate binding)] topology
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct  2 02:02:39.656: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "topology-5949" for this suite.


S [SKIPPING] [0.788 seconds]
External Storage [Driver: test.csi.azure.com]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (immediate binding)] topology
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should fail to schedule a pod which has topologies that conflict with AllowedTopologies [Measurement]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192

    Driver didn't provide topology keys -- skipping

    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:124
------------------------------
... skipping 115 lines ...
Oct  2 02:01:17.377: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.coms8bnn] to have phase Bound
Oct  2 02:01:17.487: INFO: PersistentVolumeClaim test.csi.azure.coms8bnn found but phase is Pending instead of Bound.
Oct  2 02:01:19.599: INFO: PersistentVolumeClaim test.csi.azure.coms8bnn found but phase is Pending instead of Bound.
Oct  2 02:01:21.709: INFO: PersistentVolumeClaim test.csi.azure.coms8bnn found and phase=Bound (4.332267287s)
STEP: Creating pod pod-subpath-test-dynamicpv-6jmp
STEP: Creating a pod to test subpath
Oct  2 02:01:22.046: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-6jmp" in namespace "provisioning-526" to be "Succeeded or Failed"
Oct  2 02:01:22.158: INFO: Pod "pod-subpath-test-dynamicpv-6jmp": Phase="Pending", Reason="", readiness=false. Elapsed: 111.902514ms
Oct  2 02:01:24.271: INFO: Pod "pod-subpath-test-dynamicpv-6jmp": Phase="Pending", Reason="", readiness=false. Elapsed: 2.22460767s
Oct  2 02:01:26.384: INFO: Pod "pod-subpath-test-dynamicpv-6jmp": Phase="Pending", Reason="", readiness=false. Elapsed: 4.337729922s
Oct  2 02:01:28.496: INFO: Pod "pod-subpath-test-dynamicpv-6jmp": Phase="Pending", Reason="", readiness=false. Elapsed: 6.450304037s
Oct  2 02:01:30.609: INFO: Pod "pod-subpath-test-dynamicpv-6jmp": Phase="Pending", Reason="", readiness=false. Elapsed: 8.562708136s
Oct  2 02:01:32.721: INFO: Pod "pod-subpath-test-dynamicpv-6jmp": Phase="Pending", Reason="", readiness=false. Elapsed: 10.675405971s
Oct  2 02:01:34.834: INFO: Pod "pod-subpath-test-dynamicpv-6jmp": Phase="Pending", Reason="", readiness=false. Elapsed: 12.787852071s
Oct  2 02:01:36.946: INFO: Pod "pod-subpath-test-dynamicpv-6jmp": Phase="Pending", Reason="", readiness=false. Elapsed: 14.900094564s
Oct  2 02:01:39.058: INFO: Pod "pod-subpath-test-dynamicpv-6jmp": Phase="Pending", Reason="", readiness=false. Elapsed: 17.012337912s
Oct  2 02:01:41.170: INFO: Pod "pod-subpath-test-dynamicpv-6jmp": Phase="Pending", Reason="", readiness=false. Elapsed: 19.124050323s
Oct  2 02:01:43.283: INFO: Pod "pod-subpath-test-dynamicpv-6jmp": Phase="Pending", Reason="", readiness=false. Elapsed: 21.236897809s
Oct  2 02:01:45.395: INFO: Pod "pod-subpath-test-dynamicpv-6jmp": Phase="Succeeded", Reason="", readiness=false. Elapsed: 23.348913176s
STEP: Saw pod success
Oct  2 02:01:45.395: INFO: Pod "pod-subpath-test-dynamicpv-6jmp" satisfied condition "Succeeded or Failed"
Oct  2 02:01:45.506: INFO: Trying to get logs from node k8s-agentpool1-49352361-vmss000001 pod pod-subpath-test-dynamicpv-6jmp container test-container-subpath-dynamicpv-6jmp: <nil>
STEP: delete the pod
Oct  2 02:01:45.770: INFO: Waiting for pod pod-subpath-test-dynamicpv-6jmp to disappear
Oct  2 02:01:45.880: INFO: Pod pod-subpath-test-dynamicpv-6jmp no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-6jmp
Oct  2 02:01:45.880: INFO: Deleting pod "pod-subpath-test-dynamicpv-6jmp" in namespace "provisioning-526"
... skipping 29 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should support readOnly directory specified in the volumeMount
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:365
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath should support readOnly directory specified in the volumeMount","total":19,"completed":3,"skipped":276,"failed":0}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] provisioning
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] provisioning
... skipping 130 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (filesystem volmode)] volumeMode
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should not mount / map unused volumes in a pod [LinuxOnly]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:351
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (filesystem volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]","total":18,"completed":2,"skipped":592,"failed":0}

SSSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (ext3)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct  2 02:03:37.278: INFO: Driver "test.csi.azure.com" does not support volume type "PreprovisionedPV" - skipping
... skipping 37 lines ...
Oct  2 02:00:35.813: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.comz98kn] to have phase Bound
Oct  2 02:00:35.924: INFO: PersistentVolumeClaim test.csi.azure.comz98kn found but phase is Pending instead of Bound.
Oct  2 02:00:38.035: INFO: PersistentVolumeClaim test.csi.azure.comz98kn found but phase is Pending instead of Bound.
Oct  2 02:00:40.148: INFO: PersistentVolumeClaim test.csi.azure.comz98kn found and phase=Bound (4.335089887s)
STEP: Creating pod pod-subpath-test-dynamicpv-vz2q
STEP: Creating a pod to test subpath
Oct  2 02:00:40.482: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-vz2q" in namespace "provisioning-5446" to be "Succeeded or Failed"
Oct  2 02:00:40.593: INFO: Pod "pod-subpath-test-dynamicpv-vz2q": Phase="Pending", Reason="", readiness=false. Elapsed: 110.474793ms
Oct  2 02:00:42.708: INFO: Pod "pod-subpath-test-dynamicpv-vz2q": Phase="Pending", Reason="", readiness=false. Elapsed: 2.225622633s
Oct  2 02:00:44.820: INFO: Pod "pod-subpath-test-dynamicpv-vz2q": Phase="Pending", Reason="", readiness=false. Elapsed: 4.337426198s
Oct  2 02:00:46.934: INFO: Pod "pod-subpath-test-dynamicpv-vz2q": Phase="Pending", Reason="", readiness=false. Elapsed: 6.45162496s
Oct  2 02:00:49.046: INFO: Pod "pod-subpath-test-dynamicpv-vz2q": Phase="Pending", Reason="", readiness=false. Elapsed: 8.563652134s
Oct  2 02:00:51.158: INFO: Pod "pod-subpath-test-dynamicpv-vz2q": Phase="Pending", Reason="", readiness=false. Elapsed: 10.676085298s
... skipping 56 lines ...
Oct  2 02:02:51.578: INFO: Pod "pod-subpath-test-dynamicpv-vz2q": Phase="Pending", Reason="", readiness=false. Elapsed: 2m11.096063117s
Oct  2 02:02:53.724: INFO: Pod "pod-subpath-test-dynamicpv-vz2q": Phase="Pending", Reason="", readiness=false. Elapsed: 2m13.241379316s
Oct  2 02:02:55.836: INFO: Pod "pod-subpath-test-dynamicpv-vz2q": Phase="Pending", Reason="", readiness=false. Elapsed: 2m15.354046439s
Oct  2 02:02:57.948: INFO: Pod "pod-subpath-test-dynamicpv-vz2q": Phase="Pending", Reason="", readiness=false. Elapsed: 2m17.465513629s
Oct  2 02:03:00.060: INFO: Pod "pod-subpath-test-dynamicpv-vz2q": Phase="Succeeded", Reason="", readiness=false. Elapsed: 2m19.577566866s
STEP: Saw pod success
Oct  2 02:03:00.060: INFO: Pod "pod-subpath-test-dynamicpv-vz2q" satisfied condition "Succeeded or Failed"
Oct  2 02:03:00.171: INFO: Trying to get logs from node k8s-agentpool1-49352361-vmss000001 pod pod-subpath-test-dynamicpv-vz2q container test-container-subpath-dynamicpv-vz2q: <nil>
STEP: delete the pod
Oct  2 02:03:00.407: INFO: Waiting for pod pod-subpath-test-dynamicpv-vz2q to disappear
Oct  2 02:03:00.517: INFO: Pod pod-subpath-test-dynamicpv-vz2q no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-vz2q
Oct  2 02:03:00.517: INFO: Deleting pod "pod-subpath-test-dynamicpv-vz2q" in namespace "provisioning-5446"
STEP: Creating pod pod-subpath-test-dynamicpv-vz2q
STEP: Creating a pod to test subpath
Oct  2 02:03:00.744: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-vz2q" in namespace "provisioning-5446" to be "Succeeded or Failed"
Oct  2 02:03:00.854: INFO: Pod "pod-subpath-test-dynamicpv-vz2q": Phase="Pending", Reason="", readiness=false. Elapsed: 110.437349ms
Oct  2 02:03:02.966: INFO: Pod "pod-subpath-test-dynamicpv-vz2q": Phase="Pending", Reason="", readiness=false. Elapsed: 2.222530283s
Oct  2 02:03:05.078: INFO: Pod "pod-subpath-test-dynamicpv-vz2q": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.334609121s
STEP: Saw pod success
Oct  2 02:03:05.078: INFO: Pod "pod-subpath-test-dynamicpv-vz2q" satisfied condition "Succeeded or Failed"
Oct  2 02:03:05.190: INFO: Trying to get logs from node k8s-agentpool1-49352361-vmss000001 pod pod-subpath-test-dynamicpv-vz2q container test-container-subpath-dynamicpv-vz2q: <nil>
STEP: delete the pod
Oct  2 02:03:05.426: INFO: Waiting for pod pod-subpath-test-dynamicpv-vz2q to disappear
Oct  2 02:03:05.536: INFO: Pod pod-subpath-test-dynamicpv-vz2q no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-vz2q
Oct  2 02:03:05.536: INFO: Deleting pod "pod-subpath-test-dynamicpv-vz2q" in namespace "provisioning-5446"
... skipping 29 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should support existing directories when readOnly specified in the volumeSource
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:395
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath should support existing directories when readOnly specified in the volumeSource","total":14,"completed":2,"skipped":220,"failed":0}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct  2 02:04:18.142: INFO: Driver "test.csi.azure.com" does not support volume type "PreprovisionedPV" - skipping
... skipping 159 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/fsgroupchangepolicy.go:208
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents","total":16,"completed":2,"skipped":211,"failed":0}

SSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct  2 02:04:29.311: INFO: Driver test.csi.azure.com doesn't support ntfs -- skipping
... skipping 68 lines ...
Oct  2 02:04:15.627: INFO: stderr: ""
Oct  2 02:04:15.627: INFO: stdout: "Hello from test.csi.azure.com from namespace volume-4531"
Oct  2 02:04:15.627: INFO: ExecWithOptions {Command:[/bin/sh -c test -b /opt/0] Namespace:volume-4531 PodName:external-injector ContainerName:external-injector Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false}
Oct  2 02:04:15.627: INFO: >>> kubeConfig: /root/tmp1996108316/kubeconfig/kubeconfig.westeurope.json
Oct  2 02:04:16.488: INFO: ExecWithOptions {Command:[/bin/sh -c test -d /opt/0] Namespace:volume-4531 PodName:external-injector ContainerName:external-injector Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false}
Oct  2 02:04:16.488: INFO: >>> kubeConfig: /root/tmp1996108316/kubeconfig/kubeconfig.westeurope.json
Oct  2 02:04:25.178: FAIL: "test -d /opt/0" should fail with exit code 1, but failed with error message "error dialing backend: dial tcp: lookup k8s-agentpool1-49352361-vmss000001 on 168.63.129.16:53: no such host"
stdout: 
stderr: 
Unexpected error:
    <*errors.StatusError | 0xc000bf4960>: {
        ErrStatus: {
            TypeMeta: {Kind: "", APIVersion: ""},
            ListMeta: {
                SelfLink: "",
                ResourceVersion: "",
                Continue: "",
                RemainingItemCount: nil,
            },
            Status: "Failure",
            Message: "error dialing backend: dial tcp: lookup k8s-agentpool1-49352361-vmss000001 on 168.63.129.16:53: no such host",
            Reason: "",
            Details: nil,
            Code: 500,
        },
    }
    error dialing backend: dial tcp: lookup k8s-agentpool1-49352361-vmss000001 on 168.63.129.16:53: no such host
occurred

Full Stack Trace
k8s.io/kubernetes/test/e2e/framework/volume.VerifyExecInPodFail(0xc003a0e160, 0xc0004dbc00, 0xc0029b16e0, 0xe, 0x1)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/volume/fixtures.go:655 +0x5b4
k8s.io/kubernetes/test/e2e/framework/volume.CheckVolumeModeOfPath(0xc003a0e160, 0xc0004dbc00, 0x7064644, 0x5, 0xc002ddd3aa, 0x6)
... skipping 151 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (block volmode)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should store data [Measurement]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:159

    Oct  2 02:04:25.178: "test -d /opt/0" should fail with exit code 1, but failed with error message "error dialing backend: dial tcp: lookup k8s-agentpool1-49352361-vmss000001 on 168.63.129.16:53: no such host"
    stdout: 
    stderr: 
    Unexpected error:
        <*errors.StatusError | 0xc000bf4960>: {
            ErrStatus: {
                TypeMeta: {Kind: "", APIVersion: ""},
                ListMeta: {
                    SelfLink: "",
                    ResourceVersion: "",
                    Continue: "",
                    RemainingItemCount: nil,
                },
                Status: "Failure",
                Message: "error dialing backend: dial tcp: lookup k8s-agentpool1-49352361-vmss000001 on 168.63.129.16:53: no such host",
                Reason: "",
                Details: nil,
                Code: 500,
            },
        }
        error dialing backend: dial tcp: lookup k8s-agentpool1-49352361-vmss000001 on 168.63.129.16:53: no such host
    occurred

    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/volume/fixtures.go:655
------------------------------
{"msg":"FAILED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (block volmode)] volumes should store data","total":19,"completed":3,"skipped":374,"failed":1,"failures":["External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (block volmode)] volumes should store data"]}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct  2 02:05:11.839: INFO: Driver test.csi.azure.com doesn't support ntfs -- skipping
... skipping 206 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should store data
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:159
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] volumes should store data","total":14,"completed":2,"skipped":69,"failed":0}

SSSSSSSSSSSSSSSSSSSSSSS
------------------------------
External Storage [Driver: test.csi.azure.com] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral 
  should create read/write inline ephemeral volume
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/ephemeral.go:166
... skipping 14 lines ...
Oct  2 02:03:38.420: INFO: Creating resource for dynamic PV
Oct  2 02:03:38.420: INFO: Using claimSize:5Gi, test suite supported size:{ }, driver(test.csi.azure.com) supported size:{ } 
STEP: creating a StorageClass ephemeral-968-e2e-sc2dmsp
STEP: checking the requested inline volume exists in the pod running on node {Name: Selector:map[] Affinity:nil}
Oct  2 02:04:18.972: INFO: ExecWithOptions {Command:[/bin/sh -c mount | grep /mnt/test | grep rw,] Namespace:ephemeral-968 PodName:inline-volume-tester-v9f8m ContainerName:csi-volume-tester Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false}
Oct  2 02:04:18.972: INFO: >>> kubeConfig: /root/tmp1996108316/kubeconfig/kubeconfig.westeurope.json
Oct  2 02:04:25.176: FAIL: "mount | grep /mnt/test | grep rw," should succeed, but failed with error message "error dialing backend: dial tcp: lookup k8s-agentpool1-49352361-vmss000001 on 168.63.129.16:53: no such host"
stdout: 
stderr: 
Unexpected error:
    <*errors.StatusError | 0xc002c212c0>: {
        ErrStatus: {
            TypeMeta: {Kind: "", APIVersion: ""},
            ListMeta: {
                SelfLink: "",
                ResourceVersion: "",
                Continue: "",
                RemainingItemCount: nil,
            },
            Status: "Failure",
            Message: "error dialing backend: dial tcp: lookup k8s-agentpool1-49352361-vmss000001 on 168.63.129.16:53: no such host",
            Reason: "",
            Details: nil,
            Code: 500,
        },
    }
    error dialing backend: dial tcp: lookup k8s-agentpool1-49352361-vmss000001 on 168.63.129.16:53: no such host
occurred

Full Stack Trace
k8s.io/kubernetes/test/e2e/framework/volume.VerifyExecInPodSucceed(0xc003d75e40, 0xc00008d000, 0x70fbb9a, 0x21)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/volume/fixtures.go:636 +0x471
k8s.io/kubernetes/test/e2e/storage/testsuites.(*ephemeralTestSuite).DefineTests.func4.1(0xc00008d000, 0x0, 0x0)
... skipping 151 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should create read/write inline ephemeral volume [Measurement]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/ephemeral.go:166

    Oct  2 02:04:25.176: "mount | grep /mnt/test | grep rw," should succeed, but failed with error message "error dialing backend: dial tcp: lookup k8s-agentpool1-49352361-vmss000001 on 168.63.129.16:53: no such host"
    stdout: 
    stderr: 
    Unexpected error:
        <*errors.StatusError | 0xc002c212c0>: {
            ErrStatus: {
                TypeMeta: {Kind: "", APIVersion: ""},
                ListMeta: {
                    SelfLink: "",
                    ResourceVersion: "",
                    Continue: "",
                    RemainingItemCount: nil,
                },
                Status: "Failure",
                Message: "error dialing backend: dial tcp: lookup k8s-agentpool1-49352361-vmss000001 on 168.63.129.16:53: no such host",
                Reason: "",
                Details: nil,
                Code: 500,
            },
        }
        error dialing backend: dial tcp: lookup k8s-agentpool1-49352361-vmss000001 on 168.63.129.16:53: no such host
    occurred

    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/volume/fixtures.go:636
------------------------------
{"msg":"FAILED External Storage [Driver: test.csi.azure.com] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should create read/write inline ephemeral volume","total":18,"completed":2,"skipped":638,"failed":1,"failures":["External Storage [Driver: test.csi.azure.com] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should create read/write inline ephemeral volume"]}

SSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct  2 02:05:36.818: INFO: Driver "test.csi.azure.com" does not support volume type "PreprovisionedPV" - skipping
... skipping 58 lines ...
Oct  2 02:04:30.161: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.comgtlqh] to have phase Bound
Oct  2 02:04:30.273: INFO: PersistentVolumeClaim test.csi.azure.comgtlqh found but phase is Pending instead of Bound.
Oct  2 02:04:32.385: INFO: PersistentVolumeClaim test.csi.azure.comgtlqh found but phase is Pending instead of Bound.
Oct  2 02:04:34.497: INFO: PersistentVolumeClaim test.csi.azure.comgtlqh found and phase=Bound (4.336042883s)
STEP: Creating pod exec-volume-test-dynamicpv-k8mb
STEP: Creating a pod to test exec-volume-test
Oct  2 02:04:34.833: INFO: Waiting up to 5m0s for pod "exec-volume-test-dynamicpv-k8mb" in namespace "volume-390" to be "Succeeded or Failed"
Oct  2 02:04:34.945: INFO: Pod "exec-volume-test-dynamicpv-k8mb": Phase="Pending", Reason="", readiness=false. Elapsed: 112.152096ms
Oct  2 02:04:37.058: INFO: Pod "exec-volume-test-dynamicpv-k8mb": Phase="Pending", Reason="", readiness=false. Elapsed: 2.224673871s
Oct  2 02:04:39.170: INFO: Pod "exec-volume-test-dynamicpv-k8mb": Phase="Pending", Reason="", readiness=false. Elapsed: 4.336363998s
Oct  2 02:04:41.283: INFO: Pod "exec-volume-test-dynamicpv-k8mb": Phase="Pending", Reason="", readiness=false. Elapsed: 6.44956562s
Oct  2 02:04:43.396: INFO: Pod "exec-volume-test-dynamicpv-k8mb": Phase="Pending", Reason="", readiness=false. Elapsed: 8.562908741s
Oct  2 02:04:45.509: INFO: Pod "exec-volume-test-dynamicpv-k8mb": Phase="Pending", Reason="", readiness=false. Elapsed: 10.675751453s
... skipping 23 lines ...
Oct  2 02:05:36.240: INFO: Pod "exec-volume-test-dynamicpv-k8mb": Phase="Pending", Reason="", readiness=false. Elapsed: 1m1.406710745s
Oct  2 02:05:38.352: INFO: Pod "exec-volume-test-dynamicpv-k8mb": Phase="Pending", Reason="", readiness=false. Elapsed: 1m3.518692562s
Oct  2 02:05:40.464: INFO: Pod "exec-volume-test-dynamicpv-k8mb": Phase="Pending", Reason="", readiness=false. Elapsed: 1m5.630647184s
Oct  2 02:05:42.581: INFO: Pod "exec-volume-test-dynamicpv-k8mb": Phase="Pending", Reason="", readiness=false. Elapsed: 1m7.74738117s
Oct  2 02:05:44.693: INFO: Pod "exec-volume-test-dynamicpv-k8mb": Phase="Succeeded", Reason="", readiness=false. Elapsed: 1m9.859559395s
STEP: Saw pod success
Oct  2 02:05:44.693: INFO: Pod "exec-volume-test-dynamicpv-k8mb" satisfied condition "Succeeded or Failed"
Oct  2 02:05:44.807: INFO: Trying to get logs from node k8s-agentpool1-49352361-vmss000001 pod exec-volume-test-dynamicpv-k8mb container exec-container-dynamicpv-k8mb: <nil>
STEP: delete the pod
Oct  2 02:05:45.045: INFO: Waiting for pod exec-volume-test-dynamicpv-k8mb to disappear
Oct  2 02:05:45.156: INFO: Pod exec-volume-test-dynamicpv-k8mb no longer exists
STEP: Deleting pod exec-volume-test-dynamicpv-k8mb
Oct  2 02:05:45.156: INFO: Deleting pod "exec-volume-test-dynamicpv-k8mb" in namespace "volume-390"
... skipping 21 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should allow exec of files on the volume
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:196
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] volumes should allow exec of files on the volume","total":16,"completed":3,"skipped":269,"failed":0}

SSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct  2 02:06:26.906: INFO: Driver "test.csi.azure.com" does not support volume type "InlineVolume" - skipping
... skipping 125 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should create read-only inline ephemeral volume
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/ephemeral.go:149
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should create read-only inline ephemeral volume","total":9,"completed":2,"skipped":533,"failed":0}

SS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct  2 02:06:37.382: INFO: Driver test.csi.azure.com doesn't support ext4 -- skipping
... skipping 142 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with different fsgroup applied to the volume contents
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/fsgroupchangepolicy.go:208
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with different fsgroup applied to the volume contents","total":19,"completed":4,"skipped":750,"failed":1,"failures":["External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (block volmode)] volumes should store data"]}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy 
  (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with different fsgroup applied to the volume contents
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/fsgroupchangepolicy.go:208
... skipping 96 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with different fsgroup applied to the volume contents
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/fsgroupchangepolicy.go:208
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with different fsgroup applied to the volume contents","total":18,"completed":3,"skipped":726,"failed":1,"failures":["External Storage [Driver: test.csi.azure.com] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should create read/write inline ephemeral volume"]}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (delayed binding)] topology
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (delayed binding)] topology
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct  2 02:07:37.365: INFO: >>> kubeConfig: /root/tmp1996108316/kubeconfig/kubeconfig.westeurope.json
STEP: Building a namespace api object, basename topology
STEP: Waiting for a default service account to be provisioned in namespace
[It] should fail to schedule a pod which has topologies that conflict with AllowedTopologies
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192
Oct  2 02:07:37.915: INFO: Driver didn't provide topology keys -- skipping
[AfterEach] [Testpattern: Dynamic PV (delayed binding)] topology
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct  2 02:07:37.915: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "topology-2899" for this suite.


S [SKIPPING] [0.774 seconds]
External Storage [Driver: test.csi.azure.com]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (delayed binding)] topology
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should fail to schedule a pod which has topologies that conflict with AllowedTopologies [Measurement]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192

    Driver didn't provide topology keys -- skipping

    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:124
------------------------------
... skipping 137 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with same fsgroup applied to the volume contents
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/fsgroupchangepolicy.go:208
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with same fsgroup applied to the volume contents","total":16,"completed":4,"skipped":559,"failed":0}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct  2 02:08:17.464: INFO: Driver "test.csi.azure.com" does not support volume type "PreprovisionedPV" - skipping
... skipping 93 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should support multiple inline ephemeral volumes
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/ephemeral.go:221
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should support multiple inline ephemeral volumes","total":14,"completed":3,"skipped":748,"failed":0}

SSS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct  2 02:08:22.552: INFO: Driver "test.csi.azure.com" does not support volume type "PreprovisionedPV" - skipping
... skipping 223 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (block volmode)] provisioning
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/provisioning.go:201
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource]","total":14,"completed":3,"skipped":92,"failed":0}

SSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct  2 02:08:30.401: INFO: Driver "test.csi.azure.com" does not support volume type "PreprovisionedPV" - skipping
... skipping 98 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (block volmode)] volumeMode
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should not mount / map unused volumes in a pod [LinuxOnly]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:351
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (block volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]","total":18,"completed":4,"skipped":914,"failed":1,"failures":["External Storage [Driver: test.csi.azure.com] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should create read/write inline ephemeral volume"]}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
Oct  2 02:08:35.207: INFO: Running AfterSuite actions on all nodes
Oct  2 02:08:35.207: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage.glob..func17.2
Oct  2 02:08:35.207: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage.glob..func8.2
... skipping 53 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should create read/write inline ephemeral volume
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/ephemeral.go:166
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should create read/write inline ephemeral volume","total":16,"completed":5,"skipped":729,"failed":0}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct  2 02:09:55.525: INFO: Driver "test.csi.azure.com" does not support volume type "InlineVolume" - skipping
... skipping 151 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] provisioning
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/provisioning.go:201
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource]","total":14,"completed":4,"skipped":345,"failed":0}

SSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct  2 02:10:38.043: INFO: Driver "test.csi.azure.com" does not support volume type "PreprovisionedPV" - skipping
... skipping 118 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should support two pods which share the same volume
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/ephemeral.go:183
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should support two pods which share the same volume","total":19,"completed":5,"skipped":820,"failed":1,"failures":["External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (block volmode)] volumes should store data"]}

SSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath 
  should support non-existent path
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:194
... skipping 16 lines ...
Oct  2 02:10:39.873: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.comctt8x] to have phase Bound
Oct  2 02:10:39.986: INFO: PersistentVolumeClaim test.csi.azure.comctt8x found but phase is Pending instead of Bound.
Oct  2 02:10:42.098: INFO: PersistentVolumeClaim test.csi.azure.comctt8x found but phase is Pending instead of Bound.
Oct  2 02:10:44.210: INFO: PersistentVolumeClaim test.csi.azure.comctt8x found and phase=Bound (4.336920567s)
STEP: Creating pod pod-subpath-test-dynamicpv-mbj4
STEP: Creating a pod to test subpath
Oct  2 02:10:44.545: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-mbj4" in namespace "provisioning-6424" to be "Succeeded or Failed"
Oct  2 02:10:44.656: INFO: Pod "pod-subpath-test-dynamicpv-mbj4": Phase="Pending", Reason="", readiness=false. Elapsed: 110.884836ms
Oct  2 02:10:46.769: INFO: Pod "pod-subpath-test-dynamicpv-mbj4": Phase="Pending", Reason="", readiness=false. Elapsed: 2.223213829s
Oct  2 02:10:48.881: INFO: Pod "pod-subpath-test-dynamicpv-mbj4": Phase="Pending", Reason="", readiness=false. Elapsed: 4.335337643s
Oct  2 02:10:50.994: INFO: Pod "pod-subpath-test-dynamicpv-mbj4": Phase="Pending", Reason="", readiness=false. Elapsed: 6.448776552s
Oct  2 02:10:53.105: INFO: Pod "pod-subpath-test-dynamicpv-mbj4": Phase="Pending", Reason="", readiness=false. Elapsed: 8.560032835s
Oct  2 02:10:55.218: INFO: Pod "pod-subpath-test-dynamicpv-mbj4": Phase="Pending", Reason="", readiness=false. Elapsed: 10.672826771s
... skipping 9 lines ...
Oct  2 02:11:16.347: INFO: Pod "pod-subpath-test-dynamicpv-mbj4": Phase="Pending", Reason="", readiness=false. Elapsed: 31.801985592s
Oct  2 02:11:18.460: INFO: Pod "pod-subpath-test-dynamicpv-mbj4": Phase="Pending", Reason="", readiness=false. Elapsed: 33.91491594s
Oct  2 02:11:20.574: INFO: Pod "pod-subpath-test-dynamicpv-mbj4": Phase="Pending", Reason="", readiness=false. Elapsed: 36.029036318s
Oct  2 02:11:22.686: INFO: Pod "pod-subpath-test-dynamicpv-mbj4": Phase="Pending", Reason="", readiness=false. Elapsed: 38.141041415s
Oct  2 02:11:24.799: INFO: Pod "pod-subpath-test-dynamicpv-mbj4": Phase="Succeeded", Reason="", readiness=false. Elapsed: 40.254107462s
STEP: Saw pod success
Oct  2 02:11:24.800: INFO: Pod "pod-subpath-test-dynamicpv-mbj4" satisfied condition "Succeeded or Failed"
Oct  2 02:11:24.912: INFO: Trying to get logs from node k8s-agentpool1-49352361-vmss000001 pod pod-subpath-test-dynamicpv-mbj4 container test-container-volume-dynamicpv-mbj4: <nil>
STEP: delete the pod
Oct  2 02:11:25.186: INFO: Waiting for pod pod-subpath-test-dynamicpv-mbj4 to disappear
Oct  2 02:11:25.297: INFO: Pod pod-subpath-test-dynamicpv-mbj4 no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-mbj4
Oct  2 02:11:25.297: INFO: Deleting pod "pod-subpath-test-dynamicpv-mbj4" in namespace "provisioning-6424"
... skipping 23 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should support non-existent path
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:194
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath should support non-existent path","total":14,"completed":5,"skipped":585,"failed":0}

SSSS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct  2 02:12:07.152: INFO: Driver "test.csi.azure.com" does not support volume type "PreprovisionedPV" - skipping
... skipping 163 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should support two pods which share the same volume
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/ephemeral.go:183
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should support two pods which share the same volume","total":19,"completed":6,"skipped":845,"failed":1,"failures":["External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (block volmode)] volumes should store data"]}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Inline-volume (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct  2 02:14:57.476: INFO: Driver "test.csi.azure.com" does not support volume type "InlineVolume" - skipping
... skipping 57 lines ...
Oct  2 02:14:57.563: INFO: Running AfterSuite actions on node 1



Summarizing 2 Failures:

[Fail] External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (block volmode)] volumes [Measurement] should store data 
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/volume/fixtures.go:655

[Fail] External Storage [Driver: test.csi.azure.com] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral [Measurement] should create read/write inline ephemeral volume 
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/volume/fixtures.go:636

Ran 30 of 6664 Specs in 1170.970 seconds
FAIL! -- 28 Passed | 2 Failed | 0 Pending | 6634 Skipped 

Ginkgo ran 1 suite in 19m35.269571333s
Test Suite Failed
+ print_logs
+ sed -i s/disk.csi.azure.com/test.csi.azure.com/g deploy/example/storageclass-azuredisk-csi.yaml
+ bash ./hack/verify-examples.sh linux azurepubliccloud ephemeral test
begin to create deployment examples ...
storageclass.storage.k8s.io/managed-csi created
Applying config "deploy/example/deployment.yaml"
... skipping 73 lines ...
Platform: linux/amd64
Topology Key: topology.test.csi.azure.com/zone

Streaming logs below:
I1002 01:55:19.001207       1 azuredisk.go:139] driver userAgent: test.csi.azure.com/v1.8.0-30279da837c543c1cc083aa2b7b1e62b5b25f83a gc/go1.17.1 (amd64-linux) e2e-test
I1002 01:55:19.002595       1 azure_disk_utils.go:137] reading cloud config from secret kube-system/azure-cloud-provider
W1002 01:55:19.038253       1 azure_disk_utils.go:144] InitializeCloudFromSecret: failed to get cloud config from secret kube-system/azure-cloud-provider: failed to get secret kube-system/azure-cloud-provider: secrets "azure-cloud-provider" not found
I1002 01:55:19.038282       1 azure_disk_utils.go:149] could not read cloud config from secret kube-system/azure-cloud-provider
I1002 01:55:19.038289       1 azure_disk_utils.go:159] use default AZURE_CREDENTIAL_FILE env var: /etc/kubernetes/azure.json
I1002 01:55:19.038318       1 azure_disk_utils.go:167] read cloud config from file: /etc/kubernetes/azure.json successfully
I1002 01:55:19.039437       1 azure_auth.go:234] Using AzurePublicCloud environment
I1002 01:55:19.039490       1 azure_auth.go:96] azure: using managed identity extension to retrieve access token
I1002 01:55:19.039494       1 azure_auth.go:102] azure: using User Assigned MSI ID to retrieve access token
... skipping 85 lines ...
I1002 01:55:19.759184       1 utils.go:102] GRPC response: {"capabilities":[{"Type":{"Service":{"type":1}}},{"Type":{"Service":{"type":2}}}]}
I1002 01:55:19.759657       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerGetCapabilities
I1002 01:55:19.759671       1 utils.go:96] GRPC request: {}
I1002 01:55:19.759726       1 utils.go:102] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":9}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":10}}},{"Type":{"Rpc":{"type":13}}}]}
I1002 01:55:29.518329       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 01:55:29.518375       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-f1d1f5f7-ff63-45b7-831c-1ad5308d4724","parameters":{"csi.storage.k8s.io/pv/name":"pvc-f1d1f5f7-ff63-45b7-831c-1ad5308d4724","csi.storage.k8s.io/pvc/name":"test.csi.azure.comk252f","csi.storage.k8s.io/pvc/namespace":"provisioning-9161"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 01:55:29.650065       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-f1d1f5f7-ff63-45b7-831c-1ad5308d4724, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-f1d1f5f7-ff63-45b7-831c-1ad5308d4724' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 01:55:29.650307       1 controllerserver.go:271] begin to create azure disk(pvc-f1d1f5f7-ff63-45b7-831c-1ad5308d4724) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 01:55:29.650376       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-f1d1f5f7-ff63-45b7-831c-1ad5308d4724 StorageAccountType:StandardSSD_LRS Size:5
I1002 01:55:29.722923       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 01:55:29.722946       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-3c71ca27-2ba7-4195-b958-07189f8898d1","parameters":{"csi.storage.k8s.io/pv/name":"pvc-3c71ca27-2ba7-4195-b958-07189f8898d1","csi.storage.k8s.io/pvc/name":"test.csi.azure.comlx257","csi.storage.k8s.io/pvc/namespace":"provisioning-6477"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 01:55:29.838626       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-3c71ca27-2ba7-4195-b958-07189f8898d1, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-3c71ca27-2ba7-4195-b958-07189f8898d1' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 01:55:29.838711       1 controllerserver.go:271] begin to create azure disk(pvc-3c71ca27-2ba7-4195-b958-07189f8898d1) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 01:55:29.838726       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-3c71ca27-2ba7-4195-b958-07189f8898d1 StorageAccountType:StandardSSD_LRS Size:5
I1002 01:55:30.052239       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 01:55:30.052265       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-fa5712bf-8647-4948-a5c0-c1b46143e997","parameters":{"csi.storage.k8s.io/pv/name":"pvc-fa5712bf-8647-4948-a5c0-c1b46143e997","csi.storage.k8s.io/pvc/name":"test.csi.azure.comp6xb8","csi.storage.k8s.io/pvc/namespace":"provisioning-4786"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 01:55:30.071083       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-fa5712bf-8647-4948-a5c0-c1b46143e997, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-fa5712bf-8647-4948-a5c0-c1b46143e997' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 01:55:30.071177       1 controllerserver.go:271] begin to create azure disk(pvc-fa5712bf-8647-4948-a5c0-c1b46143e997) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 01:55:30.071192       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-fa5712bf-8647-4948-a5c0-c1b46143e997 StorageAccountType:StandardSSD_LRS Size:5
I1002 01:55:30.197707       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 01:55:30.197748       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-7b6b6c64-a8e8-4dd4-8d01-09520591cf7f","parameters":{"csi.storage.k8s.io/pv/name":"pvc-7b6b6c64-a8e8-4dd4-8d01-09520591cf7f","csi.storage.k8s.io/pvc/name":"test.csi.azure.com46lkg","csi.storage.k8s.io/pvc/namespace":"volumelimits-2321"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 01:55:30.242594       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-7b6b6c64-a8e8-4dd4-8d01-09520591cf7f, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-7b6b6c64-a8e8-4dd4-8d01-09520591cf7f' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 01:55:30.242684       1 controllerserver.go:271] begin to create azure disk(pvc-7b6b6c64-a8e8-4dd4-8d01-09520591cf7f) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 01:55:30.242714       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-7b6b6c64-a8e8-4dd4-8d01-09520591cf7f StorageAccountType:StandardSSD_LRS Size:5
I1002 01:55:30.270443       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 01:55:30.270463       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-35c2534c-cb5e-485c-85f5-f3fc365ff489","parameters":{"csi.storage.k8s.io/pv/name":"pvc-35c2534c-cb5e-485c-85f5-f3fc365ff489","csi.storage.k8s.io/pvc/name":"test.csi.azure.comqmtdn","csi.storage.k8s.io/pvc/namespace":"fsgroupchangepolicy-8381"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 01:55:30.349815       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-35c2534c-cb5e-485c-85f5-f3fc365ff489, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-35c2534c-cb5e-485c-85f5-f3fc365ff489' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 01:55:30.349878       1 controllerserver.go:271] begin to create azure disk(pvc-35c2534c-cb5e-485c-85f5-f3fc365ff489) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 01:55:30.349892       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-35c2534c-cb5e-485c-85f5-f3fc365ff489 StorageAccountType:StandardSSD_LRS Size:5
I1002 01:55:30.368286       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 01:55:30.368306       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-ff2b513a-845f-4230-a382-e4d526ea336f","parameters":{"csi.storage.k8s.io/pv/name":"pvc-ff2b513a-845f-4230-a382-e4d526ea336f","csi.storage.k8s.io/pvc/name":"test.csi.azure.comm77q4","csi.storage.k8s.io/pvc/namespace":"provisioning-2392"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 01:55:30.387704       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-ff2b513a-845f-4230-a382-e4d526ea336f, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-ff2b513a-845f-4230-a382-e4d526ea336f' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 01:55:30.387745       1 controllerserver.go:271] begin to create azure disk(pvc-ff2b513a-845f-4230-a382-e4d526ea336f) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 01:55:30.387754       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-ff2b513a-845f-4230-a382-e4d526ea336f StorageAccountType:StandardSSD_LRS Size:5
I1002 01:55:32.096684       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-f1d1f5f7-ff63-45b7-831c-1ad5308d4724 StorageAccountType:StandardSSD_LRS Size:5
I1002 01:55:32.096764       1 controllerserver.go:348] create azure disk(pvc-f1d1f5f7-ff63-45b7-831c-1ad5308d4724) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-f1d1f5f7-ff63-45b7-831c-1ad5308d4724 kubernetes.io-created-for-pvc-name:test.csi.azure.comk252f kubernetes.io-created-for-pvc-namespace:provisioning-9161]) successfully
I1002 01:55:32.096851       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-f1d1f5f7-ff63-45b7-831c-1ad5308d4724","csi.storage.k8s.io/pvc/name":"test.csi.azure.comk252f","csi.storage.k8s.io/pvc/namespace":"provisioning-9161","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-f1d1f5f7-ff63-45b7-831c-1ad5308d4724"}}
I1002 01:55:32.213940       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-3c71ca27-2ba7-4195-b958-07189f8898d1 StorageAccountType:StandardSSD_LRS Size:5
I1002 01:55:32.214045       1 controllerserver.go:348] create azure disk(pvc-3c71ca27-2ba7-4195-b958-07189f8898d1) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-3c71ca27-2ba7-4195-b958-07189f8898d1 kubernetes.io-created-for-pvc-name:test.csi.azure.comlx257 kubernetes.io-created-for-pvc-namespace:provisioning-6477]) successfully
I1002 01:55:32.214102       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-3c71ca27-2ba7-4195-b958-07189f8898d1","csi.storage.k8s.io/pvc/name":"test.csi.azure.comlx257","csi.storage.k8s.io/pvc/namespace":"provisioning-6477","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-3c71ca27-2ba7-4195-b958-07189f8898d1"}}
I1002 01:55:32.247101       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 01:55:32.247125       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-aa0379d9-1709-45f4-9c57-948094e9eb2a","parameters":{"csi.storage.k8s.io/pv/name":"pvc-aa0379d9-1709-45f4-9c57-948094e9eb2a","csi.storage.k8s.io/pvc/name":"inline-volume-tester-wvdrh-my-volume-0","csi.storage.k8s.io/pvc/namespace":"ephemeral-4353"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 01:55:32.267315       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-aa0379d9-1709-45f4-9c57-948094e9eb2a, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-aa0379d9-1709-45f4-9c57-948094e9eb2a' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 01:55:32.267410       1 controllerserver.go:271] begin to create azure disk(pvc-aa0379d9-1709-45f4-9c57-948094e9eb2a) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 01:55:32.267438       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-aa0379d9-1709-45f4-9c57-948094e9eb2a StorageAccountType:StandardSSD_LRS Size:5
I1002 01:55:32.387708       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-fa5712bf-8647-4948-a5c0-c1b46143e997 StorageAccountType:StandardSSD_LRS Size:5
I1002 01:55:32.387741       1 controllerserver.go:348] create azure disk(pvc-fa5712bf-8647-4948-a5c0-c1b46143e997) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-fa5712bf-8647-4948-a5c0-c1b46143e997 kubernetes.io-created-for-pvc-name:test.csi.azure.comp6xb8 kubernetes.io-created-for-pvc-namespace:provisioning-4786]) successfully
I1002 01:55:32.387778       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-fa5712bf-8647-4948-a5c0-c1b46143e997","csi.storage.k8s.io/pvc/name":"test.csi.azure.comp6xb8","csi.storage.k8s.io/pvc/namespace":"provisioning-4786","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-fa5712bf-8647-4948-a5c0-c1b46143e997"}}
I1002 01:55:32.569604       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-7b6b6c64-a8e8-4dd4-8d01-09520591cf7f StorageAccountType:StandardSSD_LRS Size:5
... skipping 28 lines ...
I1002 01:55:34.588517       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-aa0379d9-1709-45f4-9c57-948094e9eb2a","csi.storage.k8s.io/pvc/name":"inline-volume-tester-wvdrh-my-volume-0","csi.storage.k8s.io/pvc/namespace":"ephemeral-4353","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-aa0379d9-1709-45f4-9c57-948094e9eb2a"}}
I1002 01:55:34.737692       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
I1002 01:55:34.737723       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-49352361-vmss000001","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":7}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-fa5712bf-8647-4948-a5c0-c1b46143e997","csi.storage.k8s.io/pvc/name":"test.csi.azure.comp6xb8","csi.storage.k8s.io/pvc/namespace":"provisioning-4786","requestedsizegib":"5","storage.kubernetes.io/csiProvisionerIdentity":"1633139719760-8081-test.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-fa5712bf-8647-4948-a5c0-c1b46143e997"}
I1002 01:55:34.762382       1 controllerserver.go:440] GetDiskLun returned: <nil>. Initiating attaching volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-fa5712bf-8647-4948-a5c0-c1b46143e997" to node "k8s-agentpool1-49352361-vmss000001".
I1002 01:55:34.762433       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 01:55:34.762472       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-fa5712bf-8647-4948-a5c0-c1b46143e997" to node "k8s-agentpool1-49352361-vmss000001"
I1002 01:55:34.793525       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-f1d1f5f7-ff63-45b7-831c-1ad5308d4724:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-f1d1f5f7-ff63-45b7-831c-1ad5308d4724  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1002 01:55:34.793678       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 01:55:34.793741       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-49352361-vmss000001, refreshing the cache
I1002 01:55:34.802527       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 01:55:34.802547       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-d445dff4-aed9-4366-9530-a4fc40ad1c97","parameters":{"csi.storage.k8s.io/pv/name":"pvc-d445dff4-aed9-4366-9530-a4fc40ad1c97","csi.storage.k8s.io/pvc/name":"pvc-5nx8v","csi.storage.k8s.io/pvc/namespace":"volumelimits-2321"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 01:55:34.896889       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-d445dff4-aed9-4366-9530-a4fc40ad1c97, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-d445dff4-aed9-4366-9530-a4fc40ad1c97' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 01:55:34.897211       1 controllerserver.go:271] begin to create azure disk(pvc-d445dff4-aed9-4366-9530-a4fc40ad1c97) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 01:55:34.897253       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-d445dff4-aed9-4366-9530-a4fc40ad1c97 StorageAccountType:StandardSSD_LRS Size:5
I1002 01:55:34.897431       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-3c71ca27-2ba7-4195-b958-07189f8898d1:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-3c71ca27-2ba7-4195-b958-07189f8898d1  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1002 01:55:34.898724       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-fa5712bf-8647-4948-a5c0-c1b46143e997" lun 1 to node "k8s-agentpool1-49352361-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-fa5712bf-8647-4948-a5c0-c1b46143e997:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-fa5712bf-8647-4948-a5c0-c1b46143e997  true false 1})]
I1002 01:55:34.898752       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 01:55:34.898801       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-fa5712bf-8647-4948-a5c0-c1b46143e997:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-fa5712bf-8647-4948-a5c0-c1b46143e997  true false 1})])
I1002 01:55:34.912587       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 01:55:34.912612       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-ec5cb6d2-2a40-4f38-8af1-bdde74d41daf","parameters":{"csi.storage.k8s.io/pv/name":"pvc-ec5cb6d2-2a40-4f38-8af1-bdde74d41daf","csi.storage.k8s.io/pvc/name":"pvc-c6zql","csi.storage.k8s.io/pvc/namespace":"volumelimits-2321"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 01:55:34.965879       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-ec5cb6d2-2a40-4f38-8af1-bdde74d41daf, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-ec5cb6d2-2a40-4f38-8af1-bdde74d41daf' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 01:55:34.965932       1 controllerserver.go:271] begin to create azure disk(pvc-ec5cb6d2-2a40-4f38-8af1-bdde74d41daf) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 01:55:34.965943       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-ec5cb6d2-2a40-4f38-8af1-bdde74d41daf StorageAccountType:StandardSSD_LRS Size:5
I1002 01:55:35.029602       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 01:55:35.029626       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-a6f40584-cccb-4097-b8c5-d0043ebf7e12","parameters":{"csi.storage.k8s.io/pv/name":"pvc-a6f40584-cccb-4097-b8c5-d0043ebf7e12","csi.storage.k8s.io/pvc/name":"pvc-cdc6n","csi.storage.k8s.io/pvc/namespace":"volumelimits-2321"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 01:55:35.037329       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-fa5712bf-8647-4948-a5c0-c1b46143e997:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-fa5712bf-8647-4948-a5c0-c1b46143e997  true false 1})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1002 01:55:35.054939       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a6f40584-cccb-4097-b8c5-d0043ebf7e12, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-a6f40584-cccb-4097-b8c5-d0043ebf7e12' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 01:55:35.055011       1 controllerserver.go:271] begin to create azure disk(pvc-a6f40584-cccb-4097-b8c5-d0043ebf7e12) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 01:55:35.055025       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-a6f40584-cccb-4097-b8c5-d0043ebf7e12 StorageAccountType:StandardSSD_LRS Size:5
I1002 01:55:35.062991       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
I1002 01:55:35.063011       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-49352361-vmss000000","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":7}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-35c2534c-cb5e-485c-85f5-f3fc365ff489","csi.storage.k8s.io/pvc/name":"test.csi.azure.comqmtdn","csi.storage.k8s.io/pvc/namespace":"fsgroupchangepolicy-8381","requestedsizegib":"5","storage.kubernetes.io/csiProvisionerIdentity":"1633139719760-8081-test.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-35c2534c-cb5e-485c-85f5-f3fc365ff489"}
I1002 01:55:35.097885       1 controllerserver.go:440] GetDiskLun returned: <nil>. Initiating attaching volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-35c2534c-cb5e-485c-85f5-f3fc365ff489" to node "k8s-agentpool1-49352361-vmss000000".
I1002 01:55:35.097931       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
... skipping 6 lines ...
I1002 01:55:35.143516       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 01:55:35.143538       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-3561166c-3c17-4714-863e-423465baaec5","parameters":{"csi.storage.k8s.io/pv/name":"pvc-3561166c-3c17-4714-863e-423465baaec5","csi.storage.k8s.io/pvc/name":"pvc-c7bqr","csi.storage.k8s.io/pvc/namespace":"volumelimits-2321"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 01:55:35.147202       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
I1002 01:55:35.147224       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-49352361-vmss000001","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":7}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-ff2b513a-845f-4230-a382-e4d526ea336f","csi.storage.k8s.io/pvc/name":"test.csi.azure.comm77q4","csi.storage.k8s.io/pvc/namespace":"provisioning-2392","requestedsizegib":"5","storage.kubernetes.io/csiProvisionerIdentity":"1633139719760-8081-test.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-ff2b513a-845f-4230-a382-e4d526ea336f"}
I1002 01:55:35.297279       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 01:55:35.297305       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-0bf4e443-1f9d-49eb-9a5f-5fa0838d9ff6","parameters":{"csi.storage.k8s.io/pv/name":"pvc-0bf4e443-1f9d-49eb-9a5f-5fa0838d9ff6","csi.storage.k8s.io/pvc/name":"pvc-rvvks","csi.storage.k8s.io/pvc/namespace":"volumelimits-2321"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 01:55:35.317935       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-0bf4e443-1f9d-49eb-9a5f-5fa0838d9ff6, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-0bf4e443-1f9d-49eb-9a5f-5fa0838d9ff6' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 01:55:35.317993       1 controllerserver.go:271] begin to create azure disk(pvc-0bf4e443-1f9d-49eb-9a5f-5fa0838d9ff6) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 01:55:35.318007       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-0bf4e443-1f9d-49eb-9a5f-5fa0838d9ff6 StorageAccountType:StandardSSD_LRS Size:5
I1002 01:55:35.319457       1 controllerserver.go:440] GetDiskLun returned: <nil>. Initiating attaching volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-ff2b513a-845f-4230-a382-e4d526ea336f" to node "k8s-agentpool1-49352361-vmss000001".
I1002 01:55:35.319488       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 01:55:35.319526       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-ff2b513a-845f-4230-a382-e4d526ea336f" to node "k8s-agentpool1-49352361-vmss000001"
I1002 01:55:35.319569       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 01:55:35.319581       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-ff2b513a-845f-4230-a382-e4d526ea336f" lun 2 to node "k8s-agentpool1-49352361-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-ff2b513a-845f-4230-a382-e4d526ea336f:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-ff2b513a-845f-4230-a382-e4d526ea336f  true false 2})]
I1002 01:55:35.319597       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 01:55:35.319611       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-ff2b513a-845f-4230-a382-e4d526ea336f:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-ff2b513a-845f-4230-a382-e4d526ea336f  true false 2})])
I1002 01:55:35.319790       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-35c2534c-cb5e-485c-85f5-f3fc365ff489:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-35c2534c-cb5e-485c-85f5-f3fc365ff489  true false 1})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1002 01:55:35.334931       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-3561166c-3c17-4714-863e-423465baaec5, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-3561166c-3c17-4714-863e-423465baaec5' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 01:55:35.334977       1 controllerserver.go:271] begin to create azure disk(pvc-3561166c-3c17-4714-863e-423465baaec5) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 01:55:35.334991       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-3561166c-3c17-4714-863e-423465baaec5 StorageAccountType:StandardSSD_LRS Size:5
I1002 01:55:35.396741       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 01:55:35.396762       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-cefb6057-ef88-4f5b-b3bf-c887a8758dc1","parameters":{"csi.storage.k8s.io/pv/name":"pvc-cefb6057-ef88-4f5b-b3bf-c887a8758dc1","csi.storage.k8s.io/pvc/name":"pvc-ks5zx","csi.storage.k8s.io/pvc/namespace":"volumelimits-2321"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 01:55:35.414521       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-cefb6057-ef88-4f5b-b3bf-c887a8758dc1, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-cefb6057-ef88-4f5b-b3bf-c887a8758dc1' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 01:55:35.414614       1 controllerserver.go:271] begin to create azure disk(pvc-cefb6057-ef88-4f5b-b3bf-c887a8758dc1) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 01:55:35.414625       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-cefb6057-ef88-4f5b-b3bf-c887a8758dc1 StorageAccountType:StandardSSD_LRS Size:5
I1002 01:55:35.478540       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-ff2b513a-845f-4230-a382-e4d526ea336f:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-ff2b513a-845f-4230-a382-e4d526ea336f  true false 2})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1002 01:55:35.480203       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 01:55:35.480225       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-79259067-5ab4-46c6-92c0-25e349e60642","parameters":{"csi.storage.k8s.io/pv/name":"pvc-79259067-5ab4-46c6-92c0-25e349e60642","csi.storage.k8s.io/pvc/name":"pvc-s95rl","csi.storage.k8s.io/pvc/namespace":"volumelimits-2321"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 01:55:35.516222       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-79259067-5ab4-46c6-92c0-25e349e60642, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-79259067-5ab4-46c6-92c0-25e349e60642' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 01:55:35.516271       1 controllerserver.go:271] begin to create azure disk(pvc-79259067-5ab4-46c6-92c0-25e349e60642) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 01:55:35.516282       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-79259067-5ab4-46c6-92c0-25e349e60642 StorageAccountType:StandardSSD_LRS Size:5
I1002 01:55:35.594394       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 01:55:35.594417       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-23545196-3d12-4834-aa61-c8d368336718","parameters":{"csi.storage.k8s.io/pv/name":"pvc-23545196-3d12-4834-aa61-c8d368336718","csi.storage.k8s.io/pvc/name":"pvc-xspp8","csi.storage.k8s.io/pvc/namespace":"volumelimits-2321"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 01:55:35.613378       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-23545196-3d12-4834-aa61-c8d368336718, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-23545196-3d12-4834-aa61-c8d368336718' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 01:55:35.613446       1 controllerserver.go:271] begin to create azure disk(pvc-23545196-3d12-4834-aa61-c8d368336718) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 01:55:35.613458       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-23545196-3d12-4834-aa61-c8d368336718 StorageAccountType:StandardSSD_LRS Size:5
I1002 01:55:35.702653       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 01:55:35.702675       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-fefd5745-9464-47d6-9eaa-287efd2a85ee","parameters":{"csi.storage.k8s.io/pv/name":"pvc-fefd5745-9464-47d6-9eaa-287efd2a85ee","csi.storage.k8s.io/pvc/name":"pvc-8mcss","csi.storage.k8s.io/pvc/namespace":"volumelimits-2321"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 01:55:35.724327       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-fefd5745-9464-47d6-9eaa-287efd2a85ee, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-fefd5745-9464-47d6-9eaa-287efd2a85ee' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 01:55:35.724406       1 controllerserver.go:271] begin to create azure disk(pvc-fefd5745-9464-47d6-9eaa-287efd2a85ee) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 01:55:35.724420       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-fefd5745-9464-47d6-9eaa-287efd2a85ee StorageAccountType:StandardSSD_LRS Size:5
I1002 01:55:35.822771       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 01:55:35.822798       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-a9d53761-38d0-4ba3-b9ac-b81669771528","parameters":{"csi.storage.k8s.io/pv/name":"pvc-a9d53761-38d0-4ba3-b9ac-b81669771528","csi.storage.k8s.io/pvc/name":"pvc-dlhsk","csi.storage.k8s.io/pvc/namespace":"volumelimits-2321"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 01:55:35.840994       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a9d53761-38d0-4ba3-b9ac-b81669771528, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-a9d53761-38d0-4ba3-b9ac-b81669771528' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 01:55:35.841044       1 controllerserver.go:271] begin to create azure disk(pvc-a9d53761-38d0-4ba3-b9ac-b81669771528) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 01:55:35.841072       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-a9d53761-38d0-4ba3-b9ac-b81669771528 StorageAccountType:StandardSSD_LRS Size:5
I1002 01:55:35.928882       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 01:55:35.928902       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-979b09be-2101-4979-a637-fb477d5b4b26","parameters":{"csi.storage.k8s.io/pv/name":"pvc-979b09be-2101-4979-a637-fb477d5b4b26","csi.storage.k8s.io/pvc/name":"pvc-vp8wk","csi.storage.k8s.io/pvc/namespace":"volumelimits-2321"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 01:55:35.948995       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-979b09be-2101-4979-a637-fb477d5b4b26, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-979b09be-2101-4979-a637-fb477d5b4b26' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 01:55:35.949075       1 controllerserver.go:271] begin to create azure disk(pvc-979b09be-2101-4979-a637-fb477d5b4b26) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 01:55:35.949087       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-979b09be-2101-4979-a637-fb477d5b4b26 StorageAccountType:StandardSSD_LRS Size:5
I1002 01:55:36.043287       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 01:55:36.043308       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-ac8ee304-85fd-461e-95e4-fd453165f879","parameters":{"csi.storage.k8s.io/pv/name":"pvc-ac8ee304-85fd-461e-95e4-fd453165f879","csi.storage.k8s.io/pvc/name":"pvc-zsdb8","csi.storage.k8s.io/pvc/namespace":"volumelimits-2321"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 01:55:36.055567       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
I1002 01:55:36.055604       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-49352361-vmss000001","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":7}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-aa0379d9-1709-45f4-9c57-948094e9eb2a","csi.storage.k8s.io/pvc/name":"inline-volume-tester-wvdrh-my-volume-0","csi.storage.k8s.io/pvc/namespace":"ephemeral-4353","requestedsizegib":"5","storage.kubernetes.io/csiProvisionerIdentity":"1633139719760-8081-test.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-aa0379d9-1709-45f4-9c57-948094e9eb2a"}
I1002 01:55:36.065079       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-ac8ee304-85fd-461e-95e4-fd453165f879, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-ac8ee304-85fd-461e-95e4-fd453165f879' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 01:55:36.065175       1 controllerserver.go:271] begin to create azure disk(pvc-ac8ee304-85fd-461e-95e4-fd453165f879) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 01:55:36.065185       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-ac8ee304-85fd-461e-95e4-fd453165f879 StorageAccountType:StandardSSD_LRS Size:5
I1002 01:55:36.128252       1 controllerserver.go:440] GetDiskLun returned: <nil>. Initiating attaching volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-aa0379d9-1709-45f4-9c57-948094e9eb2a" to node "k8s-agentpool1-49352361-vmss000001".
I1002 01:55:36.128277       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 01:55:36.128313       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-49352361-vmss000001, refreshing the cache
I1002 01:55:36.153140       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 01:55:36.153160       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-be201185-40de-4072-8fbc-27c381898ce3","parameters":{"csi.storage.k8s.io/pv/name":"pvc-be201185-40de-4072-8fbc-27c381898ce3","csi.storage.k8s.io/pvc/name":"pvc-f6z9b","csi.storage.k8s.io/pvc/namespace":"volumelimits-2321"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 01:55:36.171850       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-be201185-40de-4072-8fbc-27c381898ce3, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-be201185-40de-4072-8fbc-27c381898ce3' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 01:55:36.171925       1 controllerserver.go:271] begin to create azure disk(pvc-be201185-40de-4072-8fbc-27c381898ce3) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 01:55:36.171936       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-be201185-40de-4072-8fbc-27c381898ce3 StorageAccountType:StandardSSD_LRS Size:5
I1002 01:55:36.186135       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-aa0379d9-1709-45f4-9c57-948094e9eb2a" to node "k8s-agentpool1-49352361-vmss000001"
I1002 01:55:36.186184       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 01:55:36.186200       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-aa0379d9-1709-45f4-9c57-948094e9eb2a" lun 3 to node "k8s-agentpool1-49352361-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-aa0379d9-1709-45f4-9c57-948094e9eb2a:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-aa0379d9-1709-45f4-9c57-948094e9eb2a  true false 3})]
I1002 01:55:36.186213       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 01:55:36.186245       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-aa0379d9-1709-45f4-9c57-948094e9eb2a:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-aa0379d9-1709-45f4-9c57-948094e9eb2a  true false 3})])
I1002 01:55:36.265440       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 01:55:36.265465       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-6547ac36-b6f8-4714-b516-7c1d569329f7","parameters":{"csi.storage.k8s.io/pv/name":"pvc-6547ac36-b6f8-4714-b516-7c1d569329f7","csi.storage.k8s.io/pvc/name":"pvc-jcf2b","csi.storage.k8s.io/pvc/namespace":"volumelimits-2321"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 01:55:36.316485       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-6547ac36-b6f8-4714-b516-7c1d569329f7, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-6547ac36-b6f8-4714-b516-7c1d569329f7' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 01:55:36.316581       1 controllerserver.go:271] begin to create azure disk(pvc-6547ac36-b6f8-4714-b516-7c1d569329f7) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 01:55:36.316595       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-6547ac36-b6f8-4714-b516-7c1d569329f7 StorageAccountType:StandardSSD_LRS Size:5
I1002 01:55:36.378903       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 01:55:36.378926       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-84c060cf-7773-4d64-91d9-ba52b03d8f32","parameters":{"csi.storage.k8s.io/pv/name":"pvc-84c060cf-7773-4d64-91d9-ba52b03d8f32","csi.storage.k8s.io/pvc/name":"pvc-rh726","csi.storage.k8s.io/pvc/namespace":"volumelimits-2321"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 01:55:36.398699       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-84c060cf-7773-4d64-91d9-ba52b03d8f32, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-84c060cf-7773-4d64-91d9-ba52b03d8f32' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 01:55:36.398788       1 controllerserver.go:271] begin to create azure disk(pvc-84c060cf-7773-4d64-91d9-ba52b03d8f32) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 01:55:36.398803       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-84c060cf-7773-4d64-91d9-ba52b03d8f32 StorageAccountType:StandardSSD_LRS Size:5
I1002 01:55:36.490259       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 01:55:36.490282       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-b1972d9d-bb37-4c10-a40c-b1b298200e4a","parameters":{"csi.storage.k8s.io/pv/name":"pvc-b1972d9d-bb37-4c10-a40c-b1b298200e4a","csi.storage.k8s.io/pvc/name":"pvc-qr2xz","csi.storage.k8s.io/pvc/namespace":"volumelimits-2321"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 01:55:36.510078       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-b1972d9d-bb37-4c10-a40c-b1b298200e4a, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-b1972d9d-bb37-4c10-a40c-b1b298200e4a' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 01:55:36.510151       1 controllerserver.go:271] begin to create azure disk(pvc-b1972d9d-bb37-4c10-a40c-b1b298200e4a) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 01:55:36.510166       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-b1972d9d-bb37-4c10-a40c-b1b298200e4a StorageAccountType:StandardSSD_LRS Size:5
I1002 01:55:36.531722       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-aa0379d9-1709-45f4-9c57-948094e9eb2a:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-aa0379d9-1709-45f4-9c57-948094e9eb2a  true false 3})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1002 01:55:36.605087       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 01:55:36.605112       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-8feefd0a-266d-417f-8815-60bd5f67b36a","parameters":{"csi.storage.k8s.io/pv/name":"pvc-8feefd0a-266d-417f-8815-60bd5f67b36a","csi.storage.k8s.io/pvc/name":"pvc-fjqd2","csi.storage.k8s.io/pvc/namespace":"volumelimits-2321"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 01:55:36.624538       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-8feefd0a-266d-417f-8815-60bd5f67b36a, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-8feefd0a-266d-417f-8815-60bd5f67b36a' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 01:55:36.624624       1 controllerserver.go:271] begin to create azure disk(pvc-8feefd0a-266d-417f-8815-60bd5f67b36a) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 01:55:36.624637       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-8feefd0a-266d-417f-8815-60bd5f67b36a StorageAccountType:StandardSSD_LRS Size:5
I1002 01:55:36.716345       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 01:55:36.716371       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-a485a868-121d-41ab-8913-beeadbcd5004","parameters":{"csi.storage.k8s.io/pv/name":"pvc-a485a868-121d-41ab-8913-beeadbcd5004","csi.storage.k8s.io/pvc/name":"pvc-257mj","csi.storage.k8s.io/pvc/namespace":"volumelimits-2321"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 01:55:36.734974       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a485a868-121d-41ab-8913-beeadbcd5004, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-a485a868-121d-41ab-8913-beeadbcd5004' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 01:55:36.735050       1 controllerserver.go:271] begin to create azure disk(pvc-a485a868-121d-41ab-8913-beeadbcd5004) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 01:55:36.735064       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-a485a868-121d-41ab-8913-beeadbcd5004 StorageAccountType:StandardSSD_LRS Size:5
I1002 01:55:36.829077       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 01:55:36.829099       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-8b9b0f93-30e4-46dd-aeb1-c4bb38a4b9c9","parameters":{"csi.storage.k8s.io/pv/name":"pvc-8b9b0f93-30e4-46dd-aeb1-c4bb38a4b9c9","csi.storage.k8s.io/pvc/name":"pvc-mwhfx","csi.storage.k8s.io/pvc/namespace":"volumelimits-2321"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 01:55:36.850987       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-8b9b0f93-30e4-46dd-aeb1-c4bb38a4b9c9, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-8b9b0f93-30e4-46dd-aeb1-c4bb38a4b9c9' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 01:55:36.851055       1 controllerserver.go:271] begin to create azure disk(pvc-8b9b0f93-30e4-46dd-aeb1-c4bb38a4b9c9) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 01:55:36.851085       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-8b9b0f93-30e4-46dd-aeb1-c4bb38a4b9c9 StorageAccountType:StandardSSD_LRS Size:5
I1002 01:55:36.941004       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 01:55:36.941029       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-0cca4774-7263-4bdb-90c3-7b05b92a403c","parameters":{"csi.storage.k8s.io/pv/name":"pvc-0cca4774-7263-4bdb-90c3-7b05b92a403c","csi.storage.k8s.io/pvc/name":"pvc-nlfp6","csi.storage.k8s.io/pvc/namespace":"volumelimits-2321"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 01:55:36.961330       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-0cca4774-7263-4bdb-90c3-7b05b92a403c, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-0cca4774-7263-4bdb-90c3-7b05b92a403c' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 01:55:36.961399       1 controllerserver.go:271] begin to create azure disk(pvc-0cca4774-7263-4bdb-90c3-7b05b92a403c) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 01:55:36.961434       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-0cca4774-7263-4bdb-90c3-7b05b92a403c StorageAccountType:StandardSSD_LRS Size:5
I1002 01:55:37.050886       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 01:55:37.050909       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-a7ec3e97-abdd-407b-a6c9-b9e68d3b7b46","parameters":{"csi.storage.k8s.io/pv/name":"pvc-a7ec3e97-abdd-407b-a6c9-b9e68d3b7b46","csi.storage.k8s.io/pvc/name":"pvc-4vvn8","csi.storage.k8s.io/pvc/namespace":"volumelimits-2321"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 01:55:37.069628       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a7ec3e97-abdd-407b-a6c9-b9e68d3b7b46, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-a7ec3e97-abdd-407b-a6c9-b9e68d3b7b46' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 01:55:37.069701       1 controllerserver.go:271] begin to create azure disk(pvc-a7ec3e97-abdd-407b-a6c9-b9e68d3b7b46) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 01:55:37.069741       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-a7ec3e97-abdd-407b-a6c9-b9e68d3b7b46 StorageAccountType:StandardSSD_LRS Size:5
I1002 01:55:37.162921       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 01:55:37.162944       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-a3455826-e1c4-4ea4-b049-78bdd809f47d","parameters":{"csi.storage.k8s.io/pv/name":"pvc-a3455826-e1c4-4ea4-b049-78bdd809f47d","csi.storage.k8s.io/pvc/name":"pvc-tm7k9","csi.storage.k8s.io/pvc/namespace":"volumelimits-2321"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 01:55:37.183872       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a3455826-e1c4-4ea4-b049-78bdd809f47d, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-a3455826-e1c4-4ea4-b049-78bdd809f47d' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 01:55:37.183935       1 controllerserver.go:271] begin to create azure disk(pvc-a3455826-e1c4-4ea4-b049-78bdd809f47d) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 01:55:37.183955       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-a3455826-e1c4-4ea4-b049-78bdd809f47d StorageAccountType:StandardSSD_LRS Size:5
I1002 01:55:37.274569       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 01:55:37.274597       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-4a4cdcfd-df1f-440b-a765-a1d240ff3c8e","parameters":{"csi.storage.k8s.io/pv/name":"pvc-4a4cdcfd-df1f-440b-a765-a1d240ff3c8e","csi.storage.k8s.io/pvc/name":"pvc-jzv2l","csi.storage.k8s.io/pvc/namespace":"volumelimits-2321"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 01:55:37.294270       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-4a4cdcfd-df1f-440b-a765-a1d240ff3c8e, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-4a4cdcfd-df1f-440b-a765-a1d240ff3c8e' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 01:55:37.294362       1 controllerserver.go:271] begin to create azure disk(pvc-4a4cdcfd-df1f-440b-a765-a1d240ff3c8e) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 01:55:37.294416       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-4a4cdcfd-df1f-440b-a765-a1d240ff3c8e StorageAccountType:StandardSSD_LRS Size:5
I1002 01:55:37.362949       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-a6f40584-cccb-4097-b8c5-d0043ebf7e12 StorageAccountType:StandardSSD_LRS Size:5
I1002 01:55:37.362985       1 controllerserver.go:348] create azure disk(pvc-a6f40584-cccb-4097-b8c5-d0043ebf7e12) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-a6f40584-cccb-4097-b8c5-d0043ebf7e12 kubernetes.io-created-for-pvc-name:pvc-cdc6n kubernetes.io-created-for-pvc-namespace:volumelimits-2321]) successfully
I1002 01:55:37.363060       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-d445dff4-aed9-4366-9530-a4fc40ad1c97 StorageAccountType:StandardSSD_LRS Size:5
I1002 01:55:37.363108       1 controllerserver.go:348] create azure disk(pvc-d445dff4-aed9-4366-9530-a4fc40ad1c97) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-d445dff4-aed9-4366-9530-a4fc40ad1c97 kubernetes.io-created-for-pvc-name:pvc-5nx8v kubernetes.io-created-for-pvc-namespace:volumelimits-2321]) successfully
I1002 01:55:37.363008       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-a6f40584-cccb-4097-b8c5-d0043ebf7e12","csi.storage.k8s.io/pvc/name":"pvc-cdc6n","csi.storage.k8s.io/pvc/namespace":"volumelimits-2321","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a6f40584-cccb-4097-b8c5-d0043ebf7e12"}}
I1002 01:55:37.363130       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-d445dff4-aed9-4366-9530-a4fc40ad1c97","csi.storage.k8s.io/pvc/name":"pvc-5nx8v","csi.storage.k8s.io/pvc/namespace":"volumelimits-2321","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-d445dff4-aed9-4366-9530-a4fc40ad1c97"}}
I1002 01:55:37.376590       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-ec5cb6d2-2a40-4f38-8af1-bdde74d41daf StorageAccountType:StandardSSD_LRS Size:5
I1002 01:55:37.376641       1 controllerserver.go:348] create azure disk(pvc-ec5cb6d2-2a40-4f38-8af1-bdde74d41daf) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-ec5cb6d2-2a40-4f38-8af1-bdde74d41daf kubernetes.io-created-for-pvc-name:pvc-c6zql kubernetes.io-created-for-pvc-namespace:volumelimits-2321]) successfully
I1002 01:55:37.376680       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-ec5cb6d2-2a40-4f38-8af1-bdde74d41daf","csi.storage.k8s.io/pvc/name":"pvc-c6zql","csi.storage.k8s.io/pvc/namespace":"volumelimits-2321","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-ec5cb6d2-2a40-4f38-8af1-bdde74d41daf"}}
I1002 01:55:37.390109       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 01:55:37.390131       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-cb800d19-4471-47e8-866f-3cc2554b99de","parameters":{"csi.storage.k8s.io/pv/name":"pvc-cb800d19-4471-47e8-866f-3cc2554b99de","csi.storage.k8s.io/pvc/name":"pvc-nsm68","csi.storage.k8s.io/pvc/namespace":"volumelimits-2321"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 01:55:37.408384       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-cb800d19-4471-47e8-866f-3cc2554b99de, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-cb800d19-4471-47e8-866f-3cc2554b99de' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 01:55:37.408437       1 controllerserver.go:271] begin to create azure disk(pvc-cb800d19-4471-47e8-866f-3cc2554b99de) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 01:55:37.408453       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-cb800d19-4471-47e8-866f-3cc2554b99de StorageAccountType:StandardSSD_LRS Size:5
I1002 01:55:37.502247       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 01:55:37.502272       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-031c812a-7dea-4c97-bc84-11005a74d95e","parameters":{"csi.storage.k8s.io/pv/name":"pvc-031c812a-7dea-4c97-bc84-11005a74d95e","csi.storage.k8s.io/pvc/name":"pvc-rzzb2","csi.storage.k8s.io/pvc/namespace":"volumelimits-2321"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 01:55:37.533445       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-031c812a-7dea-4c97-bc84-11005a74d95e, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-031c812a-7dea-4c97-bc84-11005a74d95e' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 01:55:37.533505       1 controllerserver.go:271] begin to create azure disk(pvc-031c812a-7dea-4c97-bc84-11005a74d95e) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 01:55:37.533537       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-031c812a-7dea-4c97-bc84-11005a74d95e StorageAccountType:StandardSSD_LRS Size:5
I1002 01:55:37.613573       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 01:55:37.613598       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-72bbe44f-5021-4f51-a052-e6e81a5b7fac","parameters":{"csi.storage.k8s.io/pv/name":"pvc-72bbe44f-5021-4f51-a052-e6e81a5b7fac","csi.storage.k8s.io/pvc/name":"pvc-xm4gd","csi.storage.k8s.io/pvc/namespace":"volumelimits-2321"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 01:55:37.632834       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-72bbe44f-5021-4f51-a052-e6e81a5b7fac, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-72bbe44f-5021-4f51-a052-e6e81a5b7fac' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 01:55:37.632927       1 controllerserver.go:271] begin to create azure disk(pvc-72bbe44f-5021-4f51-a052-e6e81a5b7fac) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 01:55:37.632965       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-72bbe44f-5021-4f51-a052-e6e81a5b7fac StorageAccountType:StandardSSD_LRS Size:5
I1002 01:55:37.635485       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-0bf4e443-1f9d-49eb-9a5f-5fa0838d9ff6 StorageAccountType:StandardSSD_LRS Size:5
I1002 01:55:37.635530       1 controllerserver.go:348] create azure disk(pvc-0bf4e443-1f9d-49eb-9a5f-5fa0838d9ff6) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-0bf4e443-1f9d-49eb-9a5f-5fa0838d9ff6 kubernetes.io-created-for-pvc-name:pvc-rvvks kubernetes.io-created-for-pvc-namespace:volumelimits-2321]) successfully
I1002 01:55:37.635573       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-0bf4e443-1f9d-49eb-9a5f-5fa0838d9ff6","csi.storage.k8s.io/pvc/name":"pvc-rvvks","csi.storage.k8s.io/pvc/namespace":"volumelimits-2321","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-0bf4e443-1f9d-49eb-9a5f-5fa0838d9ff6"}}
I1002 01:55:37.708595       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-cefb6057-ef88-4f5b-b3bf-c887a8758dc1 StorageAccountType:StandardSSD_LRS Size:5
I1002 01:55:37.708630       1 controllerserver.go:348] create azure disk(pvc-cefb6057-ef88-4f5b-b3bf-c887a8758dc1) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-cefb6057-ef88-4f5b-b3bf-c887a8758dc1 kubernetes.io-created-for-pvc-name:pvc-ks5zx kubernetes.io-created-for-pvc-namespace:volumelimits-2321]) successfully
I1002 01:55:37.708650       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-cefb6057-ef88-4f5b-b3bf-c887a8758dc1","csi.storage.k8s.io/pvc/name":"pvc-ks5zx","csi.storage.k8s.io/pvc/namespace":"volumelimits-2321","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-cefb6057-ef88-4f5b-b3bf-c887a8758dc1"}}
I1002 01:55:37.723433       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 01:55:37.723454       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-68177a65-d451-4832-912d-e4809b961979","parameters":{"csi.storage.k8s.io/pv/name":"pvc-68177a65-d451-4832-912d-e4809b961979","csi.storage.k8s.io/pvc/name":"pvc-mvkw8","csi.storage.k8s.io/pvc/namespace":"volumelimits-2321"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 01:55:37.732266       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-3561166c-3c17-4714-863e-423465baaec5 StorageAccountType:StandardSSD_LRS Size:5
I1002 01:55:37.732297       1 controllerserver.go:348] create azure disk(pvc-3561166c-3c17-4714-863e-423465baaec5) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-3561166c-3c17-4714-863e-423465baaec5 kubernetes.io-created-for-pvc-name:pvc-c7bqr kubernetes.io-created-for-pvc-namespace:volumelimits-2321]) successfully
I1002 01:55:37.732313       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-3561166c-3c17-4714-863e-423465baaec5","csi.storage.k8s.io/pvc/name":"pvc-c7bqr","csi.storage.k8s.io/pvc/namespace":"volumelimits-2321","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-3561166c-3c17-4714-863e-423465baaec5"}}
I1002 01:55:37.741882       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-68177a65-d451-4832-912d-e4809b961979, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-68177a65-d451-4832-912d-e4809b961979' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 01:55:37.741946       1 controllerserver.go:271] begin to create azure disk(pvc-68177a65-d451-4832-912d-e4809b961979) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 01:55:37.741956       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-68177a65-d451-4832-912d-e4809b961979 StorageAccountType:StandardSSD_LRS Size:5
I1002 01:55:37.835759       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 01:55:37.835782       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-fd256ead-d61a-475c-bb84-e662602d2698","parameters":{"csi.storage.k8s.io/pv/name":"pvc-fd256ead-d61a-475c-bb84-e662602d2698","csi.storage.k8s.io/pvc/name":"pvc-gb96x","csi.storage.k8s.io/pvc/namespace":"volumelimits-2321"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 01:55:37.858095       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-fd256ead-d61a-475c-bb84-e662602d2698, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-fd256ead-d61a-475c-bb84-e662602d2698' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 01:55:37.858166       1 controllerserver.go:271] begin to create azure disk(pvc-fd256ead-d61a-475c-bb84-e662602d2698) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 01:55:37.858177       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-fd256ead-d61a-475c-bb84-e662602d2698 StorageAccountType:StandardSSD_LRS Size:5
I1002 01:55:37.917722       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-23545196-3d12-4834-aa61-c8d368336718 StorageAccountType:StandardSSD_LRS Size:5
I1002 01:55:37.917788       1 controllerserver.go:348] create azure disk(pvc-23545196-3d12-4834-aa61-c8d368336718) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-23545196-3d12-4834-aa61-c8d368336718 kubernetes.io-created-for-pvc-name:pvc-xspp8 kubernetes.io-created-for-pvc-namespace:volumelimits-2321]) successfully
I1002 01:55:37.917837       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-23545196-3d12-4834-aa61-c8d368336718","csi.storage.k8s.io/pvc/name":"pvc-xspp8","csi.storage.k8s.io/pvc/namespace":"volumelimits-2321","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-23545196-3d12-4834-aa61-c8d368336718"}}
I1002 01:55:37.933593       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-79259067-5ab4-46c6-92c0-25e349e60642 StorageAccountType:StandardSSD_LRS Size:5
I1002 01:55:37.933657       1 controllerserver.go:348] create azure disk(pvc-79259067-5ab4-46c6-92c0-25e349e60642) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-79259067-5ab4-46c6-92c0-25e349e60642 kubernetes.io-created-for-pvc-name:pvc-s95rl kubernetes.io-created-for-pvc-namespace:volumelimits-2321]) successfully
I1002 01:55:37.933680       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-79259067-5ab4-46c6-92c0-25e349e60642","csi.storage.k8s.io/pvc/name":"pvc-s95rl","csi.storage.k8s.io/pvc/namespace":"volumelimits-2321","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-79259067-5ab4-46c6-92c0-25e349e60642"}}
I1002 01:55:38.025817       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 01:55:38.025841       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-a7d90131-1373-4d79-922a-da470b16b60b","parameters":{"csi.storage.k8s.io/pv/name":"pvc-a7d90131-1373-4d79-922a-da470b16b60b","csi.storage.k8s.io/pvc/name":"pvc-w7sll","csi.storage.k8s.io/pvc/namespace":"volumelimits-2321"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 01:55:38.045499       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a7d90131-1373-4d79-922a-da470b16b60b, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-a7d90131-1373-4d79-922a-da470b16b60b' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 01:55:38.045597       1 controllerserver.go:271] begin to create azure disk(pvc-a7d90131-1373-4d79-922a-da470b16b60b) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 01:55:38.045654       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-a7d90131-1373-4d79-922a-da470b16b60b StorageAccountType:StandardSSD_LRS Size:5
I1002 01:55:38.046649       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-fefd5745-9464-47d6-9eaa-287efd2a85ee StorageAccountType:StandardSSD_LRS Size:5
I1002 01:55:38.046695       1 controllerserver.go:348] create azure disk(pvc-fefd5745-9464-47d6-9eaa-287efd2a85ee) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-fefd5745-9464-47d6-9eaa-287efd2a85ee kubernetes.io-created-for-pvc-name:pvc-8mcss kubernetes.io-created-for-pvc-namespace:volumelimits-2321]) successfully
I1002 01:55:38.046712       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-fefd5745-9464-47d6-9eaa-287efd2a85ee","csi.storage.k8s.io/pvc/name":"pvc-8mcss","csi.storage.k8s.io/pvc/namespace":"volumelimits-2321","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-fefd5745-9464-47d6-9eaa-287efd2a85ee"}}
I1002 01:55:38.125323       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 01:55:38.125347       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-a5ca3c0d-628e-4d66-b0f9-e8e164307edd","parameters":{"csi.storage.k8s.io/pv/name":"pvc-a5ca3c0d-628e-4d66-b0f9-e8e164307edd","csi.storage.k8s.io/pvc/name":"pvc-fq546","csi.storage.k8s.io/pvc/namespace":"volumelimits-2321"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 01:55:38.145844       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a5ca3c0d-628e-4d66-b0f9-e8e164307edd, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-a5ca3c0d-628e-4d66-b0f9-e8e164307edd' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 01:55:38.145912       1 controllerserver.go:271] begin to create azure disk(pvc-a5ca3c0d-628e-4d66-b0f9-e8e164307edd) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 01:55:38.145925       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-a5ca3c0d-628e-4d66-b0f9-e8e164307edd StorageAccountType:StandardSSD_LRS Size:5
I1002 01:55:38.190795       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-a9d53761-38d0-4ba3-b9ac-b81669771528 StorageAccountType:StandardSSD_LRS Size:5
I1002 01:55:38.190849       1 controllerserver.go:348] create azure disk(pvc-a9d53761-38d0-4ba3-b9ac-b81669771528) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-a9d53761-38d0-4ba3-b9ac-b81669771528 kubernetes.io-created-for-pvc-name:pvc-dlhsk kubernetes.io-created-for-pvc-namespace:volumelimits-2321]) successfully
I1002 01:55:38.190876       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-a9d53761-38d0-4ba3-b9ac-b81669771528","csi.storage.k8s.io/pvc/name":"pvc-dlhsk","csi.storage.k8s.io/pvc/namespace":"volumelimits-2321","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a9d53761-38d0-4ba3-b9ac-b81669771528"}}
I1002 01:55:38.376188       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 01:55:38.376215       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-694728f1-43e9-414f-8cb9-ac6ffb4cdbd9","parameters":{"csi.storage.k8s.io/pv/name":"pvc-694728f1-43e9-414f-8cb9-ac6ffb4cdbd9","csi.storage.k8s.io/pvc/name":"pvc-b74ts","csi.storage.k8s.io/pvc/namespace":"volumelimits-2321"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 01:55:38.395822       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-694728f1-43e9-414f-8cb9-ac6ffb4cdbd9, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-694728f1-43e9-414f-8cb9-ac6ffb4cdbd9' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 01:55:38.395916       1 controllerserver.go:271] begin to create azure disk(pvc-694728f1-43e9-414f-8cb9-ac6ffb4cdbd9) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 01:55:38.395930       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-694728f1-43e9-414f-8cb9-ac6ffb4cdbd9 StorageAccountType:StandardSSD_LRS Size:5
I1002 01:55:38.446880       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-979b09be-2101-4979-a637-fb477d5b4b26 StorageAccountType:StandardSSD_LRS Size:5
I1002 01:55:38.446920       1 controllerserver.go:348] create azure disk(pvc-979b09be-2101-4979-a637-fb477d5b4b26) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-979b09be-2101-4979-a637-fb477d5b4b26 kubernetes.io-created-for-pvc-name:pvc-vp8wk kubernetes.io-created-for-pvc-namespace:volumelimits-2321]) successfully
I1002 01:55:38.446943       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-979b09be-2101-4979-a637-fb477d5b4b26","csi.storage.k8s.io/pvc/name":"pvc-vp8wk","csi.storage.k8s.io/pvc/namespace":"volumelimits-2321","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-979b09be-2101-4979-a637-fb477d5b4b26"}}
I1002 01:55:38.476590       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 01:55:38.476612       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-269327bc-6ff3-4a73-ad55-7bd80c06e321","parameters":{"csi.storage.k8s.io/pv/name":"pvc-269327bc-6ff3-4a73-ad55-7bd80c06e321","csi.storage.k8s.io/pvc/name":"pvc-9875f","csi.storage.k8s.io/pvc/namespace":"volumelimits-2321"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 01:55:38.493552       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-269327bc-6ff3-4a73-ad55-7bd80c06e321, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-269327bc-6ff3-4a73-ad55-7bd80c06e321' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 01:55:38.493638       1 controllerserver.go:271] begin to create azure disk(pvc-269327bc-6ff3-4a73-ad55-7bd80c06e321) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 01:55:38.493652       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-269327bc-6ff3-4a73-ad55-7bd80c06e321 StorageAccountType:StandardSSD_LRS Size:5
I1002 01:55:38.510720       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-ac8ee304-85fd-461e-95e4-fd453165f879 StorageAccountType:StandardSSD_LRS Size:5
I1002 01:55:38.510749       1 controllerserver.go:348] create azure disk(pvc-ac8ee304-85fd-461e-95e4-fd453165f879) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-ac8ee304-85fd-461e-95e4-fd453165f879 kubernetes.io-created-for-pvc-name:pvc-zsdb8 kubernetes.io-created-for-pvc-namespace:volumelimits-2321]) successfully
I1002 01:55:38.510766       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-ac8ee304-85fd-461e-95e4-fd453165f879","csi.storage.k8s.io/pvc/name":"pvc-zsdb8","csi.storage.k8s.io/pvc/namespace":"volumelimits-2321","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-ac8ee304-85fd-461e-95e4-fd453165f879"}}
I1002 01:55:38.569469       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-be201185-40de-4072-8fbc-27c381898ce3 StorageAccountType:StandardSSD_LRS Size:5
... skipping 325 lines ...
I1002 01:57:02.263376       1 controllerserver.go:533] detach volume /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-35c2534c-cb5e-485c-85f5-f3fc365ff489 from node k8s-agentpool1-49352361-vmss000000 successfully
I1002 01:57:02.263389       1 utils.go:102] GRPC response: {}
I1002 01:57:02.263506       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 01:57:02.263561       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-49352361-vmss000000, refreshing the cache
I1002 01:57:02.265964       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 01:57:02.265983       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-a3f4bd85-4df8-48ee-b7c4-aad35736dc2c","parameters":{"csi.storage.k8s.io/pv/name":"pvc-a3f4bd85-4df8-48ee-b7c4-aad35736dc2c","csi.storage.k8s.io/pvc/name":"test.csi.azure.comxlnsd","csi.storage.k8s.io/pvc/namespace":"fsgroupchangepolicy-6488"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 01:57:02.286680       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a3f4bd85-4df8-48ee-b7c4-aad35736dc2c, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-a3f4bd85-4df8-48ee-b7c4-aad35736dc2c' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 01:57:02.286807       1 controllerserver.go:271] begin to create azure disk(pvc-a3f4bd85-4df8-48ee-b7c4-aad35736dc2c) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 01:57:02.286840       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-a3f4bd85-4df8-48ee-b7c4-aad35736dc2c StorageAccountType:StandardSSD_LRS Size:5
I1002 01:57:02.317395       1 azure_controller_vmss.go:225] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000001) - detach disk(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-f1d1f5f7-ff63-45b7-831c-1ad5308d4724:pvc-f1d1f5f7-ff63-45b7-831c-1ad5308d4724 /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-ff2b513a-845f-4230-a382-e4d526ea336f:pvc-ff2b513a-845f-4230-a382-e4d526ea336f]) returned with <nil>
I1002 01:57:02.343130       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-4a4cdcfd-df1f-440b-a765-a1d240ff3c8e" lun 18 to node "k8s-agentpool1-49352361-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-031c812a-7dea-4c97-bc84-11005a74d95e:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-031c812a-7dea-4c97-bc84-11005a74d95e  true false 17}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-0bf4e443-1f9d-49eb-9a5f-5fa0838d9ff6:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-0bf4e443-1f9d-49eb-9a5f-5fa0838d9ff6  true false 31}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-0cca4774-7263-4bdb-90c3-7b05b92a403c:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-0cca4774-7263-4bdb-90c3-7b05b92a403c  true false 11}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-23545196-3d12-4834-aa61-c8d368336718:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-23545196-3d12-4834-aa61-c8d368336718  true false 6}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-269327bc-6ff3-4a73-ad55-7bd80c06e321:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-269327bc-6ff3-4a73-ad55-7bd80c06e321  true false 23}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-3561166c-3c17-4714-863e-423465baaec5:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-3561166c-3c17-4714-863e-423465baaec5  true false 14}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-4a4cdcfd-df1f-440b-a765-a1d240ff3c8e:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-4a4cdcfd-df1f-440b-a765-a1d240ff3c8e  true false 18}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-6547ac36-b6f8-4714-b516-7c1d569329f7:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-6547ac36-b6f8-4714-b516-7c1d569329f7  true false 4}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-68177a65-d451-4832-912d-e4809b961979:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-68177a65-d451-4832-912d-e4809b961979  true false 2}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-694728f1-43e9-414f-8cb9-ac6ffb4cdbd9:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-694728f1-43e9-414f-8cb9-ac6ffb4cdbd9  true false 20}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-72bbe44f-5021-4f51-a052-e6e81a5b7fac:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-72bbe44f-5021-4f51-a052-e6e81a5b7fac  true false 15}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-79259067-5ab4-46c6-92c0-25e349e60642:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-79259067-5ab4-46c6-92c0-25e349e60642  true false 0}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-84c060cf-7773-4d64-91d9-ba52b03d8f32:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-84c060cf-7773-4d64-91d9-ba52b03d8f32  true false 19}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-8b9b0f93-30e4-46dd-aeb1-c4bb38a4b9c9:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-8b9b0f93-30e4-46dd-aeb1-c4bb38a4b9c9  true false 13}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-8feefd0a-266d-417f-8815-60bd5f67b36a:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-8feefd0a-266d-417f-8815-60bd5f67b36a  true false 3}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-979b09be-2101-4979-a637-fb477d5b4b26:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-979b09be-2101-4979-a637-fb477d5b4b26  true false 16}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-a3455826-e1c4-4ea4-b049-78bdd809f47d:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-a3455826-e1c4-4ea4-b049-78bdd809f47d  true false 8}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-a485a868-121d-41ab-8913-beeadbcd5004:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-a485a868-121d-41ab-8913-beeadbcd5004  true false 7}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-a5ca3c0d-628e-4d66-b0f9-e8e164307edd:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-a5ca3c0d-628e-4d66-b0f9-e8e164307edd  true false 12}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-a6f40584-cccb-4097-b8c5-d0043ebf7e12:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-a6f40584-cccb-4097-b8c5-d0043ebf7e12  true false 1}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-a7d90131-1373-4d79-922a-da470b16b60b:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-a7d90131-1373-4d79-922a-da470b16b60b  true false 29}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-a7ec3e97-abdd-407b-a6c9-b9e68d3b7b46:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-a7ec3e97-abdd-407b-a6c9-b9e68d3b7b46  true false 24}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-a9d53761-38d0-4ba3-b9ac-b81669771528:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-a9d53761-38d0-4ba3-b9ac-b81669771528  true false 30}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-ac8ee304-85fd-461e-95e4-fd453165f879:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-ac8ee304-85fd-461e-95e4-fd453165f879  true false 25}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-b1972d9d-bb37-4c10-a40c-b1b298200e4a:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-b1972d9d-bb37-4c10-a40c-b1b298200e4a  true false 9}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-be201185-40de-4072-8fbc-27c381898ce3:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-be201185-40de-4072-8fbc-27c381898ce3  true false 28}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-cb800d19-4471-47e8-866f-3cc2554b99de:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-cb800d19-4471-47e8-866f-3cc2554b99de  true false 26}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-cefb6057-ef88-4f5b-b3bf-c887a8758dc1:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-cefb6057-ef88-4f5b-b3bf-c887a8758dc1  true false 10}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-d445dff4-aed9-4366-9530-a4fc40ad1c97:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-d445dff4-aed9-4366-9530-a4fc40ad1c97  true false 22}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-ec5cb6d2-2a40-4f38-8af1-bdde74d41daf:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-ec5cb6d2-2a40-4f38-8af1-bdde74d41daf  true false 21}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-fd256ead-d61a-475c-bb84-e662602d2698:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-fd256ead-d61a-475c-bb84-e662602d2698  true false 5}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-fefd5745-9464-47d6-9eaa-287efd2a85ee:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-fefd5745-9464-47d6-9eaa-287efd2a85ee  true false 27})]
I1002 01:57:02.343221       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 01:57:02.343217       1 azure_controller_common.go:369] azureDisk - detach disk(pvc-ff2b513a-845f-4230-a382-e4d526ea336f, /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-ff2b513a-845f-4230-a382-e4d526ea336f) succeeded
... skipping 6 lines ...
I1002 01:57:02.355615       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-49352361-vmss000001","volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-ff2b513a-845f-4230-a382-e4d526ea336f"}
I1002 01:57:02.355692       1 controllerserver.go:524] Trying to detach volume /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-ff2b513a-845f-4230-a382-e4d526ea336f from node k8s-agentpool1-49352361-vmss000001
I1002 01:57:02.355699       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 01:57:02.403656       1 azure_controller_vmss.go:174] azureDisk - detach disk: name "pvc-aa0379d9-1709-45f4-9c57-948094e9eb2a" uri "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-aa0379d9-1709-45f4-9c57-948094e9eb2a"
I1002 01:57:02.403701       1 azure_controller_vmss.go:213] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000001) - detach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-aa0379d9-1709-45f4-9c57-948094e9eb2a:pvc-aa0379d9-1709-45f4-9c57-948094e9eb2a /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-fa5712bf-8647-4948-a5c0-c1b46143e997:pvc-fa5712bf-8647-4948-a5c0-c1b46143e997])
I1002 01:57:02.403779       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 01:57:03.299372       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-031c812a-7dea-4c97-bc84-11005a74d95e:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-031c812a-7dea-4c97-bc84-11005a74d95e  true false 17}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-0bf4e443-1f9d-49eb-9a5f-5fa0838d9ff6:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-0bf4e443-1f9d-49eb-9a5f-5fa0838d9ff6  true false 31}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-0cca4774-7263-4bdb-90c3-7b05b92a403c:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-0cca4774-7263-4bdb-90c3-7b05b92a403c  true false 11}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-23545196-3d12-4834-aa61-c8d368336718:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-23545196-3d12-4834-aa61-c8d368336718  true false 6}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-269327bc-6ff3-4a73-ad55-7bd80c06e321:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-269327bc-6ff3-4a73-ad55-7bd80c06e321  true false 23}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-3561166c-3c17-4714-863e-423465baaec5:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-3561166c-3c17-4714-863e-423465baaec5  true false 14}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-4a4cdcfd-df1f-440b-a765-a1d240ff3c8e:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-4a4cdcfd-df1f-440b-a765-a1d240ff3c8e  true false 18}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-6547ac36-b6f8-4714-b516-7c1d569329f7:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-6547ac36-b6f8-4714-b516-7c1d569329f7  true false 4}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-68177a65-d451-4832-912d-e4809b961979:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-68177a65-d451-4832-912d-e4809b961979  true false 2}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-694728f1-43e9-414f-8cb9-ac6ffb4cdbd9:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-694728f1-43e9-414f-8cb9-ac6ffb4cdbd9  true false 20}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-72bbe44f-5021-4f51-a052-e6e81a5b7fac:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-72bbe44f-5021-4f51-a052-e6e81a5b7fac  true false 15}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-79259067-5ab4-46c6-92c0-25e349e60642:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-79259067-5ab4-46c6-92c0-25e349e60642  true false 0}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-84c060cf-7773-4d64-91d9-ba52b03d8f32:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-84c060cf-7773-4d64-91d9-ba52b03d8f32  true false 19}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-8b9b0f93-30e4-46dd-aeb1-c4bb38a4b9c9:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-8b9b0f93-30e4-46dd-aeb1-c4bb38a4b9c9  true false 13}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-8feefd0a-266d-417f-8815-60bd5f67b36a:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-8feefd0a-266d-417f-8815-60bd5f67b36a  true false 3}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-979b09be-2101-4979-a637-fb477d5b4b26:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-979b09be-2101-4979-a637-fb477d5b4b26  true false 16}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-a3455826-e1c4-4ea4-b049-78bdd809f47d:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-a3455826-e1c4-4ea4-b049-78bdd809f47d  true false 8}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-a485a868-121d-41ab-8913-beeadbcd5004:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-a485a868-121d-41ab-8913-beeadbcd5004  true false 7}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-a5ca3c0d-628e-4d66-b0f9-e8e164307edd:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-a5ca3c0d-628e-4d66-b0f9-e8e164307edd  true false 12}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-a6f40584-cccb-4097-b8c5-d0043ebf7e12:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-a6f40584-cccb-4097-b8c5-d0043ebf7e12  true false 1}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-a7d90131-1373-4d79-922a-da470b16b60b:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-a7d90131-1373-4d79-922a-da470b16b60b  true false 29}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-a7ec3e97-abdd-407b-a6c9-b9e68d3b7b46:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-a7ec3e97-abdd-407b-a6c9-b9e68d3b7b46  true false 24}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-a9d53761-38d0-4ba3-b9ac-b81669771528:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-a9d53761-38d0-4ba3-b9ac-b81669771528  true false 30}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-ac8ee304-85fd-461e-95e4-fd453165f879:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-ac8ee304-85fd-461e-95e4-fd453165f879  true false 25}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-b1972d9d-bb37-4c10-a40c-b1b298200e4a:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-b1972d9d-bb37-4c10-a40c-b1b298200e4a  true false 9}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-be201185-40de-4072-8fbc-27c381898ce3:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-be201185-40de-4072-8fbc-27c381898ce3  true false 28}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-cb800d19-4471-47e8-866f-3cc2554b99de:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-cb800d19-4471-47e8-866f-3cc2554b99de  true false 26}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-cefb6057-ef88-4f5b-b3bf-c887a8758dc1:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-cefb6057-ef88-4f5b-b3bf-c887a8758dc1  true false 10}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-d445dff4-aed9-4366-9530-a4fc40ad1c97:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-d445dff4-aed9-4366-9530-a4fc40ad1c97  true false 22}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-ec5cb6d2-2a40-4f38-8af1-bdde74d41daf:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-ec5cb6d2-2a40-4f38-8af1-bdde74d41daf  true false 21}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-fd256ead-d61a-475c-bb84-e662602d2698:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-fd256ead-d61a-475c-bb84-e662602d2698  true false 5}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-fefd5745-9464-47d6-9eaa-287efd2a85ee:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-fefd5745-9464-47d6-9eaa-287efd2a85ee  true false 27})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1002 01:57:03.299659       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 01:57:03.299691       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-49352361-vmss000000, refreshing the cache
I1002 01:57:03.350488       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-ac8ee304-85fd-461e-95e4-fd453165f879" lun 25 to node "k8s-agentpool1-49352361-vmss000000", diskMap: map[]
I1002 01:57:03.350554       1 controllerserver.go:465] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-ac8ee304-85fd-461e-95e4-fd453165f879" attached to node "k8s-agentpool1-49352361-vmss000000".
I1002 01:57:03.350568       1 controllerserver.go:485] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-ac8ee304-85fd-461e-95e4-fd453165f879" to node "k8s-agentpool1-49352361-vmss000000" successfully
I1002 01:57:03.350583       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"25"}}
... skipping 275 lines ...
I1002 01:57:15.264114       1 utils.go:102] GRPC response: {}
I1002 01:57:17.001058       1 utils.go:95] GRPC call: /csi.v1.Controller/DeleteVolume
I1002 01:57:17.001101       1 utils.go:96] GRPC request: {"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-ff2b513a-845f-4230-a382-e4d526ea336f"}
I1002 01:57:17.001221       1 controllerserver.go:389] deleting azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-ff2b513a-845f-4230-a382-e4d526ea336f)
I1002 01:57:19.881004       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 01:57:19.881028       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-0cd3c6ea-2ba9-4023-a199-d8a603c17c37","parameters":{"csi.storage.k8s.io/pv/name":"pvc-0cd3c6ea-2ba9-4023-a199-d8a603c17c37","csi.storage.k8s.io/pvc/name":"test.csi.azure.com4l926","csi.storage.k8s.io/pvc/namespace":"provisioning-3620"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 01:57:19.903688       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-0cd3c6ea-2ba9-4023-a199-d8a603c17c37, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-0cd3c6ea-2ba9-4023-a199-d8a603c17c37' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 01:57:19.903764       1 controllerserver.go:271] begin to create azure disk(pvc-0cd3c6ea-2ba9-4023-a199-d8a603c17c37) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 01:57:19.903793       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-0cd3c6ea-2ba9-4023-a199-d8a603c17c37 StorageAccountType:StandardSSD_LRS Size:5
I1002 01:57:22.193339       1 azure_managedDiskController.go:286] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-ff2b513a-845f-4230-a382-e4d526ea336f
I1002 01:57:22.193377       1 controllerserver.go:391] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-ff2b513a-845f-4230-a382-e4d526ea336f) returned with <nil>
I1002 01:57:22.193402       1 utils.go:102] GRPC response: {}
I1002 01:57:22.221661       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-0cd3c6ea-2ba9-4023-a199-d8a603c17c37 StorageAccountType:StandardSSD_LRS Size:5
... skipping 6 lines ...
I1002 01:57:24.614920       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-0cd3c6ea-2ba9-4023-a199-d8a603c17c37" to node "k8s-agentpool1-49352361-vmss000001"
I1002 01:57:24.966136       1 utils.go:95] GRPC call: /csi.v1.Controller/DeleteVolume
I1002 01:57:24.966161       1 utils.go:96] GRPC request: {"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-35c2534c-cb5e-485c-85f5-f3fc365ff489"}
I1002 01:57:24.966256       1 controllerserver.go:389] deleting azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-35c2534c-cb5e-485c-85f5-f3fc365ff489)
I1002 01:57:29.104648       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 01:57:29.104677       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8","parameters":{"csi.storage.k8s.io/pv/name":"pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8","csi.storage.k8s.io/pvc/name":"inline-volume-tester-82zvb-my-volume-0","csi.storage.k8s.io/pvc/namespace":"ephemeral-2486"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 01:57:29.126228       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 01:57:29.126298       1 controllerserver.go:271] begin to create azure disk(pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 01:57:29.126332       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8 StorageAccountType:StandardSSD_LRS Size:5
I1002 01:57:30.175431       1 azure_managedDiskController.go:286] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-35c2534c-cb5e-485c-85f5-f3fc365ff489
I1002 01:57:30.175457       1 controllerserver.go:391] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-35c2534c-cb5e-485c-85f5-f3fc365ff489) returned with <nil>
I1002 01:57:30.175501       1 utils.go:102] GRPC response: {}
I1002 01:57:31.445332       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8 StorageAccountType:StandardSSD_LRS Size:5
... skipping 5 lines ...
I1002 01:57:32.171749       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 01:57:32.171784       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8" to node "k8s-agentpool1-49352361-vmss000000"
I1002 01:57:32.171802       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 01:57:32.171813       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8" lun 32 to node "k8s-agentpool1-49352361-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8  true false 32})]
I1002 01:57:32.171830       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 01:57:32.171877       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8  true false 32})])
I1002 01:57:32.243807       1 azure_armclient.go:341] Received error in sendAsync.send: resourceID: https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-49352361-vmss/virtualMachines/0?api-version=2020-12-01, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 409, RawError: {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}
I1002 01:57:32.243861       1 azure_armclient.go:594] Received error in put.send: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-49352361-vmss/virtualMachines/0, error: %!s(<nil>)
E1002 01:57:32.243934       1 azure_controller_vmss.go:125] azureDisk - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8  true false 32})]) on rg(kubetest-croyzaob) vm(k8s-agentpool1-49352361-vmss000000) failed, err: &{false 409 0001-01-01 00:00:00 +0000 UTC {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}}
I1002 01:57:32.244030       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8  true false 32})], &{%!s(bool=false) %!s(int=409) 0001-01-01 00:00:00 +0000 UTC {
  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}}) returned with %!v(MISSING)
E1002 01:57:32.244100       1 controllerserver.go:481] Attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8" to instance "k8s-agentpool1-49352361-vmss000000" failed with Retriable: false, RetryAfter: 0s, HTTPStatusCode: 409, RawError: {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}
E1002 01:57:32.244151       1 utils.go:100] GRPC error: Attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8" to instance "k8s-agentpool1-49352361-vmss000000" failed with Retriable: false, RetryAfter: 0s, HTTPStatusCode: 409, RawError: {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}
I1002 01:57:32.250545       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 3 lines ...
I1002 01:57:32.276712       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-49352361-vmss000000, refreshing the cache
I1002 01:57:32.368411       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8" to node "k8s-agentpool1-49352361-vmss000000"
I1002 01:57:32.368483       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 01:57:32.368501       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8" lun 32 to node "k8s-agentpool1-49352361-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8  true false 32})]
I1002 01:57:32.368516       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 01:57:32.368562       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8  true false 32})])
I1002 01:57:32.431800       1 azure_armclient.go:341] Received error in sendAsync.send: resourceID: https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-49352361-vmss/virtualMachines/0?api-version=2020-12-01, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 409, RawError: {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}
I1002 01:57:32.431820       1 azure_armclient.go:594] Received error in put.send: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-49352361-vmss/virtualMachines/0, error: %!s(<nil>)
E1002 01:57:32.431908       1 azure_controller_vmss.go:125] azureDisk - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8  true false 32})]) on rg(kubetest-croyzaob) vm(k8s-agentpool1-49352361-vmss000000) failed, err: &{false 409 0001-01-01 00:00:00 +0000 UTC {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}}
I1002 01:57:32.431951       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8  true false 32})], &{%!s(bool=false) %!s(int=409) 0001-01-01 00:00:00 +0000 UTC {
  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}}) returned with %!v(MISSING)
E1002 01:57:32.431993       1 controllerserver.go:481] Attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8" to instance "k8s-agentpool1-49352361-vmss000000" failed with Retriable: false, RetryAfter: 0s, HTTPStatusCode: 409, RawError: {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}
E1002 01:57:32.432042       1 utils.go:100] GRPC error: Attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8" to instance "k8s-agentpool1-49352361-vmss000000" failed with Retriable: false, RetryAfter: 0s, HTTPStatusCode: 409, RawError: {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}
I1002 01:57:32.438490       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 3 lines ...
I1002 01:57:32.462841       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-49352361-vmss000000, refreshing the cache
I1002 01:57:32.542549       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8" to node "k8s-agentpool1-49352361-vmss000000"
I1002 01:57:32.542598       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 01:57:32.542617       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8" lun 32 to node "k8s-agentpool1-49352361-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8  true false 32})]
I1002 01:57:32.542634       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 01:57:32.542665       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8  true false 32})])
I1002 01:57:32.604333       1 azure_armclient.go:341] Received error in sendAsync.send: resourceID: https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-49352361-vmss/virtualMachines/0?api-version=2020-12-01, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 409, RawError: {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}
I1002 01:57:32.604365       1 azure_armclient.go:594] Received error in put.send: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-49352361-vmss/virtualMachines/0, error: %!s(<nil>)
E1002 01:57:32.604467       1 azure_controller_vmss.go:125] azureDisk - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8  true false 32})]) on rg(kubetest-croyzaob) vm(k8s-agentpool1-49352361-vmss000000) failed, err: &{false 409 0001-01-01 00:00:00 +0000 UTC {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}}
I1002 01:57:32.604497       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8  true false 32})], &{%!s(bool=false) %!s(int=409) 0001-01-01 00:00:00 +0000 UTC {
  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}}) returned with %!v(MISSING)
E1002 01:57:32.604546       1 controllerserver.go:481] Attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8" to instance "k8s-agentpool1-49352361-vmss000000" failed with Retriable: false, RetryAfter: 0s, HTTPStatusCode: 409, RawError: {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}
E1002 01:57:32.604583       1 utils.go:100] GRPC error: Attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8" to instance "k8s-agentpool1-49352361-vmss000000" failed with Retriable: false, RetryAfter: 0s, HTTPStatusCode: 409, RawError: {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}
I1002 01:57:33.250760       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 3 lines ...
I1002 01:57:33.276036       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-49352361-vmss000000, refreshing the cache
I1002 01:57:33.336465       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8" to node "k8s-agentpool1-49352361-vmss000000"
I1002 01:57:33.336500       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 01:57:33.336516       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8" lun 32 to node "k8s-agentpool1-49352361-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8  true false 32})]
I1002 01:57:33.336532       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 01:57:33.336580       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8  true false 32})])
I1002 01:57:33.399647       1 azure_armclient.go:341] Received error in sendAsync.send: resourceID: https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-49352361-vmss/virtualMachines/0?api-version=2020-12-01, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 409, RawError: {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}
I1002 01:57:33.399670       1 azure_armclient.go:594] Received error in put.send: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-49352361-vmss/virtualMachines/0, error: %!s(<nil>)
E1002 01:57:33.399713       1 azure_controller_vmss.go:125] azureDisk - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8  true false 32})]) on rg(kubetest-croyzaob) vm(k8s-agentpool1-49352361-vmss000000) failed, err: &{false 409 0001-01-01 00:00:00 +0000 UTC {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}}
I1002 01:57:33.399746       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8  true false 32})], &{%!s(bool=false) %!s(int=409) 0001-01-01 00:00:00 +0000 UTC {
  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}}) returned with %!v(MISSING)
E1002 01:57:33.399784       1 controllerserver.go:481] Attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8" to instance "k8s-agentpool1-49352361-vmss000000" failed with Retriable: false, RetryAfter: 0s, HTTPStatusCode: 409, RawError: {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}
E1002 01:57:33.399837       1 utils.go:100] GRPC error: Attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8" to instance "k8s-agentpool1-49352361-vmss000000" failed with Retriable: false, RetryAfter: 0s, HTTPStatusCode: 409, RawError: {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}
I1002 01:57:35.048373       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 01:57:35.048439       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-bebf4eac-9258-4547-8916-b3bb1f816b79","parameters":{"csi.storage.k8s.io/pv/name":"pvc-bebf4eac-9258-4547-8916-b3bb1f816b79","csi.storage.k8s.io/pvc/name":"test.csi.azure.comv5wn4","csi.storage.k8s.io/pvc/namespace":"fsgroupchangepolicy-6360"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 01:57:35.068983       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-bebf4eac-9258-4547-8916-b3bb1f816b79, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-bebf4eac-9258-4547-8916-b3bb1f816b79' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 01:57:35.069085       1 controllerserver.go:271] begin to create azure disk(pvc-bebf4eac-9258-4547-8916-b3bb1f816b79) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 01:57:35.069123       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-bebf4eac-9258-4547-8916-b3bb1f816b79 StorageAccountType:StandardSSD_LRS Size:5
I1002 01:57:37.390602       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-bebf4eac-9258-4547-8916-b3bb1f816b79 StorageAccountType:StandardSSD_LRS Size:5
I1002 01:57:37.390642       1 controllerserver.go:348] create azure disk(pvc-bebf4eac-9258-4547-8916-b3bb1f816b79) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-bebf4eac-9258-4547-8916-b3bb1f816b79 kubernetes.io-created-for-pvc-name:test.csi.azure.comv5wn4 kubernetes.io-created-for-pvc-namespace:fsgroupchangepolicy-6360]) successfully
I1002 01:57:37.390672       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-bebf4eac-9258-4547-8916-b3bb1f816b79","csi.storage.k8s.io/pvc/name":"test.csi.azure.comv5wn4","csi.storage.k8s.io/pvc/namespace":"fsgroupchangepolicy-6360","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-bebf4eac-9258-4547-8916-b3bb1f816b79"}}
I1002 01:57:39.817194       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 8 lines ...
I1002 01:57:41.434693       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-49352361-vmss000000, refreshing the cache
I1002 01:57:41.493571       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8" to node "k8s-agentpool1-49352361-vmss000000"
I1002 01:57:41.493603       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 01:57:41.493635       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8" lun 32 to node "k8s-agentpool1-49352361-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8  true false 32})]
I1002 01:57:41.493667       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 01:57:41.493718       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8  true false 32})])
I1002 01:57:41.556902       1 azure_armclient.go:341] Received error in sendAsync.send: resourceID: https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-49352361-vmss/virtualMachines/0?api-version=2020-12-01, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 409, RawError: {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}
I1002 01:57:41.556942       1 azure_armclient.go:594] Received error in put.send: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-49352361-vmss/virtualMachines/0, error: %!s(<nil>)
E1002 01:57:41.557035       1 azure_controller_vmss.go:125] azureDisk - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8  true false 32})]) on rg(kubetest-croyzaob) vm(k8s-agentpool1-49352361-vmss000000) failed, err: &{false 409 0001-01-01 00:00:00 +0000 UTC {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}}
I1002 01:57:41.557059       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8  true false 32})], &{%!s(bool=false) %!s(int=409) 0001-01-01 00:00:00 +0000 UTC {
  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}}) returned with %!v(MISSING)
E1002 01:57:41.557092       1 controllerserver.go:481] Attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8" to instance "k8s-agentpool1-49352361-vmss000000" failed with Retriable: false, RetryAfter: 0s, HTTPStatusCode: 409, RawError: {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}
E1002 01:57:41.557130       1 utils.go:100] GRPC error: Attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8" to instance "k8s-agentpool1-49352361-vmss000000" failed with Retriable: false, RetryAfter: 0s, HTTPStatusCode: 409, RawError: {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}
I1002 01:57:57.568800       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 3 lines ...
I1002 01:57:57.596254       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-49352361-vmss000000, refreshing the cache
I1002 01:57:57.689888       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8" to node "k8s-agentpool1-49352361-vmss000000"
I1002 01:57:57.689925       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 01:57:57.689944       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8" lun 32 to node "k8s-agentpool1-49352361-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8  true false 32})]
I1002 01:57:57.689959       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 01:57:57.690030       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8  true false 32})])
I1002 01:57:57.756108       1 azure_armclient.go:341] Received error in sendAsync.send: resourceID: https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-49352361-vmss/virtualMachines/0?api-version=2020-12-01, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 409, RawError: {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}
I1002 01:57:57.756126       1 azure_armclient.go:594] Received error in put.send: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-49352361-vmss/virtualMachines/0, error: %!s(<nil>)
E1002 01:57:57.756192       1 azure_controller_vmss.go:125] azureDisk - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8  true false 32})]) on rg(kubetest-croyzaob) vm(k8s-agentpool1-49352361-vmss000000) failed, err: &{false 409 0001-01-01 00:00:00 +0000 UTC {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}}
I1002 01:57:57.756266       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8  true false 32})], &{%!s(bool=false) %!s(int=409) 0001-01-01 00:00:00 +0000 UTC {
  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}}) returned with %!v(MISSING)
E1002 01:57:57.756292       1 controllerserver.go:481] Attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8" to instance "k8s-agentpool1-49352361-vmss000000" failed with Retriable: false, RetryAfter: 0s, HTTPStatusCode: 409, RawError: {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}
E1002 01:57:57.756336       1 utils.go:100] GRPC error: Attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8" to instance "k8s-agentpool1-49352361-vmss000000" failed with Retriable: false, RetryAfter: 0s, HTTPStatusCode: 409, RawError: {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}
I1002 01:58:20.008397       1 azure_vmss.go:319] Couldn't find VMSS VM with scaleSetName "k8s-agentpool1-49352361-vmss" and instanceID "0", refreshing the cache
... skipping 3 lines ...
I1002 01:58:29.815232       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 01:58:29.815299       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8" to node "k8s-agentpool1-49352361-vmss000000"
I1002 01:58:29.815313       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 01:58:29.815342       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8" lun 32 to node "k8s-agentpool1-49352361-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8  true false 32})]
I1002 01:58:29.815397       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 01:58:29.815449       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8  true false 32})])
I1002 01:58:29.899002       1 azure_armclient.go:341] Received error in sendAsync.send: resourceID: https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-49352361-vmss/virtualMachines/0?api-version=2020-12-01, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 409, RawError: {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}
I1002 01:58:29.899056       1 azure_armclient.go:594] Received error in put.send: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-49352361-vmss/virtualMachines/0, error: %!s(<nil>)
E1002 01:58:29.899116       1 azure_controller_vmss.go:125] azureDisk - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8  true false 32})]) on rg(kubetest-croyzaob) vm(k8s-agentpool1-49352361-vmss000000) failed, err: &{false 409 0001-01-01 00:00:00 +0000 UTC {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}}
I1002 01:58:29.899140       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8  true false 32})], &{%!s(bool=false) %!s(int=409) 0001-01-01 00:00:00 +0000 UTC {
  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}}) returned with %!v(MISSING)
E1002 01:58:29.899164       1 controllerserver.go:481] Attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8" to instance "k8s-agentpool1-49352361-vmss000000" failed with Retriable: false, RetryAfter: 0s, HTTPStatusCode: 409, RawError: {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}
E1002 01:58:29.899190       1 utils.go:100] GRPC error: Attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8" to instance "k8s-agentpool1-49352361-vmss000000" failed with Retriable: false, RetryAfter: 0s, HTTPStatusCode: 409, RawError: {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}
I1002 01:58:37.978131       1 azure_controller_vmss.go:225] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000001) - detach disk(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-aa0379d9-1709-45f4-9c57-948094e9eb2a:pvc-aa0379d9-1709-45f4-9c57-948094e9eb2a /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-fa5712bf-8647-4948-a5c0-c1b46143e997:pvc-fa5712bf-8647-4948-a5c0-c1b46143e997]) returned with <nil>
... skipping 38 lines ...
I1002 01:58:43.741254       1 controllerserver.go:533] detach volume /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-ff2b513a-845f-4230-a382-e4d526ea336f from node k8s-agentpool1-49352361-vmss000001 successfully
I1002 01:58:43.741285       1 utils.go:102] GRPC response: {}
I1002 01:58:43.741331       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 01:58:43.741388       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a3f4bd85-4df8-48ee-b7c4-aad35736dc2c" lun 1 to node "k8s-agentpool1-49352361-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-0cd3c6ea-2ba9-4023-a199-d8a603c17c37:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-0cd3c6ea-2ba9-4023-a199-d8a603c17c37  true false 2}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-a3f4bd85-4df8-48ee-b7c4-aad35736dc2c:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-a3f4bd85-4df8-48ee-b7c4-aad35736dc2c  true false 1}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-bebf4eac-9258-4547-8916-b3bb1f816b79:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-bebf4eac-9258-4547-8916-b3bb1f816b79  true false 0})]
I1002 01:58:43.741417       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 01:58:43.741437       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-0cd3c6ea-2ba9-4023-a199-d8a603c17c37:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-0cd3c6ea-2ba9-4023-a199-d8a603c17c37  true false 2}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-a3f4bd85-4df8-48ee-b7c4-aad35736dc2c:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-a3f4bd85-4df8-48ee-b7c4-aad35736dc2c  true false 1}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-bebf4eac-9258-4547-8916-b3bb1f816b79:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-bebf4eac-9258-4547-8916-b3bb1f816b79  true false 0})])
I1002 01:58:43.929467       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-0cd3c6ea-2ba9-4023-a199-d8a603c17c37:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-0cd3c6ea-2ba9-4023-a199-d8a603c17c37  true false 2}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-a3f4bd85-4df8-48ee-b7c4-aad35736dc2c:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-a3f4bd85-4df8-48ee-b7c4-aad35736dc2c  true false 1}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-bebf4eac-9258-4547-8916-b3bb1f816b79:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-bebf4eac-9258-4547-8916-b3bb1f816b79  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1002 01:58:43.929744       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 01:58:43.929812       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-49352361-vmss000001, refreshing the cache
I1002 01:58:44.004897       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-0cd3c6ea-2ba9-4023-a199-d8a603c17c37" lun 2 to node "k8s-agentpool1-49352361-vmss000001", diskMap: map[]
I1002 01:58:44.004933       1 controllerserver.go:465] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-0cd3c6ea-2ba9-4023-a199-d8a603c17c37" attached to node "k8s-agentpool1-49352361-vmss000001".
I1002 01:58:44.004965       1 controllerserver.go:485] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-0cd3c6ea-2ba9-4023-a199-d8a603c17c37" to node "k8s-agentpool1-49352361-vmss000001" successfully
I1002 01:58:44.005000       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"2"}}
... skipping 19 lines ...
I1002 01:58:52.509950       1 controllerserver.go:389] deleting azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-aa0379d9-1709-45f4-9c57-948094e9eb2a)
I1002 01:58:57.689576       1 azure_managedDiskController.go:286] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-aa0379d9-1709-45f4-9c57-948094e9eb2a
I1002 01:58:57.689639       1 controllerserver.go:391] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-aa0379d9-1709-45f4-9c57-948094e9eb2a) returned with <nil>
I1002 01:58:57.689655       1 utils.go:102] GRPC response: {}
I1002 01:59:01.083049       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 01:59:01.083075       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b","parameters":{"csi.storage.k8s.io/pv/name":"pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b","csi.storage.k8s.io/pvc/name":"test.csi.azure.coml8t2m","csi.storage.k8s.io/pvc/namespace":"volumemode-6147"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 01:59:01.104849       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 01:59:01.104912       1 controllerserver.go:271] begin to create azure disk(pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 01:59:01.104927       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b StorageAccountType:StandardSSD_LRS Size:5
I1002 01:59:03.555764       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b StorageAccountType:StandardSSD_LRS Size:5
I1002 01:59:03.555803       1 controllerserver.go:348] create azure disk(pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b kubernetes.io-created-for-pvc-name:test.csi.azure.coml8t2m kubernetes.io-created-for-pvc-namespace:volumemode-6147]) successfully
I1002 01:59:03.555827       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b","csi.storage.k8s.io/pvc/name":"test.csi.azure.coml8t2m","csi.storage.k8s.io/pvc/namespace":"volumemode-6147","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b"}}
I1002 01:59:04.109263       1 controllerserver.go:465] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a3f4bd85-4df8-48ee-b7c4-aad35736dc2c" attached to node "k8s-agentpool1-49352361-vmss000001".
... skipping 12 lines ...
I1002 01:59:05.832026       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 01:59:05.832076       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b" to node "k8s-agentpool1-49352361-vmss000000"
I1002 01:59:05.832096       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 01:59:05.832125       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b" lun 32 to node "k8s-agentpool1-49352361-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b  true false 32})]
I1002 01:59:05.832209       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 01:59:05.832243       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b  true false 32})])
I1002 01:59:05.904997       1 azure_armclient.go:341] Received error in sendAsync.send: resourceID: https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-49352361-vmss/virtualMachines/0?api-version=2020-12-01, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 409, RawError: {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}
I1002 01:59:05.905017       1 azure_armclient.go:594] Received error in put.send: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-49352361-vmss/virtualMachines/0, error: %!s(<nil>)
E1002 01:59:05.905066       1 azure_controller_vmss.go:125] azureDisk - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b  true false 32})]) on rg(kubetest-croyzaob) vm(k8s-agentpool1-49352361-vmss000000) failed, err: &{false 409 0001-01-01 00:00:00 +0000 UTC {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}}
I1002 01:59:05.905106       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b  true false 32})], &{%!s(bool=false) %!s(int=409) 0001-01-01 00:00:00 +0000 UTC {
  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}}) returned with %!v(MISSING)
E1002 01:59:05.905147       1 controllerserver.go:481] Attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b" to instance "k8s-agentpool1-49352361-vmss000000" failed with Retriable: false, RetryAfter: 0s, HTTPStatusCode: 409, RawError: {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}
E1002 01:59:05.905191       1 utils.go:100] GRPC error: Attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b" to instance "k8s-agentpool1-49352361-vmss000000" failed with Retriable: false, RetryAfter: 0s, HTTPStatusCode: 409, RawError: {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}
I1002 01:59:05.911479       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 3 lines ...
I1002 01:59:05.936685       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-49352361-vmss000000, refreshing the cache
I1002 01:59:06.016671       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b" to node "k8s-agentpool1-49352361-vmss000000"
I1002 01:59:06.016741       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 01:59:06.016757       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b" lun 32 to node "k8s-agentpool1-49352361-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b  true false 32})]
I1002 01:59:06.016770       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 01:59:06.016853       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b  true false 32})])
I1002 01:59:06.181764       1 azure_armclient.go:341] Received error in sendAsync.send: resourceID: https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-49352361-vmss/virtualMachines/0?api-version=2020-12-01, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 409, RawError: {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}
I1002 01:59:06.181798       1 azure_armclient.go:594] Received error in put.send: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-49352361-vmss/virtualMachines/0, error: %!s(<nil>)
E1002 01:59:06.181854       1 azure_controller_vmss.go:125] azureDisk - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b  true false 32})]) on rg(kubetest-croyzaob) vm(k8s-agentpool1-49352361-vmss000000) failed, err: &{false 409 0001-01-01 00:00:00 +0000 UTC {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}}
I1002 01:59:06.181896       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b  true false 32})], &{%!s(bool=false) %!s(int=409) 0001-01-01 00:00:00 +0000 UTC {
  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}}) returned with %!v(MISSING)
E1002 01:59:06.181959       1 controllerserver.go:481] Attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b" to instance "k8s-agentpool1-49352361-vmss000000" failed with Retriable: false, RetryAfter: 0s, HTTPStatusCode: 409, RawError: {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}
E1002 01:59:06.181988       1 utils.go:100] GRPC error: Attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b" to instance "k8s-agentpool1-49352361-vmss000000" failed with Retriable: false, RetryAfter: 0s, HTTPStatusCode: 409, RawError: {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}
I1002 01:59:06.188176       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 3 lines ...
I1002 01:59:06.213383       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-49352361-vmss000000, refreshing the cache
I1002 01:59:06.264085       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b" to node "k8s-agentpool1-49352361-vmss000000"
I1002 01:59:06.264119       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 01:59:06.264189       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b" lun 32 to node "k8s-agentpool1-49352361-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b  true false 32})]
I1002 01:59:06.264227       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 01:59:06.264256       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b  true false 32})])
I1002 01:59:06.326786       1 azure_armclient.go:341] Received error in sendAsync.send: resourceID: https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-49352361-vmss/virtualMachines/0?api-version=2020-12-01, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 409, RawError: {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}
I1002 01:59:06.326804       1 azure_armclient.go:594] Received error in put.send: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-49352361-vmss/virtualMachines/0, error: %!s(<nil>)
E1002 01:59:06.326852       1 azure_controller_vmss.go:125] azureDisk - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b  true false 32})]) on rg(kubetest-croyzaob) vm(k8s-agentpool1-49352361-vmss000000) failed, err: &{false 409 0001-01-01 00:00:00 +0000 UTC {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}}
I1002 01:59:06.326884       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b  true false 32})], &{%!s(bool=false) %!s(int=409) 0001-01-01 00:00:00 +0000 UTC {
  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}}) returned with %!v(MISSING)
E1002 01:59:06.326923       1 controllerserver.go:481] Attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b" to instance "k8s-agentpool1-49352361-vmss000000" failed with Retriable: false, RetryAfter: 0s, HTTPStatusCode: 409, RawError: {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}
E1002 01:59:06.326959       1 utils.go:100] GRPC error: Attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b" to instance "k8s-agentpool1-49352361-vmss000000" failed with Retriable: false, RetryAfter: 0s, HTTPStatusCode: 409, RawError: {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}
I1002 01:59:06.912828       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 3 lines ...
I1002 01:59:06.940710       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-49352361-vmss000000, refreshing the cache
I1002 01:59:07.016591       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b" to node "k8s-agentpool1-49352361-vmss000000"
I1002 01:59:07.016638       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 01:59:07.016652       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b" lun 32 to node "k8s-agentpool1-49352361-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b  true false 32})]
I1002 01:59:07.016667       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 01:59:07.016712       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b  true false 32})])
I1002 01:59:07.099471       1 azure_armclient.go:341] Received error in sendAsync.send: resourceID: https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-49352361-vmss/virtualMachines/0?api-version=2020-12-01, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 409, RawError: {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}
I1002 01:59:07.099516       1 azure_armclient.go:594] Received error in put.send: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-49352361-vmss/virtualMachines/0, error: %!s(<nil>)
E1002 01:59:07.099590       1 azure_controller_vmss.go:125] azureDisk - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b  true false 32})]) on rg(kubetest-croyzaob) vm(k8s-agentpool1-49352361-vmss000000) failed, err: &{false 409 0001-01-01 00:00:00 +0000 UTC {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}}
I1002 01:59:07.099638       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b  true false 32})], &{%!s(bool=false) %!s(int=409) 0001-01-01 00:00:00 +0000 UTC {
  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}}) returned with %!v(MISSING)
E1002 01:59:07.099689       1 controllerserver.go:481] Attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b" to instance "k8s-agentpool1-49352361-vmss000000" failed with Retriable: false, RetryAfter: 0s, HTTPStatusCode: 409, RawError: {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}
E1002 01:59:07.099718       1 utils.go:100] GRPC error: Attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b" to instance "k8s-agentpool1-49352361-vmss000000" failed with Retriable: false, RetryAfter: 0s, HTTPStatusCode: 409, RawError: {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}
I1002 01:59:12.312325       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerUnpublishVolume
... skipping 371 lines ...
I1002 02:00:03.152075       1 controllerserver.go:533] detach volume /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-3561166c-3c17-4714-863e-423465baaec5 from node k8s-agentpool1-49352361-vmss000000 successfully
I1002 02:00:03.152082       1 utils.go:102] GRPC response: {}
I1002 02:00:03.152101       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:00:03.152120       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b" lun 0 to node "k8s-agentpool1-49352361-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b  true false 0}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8  true false 1})]
I1002 02:00:03.152155       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:00:03.152170       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b  true false 0}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8  true false 1})])
I1002 02:00:03.351696       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b  true false 0}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8  true false 1})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1002 02:00:03.351907       1 azure_controller_common.go:346] Trying to detach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-cb800d19-4471-47e8-866f-3cc2554b99de" from node "k8s-agentpool1-49352361-vmss000000", diskMap: map[]
I1002 02:00:03.351939       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:00:03.351956       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-49352361-vmss000000, refreshing the cache
I1002 02:00:03.412586       1 azure_controller_common.go:369] azureDisk - detach disk(pvc-cb800d19-4471-47e8-866f-3cc2554b99de, /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-cb800d19-4471-47e8-866f-3cc2554b99de) succeeded
I1002 02:00:03.412637       1 controllerserver.go:533] detach volume /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-cb800d19-4471-47e8-866f-3cc2554b99de from node k8s-agentpool1-49352361-vmss000000 successfully
I1002 02:00:03.412658       1 utils.go:102] GRPC response: {}
... skipping 216 lines ...
I1002 02:00:14.949783       1 utils.go:95] GRPC call: /csi.v1.Controller/DeleteVolume
I1002 02:00:14.949806       1 utils.go:96] GRPC request: {"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-68177a65-d451-4832-912d-e4809b961979"}
I1002 02:00:14.949921       1 controllerserver.go:389] deleting azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-68177a65-d451-4832-912d-e4809b961979)
I1002 02:00:15.091806       1 utils.go:95] GRPC call: /csi.v1.Controller/DeleteVolume
I1002 02:00:15.091844       1 utils.go:96] GRPC request: {"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-fd256ead-d61a-475c-bb84-e662602d2698"}
I1002 02:00:15.091919       1 controllerserver.go:389] deleting azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-fd256ead-d61a-475c-bb84-e662602d2698)
I1002 02:00:15.091930       1 controllerserver.go:391] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-fd256ead-d61a-475c-bb84-e662602d2698) returned with failed to delete disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-fd256ead-d61a-475c-bb84-e662602d2698) since it's in attaching or detaching state
E1002 02:00:15.091951       1 utils.go:100] GRPC error: failed to delete disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-fd256ead-d61a-475c-bb84-e662602d2698) since it's in attaching or detaching state
I1002 02:00:15.296053       1 utils.go:95] GRPC call: /csi.v1.Controller/DeleteVolume
I1002 02:00:15.296079       1 utils.go:96] GRPC request: {"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a7d90131-1373-4d79-922a-da470b16b60b"}
I1002 02:00:15.296205       1 controllerserver.go:389] deleting azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a7d90131-1373-4d79-922a-da470b16b60b)
I1002 02:00:15.502026       1 utils.go:95] GRPC call: /csi.v1.Controller/DeleteVolume
I1002 02:00:15.502051       1 utils.go:96] GRPC request: {"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a5ca3c0d-628e-4d66-b0f9-e8e164307edd"}
I1002 02:00:15.502171       1 controllerserver.go:389] deleting azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a5ca3c0d-628e-4d66-b0f9-e8e164307edd)
... skipping 58 lines ...
I1002 02:00:32.856746       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:00:33.791103       1 azure_managedDiskController.go:286] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-f1d1f5f7-ff63-45b7-831c-1ad5308d4724
I1002 02:00:33.791132       1 controllerserver.go:391] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-f1d1f5f7-ff63-45b7-831c-1ad5308d4724) returned with <nil>
I1002 02:00:33.791170       1 utils.go:102] GRPC response: {}
I1002 02:00:35.765488       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 02:00:35.765529       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-a57bab16-cfdf-4025-badd-5b01d9e1faf5","parameters":{"csi.storage.k8s.io/pv/name":"pvc-a57bab16-cfdf-4025-badd-5b01d9e1faf5","csi.storage.k8s.io/pvc/name":"test.csi.azure.comz98kn","csi.storage.k8s.io/pvc/namespace":"provisioning-5446"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 02:00:35.831074       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a57bab16-cfdf-4025-badd-5b01d9e1faf5, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-a57bab16-cfdf-4025-badd-5b01d9e1faf5' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 02:00:35.831136       1 controllerserver.go:271] begin to create azure disk(pvc-a57bab16-cfdf-4025-badd-5b01d9e1faf5) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 02:00:35.831151       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-a57bab16-cfdf-4025-badd-5b01d9e1faf5 StorageAccountType:StandardSSD_LRS Size:5
I1002 02:00:38.196694       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-a57bab16-cfdf-4025-badd-5b01d9e1faf5 StorageAccountType:StandardSSD_LRS Size:5
I1002 02:00:38.196734       1 controllerserver.go:348] create azure disk(pvc-a57bab16-cfdf-4025-badd-5b01d9e1faf5) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-a57bab16-cfdf-4025-badd-5b01d9e1faf5 kubernetes.io-created-for-pvc-name:test.csi.azure.comz98kn kubernetes.io-created-for-pvc-namespace:provisioning-5446]) successfully
I1002 02:00:38.196757       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-a57bab16-cfdf-4025-badd-5b01d9e1faf5","csi.storage.k8s.io/pvc/name":"test.csi.azure.comz98kn","csi.storage.k8s.io/pvc/namespace":"provisioning-5446","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a57bab16-cfdf-4025-badd-5b01d9e1faf5"}}
I1002 02:00:40.697592       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 42 lines ...
I1002 02:01:16.198597       1 controllerserver.go:389] deleting azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a9d53761-38d0-4ba3-b9ac-b81669771528)
I1002 02:01:16.298768       1 utils.go:95] GRPC call: /csi.v1.Controller/DeleteVolume
I1002 02:01:16.298791       1 utils.go:96] GRPC request: {"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-979b09be-2101-4979-a637-fb477d5b4b26"}
I1002 02:01:16.298880       1 controllerserver.go:389] deleting azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-979b09be-2101-4979-a637-fb477d5b4b26)
I1002 02:01:17.331465       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 02:01:17.331489       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-efdb8371-3cea-43cf-b2e1-5b2c59976ca7","parameters":{"csi.storage.k8s.io/pv/name":"pvc-efdb8371-3cea-43cf-b2e1-5b2c59976ca7","csi.storage.k8s.io/pvc/name":"test.csi.azure.coms8bnn","csi.storage.k8s.io/pvc/namespace":"provisioning-526"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 02:01:17.350933       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-efdb8371-3cea-43cf-b2e1-5b2c59976ca7, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-efdb8371-3cea-43cf-b2e1-5b2c59976ca7' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 02:01:17.351009       1 controllerserver.go:271] begin to create azure disk(pvc-efdb8371-3cea-43cf-b2e1-5b2c59976ca7) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 02:01:17.351043       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-efdb8371-3cea-43cf-b2e1-5b2c59976ca7 StorageAccountType:StandardSSD_LRS Size:5
I1002 02:01:17.502694       1 utils.go:95] GRPC call: /csi.v1.Controller/DeleteVolume
I1002 02:01:17.502737       1 utils.go:96] GRPC request: {"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-8b9b0f93-30e4-46dd-aeb1-c4bb38a4b9c9"}
I1002 02:01:17.502829       1 controllerserver.go:389] deleting azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-8b9b0f93-30e4-46dd-aeb1-c4bb38a4b9c9)
I1002 02:01:19.093282       1 utils.go:95] GRPC call: /csi.v1.Controller/DeleteVolume
... skipping 59 lines ...
I1002 02:01:28.975140       1 controllerserver.go:533] detach volume /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-84c060cf-7773-4d64-91d9-ba52b03d8f32 from node k8s-agentpool1-49352361-vmss000000 successfully
I1002 02:01:28.975148       1 utils.go:102] GRPC response: {}
I1002 02:01:28.975166       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:01:28.975186       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a3f4bd85-4df8-48ee-b7c4-aad35736dc2c" lun 0 to node "k8s-agentpool1-49352361-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-a3f4bd85-4df8-48ee-b7c4-aad35736dc2c:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-a3f4bd85-4df8-48ee-b7c4-aad35736dc2c  true false 0})]
I1002 02:01:28.975201       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:01:28.975216       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-a3f4bd85-4df8-48ee-b7c4-aad35736dc2c:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-a3f4bd85-4df8-48ee-b7c4-aad35736dc2c  true false 0})])
I1002 02:01:29.323684       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-a3f4bd85-4df8-48ee-b7c4-aad35736dc2c:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-a3f4bd85-4df8-48ee-b7c4-aad35736dc2c  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1002 02:01:29.323969       1 azure_controller_common.go:346] Trying to detach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-72bbe44f-5021-4f51-a052-e6e81a5b7fac" from node "k8s-agentpool1-49352361-vmss000000", diskMap: map[]
I1002 02:01:29.323994       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:01:29.324007       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-49352361-vmss000000, refreshing the cache
I1002 02:01:29.373942       1 azure_controller_common.go:369] azureDisk - detach disk(pvc-72bbe44f-5021-4f51-a052-e6e81a5b7fac, /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-72bbe44f-5021-4f51-a052-e6e81a5b7fac) succeeded
I1002 02:01:29.374037       1 azure_controller_common.go:346] Trying to detach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a3455826-e1c4-4ea4-b049-78bdd809f47d" from node "k8s-agentpool1-49352361-vmss000000", diskMap: map[]
I1002 02:01:29.374074       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
... skipping 56 lines ...
I1002 02:01:30.293272       1 azure_managedDiskController.go:286] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-7b6b6c64-a8e8-4dd4-8d01-09520591cf7f
I1002 02:01:30.293311       1 controllerserver.go:391] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-7b6b6c64-a8e8-4dd4-8d01-09520591cf7f) returned with <nil>
I1002 02:01:30.293325       1 utils.go:102] GRPC response: {}
I1002 02:01:30.308936       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a57bab16-cfdf-4025-badd-5b01d9e1faf5" lun 0 to node "k8s-agentpool1-49352361-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-a57bab16-cfdf-4025-badd-5b01d9e1faf5:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-a57bab16-cfdf-4025-badd-5b01d9e1faf5  true false 0}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-efdb8371-3cea-43cf-b2e1-5b2c59976ca7:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-efdb8371-3cea-43cf-b2e1-5b2c59976ca7  true false 1})]
I1002 02:01:30.308971       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:01:30.309005       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-a57bab16-cfdf-4025-badd-5b01d9e1faf5:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-a57bab16-cfdf-4025-badd-5b01d9e1faf5  true false 0}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-efdb8371-3cea-43cf-b2e1-5b2c59976ca7:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-efdb8371-3cea-43cf-b2e1-5b2c59976ca7  true false 1})])
I1002 02:01:30.485405       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-a57bab16-cfdf-4025-badd-5b01d9e1faf5:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-a57bab16-cfdf-4025-badd-5b01d9e1faf5  true false 0}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-efdb8371-3cea-43cf-b2e1-5b2c59976ca7:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-efdb8371-3cea-43cf-b2e1-5b2c59976ca7  true false 1})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1002 02:01:30.485568       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:01:30.485590       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-49352361-vmss000001, refreshing the cache
I1002 02:01:30.563117       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-efdb8371-3cea-43cf-b2e1-5b2c59976ca7" lun 1 to node "k8s-agentpool1-49352361-vmss000001", diskMap: map[]
I1002 02:01:30.563175       1 controllerserver.go:465] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-efdb8371-3cea-43cf-b2e1-5b2c59976ca7" attached to node "k8s-agentpool1-49352361-vmss000001".
I1002 02:01:30.563186       1 controllerserver.go:485] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-efdb8371-3cea-43cf-b2e1-5b2c59976ca7" to node "k8s-agentpool1-49352361-vmss000001" successfully
I1002 02:01:30.563204       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"1"}}
I1002 02:01:31.617307       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 02:01:31.617338       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-86899ad1-9627-452f-a1c2-84f09e2b5b36","parameters":{"csi.storage.k8s.io/pv/name":"pvc-86899ad1-9627-452f-a1c2-84f09e2b5b36","csi.storage.k8s.io/pvc/name":"test.csi.azure.com99m7s","csi.storage.k8s.io/pvc/namespace":"volume-3687"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 02:01:31.637621       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-86899ad1-9627-452f-a1c2-84f09e2b5b36, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-86899ad1-9627-452f-a1c2-84f09e2b5b36' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 02:01:31.637775       1 controllerserver.go:271] begin to create azure disk(pvc-86899ad1-9627-452f-a1c2-84f09e2b5b36) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 02:01:31.637806       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-86899ad1-9627-452f-a1c2-84f09e2b5b36 StorageAccountType:StandardSSD_LRS Size:5
I1002 02:01:33.917046       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerUnpublishVolume
I1002 02:01:33.917071       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-49352361-vmss000000","volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b"}
I1002 02:01:33.917171       1 controllerserver.go:524] Trying to detach volume /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b from node k8s-agentpool1-49352361-vmss000000
I1002 02:01:33.917194       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
... skipping 15 lines ...
I1002 02:01:49.143332       1 utils.go:102] GRPC response: {}
I1002 02:01:49.143457       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:01:49.143479       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-49352361-vmss000000, refreshing the cache
I1002 02:01:49.211247       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-86899ad1-9627-452f-a1c2-84f09e2b5b36" lun 2 to node "k8s-agentpool1-49352361-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-86899ad1-9627-452f-a1c2-84f09e2b5b36:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-86899ad1-9627-452f-a1c2-84f09e2b5b36  true false 2})]
I1002 02:01:49.211312       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:01:49.211337       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-86899ad1-9627-452f-a1c2-84f09e2b5b36:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-86899ad1-9627-452f-a1c2-84f09e2b5b36  true false 2})])
I1002 02:01:49.378850       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-86899ad1-9627-452f-a1c2-84f09e2b5b36:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-86899ad1-9627-452f-a1c2-84f09e2b5b36  true false 2})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1002 02:01:49.441310       1 controllerserver.go:465] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a3f4bd85-4df8-48ee-b7c4-aad35736dc2c" attached to node "k8s-agentpool1-49352361-vmss000000".
I1002 02:01:49.441341       1 controllerserver.go:485] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a3f4bd85-4df8-48ee-b7c4-aad35736dc2c" to node "k8s-agentpool1-49352361-vmss000000" successfully
I1002 02:01:49.441358       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
I1002 02:01:50.620702       1 controllerserver.go:465] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a57bab16-cfdf-4025-badd-5b01d9e1faf5" attached to node "k8s-agentpool1-49352361-vmss000001".
I1002 02:01:50.620735       1 controllerserver.go:485] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a57bab16-cfdf-4025-badd-5b01d9e1faf5" to node "k8s-agentpool1-49352361-vmss000001" successfully
I1002 02:01:50.620774       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
... skipping 38 lines ...
I1002 02:02:49.189839       1 controllerserver.go:389] deleting azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-efdb8371-3cea-43cf-b2e1-5b2c59976ca7)
I1002 02:02:54.423349       1 azure_managedDiskController.go:286] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-efdb8371-3cea-43cf-b2e1-5b2c59976ca7
I1002 02:02:54.423392       1 controllerserver.go:391] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-efdb8371-3cea-43cf-b2e1-5b2c59976ca7) returned with <nil>
I1002 02:02:54.423441       1 utils.go:102] GRPC response: {}
I1002 02:03:00.032611       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 02:03:00.032639       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-a68aa61e-80ec-4241-b56c-c912796dbe85","parameters":{"csi.storage.k8s.io/pv/name":"pvc-a68aa61e-80ec-4241-b56c-c912796dbe85","csi.storage.k8s.io/pvc/name":"test.csi.azure.com2tzwr","csi.storage.k8s.io/pvc/namespace":"volume-4531"},"volume_capabilities":[{"AccessType":{"Block":{}},"access_mode":{"mode":7}}]}
I1002 02:03:00.052400       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a68aa61e-80ec-4241-b56c-c912796dbe85, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-a68aa61e-80ec-4241-b56c-c912796dbe85' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 02:03:00.052458       1 controllerserver.go:271] begin to create azure disk(pvc-a68aa61e-80ec-4241-b56c-c912796dbe85) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 02:03:00.052472       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-a68aa61e-80ec-4241-b56c-c912796dbe85 StorageAccountType:StandardSSD_LRS Size:5
I1002 02:03:02.404967       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-a68aa61e-80ec-4241-b56c-c912796dbe85 StorageAccountType:StandardSSD_LRS Size:5
I1002 02:03:02.405008       1 controllerserver.go:348] create azure disk(pvc-a68aa61e-80ec-4241-b56c-c912796dbe85) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-a68aa61e-80ec-4241-b56c-c912796dbe85 kubernetes.io-created-for-pvc-name:test.csi.azure.com2tzwr kubernetes.io-created-for-pvc-namespace:volume-4531]) successfully
I1002 02:03:02.405033       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-a68aa61e-80ec-4241-b56c-c912796dbe85","csi.storage.k8s.io/pvc/name":"test.csi.azure.com2tzwr","csi.storage.k8s.io/pvc/namespace":"volume-4531","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a68aa61e-80ec-4241-b56c-c912796dbe85"}}
I1002 02:03:04.754809       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 3 lines ...
I1002 02:03:04.821469       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-49352361-vmss000001, refreshing the cache
I1002 02:03:04.916627       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a68aa61e-80ec-4241-b56c-c912796dbe85" to node "k8s-agentpool1-49352361-vmss000001"
I1002 02:03:04.916658       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:03:04.916673       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a68aa61e-80ec-4241-b56c-c912796dbe85" lun 1 to node "k8s-agentpool1-49352361-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-a68aa61e-80ec-4241-b56c-c912796dbe85:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-a68aa61e-80ec-4241-b56c-c912796dbe85  true false 1})]
I1002 02:03:04.916687       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:03:04.916699       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-a68aa61e-80ec-4241-b56c-c912796dbe85:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-a68aa61e-80ec-4241-b56c-c912796dbe85  true false 1})])
I1002 02:03:05.109999       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-a68aa61e-80ec-4241-b56c-c912796dbe85:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-a68aa61e-80ec-4241-b56c-c912796dbe85  true false 1})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1002 02:03:13.932001       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerUnpublishVolume
I1002 02:03:13.932028       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-49352361-vmss000001","volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a57bab16-cfdf-4025-badd-5b01d9e1faf5"}
I1002 02:03:13.932188       1 controllerserver.go:524] Trying to detach volume /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a57bab16-cfdf-4025-badd-5b01d9e1faf5 from node k8s-agentpool1-49352361-vmss000001
I1002 02:03:13.932210       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:03:13.932230       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-49352361-vmss000001, refreshing the cache
I1002 02:03:13.980172       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
... skipping 5 lines ...
I1002 02:03:30.883995       1 controllerserver.go:389] deleting azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b)
I1002 02:03:36.090599       1 azure_managedDiskController.go:286] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b
I1002 02:03:36.090628       1 controllerserver.go:391] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-717f4ec7-895d-4f4e-a8f3-9b04c0b5907b) returned with <nil>
I1002 02:03:36.090654       1 utils.go:102] GRPC response: {}
I1002 02:03:38.599753       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 02:03:38.599780       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-e4ffebee-31b2-469e-bb14-001e1814534e","parameters":{"csi.storage.k8s.io/pv/name":"pvc-e4ffebee-31b2-469e-bb14-001e1814534e","csi.storage.k8s.io/pvc/name":"inline-volume-tester-v9f8m-my-volume-0","csi.storage.k8s.io/pvc/namespace":"ephemeral-968"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 02:03:38.620635       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-e4ffebee-31b2-469e-bb14-001e1814534e, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-e4ffebee-31b2-469e-bb14-001e1814534e' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 02:03:38.620723       1 controllerserver.go:271] begin to create azure disk(pvc-e4ffebee-31b2-469e-bb14-001e1814534e) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 02:03:38.620757       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-e4ffebee-31b2-469e-bb14-001e1814534e StorageAccountType:StandardSSD_LRS Size:5
I1002 02:03:41.074024       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-e4ffebee-31b2-469e-bb14-001e1814534e StorageAccountType:StandardSSD_LRS Size:5
I1002 02:03:41.074093       1 controllerserver.go:348] create azure disk(pvc-e4ffebee-31b2-469e-bb14-001e1814534e) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-e4ffebee-31b2-469e-bb14-001e1814534e kubernetes.io-created-for-pvc-name:inline-volume-tester-v9f8m-my-volume-0 kubernetes.io-created-for-pvc-namespace:ephemeral-968]) successfully
I1002 02:03:41.074115       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-e4ffebee-31b2-469e-bb14-001e1814534e","csi.storage.k8s.io/pvc/name":"inline-volume-tester-v9f8m-my-volume-0","csi.storage.k8s.io/pvc/namespace":"ephemeral-968","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-e4ffebee-31b2-469e-bb14-001e1814534e"}}
I1002 02:03:42.442375       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 7 lines ...
I1002 02:03:44.320434       1 utils.go:102] GRPC response: {}
I1002 02:03:44.320557       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:03:44.320572       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-49352361-vmss000001, refreshing the cache
I1002 02:03:44.412671       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-e4ffebee-31b2-469e-bb14-001e1814534e" lun 0 to node "k8s-agentpool1-49352361-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-e4ffebee-31b2-469e-bb14-001e1814534e:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-e4ffebee-31b2-469e-bb14-001e1814534e  true false 0})]
I1002 02:03:44.412709       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:03:44.412761       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-e4ffebee-31b2-469e-bb14-001e1814534e:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-e4ffebee-31b2-469e-bb14-001e1814534e  true false 0})])
I1002 02:03:44.577618       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-e4ffebee-31b2-469e-bb14-001e1814534e:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-e4ffebee-31b2-469e-bb14-001e1814534e  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1002 02:03:45.355022       1 controllerserver.go:465] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a68aa61e-80ec-4241-b56c-c912796dbe85" attached to node "k8s-agentpool1-49352361-vmss000001".
I1002 02:03:45.355055       1 controllerserver.go:485] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a68aa61e-80ec-4241-b56c-c912796dbe85" to node "k8s-agentpool1-49352361-vmss000001" successfully
I1002 02:03:45.355073       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"1"}}
I1002 02:03:45.363538       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
I1002 02:03:45.363576       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-49352361-vmss000001","volume_capability":{"AccessType":{"Block":{}},"access_mode":{"mode":7}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-a68aa61e-80ec-4241-b56c-c912796dbe85","csi.storage.k8s.io/pvc/name":"test.csi.azure.com2tzwr","csi.storage.k8s.io/pvc/namespace":"volume-4531","requestedsizegib":"5","storage.kubernetes.io/csiProvisionerIdentity":"1633139719760-8081-test.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a68aa61e-80ec-4241-b56c-c912796dbe85"}
I1002 02:03:45.389565       1 controllerserver.go:440] GetDiskLun returned: <nil>. Initiating attaching volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a68aa61e-80ec-4241-b56c-c912796dbe85" to node "k8s-agentpool1-49352361-vmss000001".
... skipping 45 lines ...
I1002 02:04:14.735904       1 utils.go:102] GRPC response: {}
I1002 02:04:20.949796       1 azure_vmss.go:319] Couldn't find VMSS VM with scaleSetName "k8s-agentpool1-49352361-vmss" and instanceID "0", refreshing the cache
I1002 02:04:21.389079       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 02:04:21.389082       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 02:04:21.389307       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-5185e3c9-682c-4e7d-9b6c-556f24c7cdda","parameters":{"csi.storage.k8s.io/pv/name":"pvc-5185e3c9-682c-4e7d-9b6c-556f24c7cdda","csi.storage.k8s.io/pvc/name":"inline-volume-tester-4zkst-my-volume-1","csi.storage.k8s.io/pvc/namespace":"ephemeral-5138"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 02:04:21.389130       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-4cf075ab-9094-4e78-9b1b-d6f0d70ad7ca","parameters":{"csi.storage.k8s.io/pv/name":"pvc-4cf075ab-9094-4e78-9b1b-d6f0d70ad7ca","csi.storage.k8s.io/pvc/name":"inline-volume-tester-4zkst-my-volume-0","csi.storage.k8s.io/pvc/namespace":"ephemeral-5138"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 02:04:21.415203       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-5185e3c9-682c-4e7d-9b6c-556f24c7cdda, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-5185e3c9-682c-4e7d-9b6c-556f24c7cdda' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 02:04:21.415257       1 controllerserver.go:271] begin to create azure disk(pvc-5185e3c9-682c-4e7d-9b6c-556f24c7cdda) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 02:04:21.415270       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-5185e3c9-682c-4e7d-9b6c-556f24c7cdda StorageAccountType:StandardSSD_LRS Size:5
I1002 02:04:21.444105       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-4cf075ab-9094-4e78-9b1b-d6f0d70ad7ca, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-4cf075ab-9094-4e78-9b1b-d6f0d70ad7ca' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 02:04:21.444182       1 controllerserver.go:271] begin to create azure disk(pvc-4cf075ab-9094-4e78-9b1b-d6f0d70ad7ca) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 02:04:21.444208       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-4cf075ab-9094-4e78-9b1b-d6f0d70ad7ca StorageAccountType:StandardSSD_LRS Size:5
I1002 02:04:23.785957       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-5185e3c9-682c-4e7d-9b6c-556f24c7cdda StorageAccountType:StandardSSD_LRS Size:5
I1002 02:04:23.786028       1 controllerserver.go:348] create azure disk(pvc-5185e3c9-682c-4e7d-9b6c-556f24c7cdda) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-5185e3c9-682c-4e7d-9b6c-556f24c7cdda kubernetes.io-created-for-pvc-name:inline-volume-tester-4zkst-my-volume-1 kubernetes.io-created-for-pvc-namespace:ephemeral-5138]) successfully
I1002 02:04:23.786069       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-5185e3c9-682c-4e7d-9b6c-556f24c7cdda","csi.storage.k8s.io/pvc/name":"inline-volume-tester-4zkst-my-volume-1","csi.storage.k8s.io/pvc/namespace":"ephemeral-5138","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-5185e3c9-682c-4e7d-9b6c-556f24c7cdda"}}
I1002 02:04:23.812968       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-4cf075ab-9094-4e78-9b1b-d6f0d70ad7ca StorageAccountType:StandardSSD_LRS Size:5
... skipping 27 lines ...
I1002 02:04:24.522273       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-4cf075ab-9094-4e78-9b1b-d6f0d70ad7ca" to node "k8s-agentpool1-49352361-vmss000000"
I1002 02:04:24.544939       1 controllerserver.go:440] GetDiskLun returned: <nil>. Initiating attaching volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-5185e3c9-682c-4e7d-9b6c-556f24c7cdda" to node "k8s-agentpool1-49352361-vmss000000".
I1002 02:04:24.544964       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:04:24.544980       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-5185e3c9-682c-4e7d-9b6c-556f24c7cdda" to node "k8s-agentpool1-49352361-vmss000000"
I1002 02:04:30.113918       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 02:04:30.113981       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-ea6ac694-d639-49f9-8188-ae767057a273","parameters":{"csi.storage.k8s.io/pv/name":"pvc-ea6ac694-d639-49f9-8188-ae767057a273","csi.storage.k8s.io/pvc/name":"test.csi.azure.comgtlqh","csi.storage.k8s.io/pvc/namespace":"volume-390"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 02:04:30.148930       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-ea6ac694-d639-49f9-8188-ae767057a273, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-ea6ac694-d639-49f9-8188-ae767057a273' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 02:04:30.149047       1 controllerserver.go:271] begin to create azure disk(pvc-ea6ac694-d639-49f9-8188-ae767057a273) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 02:04:30.149068       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-ea6ac694-d639-49f9-8188-ae767057a273 StorageAccountType:StandardSSD_LRS Size:5
I1002 02:04:32.519621       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-ea6ac694-d639-49f9-8188-ae767057a273 StorageAccountType:StandardSSD_LRS Size:5
I1002 02:04:32.519679       1 controllerserver.go:348] create azure disk(pvc-ea6ac694-d639-49f9-8188-ae767057a273) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-ea6ac694-d639-49f9-8188-ae767057a273 kubernetes.io-created-for-pvc-name:test.csi.azure.comgtlqh kubernetes.io-created-for-pvc-namespace:volume-390]) successfully
I1002 02:04:32.519719       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-ea6ac694-d639-49f9-8188-ae767057a273","csi.storage.k8s.io/pvc/name":"test.csi.azure.comgtlqh","csi.storage.k8s.io/pvc/namespace":"volume-390","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-ea6ac694-d639-49f9-8188-ae767057a273"}}
I1002 02:04:34.396077       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerUnpublishVolume
... skipping 23 lines ...
I1002 02:04:54.908192       1 utils.go:102] GRPC response: {}
I1002 02:04:54.908209       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:04:54.908232       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-49352361-vmss000001, refreshing the cache
I1002 02:04:54.969719       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-ea6ac694-d639-49f9-8188-ae767057a273" lun 1 to node "k8s-agentpool1-49352361-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-ea6ac694-d639-49f9-8188-ae767057a273:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-ea6ac694-d639-49f9-8188-ae767057a273  true false 1})]
I1002 02:04:54.969749       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:04:54.969789       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-ea6ac694-d639-49f9-8188-ae767057a273:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-ea6ac694-d639-49f9-8188-ae767057a273  true false 1})])
I1002 02:04:55.126419       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-ea6ac694-d639-49f9-8188-ae767057a273:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-ea6ac694-d639-49f9-8188-ae767057a273  true false 1})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1002 02:04:58.599450       1 utils.go:95] GRPC call: /csi.v1.Controller/DeleteVolume
I1002 02:04:58.599476       1 utils.go:96] GRPC request: {"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a68aa61e-80ec-4241-b56c-c912796dbe85"}
I1002 02:04:58.599550       1 controllerserver.go:389] deleting azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a68aa61e-80ec-4241-b56c-c912796dbe85)
I1002 02:05:03.844905       1 azure_managedDiskController.go:286] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a68aa61e-80ec-4241-b56c-c912796dbe85
I1002 02:05:03.844947       1 controllerserver.go:391] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a68aa61e-80ec-4241-b56c-c912796dbe85) returned with <nil>
I1002 02:05:03.844964       1 utils.go:102] GRPC response: {}
... skipping 5 lines ...
I1002 02:05:04.698751       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:05:04.698796       1 azure_controller_common.go:346] Trying to detach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-e4ffebee-31b2-469e-bb14-001e1814534e" from node "k8s-agentpool1-49352361-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-e4ffebee-31b2-469e-bb14-001e1814534e:pvc-e4ffebee-31b2-469e-bb14-001e1814534e]
I1002 02:05:04.698821       1 azure_controller_vmss.go:174] azureDisk - detach disk: name "pvc-e4ffebee-31b2-469e-bb14-001e1814534e" uri "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-e4ffebee-31b2-469e-bb14-001e1814534e"
I1002 02:05:04.698832       1 azure_controller_vmss.go:213] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000001) - detach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-e4ffebee-31b2-469e-bb14-001e1814534e:pvc-e4ffebee-31b2-469e-bb14-001e1814534e])
I1002 02:05:12.986682       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 02:05:12.986734       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-da8c5704-620d-42aa-aa9b-48dc69304d85","parameters":{"csi.storage.k8s.io/pv/name":"pvc-da8c5704-620d-42aa-aa9b-48dc69304d85","csi.storage.k8s.io/pvc/name":"test.csi.azure.com452wd","csi.storage.k8s.io/pvc/namespace":"fsgroupchangepolicy-277"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 02:05:13.009318       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-da8c5704-620d-42aa-aa9b-48dc69304d85, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-da8c5704-620d-42aa-aa9b-48dc69304d85' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 02:05:13.009431       1 controllerserver.go:271] begin to create azure disk(pvc-da8c5704-620d-42aa-aa9b-48dc69304d85) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 02:05:13.009460       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-da8c5704-620d-42aa-aa9b-48dc69304d85 StorageAccountType:StandardSSD_LRS Size:5
I1002 02:05:15.340478       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-da8c5704-620d-42aa-aa9b-48dc69304d85 StorageAccountType:StandardSSD_LRS Size:5
I1002 02:05:15.340547       1 controllerserver.go:348] create azure disk(pvc-da8c5704-620d-42aa-aa9b-48dc69304d85) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-da8c5704-620d-42aa-aa9b-48dc69304d85 kubernetes.io-created-for-pvc-name:test.csi.azure.com452wd kubernetes.io-created-for-pvc-namespace:fsgroupchangepolicy-277]) successfully
I1002 02:05:15.340589       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-da8c5704-620d-42aa-aa9b-48dc69304d85","csi.storage.k8s.io/pvc/name":"test.csi.azure.com452wd","csi.storage.k8s.io/pvc/namespace":"fsgroupchangepolicy-277","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-da8c5704-620d-42aa-aa9b-48dc69304d85"}}
I1002 02:05:17.727034       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 13 lines ...
I1002 02:05:25.073491       1 utils.go:102] GRPC response: {}
I1002 02:05:25.073569       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:05:25.073634       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-49352361-vmss000001, refreshing the cache
I1002 02:05:25.180331       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-da8c5704-620d-42aa-aa9b-48dc69304d85" lun 0 to node "k8s-agentpool1-49352361-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-da8c5704-620d-42aa-aa9b-48dc69304d85:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-da8c5704-620d-42aa-aa9b-48dc69304d85  true false 0})]
I1002 02:05:25.180370       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:05:25.180408       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-da8c5704-620d-42aa-aa9b-48dc69304d85:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-da8c5704-620d-42aa-aa9b-48dc69304d85  true false 0})])
I1002 02:05:25.330266       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-da8c5704-620d-42aa-aa9b-48dc69304d85:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-da8c5704-620d-42aa-aa9b-48dc69304d85  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1002 02:05:25.340090       1 azure_controller_vmss.go:225] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000000) - detach disk(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8:pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8]) returned with <nil>
I1002 02:05:25.340178       1 azure_controller_common.go:369] azureDisk - detach disk(pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8, /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8) succeeded
I1002 02:05:25.340200       1 controllerserver.go:533] detach volume /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8 from node k8s-agentpool1-49352361-vmss000000 successfully
I1002 02:05:25.340231       1 utils.go:102] GRPC response: {}
I1002 02:05:25.340310       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:05:25.340357       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-49352361-vmss000000, refreshing the cache
... skipping 7 lines ...
I1002 02:05:25.400635       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:05:25.543811       1 controllerserver.go:465] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-ea6ac694-d639-49f9-8188-ae767057a273" attached to node "k8s-agentpool1-49352361-vmss000001".
I1002 02:05:25.543850       1 controllerserver.go:485] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-ea6ac694-d639-49f9-8188-ae767057a273" to node "k8s-agentpool1-49352361-vmss000001" successfully
I1002 02:05:25.543869       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"1"}}
I1002 02:05:25.551439       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
I1002 02:05:25.551464       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-49352361-vmss000001","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":7}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-ea6ac694-d639-49f9-8188-ae767057a273","csi.storage.k8s.io/pvc/name":"test.csi.azure.comgtlqh","csi.storage.k8s.io/pvc/namespace":"volume-390","requestedsizegib":"5","storage.kubernetes.io/csiProvisionerIdentity":"1633139719760-8081-test.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-ea6ac694-d639-49f9-8188-ae767057a273"}
I1002 02:05:25.573353       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-4cf075ab-9094-4e78-9b1b-d6f0d70ad7ca:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-4cf075ab-9094-4e78-9b1b-d6f0d70ad7ca  true false 0}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-5185e3c9-682c-4e7d-9b6c-556f24c7cdda:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-5185e3c9-682c-4e7d-9b6c-556f24c7cdda  true false 1})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1002 02:05:25.573555       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:05:25.573616       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-49352361-vmss000000, refreshing the cache
I1002 02:05:25.582370       1 controllerserver.go:440] GetDiskLun returned: <nil>. Initiating attaching volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-ea6ac694-d639-49f9-8188-ae767057a273" to node "k8s-agentpool1-49352361-vmss000001".
I1002 02:05:25.582396       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:05:25.621816       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-5185e3c9-682c-4e7d-9b6c-556f24c7cdda" lun 1 to node "k8s-agentpool1-49352361-vmss000000", diskMap: map[]
I1002 02:05:25.621841       1 controllerserver.go:465] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-5185e3c9-682c-4e7d-9b6c-556f24c7cdda" attached to node "k8s-agentpool1-49352361-vmss000000".
... skipping 5 lines ...
I1002 02:05:25.622018       1 azure_controller_common.go:346] Trying to detach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8" from node "k8s-agentpool1-49352361-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8:pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8]
E1002 02:05:25.622057       1 azure_controller_vmss.go:183] detach azure disk on node(k8s-agentpool1-49352361-vmss000000): disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8:pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8]) not found
I1002 02:05:25.622074       1 azure_controller_vmss.go:213] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000000) - detach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8:pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8])
I1002 02:05:25.837646       1 utils.go:95] GRPC call: /csi.v1.Controller/DeleteVolume
I1002 02:05:25.837671       1 utils.go:96] GRPC request: {"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8"}
I1002 02:05:25.837797       1 controllerserver.go:389] deleting azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8)
I1002 02:05:25.837824       1 controllerserver.go:391] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8) returned with failed to delete disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8) since it's in attaching or detaching state
E1002 02:05:25.837841       1 utils.go:100] GRPC error: failed to delete disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8) since it's in attaching or detaching state
I1002 02:05:27.550781       1 utils.go:95] GRPC call: /csi.v1.Controller/DeleteVolume
I1002 02:05:27.550809       1 utils.go:96] GRPC request: {"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-e4ffebee-31b2-469e-bb14-001e1814534e"}
I1002 02:05:27.550894       1 controllerserver.go:389] deleting azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-e4ffebee-31b2-469e-bb14-001e1814534e)
I1002 02:05:28.351660       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 02:05:28.351686       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-2289cf6c-f625-4d09-9dff-065d2a1a10a4","parameters":{"csi.storage.k8s.io/pv/name":"pvc-2289cf6c-f625-4d09-9dff-065d2a1a10a4","csi.storage.k8s.io/pvc/name":"pvc-v58s6","csi.storage.k8s.io/pvc/namespace":"provisioning-6364"},"volume_capabilities":[{"AccessType":{"Block":{}},"access_mode":{"mode":7}}]}
I1002 02:05:28.372261       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-2289cf6c-f625-4d09-9dff-065d2a1a10a4, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-2289cf6c-f625-4d09-9dff-065d2a1a10a4' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 02:05:28.372352       1 controllerserver.go:271] begin to create azure disk(pvc-2289cf6c-f625-4d09-9dff-065d2a1a10a4) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 02:05:28.372371       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-2289cf6c-f625-4d09-9dff-065d2a1a10a4 StorageAccountType:StandardSSD_LRS Size:5
I1002 02:05:30.722028       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-2289cf6c-f625-4d09-9dff-065d2a1a10a4 StorageAccountType:StandardSSD_LRS Size:5
I1002 02:05:30.722083       1 controllerserver.go:348] create azure disk(pvc-2289cf6c-f625-4d09-9dff-065d2a1a10a4) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-2289cf6c-f625-4d09-9dff-065d2a1a10a4 kubernetes.io-created-for-pvc-name:pvc-v58s6 kubernetes.io-created-for-pvc-namespace:provisioning-6364]) successfully
I1002 02:05:30.722125       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-2289cf6c-f625-4d09-9dff-065d2a1a10a4","csi.storage.k8s.io/pvc/name":"pvc-v58s6","csi.storage.k8s.io/pvc/namespace":"provisioning-6364","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-2289cf6c-f625-4d09-9dff-065d2a1a10a4"}}
I1002 02:05:32.730082       1 azure_managedDiskController.go:286] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-e4ffebee-31b2-469e-bb14-001e1814534e
... skipping 23 lines ...
I1002 02:05:35.824600       1 utils.go:102] GRPC response: {}
I1002 02:05:35.824635       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:05:35.824657       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-49352361-vmss000000, refreshing the cache
I1002 02:05:35.893267       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-2289cf6c-f625-4d09-9dff-065d2a1a10a4" lun 2 to node "k8s-agentpool1-49352361-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-2289cf6c-f625-4d09-9dff-065d2a1a10a4:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-2289cf6c-f625-4d09-9dff-065d2a1a10a4  true false 2})]
I1002 02:05:35.893297       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:05:35.893314       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-2289cf6c-f625-4d09-9dff-065d2a1a10a4:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-2289cf6c-f625-4d09-9dff-065d2a1a10a4  true false 2})])
I1002 02:05:36.062067       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-2289cf6c-f625-4d09-9dff-065d2a1a10a4:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-2289cf6c-f625-4d09-9dff-065d2a1a10a4  true false 2})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1002 02:05:37.637334       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 02:05:37.637363       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-dabd609d-7ea8-46ea-a308-41fa78d7d806","parameters":{"csi.storage.k8s.io/pv/name":"pvc-dabd609d-7ea8-46ea-a308-41fa78d7d806","csi.storage.k8s.io/pvc/name":"test.csi.azure.com6fz4d","csi.storage.k8s.io/pvc/namespace":"fsgroupchangepolicy-9050"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 02:05:37.657614       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-dabd609d-7ea8-46ea-a308-41fa78d7d806, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-dabd609d-7ea8-46ea-a308-41fa78d7d806' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 02:05:37.657722       1 controllerserver.go:271] begin to create azure disk(pvc-dabd609d-7ea8-46ea-a308-41fa78d7d806) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 02:05:37.657745       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-dabd609d-7ea8-46ea-a308-41fa78d7d806 StorageAccountType:StandardSSD_LRS Size:5
I1002 02:05:39.979807       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-dabd609d-7ea8-46ea-a308-41fa78d7d806 StorageAccountType:StandardSSD_LRS Size:5
I1002 02:05:39.979838       1 controllerserver.go:348] create azure disk(pvc-dabd609d-7ea8-46ea-a308-41fa78d7d806) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-dabd609d-7ea8-46ea-a308-41fa78d7d806 kubernetes.io-created-for-pvc-name:test.csi.azure.com6fz4d kubernetes.io-created-for-pvc-namespace:fsgroupchangepolicy-9050]) successfully
I1002 02:05:39.979857       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-dabd609d-7ea8-46ea-a308-41fa78d7d806","csi.storage.k8s.io/pvc/name":"test.csi.azure.com6fz4d","csi.storage.k8s.io/pvc/namespace":"fsgroupchangepolicy-9050","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-dabd609d-7ea8-46ea-a308-41fa78d7d806"}}
I1002 02:05:42.347532       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 2 lines ...
I1002 02:05:42.377424       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:05:42.377447       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-dabd609d-7ea8-46ea-a308-41fa78d7d806" to node "k8s-agentpool1-49352361-vmss000001"
I1002 02:05:42.377463       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:05:42.377475       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-dabd609d-7ea8-46ea-a308-41fa78d7d806" lun 2 to node "k8s-agentpool1-49352361-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-dabd609d-7ea8-46ea-a308-41fa78d7d806:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-dabd609d-7ea8-46ea-a308-41fa78d7d806  true false 2})]
I1002 02:05:42.377491       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:05:42.377506       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-dabd609d-7ea8-46ea-a308-41fa78d7d806:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-dabd609d-7ea8-46ea-a308-41fa78d7d806  true false 2})])
I1002 02:05:42.554256       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-dabd609d-7ea8-46ea-a308-41fa78d7d806:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-dabd609d-7ea8-46ea-a308-41fa78d7d806  true false 2})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1002 02:05:51.175057       1 controllerserver.go:465] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-2289cf6c-f625-4d09-9dff-065d2a1a10a4" attached to node "k8s-agentpool1-49352361-vmss000000".
I1002 02:05:51.175178       1 controllerserver.go:485] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-2289cf6c-f625-4d09-9dff-065d2a1a10a4" to node "k8s-agentpool1-49352361-vmss000000" successfully
I1002 02:05:51.175200       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"2"}}
I1002 02:05:51.186921       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
I1002 02:05:51.186941       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-49352361-vmss000000","volume_capability":{"AccessType":{"Block":{}},"access_mode":{"mode":7}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-2289cf6c-f625-4d09-9dff-065d2a1a10a4","csi.storage.k8s.io/pvc/name":"pvc-v58s6","csi.storage.k8s.io/pvc/namespace":"provisioning-6364","requestedsizegib":"5","storage.kubernetes.io/csiProvisionerIdentity":"1633139719760-8081-test.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-2289cf6c-f625-4d09-9dff-065d2a1a10a4"}
I1002 02:05:51.244601       1 controllerserver.go:440] GetDiskLun returned: <nil>. Initiating attaching volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-2289cf6c-f625-4d09-9dff-065d2a1a10a4" to node "k8s-agentpool1-49352361-vmss000000".
... skipping 46 lines ...
I1002 02:06:20.717004       1 utils.go:102] GRPC response: {"snapshot":{"creation_time":{"nanos":546133900,"seconds":1633140378},"ready_to_use":true,"size_bytes":5368709120,"snapshot_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/snapshots/snapshot-7d4a5371-a333-43f1-9898-5ddf8fa42e1d","source_volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-2289cf6c-f625-4d09-9dff-065d2a1a10a4"}}
I1002 02:06:21.538620       1 azure_managedDiskController.go:286] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-ea6ac694-d639-49f9-8188-ae767057a273
I1002 02:06:21.538653       1 controllerserver.go:391] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-ea6ac694-d639-49f9-8188-ae767057a273) returned with <nil>
I1002 02:06:21.538670       1 utils.go:102] GRPC response: {}
I1002 02:06:23.193168       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 02:06:23.193194       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-556a65e3-0037-4f34-8d63-7bc36ce23178","parameters":{"csi.storage.k8s.io/pv/name":"pvc-556a65e3-0037-4f34-8d63-7bc36ce23178","csi.storage.k8s.io/pvc/name":"pvc-pclnx","csi.storage.k8s.io/pvc/namespace":"provisioning-6364"},"volume_capabilities":[{"AccessType":{"Block":{}},"access_mode":{"mode":7}}],"volume_content_source":{"Type":{"Snapshot":{"snapshot_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/snapshots/snapshot-7d4a5371-a333-43f1-9898-5ddf8fa42e1d"}}}}
I1002 02:06:23.215271       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-556a65e3-0037-4f34-8d63-7bc36ce23178, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-556a65e3-0037-4f34-8d63-7bc36ce23178' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 02:06:23.215370       1 controllerserver.go:271] begin to create azure disk(pvc-556a65e3-0037-4f34-8d63-7bc36ce23178) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 02:06:23.215384       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-556a65e3-0037-4f34-8d63-7bc36ce23178 StorageAccountType:StandardSSD_LRS Size:5
I1002 02:06:25.140353       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerUnpublishVolume
I1002 02:06:25.140378       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-49352361-vmss000000","volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-2289cf6c-f625-4d09-9dff-065d2a1a10a4"}
I1002 02:06:25.140486       1 controllerserver.go:524] Trying to detach volume /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-2289cf6c-f625-4d09-9dff-065d2a1a10a4 from node k8s-agentpool1-49352361-vmss000000
I1002 02:06:25.140508       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
... skipping 13 lines ...
I1002 02:06:27.584940       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-49352361-vmss000001","volume_capability":{"AccessType":{"Block":{}},"access_mode":{"mode":7}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-556a65e3-0037-4f34-8d63-7bc36ce23178","csi.storage.k8s.io/pvc/name":"pvc-pclnx","csi.storage.k8s.io/pvc/namespace":"provisioning-6364","requestedsizegib":"5","storage.kubernetes.io/csiProvisionerIdentity":"1633139719760-8081-test.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-556a65e3-0037-4f34-8d63-7bc36ce23178"}
I1002 02:06:27.610217       1 controllerserver.go:440] GetDiskLun returned: <nil>. Initiating attaching volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-556a65e3-0037-4f34-8d63-7bc36ce23178" to node "k8s-agentpool1-49352361-vmss000001".
I1002 02:06:27.610262       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:06:27.610302       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-556a65e3-0037-4f34-8d63-7bc36ce23178" to node "k8s-agentpool1-49352361-vmss000001"
I1002 02:06:27.969465       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 02:06:27.969492       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-421c8130-f9af-44eb-9d66-68fef45f99b4","parameters":{"csi.storage.k8s.io/pv/name":"pvc-421c8130-f9af-44eb-9d66-68fef45f99b4","csi.storage.k8s.io/pvc/name":"test.csi.azure.comzntx7","csi.storage.k8s.io/pvc/namespace":"fsgroupchangepolicy-3558"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 02:06:27.988569       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-421c8130-f9af-44eb-9d66-68fef45f99b4, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-421c8130-f9af-44eb-9d66-68fef45f99b4' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 02:06:27.988640       1 controllerserver.go:271] begin to create azure disk(pvc-421c8130-f9af-44eb-9d66-68fef45f99b4) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 02:06:27.988654       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-421c8130-f9af-44eb-9d66-68fef45f99b4 StorageAccountType:StandardSSD_LRS Size:5
I1002 02:06:29.839091       1 utils.go:95] GRPC call: /csi.v1.Controller/DeleteVolume
I1002 02:06:29.839134       1 utils.go:96] GRPC request: {"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8"}
I1002 02:06:29.839261       1 controllerserver.go:389] deleting azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-b9b42c1b-58f1-438e-a503-4f24149ddfb8)
I1002 02:06:30.395835       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-421c8130-f9af-44eb-9d66-68fef45f99b4 StorageAccountType:StandardSSD_LRS Size:5
... skipping 29 lines ...
I1002 02:06:45.632196       1 controllerserver.go:389] deleting azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-da8c5704-620d-42aa-aa9b-48dc69304d85)
I1002 02:06:50.850021       1 azure_managedDiskController.go:286] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-da8c5704-620d-42aa-aa9b-48dc69304d85
I1002 02:06:50.850067       1 controllerserver.go:391] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-da8c5704-620d-42aa-aa9b-48dc69304d85) returned with <nil>
I1002 02:06:50.850101       1 utils.go:102] GRPC response: {}
I1002 02:06:57.567519       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 02:06:57.567546       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-e5010bb9-b06e-4c7a-af13-d3c744184d33","parameters":{"csi.storage.k8s.io/pv/name":"pvc-e5010bb9-b06e-4c7a-af13-d3c744184d33","csi.storage.k8s.io/pvc/name":"inline-volume-tester-zdghh-my-volume-0","csi.storage.k8s.io/pvc/namespace":"ephemeral-5400"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 02:06:57.589142       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-e5010bb9-b06e-4c7a-af13-d3c744184d33, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-e5010bb9-b06e-4c7a-af13-d3c744184d33' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 02:06:57.589238       1 controllerserver.go:271] begin to create azure disk(pvc-e5010bb9-b06e-4c7a-af13-d3c744184d33) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 02:06:57.589252       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-e5010bb9-b06e-4c7a-af13-d3c744184d33 StorageAccountType:StandardSSD_LRS Size:5
I1002 02:07:00.013021       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-e5010bb9-b06e-4c7a-af13-d3c744184d33 StorageAccountType:StandardSSD_LRS Size:5
I1002 02:07:00.013075       1 controllerserver.go:348] create azure disk(pvc-e5010bb9-b06e-4c7a-af13-d3c744184d33) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-e5010bb9-b06e-4c7a-af13-d3c744184d33 kubernetes.io-created-for-pvc-name:inline-volume-tester-zdghh-my-volume-0 kubernetes.io-created-for-pvc-namespace:ephemeral-5400]) successfully
I1002 02:07:00.013096       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-e5010bb9-b06e-4c7a-af13-d3c744184d33","csi.storage.k8s.io/pvc/name":"inline-volume-tester-zdghh-my-volume-0","csi.storage.k8s.io/pvc/namespace":"ephemeral-5400","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-e5010bb9-b06e-4c7a-af13-d3c744184d33"}}
I1002 02:07:00.802763       1 azure_controller_vmss.go:225] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000001) - detach disk(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-dabd609d-7ea8-46ea-a308-41fa78d7d806:pvc-dabd609d-7ea8-46ea-a308-41fa78d7d806]) returned with <nil>
... skipping 2 lines ...
I1002 02:07:00.802917       1 utils.go:102] GRPC response: {}
I1002 02:07:00.803011       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:07:00.803033       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-49352361-vmss000001, refreshing the cache
I1002 02:07:00.873435       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-556a65e3-0037-4f34-8d63-7bc36ce23178" lun 0 to node "k8s-agentpool1-49352361-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-421c8130-f9af-44eb-9d66-68fef45f99b4:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-421c8130-f9af-44eb-9d66-68fef45f99b4  true false 1}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-556a65e3-0037-4f34-8d63-7bc36ce23178:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-556a65e3-0037-4f34-8d63-7bc36ce23178  true false 0})]
I1002 02:07:00.873467       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:07:00.873502       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-421c8130-f9af-44eb-9d66-68fef45f99b4:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-421c8130-f9af-44eb-9d66-68fef45f99b4  true false 1}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-556a65e3-0037-4f34-8d63-7bc36ce23178:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-556a65e3-0037-4f34-8d63-7bc36ce23178  true false 0})])
I1002 02:07:01.055438       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-421c8130-f9af-44eb-9d66-68fef45f99b4:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-421c8130-f9af-44eb-9d66-68fef45f99b4  true false 1}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-556a65e3-0037-4f34-8d63-7bc36ce23178:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-556a65e3-0037-4f34-8d63-7bc36ce23178  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1002 02:07:01.055762       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:07:01.055807       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-49352361-vmss000001, refreshing the cache
I1002 02:07:01.129298       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-421c8130-f9af-44eb-9d66-68fef45f99b4" lun 1 to node "k8s-agentpool1-49352361-vmss000001", diskMap: map[]
I1002 02:07:01.129395       1 controllerserver.go:465] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-421c8130-f9af-44eb-9d66-68fef45f99b4" attached to node "k8s-agentpool1-49352361-vmss000001".
I1002 02:07:01.129425       1 controllerserver.go:485] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-421c8130-f9af-44eb-9d66-68fef45f99b4" to node "k8s-agentpool1-49352361-vmss000001" successfully
I1002 02:07:01.129458       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"1"}}
... skipping 6 lines ...
I1002 02:07:01.560644       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:07:01.560689       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-e5010bb9-b06e-4c7a-af13-d3c744184d33" to node "k8s-agentpool1-49352361-vmss000000"
I1002 02:07:01.560710       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:07:01.560739       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-e5010bb9-b06e-4c7a-af13-d3c744184d33" lun 2 to node "k8s-agentpool1-49352361-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-e5010bb9-b06e-4c7a-af13-d3c744184d33:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-e5010bb9-b06e-4c7a-af13-d3c744184d33  true false 2})]
I1002 02:07:01.560772       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:07:01.560791       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-e5010bb9-b06e-4c7a-af13-d3c744184d33:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-e5010bb9-b06e-4c7a-af13-d3c744184d33  true false 2})])
I1002 02:07:01.763864       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-e5010bb9-b06e-4c7a-af13-d3c744184d33:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-e5010bb9-b06e-4c7a-af13-d3c744184d33  true false 2})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1002 02:07:11.150727       1 controllerserver.go:465] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-556a65e3-0037-4f34-8d63-7bc36ce23178" attached to node "k8s-agentpool1-49352361-vmss000001".
I1002 02:07:11.150777       1 controllerserver.go:485] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-556a65e3-0037-4f34-8d63-7bc36ce23178" to node "k8s-agentpool1-49352361-vmss000001" successfully
I1002 02:07:11.150802       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
I1002 02:07:11.163579       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
I1002 02:07:11.163599       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-49352361-vmss000001","volume_capability":{"AccessType":{"Block":{}},"access_mode":{"mode":7}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-556a65e3-0037-4f34-8d63-7bc36ce23178","csi.storage.k8s.io/pvc/name":"pvc-pclnx","csi.storage.k8s.io/pvc/namespace":"provisioning-6364","requestedsizegib":"5","storage.kubernetes.io/csiProvisionerIdentity":"1633139719760-8081-test.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-556a65e3-0037-4f34-8d63-7bc36ce23178"}
I1002 02:07:11.200704       1 controllerserver.go:440] GetDiskLun returned: <nil>. Initiating attaching volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-556a65e3-0037-4f34-8d63-7bc36ce23178" to node "k8s-agentpool1-49352361-vmss000001".
... skipping 21 lines ...
I1002 02:07:15.518118       1 azure_controller_common.go:346] Trying to detach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-5185e3c9-682c-4e7d-9b6c-556f24c7cdda" from node "k8s-agentpool1-49352361-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-5185e3c9-682c-4e7d-9b6c-556f24c7cdda:pvc-5185e3c9-682c-4e7d-9b6c-556f24c7cdda]
I1002 02:07:15.518147       1 azure_controller_vmss.go:174] azureDisk - detach disk: name "pvc-5185e3c9-682c-4e7d-9b6c-556f24c7cdda" uri "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-5185e3c9-682c-4e7d-9b6c-556f24c7cdda"
I1002 02:07:15.518157       1 azure_controller_vmss.go:213] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000000) - detach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-5185e3c9-682c-4e7d-9b6c-556f24c7cdda:pvc-5185e3c9-682c-4e7d-9b6c-556f24c7cdda])
I1002 02:07:15.518168       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:07:22.016683       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 02:07:22.016712       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-a30bd782-5592-44c7-94f6-208848426047","parameters":{"csi.storage.k8s.io/pv/name":"pvc-a30bd782-5592-44c7-94f6-208848426047","csi.storage.k8s.io/pvc/name":"inline-volume-tester2-9qhfv-my-volume-0","csi.storage.k8s.io/pvc/namespace":"ephemeral-5400"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 02:07:22.036640       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a30bd782-5592-44c7-94f6-208848426047, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-a30bd782-5592-44c7-94f6-208848426047' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 02:07:22.036701       1 controllerserver.go:271] begin to create azure disk(pvc-a30bd782-5592-44c7-94f6-208848426047) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 02:07:22.036721       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-a30bd782-5592-44c7-94f6-208848426047 StorageAccountType:StandardSSD_LRS Size:5
I1002 02:07:24.507892       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-a30bd782-5592-44c7-94f6-208848426047 StorageAccountType:StandardSSD_LRS Size:5
I1002 02:07:24.507932       1 controllerserver.go:348] create azure disk(pvc-a30bd782-5592-44c7-94f6-208848426047) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-a30bd782-5592-44c7-94f6-208848426047 kubernetes.io-created-for-pvc-name:inline-volume-tester2-9qhfv-my-volume-0 kubernetes.io-created-for-pvc-namespace:ephemeral-5400]) successfully
I1002 02:07:24.507955       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-a30bd782-5592-44c7-94f6-208848426047","csi.storage.k8s.io/pvc/name":"inline-volume-tester2-9qhfv-my-volume-0","csi.storage.k8s.io/pvc/namespace":"ephemeral-5400","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a30bd782-5592-44c7-94f6-208848426047"}}
I1002 02:07:25.538176       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 22 lines ...
I1002 02:07:35.533502       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:07:35.533540       1 azure_controller_common.go:346] Trying to detach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-421c8130-f9af-44eb-9d66-68fef45f99b4" from node "k8s-agentpool1-49352361-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-421c8130-f9af-44eb-9d66-68fef45f99b4:pvc-421c8130-f9af-44eb-9d66-68fef45f99b4]
I1002 02:07:35.533567       1 azure_controller_vmss.go:174] azureDisk - detach disk: name "pvc-421c8130-f9af-44eb-9d66-68fef45f99b4" uri "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-421c8130-f9af-44eb-9d66-68fef45f99b4"
I1002 02:07:35.533582       1 azure_controller_vmss.go:213] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000001) - detach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-421c8130-f9af-44eb-9d66-68fef45f99b4:pvc-421c8130-f9af-44eb-9d66-68fef45f99b4])
I1002 02:07:39.005057       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 02:07:39.005086       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-804f170a-3c6a-44ff-9f57-e394a9e2ebcd","parameters":{"csi.storage.k8s.io/pv/name":"pvc-804f170a-3c6a-44ff-9f57-e394a9e2ebcd","csi.storage.k8s.io/pvc/name":"test.csi.azure.comzfmlg","csi.storage.k8s.io/pvc/namespace":"volumemode-7384"},"volume_capabilities":[{"AccessType":{"Block":{}},"access_mode":{"mode":7}}]}
I1002 02:07:39.041904       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-804f170a-3c6a-44ff-9f57-e394a9e2ebcd, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-804f170a-3c6a-44ff-9f57-e394a9e2ebcd' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 02:07:39.041981       1 controllerserver.go:271] begin to create azure disk(pvc-804f170a-3c6a-44ff-9f57-e394a9e2ebcd) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 02:07:39.041995       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-804f170a-3c6a-44ff-9f57-e394a9e2ebcd StorageAccountType:StandardSSD_LRS Size:5
I1002 02:07:41.378707       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-804f170a-3c6a-44ff-9f57-e394a9e2ebcd StorageAccountType:StandardSSD_LRS Size:5
I1002 02:07:41.378750       1 controllerserver.go:348] create azure disk(pvc-804f170a-3c6a-44ff-9f57-e394a9e2ebcd) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-804f170a-3c6a-44ff-9f57-e394a9e2ebcd kubernetes.io-created-for-pvc-name:test.csi.azure.comzfmlg kubernetes.io-created-for-pvc-namespace:volumemode-7384]) successfully
I1002 02:07:41.378782       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-804f170a-3c6a-44ff-9f57-e394a9e2ebcd","csi.storage.k8s.io/pvc/name":"test.csi.azure.comzfmlg","csi.storage.k8s.io/pvc/namespace":"volumemode-7384","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-804f170a-3c6a-44ff-9f57-e394a9e2ebcd"}}
I1002 02:07:43.781279       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 24 lines ...
I1002 02:07:51.080520       1 azure_controller_vmss.go:225] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000000) - detach disk(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-4cf075ab-9094-4e78-9b1b-d6f0d70ad7ca:pvc-4cf075ab-9094-4e78-9b1b-d6f0d70ad7ca]) returned with <nil>
I1002 02:07:51.080567       1 azure_controller_common.go:369] azureDisk - detach disk(pvc-4cf075ab-9094-4e78-9b1b-d6f0d70ad7ca, /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-4cf075ab-9094-4e78-9b1b-d6f0d70ad7ca) succeeded
I1002 02:07:51.080587       1 controllerserver.go:533] detach volume /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-4cf075ab-9094-4e78-9b1b-d6f0d70ad7ca from node k8s-agentpool1-49352361-vmss000000 successfully
I1002 02:07:51.080599       1 utils.go:102] GRPC response: {}
I1002 02:07:51.080668       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:07:51.080822       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-49352361-vmss000000, refreshing the cache
I1002 02:07:51.118852       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-804f170a-3c6a-44ff-9f57-e394a9e2ebcd:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-804f170a-3c6a-44ff-9f57-e394a9e2ebcd  true false 1})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1002 02:07:51.128896       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a30bd782-5592-44c7-94f6-208848426047" lun 0 to node "k8s-agentpool1-49352361-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-a30bd782-5592-44c7-94f6-208848426047:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-a30bd782-5592-44c7-94f6-208848426047  true false 0})]
I1002 02:07:51.128924       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:07:51.128957       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-a30bd782-5592-44c7-94f6-208848426047:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-a30bd782-5592-44c7-94f6-208848426047  true false 0})])
I1002 02:07:51.129268       1 azure_controller_common.go:346] Trying to detach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-556a65e3-0037-4f34-8d63-7bc36ce23178" from node "k8s-agentpool1-49352361-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-556a65e3-0037-4f34-8d63-7bc36ce23178:pvc-556a65e3-0037-4f34-8d63-7bc36ce23178]
I1002 02:07:51.129325       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-49352361-vmss000001, refreshing the cache
I1002 02:07:51.262584       1 azure_controller_vmss.go:174] azureDisk - detach disk: name "pvc-556a65e3-0037-4f34-8d63-7bc36ce23178" uri "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-556a65e3-0037-4f34-8d63-7bc36ce23178"
I1002 02:07:51.262685       1 azure_controller_vmss.go:213] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000001) - detach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-556a65e3-0037-4f34-8d63-7bc36ce23178:pvc-556a65e3-0037-4f34-8d63-7bc36ce23178])
I1002 02:07:51.264982       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-a30bd782-5592-44c7-94f6-208848426047:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-a30bd782-5592-44c7-94f6-208848426047  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1002 02:08:06.373621       1 controllerserver.go:465] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a30bd782-5592-44c7-94f6-208848426047" attached to node "k8s-agentpool1-49352361-vmss000000".
I1002 02:08:06.373664       1 controllerserver.go:485] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a30bd782-5592-44c7-94f6-208848426047" to node "k8s-agentpool1-49352361-vmss000000" successfully
I1002 02:08:06.373684       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
I1002 02:08:06.461458       1 controllerserver.go:465] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-804f170a-3c6a-44ff-9f57-e394a9e2ebcd" attached to node "k8s-agentpool1-49352361-vmss000001".
I1002 02:08:06.461488       1 controllerserver.go:485] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-804f170a-3c6a-44ff-9f57-e394a9e2ebcd" to node "k8s-agentpool1-49352361-vmss000001" successfully
I1002 02:08:06.461524       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"1"}}
... skipping 31 lines ...
I1002 02:08:16.529090       1 controllerserver.go:389] deleting azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-4cf075ab-9094-4e78-9b1b-d6f0d70ad7ca)
I1002 02:08:17.605170       1 azure_managedDiskController.go:286] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-556a65e3-0037-4f34-8d63-7bc36ce23178
I1002 02:08:17.605199       1 controllerserver.go:391] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-556a65e3-0037-4f34-8d63-7bc36ce23178) returned with <nil>
I1002 02:08:17.605244       1 utils.go:102] GRPC response: {}
I1002 02:08:20.547163       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 02:08:20.547210       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-29abb9b4-39fa-4882-bff0-8cc42eae20b8","parameters":{"csi.storage.k8s.io/pv/name":"pvc-29abb9b4-39fa-4882-bff0-8cc42eae20b8","csi.storage.k8s.io/pvc/name":"inline-volume-tester-lbrv2-my-volume-0","csi.storage.k8s.io/pvc/namespace":"ephemeral-7360"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 02:08:20.568306       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-29abb9b4-39fa-4882-bff0-8cc42eae20b8, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-29abb9b4-39fa-4882-bff0-8cc42eae20b8' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 02:08:20.568379       1 controllerserver.go:271] begin to create azure disk(pvc-29abb9b4-39fa-4882-bff0-8cc42eae20b8) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 02:08:20.568391       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-29abb9b4-39fa-4882-bff0-8cc42eae20b8 StorageAccountType:StandardSSD_LRS Size:5
I1002 02:08:21.712193       1 azure_managedDiskController.go:286] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-4cf075ab-9094-4e78-9b1b-d6f0d70ad7ca
I1002 02:08:21.712222       1 controllerserver.go:391] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-4cf075ab-9094-4e78-9b1b-d6f0d70ad7ca) returned with <nil>
I1002 02:08:21.712238       1 utils.go:102] GRPC response: {}
I1002 02:08:22.082314       1 azure_controller_vmss.go:225] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000001) - detach disk(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-804f170a-3c6a-44ff-9f57-e394a9e2ebcd:pvc-804f170a-3c6a-44ff-9f57-e394a9e2ebcd]) returned with <nil>
... skipping 16 lines ...
I1002 02:08:23.645331       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-49352361-vmss000001, refreshing the cache
I1002 02:08:23.864430       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-29abb9b4-39fa-4882-bff0-8cc42eae20b8" to node "k8s-agentpool1-49352361-vmss000001"
I1002 02:08:23.864467       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:08:23.864486       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-29abb9b4-39fa-4882-bff0-8cc42eae20b8" lun 0 to node "k8s-agentpool1-49352361-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-29abb9b4-39fa-4882-bff0-8cc42eae20b8:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-29abb9b4-39fa-4882-bff0-8cc42eae20b8  true false 0})]
I1002 02:08:23.864502       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:08:23.864513       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-29abb9b4-39fa-4882-bff0-8cc42eae20b8:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-29abb9b4-39fa-4882-bff0-8cc42eae20b8  true false 0})])
I1002 02:08:24.006868       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-29abb9b4-39fa-4882-bff0-8cc42eae20b8:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-29abb9b4-39fa-4882-bff0-8cc42eae20b8  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1002 02:08:24.641771       1 utils.go:95] GRPC call: /csi.v1.Controller/DeleteVolume
I1002 02:08:24.641806       1 utils.go:96] GRPC request: {"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-804f170a-3c6a-44ff-9f57-e394a9e2ebcd"}
I1002 02:08:24.641891       1 controllerserver.go:389] deleting azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-804f170a-3c6a-44ff-9f57-e394a9e2ebcd)
I1002 02:08:27.972173       1 azure_managedDiskController.go:286] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-2289cf6c-f625-4d09-9dff-065d2a1a10a4
I1002 02:08:27.972202       1 controllerserver.go:391] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-2289cf6c-f625-4d09-9dff-065d2a1a10a4) returned with <nil>
I1002 02:08:27.972239       1 utils.go:102] GRPC response: {}
I1002 02:08:28.227057       1 controllerserver.go:961] delete snapshot(snapshot-7d4a5371-a333-43f1-9898-5ddf8fa42e1d) under rg(kubetest-croyzaob) successfully
I1002 02:08:28.227093       1 utils.go:102] GRPC response: {}
I1002 02:08:29.888468       1 azure_managedDiskController.go:286] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-804f170a-3c6a-44ff-9f57-e394a9e2ebcd
I1002 02:08:29.888527       1 controllerserver.go:391] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-804f170a-3c6a-44ff-9f57-e394a9e2ebcd) returned with <nil>
I1002 02:08:29.888543       1 utils.go:102] GRPC response: {}
I1002 02:08:31.652236       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 02:08:31.652263       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-18db14b2-fdd2-4962-8fc1-ccf783cd8fec","parameters":{"csi.storage.k8s.io/pv/name":"pvc-18db14b2-fdd2-4962-8fc1-ccf783cd8fec","csi.storage.k8s.io/pvc/name":"pvc-pwxpd","csi.storage.k8s.io/pvc/namespace":"provisioning-3050"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 02:08:31.672396       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-18db14b2-fdd2-4962-8fc1-ccf783cd8fec, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-18db14b2-fdd2-4962-8fc1-ccf783cd8fec' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 02:08:31.672516       1 controllerserver.go:271] begin to create azure disk(pvc-18db14b2-fdd2-4962-8fc1-ccf783cd8fec) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 02:08:31.672558       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-18db14b2-fdd2-4962-8fc1-ccf783cd8fec StorageAccountType:StandardSSD_LRS Size:5
I1002 02:08:34.019702       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-18db14b2-fdd2-4962-8fc1-ccf783cd8fec StorageAccountType:StandardSSD_LRS Size:5
I1002 02:08:34.019757       1 controllerserver.go:348] create azure disk(pvc-18db14b2-fdd2-4962-8fc1-ccf783cd8fec) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-18db14b2-fdd2-4962-8fc1-ccf783cd8fec kubernetes.io-created-for-pvc-name:pvc-pwxpd kubernetes.io-created-for-pvc-namespace:provisioning-3050]) successfully
I1002 02:08:34.019782       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-18db14b2-fdd2-4962-8fc1-ccf783cd8fec","csi.storage.k8s.io/pvc/name":"pvc-pwxpd","csi.storage.k8s.io/pvc/namespace":"provisioning-3050","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-18db14b2-fdd2-4962-8fc1-ccf783cd8fec"}}
I1002 02:08:36.599161       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 3 lines ...
I1002 02:08:36.624896       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-49352361-vmss000001, refreshing the cache
I1002 02:08:36.694149       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-18db14b2-fdd2-4962-8fc1-ccf783cd8fec" to node "k8s-agentpool1-49352361-vmss000001"
I1002 02:08:36.694182       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:08:36.694217       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-18db14b2-fdd2-4962-8fc1-ccf783cd8fec" lun 1 to node "k8s-agentpool1-49352361-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-18db14b2-fdd2-4962-8fc1-ccf783cd8fec:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-18db14b2-fdd2-4962-8fc1-ccf783cd8fec  true false 1})]
I1002 02:08:36.694249       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:08:36.694284       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-18db14b2-fdd2-4962-8fc1-ccf783cd8fec:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-18db14b2-fdd2-4962-8fc1-ccf783cd8fec  true false 1})])
I1002 02:08:36.839033       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-18db14b2-fdd2-4962-8fc1-ccf783cd8fec:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-18db14b2-fdd2-4962-8fc1-ccf783cd8fec  true false 1})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1002 02:08:39.131472       1 controllerserver.go:465] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-29abb9b4-39fa-4882-bff0-8cc42eae20b8" attached to node "k8s-agentpool1-49352361-vmss000001".
I1002 02:08:39.131508       1 controllerserver.go:485] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-29abb9b4-39fa-4882-bff0-8cc42eae20b8" to node "k8s-agentpool1-49352361-vmss000001" successfully
I1002 02:08:39.131544       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
I1002 02:08:39.144282       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
I1002 02:08:39.144303       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-49352361-vmss000001","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":7}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-29abb9b4-39fa-4882-bff0-8cc42eae20b8","csi.storage.k8s.io/pvc/name":"inline-volume-tester-lbrv2-my-volume-0","csi.storage.k8s.io/pvc/namespace":"ephemeral-7360","requestedsizegib":"5","storage.kubernetes.io/csiProvisionerIdentity":"1633139719760-8081-test.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-29abb9b4-39fa-4882-bff0-8cc42eae20b8"}
I1002 02:08:39.186019       1 controllerserver.go:440] GetDiskLun returned: <nil>. Initiating attaching volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-29abb9b4-39fa-4882-bff0-8cc42eae20b8" to node "k8s-agentpool1-49352361-vmss000001".
... skipping 27 lines ...
I1002 02:09:06.042258       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:09:06.042277       1 azure_controller_common.go:346] Trying to detach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-18db14b2-fdd2-4962-8fc1-ccf783cd8fec" from node "k8s-agentpool1-49352361-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-18db14b2-fdd2-4962-8fc1-ccf783cd8fec:pvc-18db14b2-fdd2-4962-8fc1-ccf783cd8fec]
I1002 02:09:06.042303       1 azure_controller_vmss.go:174] azureDisk - detach disk: name "pvc-18db14b2-fdd2-4962-8fc1-ccf783cd8fec" uri "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-18db14b2-fdd2-4962-8fc1-ccf783cd8fec"
I1002 02:09:06.042315       1 azure_controller_vmss.go:213] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000001) - detach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-18db14b2-fdd2-4962-8fc1-ccf783cd8fec:pvc-18db14b2-fdd2-4962-8fc1-ccf783cd8fec])
I1002 02:09:08.009434       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 02:09:08.009462       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-ff01e3b0-33e0-4e1c-9b81-798ee6cd4426","parameters":{"csi.storage.k8s.io/pv/name":"pvc-ff01e3b0-33e0-4e1c-9b81-798ee6cd4426","csi.storage.k8s.io/pvc/name":"pvc-hfh2w","csi.storage.k8s.io/pvc/namespace":"provisioning-3050"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}],"volume_content_source":{"Type":{"Snapshot":{"snapshot_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/snapshots/snapshot-c0cd5ed7-edc9-4a1f-aeca-a74a104e1de6"}}}}
I1002 02:09:08.029544       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-ff01e3b0-33e0-4e1c-9b81-798ee6cd4426, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-ff01e3b0-33e0-4e1c-9b81-798ee6cd4426' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 02:09:08.029600       1 controllerserver.go:271] begin to create azure disk(pvc-ff01e3b0-33e0-4e1c-9b81-798ee6cd4426) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 02:09:08.029614       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-ff01e3b0-33e0-4e1c-9b81-798ee6cd4426 StorageAccountType:StandardSSD_LRS Size:5
I1002 02:09:10.424206       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-ff01e3b0-33e0-4e1c-9b81-798ee6cd4426 StorageAccountType:StandardSSD_LRS Size:5
I1002 02:09:10.424277       1 controllerserver.go:348] create azure disk(pvc-ff01e3b0-33e0-4e1c-9b81-798ee6cd4426) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-ff01e3b0-33e0-4e1c-9b81-798ee6cd4426 kubernetes.io-created-for-pvc-name:pvc-hfh2w kubernetes.io-created-for-pvc-namespace:provisioning-3050]) successfully
I1002 02:09:10.424313       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":{"Snapshot":{"snapshot_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/snapshots/snapshot-c0cd5ed7-edc9-4a1f-aeca-a74a104e1de6"}}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-ff01e3b0-33e0-4e1c-9b81-798ee6cd4426","csi.storage.k8s.io/pvc/name":"pvc-hfh2w","csi.storage.k8s.io/pvc/namespace":"provisioning-3050","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-ff01e3b0-33e0-4e1c-9b81-798ee6cd4426"}}
I1002 02:09:12.603881       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 38 lines ...
I1002 02:09:26.408904       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:09:26.408916       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-49352361-vmss000000, refreshing the cache
I1002 02:09:26.469263       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:09:26.469332       1 azure_controller_common.go:346] Trying to detach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a30bd782-5592-44c7-94f6-208848426047" from node "k8s-agentpool1-49352361-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-a30bd782-5592-44c7-94f6-208848426047:pvc-a30bd782-5592-44c7-94f6-208848426047]
E1002 02:09:26.469353       1 azure_controller_vmss.go:183] detach azure disk on node(k8s-agentpool1-49352361-vmss000000): disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-a30bd782-5592-44c7-94f6-208848426047:pvc-a30bd782-5592-44c7-94f6-208848426047]) not found
I1002 02:09:26.469360       1 azure_controller_vmss.go:213] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000000) - detach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-a30bd782-5592-44c7-94f6-208848426047:pvc-a30bd782-5592-44c7-94f6-208848426047])
I1002 02:09:26.624107       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-ff01e3b0-33e0-4e1c-9b81-798ee6cd4426:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-ff01e3b0-33e0-4e1c-9b81-798ee6cd4426  true false 1})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1002 02:09:26.624403       1 azure_controller_common.go:346] Trying to detach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-29abb9b4-39fa-4882-bff0-8cc42eae20b8" from node "k8s-agentpool1-49352361-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-18db14b2-fdd2-4962-8fc1-ccf783cd8fec:pvc-18db14b2-fdd2-4962-8fc1-ccf783cd8fec /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-29abb9b4-39fa-4882-bff0-8cc42eae20b8:pvc-29abb9b4-39fa-4882-bff0-8cc42eae20b8]
I1002 02:09:26.624477       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-49352361-vmss000001, refreshing the cache
I1002 02:09:26.686510       1 azure_controller_vmss.go:174] azureDisk - detach disk: name "pvc-29abb9b4-39fa-4882-bff0-8cc42eae20b8" uri "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-29abb9b4-39fa-4882-bff0-8cc42eae20b8"
I1002 02:09:26.686559       1 azure_controller_vmss.go:213] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000001) - detach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-18db14b2-fdd2-4962-8fc1-ccf783cd8fec:pvc-18db14b2-fdd2-4962-8fc1-ccf783cd8fec /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-29abb9b4-39fa-4882-bff0-8cc42eae20b8:pvc-29abb9b4-39fa-4882-bff0-8cc42eae20b8])
I1002 02:09:38.716520       1 utils.go:95] GRPC call: /csi.v1.Controller/DeleteVolume
I1002 02:09:38.716548       1 utils.go:96] GRPC request: {"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a30bd782-5592-44c7-94f6-208848426047"}
I1002 02:09:38.716644       1 controllerserver.go:389] deleting azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a30bd782-5592-44c7-94f6-208848426047)
I1002 02:09:38.716659       1 controllerserver.go:391] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a30bd782-5592-44c7-94f6-208848426047) returned with failed to delete disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a30bd782-5592-44c7-94f6-208848426047) since it's in attaching or detaching state
E1002 02:09:38.716681       1 utils.go:100] GRPC error: failed to delete disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a30bd782-5592-44c7-94f6-208848426047) since it's in attaching or detaching state
I1002 02:09:41.790721       1 azure_controller_vmss.go:225] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000000) - detach disk(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-a30bd782-5592-44c7-94f6-208848426047:pvc-a30bd782-5592-44c7-94f6-208848426047]) returned with <nil>
I1002 02:09:41.790791       1 azure_controller_common.go:369] azureDisk - detach disk(pvc-a30bd782-5592-44c7-94f6-208848426047, /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a30bd782-5592-44c7-94f6-208848426047) succeeded
I1002 02:09:41.790802       1 controllerserver.go:533] detach volume /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a30bd782-5592-44c7-94f6-208848426047 from node k8s-agentpool1-49352361-vmss000000 successfully
I1002 02:09:41.790813       1 utils.go:102] GRPC response: {}
I1002 02:09:41.821393       1 controllerserver.go:465] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-ff01e3b0-33e0-4e1c-9b81-798ee6cd4426" attached to node "k8s-agentpool1-49352361-vmss000001".
I1002 02:09:41.821421       1 controllerserver.go:485] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-ff01e3b0-33e0-4e1c-9b81-798ee6cd4426" to node "k8s-agentpool1-49352361-vmss000001" successfully
... skipping 68 lines ...
I1002 02:10:35.588822       1 controllerserver.go:391] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-18db14b2-fdd2-4962-8fc1-ccf783cd8fec) returned with <nil>
I1002 02:10:35.588838       1 utils.go:102] GRPC response: {}
I1002 02:10:35.872529       1 controllerserver.go:961] delete snapshot(snapshot-c0cd5ed7-edc9-4a1f-aeca-a74a104e1de6) under rg(kubetest-croyzaob) successfully
I1002 02:10:35.872557       1 utils.go:102] GRPC response: {}
I1002 02:10:39.826167       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 02:10:39.826192       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-543bc30a-0314-43cc-8b64-0a2f36349de1","parameters":{"csi.storage.k8s.io/pv/name":"pvc-543bc30a-0314-43cc-8b64-0a2f36349de1","csi.storage.k8s.io/pvc/name":"test.csi.azure.comctt8x","csi.storage.k8s.io/pvc/namespace":"provisioning-6424"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 02:10:39.848559       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-543bc30a-0314-43cc-8b64-0a2f36349de1, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-543bc30a-0314-43cc-8b64-0a2f36349de1' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 02:10:39.848624       1 controllerserver.go:271] begin to create azure disk(pvc-543bc30a-0314-43cc-8b64-0a2f36349de1) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 02:10:39.848678       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-543bc30a-0314-43cc-8b64-0a2f36349de1 StorageAccountType:StandardSSD_LRS Size:5
I1002 02:10:42.182519       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-543bc30a-0314-43cc-8b64-0a2f36349de1 StorageAccountType:StandardSSD_LRS Size:5
I1002 02:10:42.182572       1 controllerserver.go:348] create azure disk(pvc-543bc30a-0314-43cc-8b64-0a2f36349de1) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-543bc30a-0314-43cc-8b64-0a2f36349de1 kubernetes.io-created-for-pvc-name:test.csi.azure.comctt8x kubernetes.io-created-for-pvc-namespace:provisioning-6424]) successfully
I1002 02:10:42.182610       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-543bc30a-0314-43cc-8b64-0a2f36349de1","csi.storage.k8s.io/pvc/name":"test.csi.azure.comctt8x","csi.storage.k8s.io/pvc/namespace":"provisioning-6424","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-543bc30a-0314-43cc-8b64-0a2f36349de1"}}
I1002 02:10:44.601528       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 3 lines ...
I1002 02:10:44.631987       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-49352361-vmss000001, refreshing the cache
I1002 02:10:44.707980       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-543bc30a-0314-43cc-8b64-0a2f36349de1" to node "k8s-agentpool1-49352361-vmss000001"
I1002 02:10:44.708033       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:10:44.708051       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-543bc30a-0314-43cc-8b64-0a2f36349de1" lun 0 to node "k8s-agentpool1-49352361-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-543bc30a-0314-43cc-8b64-0a2f36349de1:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-543bc30a-0314-43cc-8b64-0a2f36349de1  true false 0})]
I1002 02:10:44.708085       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:10:44.708097       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-543bc30a-0314-43cc-8b64-0a2f36349de1:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-543bc30a-0314-43cc-8b64-0a2f36349de1  true false 0})])
I1002 02:10:44.855224       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-543bc30a-0314-43cc-8b64-0a2f36349de1:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-543bc30a-0314-43cc-8b64-0a2f36349de1  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1002 02:10:56.690135       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerUnpublishVolume
I1002 02:10:56.690163       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-49352361-vmss000000","volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-e5010bb9-b06e-4c7a-af13-d3c744184d33"}
I1002 02:10:56.690262       1 controllerserver.go:524] Trying to detach volume /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-e5010bb9-b06e-4c7a-af13-d3c744184d33 from node k8s-agentpool1-49352361-vmss000000
I1002 02:10:56.690278       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:10:56.690317       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:10:56.690354       1 azure_controller_common.go:346] Trying to detach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-e5010bb9-b06e-4c7a-af13-d3c744184d33" from node "k8s-agentpool1-49352361-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-e5010bb9-b06e-4c7a-af13-d3c744184d33:pvc-e5010bb9-b06e-4c7a-af13-d3c744184d33]
... skipping 27 lines ...
I1002 02:11:26.925005       1 azure_controller_vmss.go:213] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000001) - detach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-543bc30a-0314-43cc-8b64-0a2f36349de1:pvc-543bc30a-0314-43cc-8b64-0a2f36349de1])
I1002 02:11:27.885469       1 azure_managedDiskController.go:286] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-e5010bb9-b06e-4c7a-af13-d3c744184d33
I1002 02:11:27.885501       1 controllerserver.go:391] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-e5010bb9-b06e-4c7a-af13-d3c744184d33) returned with <nil>
I1002 02:11:27.885536       1 utils.go:102] GRPC response: {}
I1002 02:11:32.697496       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 02:11:32.697524       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-c4dbfa1d-befe-4648-84db-d2af960b3beb","parameters":{"csi.storage.k8s.io/pv/name":"pvc-c4dbfa1d-befe-4648-84db-d2af960b3beb","csi.storage.k8s.io/pvc/name":"inline-volume-tester-72lr8-my-volume-0","csi.storage.k8s.io/pvc/namespace":"ephemeral-7749"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 02:11:32.717598       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-c4dbfa1d-befe-4648-84db-d2af960b3beb, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-c4dbfa1d-befe-4648-84db-d2af960b3beb' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 02:11:32.717662       1 controllerserver.go:271] begin to create azure disk(pvc-c4dbfa1d-befe-4648-84db-d2af960b3beb) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 02:11:32.717677       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-c4dbfa1d-befe-4648-84db-d2af960b3beb StorageAccountType:StandardSSD_LRS Size:5
I1002 02:11:35.042167       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-c4dbfa1d-befe-4648-84db-d2af960b3beb StorageAccountType:StandardSSD_LRS Size:5
I1002 02:11:35.042211       1 controllerserver.go:348] create azure disk(pvc-c4dbfa1d-befe-4648-84db-d2af960b3beb) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-c4dbfa1d-befe-4648-84db-d2af960b3beb kubernetes.io-created-for-pvc-name:inline-volume-tester-72lr8-my-volume-0 kubernetes.io-created-for-pvc-namespace:ephemeral-7749]) successfully
I1002 02:11:35.042267       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-c4dbfa1d-befe-4648-84db-d2af960b3beb","csi.storage.k8s.io/pvc/name":"inline-volume-tester-72lr8-my-volume-0","csi.storage.k8s.io/pvc/namespace":"ephemeral-7749","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-c4dbfa1d-befe-4648-84db-d2af960b3beb"}}
I1002 02:11:35.796898       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 12 lines ...
I1002 02:11:42.411946       1 controllerserver.go:524] Trying to detach volume /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-543bc30a-0314-43cc-8b64-0a2f36349de1 from node k8s-agentpool1-49352361-vmss000001
I1002 02:11:42.411962       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:11:42.490041       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-c4dbfa1d-befe-4648-84db-d2af960b3beb" lun 0 to node "k8s-agentpool1-49352361-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-c4dbfa1d-befe-4648-84db-d2af960b3beb:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-c4dbfa1d-befe-4648-84db-d2af960b3beb  true false 0})]
I1002 02:11:42.490105       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:11:42.490140       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-c4dbfa1d-befe-4648-84db-d2af960b3beb:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-c4dbfa1d-befe-4648-84db-d2af960b3beb  true false 0})])
I1002 02:11:42.490258       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:11:42.695849       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-c4dbfa1d-befe-4648-84db-d2af960b3beb:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-c4dbfa1d-befe-4648-84db-d2af960b3beb  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1002 02:11:42.696084       1 azure_controller_common.go:346] Trying to detach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-543bc30a-0314-43cc-8b64-0a2f36349de1" from node "k8s-agentpool1-49352361-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-543bc30a-0314-43cc-8b64-0a2f36349de1:pvc-543bc30a-0314-43cc-8b64-0a2f36349de1]
I1002 02:11:42.696120       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-49352361-vmss000001, refreshing the cache
E1002 02:11:42.798686       1 azure_controller_vmss.go:183] detach azure disk on node(k8s-agentpool1-49352361-vmss000001): disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-543bc30a-0314-43cc-8b64-0a2f36349de1:pvc-543bc30a-0314-43cc-8b64-0a2f36349de1]) not found
I1002 02:11:42.798716       1 azure_controller_vmss.go:213] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000001) - detach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-543bc30a-0314-43cc-8b64-0a2f36349de1:pvc-543bc30a-0314-43cc-8b64-0a2f36349de1])
I1002 02:11:53.023676       1 azure_controller_vmss.go:225] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000001) - detach disk(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-543bc30a-0314-43cc-8b64-0a2f36349de1:pvc-543bc30a-0314-43cc-8b64-0a2f36349de1]) returned with <nil>
I1002 02:11:53.023746       1 azure_controller_common.go:369] azureDisk - detach disk(pvc-543bc30a-0314-43cc-8b64-0a2f36349de1, /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-543bc30a-0314-43cc-8b64-0a2f36349de1) succeeded
... skipping 15 lines ...
I1002 02:11:57.953926       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
I1002 02:12:01.799503       1 azure_managedDiskController.go:286] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-543bc30a-0314-43cc-8b64-0a2f36349de1
I1002 02:12:01.799563       1 controllerserver.go:391] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-543bc30a-0314-43cc-8b64-0a2f36349de1) returned with <nil>
I1002 02:12:01.799600       1 utils.go:102] GRPC response: {}
I1002 02:12:14.723975       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 02:12:14.724003       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-7682da56-c79c-4167-bf3e-d2bd59c9f4ab","parameters":{"csi.storage.k8s.io/pv/name":"pvc-7682da56-c79c-4167-bf3e-d2bd59c9f4ab","csi.storage.k8s.io/pvc/name":"inline-volume-tester2-5xlm5-my-volume-0","csi.storage.k8s.io/pvc/namespace":"ephemeral-7749"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 02:12:14.745307       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-7682da56-c79c-4167-bf3e-d2bd59c9f4ab, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-7682da56-c79c-4167-bf3e-d2bd59c9f4ab' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 02:12:14.745370       1 controllerserver.go:271] begin to create azure disk(pvc-7682da56-c79c-4167-bf3e-d2bd59c9f4ab) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) diskZone() maxShares(0)
I1002 02:12:14.745384       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-7682da56-c79c-4167-bf3e-d2bd59c9f4ab StorageAccountType:StandardSSD_LRS Size:5
I1002 02:12:17.084917       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-7682da56-c79c-4167-bf3e-d2bd59c9f4ab StorageAccountType:StandardSSD_LRS Size:5
I1002 02:12:17.084977       1 controllerserver.go:348] create azure disk(pvc-7682da56-c79c-4167-bf3e-d2bd59c9f4ab) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-7682da56-c79c-4167-bf3e-d2bd59c9f4ab kubernetes.io-created-for-pvc-name:inline-volume-tester2-5xlm5-my-volume-0 kubernetes.io-created-for-pvc-namespace:ephemeral-7749]) successfully
I1002 02:12:17.085018       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-7682da56-c79c-4167-bf3e-d2bd59c9f4ab","csi.storage.k8s.io/pvc/name":"inline-volume-tester2-5xlm5-my-volume-0","csi.storage.k8s.io/pvc/namespace":"ephemeral-7749","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-7682da56-c79c-4167-bf3e-d2bd59c9f4ab"}}
I1002 02:12:17.792754       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 2 lines ...
I1002 02:12:17.818176       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:12:17.818196       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-7682da56-c79c-4167-bf3e-d2bd59c9f4ab" to node "k8s-agentpool1-49352361-vmss000000"
I1002 02:12:17.818250       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:12:17.818280       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-7682da56-c79c-4167-bf3e-d2bd59c9f4ab" lun 0 to node "k8s-agentpool1-49352361-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-7682da56-c79c-4167-bf3e-d2bd59c9f4ab:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-7682da56-c79c-4167-bf3e-d2bd59c9f4ab  true false 0})]
I1002 02:12:17.818318       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:12:17.818332       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-7682da56-c79c-4167-bf3e-d2bd59c9f4ab:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-7682da56-c79c-4167-bf3e-d2bd59c9f4ab  true false 0})])
I1002 02:12:17.973648       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-7682da56-c79c-4167-bf3e-d2bd59c9f4ab:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-7682da56-c79c-4167-bf3e-d2bd59c9f4ab  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1002 02:12:21.467497       1 azure_vmss.go:319] Couldn't find VMSS VM with scaleSetName "k8s-agentpool1-49352361-vmss" and instanceID "0", refreshing the cache
I1002 02:12:28.071485       1 controllerserver.go:465] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-7682da56-c79c-4167-bf3e-d2bd59c9f4ab" attached to node "k8s-agentpool1-49352361-vmss000000".
I1002 02:12:28.071573       1 controllerserver.go:485] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-7682da56-c79c-4167-bf3e-d2bd59c9f4ab" to node "k8s-agentpool1-49352361-vmss000000" successfully
I1002 02:12:28.071592       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
I1002 02:12:28.085904       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
I1002 02:12:28.085940       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-49352361-vmss000000","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":7}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-7682da56-c79c-4167-bf3e-d2bd59c9f4ab","csi.storage.k8s.io/pvc/name":"inline-volume-tester2-5xlm5-my-volume-0","csi.storage.k8s.io/pvc/namespace":"ephemeral-7749","requestedsizegib":"5","storage.kubernetes.io/csiProvisionerIdentity":"1633139719760-8081-test.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-7682da56-c79c-4167-bf3e-d2bd59c9f4ab"}
... skipping 50 lines ...
I1002 02:14:50.996810       1 controllerserver.go:389] deleting azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-c4dbfa1d-befe-4648-84db-d2af960b3beb)
I1002 02:14:56.189382       1 azure_managedDiskController.go:286] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-c4dbfa1d-befe-4648-84db-d2af960b3beb
I1002 02:14:56.189410       1 controllerserver.go:391] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-c4dbfa1d-befe-4648-84db-d2af960b3beb) returned with <nil>
I1002 02:14:56.189427       1 utils.go:102] GRPC response: {}
I1002 02:14:59.751579       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 02:14:59.751603       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":10737418240},"name":"pvc-36ca2709-43c4-4204-b46f-b02d860cb817","parameters":{"csi.storage.k8s.io/pv/name":"pvc-36ca2709-43c4-4204-b46f-b02d860cb817","csi.storage.k8s.io/pvc/name":"pvc-azuredisk","csi.storage.k8s.io/pvc/namespace":"default","skuName":"StandardSSD_LRS"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 02:14:59.772225       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-36ca2709-43c4-4204-b46f-b02d860cb817, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-36ca2709-43c4-4204-b46f-b02d860cb817' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 02:14:59.772299       1 controllerserver.go:271] begin to create azure disk(pvc-36ca2709-43c4-4204-b46f-b02d860cb817) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(10) diskZone() maxShares(0)
I1002 02:14:59.772312       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-36ca2709-43c4-4204-b46f-b02d860cb817 StorageAccountType:StandardSSD_LRS Size:10
I1002 02:15:02.123957       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-36ca2709-43c4-4204-b46f-b02d860cb817 StorageAccountType:StandardSSD_LRS Size:10
I1002 02:15:02.124030       1 controllerserver.go:348] create azure disk(pvc-36ca2709-43c4-4204-b46f-b02d860cb817) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(10) tags(map[kubernetes.io-created-for-pv-name:pvc-36ca2709-43c4-4204-b46f-b02d860cb817 kubernetes.io-created-for-pvc-name:pvc-azuredisk kubernetes.io-created-for-pvc-namespace:default]) successfully
I1002 02:15:02.124053       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":10737418240,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-36ca2709-43c4-4204-b46f-b02d860cb817","csi.storage.k8s.io/pvc/name":"pvc-azuredisk","csi.storage.k8s.io/pvc/namespace":"default","requestedsizegib":"10","skuName":"StandardSSD_LRS"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-36ca2709-43c4-4204-b46f-b02d860cb817"}}
I1002 02:15:04.977010       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 3 lines ...
I1002 02:15:05.013838       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-49352361-vmss000001, refreshing the cache
I1002 02:15:05.136047       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-36ca2709-43c4-4204-b46f-b02d860cb817" to node "k8s-agentpool1-49352361-vmss000001"
I1002 02:15:05.136093       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:15:05.136114       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-36ca2709-43c4-4204-b46f-b02d860cb817" lun 0 to node "k8s-agentpool1-49352361-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-36ca2709-43c4-4204-b46f-b02d860cb817:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-36ca2709-43c4-4204-b46f-b02d860cb817  true false 0})]
I1002 02:15:05.136132       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:15:05.136162       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-36ca2709-43c4-4204-b46f-b02d860cb817:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-36ca2709-43c4-4204-b46f-b02d860cb817  true false 0})])
I1002 02:15:05.305222       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-36ca2709-43c4-4204-b46f-b02d860cb817:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-36ca2709-43c4-4204-b46f-b02d860cb817  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1002 02:15:21.680899       1 azure_vmss.go:319] Couldn't find VMSS VM with scaleSetName "k8s-agentpool1-49352361-vmss" and instanceID "1", refreshing the cache
I1002 02:15:55.616837       1 controllerserver.go:465] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-36ca2709-43c4-4204-b46f-b02d860cb817" attached to node "k8s-agentpool1-49352361-vmss000001".
I1002 02:15:55.616872       1 controllerserver.go:485] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-36ca2709-43c4-4204-b46f-b02d860cb817" to node "k8s-agentpool1-49352361-vmss000001" successfully
I1002 02:15:55.616907       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
I1002 02:15:55.627059       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
I1002 02:15:55.627079       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-49352361-vmss000001","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":7}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-36ca2709-43c4-4204-b46f-b02d860cb817","csi.storage.k8s.io/pvc/name":"pvc-azuredisk","csi.storage.k8s.io/pvc/namespace":"default","requestedsizegib":"10","skuName":"StandardSSD_LRS","storage.kubernetes.io/csiProvisionerIdentity":"1633139719760-8081-test.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-36ca2709-43c4-4204-b46f-b02d860cb817"}
I1002 02:15:55.652859       1 controllerserver.go:440] GetDiskLun returned: <nil>. Initiating attaching volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-36ca2709-43c4-4204-b46f-b02d860cb817" to node "k8s-agentpool1-49352361-vmss000001".
I1002 02:15:55.652884       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:15:55.701375       1 azure_controller_common.go:457] azureDisk - find disk: lun 0 name "pvc-36ca2709-43c4-4204-b46f-b02d860cb817" uri "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-36ca2709-43c4-4204-b46f-b02d860cb817"
I1002 02:15:55.701406       1 controllerserver.go:455] Attach operation is successful. volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-36ca2709-43c4-4204-b46f-b02d860cb817" is already attached to node "k8s-agentpool1-49352361-vmss000001" at lun 0.
I1002 02:15:55.701422       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
I1002 02:16:15.471795       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 02:16:15.471820       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":10737418240},"name":"pvc-96dd0098-2491-4d81-bf82-2650a87cfb41","parameters":{"csi.storage.k8s.io/pv/name":"pvc-96dd0098-2491-4d81-bf82-2650a87cfb41","csi.storage.k8s.io/pvc/name":"persistent-storage-statefulset-azuredisk-0","csi.storage.k8s.io/pvc/namespace":"default","skuName":"StandardSSD_LRS"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 02:16:15.492508       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-96dd0098-2491-4d81-bf82-2650a87cfb41, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-96dd0098-2491-4d81-bf82-2650a87cfb41' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 02:16:15.492577       1 controllerserver.go:271] begin to create azure disk(pvc-96dd0098-2491-4d81-bf82-2650a87cfb41) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(10) diskZone() maxShares(0)
I1002 02:16:15.492607       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-96dd0098-2491-4d81-bf82-2650a87cfb41 StorageAccountType:StandardSSD_LRS Size:10
I1002 02:16:17.802208       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-96dd0098-2491-4d81-bf82-2650a87cfb41 StorageAccountType:StandardSSD_LRS Size:10
I1002 02:16:17.802271       1 controllerserver.go:348] create azure disk(pvc-96dd0098-2491-4d81-bf82-2650a87cfb41) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(10) tags(map[kubernetes.io-created-for-pv-name:pvc-96dd0098-2491-4d81-bf82-2650a87cfb41 kubernetes.io-created-for-pvc-name:persistent-storage-statefulset-azuredisk-0 kubernetes.io-created-for-pvc-namespace:default]) successfully
I1002 02:16:17.802292       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":10737418240,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-96dd0098-2491-4d81-bf82-2650a87cfb41","csi.storage.k8s.io/pvc/name":"persistent-storage-statefulset-azuredisk-0","csi.storage.k8s.io/pvc/namespace":"default","requestedsizegib":"10","skuName":"StandardSSD_LRS"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-96dd0098-2491-4d81-bf82-2650a87cfb41"}}
I1002 02:16:19.027466       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 2 lines ...
I1002 02:16:19.052264       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:16:19.052286       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-96dd0098-2491-4d81-bf82-2650a87cfb41" to node "k8s-agentpool1-49352361-vmss000000"
I1002 02:16:19.052304       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:16:19.052317       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-96dd0098-2491-4d81-bf82-2650a87cfb41" lun 0 to node "k8s-agentpool1-49352361-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-96dd0098-2491-4d81-bf82-2650a87cfb41:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-96dd0098-2491-4d81-bf82-2650a87cfb41  true false 0})]
I1002 02:16:19.052334       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:16:19.052350       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-96dd0098-2491-4d81-bf82-2650a87cfb41:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-96dd0098-2491-4d81-bf82-2650a87cfb41  true false 0})])
I1002 02:16:19.221179       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-96dd0098-2491-4d81-bf82-2650a87cfb41:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-96dd0098-2491-4d81-bf82-2650a87cfb41  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1002 02:16:21.795683       1 azure_vmss.go:319] Couldn't find VMSS VM with scaleSetName "k8s-agentpool1-49352361-vmss" and instanceID "0", refreshing the cache
I1002 02:16:34.343428       1 controllerserver.go:465] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-96dd0098-2491-4d81-bf82-2650a87cfb41" attached to node "k8s-agentpool1-49352361-vmss000000".
I1002 02:16:34.343462       1 controllerserver.go:485] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-96dd0098-2491-4d81-bf82-2650a87cfb41" to node "k8s-agentpool1-49352361-vmss000000" successfully
I1002 02:16:34.343496       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
I1002 02:16:34.352829       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
I1002 02:16:34.352850       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-49352361-vmss000000","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":7}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-96dd0098-2491-4d81-bf82-2650a87cfb41","csi.storage.k8s.io/pvc/name":"persistent-storage-statefulset-azuredisk-0","csi.storage.k8s.io/pvc/namespace":"default","requestedsizegib":"10","skuName":"StandardSSD_LRS","storage.kubernetes.io/csiProvisionerIdentity":"1633139719760-8081-test.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-96dd0098-2491-4d81-bf82-2650a87cfb41"}
I1002 02:16:34.393519       1 controllerserver.go:440] GetDiskLun returned: <nil>. Initiating attaching volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-96dd0098-2491-4d81-bf82-2650a87cfb41" to node "k8s-agentpool1-49352361-vmss000000".
I1002 02:16:34.393548       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:16:34.393585       1 azure_controller_common.go:457] azureDisk - find disk: lun 0 name "pvc-96dd0098-2491-4d81-bf82-2650a87cfb41" uri "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-96dd0098-2491-4d81-bf82-2650a87cfb41"
I1002 02:16:34.393597       1 controllerserver.go:455] Attach operation is successful. volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-96dd0098-2491-4d81-bf82-2650a87cfb41" is already attached to node "k8s-agentpool1-49352361-vmss000000" at lun 0.
I1002 02:16:34.393610       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
I1002 02:16:44.813866       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 02:16:44.813946       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":10737418240},"name":"pvc-b490aebe-e0d0-4135-b26d-46f32330bc97","parameters":{"csi.storage.k8s.io/pv/name":"pvc-b490aebe-e0d0-4135-b26d-46f32330bc97","csi.storage.k8s.io/pvc/name":"persistent-storage-statefulset-azuredisk-nonroot-0","csi.storage.k8s.io/pvc/namespace":"default","skuName":"StandardSSD_LRS"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 02:16:44.834535       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-b490aebe-e0d0-4135-b26d-46f32330bc97, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-b490aebe-e0d0-4135-b26d-46f32330bc97' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 02:16:44.834627       1 controllerserver.go:271] begin to create azure disk(pvc-b490aebe-e0d0-4135-b26d-46f32330bc97) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(10) diskZone() maxShares(0)
I1002 02:16:44.834640       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-b490aebe-e0d0-4135-b26d-46f32330bc97 StorageAccountType:StandardSSD_LRS Size:10
I1002 02:16:47.185781       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-b490aebe-e0d0-4135-b26d-46f32330bc97 StorageAccountType:StandardSSD_LRS Size:10
I1002 02:16:47.185841       1 controllerserver.go:348] create azure disk(pvc-b490aebe-e0d0-4135-b26d-46f32330bc97) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(10) tags(map[kubernetes.io-created-for-pv-name:pvc-b490aebe-e0d0-4135-b26d-46f32330bc97 kubernetes.io-created-for-pvc-name:persistent-storage-statefulset-azuredisk-nonroot-0 kubernetes.io-created-for-pvc-namespace:default]) successfully
I1002 02:16:47.185877       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":10737418240,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-b490aebe-e0d0-4135-b26d-46f32330bc97","csi.storage.k8s.io/pvc/name":"persistent-storage-statefulset-azuredisk-nonroot-0","csi.storage.k8s.io/pvc/namespace":"default","requestedsizegib":"10","skuName":"StandardSSD_LRS"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-b490aebe-e0d0-4135-b26d-46f32330bc97"}}
I1002 02:16:48.017108       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 2 lines ...
I1002 02:16:48.041699       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:16:48.041740       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-b490aebe-e0d0-4135-b26d-46f32330bc97" to node "k8s-agentpool1-49352361-vmss000001"
I1002 02:16:48.041776       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:16:48.041789       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-b490aebe-e0d0-4135-b26d-46f32330bc97" lun 1 to node "k8s-agentpool1-49352361-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-b490aebe-e0d0-4135-b26d-46f32330bc97:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-b490aebe-e0d0-4135-b26d-46f32330bc97  true false 1})]
I1002 02:16:48.041812       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:16:48.041828       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-b490aebe-e0d0-4135-b26d-46f32330bc97:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-b490aebe-e0d0-4135-b26d-46f32330bc97  true false 1})])
I1002 02:16:48.236608       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-b490aebe-e0d0-4135-b26d-46f32330bc97:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-b490aebe-e0d0-4135-b26d-46f32330bc97  true false 1})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1002 02:16:58.369355       1 controllerserver.go:465] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-b490aebe-e0d0-4135-b26d-46f32330bc97" attached to node "k8s-agentpool1-49352361-vmss000001".
I1002 02:16:58.369391       1 controllerserver.go:485] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-b490aebe-e0d0-4135-b26d-46f32330bc97" to node "k8s-agentpool1-49352361-vmss000001" successfully
I1002 02:16:58.369427       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"1"}}
I1002 02:17:11.375611       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 02:17:11.375637       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":10737418240},"name":"pvc-d68af62c-171a-4f76-b917-958abf63b1e3","parameters":{"csi.storage.k8s.io/pv/name":"pvc-d68af62c-171a-4f76-b917-958abf63b1e3","csi.storage.k8s.io/pvc/name":"nginx-azuredisk-ephemeral-azuredisk01","csi.storage.k8s.io/pvc/namespace":"default","skuName":"StandardSSD_LRS"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 02:17:11.396471       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-d68af62c-171a-4f76-b917-958abf63b1e3, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-d68af62c-171a-4f76-b917-958abf63b1e3' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 02:17:11.396583       1 controllerserver.go:271] begin to create azure disk(pvc-d68af62c-171a-4f76-b917-958abf63b1e3) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(10) diskZone() maxShares(0)
I1002 02:17:11.396598       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-d68af62c-171a-4f76-b917-958abf63b1e3 StorageAccountType:StandardSSD_LRS Size:10
I1002 02:17:13.738001       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-d68af62c-171a-4f76-b917-958abf63b1e3 StorageAccountType:StandardSSD_LRS Size:10
I1002 02:17:13.738080       1 controllerserver.go:348] create azure disk(pvc-d68af62c-171a-4f76-b917-958abf63b1e3) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(10) tags(map[kubernetes.io-created-for-pv-name:pvc-d68af62c-171a-4f76-b917-958abf63b1e3 kubernetes.io-created-for-pvc-name:nginx-azuredisk-ephemeral-azuredisk01 kubernetes.io-created-for-pvc-namespace:default]) successfully
I1002 02:17:13.738102       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":10737418240,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-d68af62c-171a-4f76-b917-958abf63b1e3","csi.storage.k8s.io/pvc/name":"nginx-azuredisk-ephemeral-azuredisk01","csi.storage.k8s.io/pvc/namespace":"default","requestedsizegib":"10","skuName":"StandardSSD_LRS"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-d68af62c-171a-4f76-b917-958abf63b1e3"}}
I1002 02:17:15.039170       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 2 lines ...
I1002 02:17:15.066823       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:17:15.066877       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-d68af62c-171a-4f76-b917-958abf63b1e3" to node "k8s-agentpool1-49352361-vmss000000"
I1002 02:17:15.066908       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:17:15.066919       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-d68af62c-171a-4f76-b917-958abf63b1e3" lun 1 to node "k8s-agentpool1-49352361-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-d68af62c-171a-4f76-b917-958abf63b1e3:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-d68af62c-171a-4f76-b917-958abf63b1e3  true false 1})]
I1002 02:17:15.066974       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:17:15.066987       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-d68af62c-171a-4f76-b917-958abf63b1e3:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-d68af62c-171a-4f76-b917-958abf63b1e3  true false 1})])
I1002 02:17:15.225848       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-d68af62c-171a-4f76-b917-958abf63b1e3:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-d68af62c-171a-4f76-b917-958abf63b1e3  true false 1})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1002 02:17:21.953285       1 azure_vmss.go:319] Couldn't find VMSS VM with scaleSetName "k8s-agentpool1-49352361-vmss" and instanceID "1", refreshing the cache
I1002 02:17:30.344537       1 controllerserver.go:465] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-d68af62c-171a-4f76-b917-958abf63b1e3" attached to node "k8s-agentpool1-49352361-vmss000000".
I1002 02:17:30.344571       1 controllerserver.go:485] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-d68af62c-171a-4f76-b917-958abf63b1e3" to node "k8s-agentpool1-49352361-vmss000000" successfully
I1002 02:17:30.344591       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"1"}}
I1002 02:17:30.353908       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
I1002 02:17:30.353929       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-49352361-vmss000000","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":7}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-d68af62c-171a-4f76-b917-958abf63b1e3","csi.storage.k8s.io/pvc/name":"nginx-azuredisk-ephemeral-azuredisk01","csi.storage.k8s.io/pvc/namespace":"default","requestedsizegib":"10","skuName":"StandardSSD_LRS","storage.kubernetes.io/csiProvisionerIdentity":"1633139719760-8081-test.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-d68af62c-171a-4f76-b917-958abf63b1e3"}
... skipping 3 lines ...
I1002 02:17:30.378998       1 controllerserver.go:455] Attach operation is successful. volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-d68af62c-171a-4f76-b917-958abf63b1e3" is already attached to node "k8s-agentpool1-49352361-vmss000000" at lun 1.
I1002 02:17:30.379010       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"1"}}
I1002 02:17:35.373936       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 02:17:35.373954       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1002 02:17:35.373969       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":10737418240},"name":"pvc-a1c8ac9f-4f0c-4de7-ba0e-5e32eb9faec2","parameters":{"csi.storage.k8s.io/pv/name":"pvc-a1c8ac9f-4f0c-4de7-ba0e-5e32eb9faec2","csi.storage.k8s.io/pvc/name":"daemonset-azuredisk-ephemeral-pbhj5-azuredisk","csi.storage.k8s.io/pvc/namespace":"default","skuName":"StandardSSD_LRS"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 02:17:35.373962       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":10737418240},"name":"pvc-c82288f3-28ea-43ef-9a14-5dfae05df932","parameters":{"csi.storage.k8s.io/pv/name":"pvc-c82288f3-28ea-43ef-9a14-5dfae05df932","csi.storage.k8s.io/pvc/name":"daemonset-azuredisk-ephemeral-d7pnf-azuredisk","csi.storage.k8s.io/pvc/namespace":"default","skuName":"StandardSSD_LRS"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1002 02:17:35.398018       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a1c8ac9f-4f0c-4de7-ba0e-5e32eb9faec2, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-a1c8ac9f-4f0c-4de7-ba0e-5e32eb9faec2' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 02:17:35.398098       1 controllerserver.go:271] begin to create azure disk(pvc-a1c8ac9f-4f0c-4de7-ba0e-5e32eb9faec2) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(10) diskZone() maxShares(0)
I1002 02:17:35.398150       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-a1c8ac9f-4f0c-4de7-ba0e-5e32eb9faec2 StorageAccountType:StandardSSD_LRS Size:10
I1002 02:17:35.421805       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-c82288f3-28ea-43ef-9a14-5dfae05df932, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-c82288f3-28ea-43ef-9a14-5dfae05df932' under resource group 'kubetest-croyzaob' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1002 02:17:35.421899       1 controllerserver.go:271] begin to create azure disk(pvc-c82288f3-28ea-43ef-9a14-5dfae05df932) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(10) diskZone() maxShares(0)
I1002 02:17:35.421910       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-c82288f3-28ea-43ef-9a14-5dfae05df932 StorageAccountType:StandardSSD_LRS Size:10
I1002 02:17:37.878633       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-c82288f3-28ea-43ef-9a14-5dfae05df932 StorageAccountType:StandardSSD_LRS Size:10
I1002 02:17:37.878698       1 controllerserver.go:348] create azure disk(pvc-c82288f3-28ea-43ef-9a14-5dfae05df932) account type(StandardSSD_LRS) rg(kubetest-croyzaob) location() size(10) tags(map[kubernetes.io-created-for-pv-name:pvc-c82288f3-28ea-43ef-9a14-5dfae05df932 kubernetes.io-created-for-pvc-name:daemonset-azuredisk-ephemeral-d7pnf-azuredisk kubernetes.io-created-for-pvc-namespace:default]) successfully
I1002 02:17:37.878776       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":10737418240,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-c82288f3-28ea-43ef-9a14-5dfae05df932","csi.storage.k8s.io/pvc/name":"daemonset-azuredisk-ephemeral-d7pnf-azuredisk","csi.storage.k8s.io/pvc/namespace":"default","requestedsizegib":"10","skuName":"StandardSSD_LRS"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-c82288f3-28ea-43ef-9a14-5dfae05df932"}}
I1002 02:17:37.973941       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-a1c8ac9f-4f0c-4de7-ba0e-5e32eb9faec2 StorageAccountType:StandardSSD_LRS Size:10
... skipping 5 lines ...
I1002 02:17:39.047889       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:17:39.047912       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a1c8ac9f-4f0c-4de7-ba0e-5e32eb9faec2" to node "k8s-agentpool1-49352361-vmss000001"
I1002 02:17:39.047947       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:17:39.047981       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-a1c8ac9f-4f0c-4de7-ba0e-5e32eb9faec2" lun 2 to node "k8s-agentpool1-49352361-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-a1c8ac9f-4f0c-4de7-ba0e-5e32eb9faec2:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-a1c8ac9f-4f0c-4de7-ba0e-5e32eb9faec2  true false 2})]
I1002 02:17:39.047997       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:17:39.048013       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-a1c8ac9f-4f0c-4de7-ba0e-5e32eb9faec2:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-a1c8ac9f-4f0c-4de7-ba0e-5e32eb9faec2  true false 2})])
I1002 02:17:39.200052       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-a1c8ac9f-4f0c-4de7-ba0e-5e32eb9faec2:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-a1c8ac9f-4f0c-4de7-ba0e-5e32eb9faec2  true false 2})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1002 02:17:40.026586       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
I1002 02:17:40.026631       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-49352361-vmss000000","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":7}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-c82288f3-28ea-43ef-9a14-5dfae05df932","csi.storage.k8s.io/pvc/name":"daemonset-azuredisk-ephemeral-d7pnf-azuredisk","csi.storage.k8s.io/pvc/namespace":"default","requestedsizegib":"10","skuName":"StandardSSD_LRS","storage.kubernetes.io/csiProvisionerIdentity":"1633139719760-8081-test.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-c82288f3-28ea-43ef-9a14-5dfae05df932"}
I1002 02:17:40.061149       1 controllerserver.go:440] GetDiskLun returned: <nil>. Initiating attaching volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-c82288f3-28ea-43ef-9a14-5dfae05df932" to node "k8s-agentpool1-49352361-vmss000000".
I1002 02:17:40.061209       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:17:40.061236       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-c82288f3-28ea-43ef-9a14-5dfae05df932" to node "k8s-agentpool1-49352361-vmss000000"
I1002 02:17:40.061269       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:17:40.061286       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-c82288f3-28ea-43ef-9a14-5dfae05df932" lun 2 to node "k8s-agentpool1-49352361-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-c82288f3-28ea-43ef-9a14-5dfae05df932:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-c82288f3-28ea-43ef-9a14-5dfae05df932  true false 2})]
I1002 02:17:40.061308       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-49352361-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1002 02:17:40.061323       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-c82288f3-28ea-43ef-9a14-5dfae05df932:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-c82288f3-28ea-43ef-9a14-5dfae05df932  true false 2})])
I1002 02:17:40.217148       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-croyzaob): vm(k8s-agentpool1-49352361-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-croyzaob/providers/microsoft.compute/disks/pvc-c82288f3-28ea-43ef-9a14-5dfae05df932:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-c82288f3-28ea-43ef-9a14-5dfae05df932  true false 2})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1002 02:17:55.400294       1 controllerserver.go:465] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-c82288f3-28ea-43ef-9a14-5dfae05df932" attached to node "k8s-agentpool1-49352361-vmss000000".
I1002 02:17:55.400353       1 controllerserver.go:485] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-c82288f3-28ea-43ef-9a14-5dfae05df932" to node "k8s-agentpool1-49352361-vmss000000" successfully
I1002 02:17:55.400372       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"2"}}
I1002 02:17:55.408955       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
I1002 02:17:55.408976       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-49352361-vmss000000","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":7}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-c82288f3-28ea-43ef-9a14-5dfae05df932","csi.storage.k8s.io/pvc/name":"daemonset-azuredisk-ephemeral-d7pnf-azuredisk","csi.storage.k8s.io/pvc/namespace":"default","requestedsizegib":"10","skuName":"StandardSSD_LRS","storage.kubernetes.io/csiProvisionerIdentity":"1633139719760-8081-test.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-c82288f3-28ea-43ef-9a14-5dfae05df932"}
I1002 02:17:55.456350       1 controllerserver.go:440] GetDiskLun returned: <nil>. Initiating attaching volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-c82288f3-28ea-43ef-9a14-5dfae05df932" to node "k8s-agentpool1-49352361-vmss000000".
... skipping 20 lines ...
Platform: linux/amd64
Topology Key: topology.test.csi.azure.com/zone

Streaming logs below:
I1002 01:55:19.323445       1 azuredisk.go:139] driver userAgent: test.csi.azure.com/v1.8.0-30279da837c543c1cc083aa2b7b1e62b5b25f83a gc/go1.17.1 (amd64-linux) e2e-test
I1002 01:55:19.324598       1 azure_disk_utils.go:137] reading cloud config from secret kube-system/azure-cloud-provider
W1002 01:55:19.413390       1 azure_disk_utils.go:144] InitializeCloudFromSecret: failed to get cloud config from secret kube-system/azure-cloud-provider: failed to get secret kube-system/azure-cloud-provider: secrets "azure-cloud-provider" not found
I1002 01:55:19.413415       1 azure_disk_utils.go:149] could not read cloud config from secret kube-system/azure-cloud-provider
I1002 01:55:19.413441       1 azure_disk_utils.go:159] use default AZURE_CREDENTIAL_FILE env var: /etc/kubernetes/azure.json
I1002 01:55:19.413483       1 azure_disk_utils.go:167] read cloud config from file: /etc/kubernetes/azure.json successfully
I1002 01:55:19.414234       1 azure_auth.go:234] Using AzurePublicCloud environment
I1002 01:55:19.414259       1 azure_auth.go:96] azure: using managed identity extension to retrieve access token
I1002 01:55:19.414263       1 azure_auth.go:102] azure: using User Assigned MSI ID to retrieve access token
... skipping 102 lines ...
Platform: linux/amd64
Topology Key: topology.test.csi.azure.com/zone

Streaming logs below:
I1002 01:55:13.015019       1 azuredisk.go:139] driver userAgent: test.csi.azure.com/v1.8.0-30279da837c543c1cc083aa2b7b1e62b5b25f83a gc/go1.17.1 (amd64-linux) e2e-test
I1002 01:55:13.016011       1 azure_disk_utils.go:137] reading cloud config from secret kube-system/azure-cloud-provider
W1002 01:55:13.037074       1 azure_disk_utils.go:144] InitializeCloudFromSecret: failed to get cloud config from secret kube-system/azure-cloud-provider: failed to get secret kube-system/azure-cloud-provider: secrets "azure-cloud-provider" not found
I1002 01:55:13.037099       1 azure_disk_utils.go:149] could not read cloud config from secret kube-system/azure-cloud-provider
I1002 01:55:13.037106       1 azure_disk_utils.go:159] use default AZURE_CREDENTIAL_FILE env var: /etc/kubernetes/azure.json
I1002 01:55:13.037127       1 azure_disk_utils.go:167] read cloud config from file: /etc/kubernetes/azure.json successfully
I1002 01:55:13.037875       1 azure_auth.go:234] Using AzurePublicCloud environment
I1002 01:55:13.037895       1 azure_auth.go:96] azure: using managed identity extension to retrieve access token
I1002 01:55:13.037899       1 azure_auth.go:102] azure: using User Assigned MSI ID to retrieve access token
... skipping 325 lines ...
I1002 01:58:22.504875       1 utils.go:96] GRPC request: {"publish_context":{"LUN":"19"},"staging_target_path":"/var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-84c060cf-7773-4d64-91d9-ba52b03d8f32/globalmount","target_path":"/var/lib/kubelet/pods/3de04288-bc99-4593-992b-c86f15d2bf76/volumes/kubernetes.io~csi/pvc-84c060cf-7773-4d64-91d9-ba52b03d8f32/mount","volume_capability":{"AccessType":{"Mount":{}},"access_mode":{"mode":7}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-84c060cf-7773-4d64-91d9-ba52b03d8f32","csi.storage.k8s.io/pvc/name":"pvc-rh726","csi.storage.k8s.io/pvc/namespace":"volumelimits-2321","requestedsizegib":"5","storage.kubernetes.io/csiProvisionerIdentity":"1633139719760-8081-test.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-84c060cf-7773-4d64-91d9-ba52b03d8f32"}
I1002 01:58:22.505065       1 nodeserver.go:262] NodePublishVolume: mounting /var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-84c060cf-7773-4d64-91d9-ba52b03d8f32/globalmount at /var/lib/kubelet/pods/3de04288-bc99-4593-992b-c86f15d2bf76/volumes/kubernetes.io~csi/pvc-84c060cf-7773-4d64-91d9-ba52b03d8f32/mount
I1002 01:58:22.505084       1 mount_linux.go:175] Mounting cmd (mount) with arguments ( -o bind /var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-84c060cf-7773-4d64-91d9-ba52b03d8f32/globalmount /var/lib/kubelet/pods/3de04288-bc99-4593-992b-c86f15d2bf76/volumes/kubernetes.io~csi/pvc-84c060cf-7773-4d64-91d9-ba52b03d8f32/mount)
I1002 01:58:22.507152       1 mount_linux.go:175] Mounting cmd (mount) with arguments ( -o bind,remount /var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-84c060cf-7773-4d64-91d9-ba52b03d8f32/globalmount /var/lib/kubelet/pods/3de04288-bc99-4593-992b-c86f15d2bf76/volumes/kubernetes.io~csi/pvc-84c060cf-7773-4d64-91d9-ba52b03d8f32/mount)
I1002 01:58:22.508810       1 nodeserver.go:267] NodePublishVolume: mount /var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-84c060cf-7773-4d64-91d9-ba52b03d8f32/globalmount at /var/lib/kubelet/pods/3de04288-bc99-4593-992b-c86f15d2bf76/volumes/kubernetes.io~csi/pvc-84c060cf-7773-4d64-91d9-ba52b03d8f32/mount successfully
I1002 01:58:22.508832       1 utils.go:102] GRPC response: {}
W1002 01:58:22.553960       1 azure_common_linux.go:180] azureDisk - getDiskLinkByDevName by sdh under /dev/disk/azure/scsi1/ failed, error: device name(sdh) is not found under /dev/disk/azure/scsi1/
W1002 01:58:22.554123       1 azure_common_linux.go:180] azureDisk - getDiskLinkByDevName by sdh under /dev/disk/by-id/ failed, error: device name(sdh) is not found under /dev/disk/by-id/
I1002 01:58:22.554175       1 nodeserver.go:111] NodeStageVolume: perf optimization is disabled for /dev/sdh. perfProfile none accountType 
I1002 01:58:22.554209       1 nodeserver.go:152] NodeStageVolume: formatting /dev/sdh and mounting at /var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-b1972d9d-bb37-4c10-a40c-b1b298200e4a/globalmount with mount options([])
I1002 01:58:22.554219       1 mount_linux.go:446] Attempting to determine if disk "/dev/sdh" is formatted using blkid with args: ([-p -s TYPE -s PTTYPE -o export /dev/sdh])
I1002 01:58:22.598145       1 mount_linux.go:449] Output: ""
I1002 01:58:22.598185       1 mount_linux.go:408] Disk "/dev/sdh" appears to be unformatted, attempting to format as type: "ext4" with options: [-F -m0 /dev/sdh]
I1002 01:58:23.035667       1 azure_common_linux.go:177] azureDisk - found /dev/disk/azure/scsi1/lun26 by sdg under /dev/disk/azure/scsi1/
... skipping 79 lines ...
I1002 01:58:24.258351       1 utils.go:96] GRPC request: {"publish_context":{"LUN":"25"},"staging_target_path":"/var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-ac8ee304-85fd-461e-95e4-fd453165f879/globalmount","target_path":"/var/lib/kubelet/pods/3de04288-bc99-4593-992b-c86f15d2bf76/volumes/kubernetes.io~csi/pvc-ac8ee304-85fd-461e-95e4-fd453165f879/mount","volume_capability":{"AccessType":{"Mount":{}},"access_mode":{"mode":7}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-ac8ee304-85fd-461e-95e4-fd453165f879","csi.storage.k8s.io/pvc/name":"pvc-zsdb8","csi.storage.k8s.io/pvc/namespace":"volumelimits-2321","requestedsizegib":"5","storage.kubernetes.io/csiProvisionerIdentity":"1633139719760-8081-test.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-croyzaob/providers/Microsoft.Compute/disks/pvc-ac8ee304-85fd-461e-95e4-fd453165f879"}
I1002 01:58:24.258547       1 nodeserver.go:262] NodePublishVolume: mounting /var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-ac8ee304-85fd-461e-95e4-fd453165f879/globalmount at /var/lib/kubelet/pods/3de04288-bc99-4593-992b-c86f15d2bf76/volumes/kubernetes.io~csi/pvc-ac8ee304-85fd-461e-95e4-fd453165f879/mount
I1002 01:58:24.258569       1 mount_linux.go:175] Mounting cmd (mount) with arguments ( -o bind /var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-ac8ee304-85fd-461e-95e4-fd453165f879/globalmount /var/lib/kubelet/pods/3de04288-bc99-4593-992b-c86f15d2bf76/volumes/kubernetes.io~csi/pvc-ac8ee304-85fd-461e-95e4-fd453165f879/mount)
I1002 01:58:24.260306       1 mount_linux.go:175] Mounting cmd (mount) with arguments ( -o bind,remount /var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-ac8ee304-85fd-461e-95e4-fd453165f879/globalmount /var/lib/kubelet/pods/3de04288-bc99-4593-992b-c86f15d2bf76/volumes/kubernetes.io~csi/pvc-ac8ee304-85fd-461e-95e4-fd453165f879/mount)
I1002 01:58:24.261801       1 nodeserver.go:267] NodePublishVolume: mount /var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-ac8ee304-85fd-461e-95e4-fd453165f879/globalmount at /var/lib/kubelet/pods/3de04288-bc99-4593-992b-c86f15d2bf76/volumes/kubernetes.io~csi/pvc-ac8ee304-85fd-461e-95e4-fd453165f879/mount successfully
I1002 01:58:24.261837       1 utils.go:102] GRPC response: {}
W1002 01:58:24.271748       1 azure_common_linux.go:180] azureDisk - getDiskLinkByDevName by sdm under /dev/disk/azure/scsi1/ failed, error: device name(sdm) is not found under /dev/disk/azure/scsi1/
W1002 01:58:24.271949       1 azure_common_linux.go:180] azureDisk - getDiskLinkByDevName by sdm under /dev/disk/by-id/ failed, error: device name(sdm) is not found under /dev/disk/by-id/
I1002 01:58:24.271981       1 nodeserver.go:111] NodeStageVolume: perf optimization is disabled for /dev/sdm. perfProfile none accountType 
I1002 01:58:24.272004       1 nodeserver.go:152] NodeStageVolume: formatting /dev/sdm and mounting at /var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-a6f40584-cccb-4097-b8c5-d0043ebf7e12/globalmount with mount options([])
I1002 01:58:24.272022       1 mount_linux.go:446] Attempting to determine if disk "/dev/sdm" is formatted using blkid with args: ([-p -s TYPE -s PTTYPE -o export /dev/sdm])
I1002 01:58:24.298647       1 mount_linux.go:449] Output: ""
I1002 01:58:24.298675       1 mount_linux.go:408] Disk "/dev/sdm" appears to be unformatted, attempting to format as type: "ext4" with options: [-F -m0 /dev/sdm]
I1002 01:58:24.726330       1 azure_common_linux.go:177] azureDisk - found /dev/disk/azure/scsi1/lun10 by sdl under /dev/disk/azure/scsi1/
... skipping 318 lines ...
I1002 01:58:31.614621       1 mount_linux.go:175] Mounting cmd (mount) with arguments ( -o bind,remount /var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-269327bc-6ff3-4a73-ad55-7bd80c06e321/globalmount /var/lib/kubelet/pods/3de04288-bc99-4593-992b-c86f15d2bf76/volumes/kubernetes.io~csi/pvc-269327bc-6ff3-4a73-ad55-7bd80c06e321/mount)
I1002 01:58:31.614829       1 mount_linux.go:175] Mounting cmd (mount) with arguments ( -o bind,remount /var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-ec5cb6d2-2a40-4f38-8af1-bdde74d41daf/globalmount /var/lib/kubelet/pods/3de04288-bc99-4593-992b-c86f15d2bf76/volumes/kubernetes.io~csi/pvc-ec5cb6d2-2a40-4f38-8af1-bdde74d41daf/mount)
I1002 01:58:31.616039       1 nodeserver.go:267] NodePublishVolume: mount /var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-269327bc-6ff3-4a73-ad55-7bd80c06e321/globalmount at /var/lib/kubelet/pods/3de04288-bc99-4593-992b-c86f15d2bf76/volumes/kubernetes.io~csi/pvc-269327bc-6ff3-4a73-ad55-7bd80c06e321/mount successfully
I1002 01:58:31.616071       1 utils.go:102] GRPC response: {}
I1002 01:58:31.616366       1 nodeserver.go:267] NodePublishVolume: mount /var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-ec5cb6d2-2a40-4f38-8af1-bdde74d41daf/globalmount at /var/lib/kubelet/pods/3de04288-bc99-4593-992b-c86f15d2bf76/volumes/kubernetes.io~csi/pvc-ec5cb6d2-2a40-4f38-8af1-bdde74d41daf/mount successfully
I1002 01:58:31.616390       1 utils.go:102] GRPC response: {}
W1002 01:58:31.761996       1 azure_common_linux.go:180] azureDisk - getDiskLinkByDevName by sdae under /dev/disk/azure/scsi1/ failed, error: device name(sdae) is not found under /dev/disk/azure/scsi1/
W1002 01:58:31.762461       1 azure_common_linux.go:180] azureDisk - getDiskLinkByDevName by sdae under /dev/disk/by-id/ failed, error: device name(sdae) is not found under /dev/disk/by-id/
I1002 01:58:31.762494       1 nodeserver.go:111] NodeStageVolume: perf optimization is disabled for /dev/sdae. perfProfile none accountType 
I1002 01:58:31.762520       1 nodeserver.go:152] NodeStageVolume: formatting /dev/sdae and mounting at /var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-8b9b0f93-30e4-46dd-aeb1-c4bb38a4b9c9/globalmount with mount options([])
I1002 01:58:31.762536       1 mount_linux.go:446] Attempting to determine if disk "/dev/sdae" is formatted using blkid with args: ([-p -s TYPE -s PTTYPE -o export /dev/sdae])
I1002 01:58:31.783922       1 mount_linux.go:449] Output: ""
I1002 01:58:31.783948       1 mount_linux.go:408] Disk "/dev/sdae" appears to be unformatted, attempting to format as type: "ext4" with options: [-F -m0 /dev/sdae]
I1002 01:58:31.793936       1 azure_common_linux.go:177] azureDisk - found /dev/disk/azure/scsi1/lun22 by sdad under /dev/disk/azure/scsi1/
... skipping 1038 lines ...
Platform: linux/amd64
Topology Key: topology.test.csi.azure.com/zone

Streaming logs below:
I1002 01:55:11.604335       1 azuredisk.go:139] driver userAgent: test.csi.azure.com/v1.8.0-30279da837c543c1cc083aa2b7b1e62b5b25f83a gc/go1.17.1 (amd64-linux) e2e-test
I1002 01:55:11.605402       1 azure_disk_utils.go:137] reading cloud config from secret kube-system/azure-cloud-provider
W1002 01:55:11.697771       1 azure_disk_utils.go:144] InitializeCloudFromSecret: failed to get cloud config from secret kube-system/azure-cloud-provider: failed to get secret kube-system/azure-cloud-provider: secrets "azure-cloud-provider" not found
I1002 01:55:11.697795       1 azure_disk_utils.go:149] could not read cloud config from secret kube-system/azure-cloud-provider
I1002 01:55:11.697803       1 azure_disk_utils.go:159] use default AZURE_CREDENTIAL_FILE env var: /etc/kubernetes/azure.json
I1002 01:55:11.697825       1 azure_disk_utils.go:167] read cloud config from file: /etc/kubernetes/azure.json successfully
I1002 01:55:11.698438       1 azure_auth.go:234] Using AzurePublicCloud environment
I1002 01:55:11.698459       1 azure_auth.go:96] azure: using managed identity extension to retrieve access token
I1002 01:55:11.698464       1 azure_auth.go:102] azure: using User Assigned MSI ID to retrieve access token
... skipping 1028 lines ...
Platform: linux/amd64
Topology Key: topology.test.csi.azure.com/zone

Streaming logs below:
I1002 01:55:06.264448       1 azuredisk.go:139] driver userAgent: test.csi.azure.com/v1.8.0-30279da837c543c1cc083aa2b7b1e62b5b25f83a gc/go1.17.1 (amd64-linux) e2e-test
I1002 01:55:06.331242       1 azure_disk_utils.go:137] reading cloud config from secret kube-system/azure-cloud-provider
W1002 01:55:06.353183       1 azure_disk_utils.go:144] InitializeCloudFromSecret: failed to get cloud config from secret kube-system/azure-cloud-provider: failed to get secret kube-system/azure-cloud-provider: secrets "azure-cloud-provider" not found
I1002 01:55:06.353206       1 azure_disk_utils.go:149] could not read cloud config from secret kube-system/azure-cloud-provider
I1002 01:55:06.353212       1 azure_disk_utils.go:159] use default AZURE_CREDENTIAL_FILE env var: /etc/kubernetes/azure.json
I1002 01:55:06.353231       1 azure_disk_utils.go:167] read cloud config from file: /etc/kubernetes/azure.json successfully
I1002 01:55:06.353856       1 azure_auth.go:234] Using AzurePublicCloud environment
I1002 01:55:06.353899       1 azure_auth.go:96] azure: using managed identity extension to retrieve access token
I1002 01:55:06.353904       1 azure_auth.go:102] azure: using User Assigned MSI ID to retrieve access token
... skipping 175 lines ...
# HELP process_virtual_memory_bytes Virtual memory size in bytes.
# TYPE process_virtual_memory_bytes gauge
process_virtual_memory_bytes 7.62544128e+08
# HELP process_virtual_memory_max_bytes Maximum amount of virtual memory available in bytes.
# TYPE process_virtual_memory_max_bytes gauge
process_virtual_memory_max_bytes -1
make: *** [Makefile:254: e2e-test] Error 1
2021/10/02 02:18:22 process.go:155: Step 'make e2e-test' finished in 33m54.629696489s
2021/10/02 02:18:22 aksengine_helpers.go:425: downloading /root/tmp1996108316/log-dump.sh from https://raw.githubusercontent.com/kubernetes-sigs/cloud-provider-azure/master/hack/log-dump/log-dump.sh
2021/10/02 02:18:22 util.go:68: curl https://raw.githubusercontent.com/kubernetes-sigs/cloud-provider-azure/master/hack/log-dump/log-dump.sh
2021/10/02 02:18:22 process.go:153: Running: chmod +x /root/tmp1996108316/log-dump.sh
2021/10/02 02:18:22 process.go:155: Step 'chmod +x /root/tmp1996108316/log-dump.sh' finished in 2.08143ms
2021/10/02 02:18:22 aksengine_helpers.go:425: downloading /root/tmp1996108316/log-dump-daemonset.yaml from https://raw.githubusercontent.com/kubernetes-sigs/cloud-provider-azure/master/hack/log-dump/log-dump-daemonset.yaml
... skipping 53 lines ...
ssh key file /root/.ssh/id_rsa does not exist. Exiting.
2021/10/02 02:19:12 process.go:155: Step 'bash -c /root/tmp1996108316/win-ci-logs-collector.sh kubetest-croyzaob.westeurope.cloudapp.azure.com /root/tmp1996108316 /root/.ssh/id_rsa' finished in 3.61462ms
2021/10/02 02:19:12 aksengine.go:1141: Deleting resource group: kubetest-croyzaob.
2021/10/02 02:26:21 process.go:96: Saved XML output to /logs/artifacts/junit_runner.xml.
2021/10/02 02:26:21 process.go:153: Running: bash -c . hack/lib/version.sh && KUBE_ROOT=. kube::version::get_version_vars && echo "${KUBE_GIT_VERSION-}"
2021/10/02 02:26:22 process.go:155: Step 'bash -c . hack/lib/version.sh && KUBE_ROOT=. kube::version::get_version_vars && echo "${KUBE_GIT_VERSION-}"' finished in 257.126477ms
2021/10/02 02:26:22 main.go:331: Something went wrong: encountered 1 errors: [error during make e2e-test: exit status 2]
+ EXIT_VALUE=1
+ set +o xtrace
Cleaning up after docker in docker.
================================================================================
Cleaning up after docker
3ddabc7ba3a8
... skipping 4 lines ...