This job view page is being replaced by Spyglass soon. Check out the new job view.
PRandyzhangx: test: enable volume expand tests
ResultFAILURE
Tests 1 failed / 11 succeeded
Started2021-10-05 15:16
Elapsed55m31s
Revision757ebbff15f373724fd27fb477cb3f3753f69d1f
Refs 1040
job-versionv1.23.0-alpha.3.150+c91f9bdc609697
kubetest-version
revisionv1.23.0-alpha.3.150+c91f9bdc609697

Test Failures


kubetest Test 42m35s

error during make e2e-test: exit status 2
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 11 Passed Tests

Error lines from build-log.txt

... skipping 222 lines ...

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100 11248  100 11248    0     0   186k      0 --:--:-- --:--:-- --:--:--  186k
Downloading https://get.helm.sh/helm-v3.7.0-linux-amd64.tar.gz
Verifying checksum... Done.
Preparing to install helm into /usr/local/bin
helm installed into /usr/local/bin/helm
docker pull k8sprow.azurecr.io/azuredisk-csi:v1.8.0-8412a9b9582277d9ca97974b5d2601e9b23694a4 || make container-all push-manifest
Error response from daemon: manifest for k8sprow.azurecr.io/azuredisk-csi:v1.8.0-8412a9b9582277d9ca97974b5d2601e9b23694a4 not found: manifest unknown: manifest tagged by "v1.8.0-8412a9b9582277d9ca97974b5d2601e9b23694a4" is not found
make[2]: Entering directory '/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver'
CGO_ENABLED=0 GOOS=windows go build -a -ldflags "-X sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk.driverVersion=v1.8.0-8412a9b9582277d9ca97974b5d2601e9b23694a4 -X sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk.gitCommit=8412a9b9582277d9ca97974b5d2601e9b23694a4 -X sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk.buildDate=2021-10-05T15:21:55Z -extldflags "-static""  -mod vendor -o _output/amd64/azurediskplugin.exe ./pkg/azurediskplugin
docker buildx rm container-builder || true
error: no builder "container-builder" found
docker buildx create --use --name=container-builder
container-builder
# enable qemu for arm64 build
# https://github.com/docker/buildx/issues/464#issuecomment-741507760
docker run --privileged --rm tonistiigi/binfmt --uninstall qemu-aarch64
Unable to find image 'tonistiigi/binfmt:latest' locally
... skipping 1781 lines ...
                    type: string
                type: object
                oneOf:
                - required: ["persistentVolumeClaimName"]
                - required: ["volumeSnapshotContentName"]
              volumeSnapshotClassName:
                description: 'VolumeSnapshotClassName is the name of the VolumeSnapshotClass requested by the VolumeSnapshot. VolumeSnapshotClassName may be left nil to indicate that the default SnapshotClass should be used. A given cluster may have multiple default Volume SnapshotClasses: one default per CSI Driver. If a VolumeSnapshot does not specify a SnapshotClass, VolumeSnapshotSource will be checked to figure out what the associated CSI Driver is, and the default VolumeSnapshotClass associated with that CSI Driver will be used. If more than one VolumeSnapshotClass exist for a given CSI Driver and more than one have been marked as default, CreateSnapshot will fail and generate an event. Empty string is not allowed for this field.'
                type: string
            required:
            - source
            type: object
          status:
            description: status represents the current information of a snapshot. Consumers must verify binding between VolumeSnapshot and VolumeSnapshotContent objects is successful (by validating that both VolumeSnapshot and VolumeSnapshotContent point at each other) before using this object.
... skipping 2 lines ...
                description: 'boundVolumeSnapshotContentName is the name of the VolumeSnapshotContent object to which this VolumeSnapshot object intends to bind to. If not specified, it indicates that the VolumeSnapshot object has not been successfully bound to a VolumeSnapshotContent object yet. NOTE: To avoid possible security issues, consumers must verify binding between VolumeSnapshot and VolumeSnapshotContent objects is successful (by validating that both VolumeSnapshot and VolumeSnapshotContent point at each other) before using this object.'
                type: string
              creationTime:
                description: creationTime is the timestamp when the point-in-time snapshot is taken by the underlying storage system. In dynamic snapshot creation case, this field will be filled in by the snapshot controller with the "creation_time" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "creation_time" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it. If not specified, it may indicate that the creation time of the snapshot is unknown.
                format: date-time
                type: string
              error:
                description: error is the last observed error during snapshot creation, if any. This field could be helpful to upper level controllers(i.e., application controller) to decide whether they should continue on waiting for the snapshot to be created based on the type of error reported. The snapshot controller will keep retrying when an error occurrs during the snapshot creation. Upon success, this error field will be cleared.
                properties:
                  message:
                    description: 'message is a string detailing the encountered error during snapshot creation if specified. NOTE: message may be logged, and it should not contain sensitive information.'
                    type: string
                  time:
                    description: time is the timestamp when the error was encountered.
                    format: date-time
                    type: string
                type: object
              readyToUse:
                description: readyToUse indicates if the snapshot is ready to be used to restore a volume. In dynamic snapshot creation case, this field will be filled in by the snapshot controller with the "ready_to_use" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "ready_to_use" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it, otherwise, this field will be set to "True". If not specified, it means the readiness of a snapshot is unknown.
                type: boolean
              restoreSize:
                type: string
                description: restoreSize represents the minimum size of volume required to create a volume from this snapshot. In dynamic snapshot creation case, this field will be filled in by the snapshot controller with the "size_bytes" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "size_bytes" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it. When restoring a volume from this snapshot, the size of the volume MUST NOT be smaller than the restoreSize if it is specified, otherwise the restoration will fail. If not specified, it indicates that the size is unknown.
                pattern: ^(\+|-)?(([0-9]+(\.[0-9]*)?)|(\.[0-9]+))(([KMGTPE]i)|[numkMGTPE]|([eE](\+|-)?(([0-9]+(\.[0-9]*)?)|(\.[0-9]+))))?$
                x-kubernetes-int-or-string: true
            type: object
        required:
        - spec
        type: object
... skipping 60 lines ...
                    type: string
                  volumeSnapshotContentName:
                    description: volumeSnapshotContentName specifies the name of a pre-existing VolumeSnapshotContent object representing an existing volume snapshot. This field should be set if the snapshot already exists and only needs a representation in Kubernetes. This field is immutable.
                    type: string
                type: object
              volumeSnapshotClassName:
                description: 'VolumeSnapshotClassName is the name of the VolumeSnapshotClass requested by the VolumeSnapshot. VolumeSnapshotClassName may be left nil to indicate that the default SnapshotClass should be used. A given cluster may have multiple default Volume SnapshotClasses: one default per CSI Driver. If a VolumeSnapshot does not specify a SnapshotClass, VolumeSnapshotSource will be checked to figure out what the associated CSI Driver is, and the default VolumeSnapshotClass associated with that CSI Driver will be used. If more than one VolumeSnapshotClass exist for a given CSI Driver and more than one have been marked as default, CreateSnapshot will fail and generate an event. Empty string is not allowed for this field.'
                type: string
            required:
            - source
            type: object
          status:
            description: status represents the current information of a snapshot. Consumers must verify binding between VolumeSnapshot and VolumeSnapshotContent objects is successful (by validating that both VolumeSnapshot and VolumeSnapshotContent point at each other) before using this object.
... skipping 2 lines ...
                description: 'boundVolumeSnapshotContentName is the name of the VolumeSnapshotContent object to which this VolumeSnapshot object intends to bind to. If not specified, it indicates that the VolumeSnapshot object has not been successfully bound to a VolumeSnapshotContent object yet. NOTE: To avoid possible security issues, consumers must verify binding between VolumeSnapshot and VolumeSnapshotContent objects is successful (by validating that both VolumeSnapshot and VolumeSnapshotContent point at each other) before using this object.'
                type: string
              creationTime:
                description: creationTime is the timestamp when the point-in-time snapshot is taken by the underlying storage system. In dynamic snapshot creation case, this field will be filled in by the snapshot controller with the "creation_time" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "creation_time" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it. If not specified, it may indicate that the creation time of the snapshot is unknown.
                format: date-time
                type: string
              error:
                description: error is the last observed error during snapshot creation, if any. This field could be helpful to upper level controllers(i.e., application controller) to decide whether they should continue on waiting for the snapshot to be created based on the type of error reported. The snapshot controller will keep retrying when an error occurrs during the snapshot creation. Upon success, this error field will be cleared.
                properties:
                  message:
                    description: 'message is a string detailing the encountered error during snapshot creation if specified. NOTE: message may be logged, and it should not contain sensitive information.'
                    type: string
                  time:
                    description: time is the timestamp when the error was encountered.
                    format: date-time
                    type: string
                type: object
              readyToUse:
                description: readyToUse indicates if the snapshot is ready to be used to restore a volume. In dynamic snapshot creation case, this field will be filled in by the snapshot controller with the "ready_to_use" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "ready_to_use" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it, otherwise, this field will be set to "True". If not specified, it means the readiness of a snapshot is unknown.
                type: boolean
              restoreSize:
                type: string
                description: restoreSize represents the minimum size of volume required to create a volume from this snapshot. In dynamic snapshot creation case, this field will be filled in by the snapshot controller with the "size_bytes" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "size_bytes" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it. When restoring a volume from this snapshot, the size of the volume MUST NOT be smaller than the restoreSize if it is specified, otherwise the restoration will fail. If not specified, it indicates that the size is unknown.
                pattern: ^(\+|-)?(([0-9]+(\.[0-9]*)?)|(\.[0-9]+))(([KMGTPE]i)|[numkMGTPE]|([eE](\+|-)?(([0-9]+(\.[0-9]*)?)|(\.[0-9]+))))?$
                x-kubernetes-int-or-string: true
            type: object
        required:
        - spec
        type: object
... skipping 248 lines ...
            description: status represents the current information of a snapshot.
            properties:
              creationTime:
                description: creationTime is the timestamp when the point-in-time snapshot is taken by the underlying storage system. In dynamic snapshot creation case, this field will be filled in by the CSI snapshotter sidecar with the "creation_time" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "creation_time" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it. If not specified, it indicates the creation time is unknown. The format of this field is a Unix nanoseconds time encoded as an int64. On Unix, the command `date +%s%N` returns the current time in nanoseconds since 1970-01-01 00:00:00 UTC.
                format: int64
                type: integer
              error:
                description: error is the last observed error during snapshot creation, if any. Upon success after retry, this error field will be cleared.
                properties:
                  message:
                    description: 'message is a string detailing the encountered error during snapshot creation if specified. NOTE: message may be logged, and it should not contain sensitive information.'
                    type: string
                  time:
                    description: time is the timestamp when the error was encountered.
                    format: date-time
                    type: string
                type: object
              readyToUse:
                description: readyToUse indicates if a snapshot is ready to be used to restore a volume. In dynamic snapshot creation case, this field will be filled in by the CSI snapshotter sidecar with the "ready_to_use" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "ready_to_use" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it, otherwise, this field will be set to "True". If not specified, it means the readiness of a snapshot is unknown.
                type: boolean
              restoreSize:
                description: restoreSize represents the complete size of the snapshot in bytes. In dynamic snapshot creation case, this field will be filled in by the CSI snapshotter sidecar with the "size_bytes" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "size_bytes" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it. When restoring a volume from this snapshot, the size of the volume MUST NOT be smaller than the restoreSize if it is specified, otherwise the restoration will fail. If not specified, it indicates that the size is unknown.
                format: int64
                minimum: 0
                type: integer
              snapshotHandle:
                description: snapshotHandle is the CSI "snapshot_id" of a snapshot on the underlying storage system. If not specified, it indicates that dynamic snapshot creation has either failed or it is still in progress.
                type: string
            type: object
        required:
        - spec
        type: object
    served: true
... skipping 108 lines ...
            description: status represents the current information of a snapshot.
            properties:
              creationTime:
                description: creationTime is the timestamp when the point-in-time snapshot is taken by the underlying storage system. In dynamic snapshot creation case, this field will be filled in by the CSI snapshotter sidecar with the "creation_time" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "creation_time" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it. If not specified, it indicates the creation time is unknown. The format of this field is a Unix nanoseconds time encoded as an int64. On Unix, the command `date +%s%N` returns the current time in nanoseconds since 1970-01-01 00:00:00 UTC.
                format: int64
                type: integer
              error:
                description: error is the last observed error during snapshot creation, if any. Upon success after retry, this error field will be cleared.
                properties:
                  message:
                    description: 'message is a string detailing the encountered error during snapshot creation if specified. NOTE: message may be logged, and it should not contain sensitive information.'
                    type: string
                  time:
                    description: time is the timestamp when the error was encountered.
                    format: date-time
                    type: string
                type: object
              readyToUse:
                description: readyToUse indicates if a snapshot is ready to be used to restore a volume. In dynamic snapshot creation case, this field will be filled in by the CSI snapshotter sidecar with the "ready_to_use" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "ready_to_use" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it, otherwise, this field will be set to "True". If not specified, it means the readiness of a snapshot is unknown.
                type: boolean
              restoreSize:
                description: restoreSize represents the complete size of the snapshot in bytes. In dynamic snapshot creation case, this field will be filled in by the CSI snapshotter sidecar with the "size_bytes" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "size_bytes" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it. When restoring a volume from this snapshot, the size of the volume MUST NOT be smaller than the restoreSize if it is specified, otherwise the restoration will fail. If not specified, it indicates that the size is unknown.
                format: int64
                minimum: 0
                type: integer
              snapshotHandle:
                description: snapshotHandle is the CSI "snapshot_id" of a snapshot on the underlying storage system. If not specified, it indicates that dynamic snapshot creation has either failed or it is still in progress.
                type: string
            type: object
        required:
        - spec
        type: object
    served: true
... skipping 850 lines ...
        - name: csi-resizer
          image: "mcr.microsoft.com/oss/kubernetes-csi/csi-resizer:v1.3.0"
          args:
            - "-csi-address=$(ADDRESS)"
            - "-v=2"
            - "-leader-election"
            - '-handle-volume-inuse-error=true'
          env:
            - name: ADDRESS
              value: /csi/csi.sock
          volumeMounts:
            - name: socket-dir
              mountPath: /csi
... skipping 580 lines ...
Oct  5 15:33:00.183: INFO: PersistentVolumeClaim test.csi.azure.comfrzmm found but phase is Pending instead of Bound.
Oct  5 15:33:02.293: INFO: PersistentVolumeClaim test.csi.azure.comfrzmm found but phase is Pending instead of Bound.
Oct  5 15:33:04.404: INFO: PersistentVolumeClaim test.csi.azure.comfrzmm found but phase is Pending instead of Bound.
Oct  5 15:33:06.513: INFO: PersistentVolumeClaim test.csi.azure.comfrzmm found and phase=Bound (21.208844783s)
STEP: Creating pod pod-subpath-test-dynamicpv-c9d8
STEP: Creating a pod to test subpath
Oct  5 15:33:06.845: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-c9d8" in namespace "provisioning-4220" to be "Succeeded or Failed"
Oct  5 15:33:06.953: INFO: Pod "pod-subpath-test-dynamicpv-c9d8": Phase="Pending", Reason="", readiness=false. Elapsed: 107.852533ms
Oct  5 15:33:09.062: INFO: Pod "pod-subpath-test-dynamicpv-c9d8": Phase="Pending", Reason="", readiness=false. Elapsed: 2.216912515s
Oct  5 15:33:11.172: INFO: Pod "pod-subpath-test-dynamicpv-c9d8": Phase="Pending", Reason="", readiness=false. Elapsed: 4.326718593s
Oct  5 15:33:13.281: INFO: Pod "pod-subpath-test-dynamicpv-c9d8": Phase="Pending", Reason="", readiness=false. Elapsed: 6.436190644s
Oct  5 15:33:15.391: INFO: Pod "pod-subpath-test-dynamicpv-c9d8": Phase="Pending", Reason="", readiness=false. Elapsed: 8.545652534s
Oct  5 15:33:17.500: INFO: Pod "pod-subpath-test-dynamicpv-c9d8": Phase="Pending", Reason="", readiness=false. Elapsed: 10.65454544s
... skipping 3 lines ...
Oct  5 15:33:25.938: INFO: Pod "pod-subpath-test-dynamicpv-c9d8": Phase="Pending", Reason="", readiness=false. Elapsed: 19.092857651s
Oct  5 15:33:28.049: INFO: Pod "pod-subpath-test-dynamicpv-c9d8": Phase="Pending", Reason="", readiness=false. Elapsed: 21.203957391s
Oct  5 15:33:30.159: INFO: Pod "pod-subpath-test-dynamicpv-c9d8": Phase="Pending", Reason="", readiness=false. Elapsed: 23.313980696s
Oct  5 15:33:32.268: INFO: Pod "pod-subpath-test-dynamicpv-c9d8": Phase="Pending", Reason="", readiness=false. Elapsed: 25.423011205s
Oct  5 15:33:34.378: INFO: Pod "pod-subpath-test-dynamicpv-c9d8": Phase="Succeeded", Reason="", readiness=false. Elapsed: 27.533328435s
STEP: Saw pod success
Oct  5 15:33:34.378: INFO: Pod "pod-subpath-test-dynamicpv-c9d8" satisfied condition "Succeeded or Failed"
Oct  5 15:33:34.488: INFO: Trying to get logs from node k8s-agentpool1-35271516-vmss000000 pod pod-subpath-test-dynamicpv-c9d8 container test-container-subpath-dynamicpv-c9d8: <nil>
STEP: delete the pod
Oct  5 15:33:34.763: INFO: Waiting for pod pod-subpath-test-dynamicpv-c9d8 to disappear
Oct  5 15:33:34.872: INFO: Pod pod-subpath-test-dynamicpv-c9d8 no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-c9d8
Oct  5 15:33:34.872: INFO: Deleting pod "pod-subpath-test-dynamicpv-c9d8" in namespace "provisioning-4220"
... skipping 22 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should support readOnly file specified in the volumeMount [LinuxOnly]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:380
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath should support readOnly file specified in the volumeMount [LinuxOnly]","total":17,"completed":1,"skipped":23,"failed":0}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (block volmode)] volumeMode
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct  5 15:34:11.614: INFO: Driver "test.csi.azure.com" does not support volume type "PreprovisionedPV" - skipping
... skipping 205 lines ...
Oct  5 15:32:46.798: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.comjvj7g] to have phase Bound
Oct  5 15:32:46.906: INFO: PersistentVolumeClaim test.csi.azure.comjvj7g found but phase is Pending instead of Bound.
Oct  5 15:32:49.024: INFO: PersistentVolumeClaim test.csi.azure.comjvj7g found but phase is Pending instead of Bound.
Oct  5 15:32:51.133: INFO: PersistentVolumeClaim test.csi.azure.comjvj7g found and phase=Bound (4.334980318s)
STEP: Creating pod exec-volume-test-dynamicpv-kjsx
STEP: Creating a pod to test exec-volume-test
Oct  5 15:32:51.461: INFO: Waiting up to 5m0s for pod "exec-volume-test-dynamicpv-kjsx" in namespace "volume-3356" to be "Succeeded or Failed"
Oct  5 15:32:51.569: INFO: Pod "exec-volume-test-dynamicpv-kjsx": Phase="Pending", Reason="", readiness=false. Elapsed: 107.851943ms
Oct  5 15:32:53.677: INFO: Pod "exec-volume-test-dynamicpv-kjsx": Phase="Pending", Reason="", readiness=false. Elapsed: 2.216549916s
Oct  5 15:32:55.788: INFO: Pod "exec-volume-test-dynamicpv-kjsx": Phase="Pending", Reason="", readiness=false. Elapsed: 4.32696308s
Oct  5 15:32:57.898: INFO: Pod "exec-volume-test-dynamicpv-kjsx": Phase="Pending", Reason="", readiness=false. Elapsed: 6.437040455s
Oct  5 15:33:00.008: INFO: Pod "exec-volume-test-dynamicpv-kjsx": Phase="Pending", Reason="", readiness=false. Elapsed: 8.547238059s
Oct  5 15:33:02.117: INFO: Pod "exec-volume-test-dynamicpv-kjsx": Phase="Pending", Reason="", readiness=false. Elapsed: 10.655907566s
Oct  5 15:33:04.226: INFO: Pod "exec-volume-test-dynamicpv-kjsx": Phase="Pending", Reason="", readiness=false. Elapsed: 12.765266217s
Oct  5 15:33:06.338: INFO: Pod "exec-volume-test-dynamicpv-kjsx": Phase="Pending", Reason="", readiness=false. Elapsed: 14.877118789s
Oct  5 15:33:08.447: INFO: Pod "exec-volume-test-dynamicpv-kjsx": Phase="Pending", Reason="", readiness=false. Elapsed: 16.986706571s
Oct  5 15:33:10.557: INFO: Pod "exec-volume-test-dynamicpv-kjsx": Phase="Pending", Reason="", readiness=false. Elapsed: 19.095992799s
Oct  5 15:33:12.666: INFO: Pod "exec-volume-test-dynamicpv-kjsx": Phase="Succeeded", Reason="", readiness=false. Elapsed: 21.205607046s
STEP: Saw pod success
Oct  5 15:33:12.666: INFO: Pod "exec-volume-test-dynamicpv-kjsx" satisfied condition "Succeeded or Failed"
Oct  5 15:33:12.774: INFO: Trying to get logs from node k8s-agentpool1-35271516-vmss000001 pod exec-volume-test-dynamicpv-kjsx container exec-container-dynamicpv-kjsx: <nil>
STEP: delete the pod
Oct  5 15:33:13.033: INFO: Waiting for pod exec-volume-test-dynamicpv-kjsx to disappear
Oct  5 15:33:13.145: INFO: Pod exec-volume-test-dynamicpv-kjsx no longer exists
STEP: Deleting pod exec-volume-test-dynamicpv-kjsx
Oct  5 15:33:13.145: INFO: Deleting pod "exec-volume-test-dynamicpv-kjsx" in namespace "volume-3356"
... skipping 27 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should allow exec of files on the volume
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:196
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] volumes should allow exec of files on the volume","total":12,"completed":1,"skipped":582,"failed":0}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct  5 15:34:25.537: INFO: Driver "test.csi.azure.com" does not support volume type "InlineVolume" - skipping
... skipping 61 lines ...
Oct  5 15:32:45.297: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.comd44sw] to have phase Bound
Oct  5 15:32:45.405: INFO: PersistentVolumeClaim test.csi.azure.comd44sw found but phase is Pending instead of Bound.
Oct  5 15:32:47.512: INFO: PersistentVolumeClaim test.csi.azure.comd44sw found but phase is Pending instead of Bound.
Oct  5 15:32:49.619: INFO: PersistentVolumeClaim test.csi.azure.comd44sw found and phase=Bound (4.322504465s)
STEP: Creating pod pod-subpath-test-dynamicpv-rd4n
STEP: Creating a pod to test atomic-volume-subpath
Oct  5 15:32:49.944: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-rd4n" in namespace "provisioning-6795" to be "Succeeded or Failed"
Oct  5 15:32:50.050: INFO: Pod "pod-subpath-test-dynamicpv-rd4n": Phase="Pending", Reason="", readiness=false. Elapsed: 106.801982ms
Oct  5 15:32:52.159: INFO: Pod "pod-subpath-test-dynamicpv-rd4n": Phase="Pending", Reason="", readiness=false. Elapsed: 2.215338066s
Oct  5 15:32:54.267: INFO: Pod "pod-subpath-test-dynamicpv-rd4n": Phase="Pending", Reason="", readiness=false. Elapsed: 4.323394744s
Oct  5 15:32:56.376: INFO: Pod "pod-subpath-test-dynamicpv-rd4n": Phase="Pending", Reason="", readiness=false. Elapsed: 6.432527836s
Oct  5 15:32:58.485: INFO: Pod "pod-subpath-test-dynamicpv-rd4n": Phase="Pending", Reason="", readiness=false. Elapsed: 8.541509498s
Oct  5 15:33:00.594: INFO: Pod "pod-subpath-test-dynamicpv-rd4n": Phase="Pending", Reason="", readiness=false. Elapsed: 10.650579552s
... skipping 20 lines ...
Oct  5 15:33:44.892: INFO: Pod "pod-subpath-test-dynamicpv-rd4n": Phase="Running", Reason="", readiness=true. Elapsed: 54.948431388s
Oct  5 15:33:47.000: INFO: Pod "pod-subpath-test-dynamicpv-rd4n": Phase="Running", Reason="", readiness=true. Elapsed: 57.056192433s
Oct  5 15:33:49.108: INFO: Pod "pod-subpath-test-dynamicpv-rd4n": Phase="Running", Reason="", readiness=true. Elapsed: 59.16471218s
Oct  5 15:33:51.218: INFO: Pod "pod-subpath-test-dynamicpv-rd4n": Phase="Running", Reason="", readiness=true. Elapsed: 1m1.274385097s
Oct  5 15:33:53.327: INFO: Pod "pod-subpath-test-dynamicpv-rd4n": Phase="Succeeded", Reason="", readiness=false. Elapsed: 1m3.383124187s
STEP: Saw pod success
Oct  5 15:33:53.327: INFO: Pod "pod-subpath-test-dynamicpv-rd4n" satisfied condition "Succeeded or Failed"
Oct  5 15:33:53.434: INFO: Trying to get logs from node k8s-agentpool1-35271516-vmss000000 pod pod-subpath-test-dynamicpv-rd4n container test-container-subpath-dynamicpv-rd4n: <nil>
STEP: delete the pod
Oct  5 15:33:53.665: INFO: Waiting for pod pod-subpath-test-dynamicpv-rd4n to disappear
Oct  5 15:33:53.772: INFO: Pod pod-subpath-test-dynamicpv-rd4n no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-rd4n
Oct  5 15:33:53.772: INFO: Deleting pod "pod-subpath-test-dynamicpv-rd4n" in namespace "provisioning-6795"
... skipping 29 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should support file as subpath [LinuxOnly]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:230
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath should support file as subpath [LinuxOnly]","total":6,"completed":1,"skipped":297,"failed":0}

SSSSSSSSSSSSSSSSSSSSS
------------------------------
External Storage [Driver: test.csi.azure.com] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral 
  should create read/write inline ephemeral volume
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/ephemeral.go:166
... skipping 50 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should create read/write inline ephemeral volume
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/ephemeral.go:166
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should create read/write inline ephemeral volume","total":17,"completed":1,"skipped":86,"failed":0}

SSSSS
------------------------------
External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath 
  should support non-existent path
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:194
... skipping 16 lines ...
Oct  5 15:34:12.875: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.com44tnc] to have phase Bound
Oct  5 15:34:12.983: INFO: PersistentVolumeClaim test.csi.azure.com44tnc found but phase is Pending instead of Bound.
Oct  5 15:34:15.093: INFO: PersistentVolumeClaim test.csi.azure.com44tnc found but phase is Pending instead of Bound.
Oct  5 15:34:17.203: INFO: PersistentVolumeClaim test.csi.azure.com44tnc found and phase=Bound (4.328101288s)
STEP: Creating pod pod-subpath-test-dynamicpv-72dj
STEP: Creating a pod to test subpath
Oct  5 15:34:17.531: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-72dj" in namespace "provisioning-4973" to be "Succeeded or Failed"
Oct  5 15:34:17.639: INFO: Pod "pod-subpath-test-dynamicpv-72dj": Phase="Pending", Reason="", readiness=false. Elapsed: 108.179121ms
Oct  5 15:34:19.749: INFO: Pod "pod-subpath-test-dynamicpv-72dj": Phase="Pending", Reason="", readiness=false. Elapsed: 2.217948677s
Oct  5 15:34:21.858: INFO: Pod "pod-subpath-test-dynamicpv-72dj": Phase="Pending", Reason="", readiness=false. Elapsed: 4.327120114s
Oct  5 15:34:23.969: INFO: Pod "pod-subpath-test-dynamicpv-72dj": Phase="Pending", Reason="", readiness=false. Elapsed: 6.438319745s
Oct  5 15:34:26.079: INFO: Pod "pod-subpath-test-dynamicpv-72dj": Phase="Pending", Reason="", readiness=false. Elapsed: 8.548735134s
Oct  5 15:34:28.190: INFO: Pod "pod-subpath-test-dynamicpv-72dj": Phase="Pending", Reason="", readiness=false. Elapsed: 10.659646383s
... skipping 8 lines ...
Oct  5 15:34:47.188: INFO: Pod "pod-subpath-test-dynamicpv-72dj": Phase="Pending", Reason="", readiness=false. Elapsed: 29.657356482s
Oct  5 15:34:49.298: INFO: Pod "pod-subpath-test-dynamicpv-72dj": Phase="Pending", Reason="", readiness=false. Elapsed: 31.767193425s
Oct  5 15:34:51.407: INFO: Pod "pod-subpath-test-dynamicpv-72dj": Phase="Pending", Reason="", readiness=false. Elapsed: 33.876061855s
Oct  5 15:34:53.517: INFO: Pod "pod-subpath-test-dynamicpv-72dj": Phase="Pending", Reason="", readiness=false. Elapsed: 35.985978251s
Oct  5 15:34:55.628: INFO: Pod "pod-subpath-test-dynamicpv-72dj": Phase="Succeeded", Reason="", readiness=false. Elapsed: 38.09695708s
STEP: Saw pod success
Oct  5 15:34:55.628: INFO: Pod "pod-subpath-test-dynamicpv-72dj" satisfied condition "Succeeded or Failed"
Oct  5 15:34:55.737: INFO: Trying to get logs from node k8s-agentpool1-35271516-vmss000000 pod pod-subpath-test-dynamicpv-72dj container test-container-volume-dynamicpv-72dj: <nil>
STEP: delete the pod
Oct  5 15:34:55.975: INFO: Waiting for pod pod-subpath-test-dynamicpv-72dj to disappear
Oct  5 15:34:56.083: INFO: Pod pod-subpath-test-dynamicpv-72dj no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-72dj
Oct  5 15:34:56.083: INFO: Deleting pod "pod-subpath-test-dynamicpv-72dj" in namespace "provisioning-4973"
... skipping 23 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should support non-existent path
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:194
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath should support non-existent path","total":17,"completed":2,"skipped":531,"failed":0}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (immediate binding)] topology
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (immediate binding)] topology
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct  5 15:35:37.939: INFO: >>> kubeConfig: /root/tmp1967779287/kubeconfig/kubeconfig.westeurope.json
STEP: Building a namespace api object, basename topology
STEP: Waiting for a default service account to be provisioned in namespace
[It] should fail to schedule a pod which has topologies that conflict with AllowedTopologies
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192
Oct  5 15:35:38.484: INFO: Driver didn't provide topology keys -- skipping
[AfterEach] [Testpattern: Dynamic PV (immediate binding)] topology
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct  5 15:35:38.485: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "topology-4805" for this suite.


S [SKIPPING] [0.773 seconds]
External Storage [Driver: test.csi.azure.com]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (immediate binding)] topology
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should fail to schedule a pod which has topologies that conflict with AllowedTopologies [Measurement]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192

    Driver didn't provide topology keys -- skipping

    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:124
------------------------------
... skipping 20 lines ...
Oct  5 15:35:39.494: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.comnvh98] to have phase Bound
Oct  5 15:35:39.604: INFO: PersistentVolumeClaim test.csi.azure.comnvh98 found but phase is Pending instead of Bound.
Oct  5 15:35:41.712: INFO: PersistentVolumeClaim test.csi.azure.comnvh98 found but phase is Pending instead of Bound.
Oct  5 15:35:43.821: INFO: PersistentVolumeClaim test.csi.azure.comnvh98 found and phase=Bound (4.326847261s)
STEP: Expanding non-expandable pvc
Oct  5 15:35:44.037: INFO: currentPvcSize {{5368709120 0} {<nil>} 5Gi BinarySI}, newSize {{6442450944 0} {<nil>}  BinarySI}
Oct  5 15:35:44.255: INFO: Error updating pvc test.csi.azure.comnvh98: persistentvolumeclaims "test.csi.azure.comnvh98" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Oct  5 15:35:46.475: INFO: Error updating pvc test.csi.azure.comnvh98: persistentvolumeclaims "test.csi.azure.comnvh98" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Oct  5 15:35:48.476: INFO: Error updating pvc test.csi.azure.comnvh98: persistentvolumeclaims "test.csi.azure.comnvh98" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Oct  5 15:35:50.474: INFO: Error updating pvc test.csi.azure.comnvh98: persistentvolumeclaims "test.csi.azure.comnvh98" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Oct  5 15:35:52.476: INFO: Error updating pvc test.csi.azure.comnvh98: persistentvolumeclaims "test.csi.azure.comnvh98" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Oct  5 15:35:54.475: INFO: Error updating pvc test.csi.azure.comnvh98: persistentvolumeclaims "test.csi.azure.comnvh98" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Oct  5 15:35:56.474: INFO: Error updating pvc test.csi.azure.comnvh98: persistentvolumeclaims "test.csi.azure.comnvh98" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Oct  5 15:35:58.476: INFO: Error updating pvc test.csi.azure.comnvh98: persistentvolumeclaims "test.csi.azure.comnvh98" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Oct  5 15:36:00.472: INFO: Error updating pvc test.csi.azure.comnvh98: persistentvolumeclaims "test.csi.azure.comnvh98" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Oct  5 15:36:02.474: INFO: Error updating pvc test.csi.azure.comnvh98: persistentvolumeclaims "test.csi.azure.comnvh98" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Oct  5 15:36:04.474: INFO: Error updating pvc test.csi.azure.comnvh98: persistentvolumeclaims "test.csi.azure.comnvh98" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Oct  5 15:36:06.474: INFO: Error updating pvc test.csi.azure.comnvh98: persistentvolumeclaims "test.csi.azure.comnvh98" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Oct  5 15:36:08.474: INFO: Error updating pvc test.csi.azure.comnvh98: persistentvolumeclaims "test.csi.azure.comnvh98" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Oct  5 15:36:10.476: INFO: Error updating pvc test.csi.azure.comnvh98: persistentvolumeclaims "test.csi.azure.comnvh98" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Oct  5 15:36:12.477: INFO: Error updating pvc test.csi.azure.comnvh98: persistentvolumeclaims "test.csi.azure.comnvh98" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Oct  5 15:36:14.474: INFO: Error updating pvc test.csi.azure.comnvh98: persistentvolumeclaims "test.csi.azure.comnvh98" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Oct  5 15:36:14.693: INFO: Error updating pvc test.csi.azure.comnvh98: persistentvolumeclaims "test.csi.azure.comnvh98" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
STEP: Deleting pvc
Oct  5 15:36:14.693: INFO: Deleting PersistentVolumeClaim "test.csi.azure.comnvh98"
Oct  5 15:36:14.802: INFO: Waiting up to 5m0s for PersistentVolume pvc-1a5dc421-3f0e-4f4e-95c4-c1560e04997a to get deleted
Oct  5 15:36:14.911: INFO: PersistentVolume pvc-1a5dc421-3f0e-4f4e-95c4-c1560e04997a found and phase=Released (108.921156ms)
Oct  5 15:36:20.020: INFO: PersistentVolume pvc-1a5dc421-3f0e-4f4e-95c4-c1560e04997a found and phase=Released (5.217971296s)
Oct  5 15:36:25.132: INFO: PersistentVolume pvc-1a5dc421-3f0e-4f4e-95c4-c1560e04997a was removed
... skipping 9 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (block volmode)] volume-expand
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should not allow expansion of pvcs without AllowVolumeExpansion property
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volume_expand.go:157
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (block volmode)] volume-expand should not allow expansion of pvcs without AllowVolumeExpansion property","total":17,"completed":3,"skipped":575,"failed":0}

SSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Inline-volume (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct  5 15:36:25.702: INFO: Driver "test.csi.azure.com" does not support volume type "InlineVolume" - skipping
... skipping 156 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should support two pods which share the same volume
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/ephemeral.go:183
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should support two pods which share the same volume","total":18,"completed":1,"skipped":41,"failed":0}

SSSSSSSSSSSSSSSSSSSS
------------------------------
External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy 
  (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with same fsgroup applied to the volume contents
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/fsgroupchangepolicy.go:208
... skipping 90 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with same fsgroup applied to the volume contents
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/fsgroupchangepolicy.go:208
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with same fsgroup applied to the volume contents","total":12,"completed":2,"skipped":684,"failed":0}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct  5 15:36:41.510: INFO: Driver "test.csi.azure.com" does not support volume type "PreprovisionedPV" - skipping
... skipping 135 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/fsgroupchangepolicy.go:208
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents","total":20,"completed":1,"skipped":60,"failed":0}

SSS
------------------------------
[BeforeEach] [Testpattern: CSI Ephemeral-volume (default fs)] ephemeral
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct  5 15:37:08.511: INFO: Driver "test.csi.azure.com" does not support volume type "CSIInlineVolume" - skipping
... skipping 119 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (block volmode)] provisioning
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/provisioning.go:201
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource]","total":6,"completed":2,"skipped":318,"failed":0}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (ext3)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct  5 15:37:52.566: INFO: Driver test.csi.azure.com doesn't support ext3 -- skipping
... skipping 85 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    Verify if offline PVC expansion works
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volume_expand.go:174
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand Verify if offline PVC expansion works","total":17,"completed":2,"skipped":91,"failed":0}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct  5 15:39:05.338: INFO: Driver test.csi.azure.com doesn't support ntfs -- skipping
... skipping 97 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (filesystem volmode)] volumeLimits
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should support volume limits [Serial]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumelimits.go:123
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (filesystem volmode)] volumeLimits should support volume limits [Serial]","total":15,"completed":1,"skipped":353,"failed":0}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy 
  (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with different fsgroup applied to the volume contents
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/fsgroupchangepolicy.go:208
... skipping 96 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with different fsgroup applied to the volume contents
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/fsgroupchangepolicy.go:208
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with different fsgroup applied to the volume contents","total":20,"completed":2,"skipped":110,"failed":0}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct  5 15:40:56.929: INFO: Driver "test.csi.azure.com" does not support volume type "PreprovisionedPV" - skipping
... skipping 187 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should store data
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:159
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] volumes should store data","total":18,"completed":2,"skipped":61,"failed":0}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (block volmode)] volumes 
  should store data
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:159
... skipping 75 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (block volmode)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should store data
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:159
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (block volmode)] volumes should store data","total":17,"completed":3,"skipped":252,"failed":0}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct  5 15:41:53.030: INFO: Driver "test.csi.azure.com" does not support volume type "PreprovisionedPV" - skipping
... skipping 242 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with different fsgroup applied to the volume contents
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/fsgroupchangepolicy.go:208
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with different fsgroup applied to the volume contents","total":6,"completed":3,"skipped":751,"failed":0}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral
... skipping 136 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should create read/write inline ephemeral volume
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/ephemeral.go:166
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should create read/write inline ephemeral volume","total":20,"completed":3,"skipped":391,"failed":0}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (ntfs)][Feature:Windows] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct  5 15:42:27.733: INFO: Driver "test.csi.azure.com" does not support volume type "PreprovisionedPV" - skipping
... skipping 95 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    (Always)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/fsgroupchangepolicy.go:208
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents","total":15,"completed":2,"skipped":405,"failed":0}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct  5 15:42:31.735: INFO: Driver "test.csi.azure.com" does not support volume type "PreprovisionedPV" - skipping
... skipping 37 lines ...
Oct  5 15:42:28.507: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.comrlsjb] to have phase Bound
Oct  5 15:42:28.616: INFO: PersistentVolumeClaim test.csi.azure.comrlsjb found but phase is Pending instead of Bound.
Oct  5 15:42:30.726: INFO: PersistentVolumeClaim test.csi.azure.comrlsjb found but phase is Pending instead of Bound.
Oct  5 15:42:32.835: INFO: PersistentVolumeClaim test.csi.azure.comrlsjb found and phase=Bound (4.328049496s)
STEP: Creating pod pod-subpath-test-dynamicpv-p2x5
STEP: Creating a pod to test subpath
Oct  5 15:42:33.167: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-p2x5" in namespace "provisioning-7940" to be "Succeeded or Failed"
Oct  5 15:42:33.276: INFO: Pod "pod-subpath-test-dynamicpv-p2x5": Phase="Pending", Reason="", readiness=false. Elapsed: 108.85424ms
Oct  5 15:42:35.387: INFO: Pod "pod-subpath-test-dynamicpv-p2x5": Phase="Pending", Reason="", readiness=false. Elapsed: 2.219761145s
Oct  5 15:42:37.496: INFO: Pod "pod-subpath-test-dynamicpv-p2x5": Phase="Pending", Reason="", readiness=false. Elapsed: 4.329231202s
Oct  5 15:42:39.606: INFO: Pod "pod-subpath-test-dynamicpv-p2x5": Phase="Pending", Reason="", readiness=false. Elapsed: 6.439236533s
Oct  5 15:42:41.717: INFO: Pod "pod-subpath-test-dynamicpv-p2x5": Phase="Pending", Reason="", readiness=false. Elapsed: 8.550459341s
Oct  5 15:42:43.833: INFO: Pod "pod-subpath-test-dynamicpv-p2x5": Phase="Pending", Reason="", readiness=false. Elapsed: 10.666210025s
... skipping 9 lines ...
Oct  5 15:43:04.940: INFO: Pod "pod-subpath-test-dynamicpv-p2x5": Phase="Pending", Reason="", readiness=false. Elapsed: 31.773490832s
Oct  5 15:43:07.052: INFO: Pod "pod-subpath-test-dynamicpv-p2x5": Phase="Pending", Reason="", readiness=false. Elapsed: 33.885165011s
Oct  5 15:43:09.161: INFO: Pod "pod-subpath-test-dynamicpv-p2x5": Phase="Pending", Reason="", readiness=false. Elapsed: 35.99465727s
Oct  5 15:43:11.274: INFO: Pod "pod-subpath-test-dynamicpv-p2x5": Phase="Pending", Reason="", readiness=false. Elapsed: 38.107088359s
Oct  5 15:43:13.384: INFO: Pod "pod-subpath-test-dynamicpv-p2x5": Phase="Succeeded", Reason="", readiness=false. Elapsed: 40.216836661s
STEP: Saw pod success
Oct  5 15:43:13.384: INFO: Pod "pod-subpath-test-dynamicpv-p2x5" satisfied condition "Succeeded or Failed"
Oct  5 15:43:13.492: INFO: Trying to get logs from node k8s-agentpool1-35271516-vmss000000 pod pod-subpath-test-dynamicpv-p2x5 container test-container-volume-dynamicpv-p2x5: <nil>
STEP: delete the pod
Oct  5 15:43:13.730: INFO: Waiting for pod pod-subpath-test-dynamicpv-p2x5 to disappear
Oct  5 15:43:13.839: INFO: Pod pod-subpath-test-dynamicpv-p2x5 no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-p2x5
Oct  5 15:43:13.839: INFO: Deleting pod "pod-subpath-test-dynamicpv-p2x5" in namespace "provisioning-7940"
... skipping 23 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should support existing directory
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:205
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath should support existing directory","total":20,"completed":4,"skipped":427,"failed":0}

SSSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] provisioning
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] provisioning
... skipping 66 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct  5 15:43:57.331: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "volumelimits-6564" for this suite.

•
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (filesystem volmode)] volumeLimits should verify that all csinodes have volume limits","total":20,"completed":5,"skipped":502,"failed":0}

SSS
------------------------------
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct  5 15:43:57.556: INFO: Driver "test.csi.azure.com" does not support volume type "InlineVolume" - skipping
... skipping 111 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with same fsgroup skips ownership changes to the volume contents
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/fsgroupchangepolicy.go:208
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with same fsgroup skips ownership changes to the volume contents","total":17,"completed":4,"skipped":846,"failed":0}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
External Storage [Driver: test.csi.azure.com] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral 
  should support two pods which share the same volume
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/ephemeral.go:183
... skipping 66 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should support two pods which share the same volume
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/ephemeral.go:183
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should support two pods which share the same volume","total":12,"completed":3,"skipped":797,"failed":0}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
Oct  5 15:44:55.272: INFO: Running AfterSuite actions on all nodes
Oct  5 15:44:55.272: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage.glob..func17.2
Oct  5 15:44:55.272: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage.glob..func8.2
... skipping 26 lines ...
Oct  5 15:42:32.513: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.comm4q4t] to have phase Bound
Oct  5 15:42:32.623: INFO: PersistentVolumeClaim test.csi.azure.comm4q4t found but phase is Pending instead of Bound.
Oct  5 15:42:34.734: INFO: PersistentVolumeClaim test.csi.azure.comm4q4t found but phase is Pending instead of Bound.
Oct  5 15:42:36.844: INFO: PersistentVolumeClaim test.csi.azure.comm4q4t found and phase=Bound (4.330925029s)
STEP: Creating pod pod-subpath-test-dynamicpv-8cbq
STEP: Creating a pod to test subpath
Oct  5 15:42:37.171: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-8cbq" in namespace "provisioning-2361" to be "Succeeded or Failed"
Oct  5 15:42:37.280: INFO: Pod "pod-subpath-test-dynamicpv-8cbq": Phase="Pending", Reason="", readiness=false. Elapsed: 108.384432ms
Oct  5 15:42:39.390: INFO: Pod "pod-subpath-test-dynamicpv-8cbq": Phase="Pending", Reason="", readiness=false. Elapsed: 2.218430846s
Oct  5 15:42:41.499: INFO: Pod "pod-subpath-test-dynamicpv-8cbq": Phase="Pending", Reason="", readiness=false. Elapsed: 4.327539845s
Oct  5 15:42:43.608: INFO: Pod "pod-subpath-test-dynamicpv-8cbq": Phase="Pending", Reason="", readiness=false. Elapsed: 6.436784374s
Oct  5 15:42:45.719: INFO: Pod "pod-subpath-test-dynamicpv-8cbq": Phase="Pending", Reason="", readiness=false. Elapsed: 8.547514055s
Oct  5 15:42:47.830: INFO: Pod "pod-subpath-test-dynamicpv-8cbq": Phase="Pending", Reason="", readiness=false. Elapsed: 10.658305307s
... skipping 25 lines ...
Oct  5 15:43:42.702: INFO: Pod "pod-subpath-test-dynamicpv-8cbq": Phase="Pending", Reason="", readiness=false. Elapsed: 1m5.530596416s
Oct  5 15:43:44.813: INFO: Pod "pod-subpath-test-dynamicpv-8cbq": Phase="Pending", Reason="", readiness=false. Elapsed: 1m7.641262407s
Oct  5 15:43:46.924: INFO: Pod "pod-subpath-test-dynamicpv-8cbq": Phase="Pending", Reason="", readiness=false. Elapsed: 1m9.752419531s
Oct  5 15:43:49.035: INFO: Pod "pod-subpath-test-dynamicpv-8cbq": Phase="Pending", Reason="", readiness=false. Elapsed: 1m11.863360381s
Oct  5 15:43:51.147: INFO: Pod "pod-subpath-test-dynamicpv-8cbq": Phase="Succeeded", Reason="", readiness=false. Elapsed: 1m13.975523107s
STEP: Saw pod success
Oct  5 15:43:51.147: INFO: Pod "pod-subpath-test-dynamicpv-8cbq" satisfied condition "Succeeded or Failed"
Oct  5 15:43:51.256: INFO: Trying to get logs from node k8s-agentpool1-35271516-vmss000001 pod pod-subpath-test-dynamicpv-8cbq container test-container-subpath-dynamicpv-8cbq: <nil>
STEP: delete the pod
Oct  5 15:43:51.543: INFO: Waiting for pod pod-subpath-test-dynamicpv-8cbq to disappear
Oct  5 15:43:51.650: INFO: Pod pod-subpath-test-dynamicpv-8cbq no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-8cbq
Oct  5 15:43:51.650: INFO: Deleting pod "pod-subpath-test-dynamicpv-8cbq" in namespace "provisioning-2361"
STEP: Creating pod pod-subpath-test-dynamicpv-8cbq
STEP: Creating a pod to test subpath
Oct  5 15:43:51.871: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-8cbq" in namespace "provisioning-2361" to be "Succeeded or Failed"
Oct  5 15:43:51.979: INFO: Pod "pod-subpath-test-dynamicpv-8cbq": Phase="Pending", Reason="", readiness=false. Elapsed: 108.536991ms
Oct  5 15:43:54.089: INFO: Pod "pod-subpath-test-dynamicpv-8cbq": Phase="Pending", Reason="", readiness=false. Elapsed: 2.218300911s
Oct  5 15:43:56.200: INFO: Pod "pod-subpath-test-dynamicpv-8cbq": Phase="Pending", Reason="", readiness=false. Elapsed: 4.328649134s
Oct  5 15:43:58.310: INFO: Pod "pod-subpath-test-dynamicpv-8cbq": Phase="Pending", Reason="", readiness=false. Elapsed: 6.438941211s
Oct  5 15:44:00.420: INFO: Pod "pod-subpath-test-dynamicpv-8cbq": Phase="Pending", Reason="", readiness=false. Elapsed: 8.548792589s
Oct  5 15:44:02.534: INFO: Pod "pod-subpath-test-dynamicpv-8cbq": Phase="Pending", Reason="", readiness=false. Elapsed: 10.662855299s
... skipping 22 lines ...
Oct  5 15:44:51.078: INFO: Pod "pod-subpath-test-dynamicpv-8cbq": Phase="Pending", Reason="", readiness=false. Elapsed: 59.207250724s
Oct  5 15:44:53.191: INFO: Pod "pod-subpath-test-dynamicpv-8cbq": Phase="Pending", Reason="", readiness=false. Elapsed: 1m1.319865141s
Oct  5 15:44:55.303: INFO: Pod "pod-subpath-test-dynamicpv-8cbq": Phase="Pending", Reason="", readiness=false. Elapsed: 1m3.431891425s
Oct  5 15:44:57.414: INFO: Pod "pod-subpath-test-dynamicpv-8cbq": Phase="Pending", Reason="", readiness=false. Elapsed: 1m5.543247351s
Oct  5 15:44:59.525: INFO: Pod "pod-subpath-test-dynamicpv-8cbq": Phase="Succeeded", Reason="", readiness=false. Elapsed: 1m7.654533816s
STEP: Saw pod success
Oct  5 15:44:59.526: INFO: Pod "pod-subpath-test-dynamicpv-8cbq" satisfied condition "Succeeded or Failed"
Oct  5 15:44:59.636: INFO: Trying to get logs from node k8s-agentpool1-35271516-vmss000000 pod pod-subpath-test-dynamicpv-8cbq container test-container-subpath-dynamicpv-8cbq: <nil>
STEP: delete the pod
Oct  5 15:44:59.892: INFO: Waiting for pod pod-subpath-test-dynamicpv-8cbq to disappear
Oct  5 15:45:00.001: INFO: Pod pod-subpath-test-dynamicpv-8cbq no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-8cbq
Oct  5 15:45:00.001: INFO: Deleting pod "pod-subpath-test-dynamicpv-8cbq" in namespace "provisioning-2361"
... skipping 23 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should support existing directories when readOnly specified in the volumeSource
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:395
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath should support existing directories when readOnly specified in the volumeSource","total":15,"completed":3,"skipped":665,"failed":0}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Inline-volume (default fs)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct  5 15:45:41.960: INFO: Driver "test.csi.azure.com" does not support volume type "InlineVolume" - skipping
... skipping 77 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should be able to unmount after the subpath directory is deleted [LinuxOnly]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:445
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]","total":17,"completed":5,"skipped":906,"failed":0}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
Oct  5 15:46:42.017: INFO: Running AfterSuite actions on all nodes
Oct  5 15:46:42.017: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage.glob..func17.2
Oct  5 15:46:42.017: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage.glob..func8.2
... skipping 62 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should support multiple inline ephemeral volumes
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/ephemeral.go:221
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should support multiple inline ephemeral volumes","total":20,"completed":6,"skipped":591,"failed":0}

SSSSSSSSSSSSSSS
------------------------------
External Storage [Driver: test.csi.azure.com] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral 
  should create read-only inline ephemeral volume
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/ephemeral.go:149
... skipping 43 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should create read-only inline ephemeral volume
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/ephemeral.go:149
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should create read-only inline ephemeral volume","total":20,"completed":7,"skipped":606,"failed":0}

SSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct  5 15:48:48.164: INFO: Driver "test.csi.azure.com" does not support volume type "PreprovisionedPV" - skipping
... skipping 58 lines ...
Oct  5 15:48:49.144: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.com69d65] to have phase Bound
Oct  5 15:48:49.253: INFO: PersistentVolumeClaim test.csi.azure.com69d65 found but phase is Pending instead of Bound.
Oct  5 15:48:51.362: INFO: PersistentVolumeClaim test.csi.azure.com69d65 found but phase is Pending instead of Bound.
Oct  5 15:48:53.471: INFO: PersistentVolumeClaim test.csi.azure.com69d65 found and phase=Bound (4.327275687s)
STEP: Creating pod pod-subpath-test-dynamicpv-zjqf
STEP: Creating a pod to test subpath
Oct  5 15:48:53.799: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-zjqf" in namespace "provisioning-9545" to be "Succeeded or Failed"
Oct  5 15:48:53.908: INFO: Pod "pod-subpath-test-dynamicpv-zjqf": Phase="Pending", Reason="", readiness=false. Elapsed: 108.619026ms
Oct  5 15:48:56.018: INFO: Pod "pod-subpath-test-dynamicpv-zjqf": Phase="Pending", Reason="", readiness=false. Elapsed: 2.219188321s
Oct  5 15:48:58.131: INFO: Pod "pod-subpath-test-dynamicpv-zjqf": Phase="Pending", Reason="", readiness=false. Elapsed: 4.331501572s
Oct  5 15:49:00.241: INFO: Pod "pod-subpath-test-dynamicpv-zjqf": Phase="Pending", Reason="", readiness=false. Elapsed: 6.44190495s
Oct  5 15:49:02.351: INFO: Pod "pod-subpath-test-dynamicpv-zjqf": Phase="Pending", Reason="", readiness=false. Elapsed: 8.55173448s
Oct  5 15:49:04.461: INFO: Pod "pod-subpath-test-dynamicpv-zjqf": Phase="Pending", Reason="", readiness=false. Elapsed: 10.661589117s
... skipping 8 lines ...
Oct  5 15:49:23.459: INFO: Pod "pod-subpath-test-dynamicpv-zjqf": Phase="Pending", Reason="", readiness=false. Elapsed: 29.659722042s
Oct  5 15:49:25.581: INFO: Pod "pod-subpath-test-dynamicpv-zjqf": Phase="Pending", Reason="", readiness=false. Elapsed: 31.781756513s
Oct  5 15:49:27.692: INFO: Pod "pod-subpath-test-dynamicpv-zjqf": Phase="Pending", Reason="", readiness=false. Elapsed: 33.892815648s
Oct  5 15:49:29.802: INFO: Pod "pod-subpath-test-dynamicpv-zjqf": Phase="Pending", Reason="", readiness=false. Elapsed: 36.002955077s
Oct  5 15:49:31.913: INFO: Pod "pod-subpath-test-dynamicpv-zjqf": Phase="Succeeded", Reason="", readiness=false. Elapsed: 38.113918298s
STEP: Saw pod success
Oct  5 15:49:31.913: INFO: Pod "pod-subpath-test-dynamicpv-zjqf" satisfied condition "Succeeded or Failed"
Oct  5 15:49:32.023: INFO: Trying to get logs from node k8s-agentpool1-35271516-vmss000001 pod pod-subpath-test-dynamicpv-zjqf container test-container-subpath-dynamicpv-zjqf: <nil>
STEP: delete the pod
Oct  5 15:49:32.308: INFO: Waiting for pod pod-subpath-test-dynamicpv-zjqf to disappear
Oct  5 15:49:32.418: INFO: Pod pod-subpath-test-dynamicpv-zjqf no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-zjqf
Oct  5 15:49:32.418: INFO: Deleting pod "pod-subpath-test-dynamicpv-zjqf" in namespace "provisioning-9545"
... skipping 23 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should support readOnly directory specified in the volumeMount
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:365
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath should support readOnly directory specified in the volumeMount","total":20,"completed":8,"skipped":828,"failed":0}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
Oct  5 15:50:14.328: INFO: Running AfterSuite actions on all nodes
Oct  5 15:50:14.328: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage.glob..func17.2
Oct  5 15:50:14.328: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage.glob..func8.2
... skipping 27 lines ...
Oct  5 15:41:25.996: INFO: PersistentVolumeClaim test.csi.azure.compkb6r found but phase is Pending instead of Bound.
Oct  5 15:41:28.108: INFO: PersistentVolumeClaim test.csi.azure.compkb6r found and phase=Bound (4.328663508s)
STEP: Creating a pod with dynamically provisioned volume
STEP: Expanding current pvc
Oct  5 15:41:48.763: INFO: currentPvcSize {{5368709120 0} {<nil>} 5Gi BinarySI}, newSize {{6442450944 0} {<nil>}  BinarySI}
STEP: Waiting for cloudprovider resize to finish
Oct  5 15:51:49.308: FAIL: While waiting for pvc resize to finish
Unexpected error:
    <*errors.errorString | 0xc003f0ac50>: {
        s: "error while waiting for controller resize to finish: timed out waiting for the condition",
    }
    error while waiting for controller resize to finish: timed out waiting for the condition
occurred

Full Stack Trace
k8s.io/kubernetes/test/e2e/storage/testsuites.(*volumeExpandTestSuite).DefineTests.func5()
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volume_expand.go:288 +0xa45
k8s.io/kubernetes/test/e2e.RunE2ETests(0xc000502c00)
... skipping 35 lines ...
Oct  5 15:52:35.072: INFO: At 2021-10-05 15:41:46 +0000 UTC - event for pod-6b62c331-7020-4d1a-88c8-448459158cae: {kubelet k8s-agentpool1-35271516-vmss000001} Started: Started container write-pod
Oct  5 15:52:35.072: INFO: At 2021-10-05 15:41:46 +0000 UTC - event for pod-6b62c331-7020-4d1a-88c8-448459158cae: {kubelet k8s-agentpool1-35271516-vmss000001} Created: Created container write-pod
Oct  5 15:52:35.072: INFO: At 2021-10-05 15:41:46 +0000 UTC - event for pod-6b62c331-7020-4d1a-88c8-448459158cae: {kubelet k8s-agentpool1-35271516-vmss000001} Pulled: Successfully pulled image "k8s.gcr.io/e2e-test-images/busybox:1.29-1" in 354.36078ms
Oct  5 15:52:35.072: INFO: At 2021-10-05 15:41:46 +0000 UTC - event for pod-6b62c331-7020-4d1a-88c8-448459158cae: {kubelet k8s-agentpool1-35271516-vmss000001} Pulling: Pulling image "k8s.gcr.io/e2e-test-images/busybox:1.29-1"
Oct  5 15:52:35.072: INFO: At 2021-10-05 15:41:48 +0000 UTC - event for test.csi.azure.compkb6r: {volume_expand } ExternalExpanding: Ignoring the PVC: didn't find a plugin capable of expanding the volume; waiting for an external controller to process this PVC.
Oct  5 15:52:35.072: INFO: At 2021-10-05 15:41:48 +0000 UTC - event for test.csi.azure.compkb6r: {external-resizer test.csi.azure.com } Resizing: External resizer is resizing volume pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc
Oct  5 15:52:35.072: INFO: At 2021-10-05 15:41:48 +0000 UTC - event for test.csi.azure.compkb6r: {external-resizer test.csi.azure.com } VolumeResizeFailed: resize volume "pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc" by resizer "test.csi.azure.com" failed: rpc error: code = Internal desc = failed to resize disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc) with error(azureDisk - disk resize is only supported on Unattached disk, current disk state: Attached, already attached to /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-35271516-vmss/virtualMachines/k8s-agentpool1-35271516-vmss_1)
Oct  5 15:52:35.072: INFO: At 2021-10-05 15:51:49 +0000 UTC - event for pod-6b62c331-7020-4d1a-88c8-448459158cae: {kubelet k8s-agentpool1-35271516-vmss000001} Killing: Stopping container write-pod
Oct  5 15:52:35.179: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Oct  5 15:52:35.179: INFO: 
Oct  5 15:52:35.392: INFO: 
Logging node info for node k8s-agentpool1-35271516-vmss000000
Oct  5 15:52:35.500: INFO: Node Info: &Node{ObjectMeta:{k8s-agentpool1-35271516-vmss000000    1ff8aa32-7036-44b8-8269-9fe09f51447c 8829 0 2021-10-05 15:19:35 +0000 UTC <nil> <nil> map[agentpool:agentpool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_DS4_v2 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westeurope failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-4edgu0dt kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:k8s-agentpool1-35271516-vmss000000 kubernetes.io/os:linux kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_DS4_v2 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:westeurope topology.kubernetes.io/zone:0 topology.test.csi.azure.com/zone:] map[csi.volume.kubernetes.io/nodeid:{"test.csi.azure.com":"k8s-agentpool1-35271516-vmss000000"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  [{kubelet Update v1 2021-10-05 15:19:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:storageprofile":{},"f:storagetier":{}}}} } {kubectl-label Update v1 2021-10-05 15:19:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}} } {cloud-controller-manager Update v1 2021-10-05 15:19:54 +0000 UTC FieldsV1 {"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}}}} } {kube-controller-manager Update v1 2021-10-05 15:20:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}} } {cloud-node-manager Update v1 2021-10-05 15:20:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {cloud-controller-manager Update v1 2021-10-05 15:20:50 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2021-10-05 15:45:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.test.csi.azure.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2021-10-05 15:46:26 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-35271516-vmss/virtualMachines/0,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{31036686336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{29449355264 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{27933017657 0} {<nil>} 27933017657 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{28662923264 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-10-05 15:20:50 +0000 UTC,LastTransitionTime:2021-10-05 15:20:50 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-10-05 15:48:15 +0000 UTC,LastTransitionTime:2021-10-05 15:19:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-10-05 15:48:15 +0000 UTC,LastTransitionTime:2021-10-05 15:19:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-10-05 15:48:15 +0000 UTC,LastTransitionTime:2021-10-05 15:19:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-10-05 15:48:15 +0000 UTC,LastTransitionTime:2021-10-05 15:19:54 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.240.0.4,},NodeAddress{Type:Hostname,Address:k8s-agentpool1-35271516-vmss000000,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1c322c8072464758b76d750982b52da0,SystemUUID:57d0341c-2d82-6647-9904-f04b3dca3d40,BootID:b6459388-44cd-4428-8842-4c9aead099a4,KernelVersion:5.4.0-1055-azure,OSImage:Ubuntu 18.04.5 LTS,ContainerRuntimeVersion:docker://20.10.7+azure,KubeletVersion:v1.22.2,KubeProxyVersion:v1.22.2,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azurefile-csi@sha256:558b9ac2bb6cf988252222039c506da0e4703d28480b21788687b111fde9e59d mcr.microsoft.com/k8s/csi/azurefile-csi:v0.6.0],SizeBytes:346369171,},ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azuredisk-csi@sha256:2536d09114a6be2b9e9a64542990996f24e66586933b02c2a4fa41331c333b55 mcr.microsoft.com/k8s/csi/azuredisk-csi:v0.7.0],SizeBytes:286159349,},ContainerImage{Names:[k8sprow.azurecr.io/azuredisk-csi@sha256:8e6b6727210ccb1d87d0cda2d06381b631a1c74f6ca8e6bb6219ab5a1648e62c k8sprow.azurecr.io/azuredisk-csi:v1.8.0-8412a9b9582277d9ca97974b5d2601e9b23694a4],SizeBytes:237779279,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/azure-npm@sha256:106f669f48e5e80c4ec0afb49858ead72cf4b901cd8664e7bf81f8d789e56e12 mcr.microsoft.com/containernetworking/azure-npm:v1.2.2_hotfix],SizeBytes:175230380,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:758db666ac7028534dba72e7e9bb1e57bb81b8196f976f7a5cc351ef8b3529e1 k8s.gcr.io/e2e-test-images/agnhost:2.32],SizeBytes:125910179,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver@sha256:c0d040a1c4fbfceb65663e31c09ea40f4f78e356437610cbc3fbb4bb409bd6f1 mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver:v0.0.19],SizeBytes:123229697,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:b1ec3f3090fc799799bee98619a33300d8ee9095219adc4bb688084718810d23 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.22.2],SizeBytes:103625747,},ContainerImage{Names:[mcr.microsoft.com/oss/azure/secrets-store/provider-azure@sha256:6f67f3d0c7cdde5702f8ce7f101b6519daa0237f0c34fecb7c058b6af8c22ad1 mcr.microsoft.com/oss/azure/secrets-store/provider-azure:0.0.12],SizeBytes:101061355,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:da9dc5ded174ce042c9bc8189cd2aa0b69ee49b4cd90700e5ddd649502eef482 mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.21.0],SizeBytes:100942381,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager@sha256:0085ffc5930e0d47b388ee3446a9c72ac434117944552a5c47dbdf64d34c00a0 mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager:v0.5.1],SizeBytes:88867004,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:0f0c53b4d1231c7ff062ec4453fa6bb5fe1a9df81379207ad87c734eff635604 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.5.1],SizeBytes:88166588,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-addon-manager@sha256:32e2836018c96e73533bd4642fe438e465b81dcbfa8b7b61935a6f4d0246c7ae mcr.microsoft.com/oss/kubernetes/kube-addon-manager:v9.1.3],SizeBytes:86832059,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-addon-manager@sha256:92c2c5aad9012ee32d2a43a74966cc0adc6ccb1705ad15abb10485ecf406d88b mcr.microsoft.com/oss/kubernetes/kube-addon-manager:v9.1.5],SizeBytes:84094027,},ContainerImage{Names:[mcr.microsoft.com/oss/nvidia/k8s-device-plugin@sha256:0f5b52bf28239234e831697d96db63ac03cde70fe68058f964504ab7564ee810 mcr.microsoft.com/oss/nvidia/k8s-device-plugin:1.0.0-beta6],SizeBytes:64160241,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/metrics-server@sha256:682d3a1a48abbe03df05e1084923ab668a6651fd80327f9694b0cf302cc49f90 mcr.microsoft.com/oss/kubernetes/metrics-server:v0.5.0],SizeBytes:63501445,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner@sha256:e9ddadc44ba87a4a27f67e54760a14f9986885b534b3dff170a14eae1e35d213 mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner:v3.0.0],SizeBytes:56881280,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner@sha256:21fae82e312b135c9b09f75041922a4e189ce6d86d23c83a7e1be48dbe172a74 mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner:v1.5.0],SizeBytes:56655289,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner@sha256:3e1695221da4da4744e7eea688ff6acaf4a8724650a10fda66c4cdea931a134b mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner:v1.4.0],SizeBytes:54454557,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-resizer@sha256:c5bb71ceaac60b1a4b58739fa07b709f6248c452ff6272a384d2f7648895a750 mcr.microsoft.com/oss/kubernetes-csi/csi-resizer:v1.3.0],SizeBytes:54313772,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter@sha256:e28e996e03519565907d7158e0e1a6613cec76220fa8625e0ebfc1aa1c3bacb2 mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter:v4.2.1],SizeBytes:54210936,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-attacher@sha256:6b41e7153ebdfdc1501aa65184624bc15fd33a52d93f88ec3a758d0f8c9b8c10 mcr.microsoft.com/oss/kubernetes-csi/csi-attacher:v3.3.0],SizeBytes:53842561,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/snapshot-controller@sha256:bb61653b29713588c280999cbb25b472fef8794623164fd9177c270da1121db0 mcr.microsoft.com/oss/kubernetes-csi/snapshot-controller:v4.2.1],SizeBytes:51575245,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:c24707c5f947d9e384d0f111469ca3266a01c48de6557f306e718c23d699cadf mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v1.1.1],SizeBytes:50295363,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/ip-masq-agent@sha256:bddf19be25644c7176e8c501465dbad07d032288334f135877b984660b0d3ee6 mcr.microsoft.com/oss/kubernetes/ip-masq-agent:v2.5.0],SizeBytes:50146762,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter@sha256:7d4825b057634e815ba0fb21b528b58781ab83b1199c1fb6211c2ef56c66e41a mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter:v1.1.0],SizeBytes:47611988,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter@sha256:f714d2a97234ad53cab35c201a2f2f503e9707e107c6e741777a9ead190760e3 mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter:v2.0.0],SizeBytes:46292802,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-attacher@sha256:5321c1199ed7cc0920ce09cea2158f93644b72bebb0517958e30afaf2392e572 mcr.microsoft.com/oss/kubernetes-csi/csi-attacher:v1.2.0],SizeBytes:46212935,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-resizer@sha256:89ad3037cdce5b7501add15265f37faf1e21adec27b7727087fe3e1826da640a mcr.microsoft.com/oss/kubernetes-csi/csi-resizer:v0.3.0],SizeBytes:46004414,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/coredns@sha256:1c23b17c78ffbc90c068ee088b77456284b9649952fa127b0f86a0ccff575539 mcr.microsoft.com/oss/kubernetes/coredns:1.7.0],SizeBytes:45233936,},ContainerImage{Names:[mcr.microsoft.com/oss/etcd-io/etcd@sha256:cf587862e3f1b6fa4d9a2565520a34f164bdf72c50f37af8c3c668160593246e mcr.microsoft.com/oss/etcd-io/etcd:v3.3.25],SizeBytes:41832119,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/snapshot-controller@sha256:da80086fff8b98c58e6ff0403a5835cf7ea7dc0b8fdb504cc55601c4b6881066 mcr.microsoft.com/oss/kubernetes-csi/snapshot-controller:v2.0.0],SizeBytes:41412938,},ContainerImage{Names:[mcr.microsoft.com/k8s/aad-pod-identity/mic@sha256:bd9465be94966b9a917e1e3904fa5e63dd91772ccadf304e18ffd8e4ad8ccedd mcr.microsoft.com/k8s/aad-pod-identity/mic:1.6.1],SizeBytes:41374894,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-proportional-autoscaler@sha256:753e3ca79dc833feed24ee4107ff4f06a96abbd6cefba8d41d7dec6f4d3e75f0 mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-proportional-autoscaler:1.7.1],SizeBytes:40051560,},ContainerImage{Names:[mcr.microsoft.com/k8s/aad-pod-identity/nmi@sha256:02128fefcdb7593ac53fc342e2c53a0fc6fabd813036bf60457bf43cc2940116 mcr.microsoft.com/k8s/aad-pod-identity/nmi:1.6.1],SizeBytes:38007982,},ContainerImage{Names:[mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume@sha256:921f301c44dda06a325164accf22e78ecc570b5c7d9d6ee4c66bd8cbb2b60b9a mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume:v0.0.16],SizeBytes:26970670,},ContainerImage{Names:[mcr.microsoft.com/k8s/kms/keyvault@sha256:1a27e175f8c125209e32d2957b5509fe20757bd8cb309ff9da598799b56326fb mcr.microsoft.com/k8s/kms/keyvault:v0.0.10],SizeBytes:23077387,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:60b7645ece041ce343e5f74017e39b72c6703661bd147d225772a81c4d18f4e3 mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v2.1.0],SizeBytes:19663065,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:f1205ba7ae0b0783bb19442064f4d7d664f3dc0c9b0b5b33358e5eef5aedc554 mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v2.3.0],SizeBytes:18746317,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:b7d82802cca8523df1d5973332c64d558fe352617926fd01707b17e2f022755f mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.2.0],SizeBytes:17752565,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:3770688d4efa33f8f284cc2ef58d33efa4ff606147e0a8de20e67458e13fedc2 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.4.0],SizeBytes:17183286,},ContainerImage{Names:[busybox@sha256:0f354ec1728d9ff32edcd7d1b8bbdfc798277ad36120dc3dc683be44524c8b60 busybox:latest],SizeBytes:1235821,},ContainerImage{Names:[mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume@sha256:23d8c6033f02a1ecad05127ebdc931bb871264228661bc122704b0974e4d9fdd mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume:1.0.8],SizeBytes:1159025,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:1154361,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:e3b8c20681593c21b344ad801fbb8abaf564427ee3a57a9fcfa3b455f917ce46 mcr.microsoft.com/oss/kubernetes/pause:3.4.1],SizeBytes:682696,},},VolumesInUse:[kubernetes.io/csi/test.csi.azure.com^/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-d420d34b-aebb-4da8-b0fe-f88f30946243],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/test.csi.azure.com^/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-d420d34b-aebb-4da8-b0fe-f88f30946243,DevicePath:,},},Config:nil,},}
... skipping 95 lines ...
  [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should resize volume when PVC is edited while pod is using it [Measurement]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volume_expand.go:246

    Oct  5 15:51:49.308: While waiting for pvc resize to finish
    Unexpected error:
        <*errors.errorString | 0xc003f0ac50>: {
            s: "error while waiting for controller resize to finish: timed out waiting for the condition",
        }
        error while waiting for controller resize to finish: timed out waiting for the condition
    occurred

    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volume_expand.go:288
------------------------------
{"msg":"FAILED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand should resize volume when PVC is edited while pod is using it","total":18,"completed":2,"skipped":120,"failed":1,"failures":["External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand should resize volume when PVC is edited while pod is using it"]}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand 
  Verify if offline PVC expansion works
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volume_expand.go:174
... skipping 57 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    Verify if offline PVC expansion works
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volume_expand.go:174
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand Verify if offline PVC expansion works","total":18,"completed":3,"skipped":218,"failed":1,"failures":["External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand should resize volume when PVC is edited while pod is using it"]}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Inline-volume (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct  5 15:55:05.683: INFO: Driver "test.csi.azure.com" does not support volume type "InlineVolume" - skipping
... skipping 20 lines ...
[BeforeEach] [Testpattern: Dynamic PV (delayed binding)] topology
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct  5 15:55:05.753: INFO: >>> kubeConfig: /root/tmp1967779287/kubeconfig/kubeconfig.westeurope.json
STEP: Building a namespace api object, basename topology
STEP: Waiting for a default service account to be provisioned in namespace
[It] should fail to schedule a pod which has topologies that conflict with AllowedTopologies
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192
Oct  5 15:55:06.291: INFO: Driver didn't provide topology keys -- skipping
[AfterEach] [Testpattern: Dynamic PV (delayed binding)] topology
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct  5 15:55:06.292: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "topology-1325" for this suite.


S [SKIPPING] [0.861 seconds]
External Storage [Driver: test.csi.azure.com]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (delayed binding)] topology
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should fail to schedule a pod which has topologies that conflict with AllowedTopologies [Measurement]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192

    Driver didn't provide topology keys -- skipping

    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:124
------------------------------
... skipping 78 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should create read-only inline ephemeral volume
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/ephemeral.go:149
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should create read-only inline ephemeral volume","total":18,"completed":4,"skipped":555,"failed":1,"failures":["External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand should resize volume when PVC is edited while pod is using it"]}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand 
  should resize volume when PVC is edited while pod is using it
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volume_expand.go:246
... skipping 18 lines ...
Oct  5 15:45:44.956: INFO: PersistentVolumeClaim test.csi.azure.comk86zq found but phase is Pending instead of Bound.
Oct  5 15:45:47.065: INFO: PersistentVolumeClaim test.csi.azure.comk86zq found and phase=Bound (4.327894836s)
STEP: Creating a pod with dynamically provisioned volume
STEP: Expanding current pvc
Oct  5 15:46:55.722: INFO: currentPvcSize {{5368709120 0} {<nil>} 5Gi BinarySI}, newSize {{6442450944 0} {<nil>}  BinarySI}
STEP: Waiting for cloudprovider resize to finish
Oct  5 15:56:56.273: FAIL: While waiting for pvc resize to finish
Unexpected error:
    <*errors.errorString | 0xc0030dc430>: {
        s: "error while waiting for controller resize to finish: timed out waiting for the condition",
    }
    error while waiting for controller resize to finish: timed out waiting for the condition
occurred

Full Stack Trace
k8s.io/kubernetes/test/e2e/storage/testsuites.(*volumeExpandTestSuite).DefineTests.func5()
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volume_expand.go:288 +0xa45
k8s.io/kubernetes/test/e2e.RunE2ETests(0xc0003b8a80)
... skipping 31 lines ...
Oct  5 15:57:40.028: INFO: At 2021-10-05 15:45:45 +0000 UTC - event for test.csi.azure.comk86zq: {test.csi.azure.com_k8s-agentpool1-35271516-vmss000000_817543c7-a698-45e4-9dc8-910e62bff90c } ProvisioningSucceeded: Successfully provisioned volume pvc-d420d34b-aebb-4da8-b0fe-f88f30946243
Oct  5 15:57:40.028: INFO: At 2021-10-05 15:46:26 +0000 UTC - event for pod-ae80d001-116b-4c3c-895f-6a8ff3d628c9: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-d420d34b-aebb-4da8-b0fe-f88f30946243" 
Oct  5 15:57:40.028: INFO: At 2021-10-05 15:46:54 +0000 UTC - event for pod-ae80d001-116b-4c3c-895f-6a8ff3d628c9: {kubelet k8s-agentpool1-35271516-vmss000000} Pulled: Successfully pulled image "k8s.gcr.io/e2e-test-images/busybox:1.29-1" in 323.96582ms
Oct  5 15:57:40.028: INFO: At 2021-10-05 15:46:54 +0000 UTC - event for pod-ae80d001-116b-4c3c-895f-6a8ff3d628c9: {kubelet k8s-agentpool1-35271516-vmss000000} Created: Created container write-pod
Oct  5 15:57:40.028: INFO: At 2021-10-05 15:46:54 +0000 UTC - event for pod-ae80d001-116b-4c3c-895f-6a8ff3d628c9: {kubelet k8s-agentpool1-35271516-vmss000000} Started: Started container write-pod
Oct  5 15:57:40.028: INFO: At 2021-10-05 15:46:54 +0000 UTC - event for pod-ae80d001-116b-4c3c-895f-6a8ff3d628c9: {kubelet k8s-agentpool1-35271516-vmss000000} Pulling: Pulling image "k8s.gcr.io/e2e-test-images/busybox:1.29-1"
Oct  5 15:57:40.028: INFO: At 2021-10-05 15:46:55 +0000 UTC - event for test.csi.azure.comk86zq: {external-resizer test.csi.azure.com } VolumeResizeFailed: resize volume "pvc-d420d34b-aebb-4da8-b0fe-f88f30946243" by resizer "test.csi.azure.com" failed: rpc error: code = Internal desc = failed to resize disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-d420d34b-aebb-4da8-b0fe-f88f30946243) with error(azureDisk - disk resize is only supported on Unattached disk, current disk state: Attached, already attached to /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-35271516-vmss/virtualMachines/k8s-agentpool1-35271516-vmss_0)
Oct  5 15:57:40.028: INFO: At 2021-10-05 15:46:55 +0000 UTC - event for test.csi.azure.comk86zq: {volume_expand } ExternalExpanding: Ignoring the PVC: didn't find a plugin capable of expanding the volume; waiting for an external controller to process this PVC.
Oct  5 15:57:40.028: INFO: At 2021-10-05 15:46:55 +0000 UTC - event for test.csi.azure.comk86zq: {external-resizer test.csi.azure.com } Resizing: External resizer is resizing volume pvc-d420d34b-aebb-4da8-b0fe-f88f30946243
Oct  5 15:57:40.028: INFO: At 2021-10-05 15:56:56 +0000 UTC - event for pod-ae80d001-116b-4c3c-895f-6a8ff3d628c9: {kubelet k8s-agentpool1-35271516-vmss000000} Killing: Stopping container write-pod
Oct  5 15:57:40.135: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Oct  5 15:57:40.135: INFO: 
Oct  5 15:57:40.348: INFO: 
... skipping 95 lines ...
  [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should resize volume when PVC is edited while pod is using it [Measurement]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volume_expand.go:246

    Oct  5 15:56:56.273: While waiting for pvc resize to finish
    Unexpected error:
        <*errors.errorString | 0xc0030dc430>: {
            s: "error while waiting for controller resize to finish: timed out waiting for the condition",
        }
        error while waiting for controller resize to finish: timed out waiting for the condition
    occurred

    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volume_expand.go:288
------------------------------
{"msg":"FAILED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand should resize volume when PVC is edited while pod is using it","total":15,"completed":3,"skipped":818,"failed":1,"failures":["External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand should resize volume when PVC is edited while pod is using it"]}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] volume-expand 
  should not allow expansion of pvcs without AllowVolumeExpansion property
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volume_expand.go:157
... skipping 16 lines ...
Oct  5 15:57:29.116: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.comk4fz2] to have phase Bound
Oct  5 15:57:29.223: INFO: PersistentVolumeClaim test.csi.azure.comk4fz2 found but phase is Pending instead of Bound.
Oct  5 15:57:31.334: INFO: PersistentVolumeClaim test.csi.azure.comk4fz2 found but phase is Pending instead of Bound.
Oct  5 15:57:33.441: INFO: PersistentVolumeClaim test.csi.azure.comk4fz2 found and phase=Bound (4.325352336s)
STEP: Expanding non-expandable pvc
Oct  5 15:57:33.657: INFO: currentPvcSize {{5368709120 0} {<nil>} 5Gi BinarySI}, newSize {{6442450944 0} {<nil>}  BinarySI}
Oct  5 15:57:33.873: INFO: Error updating pvc test.csi.azure.comk4fz2: persistentvolumeclaims "test.csi.azure.comk4fz2" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Oct  5 15:57:36.091: INFO: Error updating pvc test.csi.azure.comk4fz2: persistentvolumeclaims "test.csi.azure.comk4fz2" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Oct  5 15:57:38.091: INFO: Error updating pvc test.csi.azure.comk4fz2: persistentvolumeclaims "test.csi.azure.comk4fz2" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Oct  5 15:57:40.089: INFO: Error updating pvc test.csi.azure.comk4fz2: persistentvolumeclaims "test.csi.azure.comk4fz2" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Oct  5 15:57:42.088: INFO: Error updating pvc test.csi.azure.comk4fz2: persistentvolumeclaims "test.csi.azure.comk4fz2" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Oct  5 15:57:44.088: INFO: Error updating pvc test.csi.azure.comk4fz2: persistentvolumeclaims "test.csi.azure.comk4fz2" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Oct  5 15:57:46.089: INFO: Error updating pvc test.csi.azure.comk4fz2: persistentvolumeclaims "test.csi.azure.comk4fz2" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Oct  5 15:57:48.088: INFO: Error updating pvc test.csi.azure.comk4fz2: persistentvolumeclaims "test.csi.azure.comk4fz2" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Oct  5 15:57:50.091: INFO: Error updating pvc test.csi.azure.comk4fz2: persistentvolumeclaims "test.csi.azure.comk4fz2" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Oct  5 15:57:52.092: INFO: Error updating pvc test.csi.azure.comk4fz2: persistentvolumeclaims "test.csi.azure.comk4fz2" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Oct  5 15:57:54.090: INFO: Error updating pvc test.csi.azure.comk4fz2: persistentvolumeclaims "test.csi.azure.comk4fz2" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Oct  5 15:57:56.090: INFO: Error updating pvc test.csi.azure.comk4fz2: persistentvolumeclaims "test.csi.azure.comk4fz2" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Oct  5 15:57:58.092: INFO: Error updating pvc test.csi.azure.comk4fz2: persistentvolumeclaims "test.csi.azure.comk4fz2" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Oct  5 15:58:00.093: INFO: Error updating pvc test.csi.azure.comk4fz2: persistentvolumeclaims "test.csi.azure.comk4fz2" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Oct  5 15:58:02.093: INFO: Error updating pvc test.csi.azure.comk4fz2: persistentvolumeclaims "test.csi.azure.comk4fz2" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Oct  5 15:58:04.089: INFO: Error updating pvc test.csi.azure.comk4fz2: persistentvolumeclaims "test.csi.azure.comk4fz2" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Oct  5 15:58:04.305: INFO: Error updating pvc test.csi.azure.comk4fz2: persistentvolumeclaims "test.csi.azure.comk4fz2" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
STEP: Deleting pvc
Oct  5 15:58:04.305: INFO: Deleting PersistentVolumeClaim "test.csi.azure.comk4fz2"
Oct  5 15:58:04.414: INFO: Waiting up to 5m0s for PersistentVolume pvc-8bab8be7-0cdf-463a-ab7d-d07cdeedf723 to get deleted
Oct  5 15:58:04.522: INFO: PersistentVolume pvc-8bab8be7-0cdf-463a-ab7d-d07cdeedf723 found and phase=Released (107.864869ms)
Oct  5 15:58:09.632: INFO: PersistentVolume pvc-8bab8be7-0cdf-463a-ab7d-d07cdeedf723 found and phase=Released (5.217743427s)
Oct  5 15:58:14.741: INFO: PersistentVolume pvc-8bab8be7-0cdf-463a-ab7d-d07cdeedf723 was removed
... skipping 9 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] volume-expand
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should not allow expansion of pvcs without AllowVolumeExpansion property
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volume_expand.go:157
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] volume-expand should not allow expansion of pvcs without AllowVolumeExpansion property","total":18,"completed":5,"skipped":588,"failed":1,"failures":["External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand should resize volume when PVC is edited while pod is using it"]}

SSSSSSSSSSSSSSSSSSSSS
------------------------------
External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath 
  should support existing single file [LinuxOnly]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:219
... skipping 16 lines ...
Oct  5 15:58:15.995: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.comkmbzd] to have phase Bound
Oct  5 15:58:16.103: INFO: PersistentVolumeClaim test.csi.azure.comkmbzd found but phase is Pending instead of Bound.
Oct  5 15:58:18.212: INFO: PersistentVolumeClaim test.csi.azure.comkmbzd found but phase is Pending instead of Bound.
Oct  5 15:58:20.320: INFO: PersistentVolumeClaim test.csi.azure.comkmbzd found and phase=Bound (4.325038287s)
STEP: Creating pod pod-subpath-test-dynamicpv-tdn8
STEP: Creating a pod to test subpath
Oct  5 15:58:20.645: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-tdn8" in namespace "provisioning-6705" to be "Succeeded or Failed"
Oct  5 15:58:20.752: INFO: Pod "pod-subpath-test-dynamicpv-tdn8": Phase="Pending", Reason="", readiness=false. Elapsed: 106.847888ms
Oct  5 15:58:22.862: INFO: Pod "pod-subpath-test-dynamicpv-tdn8": Phase="Pending", Reason="", readiness=false. Elapsed: 2.217037756s
Oct  5 15:58:24.971: INFO: Pod "pod-subpath-test-dynamicpv-tdn8": Phase="Pending", Reason="", readiness=false. Elapsed: 4.325948949s
Oct  5 15:58:27.081: INFO: Pod "pod-subpath-test-dynamicpv-tdn8": Phase="Pending", Reason="", readiness=false. Elapsed: 6.435720386s
Oct  5 15:58:29.189: INFO: Pod "pod-subpath-test-dynamicpv-tdn8": Phase="Pending", Reason="", readiness=false. Elapsed: 8.544318826s
Oct  5 15:58:31.298: INFO: Pod "pod-subpath-test-dynamicpv-tdn8": Phase="Pending", Reason="", readiness=false. Elapsed: 10.653132215s
... skipping 8 lines ...
Oct  5 15:58:50.284: INFO: Pod "pod-subpath-test-dynamicpv-tdn8": Phase="Pending", Reason="", readiness=false. Elapsed: 29.639578196s
Oct  5 15:58:52.398: INFO: Pod "pod-subpath-test-dynamicpv-tdn8": Phase="Pending", Reason="", readiness=false. Elapsed: 31.752855671s
Oct  5 15:58:54.507: INFO: Pod "pod-subpath-test-dynamicpv-tdn8": Phase="Pending", Reason="", readiness=false. Elapsed: 33.862590647s
Oct  5 15:58:56.617: INFO: Pod "pod-subpath-test-dynamicpv-tdn8": Phase="Pending", Reason="", readiness=false. Elapsed: 35.971741371s
Oct  5 15:58:58.726: INFO: Pod "pod-subpath-test-dynamicpv-tdn8": Phase="Succeeded", Reason="", readiness=false. Elapsed: 38.081446765s
STEP: Saw pod success
Oct  5 15:58:58.726: INFO: Pod "pod-subpath-test-dynamicpv-tdn8" satisfied condition "Succeeded or Failed"
Oct  5 15:58:58.835: INFO: Trying to get logs from node k8s-agentpool1-35271516-vmss000000 pod pod-subpath-test-dynamicpv-tdn8 container test-container-subpath-dynamicpv-tdn8: <nil>
STEP: delete the pod
Oct  5 15:58:59.067: INFO: Waiting for pod pod-subpath-test-dynamicpv-tdn8 to disappear
Oct  5 15:58:59.219: INFO: Pod pod-subpath-test-dynamicpv-tdn8 no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-tdn8
Oct  5 15:58:59.220: INFO: Deleting pod "pod-subpath-test-dynamicpv-tdn8" in namespace "provisioning-6705"
... skipping 23 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should support existing single file [LinuxOnly]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:219
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath should support existing single file [LinuxOnly]","total":18,"completed":6,"skipped":609,"failed":1,"failures":["External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand should resize volume when PVC is edited while pod is using it"]}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] provisioning 
  should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/provisioning.go:201
... skipping 100 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] provisioning
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/provisioning.go:201
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource]","total":15,"completed":4,"skipped":862,"failed":1,"failures":["External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand should resize volume when PVC is edited while pod is using it"]}
[BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct  5 16:00:17.488: INFO: Driver test.csi.azure.com doesn't support ntfs -- skipping
[AfterEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 105 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (filesystem volmode)] volumeMode
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should not mount / map unused volumes in a pod [LinuxOnly]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:351
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (filesystem volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]","total":18,"completed":7,"skipped":656,"failed":1,"failures":["External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand should resize volume when PVC is edited while pod is using it"]}

SSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (ntfs)(allowExpansion)][Feature:Windows] volume-expand
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct  5 16:00:37.979: INFO: Driver test.csi.azure.com doesn't support ntfs -- skipping
... skipping 119 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (block volmode)] volumeMode
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should not mount / map unused volumes in a pod [LinuxOnly]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:351
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (block volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]","total":18,"completed":8,"skipped":834,"failed":1,"failures":["External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand should resize volume when PVC is edited while pod is using it"]}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct  5 16:01:37.171: INFO: Driver test.csi.azure.com doesn't support ntfs -- skipping
... skipping 78 lines ...
Oct  5 16:01:37.252: INFO: Running AfterSuite actions on node 1



Summarizing 2 Failures:

[Fail] External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand [Measurement] should resize volume when PVC is edited while pod is using it 
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volume_expand.go:288

[Fail] External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand [Measurement] should resize volume when PVC is edited while pod is using it 
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volume_expand.go:288

Ran 36 of 6664 Specs in 1735.069 seconds
FAIL! -- 34 Passed | 2 Failed | 0 Pending | 6628 Skipped 

Ginkgo ran 1 suite in 28m59.665814841s
Test Suite Failed
+ print_logs
+ sed -i s/disk.csi.azure.com/test.csi.azure.com/g deploy/example/storageclass-azuredisk-csi.yaml
+ bash ./hack/verify-examples.sh linux azurepubliccloud ephemeral test
begin to create deployment examples ...
storageclass.storage.k8s.io/managed-csi created
Applying config "deploy/example/deployment.yaml"
... skipping 73 lines ...
Platform: linux/amd64
Topology Key: topology.test.csi.azure.com/zone

Streaming logs below:
I1005 15:32:33.626085       1 azuredisk.go:139] driver userAgent: test.csi.azure.com/v1.8.0-8412a9b9582277d9ca97974b5d2601e9b23694a4 gc/go1.17.1 (amd64-linux) e2e-test
I1005 15:32:33.627286       1 azure_disk_utils.go:137] reading cloud config from secret kube-system/azure-cloud-provider
W1005 15:32:33.658524       1 azure_disk_utils.go:144] InitializeCloudFromSecret: failed to get cloud config from secret kube-system/azure-cloud-provider: failed to get secret kube-system/azure-cloud-provider: secrets "azure-cloud-provider" not found
I1005 15:32:33.658549       1 azure_disk_utils.go:149] could not read cloud config from secret kube-system/azure-cloud-provider
I1005 15:32:33.658555       1 azure_disk_utils.go:159] use default AZURE_CREDENTIAL_FILE env var: /etc/kubernetes/azure.json
I1005 15:32:33.658573       1 azure_disk_utils.go:167] read cloud config from file: /etc/kubernetes/azure.json successfully
I1005 15:32:33.722944       1 azure_auth.go:234] Using AzurePublicCloud environment
I1005 15:32:33.722968       1 azure_auth.go:96] azure: using managed identity extension to retrieve access token
I1005 15:32:33.722993       1 azure_auth.go:102] azure: using User Assigned MSI ID to retrieve access token
... skipping 101 lines ...
Platform: linux/amd64
Topology Key: topology.test.csi.azure.com/zone

Streaming logs below:
I1005 15:32:26.546586       1 azuredisk.go:139] driver userAgent: test.csi.azure.com/v1.8.0-8412a9b9582277d9ca97974b5d2601e9b23694a4 gc/go1.17.1 (amd64-linux) e2e-test
I1005 15:32:26.547794       1 azure_disk_utils.go:137] reading cloud config from secret kube-system/azure-cloud-provider
W1005 15:32:26.643259       1 azure_disk_utils.go:144] InitializeCloudFromSecret: failed to get cloud config from secret kube-system/azure-cloud-provider: failed to get secret kube-system/azure-cloud-provider: secrets "azure-cloud-provider" not found
I1005 15:32:26.643405       1 azure_disk_utils.go:149] could not read cloud config from secret kube-system/azure-cloud-provider
I1005 15:32:26.643415       1 azure_disk_utils.go:159] use default AZURE_CREDENTIAL_FILE env var: /etc/kubernetes/azure.json
I1005 15:32:26.643470       1 azure_disk_utils.go:167] read cloud config from file: /etc/kubernetes/azure.json successfully
I1005 15:32:26.644195       1 azure_auth.go:234] Using AzurePublicCloud environment
I1005 15:32:26.644214       1 azure_auth.go:96] azure: using managed identity extension to retrieve access token
I1005 15:32:26.644236       1 azure_auth.go:102] azure: using User Assigned MSI ID to retrieve access token
... skipping 89 lines ...
I1005 15:32:45.255135       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:32:45.255180       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-6996fdb3-f757-4044-ae54-b9343f09d6f4","parameters":{"csi.storage.k8s.io/pv/name":"pvc-6996fdb3-f757-4044-ae54-b9343f09d6f4","csi.storage.k8s.io/pvc/name":"test.csi.azure.comd44sw","csi.storage.k8s.io/pvc/namespace":"provisioning-6795"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:32:45.343054       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:32:45.343086       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-469b220d-af6b-4bdb-863c-463ed8b0bd25","parameters":{"csi.storage.k8s.io/pv/name":"pvc-469b220d-af6b-4bdb-863c-463ed8b0bd25","csi.storage.k8s.io/pvc/name":"test.csi.azure.com5gbjq","csi.storage.k8s.io/pvc/namespace":"fsgroupchangepolicy-5534"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:32:45.343291       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:32:45.343325       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-efdac82f-9f35-4fb3-a8c1-6b420052c12c","parameters":{"csi.storage.k8s.io/pv/name":"pvc-efdac82f-9f35-4fb3-a8c1-6b420052c12c","csi.storage.k8s.io/pvc/name":"test.csi.azure.comfrzmm","csi.storage.k8s.io/pvc/namespace":"provisioning-4220"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:32:45.669831       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-6996fdb3-f757-4044-ae54-b9343f09d6f4, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-6996fdb3-f757-4044-ae54-b9343f09d6f4' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:32:45.670035       1 controllerserver.go:271] begin to create azure disk(pvc-6996fdb3-f757-4044-ae54-b9343f09d6f4) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:32:45.670079       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-6996fdb3-f757-4044-ae54-b9343f09d6f4 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:32:45.819967       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:32:45.819992       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-b9b2e984-6896-40b6-b551-6b4cd298d4f2","parameters":{"csi.storage.k8s.io/pv/name":"pvc-b9b2e984-6896-40b6-b551-6b4cd298d4f2","csi.storage.k8s.io/pvc/name":"inline-volume-tester-7khl7-my-volume-0","csi.storage.k8s.io/pvc/namespace":"ephemeral-4672"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:32:45.884462       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-b9b2e984-6896-40b6-b551-6b4cd298d4f2, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-b9b2e984-6896-40b6-b551-6b4cd298d4f2' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:32:45.884571       1 controllerserver.go:271] begin to create azure disk(pvc-b9b2e984-6896-40b6-b551-6b4cd298d4f2) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:32:45.884583       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-b9b2e984-6896-40b6-b551-6b4cd298d4f2 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:32:46.728578       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:32:46.728603       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-a61c6a08-4907-4725-8079-677e36da4a6b","parameters":{"csi.storage.k8s.io/pv/name":"pvc-a61c6a08-4907-4725-8079-677e36da4a6b","csi.storage.k8s.io/pvc/name":"test.csi.azure.comrmvd4","csi.storage.k8s.io/pvc/namespace":"volumelimits-8266"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:32:46.748606       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-a61c6a08-4907-4725-8079-677e36da4a6b, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-a61c6a08-4907-4725-8079-677e36da4a6b' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:32:46.748770       1 controllerserver.go:271] begin to create azure disk(pvc-a61c6a08-4907-4725-8079-677e36da4a6b) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:32:46.748786       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-a61c6a08-4907-4725-8079-677e36da4a6b StorageAccountType:StandardSSD_LRS Size:5
I1005 15:32:46.754007       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:32:46.754029       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-c1d29047-58fd-4634-a4ec-2a8cdf5ce767","parameters":{"csi.storage.k8s.io/pv/name":"pvc-c1d29047-58fd-4634-a4ec-2a8cdf5ce767","csi.storage.k8s.io/pvc/name":"test.csi.azure.comjvj7g","csi.storage.k8s.io/pvc/namespace":"volume-3356"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:32:46.773177       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-c1d29047-58fd-4634-a4ec-2a8cdf5ce767, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-c1d29047-58fd-4634-a4ec-2a8cdf5ce767' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:32:46.773274       1 controllerserver.go:271] begin to create azure disk(pvc-c1d29047-58fd-4634-a4ec-2a8cdf5ce767) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:32:46.773288       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-c1d29047-58fd-4634-a4ec-2a8cdf5ce767 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:32:47.966357       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:32:47.966385       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-43774747-ffed-4bc4-bd3c-22d6b0664129","parameters":{"csi.storage.k8s.io/pv/name":"pvc-43774747-ffed-4bc4-bd3c-22d6b0664129","csi.storage.k8s.io/pvc/name":"inline-volume-tester-94gc9-my-volume-0","csi.storage.k8s.io/pvc/namespace":"ephemeral-6742"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:32:47.985167       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-43774747-ffed-4bc4-bd3c-22d6b0664129, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-43774747-ffed-4bc4-bd3c-22d6b0664129' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:32:47.985241       1 controllerserver.go:271] begin to create azure disk(pvc-43774747-ffed-4bc4-bd3c-22d6b0664129) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:32:47.985254       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-43774747-ffed-4bc4-bd3c-22d6b0664129 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:32:48.100978       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-6996fdb3-f757-4044-ae54-b9343f09d6f4 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:32:48.101040       1 controllerserver.go:348] create azure disk(pvc-6996fdb3-f757-4044-ae54-b9343f09d6f4) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-6996fdb3-f757-4044-ae54-b9343f09d6f4 kubernetes.io-created-for-pvc-name:test.csi.azure.comd44sw kubernetes.io-created-for-pvc-namespace:provisioning-6795]) successfully
I1005 15:32:48.101088       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-6996fdb3-f757-4044-ae54-b9343f09d6f4","csi.storage.k8s.io/pvc/name":"test.csi.azure.comd44sw","csi.storage.k8s.io/pvc/namespace":"provisioning-6795","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-6996fdb3-f757-4044-ae54-b9343f09d6f4"}}
I1005 15:32:48.287092       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-b9b2e984-6896-40b6-b551-6b4cd298d4f2 StorageAccountType:StandardSSD_LRS Size:5
... skipping 11 lines ...
I1005 15:32:49.268654       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-a61c6a08-4907-4725-8079-677e36da4a6b","csi.storage.k8s.io/pvc/name":"test.csi.azure.comrmvd4","csi.storage.k8s.io/pvc/namespace":"volumelimits-8266","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-a61c6a08-4907-4725-8079-677e36da4a6b"}}
I1005 15:32:49.464845       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-b9b2e984-6896-40b6-b551-6b4cd298d4f2" to node "k8s-agentpool1-35271516-vmss000000"
I1005 15:32:49.464889       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:32:49.464908       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-b9b2e984-6896-40b6-b551-6b4cd298d4f2" lun 0 to node "k8s-agentpool1-35271516-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-b9b2e984-6896-40b6-b551-6b4cd298d4f2:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-b9b2e984-6896-40b6-b551-6b4cd298d4f2  true false 0})]
I1005 15:32:49.464967       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:32:49.465013       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-b9b2e984-6896-40b6-b551-6b4cd298d4f2:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-b9b2e984-6896-40b6-b551-6b4cd298d4f2  true false 0})])
I1005 15:32:49.891068       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-b9b2e984-6896-40b6-b551-6b4cd298d4f2:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-b9b2e984-6896-40b6-b551-6b4cd298d4f2  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1005 15:32:49.955537       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
I1005 15:32:49.955565       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-35271516-vmss000000","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":7}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-6996fdb3-f757-4044-ae54-b9343f09d6f4","csi.storage.k8s.io/pvc/name":"test.csi.azure.comd44sw","csi.storage.k8s.io/pvc/namespace":"provisioning-6795","requestedsizegib":"5","storage.kubernetes.io/csiProvisionerIdentity":"1633447947345-8081-test.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-6996fdb3-f757-4044-ae54-b9343f09d6f4"}
I1005 15:32:49.982765       1 controllerserver.go:440] GetDiskLun returned: <nil>. Initiating attaching volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-6996fdb3-f757-4044-ae54-b9343f09d6f4" to node "k8s-agentpool1-35271516-vmss000000".
I1005 15:32:49.982798       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:32:49.982816       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-35271516-vmss000000, refreshing the cache
I1005 15:32:50.056202       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-6996fdb3-f757-4044-ae54-b9343f09d6f4" to node "k8s-agentpool1-35271516-vmss000000"
I1005 15:32:50.056233       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:32:50.056248       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-6996fdb3-f757-4044-ae54-b9343f09d6f4" lun 1 to node "k8s-agentpool1-35271516-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-6996fdb3-f757-4044-ae54-b9343f09d6f4:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-6996fdb3-f757-4044-ae54-b9343f09d6f4  true false 1})]
I1005 15:32:50.056263       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:32:50.056274       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-6996fdb3-f757-4044-ae54-b9343f09d6f4:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-6996fdb3-f757-4044-ae54-b9343f09d6f4  true false 1})])
I1005 15:32:50.281881       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-6996fdb3-f757-4044-ae54-b9343f09d6f4:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-6996fdb3-f757-4044-ae54-b9343f09d6f4  true false 1})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1005 15:32:50.306135       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-43774747-ffed-4bc4-bd3c-22d6b0664129 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:32:50.306188       1 controllerserver.go:348] create azure disk(pvc-43774747-ffed-4bc4-bd3c-22d6b0664129) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-43774747-ffed-4bc4-bd3c-22d6b0664129 kubernetes.io-created-for-pvc-name:inline-volume-tester-94gc9-my-volume-0 kubernetes.io-created-for-pvc-namespace:ephemeral-6742]) successfully
I1005 15:32:50.306211       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-43774747-ffed-4bc4-bd3c-22d6b0664129","csi.storage.k8s.io/pvc/name":"inline-volume-tester-94gc9-my-volume-0","csi.storage.k8s.io/pvc/namespace":"ephemeral-6742","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-43774747-ffed-4bc4-bd3c-22d6b0664129"}}
I1005 15:32:51.242279       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
I1005 15:32:51.242307       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-35271516-vmss000001","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":7}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-43774747-ffed-4bc4-bd3c-22d6b0664129","csi.storage.k8s.io/pvc/name":"inline-volume-tester-94gc9-my-volume-0","csi.storage.k8s.io/pvc/namespace":"ephemeral-6742","requestedsizegib":"5","storage.kubernetes.io/csiProvisionerIdentity":"1633447947345-8081-test.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-43774747-ffed-4bc4-bd3c-22d6b0664129"}
I1005 15:32:51.355994       1 controllerserver.go:440] GetDiskLun returned: <nil>. Initiating attaching volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-43774747-ffed-4bc4-bd3c-22d6b0664129" to node "k8s-agentpool1-35271516-vmss000001".
... skipping 2 lines ...
I1005 15:32:51.356086       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:32:51.356097       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-43774747-ffed-4bc4-bd3c-22d6b0664129" lun 0 to node "k8s-agentpool1-35271516-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-43774747-ffed-4bc4-bd3c-22d6b0664129:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-43774747-ffed-4bc4-bd3c-22d6b0664129  true false 0})]
I1005 15:32:51.356133       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:32:51.356163       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-43774747-ffed-4bc4-bd3c-22d6b0664129:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-43774747-ffed-4bc4-bd3c-22d6b0664129  true false 0})])
I1005 15:32:51.385888       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:32:51.385909       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-18a5b3fc-fda9-42b4-8f9f-345b9ba4485d","parameters":{"csi.storage.k8s.io/pv/name":"pvc-18a5b3fc-fda9-42b4-8f9f-345b9ba4485d","csi.storage.k8s.io/pvc/name":"pvc-29mjc","csi.storage.k8s.io/pvc/namespace":"volumelimits-8266"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:32:51.404548       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-18a5b3fc-fda9-42b4-8f9f-345b9ba4485d, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-18a5b3fc-fda9-42b4-8f9f-345b9ba4485d' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:32:51.404656       1 controllerserver.go:271] begin to create azure disk(pvc-18a5b3fc-fda9-42b4-8f9f-345b9ba4485d) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:32:51.404671       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-18a5b3fc-fda9-42b4-8f9f-345b9ba4485d StorageAccountType:StandardSSD_LRS Size:5
I1005 15:32:51.467375       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
I1005 15:32:51.467394       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-35271516-vmss000001","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":7}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-c1d29047-58fd-4634-a4ec-2a8cdf5ce767","csi.storage.k8s.io/pvc/name":"test.csi.azure.comjvj7g","csi.storage.k8s.io/pvc/namespace":"volume-3356","requestedsizegib":"5","storage.kubernetes.io/csiProvisionerIdentity":"1633447947345-8081-test.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-c1d29047-58fd-4634-a4ec-2a8cdf5ce767"}
I1005 15:32:51.491965       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:32:51.491986       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-9fd5f8d8-7e49-4206-be01-9d9b78035de8","parameters":{"csi.storage.k8s.io/pv/name":"pvc-9fd5f8d8-7e49-4206-be01-9d9b78035de8","csi.storage.k8s.io/pvc/name":"pvc-ffkjj","csi.storage.k8s.io/pvc/namespace":"volumelimits-8266"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:32:51.530487       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-9fd5f8d8-7e49-4206-be01-9d9b78035de8, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-9fd5f8d8-7e49-4206-be01-9d9b78035de8' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:32:51.530613       1 controllerserver.go:271] begin to create azure disk(pvc-9fd5f8d8-7e49-4206-be01-9d9b78035de8) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:32:51.530625       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-9fd5f8d8-7e49-4206-be01-9d9b78035de8 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:32:51.535317       1 controllerserver.go:440] GetDiskLun returned: <nil>. Initiating attaching volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-c1d29047-58fd-4634-a4ec-2a8cdf5ce767" to node "k8s-agentpool1-35271516-vmss000001".
I1005 15:32:51.535345       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:32:51.535361       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-c1d29047-58fd-4634-a4ec-2a8cdf5ce767" to node "k8s-agentpool1-35271516-vmss000001"
I1005 15:32:51.609829       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:32:51.609881       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-386107df-96f8-4c5c-bce8-42b64d9d030d","parameters":{"csi.storage.k8s.io/pv/name":"pvc-386107df-96f8-4c5c-bce8-42b64d9d030d","csi.storage.k8s.io/pvc/name":"pvc-xnpzh","csi.storage.k8s.io/pvc/namespace":"volumelimits-8266"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:32:51.631389       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-386107df-96f8-4c5c-bce8-42b64d9d030d, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-386107df-96f8-4c5c-bce8-42b64d9d030d' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:32:51.631500       1 controllerserver.go:271] begin to create azure disk(pvc-386107df-96f8-4c5c-bce8-42b64d9d030d) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:32:51.631542       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-386107df-96f8-4c5c-bce8-42b64d9d030d StorageAccountType:StandardSSD_LRS Size:5
I1005 15:32:51.720167       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:32:51.720210       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-22b9fe01-edf1-4560-8956-05a355e670df","parameters":{"csi.storage.k8s.io/pv/name":"pvc-22b9fe01-edf1-4560-8956-05a355e670df","csi.storage.k8s.io/pvc/name":"pvc-wv9vm","csi.storage.k8s.io/pvc/namespace":"volumelimits-8266"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:32:51.737404       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-22b9fe01-edf1-4560-8956-05a355e670df, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-22b9fe01-edf1-4560-8956-05a355e670df' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:32:51.737466       1 controllerserver.go:271] begin to create azure disk(pvc-22b9fe01-edf1-4560-8956-05a355e670df) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:32:51.737488       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-22b9fe01-edf1-4560-8956-05a355e670df StorageAccountType:StandardSSD_LRS Size:5
I1005 15:32:51.772097       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-43774747-ffed-4bc4-bd3c-22d6b0664129:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-43774747-ffed-4bc4-bd3c-22d6b0664129  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1005 15:32:51.772330       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:32:51.772380       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-35271516-vmss000001, refreshing the cache
I1005 15:32:51.820131       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-c1d29047-58fd-4634-a4ec-2a8cdf5ce767" lun 1 to node "k8s-agentpool1-35271516-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-c1d29047-58fd-4634-a4ec-2a8cdf5ce767:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-c1d29047-58fd-4634-a4ec-2a8cdf5ce767  true false 1})]
I1005 15:32:51.820163       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:32:51.820196       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-c1d29047-58fd-4634-a4ec-2a8cdf5ce767:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-c1d29047-58fd-4634-a4ec-2a8cdf5ce767  true false 1})])
I1005 15:32:51.829192       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:32:51.829215       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-0e466a66-660b-4917-ba77-72beb04c4e56","parameters":{"csi.storage.k8s.io/pv/name":"pvc-0e466a66-660b-4917-ba77-72beb04c4e56","csi.storage.k8s.io/pvc/name":"pvc-qbljl","csi.storage.k8s.io/pvc/namespace":"volumelimits-8266"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:32:51.847182       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-0e466a66-660b-4917-ba77-72beb04c4e56, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-0e466a66-660b-4917-ba77-72beb04c4e56' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:32:51.847273       1 controllerserver.go:271] begin to create azure disk(pvc-0e466a66-660b-4917-ba77-72beb04c4e56) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:32:51.847307       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-0e466a66-660b-4917-ba77-72beb04c4e56 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:32:51.937246       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:32:51.937271       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-309b3973-86d5-4cc3-9275-404c6a423244","parameters":{"csi.storage.k8s.io/pv/name":"pvc-309b3973-86d5-4cc3-9275-404c6a423244","csi.storage.k8s.io/pvc/name":"pvc-mchw7","csi.storage.k8s.io/pvc/namespace":"volumelimits-8266"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:32:52.000095       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-309b3973-86d5-4cc3-9275-404c6a423244, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-309b3973-86d5-4cc3-9275-404c6a423244' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:32:52.000296       1 controllerserver.go:271] begin to create azure disk(pvc-309b3973-86d5-4cc3-9275-404c6a423244) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:32:52.000317       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-309b3973-86d5-4cc3-9275-404c6a423244 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:32:52.045696       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:32:52.045718       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-b186a7a5-d621-4d78-9215-933abd4be408","parameters":{"csi.storage.k8s.io/pv/name":"pvc-b186a7a5-d621-4d78-9215-933abd4be408","csi.storage.k8s.io/pvc/name":"pvc-hwzdb","csi.storage.k8s.io/pvc/namespace":"volumelimits-8266"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:32:52.154344       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:32:52.154371       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-6ef9c8dc-fc75-4674-b3b7-2bbae0ecba20","parameters":{"csi.storage.k8s.io/pv/name":"pvc-6ef9c8dc-fc75-4674-b3b7-2bbae0ecba20","csi.storage.k8s.io/pvc/name":"pvc-pzhxr","csi.storage.k8s.io/pvc/namespace":"volumelimits-8266"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:32:52.168525       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-c1d29047-58fd-4634-a4ec-2a8cdf5ce767:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-c1d29047-58fd-4634-a4ec-2a8cdf5ce767  true false 1})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1005 15:32:52.175381       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-6ef9c8dc-fc75-4674-b3b7-2bbae0ecba20, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-6ef9c8dc-fc75-4674-b3b7-2bbae0ecba20' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:32:52.175516       1 controllerserver.go:271] begin to create azure disk(pvc-6ef9c8dc-fc75-4674-b3b7-2bbae0ecba20) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:32:52.175530       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-6ef9c8dc-fc75-4674-b3b7-2bbae0ecba20 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:32:52.188549       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-b186a7a5-d621-4d78-9215-933abd4be408, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-b186a7a5-d621-4d78-9215-933abd4be408' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:32:52.188620       1 controllerserver.go:271] begin to create azure disk(pvc-b186a7a5-d621-4d78-9215-933abd4be408) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:32:52.188651       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-b186a7a5-d621-4d78-9215-933abd4be408 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:32:52.267295       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:32:52.267321       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-8876a4f7-7d0c-4ad8-89c2-37439e18527a","parameters":{"csi.storage.k8s.io/pv/name":"pvc-8876a4f7-7d0c-4ad8-89c2-37439e18527a","csi.storage.k8s.io/pvc/name":"pvc-hqqbb","csi.storage.k8s.io/pvc/namespace":"volumelimits-8266"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:32:52.286912       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-8876a4f7-7d0c-4ad8-89c2-37439e18527a, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-8876a4f7-7d0c-4ad8-89c2-37439e18527a' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:32:52.286988       1 controllerserver.go:271] begin to create azure disk(pvc-8876a4f7-7d0c-4ad8-89c2-37439e18527a) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:32:52.287056       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-8876a4f7-7d0c-4ad8-89c2-37439e18527a StorageAccountType:StandardSSD_LRS Size:5
I1005 15:32:52.376031       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:32:52.376175       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-2a06c584-15f4-46ea-9d7a-2a7efa44b458","parameters":{"csi.storage.k8s.io/pv/name":"pvc-2a06c584-15f4-46ea-9d7a-2a7efa44b458","csi.storage.k8s.io/pvc/name":"pvc-s52lx","csi.storage.k8s.io/pvc/namespace":"volumelimits-8266"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:32:52.396983       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-2a06c584-15f4-46ea-9d7a-2a7efa44b458, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-2a06c584-15f4-46ea-9d7a-2a7efa44b458' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:32:52.397084       1 controllerserver.go:271] begin to create azure disk(pvc-2a06c584-15f4-46ea-9d7a-2a7efa44b458) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:32:52.397098       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-2a06c584-15f4-46ea-9d7a-2a7efa44b458 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:32:52.487773       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:32:52.487794       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-ecddc8e6-1743-42d2-953c-7c5d3f767704","parameters":{"csi.storage.k8s.io/pv/name":"pvc-ecddc8e6-1743-42d2-953c-7c5d3f767704","csi.storage.k8s.io/pvc/name":"pvc-nwt95","csi.storage.k8s.io/pvc/namespace":"volumelimits-8266"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:32:52.506257       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-ecddc8e6-1743-42d2-953c-7c5d3f767704, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-ecddc8e6-1743-42d2-953c-7c5d3f767704' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:32:52.506352       1 controllerserver.go:271] begin to create azure disk(pvc-ecddc8e6-1743-42d2-953c-7c5d3f767704) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:32:52.506363       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-ecddc8e6-1743-42d2-953c-7c5d3f767704 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:32:52.597620       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:32:52.597643       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-79f9f558-0a63-4e9a-a428-d45a3dc8d594","parameters":{"csi.storage.k8s.io/pv/name":"pvc-79f9f558-0a63-4e9a-a428-d45a3dc8d594","csi.storage.k8s.io/pvc/name":"pvc-xtt2r","csi.storage.k8s.io/pvc/namespace":"volumelimits-8266"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:32:52.709608       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:32:52.709638       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-4b60fcee-8d14-402e-81b1-45efe61d0cbe","parameters":{"csi.storage.k8s.io/pv/name":"pvc-4b60fcee-8d14-402e-81b1-45efe61d0cbe","csi.storage.k8s.io/pvc/name":"pvc-svkk6","csi.storage.k8s.io/pvc/namespace":"volumelimits-8266"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:32:52.744467       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-79f9f558-0a63-4e9a-a428-d45a3dc8d594, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-79f9f558-0a63-4e9a-a428-d45a3dc8d594' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:32:52.744595       1 controllerserver.go:271] begin to create azure disk(pvc-79f9f558-0a63-4e9a-a428-d45a3dc8d594) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:32:52.744626       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-79f9f558-0a63-4e9a-a428-d45a3dc8d594 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:32:52.754450       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-4b60fcee-8d14-402e-81b1-45efe61d0cbe, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-4b60fcee-8d14-402e-81b1-45efe61d0cbe' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:32:52.754509       1 controllerserver.go:271] begin to create azure disk(pvc-4b60fcee-8d14-402e-81b1-45efe61d0cbe) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:32:52.754520       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-4b60fcee-8d14-402e-81b1-45efe61d0cbe StorageAccountType:StandardSSD_LRS Size:5
I1005 15:32:52.818189       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:32:52.818217       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-809a8a7c-d606-4428-9d0f-c2069767c511","parameters":{"csi.storage.k8s.io/pv/name":"pvc-809a8a7c-d606-4428-9d0f-c2069767c511","csi.storage.k8s.io/pvc/name":"pvc-cdnw5","csi.storage.k8s.io/pvc/namespace":"volumelimits-8266"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:32:52.837213       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-809a8a7c-d606-4428-9d0f-c2069767c511, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-809a8a7c-d606-4428-9d0f-c2069767c511' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:32:52.837341       1 controllerserver.go:271] begin to create azure disk(pvc-809a8a7c-d606-4428-9d0f-c2069767c511) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:32:52.837358       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-809a8a7c-d606-4428-9d0f-c2069767c511 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:32:52.926953       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:32:52.926980       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-dfd85c6a-9a7f-44bc-b0e4-eb64246bbcd8","parameters":{"csi.storage.k8s.io/pv/name":"pvc-dfd85c6a-9a7f-44bc-b0e4-eb64246bbcd8","csi.storage.k8s.io/pvc/name":"pvc-krtwm","csi.storage.k8s.io/pvc/namespace":"volumelimits-8266"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:32:52.948462       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-dfd85c6a-9a7f-44bc-b0e4-eb64246bbcd8, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-dfd85c6a-9a7f-44bc-b0e4-eb64246bbcd8' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:32:52.948545       1 controllerserver.go:271] begin to create azure disk(pvc-dfd85c6a-9a7f-44bc-b0e4-eb64246bbcd8) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:32:52.948602       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-dfd85c6a-9a7f-44bc-b0e4-eb64246bbcd8 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:32:53.035217       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:32:53.035261       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-206a2766-a59c-43f1-b9e8-c4765b5b4784","parameters":{"csi.storage.k8s.io/pv/name":"pvc-206a2766-a59c-43f1-b9e8-c4765b5b4784","csi.storage.k8s.io/pvc/name":"pvc-qj9zw","csi.storage.k8s.io/pvc/namespace":"volumelimits-8266"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:32:53.054091       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-206a2766-a59c-43f1-b9e8-c4765b5b4784, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-206a2766-a59c-43f1-b9e8-c4765b5b4784' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:32:53.054217       1 controllerserver.go:271] begin to create azure disk(pvc-206a2766-a59c-43f1-b9e8-c4765b5b4784) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:32:53.054234       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-206a2766-a59c-43f1-b9e8-c4765b5b4784 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:32:53.145970       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:32:53.145996       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-12bcf88a-f3a4-471c-92b5-9d41389eb683","parameters":{"csi.storage.k8s.io/pv/name":"pvc-12bcf88a-f3a4-471c-92b5-9d41389eb683","csi.storage.k8s.io/pvc/name":"pvc-qgqdk","csi.storage.k8s.io/pvc/namespace":"volumelimits-8266"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:32:53.165218       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-12bcf88a-f3a4-471c-92b5-9d41389eb683, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-12bcf88a-f3a4-471c-92b5-9d41389eb683' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:32:53.165281       1 controllerserver.go:271] begin to create azure disk(pvc-12bcf88a-f3a4-471c-92b5-9d41389eb683) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:32:53.165302       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-12bcf88a-f3a4-471c-92b5-9d41389eb683 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:32:53.255693       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:32:53.255716       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-5cc2f503-b883-4209-8c7c-221e2372c996","parameters":{"csi.storage.k8s.io/pv/name":"pvc-5cc2f503-b883-4209-8c7c-221e2372c996","csi.storage.k8s.io/pvc/name":"pvc-6fslm","csi.storage.k8s.io/pvc/namespace":"volumelimits-8266"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:32:53.275990       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-5cc2f503-b883-4209-8c7c-221e2372c996, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-5cc2f503-b883-4209-8c7c-221e2372c996' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:32:53.276162       1 controllerserver.go:271] begin to create azure disk(pvc-5cc2f503-b883-4209-8c7c-221e2372c996) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:32:53.276176       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-5cc2f503-b883-4209-8c7c-221e2372c996 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:32:53.365617       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:32:53.365635       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-d5e0b720-bc05-435b-bf4b-94ad3d91cda8","parameters":{"csi.storage.k8s.io/pv/name":"pvc-d5e0b720-bc05-435b-bf4b-94ad3d91cda8","csi.storage.k8s.io/pvc/name":"pvc-nf88k","csi.storage.k8s.io/pvc/namespace":"volumelimits-8266"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:32:53.384711       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-d5e0b720-bc05-435b-bf4b-94ad3d91cda8, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-d5e0b720-bc05-435b-bf4b-94ad3d91cda8' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:32:53.384789       1 controllerserver.go:271] begin to create azure disk(pvc-d5e0b720-bc05-435b-bf4b-94ad3d91cda8) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:32:53.384802       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-d5e0b720-bc05-435b-bf4b-94ad3d91cda8 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:32:53.474905       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:32:53.474933       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-27ff6a26-7023-4a22-a7ef-05b82e08b4e2","parameters":{"csi.storage.k8s.io/pv/name":"pvc-27ff6a26-7023-4a22-a7ef-05b82e08b4e2","csi.storage.k8s.io/pvc/name":"pvc-lwvp8","csi.storage.k8s.io/pvc/namespace":"volumelimits-8266"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:32:53.495145       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-27ff6a26-7023-4a22-a7ef-05b82e08b4e2, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-27ff6a26-7023-4a22-a7ef-05b82e08b4e2' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:32:53.495218       1 controllerserver.go:271] begin to create azure disk(pvc-27ff6a26-7023-4a22-a7ef-05b82e08b4e2) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:32:53.495232       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-27ff6a26-7023-4a22-a7ef-05b82e08b4e2 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:32:53.582146       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:32:53.582170       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-966a20f6-7ce4-4dab-80d5-ca44b1977ad8","parameters":{"csi.storage.k8s.io/pv/name":"pvc-966a20f6-7ce4-4dab-80d5-ca44b1977ad8","csi.storage.k8s.io/pvc/name":"pvc-h48tg","csi.storage.k8s.io/pvc/namespace":"volumelimits-8266"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:32:53.601579       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-966a20f6-7ce4-4dab-80d5-ca44b1977ad8, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-966a20f6-7ce4-4dab-80d5-ca44b1977ad8' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:32:53.601663       1 controllerserver.go:271] begin to create azure disk(pvc-966a20f6-7ce4-4dab-80d5-ca44b1977ad8) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:32:53.601692       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-966a20f6-7ce4-4dab-80d5-ca44b1977ad8 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:32:53.695080       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:32:53.695102       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-5e8eb74a-406f-4921-bad1-a2bc9a9fdb75","parameters":{"csi.storage.k8s.io/pv/name":"pvc-5e8eb74a-406f-4921-bad1-a2bc9a9fdb75","csi.storage.k8s.io/pvc/name":"pvc-kndsf","csi.storage.k8s.io/pvc/namespace":"volumelimits-8266"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:32:53.713586       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-5e8eb74a-406f-4921-bad1-a2bc9a9fdb75, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-5e8eb74a-406f-4921-bad1-a2bc9a9fdb75' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:32:53.713655       1 controllerserver.go:271] begin to create azure disk(pvc-5e8eb74a-406f-4921-bad1-a2bc9a9fdb75) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:32:53.713667       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-5e8eb74a-406f-4921-bad1-a2bc9a9fdb75 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:32:53.800362       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:32:53.800382       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-a1292d7f-302c-4e15-9f27-8c756100845c","parameters":{"csi.storage.k8s.io/pv/name":"pvc-a1292d7f-302c-4e15-9f27-8c756100845c","csi.storage.k8s.io/pvc/name":"pvc-kh7jz","csi.storage.k8s.io/pvc/namespace":"volumelimits-8266"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:32:53.818950       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-a1292d7f-302c-4e15-9f27-8c756100845c, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-a1292d7f-302c-4e15-9f27-8c756100845c' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:32:53.819072       1 controllerserver.go:271] begin to create azure disk(pvc-a1292d7f-302c-4e15-9f27-8c756100845c) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:32:53.819104       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-a1292d7f-302c-4e15-9f27-8c756100845c StorageAccountType:StandardSSD_LRS Size:5
I1005 15:32:53.845683       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-18a5b3fc-fda9-42b4-8f9f-345b9ba4485d StorageAccountType:StandardSSD_LRS Size:5
I1005 15:32:53.845738       1 controllerserver.go:348] create azure disk(pvc-18a5b3fc-fda9-42b4-8f9f-345b9ba4485d) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-18a5b3fc-fda9-42b4-8f9f-345b9ba4485d kubernetes.io-created-for-pvc-name:pvc-29mjc kubernetes.io-created-for-pvc-namespace:volumelimits-8266]) successfully
I1005 15:32:53.845788       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-18a5b3fc-fda9-42b4-8f9f-345b9ba4485d","csi.storage.k8s.io/pvc/name":"pvc-29mjc","csi.storage.k8s.io/pvc/namespace":"volumelimits-8266","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-18a5b3fc-fda9-42b4-8f9f-345b9ba4485d"}}
I1005 15:32:53.883737       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-9fd5f8d8-7e49-4206-be01-9d9b78035de8 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:32:53.883788       1 controllerserver.go:348] create azure disk(pvc-9fd5f8d8-7e49-4206-be01-9d9b78035de8) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-9fd5f8d8-7e49-4206-be01-9d9b78035de8 kubernetes.io-created-for-pvc-name:pvc-ffkjj kubernetes.io-created-for-pvc-namespace:volumelimits-8266]) successfully
I1005 15:32:53.883824       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-9fd5f8d8-7e49-4206-be01-9d9b78035de8","csi.storage.k8s.io/pvc/name":"pvc-ffkjj","csi.storage.k8s.io/pvc/namespace":"volumelimits-8266","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-9fd5f8d8-7e49-4206-be01-9d9b78035de8"}}
I1005 15:32:53.910363       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:32:53.910404       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-10d10fa8-ebe1-4d36-8922-aacc1360f3b7","parameters":{"csi.storage.k8s.io/pv/name":"pvc-10d10fa8-ebe1-4d36-8922-aacc1360f3b7","csi.storage.k8s.io/pvc/name":"pvc-7lzcm","csi.storage.k8s.io/pvc/namespace":"volumelimits-8266"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:32:53.932821       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-10d10fa8-ebe1-4d36-8922-aacc1360f3b7, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-10d10fa8-ebe1-4d36-8922-aacc1360f3b7' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:32:53.932889       1 controllerserver.go:271] begin to create azure disk(pvc-10d10fa8-ebe1-4d36-8922-aacc1360f3b7) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:32:53.932914       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-10d10fa8-ebe1-4d36-8922-aacc1360f3b7 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:32:54.020604       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:32:54.020630       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-045ffe13-f563-4fe0-a80f-c2ef18fcff0a","parameters":{"csi.storage.k8s.io/pv/name":"pvc-045ffe13-f563-4fe0-a80f-c2ef18fcff0a","csi.storage.k8s.io/pvc/name":"pvc-jvd52","csi.storage.k8s.io/pvc/namespace":"volumelimits-8266"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:32:54.032422       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-386107df-96f8-4c5c-bce8-42b64d9d030d StorageAccountType:StandardSSD_LRS Size:5
I1005 15:32:54.032476       1 controllerserver.go:348] create azure disk(pvc-386107df-96f8-4c5c-bce8-42b64d9d030d) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-386107df-96f8-4c5c-bce8-42b64d9d030d kubernetes.io-created-for-pvc-name:pvc-xnpzh kubernetes.io-created-for-pvc-namespace:volumelimits-8266]) successfully
I1005 15:32:54.032530       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-386107df-96f8-4c5c-bce8-42b64d9d030d","csi.storage.k8s.io/pvc/name":"pvc-xnpzh","csi.storage.k8s.io/pvc/namespace":"volumelimits-8266","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-386107df-96f8-4c5c-bce8-42b64d9d030d"}}
I1005 15:32:54.040331       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-045ffe13-f563-4fe0-a80f-c2ef18fcff0a, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-045ffe13-f563-4fe0-a80f-c2ef18fcff0a' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:32:54.040406       1 controllerserver.go:271] begin to create azure disk(pvc-045ffe13-f563-4fe0-a80f-c2ef18fcff0a) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:32:54.040420       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-045ffe13-f563-4fe0-a80f-c2ef18fcff0a StorageAccountType:StandardSSD_LRS Size:5
I1005 15:32:54.073962       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-22b9fe01-edf1-4560-8956-05a355e670df StorageAccountType:StandardSSD_LRS Size:5
I1005 15:32:54.074028       1 controllerserver.go:348] create azure disk(pvc-22b9fe01-edf1-4560-8956-05a355e670df) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-22b9fe01-edf1-4560-8956-05a355e670df kubernetes.io-created-for-pvc-name:pvc-wv9vm kubernetes.io-created-for-pvc-namespace:volumelimits-8266]) successfully
I1005 15:32:54.074129       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-22b9fe01-edf1-4560-8956-05a355e670df","csi.storage.k8s.io/pvc/name":"pvc-wv9vm","csi.storage.k8s.io/pvc/namespace":"volumelimits-8266","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-22b9fe01-edf1-4560-8956-05a355e670df"}}
I1005 15:32:54.129010       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:32:54.129037       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-2fef4ac7-a62c-4ba6-87a7-307b8f106084","parameters":{"csi.storage.k8s.io/pv/name":"pvc-2fef4ac7-a62c-4ba6-87a7-307b8f106084","csi.storage.k8s.io/pvc/name":"pvc-tj86l","csi.storage.k8s.io/pvc/namespace":"volumelimits-8266"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:32:54.144126       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-0e466a66-660b-4917-ba77-72beb04c4e56 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:32:54.144176       1 controllerserver.go:348] create azure disk(pvc-0e466a66-660b-4917-ba77-72beb04c4e56) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-0e466a66-660b-4917-ba77-72beb04c4e56 kubernetes.io-created-for-pvc-name:pvc-qbljl kubernetes.io-created-for-pvc-namespace:volumelimits-8266]) successfully
I1005 15:32:54.144198       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-0e466a66-660b-4917-ba77-72beb04c4e56","csi.storage.k8s.io/pvc/name":"pvc-qbljl","csi.storage.k8s.io/pvc/namespace":"volumelimits-8266","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-0e466a66-660b-4917-ba77-72beb04c4e56"}}
I1005 15:32:54.149271       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-2fef4ac7-a62c-4ba6-87a7-307b8f106084, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-2fef4ac7-a62c-4ba6-87a7-307b8f106084' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:32:54.149390       1 controllerserver.go:271] begin to create azure disk(pvc-2fef4ac7-a62c-4ba6-87a7-307b8f106084) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:32:54.149402       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-2fef4ac7-a62c-4ba6-87a7-307b8f106084 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:32:54.239353       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:32:54.239379       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-84a78d2e-b641-434e-a52a-75ba80aa7342","parameters":{"csi.storage.k8s.io/pv/name":"pvc-84a78d2e-b641-434e-a52a-75ba80aa7342","csi.storage.k8s.io/pvc/name":"pvc-dcr8d","csi.storage.k8s.io/pvc/namespace":"volumelimits-8266"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:32:54.257848       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-84a78d2e-b641-434e-a52a-75ba80aa7342, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-84a78d2e-b641-434e-a52a-75ba80aa7342' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:32:54.257941       1 controllerserver.go:271] begin to create azure disk(pvc-84a78d2e-b641-434e-a52a-75ba80aa7342) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:32:54.257954       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-84a78d2e-b641-434e-a52a-75ba80aa7342 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:32:54.353284       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:32:54.353306       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-1449718c-8240-4f3b-9b9d-73dff2f1c007","parameters":{"csi.storage.k8s.io/pv/name":"pvc-1449718c-8240-4f3b-9b9d-73dff2f1c007","csi.storage.k8s.io/pvc/name":"pvc-g27dn","csi.storage.k8s.io/pvc/namespace":"volumelimits-8266"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:32:54.372518       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-1449718c-8240-4f3b-9b9d-73dff2f1c007, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-1449718c-8240-4f3b-9b9d-73dff2f1c007' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:32:54.372585       1 controllerserver.go:271] begin to create azure disk(pvc-1449718c-8240-4f3b-9b9d-73dff2f1c007) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:32:54.372600       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-1449718c-8240-4f3b-9b9d-73dff2f1c007 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:32:54.464071       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:32:54.464096       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-64e743ca-f460-4867-a7ac-04c113e3f0f9","parameters":{"csi.storage.k8s.io/pv/name":"pvc-64e743ca-f460-4867-a7ac-04c113e3f0f9","csi.storage.k8s.io/pvc/name":"pvc-6vrbh","csi.storage.k8s.io/pvc/namespace":"volumelimits-8266"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:32:54.471611       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-6ef9c8dc-fc75-4674-b3b7-2bbae0ecba20 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:32:54.471648       1 controllerserver.go:348] create azure disk(pvc-6ef9c8dc-fc75-4674-b3b7-2bbae0ecba20) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-6ef9c8dc-fc75-4674-b3b7-2bbae0ecba20 kubernetes.io-created-for-pvc-name:pvc-pzhxr kubernetes.io-created-for-pvc-namespace:volumelimits-8266]) successfully
I1005 15:32:54.471670       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-6ef9c8dc-fc75-4674-b3b7-2bbae0ecba20","csi.storage.k8s.io/pvc/name":"pvc-pzhxr","csi.storage.k8s.io/pvc/namespace":"volumelimits-8266","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-6ef9c8dc-fc75-4674-b3b7-2bbae0ecba20"}}
I1005 15:32:54.542095       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-64e743ca-f460-4867-a7ac-04c113e3f0f9, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-64e743ca-f460-4867-a7ac-04c113e3f0f9' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:32:54.542221       1 controllerserver.go:271] begin to create azure disk(pvc-64e743ca-f460-4867-a7ac-04c113e3f0f9) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:32:54.542236       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-64e743ca-f460-4867-a7ac-04c113e3f0f9 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:32:54.542518       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-309b3973-86d5-4cc3-9275-404c6a423244 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:32:54.542551       1 controllerserver.go:348] create azure disk(pvc-309b3973-86d5-4cc3-9275-404c6a423244) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-309b3973-86d5-4cc3-9275-404c6a423244 kubernetes.io-created-for-pvc-name:pvc-mchw7 kubernetes.io-created-for-pvc-namespace:volumelimits-8266]) successfully
I1005 15:32:54.542572       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-309b3973-86d5-4cc3-9275-404c6a423244","csi.storage.k8s.io/pvc/name":"pvc-mchw7","csi.storage.k8s.io/pvc/namespace":"volumelimits-8266","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-309b3973-86d5-4cc3-9275-404c6a423244"}}
I1005 15:32:54.642575       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:32:54.642610       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-d8b382ba-c457-4914-9379-96f00360a656","parameters":{"csi.storage.k8s.io/pv/name":"pvc-d8b382ba-c457-4914-9379-96f00360a656","csi.storage.k8s.io/pvc/name":"pvc-sllhp","csi.storage.k8s.io/pvc/namespace":"volumelimits-8266"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:32:54.742202       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:32:54.742248       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-dc4631c0-2b34-4bf5-b7cd-1cad90a64283","parameters":{"csi.storage.k8s.io/pv/name":"pvc-dc4631c0-2b34-4bf5-b7cd-1cad90a64283","csi.storage.k8s.io/pvc/name":"pvc-59rkv","csi.storage.k8s.io/pvc/namespace":"volumelimits-8266"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:32:54.842091       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-dc4631c0-2b34-4bf5-b7cd-1cad90a64283, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-dc4631c0-2b34-4bf5-b7cd-1cad90a64283' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:32:54.842161       1 controllerserver.go:271] begin to create azure disk(pvc-dc4631c0-2b34-4bf5-b7cd-1cad90a64283) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:32:54.842183       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-dc4631c0-2b34-4bf5-b7cd-1cad90a64283 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:32:54.842257       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:32:54.842271       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-2f664dae-92ad-43a6-82ac-ea4f2c9e5ec0","parameters":{"csi.storage.k8s.io/pv/name":"pvc-2f664dae-92ad-43a6-82ac-ea4f2c9e5ec0","csi.storage.k8s.io/pvc/name":"pvc-tfs26","csi.storage.k8s.io/pvc/namespace":"volumelimits-8266"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:32:54.843006       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-b186a7a5-d621-4d78-9215-933abd4be408 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:32:54.848550       1 controllerserver.go:348] create azure disk(pvc-b186a7a5-d621-4d78-9215-933abd4be408) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-b186a7a5-d621-4d78-9215-933abd4be408 kubernetes.io-created-for-pvc-name:pvc-hwzdb kubernetes.io-created-for-pvc-namespace:volumelimits-8266]) successfully
I1005 15:32:54.848624       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-b186a7a5-d621-4d78-9215-933abd4be408","csi.storage.k8s.io/pvc/name":"pvc-hwzdb","csi.storage.k8s.io/pvc/namespace":"volumelimits-8266","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-b186a7a5-d621-4d78-9215-933abd4be408"}}
I1005 15:32:54.941652       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-2f664dae-92ad-43a6-82ac-ea4f2c9e5ec0, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-2f664dae-92ad-43a6-82ac-ea4f2c9e5ec0' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:32:54.941745       1 controllerserver.go:271] begin to create azure disk(pvc-2f664dae-92ad-43a6-82ac-ea4f2c9e5ec0) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:32:54.941803       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-2f664dae-92ad-43a6-82ac-ea4f2c9e5ec0 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:32:54.942783       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-d8b382ba-c457-4914-9379-96f00360a656, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-d8b382ba-c457-4914-9379-96f00360a656' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:32:54.942852       1 controllerserver.go:271] begin to create azure disk(pvc-d8b382ba-c457-4914-9379-96f00360a656) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:32:54.942880       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-d8b382ba-c457-4914-9379-96f00360a656 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:32:54.943728       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-8876a4f7-7d0c-4ad8-89c2-37439e18527a StorageAccountType:StandardSSD_LRS Size:5
I1005 15:32:54.943755       1 controllerserver.go:348] create azure disk(pvc-8876a4f7-7d0c-4ad8-89c2-37439e18527a) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-8876a4f7-7d0c-4ad8-89c2-37439e18527a kubernetes.io-created-for-pvc-name:pvc-hqqbb kubernetes.io-created-for-pvc-namespace:volumelimits-8266]) successfully
I1005 15:32:54.943774       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-8876a4f7-7d0c-4ad8-89c2-37439e18527a","csi.storage.k8s.io/pvc/name":"pvc-hqqbb","csi.storage.k8s.io/pvc/namespace":"volumelimits-8266","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-8876a4f7-7d0c-4ad8-89c2-37439e18527a"}}
I1005 15:32:55.043937       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-2a06c584-15f4-46ea-9d7a-2a7efa44b458 StorageAccountType:StandardSSD_LRS Size:5
... skipping 62 lines ...
I1005 15:32:57.337976       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-d8b382ba-c457-4914-9379-96f00360a656 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:32:57.338009       1 controllerserver.go:348] create azure disk(pvc-d8b382ba-c457-4914-9379-96f00360a656) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-d8b382ba-c457-4914-9379-96f00360a656 kubernetes.io-created-for-pvc-name:pvc-sllhp kubernetes.io-created-for-pvc-namespace:volumelimits-8266]) successfully
I1005 15:32:57.338044       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-d8b382ba-c457-4914-9379-96f00360a656","csi.storage.k8s.io/pvc/name":"pvc-sllhp","csi.storage.k8s.io/pvc/namespace":"volumelimits-8266","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-d8b382ba-c457-4914-9379-96f00360a656"}}
I1005 15:32:57.402937       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-2f664dae-92ad-43a6-82ac-ea4f2c9e5ec0 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:32:57.402978       1 controllerserver.go:348] create azure disk(pvc-2f664dae-92ad-43a6-82ac-ea4f2c9e5ec0) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-2f664dae-92ad-43a6-82ac-ea4f2c9e5ec0 kubernetes.io-created-for-pvc-name:pvc-tfs26 kubernetes.io-created-for-pvc-namespace:volumelimits-8266]) successfully
I1005 15:32:57.403081       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-2f664dae-92ad-43a6-82ac-ea4f2c9e5ec0","csi.storage.k8s.io/pvc/name":"pvc-tfs26","csi.storage.k8s.io/pvc/namespace":"volumelimits-8266","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-2f664dae-92ad-43a6-82ac-ea4f2c9e5ec0"}}
I1005 15:33:00.343455       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-469b220d-af6b-4bdb-863c-463ed8b0bd25, error: Retriable: true, RetryAfter: 0s, HTTPStatusCode: -1, RawError: context deadline exceeded
I1005 15:33:00.343463       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-efdac82f-9f35-4fb3-a8c1-6b420052c12c, error: Retriable: true, RetryAfter: 0s, HTTPStatusCode: -1, RawError: context deadline exceeded
I1005 15:33:00.343534       1 controllerserver.go:271] begin to create azure disk(pvc-469b220d-af6b-4bdb-863c-463ed8b0bd25) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:33:00.343551       1 controllerserver.go:271] begin to create azure disk(pvc-efdac82f-9f35-4fb3-a8c1-6b420052c12c) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:33:00.343554       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-469b220d-af6b-4bdb-863c-463ed8b0bd25 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:33:00.343567       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-efdac82f-9f35-4fb3-a8c1-6b420052c12c StorageAccountType:StandardSSD_LRS Size:5
I1005 15:33:01.344945       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:33:01.344989       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:33:01.345003       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-efdac82f-9f35-4fb3-a8c1-6b420052c12c","parameters":{"csi.storage.k8s.io/pv/name":"pvc-efdac82f-9f35-4fb3-a8c1-6b420052c12c","csi.storage.k8s.io/pvc/name":"test.csi.azure.comfrzmm","csi.storage.k8s.io/pvc/namespace":"provisioning-4220"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:33:01.344976       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-469b220d-af6b-4bdb-863c-463ed8b0bd25","parameters":{"csi.storage.k8s.io/pv/name":"pvc-469b220d-af6b-4bdb-863c-463ed8b0bd25","csi.storage.k8s.io/pvc/name":"test.csi.azure.com5gbjq","csi.storage.k8s.io/pvc/namespace":"fsgroupchangepolicy-5534"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
E1005 15:33:01.345137       1 utils.go:100] GRPC error: rpc error: code = Aborted desc = An operation with the given Volume ID pvc-efdac82f-9f35-4fb3-a8c1-6b420052c12c already exists
E1005 15:33:01.345165       1 utils.go:100] GRPC error: rpc error: code = Aborted desc = An operation with the given Volume ID pvc-469b220d-af6b-4bdb-863c-463ed8b0bd25 already exists
I1005 15:33:02.373629       1 controllerserver.go:465] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-c1d29047-58fd-4634-a4ec-2a8cdf5ce767" attached to node "k8s-agentpool1-35271516-vmss000001".
I1005 15:33:02.373668       1 controllerserver.go:485] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-c1d29047-58fd-4634-a4ec-2a8cdf5ce767" to node "k8s-agentpool1-35271516-vmss000001" successfully
I1005 15:33:02.373689       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"1"}}
I1005 15:33:02.382813       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
I1005 15:33:02.382834       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-35271516-vmss000001","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":7}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-c1d29047-58fd-4634-a4ec-2a8cdf5ce767","csi.storage.k8s.io/pvc/name":"test.csi.azure.comjvj7g","csi.storage.k8s.io/pvc/namespace":"volume-3356","requestedsizegib":"5","storage.kubernetes.io/csiProvisionerIdentity":"1633447947345-8081-test.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-c1d29047-58fd-4634-a4ec-2a8cdf5ce767"}
I1005 15:33:02.406606       1 controllerserver.go:440] GetDiskLun returned: <nil>. Initiating attaching volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-c1d29047-58fd-4634-a4ec-2a8cdf5ce767" to node "k8s-agentpool1-35271516-vmss000001".
... skipping 67 lines ...
I1005 15:33:06.938179       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-35271516-vmss000001","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":7}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-43774747-ffed-4bc4-bd3c-22d6b0664129","csi.storage.k8s.io/pvc/name":"inline-volume-tester-94gc9-my-volume-0","csi.storage.k8s.io/pvc/namespace":"ephemeral-6742","requestedsizegib":"5","storage.kubernetes.io/csiProvisionerIdentity":"1633447947345-8081-test.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-43774747-ffed-4bc4-bd3c-22d6b0664129"}
I1005 15:33:06.987322       1 controllerserver.go:440] GetDiskLun returned: <nil>. Initiating attaching volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-43774747-ffed-4bc4-bd3c-22d6b0664129" to node "k8s-agentpool1-35271516-vmss000001".
I1005 15:33:06.987368       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:33:06.987382       1 azure_controller_common.go:457] azureDisk - find disk: lun 0 name "pvc-43774747-ffed-4bc4-bd3c-22d6b0664129" uri "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-43774747-ffed-4bc4-bd3c-22d6b0664129"
I1005 15:33:06.987393       1 controllerserver.go:455] Attach operation is successful. volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-43774747-ffed-4bc4-bd3c-22d6b0664129" is already attached to node "k8s-agentpool1-35271516-vmss000001" at lun 0.
I1005 15:33:06.987411       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
I1005 15:33:07.274734       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-469b220d-af6b-4bdb-863c-463ed8b0bd25:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-469b220d-af6b-4bdb-863c-463ed8b0bd25  true false 2})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1005 15:33:07.315459       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-efdac82f-9f35-4fb3-a8c1-6b420052c12c:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-efdac82f-9f35-4fb3-a8c1-6b420052c12c  true false 2})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1005 15:33:17.379749       1 controllerserver.go:465] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-469b220d-af6b-4bdb-863c-463ed8b0bd25" attached to node "k8s-agentpool1-35271516-vmss000001".
I1005 15:33:17.379785       1 controllerserver.go:485] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-469b220d-af6b-4bdb-863c-463ed8b0bd25" to node "k8s-agentpool1-35271516-vmss000001" successfully
I1005 15:33:17.379821       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"2"}}
I1005 15:33:17.420186       1 controllerserver.go:465] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-efdac82f-9f35-4fb3-a8c1-6b420052c12c" attached to node "k8s-agentpool1-35271516-vmss000000".
I1005 15:33:17.420218       1 controllerserver.go:485] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-efdac82f-9f35-4fb3-a8c1-6b420052c12c" to node "k8s-agentpool1-35271516-vmss000000" successfully
I1005 15:33:17.420251       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"2"}}
... skipping 5 lines ...
I1005 15:33:19.928076       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:33:19.928124       1 azure_controller_common.go:346] Trying to detach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-c1d29047-58fd-4634-a4ec-2a8cdf5ce767" from node "k8s-agentpool1-35271516-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-c1d29047-58fd-4634-a4ec-2a8cdf5ce767:pvc-c1d29047-58fd-4634-a4ec-2a8cdf5ce767]
I1005 15:33:19.928149       1 azure_controller_vmss.go:174] azureDisk - detach disk: name "pvc-c1d29047-58fd-4634-a4ec-2a8cdf5ce767" uri "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-c1d29047-58fd-4634-a4ec-2a8cdf5ce767"
I1005 15:33:19.928159       1 azure_controller_vmss.go:213] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - detach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-c1d29047-58fd-4634-a4ec-2a8cdf5ce767:pvc-c1d29047-58fd-4634-a4ec-2a8cdf5ce767])
I1005 15:33:26.276725       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:33:26.276753       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-c3291b60-9569-4ad0-a5e8-058eb95a6af4","parameters":{"csi.storage.k8s.io/pv/name":"pvc-c3291b60-9569-4ad0-a5e8-058eb95a6af4","csi.storage.k8s.io/pvc/name":"inline-volume-tester2-tk78n-my-volume-0","csi.storage.k8s.io/pvc/namespace":"ephemeral-4672"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:33:26.294251       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-c3291b60-9569-4ad0-a5e8-058eb95a6af4, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-c3291b60-9569-4ad0-a5e8-058eb95a6af4' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:33:26.294324       1 controllerserver.go:271] begin to create azure disk(pvc-c3291b60-9569-4ad0-a5e8-058eb95a6af4) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:33:26.294337       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-c3291b60-9569-4ad0-a5e8-058eb95a6af4 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:33:28.615153       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-c3291b60-9569-4ad0-a5e8-058eb95a6af4 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:33:28.615191       1 controllerserver.go:348] create azure disk(pvc-c3291b60-9569-4ad0-a5e8-058eb95a6af4) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-c3291b60-9569-4ad0-a5e8-058eb95a6af4 kubernetes.io-created-for-pvc-name:inline-volume-tester2-tk78n-my-volume-0 kubernetes.io-created-for-pvc-namespace:ephemeral-4672]) successfully
I1005 15:33:28.615213       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-c3291b60-9569-4ad0-a5e8-058eb95a6af4","csi.storage.k8s.io/pvc/name":"inline-volume-tester2-tk78n-my-volume-0","csi.storage.k8s.io/pvc/namespace":"ephemeral-4672","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-c3291b60-9569-4ad0-a5e8-058eb95a6af4"}}
I1005 15:33:30.040517       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 12 lines ...
I1005 15:33:35.235628       1 controllerserver.go:524] Trying to detach volume /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-c1d29047-58fd-4634-a4ec-2a8cdf5ce767 from node k8s-agentpool1-35271516-vmss000001
I1005 15:33:35.235645       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:33:35.333171       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-c3291b60-9569-4ad0-a5e8-058eb95a6af4" lun 1 to node "k8s-agentpool1-35271516-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-c3291b60-9569-4ad0-a5e8-058eb95a6af4:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-c3291b60-9569-4ad0-a5e8-058eb95a6af4  true false 1})]
I1005 15:33:35.333202       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:33:35.333260       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-c3291b60-9569-4ad0-a5e8-058eb95a6af4:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-c3291b60-9569-4ad0-a5e8-058eb95a6af4  true false 1})])
I1005 15:33:35.333287       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:33:35.490817       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-c3291b60-9569-4ad0-a5e8-058eb95a6af4:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-c3291b60-9569-4ad0-a5e8-058eb95a6af4  true false 1})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1005 15:33:35.491056       1 azure_controller_common.go:346] Trying to detach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-c1d29047-58fd-4634-a4ec-2a8cdf5ce767" from node "k8s-agentpool1-35271516-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-c1d29047-58fd-4634-a4ec-2a8cdf5ce767:pvc-c1d29047-58fd-4634-a4ec-2a8cdf5ce767]
I1005 15:33:35.491108       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-35271516-vmss000001, refreshing the cache
E1005 15:33:35.553416       1 azure_controller_vmss.go:183] detach azure disk on node(k8s-agentpool1-35271516-vmss000001): disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-c1d29047-58fd-4634-a4ec-2a8cdf5ce767:pvc-c1d29047-58fd-4634-a4ec-2a8cdf5ce767]) not found
I1005 15:33:35.553440       1 azure_controller_vmss.go:213] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - detach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-c1d29047-58fd-4634-a4ec-2a8cdf5ce767:pvc-c1d29047-58fd-4634-a4ec-2a8cdf5ce767])
I1005 15:33:39.939058       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerUnpublishVolume
I1005 15:33:39.939086       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-35271516-vmss000001","volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-469b220d-af6b-4bdb-863c-463ed8b0bd25"}
... skipping 8 lines ...
I1005 15:33:39.951073       1 azure_controller_common.go:346] Trying to detach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-efdac82f-9f35-4fb3-a8c1-6b420052c12c" from node "k8s-agentpool1-35271516-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-efdac82f-9f35-4fb3-a8c1-6b420052c12c:pvc-efdac82f-9f35-4fb3-a8c1-6b420052c12c]
I1005 15:33:39.951105       1 azure_controller_vmss.go:174] azureDisk - detach disk: name "pvc-efdac82f-9f35-4fb3-a8c1-6b420052c12c" uri "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-efdac82f-9f35-4fb3-a8c1-6b420052c12c"
I1005 15:33:39.951122       1 azure_controller_vmss.go:213] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - detach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-efdac82f-9f35-4fb3-a8c1-6b420052c12c:pvc-efdac82f-9f35-4fb3-a8c1-6b420052c12c])
I1005 15:33:44.337674       1 utils.go:95] GRPC call: /csi.v1.Controller/DeleteVolume
I1005 15:33:44.337718       1 utils.go:96] GRPC request: {"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-c1d29047-58fd-4634-a4ec-2a8cdf5ce767"}
I1005 15:33:44.337844       1 controllerserver.go:389] deleting azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-c1d29047-58fd-4634-a4ec-2a8cdf5ce767)
I1005 15:33:44.337861       1 controllerserver.go:391] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-c1d29047-58fd-4634-a4ec-2a8cdf5ce767) returned with failed to delete disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-c1d29047-58fd-4634-a4ec-2a8cdf5ce767) since it's in attaching or detaching state
E1005 15:33:44.337888       1 utils.go:100] GRPC error: failed to delete disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-c1d29047-58fd-4634-a4ec-2a8cdf5ce767) since it's in attaching or detaching state
I1005 15:33:55.189133       1 azure_controller_vmss.go:225] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - detach disk(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-efdac82f-9f35-4fb3-a8c1-6b420052c12c:pvc-efdac82f-9f35-4fb3-a8c1-6b420052c12c]) returned with <nil>
I1005 15:33:55.189200       1 azure_controller_common.go:369] azureDisk - detach disk(pvc-efdac82f-9f35-4fb3-a8c1-6b420052c12c, /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-efdac82f-9f35-4fb3-a8c1-6b420052c12c) succeeded
I1005 15:33:55.189229       1 controllerserver.go:533] detach volume /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-efdac82f-9f35-4fb3-a8c1-6b420052c12c from node k8s-agentpool1-35271516-vmss000000 successfully
I1005 15:33:55.189242       1 utils.go:102] GRPC response: {}
I1005 15:33:55.663989       1 controllerserver.go:465] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-c3291b60-9569-4ad0-a5e8-058eb95a6af4" attached to node "k8s-agentpool1-35271516-vmss000001".
I1005 15:33:55.664031       1 controllerserver.go:485] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-c3291b60-9569-4ad0-a5e8-058eb95a6af4" to node "k8s-agentpool1-35271516-vmss000001" successfully
... skipping 24 lines ...
I1005 15:34:10.168040       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-35271516-vmss000001","volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-43774747-ffed-4bc4-bd3c-22d6b0664129"}
I1005 15:34:10.168238       1 controllerserver.go:524] Trying to detach volume /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-43774747-ffed-4bc4-bd3c-22d6b0664129 from node k8s-agentpool1-35271516-vmss000001
I1005 15:34:10.168258       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:34:10.168315       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:34:12.849964       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:34:12.849992       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-95baaad0-e88a-4722-bbe0-90b094402f8f","parameters":{"csi.storage.k8s.io/pv/name":"pvc-95baaad0-e88a-4722-bbe0-90b094402f8f","csi.storage.k8s.io/pvc/name":"test.csi.azure.com44tnc","csi.storage.k8s.io/pvc/namespace":"provisioning-4973"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:34:12.868303       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-95baaad0-e88a-4722-bbe0-90b094402f8f, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-95baaad0-e88a-4722-bbe0-90b094402f8f' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:34:12.868375       1 controllerserver.go:271] begin to create azure disk(pvc-95baaad0-e88a-4722-bbe0-90b094402f8f) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:34:12.868388       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-95baaad0-e88a-4722-bbe0-90b094402f8f StorageAccountType:StandardSSD_LRS Size:5
I1005 15:34:15.253753       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-95baaad0-e88a-4722-bbe0-90b094402f8f StorageAccountType:StandardSSD_LRS Size:5
I1005 15:34:15.253805       1 controllerserver.go:348] create azure disk(pvc-95baaad0-e88a-4722-bbe0-90b094402f8f) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-95baaad0-e88a-4722-bbe0-90b094402f8f kubernetes.io-created-for-pvc-name:test.csi.azure.com44tnc kubernetes.io-created-for-pvc-namespace:provisioning-4973]) successfully
I1005 15:34:15.253845       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-95baaad0-e88a-4722-bbe0-90b094402f8f","csi.storage.k8s.io/pvc/name":"test.csi.azure.com44tnc","csi.storage.k8s.io/pvc/namespace":"provisioning-4973","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-95baaad0-e88a-4722-bbe0-90b094402f8f"}}
I1005 15:34:16.339232       1 utils.go:95] GRPC call: /csi.v1.Controller/DeleteVolume
... skipping 15 lines ...
I1005 15:34:20.400070       1 controllerserver.go:524] Trying to detach volume /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-6996fdb3-f757-4044-ae54-b9343f09d6f4 from node k8s-agentpool1-35271516-vmss000000
I1005 15:34:20.400087       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:34:20.453411       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-95baaad0-e88a-4722-bbe0-90b094402f8f" lun 1 to node "k8s-agentpool1-35271516-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-95baaad0-e88a-4722-bbe0-90b094402f8f:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-95baaad0-e88a-4722-bbe0-90b094402f8f  true false 1})]
I1005 15:34:20.453444       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:34:20.453479       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-95baaad0-e88a-4722-bbe0-90b094402f8f:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-95baaad0-e88a-4722-bbe0-90b094402f8f  true false 1})])
I1005 15:34:20.453493       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:34:20.620423       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-95baaad0-e88a-4722-bbe0-90b094402f8f:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-95baaad0-e88a-4722-bbe0-90b094402f8f  true false 1})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1005 15:34:20.620665       1 azure_controller_common.go:346] Trying to detach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-6996fdb3-f757-4044-ae54-b9343f09d6f4" from node "k8s-agentpool1-35271516-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-6996fdb3-f757-4044-ae54-b9343f09d6f4:pvc-6996fdb3-f757-4044-ae54-b9343f09d6f4]
I1005 15:34:20.620727       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-35271516-vmss000000, refreshing the cache
E1005 15:34:20.734682       1 azure_controller_vmss.go:183] detach azure disk on node(k8s-agentpool1-35271516-vmss000000): disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-6996fdb3-f757-4044-ae54-b9343f09d6f4:pvc-6996fdb3-f757-4044-ae54-b9343f09d6f4]) not found
I1005 15:34:20.734716       1 azure_controller_vmss.go:213] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - detach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-6996fdb3-f757-4044-ae54-b9343f09d6f4:pvc-6996fdb3-f757-4044-ae54-b9343f09d6f4])
I1005 15:34:21.196874       1 azure_controller_vmss.go:225] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - detach disk(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-469b220d-af6b-4bdb-863c-463ed8b0bd25:pvc-469b220d-af6b-4bdb-863c-463ed8b0bd25]) returned with <nil>
I1005 15:34:21.196985       1 azure_controller_common.go:369] azureDisk - detach disk(pvc-469b220d-af6b-4bdb-863c-463ed8b0bd25, /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-469b220d-af6b-4bdb-863c-463ed8b0bd25) succeeded
... skipping 11 lines ...
I1005 15:34:21.665784       1 azure_managedDiskController.go:286] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-c1d29047-58fd-4634-a4ec-2a8cdf5ce767
I1005 15:34:21.665836       1 controllerserver.go:391] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-c1d29047-58fd-4634-a4ec-2a8cdf5ce767) returned with <nil>
I1005 15:34:21.665853       1 utils.go:102] GRPC response: {}
I1005 15:34:25.065054       1 utils.go:95] GRPC call: /csi.v1.Controller/DeleteVolume
I1005 15:34:25.065081       1 utils.go:96] GRPC request: {"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-6996fdb3-f757-4044-ae54-b9343f09d6f4"}
I1005 15:34:25.065167       1 controllerserver.go:389] deleting azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-6996fdb3-f757-4044-ae54-b9343f09d6f4)
I1005 15:34:25.065202       1 controllerserver.go:391] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-6996fdb3-f757-4044-ae54-b9343f09d6f4) returned with failed to delete disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-6996fdb3-f757-4044-ae54-b9343f09d6f4) since it's in attaching or detaching state
E1005 15:34:25.065225       1 utils.go:100] GRPC error: failed to delete disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-6996fdb3-f757-4044-ae54-b9343f09d6f4) since it's in attaching or detaching state
I1005 15:34:26.322780       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:34:26.322828       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-5050f2e9-0a62-425d-993c-c59d4d8f30c7","parameters":{"csi.storage.k8s.io/pv/name":"pvc-5050f2e9-0a62-425d-993c-c59d4d8f30c7","csi.storage.k8s.io/pvc/name":"test.csi.azure.combbb8n","csi.storage.k8s.io/pvc/namespace":"fsgroupchangepolicy-8768"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:34:26.340911       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-5050f2e9-0a62-425d-993c-c59d4d8f30c7, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-5050f2e9-0a62-425d-993c-c59d4d8f30c7' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:34:26.340994       1 controllerserver.go:271] begin to create azure disk(pvc-5050f2e9-0a62-425d-993c-c59d4d8f30c7) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:34:26.341034       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-5050f2e9-0a62-425d-993c-c59d4d8f30c7 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:34:28.726925       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-5050f2e9-0a62-425d-993c-c59d4d8f30c7 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:34:28.726970       1 controllerserver.go:348] create azure disk(pvc-5050f2e9-0a62-425d-993c-c59d4d8f30c7) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-5050f2e9-0a62-425d-993c-c59d4d8f30c7 kubernetes.io-created-for-pvc-name:test.csi.azure.combbb8n kubernetes.io-created-for-pvc-namespace:fsgroupchangepolicy-8768]) successfully
I1005 15:34:28.727008       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-5050f2e9-0a62-425d-993c-c59d4d8f30c7","csi.storage.k8s.io/pvc/name":"test.csi.azure.combbb8n","csi.storage.k8s.io/pvc/namespace":"fsgroupchangepolicy-8768","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-5050f2e9-0a62-425d-993c-c59d4d8f30c7"}}
I1005 15:34:31.025624       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 22 lines ...
I1005 15:34:40.958252       1 utils.go:102] GRPC response: {}
I1005 15:34:40.958329       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:34:40.958364       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-35271516-vmss000000, refreshing the cache
I1005 15:34:41.018789       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-469b220d-af6b-4bdb-863c-463ed8b0bd25" lun 2 to node "k8s-agentpool1-35271516-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-469b220d-af6b-4bdb-863c-463ed8b0bd25:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-469b220d-af6b-4bdb-863c-463ed8b0bd25  true false 2})]
I1005 15:34:41.018824       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:34:41.018844       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-469b220d-af6b-4bdb-863c-463ed8b0bd25:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-469b220d-af6b-4bdb-863c-463ed8b0bd25  true false 2})])
I1005 15:34:41.163477       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-469b220d-af6b-4bdb-863c-463ed8b0bd25:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-469b220d-af6b-4bdb-863c-463ed8b0bd25  true false 2})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1005 15:34:41.568201       1 azure_controller_vmss.go:225] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - detach disk(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-43774747-ffed-4bc4-bd3c-22d6b0664129:pvc-43774747-ffed-4bc4-bd3c-22d6b0664129]) returned with <nil>
I1005 15:34:41.568278       1 azure_controller_common.go:369] azureDisk - detach disk(pvc-43774747-ffed-4bc4-bd3c-22d6b0664129, /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-43774747-ffed-4bc4-bd3c-22d6b0664129) succeeded
I1005 15:34:41.568298       1 controllerserver.go:533] detach volume /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-43774747-ffed-4bc4-bd3c-22d6b0664129 from node k8s-agentpool1-35271516-vmss000001 successfully
I1005 15:34:41.568328       1 utils.go:102] GRPC response: {}
I1005 15:34:41.568407       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:34:41.568432       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-35271516-vmss000001, refreshing the cache
I1005 15:34:41.614232       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-5050f2e9-0a62-425d-993c-c59d4d8f30c7" lun 0 to node "k8s-agentpool1-35271516-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-5050f2e9-0a62-425d-993c-c59d4d8f30c7:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-5050f2e9-0a62-425d-993c-c59d4d8f30c7  true false 0})]
I1005 15:34:41.614285       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:34:41.614319       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-5050f2e9-0a62-425d-993c-c59d4d8f30c7:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-5050f2e9-0a62-425d-993c-c59d4d8f30c7  true false 0})])
I1005 15:34:41.768997       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-5050f2e9-0a62-425d-993c-c59d4d8f30c7:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-5050f2e9-0a62-425d-993c-c59d4d8f30c7  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1005 15:34:41.769201       1 azure_controller_common.go:346] Trying to detach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-c3291b60-9569-4ad0-a5e8-058eb95a6af4" from node "k8s-agentpool1-35271516-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-c3291b60-9569-4ad0-a5e8-058eb95a6af4:pvc-c3291b60-9569-4ad0-a5e8-058eb95a6af4]
I1005 15:34:41.769265       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-35271516-vmss000001, refreshing the cache
I1005 15:34:41.820788       1 azure_controller_vmss.go:174] azureDisk - detach disk: name "pvc-c3291b60-9569-4ad0-a5e8-058eb95a6af4" uri "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-c3291b60-9569-4ad0-a5e8-058eb95a6af4"
I1005 15:34:41.820819       1 azure_controller_vmss.go:213] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - detach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-c3291b60-9569-4ad0-a5e8-058eb95a6af4:pvc-c3291b60-9569-4ad0-a5e8-058eb95a6af4])
I1005 15:34:57.066246       1 utils.go:95] GRPC call: /csi.v1.Controller/DeleteVolume
I1005 15:34:57.066290       1 utils.go:96] GRPC request: {"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-6996fdb3-f757-4044-ae54-b9343f09d6f4"}
... skipping 28 lines ...
I1005 15:35:02.299108       1 utils.go:102] GRPC response: {}
I1005 15:35:04.639283       1 utils.go:95] GRPC call: /csi.v1.Controller/DeleteVolume
I1005 15:35:04.639328       1 utils.go:96] GRPC request: {"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-43774747-ffed-4bc4-bd3c-22d6b0664129"}
I1005 15:35:04.639439       1 controllerserver.go:389] deleting azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-43774747-ffed-4bc4-bd3c-22d6b0664129)
I1005 15:35:07.153428       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:35:07.153511       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-59fe9b6d-ebeb-456f-8421-0787a1b6eb2e","parameters":{"csi.storage.k8s.io/pv/name":"pvc-59fe9b6d-ebeb-456f-8421-0787a1b6eb2e","csi.storage.k8s.io/pvc/name":"pvc-tq9d5","csi.storage.k8s.io/pvc/namespace":"provisioning-8456"},"volume_capabilities":[{"AccessType":{"Block":{}},"access_mode":{"mode":7}}]}
I1005 15:35:07.172788       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-59fe9b6d-ebeb-456f-8421-0787a1b6eb2e, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-59fe9b6d-ebeb-456f-8421-0787a1b6eb2e' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:35:07.172855       1 controllerserver.go:271] begin to create azure disk(pvc-59fe9b6d-ebeb-456f-8421-0787a1b6eb2e) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:35:07.172870       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-59fe9b6d-ebeb-456f-8421-0787a1b6eb2e StorageAccountType:StandardSSD_LRS Size:5
I1005 15:35:09.503719       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-59fe9b6d-ebeb-456f-8421-0787a1b6eb2e StorageAccountType:StandardSSD_LRS Size:5
I1005 15:35:09.503773       1 controllerserver.go:348] create azure disk(pvc-59fe9b6d-ebeb-456f-8421-0787a1b6eb2e) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-59fe9b6d-ebeb-456f-8421-0787a1b6eb2e kubernetes.io-created-for-pvc-name:pvc-tq9d5 kubernetes.io-created-for-pvc-namespace:provisioning-8456]) successfully
I1005 15:35:09.503810       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-59fe9b6d-ebeb-456f-8421-0787a1b6eb2e","csi.storage.k8s.io/pvc/name":"pvc-tq9d5","csi.storage.k8s.io/pvc/namespace":"provisioning-8456","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-59fe9b6d-ebeb-456f-8421-0787a1b6eb2e"}}
I1005 15:35:09.891735       1 azure_managedDiskController.go:286] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-43774747-ffed-4bc4-bd3c-22d6b0664129
... skipping 9 lines ...
I1005 15:35:12.189560       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-35271516-vmss000001, refreshing the cache
I1005 15:35:12.291855       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-59fe9b6d-ebeb-456f-8421-0787a1b6eb2e" to node "k8s-agentpool1-35271516-vmss000001"
I1005 15:35:12.291933       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:35:12.291969       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-59fe9b6d-ebeb-456f-8421-0787a1b6eb2e" lun 1 to node "k8s-agentpool1-35271516-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-59fe9b6d-ebeb-456f-8421-0787a1b6eb2e:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-59fe9b6d-ebeb-456f-8421-0787a1b6eb2e  true false 1})]
I1005 15:35:12.291993       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:35:12.292024       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-59fe9b6d-ebeb-456f-8421-0787a1b6eb2e:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-59fe9b6d-ebeb-456f-8421-0787a1b6eb2e  true false 1})])
I1005 15:35:12.460977       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-59fe9b6d-ebeb-456f-8421-0787a1b6eb2e:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-59fe9b6d-ebeb-456f-8421-0787a1b6eb2e  true false 1})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1005 15:35:15.837452       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:35:15.837481       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b","parameters":{"csi.storage.k8s.io/pv/name":"pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b","csi.storage.k8s.io/pvc/name":"test.csi.azure.comm8tjd","csi.storage.k8s.io/pvc/namespace":"volume-expand-8201"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:35:15.856598       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:35:15.856688       1 controllerserver.go:271] begin to create azure disk(pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:35:15.856718       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b StorageAccountType:StandardSSD_LRS Size:5
I1005 15:35:16.486010       1 azure_managedDiskController.go:286] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-c3291b60-9569-4ad0-a5e8-058eb95a6af4
I1005 15:35:16.486042       1 controllerserver.go:391] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-c3291b60-9569-4ad0-a5e8-058eb95a6af4) returned with <nil>
I1005 15:35:16.486075       1 utils.go:102] GRPC response: {}
I1005 15:35:18.225236       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b StorageAccountType:StandardSSD_LRS Size:5
... skipping 10 lines ...
I1005 15:35:20.895135       1 utils.go:102] GRPC response: {}
I1005 15:35:20.895206       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:35:20.895252       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-35271516-vmss000000, refreshing the cache
I1005 15:35:20.990170       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b" lun 1 to node "k8s-agentpool1-35271516-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b  true false 1})]
I1005 15:35:20.990264       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:35:20.990289       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b  true false 1})])
I1005 15:35:21.137479       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b  true false 1})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1005 15:35:22.558254       1 controllerserver.go:465] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-59fe9b6d-ebeb-456f-8421-0787a1b6eb2e" attached to node "k8s-agentpool1-35271516-vmss000001".
I1005 15:35:22.558309       1 controllerserver.go:485] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-59fe9b6d-ebeb-456f-8421-0787a1b6eb2e" to node "k8s-agentpool1-35271516-vmss000001" successfully
I1005 15:35:22.558353       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"1"}}
I1005 15:35:27.384331       1 utils.go:95] GRPC call: /csi.v1.Controller/DeleteVolume
I1005 15:35:27.384353       1 utils.go:96] GRPC request: {"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-95baaad0-e88a-4722-bbe0-90b094402f8f"}
I1005 15:35:27.384431       1 controllerserver.go:389] deleting azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-95baaad0-e88a-4722-bbe0-90b094402f8f)
... skipping 10 lines ...
I1005 15:35:31.266308       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"1"}}
I1005 15:35:32.596288       1 azure_managedDiskController.go:286] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-95baaad0-e88a-4722-bbe0-90b094402f8f
I1005 15:35:32.596375       1 controllerserver.go:391] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-95baaad0-e88a-4722-bbe0-90b094402f8f) returned with <nil>
I1005 15:35:32.596393       1 utils.go:102] GRPC response: {}
I1005 15:35:39.451918       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:35:39.451947       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-1a5dc421-3f0e-4f4e-95c4-c1560e04997a","parameters":{"csi.storage.k8s.io/pv/name":"pvc-1a5dc421-3f0e-4f4e-95c4-c1560e04997a","csi.storage.k8s.io/pvc/name":"test.csi.azure.comnvh98","csi.storage.k8s.io/pvc/namespace":"volume-expand-5104"},"volume_capabilities":[{"AccessType":{"Block":{}},"access_mode":{"mode":7}}]}
I1005 15:35:39.472033       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-1a5dc421-3f0e-4f4e-95c4-c1560e04997a, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-1a5dc421-3f0e-4f4e-95c4-c1560e04997a' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:35:39.472125       1 controllerserver.go:271] begin to create azure disk(pvc-1a5dc421-3f0e-4f4e-95c4-c1560e04997a) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:35:39.472145       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-1a5dc421-3f0e-4f4e-95c4-c1560e04997a StorageAccountType:StandardSSD_LRS Size:5
I1005 15:35:40.478625       1 utils.go:95] GRPC call: /csi.v1.Identity/GetPluginInfo
I1005 15:35:40.478649       1 utils.go:96] GRPC request: {}
I1005 15:35:40.478747       1 utils.go:102] GRPC response: {"name":"test.csi.azure.com","vendor_version":"v1.8.0-8412a9b9582277d9ca97974b5d2601e9b23694a4"}
I1005 15:35:40.479274       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateSnapshot
... skipping 16 lines ...
I1005 15:35:43.429906       1 utils.go:96] GRPC request: {}
I1005 15:35:43.429952       1 utils.go:102] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":9}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":10}}},{"Type":{"Rpc":{"type":13}}}]}
I1005 15:35:43.430828       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerExpandVolume
I1005 15:35:43.430846       1 utils.go:96] GRPC request: {"capacity_range":{"required_bytes":6442450944},"volume_capability":{"AccessType":{"Mount":{}},"access_mode":{"mode":7}},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b"}
I1005 15:35:43.453039       1 controllerserver.go:807] begin to expand azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b) with new size(6442450944)
I1005 15:35:43.473816       1 azure_managedDiskController.go:336] azureDisk - begin to resize disk(pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b) with new size(6), old size({{5 0} {<nil>}  BinarySI})
E1005 15:35:43.473884       1 utils.go:100] GRPC error: rpc error: code = Internal desc = failed to resize disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b) with error(azureDisk - disk resize is only supported on Unattached disk, current disk state: Attached, already attached to /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-35271516-vmss/virtualMachines/k8s-agentpool1-35271516-vmss_0)
I1005 15:35:43.483125       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerGetCapabilities
I1005 15:35:43.483165       1 utils.go:96] GRPC request: {}
I1005 15:35:43.483203       1 utils.go:102] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":9}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":10}}},{"Type":{"Rpc":{"type":13}}}]}
I1005 15:35:43.642633       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerExpandVolume
I1005 15:35:43.642660       1 utils.go:96] GRPC request: {"capacity_range":{"required_bytes":6442450944},"volume_capability":{"AccessType":{"Mount":{}},"access_mode":{"mode":7}},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b"}
I1005 15:35:43.666922       1 controllerserver.go:807] begin to expand azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b) with new size(6442450944)
I1005 15:35:43.693482       1 azure_managedDiskController.go:336] azureDisk - begin to resize disk(pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b) with new size(6), old size({{5 0} {<nil>}  BinarySI})
E1005 15:35:43.693535       1 utils.go:100] GRPC error: rpc error: code = Internal desc = failed to resize disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b) with error(azureDisk - disk resize is only supported on Unattached disk, current disk state: Attached, already attached to /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-35271516-vmss/virtualMachines/k8s-agentpool1-35271516-vmss_0)
I1005 15:35:44.483395       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerGetCapabilities
I1005 15:35:44.483424       1 utils.go:96] GRPC request: {}
I1005 15:35:44.483495       1 utils.go:102] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":9}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":10}}},{"Type":{"Rpc":{"type":13}}}]}
I1005 15:35:44.484144       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerExpandVolume
I1005 15:35:44.484165       1 utils.go:96] GRPC request: {"capacity_range":{"required_bytes":6442450944},"volume_capability":{"AccessType":{"Mount":{}},"access_mode":{"mode":7}},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b"}
I1005 15:35:44.506630       1 controllerserver.go:807] begin to expand azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b) with new size(6442450944)
I1005 15:35:44.535217       1 azure_managedDiskController.go:336] azureDisk - begin to resize disk(pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b) with new size(6), old size({{5 0} {<nil>}  BinarySI})
E1005 15:35:44.535260       1 utils.go:100] GRPC error: rpc error: code = Internal desc = failed to resize disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b) with error(azureDisk - disk resize is only supported on Unattached disk, current disk state: Attached, already attached to /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-35271516-vmss/virtualMachines/k8s-agentpool1-35271516-vmss_0)
I1005 15:35:44.541634       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerGetCapabilities
I1005 15:35:44.541655       1 utils.go:96] GRPC request: {}
I1005 15:35:44.541700       1 utils.go:102] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":9}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":10}}},{"Type":{"Rpc":{"type":13}}}]}
I1005 15:35:44.542207       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerExpandVolume
I1005 15:35:44.542222       1 utils.go:96] GRPC request: {"capacity_range":{"required_bytes":6442450944},"volume_capability":{"AccessType":{"Mount":{}},"access_mode":{"mode":7}},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b"}
I1005 15:35:44.565878       1 controllerserver.go:807] begin to expand azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b) with new size(6442450944)
I1005 15:35:44.586812       1 azure_managedDiskController.go:336] azureDisk - begin to resize disk(pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b) with new size(6), old size({{5 0} {<nil>}  BinarySI})
E1005 15:35:44.586852       1 utils.go:100] GRPC error: rpc error: code = Internal desc = failed to resize disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b) with error(azureDisk - disk resize is only supported on Unattached disk, current disk state: Attached, already attached to /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-35271516-vmss/virtualMachines/k8s-agentpool1-35271516-vmss_0)
I1005 15:35:45.227769       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:35:45.227798       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-4e097b77-501d-45be-b10b-fbad18d552ef","parameters":{"csi.storage.k8s.io/pv/name":"pvc-4e097b77-501d-45be-b10b-fbad18d552ef","csi.storage.k8s.io/pvc/name":"pvc-vdq9w","csi.storage.k8s.io/pvc/namespace":"provisioning-8456"},"volume_capabilities":[{"AccessType":{"Block":{}},"access_mode":{"mode":7}}],"volume_content_source":{"Type":{"Snapshot":{"snapshot_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/snapshots/snapshot-51cfcc8e-a5f9-4fe5-a5ca-42555dc89ca6"}}}}
I1005 15:35:45.244998       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-4e097b77-501d-45be-b10b-fbad18d552ef, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-4e097b77-501d-45be-b10b-fbad18d552ef' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:35:45.245091       1 controllerserver.go:271] begin to create azure disk(pvc-4e097b77-501d-45be-b10b-fbad18d552ef) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:35:45.245122       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-4e097b77-501d-45be-b10b-fbad18d552ef StorageAccountType:StandardSSD_LRS Size:5
I1005 15:35:47.632107       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-4e097b77-501d-45be-b10b-fbad18d552ef StorageAccountType:StandardSSD_LRS Size:5
I1005 15:35:47.632179       1 controllerserver.go:348] create azure disk(pvc-4e097b77-501d-45be-b10b-fbad18d552ef) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-4e097b77-501d-45be-b10b-fbad18d552ef kubernetes.io-created-for-pvc-name:pvc-vdq9w kubernetes.io-created-for-pvc-namespace:provisioning-8456]) successfully
I1005 15:35:47.632203       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":{"Snapshot":{"snapshot_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/snapshots/snapshot-51cfcc8e-a5f9-4fe5-a5ca-42555dc89ca6"}}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-4e097b77-501d-45be-b10b-fbad18d552ef","csi.storage.k8s.io/pvc/name":"pvc-vdq9w","csi.storage.k8s.io/pvc/namespace":"provisioning-8456","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-4e097b77-501d-45be-b10b-fbad18d552ef"}}
I1005 15:35:48.544952       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerGetCapabilities
I1005 15:35:48.544978       1 utils.go:96] GRPC request: {}
I1005 15:35:48.545012       1 utils.go:102] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":9}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":10}}},{"Type":{"Rpc":{"type":13}}}]}
I1005 15:35:48.545535       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerExpandVolume
I1005 15:35:48.545552       1 utils.go:96] GRPC request: {"capacity_range":{"required_bytes":6442450944},"volume_capability":{"AccessType":{"Mount":{}},"access_mode":{"mode":7}},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b"}
I1005 15:35:48.567549       1 controllerserver.go:807] begin to expand azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b) with new size(6442450944)
I1005 15:35:48.589435       1 azure_managedDiskController.go:336] azureDisk - begin to resize disk(pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b) with new size(6), old size({{5 0} {<nil>}  BinarySI})
E1005 15:35:48.589489       1 utils.go:100] GRPC error: rpc error: code = Internal desc = failed to resize disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b) with error(azureDisk - disk resize is only supported on Unattached disk, current disk state: Attached, already attached to /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-35271516-vmss/virtualMachines/k8s-agentpool1-35271516-vmss_0)
I1005 15:35:50.179162       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
I1005 15:35:50.179193       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-35271516-vmss000001","volume_capability":{"AccessType":{"Block":{}},"access_mode":{"mode":7}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-4e097b77-501d-45be-b10b-fbad18d552ef","csi.storage.k8s.io/pvc/name":"pvc-vdq9w","csi.storage.k8s.io/pvc/namespace":"provisioning-8456","requestedsizegib":"5","storage.kubernetes.io/csiProvisionerIdentity":"1633447947345-8081-test.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-4e097b77-501d-45be-b10b-fbad18d552ef"}
I1005 15:35:50.205025       1 controllerserver.go:440] GetDiskLun returned: <nil>. Initiating attaching volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-4e097b77-501d-45be-b10b-fbad18d552ef" to node "k8s-agentpool1-35271516-vmss000001".
I1005 15:35:50.205056       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:35:50.205078       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-4e097b77-501d-45be-b10b-fbad18d552ef" to node "k8s-agentpool1-35271516-vmss000001"
I1005 15:35:50.782910       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerUnpublishVolume
... skipping 53 lines ...
I1005 15:36:04.596996       1 utils.go:96] GRPC request: {"capacity_range":{"required_bytes":6442450944},"volume_capability":{"AccessType":{"Mount":{}},"access_mode":{"mode":7}},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b"}
I1005 15:36:04.604480       1 controllerserver.go:440] GetDiskLun returned: <nil>. Initiating attaching volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-dc4631c0-2b34-4bf5-b7cd-1cad90a64283" to node "k8s-agentpool1-35271516-vmss000000".
I1005 15:36:04.604507       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:36:04.604545       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-dc4631c0-2b34-4bf5-b7cd-1cad90a64283" to node "k8s-agentpool1-35271516-vmss000000"
I1005 15:36:04.630058       1 controllerserver.go:807] begin to expand azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b) with new size(6442450944)
I1005 15:36:04.660998       1 azure_managedDiskController.go:336] azureDisk - begin to resize disk(pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b) with new size(6), old size({{5 0} {<nil>}  BinarySI})
E1005 15:36:04.661040       1 utils.go:100] GRPC error: rpc error: code = Internal desc = failed to resize disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b) with error(azureDisk - disk resize is only supported on Unattached disk, current disk state: Attached, already attached to /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-35271516-vmss/virtualMachines/k8s-agentpool1-35271516-vmss_0)
I1005 15:36:04.671637       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerGetCapabilities
I1005 15:36:04.671656       1 utils.go:96] GRPC request: {}
I1005 15:36:04.671692       1 utils.go:102] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":9}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":10}}},{"Type":{"Rpc":{"type":13}}}]}
I1005 15:36:04.672220       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerExpandVolume
I1005 15:36:04.672232       1 utils.go:96] GRPC request: {"capacity_range":{"required_bytes":6442450944},"volume_capability":{"AccessType":{"Mount":{}},"access_mode":{"mode":7}},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b"}
I1005 15:36:04.698184       1 controllerserver.go:807] begin to expand azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b) with new size(6442450944)
I1005 15:36:04.722143       1 azure_managedDiskController.go:336] azureDisk - begin to resize disk(pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b) with new size(6), old size({{5 0} {<nil>}  BinarySI})
E1005 15:36:04.722206       1 utils.go:100] GRPC error: rpc error: code = Internal desc = failed to resize disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b) with error(azureDisk - disk resize is only supported on Unattached disk, current disk state: Attached, already attached to /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-35271516-vmss/virtualMachines/k8s-agentpool1-35271516-vmss_0)
I1005 15:36:05.178376       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
I1005 15:36:05.178410       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-35271516-vmss000000","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":7}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-12bcf88a-f3a4-471c-92b5-9d41389eb683","csi.storage.k8s.io/pvc/name":"pvc-qgqdk","csi.storage.k8s.io/pvc/namespace":"volumelimits-8266","requestedsizegib":"5","storage.kubernetes.io/csiProvisionerIdentity":"1633447947345-8081-test.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-12bcf88a-f3a4-471c-92b5-9d41389eb683"}
I1005 15:36:05.202185       1 controllerserver.go:440] GetDiskLun returned: <nil>. Initiating attaching volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-12bcf88a-f3a4-471c-92b5-9d41389eb683" to node "k8s-agentpool1-35271516-vmss000000".
I1005 15:36:05.202238       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:36:05.202296       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-12bcf88a-f3a4-471c-92b5-9d41389eb683" to node "k8s-agentpool1-35271516-vmss000000"
I1005 15:36:06.041148       1 azure_controller_vmss.go:225] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - detach disk(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-59fe9b6d-ebeb-456f-8421-0787a1b6eb2e:pvc-59fe9b6d-ebeb-456f-8421-0787a1b6eb2e]) returned with <nil>
... skipping 21 lines ...
I1005 15:36:06.205853       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-79f9f558-0a63-4e9a-a428-d45a3dc8d594" to node "k8s-agentpool1-35271516-vmss000000"
I1005 15:36:06.379162       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
I1005 15:36:06.379190       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-35271516-vmss000000","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":7}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-dfd85c6a-9a7f-44bc-b0e4-eb64246bbcd8","csi.storage.k8s.io/pvc/name":"pvc-krtwm","csi.storage.k8s.io/pvc/namespace":"volumelimits-8266","requestedsizegib":"5","storage.kubernetes.io/csiProvisionerIdentity":"1633447947345-8081-test.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-dfd85c6a-9a7f-44bc-b0e4-eb64246bbcd8"}
I1005 15:36:06.409031       1 controllerserver.go:440] GetDiskLun returned: <nil>. Initiating attaching volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-dfd85c6a-9a7f-44bc-b0e4-eb64246bbcd8" to node "k8s-agentpool1-35271516-vmss000000".
I1005 15:36:06.409073       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:36:06.409111       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-dfd85c6a-9a7f-44bc-b0e4-eb64246bbcd8" to node "k8s-agentpool1-35271516-vmss000000"
I1005 15:36:06.527292       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-4e097b77-501d-45be-b10b-fbad18d552ef:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-4e097b77-501d-45be-b10b-fbad18d552ef  true false 1})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1005 15:36:06.527458       1 azure_controller_common.go:346] Trying to detach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-5050f2e9-0a62-425d-993c-c59d4d8f30c7" from node "k8s-agentpool1-35271516-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-5050f2e9-0a62-425d-993c-c59d4d8f30c7:pvc-5050f2e9-0a62-425d-993c-c59d4d8f30c7]
I1005 15:36:06.527502       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-35271516-vmss000001, refreshing the cache
I1005 15:36:06.571178       1 azure_controller_vmss.go:174] azureDisk - detach disk: name "pvc-5050f2e9-0a62-425d-993c-c59d4d8f30c7" uri "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-5050f2e9-0a62-425d-993c-c59d4d8f30c7"
I1005 15:36:06.571214       1 azure_controller_vmss.go:213] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - detach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-5050f2e9-0a62-425d-993c-c59d4d8f30c7:pvc-5050f2e9-0a62-425d-993c-c59d4d8f30c7])
I1005 15:36:06.580787       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
I1005 15:36:06.580808       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-35271516-vmss000000","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":7}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-966a20f6-7ce4-4dab-80d5-ca44b1977ad8","csi.storage.k8s.io/pvc/name":"pvc-h48tg","csi.storage.k8s.io/pvc/namespace":"volumelimits-8266","requestedsizegib":"5","storage.kubernetes.io/csiProvisionerIdentity":"1633447947345-8081-test.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-966a20f6-7ce4-4dab-80d5-ca44b1977ad8"}
... skipping 144 lines ...
I1005 15:36:26.857404       1 azure_controller_vmss.go:225] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - detach disk(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-5050f2e9-0a62-425d-993c-c59d4d8f30c7:pvc-5050f2e9-0a62-425d-993c-c59d4d8f30c7]) returned with <nil>
I1005 15:36:26.857490       1 azure_controller_common.go:369] azureDisk - detach disk(pvc-5050f2e9-0a62-425d-993c-c59d4d8f30c7, /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-5050f2e9-0a62-425d-993c-c59d4d8f30c7) succeeded
I1005 15:36:26.857502       1 controllerserver.go:533] detach volume /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-5050f2e9-0a62-425d-993c-c59d4d8f30c7 from node k8s-agentpool1-35271516-vmss000001 successfully
I1005 15:36:26.857513       1 utils.go:102] GRPC response: {}
I1005 15:36:27.300025       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:36:27.300053       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-51c75314-588b-48db-96c2-d6011d676075","parameters":{"csi.storage.k8s.io/pv/name":"pvc-51c75314-588b-48db-96c2-d6011d676075","csi.storage.k8s.io/pvc/name":"test.csi.azure.comhhrdk","csi.storage.k8s.io/pvc/namespace":"volume-7421"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:36:27.321152       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-51c75314-588b-48db-96c2-d6011d676075, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-51c75314-588b-48db-96c2-d6011d676075' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:36:27.321258       1 controllerserver.go:271] begin to create azure disk(pvc-51c75314-588b-48db-96c2-d6011d676075) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:36:27.321288       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-51c75314-588b-48db-96c2-d6011d676075 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:36:27.566455       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-045ffe13-f563-4fe0-a80f-c2ef18fcff0a:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-045ffe13-f563-4fe0-a80f-c2ef18fcff0a  true false 26}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-0e466a66-660b-4917-ba77-72beb04c4e56:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-0e466a66-660b-4917-ba77-72beb04c4e56  true false 3}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-10d10fa8-ebe1-4d36-8922-aacc1360f3b7:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-10d10fa8-ebe1-4d36-8922-aacc1360f3b7  true false 17}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-12bcf88a-f3a4-471c-92b5-9d41389eb683:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-12bcf88a-f3a4-471c-92b5-9d41389eb683  true false 10}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-1449718c-8240-4f3b-9b9d-73dff2f1c007:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-1449718c-8240-4f3b-9b9d-73dff2f1c007  true false 30}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-18a5b3fc-fda9-42b4-8f9f-345b9ba4485d:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-18a5b3fc-fda9-42b4-8f9f-345b9ba4485d  true false 14}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-206a2766-a59c-43f1-b9e8-c4765b5b4784:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-206a2766-a59c-43f1-b9e8-c4765b5b4784  true false 28}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-22b9fe01-edf1-4560-8956-05a355e670df:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-22b9fe01-edf1-4560-8956-05a355e670df  true false 27}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-27ff6a26-7023-4a22-a7ef-05b82e08b4e2:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-27ff6a26-7023-4a22-a7ef-05b82e08b4e2  true false 11}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-2a06c584-15f4-46ea-9d7a-2a7efa44b458:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-2a06c584-15f4-46ea-9d7a-2a7efa44b458  true false 9}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-2f664dae-92ad-43a6-82ac-ea4f2c9e5ec0:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-2f664dae-92ad-43a6-82ac-ea4f2c9e5ec0  true false 29}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-2fef4ac7-a62c-4ba6-87a7-307b8f106084:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-2fef4ac7-a62c-4ba6-87a7-307b8f106084  true false 7}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-309b3973-86d5-4cc3-9275-404c6a423244:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-309b3973-86d5-4cc3-9275-404c6a423244  true false 0}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-386107df-96f8-4c5c-bce8-42b64d9d030d:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-386107df-96f8-4c5c-bce8-42b64d9d030d  true false 23}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-4b60fcee-8d14-402e-81b1-45efe61d0cbe:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-4b60fcee-8d14-402e-81b1-45efe61d0cbe  true false 8}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-5cc2f503-b883-4209-8c7c-221e2372c996:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-5cc2f503-b883-4209-8c7c-221e2372c996  true false 1}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-5e8eb74a-406f-4921-bad1-a2bc9a9fdb75:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-5e8eb74a-406f-4921-bad1-a2bc9a9fdb75  true false 18}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-64e743ca-f460-4867-a7ac-04c113e3f0f9:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-64e743ca-f460-4867-a7ac-04c113e3f0f9  true false 12}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-6ef9c8dc-fc75-4674-b3b7-2bbae0ecba20:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-6ef9c8dc-fc75-4674-b3b7-2bbae0ecba20  true false 5}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-79f9f558-0a63-4e9a-a428-d45a3dc8d594:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-79f9f558-0a63-4e9a-a428-d45a3dc8d594  true false 15}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-809a8a7c-d606-4428-9d0f-c2069767c511:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-809a8a7c-d606-4428-9d0f-c2069767c511  true false 13}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-84a78d2e-b641-434e-a52a-75ba80aa7342:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-84a78d2e-b641-434e-a52a-75ba80aa7342  true false 2}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-8876a4f7-7d0c-4ad8-89c2-37439e18527a:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-8876a4f7-7d0c-4ad8-89c2-37439e18527a  true false 20}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-966a20f6-7ce4-4dab-80d5-ca44b1977ad8:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-966a20f6-7ce4-4dab-80d5-ca44b1977ad8  true false 19}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-9fd5f8d8-7e49-4206-be01-9d9b78035de8:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-9fd5f8d8-7e49-4206-be01-9d9b78035de8  true false 22}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-a1292d7f-302c-4e15-9f27-8c756100845c:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-a1292d7f-302c-4e15-9f27-8c756100845c  true false 31}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-b186a7a5-d621-4d78-9215-933abd4be408:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-b186a7a5-d621-4d78-9215-933abd4be408  true false 6}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-d5e0b720-bc05-435b-bf4b-94ad3d91cda8:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-d5e0b720-bc05-435b-bf4b-94ad3d91cda8  true false 4}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-d8b382ba-c457-4914-9379-96f00360a656:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-d8b382ba-c457-4914-9379-96f00360a656  true false 21}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-dc4631c0-2b34-4bf5-b7cd-1cad90a64283:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-dc4631c0-2b34-4bf5-b7cd-1cad90a64283  true false 24}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-dfd85c6a-9a7f-44bc-b0e4-eb64246bbcd8:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-dfd85c6a-9a7f-44bc-b0e4-eb64246bbcd8  true false 25}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-ecddc8e6-1743-42d2-953c-7c5d3f767704:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-ecddc8e6-1743-42d2-953c-7c5d3f767704  true false 16})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1005 15:36:27.566788       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:36:27.566829       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-35271516-vmss000000, refreshing the cache
I1005 15:36:27.653131       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-386107df-96f8-4c5c-bce8-42b64d9d030d" lun 23 to node "k8s-agentpool1-35271516-vmss000000", diskMap: map[]
I1005 15:36:27.653190       1 controllerserver.go:465] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-386107df-96f8-4c5c-bce8-42b64d9d030d" attached to node "k8s-agentpool1-35271516-vmss000000".
I1005 15:36:27.653225       1 controllerserver.go:485] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-386107df-96f8-4c5c-bce8-42b64d9d030d" to node "k8s-agentpool1-35271516-vmss000000" successfully
I1005 15:36:27.653239       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"23"}}
... skipping 373 lines ...
I1005 15:36:38.734437       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-51c75314-588b-48db-96c2-d6011d676075" lun 0 to node "k8s-agentpool1-35271516-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-51c75314-588b-48db-96c2-d6011d676075:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-51c75314-588b-48db-96c2-d6011d676075  true false 0})]
I1005 15:36:38.734474       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:36:38.734503       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-51c75314-588b-48db-96c2-d6011d676075:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-51c75314-588b-48db-96c2-d6011d676075  true false 0})])
I1005 15:36:38.875866       1 azure_managedDiskController.go:358] azureDisk - resize disk(pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b) with new size(6) completed
I1005 15:36:38.875920       1 controllerserver.go:819] expand azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b) successfully, currentSize(6442450944)
I1005 15:36:38.875934       1 utils.go:102] GRPC response: {"capacity_bytes":6442450944,"node_expansion_required":true}
I1005 15:36:38.894490       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-51c75314-588b-48db-96c2-d6011d676075:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-51c75314-588b-48db-96c2-d6011d676075  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1005 15:36:39.937753       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
I1005 15:36:39.937788       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-35271516-vmss000001","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":7}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b","csi.storage.k8s.io/pvc/name":"test.csi.azure.comm8tjd","csi.storage.k8s.io/pvc/namespace":"volume-expand-8201","requestedsizegib":"5","storage.kubernetes.io/csiProvisionerIdentity":"1633447947345-8081-test.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b"}
I1005 15:36:39.963600       1 controllerserver.go:440] GetDiskLun returned: <nil>. Initiating attaching volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b" to node "k8s-agentpool1-35271516-vmss000001".
I1005 15:36:39.963629       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:36:39.963669       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-35271516-vmss000001, refreshing the cache
I1005 15:36:40.011174       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b" to node "k8s-agentpool1-35271516-vmss000001"
I1005 15:36:40.011206       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:36:40.011221       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b" lun 2 to node "k8s-agentpool1-35271516-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b  true false 2})]
I1005 15:36:40.011253       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:36:40.011266       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b  true false 2})])
I1005 15:36:40.180434       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b  true false 2})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1005 15:36:44.107493       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:36:44.107521       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3","parameters":{"csi.storage.k8s.io/pv/name":"pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3","csi.storage.k8s.io/pvc/name":"inline-volume-tester-2962x-my-volume-0","csi.storage.k8s.io/pvc/namespace":"ephemeral-7855"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:36:44.127868       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:36:44.127987       1 controllerserver.go:271] begin to create azure disk(pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:36:44.128055       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:36:46.549861       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:36:46.549900       1 controllerserver.go:348] create azure disk(pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3 kubernetes.io-created-for-pvc-name:inline-volume-tester-2962x-my-volume-0 kubernetes.io-created-for-pvc-namespace:ephemeral-7855]) successfully
I1005 15:36:46.549924       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3","csi.storage.k8s.io/pvc/name":"inline-volume-tester-2962x-my-volume-0","csi.storage.k8s.io/pvc/namespace":"ephemeral-7855","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3"}}
I1005 15:36:47.195341       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 2 lines ...
I1005 15:36:47.230702       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:36:47.230777       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3" to node "k8s-agentpool1-35271516-vmss000000"
I1005 15:36:47.230820       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:36:47.230848       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3" lun 32 to node "k8s-agentpool1-35271516-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3  true false 32})]
I1005 15:36:47.230907       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:36:47.230958       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3  true false 32})])
I1005 15:36:47.330817       1 azure_armclient.go:341] Received error in sendAsync.send: resourceID: https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-35271516-vmss/virtualMachines/0?api-version=2020-12-01, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 409, RawError: {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}
I1005 15:36:47.330844       1 azure_armclient.go:594] Received error in put.send: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-35271516-vmss/virtualMachines/0, error: %!s(<nil>)
E1005 15:36:47.330918       1 azure_controller_vmss.go:125] azureDisk - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3  true false 32})]) on rg(kubetest-4edgu0dt) vm(k8s-agentpool1-35271516-vmss000000) failed, err: &{false 409 0001-01-01 00:00:00 +0000 UTC {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}}
I1005 15:36:47.330983       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3  true false 32})], &{%!s(bool=false) %!s(int=409) 0001-01-01 00:00:00 +0000 UTC {
  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}}) returned with %!v(MISSING)
E1005 15:36:47.331076       1 controllerserver.go:481] Attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3" to instance "k8s-agentpool1-35271516-vmss000000" failed with Retriable: false, RetryAfter: 0s, HTTPStatusCode: 409, RawError: {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}
E1005 15:36:47.331147       1 utils.go:100] GRPC error: Attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3" to instance "k8s-agentpool1-35271516-vmss000000" failed with Retriable: false, RetryAfter: 0s, HTTPStatusCode: 409, RawError: {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}
I1005 15:36:47.337650       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 3 lines ...
I1005 15:36:47.359984       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-35271516-vmss000000, refreshing the cache
I1005 15:36:47.414732       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3" to node "k8s-agentpool1-35271516-vmss000000"
I1005 15:36:47.414772       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:36:47.414792       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3" lun 32 to node "k8s-agentpool1-35271516-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3  true false 32})]
I1005 15:36:47.414808       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:36:47.414837       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3  true false 32})])
I1005 15:36:47.473437       1 azure_armclient.go:341] Received error in sendAsync.send: resourceID: https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-35271516-vmss/virtualMachines/0?api-version=2020-12-01, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 409, RawError: {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}
I1005 15:36:47.473468       1 azure_armclient.go:594] Received error in put.send: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-35271516-vmss/virtualMachines/0, error: %!s(<nil>)
E1005 15:36:47.473535       1 azure_controller_vmss.go:125] azureDisk - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3  true false 32})]) on rg(kubetest-4edgu0dt) vm(k8s-agentpool1-35271516-vmss000000) failed, err: &{false 409 0001-01-01 00:00:00 +0000 UTC {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}}
I1005 15:36:47.473590       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3  true false 32})], &{%!s(bool=false) %!s(int=409) 0001-01-01 00:00:00 +0000 UTC {
  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}}) returned with %!v(MISSING)
E1005 15:36:47.473625       1 controllerserver.go:481] Attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3" to instance "k8s-agentpool1-35271516-vmss000000" failed with Retriable: false, RetryAfter: 0s, HTTPStatusCode: 409, RawError: {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}
E1005 15:36:47.473649       1 utils.go:100] GRPC error: Attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3" to instance "k8s-agentpool1-35271516-vmss000000" failed with Retriable: false, RetryAfter: 0s, HTTPStatusCode: 409, RawError: {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}
I1005 15:36:48.337911       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 3 lines ...
I1005 15:36:48.361152       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-35271516-vmss000000, refreshing the cache
I1005 15:36:48.432348       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3" to node "k8s-agentpool1-35271516-vmss000000"
I1005 15:36:48.432431       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:36:48.432451       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3" lun 32 to node "k8s-agentpool1-35271516-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3  true false 32})]
I1005 15:36:48.432468       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:36:48.432530       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3  true false 32})])
I1005 15:36:48.508660       1 azure_armclient.go:341] Received error in sendAsync.send: resourceID: https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-35271516-vmss/virtualMachines/0?api-version=2020-12-01, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 409, RawError: {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}
I1005 15:36:48.508694       1 azure_armclient.go:594] Received error in put.send: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-35271516-vmss/virtualMachines/0, error: %!s(<nil>)
E1005 15:36:48.508761       1 azure_controller_vmss.go:125] azureDisk - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3  true false 32})]) on rg(kubetest-4edgu0dt) vm(k8s-agentpool1-35271516-vmss000000) failed, err: &{false 409 0001-01-01 00:00:00 +0000 UTC {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}}
I1005 15:36:48.508849       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3  true false 32})], &{%!s(bool=false) %!s(int=409) 0001-01-01 00:00:00 +0000 UTC {
  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}}) returned with %!v(MISSING)
E1005 15:36:48.508927       1 controllerserver.go:481] Attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3" to instance "k8s-agentpool1-35271516-vmss000000" failed with Retriable: false, RetryAfter: 0s, HTTPStatusCode: 409, RawError: {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}
E1005 15:36:48.509001       1 utils.go:100] GRPC error: Attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3" to instance "k8s-agentpool1-35271516-vmss000000" failed with Retriable: false, RetryAfter: 0s, HTTPStatusCode: 409, RawError: {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}
I1005 15:36:52.521184       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 3 lines ...
I1005 15:36:52.563287       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-35271516-vmss000000, refreshing the cache
I1005 15:36:52.639836       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3" to node "k8s-agentpool1-35271516-vmss000000"
I1005 15:36:52.639896       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:36:52.639917       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3" lun 32 to node "k8s-agentpool1-35271516-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3  true false 32})]
I1005 15:36:52.639952       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:36:52.639982       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3  true false 32})])
I1005 15:36:52.728269       1 azure_armclient.go:341] Received error in sendAsync.send: resourceID: https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-35271516-vmss/virtualMachines/0?api-version=2020-12-01, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 409, RawError: {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}
I1005 15:36:52.728294       1 azure_armclient.go:594] Received error in put.send: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-35271516-vmss/virtualMachines/0, error: %!s(<nil>)
E1005 15:36:52.728339       1 azure_controller_vmss.go:125] azureDisk - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3  true false 32})]) on rg(kubetest-4edgu0dt) vm(k8s-agentpool1-35271516-vmss000000) failed, err: &{false 409 0001-01-01 00:00:00 +0000 UTC {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}}
I1005 15:36:52.728382       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3  true false 32})], &{%!s(bool=false) %!s(int=409) 0001-01-01 00:00:00 +0000 UTC {
  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}}) returned with %!v(MISSING)
E1005 15:36:52.728426       1 controllerserver.go:481] Attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3" to instance "k8s-agentpool1-35271516-vmss000000" failed with Retriable: false, RetryAfter: 0s, HTTPStatusCode: 409, RawError: {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}
E1005 15:36:52.728451       1 utils.go:100] GRPC error: Attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3" to instance "k8s-agentpool1-35271516-vmss000000" failed with Retriable: false, RetryAfter: 0s, HTTPStatusCode: 409, RawError: {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}
I1005 15:36:59.271193       1 utils.go:95] GRPC call: /csi.v1.Controller/DeleteVolume
... skipping 6 lines ...
I1005 15:37:00.764692       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-35271516-vmss000000, refreshing the cache
I1005 15:37:00.852741       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3" to node "k8s-agentpool1-35271516-vmss000000"
I1005 15:37:00.852787       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:37:00.852807       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3" lun 32 to node "k8s-agentpool1-35271516-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3  true false 32})]
I1005 15:37:00.852824       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:37:00.852854       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3  true false 32})])
I1005 15:37:00.928525       1 azure_armclient.go:341] Received error in sendAsync.send: resourceID: https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-35271516-vmss/virtualMachines/0?api-version=2020-12-01, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 409, RawError: {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}
I1005 15:37:00.928554       1 azure_armclient.go:594] Received error in put.send: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-35271516-vmss/virtualMachines/0, error: %!s(<nil>)
E1005 15:37:00.928616       1 azure_controller_vmss.go:125] azureDisk - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3  true false 32})]) on rg(kubetest-4edgu0dt) vm(k8s-agentpool1-35271516-vmss000000) failed, err: &{false 409 0001-01-01 00:00:00 +0000 UTC {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}}
I1005 15:37:00.928643       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3  true false 32})], &{%!s(bool=false) %!s(int=409) 0001-01-01 00:00:00 +0000 UTC {
  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}}) returned with %!v(MISSING)
E1005 15:37:00.928715       1 controllerserver.go:481] Attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3" to instance "k8s-agentpool1-35271516-vmss000000" failed with Retriable: false, RetryAfter: 0s, HTTPStatusCode: 409, RawError: {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}
E1005 15:37:00.928746       1 utils.go:100] GRPC error: Attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3" to instance "k8s-agentpool1-35271516-vmss000000" failed with Retriable: false, RetryAfter: 0s, HTTPStatusCode: 409, RawError: {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}
I1005 15:37:04.475939       1 azure_managedDiskController.go:286] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-469b220d-af6b-4bdb-863c-463ed8b0bd25
... skipping 19 lines ...
I1005 15:37:09.121320       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:37:09.121373       1 azure_controller_common.go:457] azureDisk - find disk: lun 0 name "pvc-51c75314-588b-48db-96c2-d6011d676075" uri "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-51c75314-588b-48db-96c2-d6011d676075"
I1005 15:37:09.121383       1 controllerserver.go:455] Attach operation is successful. volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-51c75314-588b-48db-96c2-d6011d676075" is already attached to node "k8s-agentpool1-35271516-vmss000001" at lun 0.
I1005 15:37:09.121412       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
I1005 15:37:09.276891       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:37:09.276913       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-8b97da8c-553c-4700-a0a9-d72d028b1e34","parameters":{"csi.storage.k8s.io/pv/name":"pvc-8b97da8c-553c-4700-a0a9-d72d028b1e34","csi.storage.k8s.io/pvc/name":"test.csi.azure.commf2f7","csi.storage.k8s.io/pvc/namespace":"fsgroupchangepolicy-2303"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:37:09.296839       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-8b97da8c-553c-4700-a0a9-d72d028b1e34, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-8b97da8c-553c-4700-a0a9-d72d028b1e34' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:37:09.296909       1 controllerserver.go:271] begin to create azure disk(pvc-8b97da8c-553c-4700-a0a9-d72d028b1e34) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:37:09.296938       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-8b97da8c-553c-4700-a0a9-d72d028b1e34 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:37:10.537363       1 controllerserver.go:465] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b" attached to node "k8s-agentpool1-35271516-vmss000001".
I1005 15:37:10.537398       1 controllerserver.go:485] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b" to node "k8s-agentpool1-35271516-vmss000001" successfully
I1005 15:37:10.537433       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"2"}}
I1005 15:37:11.114035       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerUnpublishVolume
... skipping 18 lines ...
I1005 15:37:16.992958       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:37:16.993029       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3" to node "k8s-agentpool1-35271516-vmss000000"
I1005 15:37:16.993043       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:37:16.993072       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3" lun 32 to node "k8s-agentpool1-35271516-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3  true false 32})]
I1005 15:37:16.993113       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:37:16.993144       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3  true false 32})])
I1005 15:37:17.063541       1 azure_armclient.go:341] Received error in sendAsync.send: resourceID: https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-35271516-vmss/virtualMachines/0?api-version=2020-12-01, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 409, RawError: {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}
I1005 15:37:17.063580       1 azure_armclient.go:594] Received error in put.send: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-35271516-vmss/virtualMachines/0, error: %!s(<nil>)
E1005 15:37:17.063649       1 azure_controller_vmss.go:125] azureDisk - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3  true false 32})]) on rg(kubetest-4edgu0dt) vm(k8s-agentpool1-35271516-vmss000000) failed, err: &{false 409 0001-01-01 00:00:00 +0000 UTC {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}}
I1005 15:37:17.063718       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3  true false 32})], &{%!s(bool=false) %!s(int=409) 0001-01-01 00:00:00 +0000 UTC {
  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}}) returned with %!v(MISSING)
E1005 15:37:17.063770       1 controllerserver.go:481] Attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3" to instance "k8s-agentpool1-35271516-vmss000000" failed with Retriable: false, RetryAfter: 0s, HTTPStatusCode: 409, RawError: {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}
E1005 15:37:17.063834       1 utils.go:100] GRPC error: Attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3" to instance "k8s-agentpool1-35271516-vmss000000" failed with Retriable: false, RetryAfter: 0s, HTTPStatusCode: 409, RawError: {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}
I1005 15:37:28.843245       1 azure_vmss.go:319] Couldn't find VMSS VM with scaleSetName "k8s-agentpool1-35271516-vmss" and instanceID "0", refreshing the cache
... skipping 3 lines ...
I1005 15:37:31.409302       1 utils.go:102] GRPC response: {}
I1005 15:37:31.409456       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:37:31.409513       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-35271516-vmss000001, refreshing the cache
I1005 15:37:31.456030       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-8b97da8c-553c-4700-a0a9-d72d028b1e34" lun 1 to node "k8s-agentpool1-35271516-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-8b97da8c-553c-4700-a0a9-d72d028b1e34:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-8b97da8c-553c-4700-a0a9-d72d028b1e34  true false 1})]
I1005 15:37:31.456091       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:37:31.456132       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-8b97da8c-553c-4700-a0a9-d72d028b1e34:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-8b97da8c-553c-4700-a0a9-d72d028b1e34  true false 1})])
I1005 15:37:31.630309       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-8b97da8c-553c-4700-a0a9-d72d028b1e34:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-8b97da8c-553c-4700-a0a9-d72d028b1e34  true false 1})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1005 15:37:34.335441       1 utils.go:95] GRPC call: /csi.v1.Controller/DeleteVolume
I1005 15:37:34.335468       1 utils.go:96] GRPC request: {"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-4e097b77-501d-45be-b10b-fbad18d552ef"}
I1005 15:37:34.335570       1 controllerserver.go:389] deleting azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-4e097b77-501d-45be-b10b-fbad18d552ef)
I1005 15:37:39.557806       1 azure_managedDiskController.go:286] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-4e097b77-501d-45be-b10b-fbad18d552ef
I1005 15:37:39.557840       1 controllerserver.go:391] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-4e097b77-501d-45be-b10b-fbad18d552ef) returned with <nil>
I1005 15:37:39.557891       1 utils.go:102] GRPC response: {}
... skipping 20 lines ...
I1005 15:37:49.103001       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:37:49.103074       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3" to node "k8s-agentpool1-35271516-vmss000000"
I1005 15:37:49.103109       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:37:49.103123       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3" lun 32 to node "k8s-agentpool1-35271516-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3  true false 32})]
I1005 15:37:49.103148       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:37:49.103181       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3  true false 32})])
I1005 15:37:49.191185       1 azure_armclient.go:341] Received error in sendAsync.send: resourceID: https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-35271516-vmss/virtualMachines/0?api-version=2020-12-01, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 409, RawError: {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}
I1005 15:37:49.191213       1 azure_armclient.go:594] Received error in put.send: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-35271516-vmss/virtualMachines/0, error: %!s(<nil>)
E1005 15:37:49.191280       1 azure_controller_vmss.go:125] azureDisk - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3  true false 32})]) on rg(kubetest-4edgu0dt) vm(k8s-agentpool1-35271516-vmss000000) failed, err: &{false 409 0001-01-01 00:00:00 +0000 UTC {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}}
I1005 15:37:49.191345       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3  true false 32})], &{%!s(bool=false) %!s(int=409) 0001-01-01 00:00:00 +0000 UTC {
  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}}) returned with %!v(MISSING)
E1005 15:37:49.191388       1 controllerserver.go:481] Attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3" to instance "k8s-agentpool1-35271516-vmss000000" failed with Retriable: false, RetryAfter: 0s, HTTPStatusCode: 409, RawError: {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}
E1005 15:37:49.191446       1 utils.go:100] GRPC error: Attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3" to instance "k8s-agentpool1-35271516-vmss000000" failed with Retriable: false, RetryAfter: 0s, HTTPStatusCode: 409, RawError: {

  "error": {

    "code": "OperationNotAllowed",
    "message": "The maximum number of data disks allowed to be attached to a VM of this size is 32.",
    "target": "dataDisks"
  }
}
I1005 15:37:49.702960       1 azure_managedDiskController.go:286] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-59fe9b6d-ebeb-456f-8421-0787a1b6eb2e
... skipping 137 lines ...
I1005 15:37:53.863694       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-35271516-vmss000000","volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-ecddc8e6-1743-42d2-953c-7c5d3f767704"}
I1005 15:37:53.863804       1 controllerserver.go:524] Trying to detach volume /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-ecddc8e6-1743-42d2-953c-7c5d3f767704 from node k8s-agentpool1-35271516-vmss000000
I1005 15:37:53.863815       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:37:53.863855       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:37:53.866941       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:37:53.866963       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-72cb0e0b-687c-4961-b868-6ab79b6df0de","parameters":{"csi.storage.k8s.io/pv/name":"pvc-72cb0e0b-687c-4961-b868-6ab79b6df0de","csi.storage.k8s.io/pvc/name":"test.csi.azure.com4cmrn","csi.storage.k8s.io/pvc/namespace":"fsgroupchangepolicy-2468"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:37:53.896352       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-72cb0e0b-687c-4961-b868-6ab79b6df0de, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-72cb0e0b-687c-4961-b868-6ab79b6df0de' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:37:53.896430       1 controllerserver.go:271] begin to create azure disk(pvc-72cb0e0b-687c-4961-b868-6ab79b6df0de) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:37:53.896462       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-72cb0e0b-687c-4961-b868-6ab79b6df0de StorageAccountType:StandardSSD_LRS Size:5
I1005 15:37:54.011974       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerUnpublishVolume
I1005 15:37:54.011999       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-35271516-vmss000000","volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-309b3973-86d5-4cc3-9275-404c6a423244"}
I1005 15:37:54.012145       1 controllerserver.go:524] Trying to detach volume /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-309b3973-86d5-4cc3-9275-404c6a423244 from node k8s-agentpool1-35271516-vmss000000
I1005 15:37:54.012164       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
... skipping 126 lines ...
I1005 15:38:48.070818       1 controllerserver.go:524] Trying to detach volume /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b from node k8s-agentpool1-35271516-vmss000001
I1005 15:38:48.070833       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:38:48.098019       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-72cb0e0b-687c-4961-b868-6ab79b6df0de" lun 0 to node "k8s-agentpool1-35271516-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-72cb0e0b-687c-4961-b868-6ab79b6df0de:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-72cb0e0b-687c-4961-b868-6ab79b6df0de  true false 0})]
I1005 15:38:48.098067       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:38:48.098084       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-72cb0e0b-687c-4961-b868-6ab79b6df0de:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-72cb0e0b-687c-4961-b868-6ab79b6df0de  true false 0})])
I1005 15:38:48.098233       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:38:48.259844       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-72cb0e0b-687c-4961-b868-6ab79b6df0de:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-72cb0e0b-687c-4961-b868-6ab79b6df0de  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1005 15:38:48.260151       1 azure_controller_common.go:346] Trying to detach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-8b97da8c-553c-4700-a0a9-d72d028b1e34" from node "k8s-agentpool1-35271516-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b:pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-8b97da8c-553c-4700-a0a9-d72d028b1e34:pvc-8b97da8c-553c-4700-a0a9-d72d028b1e34]
I1005 15:38:48.260251       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-35271516-vmss000001, refreshing the cache
I1005 15:38:48.394772       1 azure_controller_vmss.go:174] azureDisk - detach disk: name "pvc-8b97da8c-553c-4700-a0a9-d72d028b1e34" uri "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-8b97da8c-553c-4700-a0a9-d72d028b1e34"
I1005 15:38:48.394822       1 azure_controller_vmss.go:213] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - detach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b:pvc-1aadaea7-2b1e-4124-80a0-01d7e676c36b /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-8b97da8c-553c-4700-a0a9-d72d028b1e34:pvc-8b97da8c-553c-4700-a0a9-d72d028b1e34])
I1005 15:38:51.194438       1 utils.go:95] GRPC call: /csi.v1.Controller/DeleteVolume
I1005 15:38:51.194471       1 utils.go:96] GRPC request: {"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-9fd5f8d8-7e49-4206-be01-9d9b78035de8"}
... skipping 87 lines ...
I1005 15:39:04.064519       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:39:04.064558       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-8b97da8c-553c-4700-a0a9-d72d028b1e34" to node "k8s-agentpool1-35271516-vmss000001"
I1005 15:39:04.064593       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:39:04.064608       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-8b97da8c-553c-4700-a0a9-d72d028b1e34" lun 1 to node "k8s-agentpool1-35271516-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-8b97da8c-553c-4700-a0a9-d72d028b1e34:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-8b97da8c-553c-4700-a0a9-d72d028b1e34  true false 1})]
I1005 15:39:04.064628       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:39:04.064644       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-8b97da8c-553c-4700-a0a9-d72d028b1e34:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-8b97da8c-553c-4700-a0a9-d72d028b1e34  true false 1})])
I1005 15:39:04.235993       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-8b97da8c-553c-4700-a0a9-d72d028b1e34:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-8b97da8c-553c-4700-a0a9-d72d028b1e34  true false 1})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1005 15:39:06.185069       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:39:06.185116       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-46ac4c54-1882-4816-82e1-ea39f5a77587","parameters":{"csi.storage.k8s.io/pv/name":"pvc-46ac4c54-1882-4816-82e1-ea39f5a77587","csi.storage.k8s.io/pvc/name":"test.csi.azure.comgm9x2","csi.storage.k8s.io/pvc/namespace":"volume-2349"},"volume_capabilities":[{"AccessType":{"Block":{}},"access_mode":{"mode":7}}]}
I1005 15:39:06.203880       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-46ac4c54-1882-4816-82e1-ea39f5a77587, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-46ac4c54-1882-4816-82e1-ea39f5a77587' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:39:06.204020       1 controllerserver.go:271] begin to create azure disk(pvc-46ac4c54-1882-4816-82e1-ea39f5a77587) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:39:06.204040       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-46ac4c54-1882-4816-82e1-ea39f5a77587 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:39:08.647944       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-46ac4c54-1882-4816-82e1-ea39f5a77587 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:39:08.647999       1 controllerserver.go:348] create azure disk(pvc-46ac4c54-1882-4816-82e1-ea39f5a77587) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-46ac4c54-1882-4816-82e1-ea39f5a77587 kubernetes.io-created-for-pvc-name:test.csi.azure.comgm9x2 kubernetes.io-created-for-pvc-namespace:volume-2349]) successfully
I1005 15:39:08.648023       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-46ac4c54-1882-4816-82e1-ea39f5a77587","csi.storage.k8s.io/pvc/name":"test.csi.azure.comgm9x2","csi.storage.k8s.io/pvc/namespace":"volume-2349","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-46ac4c54-1882-4816-82e1-ea39f5a77587"}}
I1005 15:39:08.948473       1 azure_controller_vmss.go:225] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - detach disk(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-18a5b3fc-fda9-42b4-8f9f-345b9ba4485d:pvc-18a5b3fc-fda9-42b4-8f9f-345b9ba4485d]) returned with <nil>
... skipping 122 lines ...
I1005 15:39:09.068943       1 controllerserver.go:533] detach volume /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-0e466a66-660b-4917-ba77-72beb04c4e56 from node k8s-agentpool1-35271516-vmss000000 successfully
I1005 15:39:09.068964       1 utils.go:102] GRPC response: {}
I1005 15:39:09.068998       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:39:09.069022       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-51c75314-588b-48db-96c2-d6011d676075" lun 0 to node "k8s-agentpool1-35271516-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3  true false 1}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-51c75314-588b-48db-96c2-d6011d676075:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-51c75314-588b-48db-96c2-d6011d676075  true false 0})]
I1005 15:39:09.069043       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:39:09.069057       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3  true false 1}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-51c75314-588b-48db-96c2-d6011d676075:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-51c75314-588b-48db-96c2-d6011d676075  true false 0})])
I1005 15:39:09.262185       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3  true false 1}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-51c75314-588b-48db-96c2-d6011d676075:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-51c75314-588b-48db-96c2-d6011d676075  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1005 15:39:09.262386       1 azure_controller_common.go:346] Trying to detach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-4b60fcee-8d14-402e-81b1-45efe61d0cbe" from node "k8s-agentpool1-35271516-vmss000000", diskMap: map[]
I1005 15:39:09.262412       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:39:09.262451       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-35271516-vmss000000, refreshing the cache
I1005 15:39:09.314153       1 azure_controller_common.go:369] azureDisk - detach disk(pvc-4b60fcee-8d14-402e-81b1-45efe61d0cbe, /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-4b60fcee-8d14-402e-81b1-45efe61d0cbe) succeeded
I1005 15:39:09.314193       1 controllerserver.go:533] detach volume /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-4b60fcee-8d14-402e-81b1-45efe61d0cbe from node k8s-agentpool1-35271516-vmss000000 successfully
I1005 15:39:09.314212       1 utils.go:102] GRPC response: {}
... skipping 152 lines ...
I1005 15:39:24.138657       1 controllerserver.go:533] detach volume /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-22b9fe01-edf1-4560-8956-05a355e670df from node k8s-agentpool1-35271516-vmss000000 successfully
I1005 15:39:24.138664       1 utils.go:102] GRPC response: {}
I1005 15:39:24.138679       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:39:24.138691       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-46ac4c54-1882-4816-82e1-ea39f5a77587" lun 2 to node "k8s-agentpool1-35271516-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-46ac4c54-1882-4816-82e1-ea39f5a77587:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-46ac4c54-1882-4816-82e1-ea39f5a77587  true false 2})]
I1005 15:39:24.138705       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:39:24.138720       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-46ac4c54-1882-4816-82e1-ea39f5a77587:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-46ac4c54-1882-4816-82e1-ea39f5a77587  true false 2})])
I1005 15:39:24.317265       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-46ac4c54-1882-4816-82e1-ea39f5a77587:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-46ac4c54-1882-4816-82e1-ea39f5a77587  true false 2})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1005 15:39:29.193210       1 azure_vmss.go:319] Couldn't find VMSS VM with scaleSetName "k8s-agentpool1-35271516-vmss" and instanceID "0", refreshing the cache
I1005 15:39:34.440054       1 controllerserver.go:465] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-46ac4c54-1882-4816-82e1-ea39f5a77587" attached to node "k8s-agentpool1-35271516-vmss000000".
I1005 15:39:34.440087       1 controllerserver.go:485] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-46ac4c54-1882-4816-82e1-ea39f5a77587" to node "k8s-agentpool1-35271516-vmss000000" successfully
I1005 15:39:34.440121       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"2"}}
I1005 15:39:34.451514       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
I1005 15:39:34.451536       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-35271516-vmss000000","volume_capability":{"AccessType":{"Block":{}},"access_mode":{"mode":7}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-46ac4c54-1882-4816-82e1-ea39f5a77587","csi.storage.k8s.io/pvc/name":"test.csi.azure.comgm9x2","csi.storage.k8s.io/pvc/namespace":"volume-2349","requestedsizegib":"5","storage.kubernetes.io/csiProvisionerIdentity":"1633447947345-8081-test.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-46ac4c54-1882-4816-82e1-ea39f5a77587"}
... skipping 227 lines ...
I1005 15:40:19.035987       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-35271516-vmss000001, refreshing the cache
I1005 15:40:19.150294       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-46ac4c54-1882-4816-82e1-ea39f5a77587" to node "k8s-agentpool1-35271516-vmss000001"
I1005 15:40:19.150334       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:40:19.150352       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-46ac4c54-1882-4816-82e1-ea39f5a77587" lun 1 to node "k8s-agentpool1-35271516-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-46ac4c54-1882-4816-82e1-ea39f5a77587:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-46ac4c54-1882-4816-82e1-ea39f5a77587  true false 1})]
I1005 15:40:19.150387       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:40:19.150417       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-46ac4c54-1882-4816-82e1-ea39f5a77587:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-46ac4c54-1882-4816-82e1-ea39f5a77587  true false 1})])
I1005 15:40:19.375596       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-46ac4c54-1882-4816-82e1-ea39f5a77587:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-46ac4c54-1882-4816-82e1-ea39f5a77587  true false 1})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1005 15:40:21.788513       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:40:21.788543       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-66e95473-cab6-48b5-a482-48219f78732f","parameters":{"csi.storage.k8s.io/pv/name":"pvc-66e95473-cab6-48b5-a482-48219f78732f","csi.storage.k8s.io/pvc/name":"test.csi.azure.comd6l56","csi.storage.k8s.io/pvc/namespace":"fsgroupchangepolicy-5208"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:40:21.808678       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-66e95473-cab6-48b5-a482-48219f78732f, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-66e95473-cab6-48b5-a482-48219f78732f' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:40:21.808741       1 controllerserver.go:271] begin to create azure disk(pvc-66e95473-cab6-48b5-a482-48219f78732f) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:40:21.808755       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-66e95473-cab6-48b5-a482-48219f78732f StorageAccountType:StandardSSD_LRS Size:5
I1005 15:40:24.350447       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-66e95473-cab6-48b5-a482-48219f78732f StorageAccountType:StandardSSD_LRS Size:5
I1005 15:40:24.350505       1 controllerserver.go:348] create azure disk(pvc-66e95473-cab6-48b5-a482-48219f78732f) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-66e95473-cab6-48b5-a482-48219f78732f kubernetes.io-created-for-pvc-name:test.csi.azure.comd6l56 kubernetes.io-created-for-pvc-namespace:fsgroupchangepolicy-5208]) successfully
I1005 15:40:24.350544       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-66e95473-cab6-48b5-a482-48219f78732f","csi.storage.k8s.io/pvc/name":"test.csi.azure.comd6l56","csi.storage.k8s.io/pvc/namespace":"fsgroupchangepolicy-5208","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-66e95473-cab6-48b5-a482-48219f78732f"}}
I1005 15:40:26.516671       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 29 lines ...
I1005 15:40:48.801988       1 utils.go:102] GRPC response: {}
I1005 15:40:48.802117       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:40:48.802150       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-35271516-vmss000000, refreshing the cache
I1005 15:40:48.846710       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-66e95473-cab6-48b5-a482-48219f78732f" lun 0 to node "k8s-agentpool1-35271516-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-66e95473-cab6-48b5-a482-48219f78732f:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-66e95473-cab6-48b5-a482-48219f78732f  true false 0})]
I1005 15:40:48.846768       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:40:48.846809       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-66e95473-cab6-48b5-a482-48219f78732f:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-66e95473-cab6-48b5-a482-48219f78732f  true false 0})])
I1005 15:40:49.175447       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-66e95473-cab6-48b5-a482-48219f78732f:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-66e95473-cab6-48b5-a482-48219f78732f  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1005 15:40:52.410058       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerUnpublishVolume
I1005 15:40:52.410088       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-35271516-vmss000001","volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-72cb0e0b-687c-4961-b868-6ab79b6df0de"}
I1005 15:40:52.410190       1 controllerserver.go:524] Trying to detach volume /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-72cb0e0b-687c-4961-b868-6ab79b6df0de from node k8s-agentpool1-35271516-vmss000001
I1005 15:40:52.410209       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:40:52.410255       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:40:52.410276       1 azure_controller_common.go:346] Trying to detach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-72cb0e0b-687c-4961-b868-6ab79b6df0de" from node "k8s-agentpool1-35271516-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-72cb0e0b-687c-4961-b868-6ab79b6df0de:pvc-72cb0e0b-687c-4961-b868-6ab79b6df0de]
I1005 15:40:52.410303       1 azure_controller_vmss.go:174] azureDisk - detach disk: name "pvc-72cb0e0b-687c-4961-b868-6ab79b6df0de" uri "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-72cb0e0b-687c-4961-b868-6ab79b6df0de"
I1005 15:40:52.410319       1 azure_controller_vmss.go:213] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - detach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-72cb0e0b-687c-4961-b868-6ab79b6df0de:pvc-72cb0e0b-687c-4961-b868-6ab79b6df0de])
I1005 15:40:52.879236       1 azure_managedDiskController.go:286] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-8b97da8c-553c-4700-a0a9-d72d028b1e34
I1005 15:40:52.879267       1 controllerserver.go:391] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-8b97da8c-553c-4700-a0a9-d72d028b1e34) returned with <nil>
I1005 15:40:52.879284       1 utils.go:102] GRPC response: {}
I1005 15:40:58.437409       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:40:58.437454       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-aa76d37f-eba5-4fb9-b42f-37049e9e4629","parameters":{"csi.storage.k8s.io/pv/name":"pvc-aa76d37f-eba5-4fb9-b42f-37049e9e4629","csi.storage.k8s.io/pvc/name":"inline-volume-tester-245k2-my-volume-0","csi.storage.k8s.io/pvc/namespace":"ephemeral-3665"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:40:58.456413       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-aa76d37f-eba5-4fb9-b42f-37049e9e4629, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-aa76d37f-eba5-4fb9-b42f-37049e9e4629' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:40:58.456493       1 controllerserver.go:271] begin to create azure disk(pvc-aa76d37f-eba5-4fb9-b42f-37049e9e4629) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:40:58.456537       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-aa76d37f-eba5-4fb9-b42f-37049e9e4629 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:41:00.830163       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-aa76d37f-eba5-4fb9-b42f-37049e9e4629 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:41:00.830221       1 controllerserver.go:348] create azure disk(pvc-aa76d37f-eba5-4fb9-b42f-37049e9e4629) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-aa76d37f-eba5-4fb9-b42f-37049e9e4629 kubernetes.io-created-for-pvc-name:inline-volume-tester-245k2-my-volume-0 kubernetes.io-created-for-pvc-namespace:ephemeral-3665]) successfully
I1005 15:41:00.830244       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-aa76d37f-eba5-4fb9-b42f-37049e9e4629","csi.storage.k8s.io/pvc/name":"inline-volume-tester-245k2-my-volume-0","csi.storage.k8s.io/pvc/namespace":"ephemeral-3665","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-aa76d37f-eba5-4fb9-b42f-37049e9e4629"}}
I1005 15:41:02.398077       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 3 lines ...
I1005 15:41:02.423118       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-35271516-vmss000000, refreshing the cache
I1005 15:41:02.482720       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-aa76d37f-eba5-4fb9-b42f-37049e9e4629" to node "k8s-agentpool1-35271516-vmss000000"
I1005 15:41:02.482781       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:41:02.482801       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-aa76d37f-eba5-4fb9-b42f-37049e9e4629" lun 2 to node "k8s-agentpool1-35271516-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-aa76d37f-eba5-4fb9-b42f-37049e9e4629:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-aa76d37f-eba5-4fb9-b42f-37049e9e4629  true false 2})]
I1005 15:41:02.482817       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:41:02.482829       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-aa76d37f-eba5-4fb9-b42f-37049e9e4629:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-aa76d37f-eba5-4fb9-b42f-37049e9e4629  true false 2})])
I1005 15:41:02.650791       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-aa76d37f-eba5-4fb9-b42f-37049e9e4629:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-aa76d37f-eba5-4fb9-b42f-37049e9e4629  true false 2})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1005 15:41:12.484553       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerUnpublishVolume
I1005 15:41:12.484582       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-35271516-vmss000001","volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-46ac4c54-1882-4816-82e1-ea39f5a77587"}
I1005 15:41:12.484698       1 controllerserver.go:524] Trying to detach volume /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-46ac4c54-1882-4816-82e1-ea39f5a77587 from node k8s-agentpool1-35271516-vmss000001
I1005 15:41:12.484722       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:41:12.484762       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:41:13.773995       1 utils.go:95] GRPC call: /csi.v1.Controller/DeleteVolume
... skipping 22 lines ...
I1005 15:41:17.798002       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"2"}}
I1005 15:41:18.974444       1 azure_managedDiskController.go:286] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-51c75314-588b-48db-96c2-d6011d676075
I1005 15:41:18.974614       1 controllerserver.go:391] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-51c75314-588b-48db-96c2-d6011d676075) returned with <nil>
I1005 15:41:18.974635       1 utils.go:102] GRPC response: {}
I1005 15:41:21.301667       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:41:21.301695       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-ae723511-6f84-473f-875e-c08b1113a43a","parameters":{"csi.storage.k8s.io/pv/name":"pvc-ae723511-6f84-473f-875e-c08b1113a43a","csi.storage.k8s.io/pvc/name":"inline-volume-tester2-gfrtb-my-volume-0","csi.storage.k8s.io/pvc/namespace":"ephemeral-7855"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:41:21.325229       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-ae723511-6f84-473f-875e-c08b1113a43a, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-ae723511-6f84-473f-875e-c08b1113a43a' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:41:21.325312       1 controllerserver.go:271] begin to create azure disk(pvc-ae723511-6f84-473f-875e-c08b1113a43a) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:41:21.325349       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-ae723511-6f84-473f-875e-c08b1113a43a StorageAccountType:StandardSSD_LRS Size:5
I1005 15:41:23.608587       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-ae723511-6f84-473f-875e-c08b1113a43a StorageAccountType:StandardSSD_LRS Size:5
I1005 15:41:23.608624       1 controllerserver.go:348] create azure disk(pvc-ae723511-6f84-473f-875e-c08b1113a43a) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-ae723511-6f84-473f-875e-c08b1113a43a kubernetes.io-created-for-pvc-name:inline-volume-tester2-gfrtb-my-volume-0 kubernetes.io-created-for-pvc-namespace:ephemeral-7855]) successfully
I1005 15:41:23.608645       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-ae723511-6f84-473f-875e-c08b1113a43a","csi.storage.k8s.io/pvc/name":"inline-volume-tester2-gfrtb-my-volume-0","csi.storage.k8s.io/pvc/namespace":"ephemeral-7855","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-ae723511-6f84-473f-875e-c08b1113a43a"}}
I1005 15:41:23.735822       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:41:23.735846       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc","parameters":{"csi.storage.k8s.io/pv/name":"pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc","csi.storage.k8s.io/pvc/name":"test.csi.azure.compkb6r","csi.storage.k8s.io/pvc/namespace":"volume-expand-9804"},"volume_capabilities":[{"AccessType":{"Block":{}},"access_mode":{"mode":7}}]}
I1005 15:41:23.766470       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:41:23.766567       1 controllerserver.go:271] begin to create azure disk(pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:41:23.766602       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc StorageAccountType:StandardSSD_LRS Size:5
I1005 15:41:24.399859       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
I1005 15:41:24.399886       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-35271516-vmss000001","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":7}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-ae723511-6f84-473f-875e-c08b1113a43a","csi.storage.k8s.io/pvc/name":"inline-volume-tester2-gfrtb-my-volume-0","csi.storage.k8s.io/pvc/namespace":"ephemeral-7855","requestedsizegib":"5","storage.kubernetes.io/csiProvisionerIdentity":"1633447947345-8081-test.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-ae723511-6f84-473f-875e-c08b1113a43a"}
I1005 15:41:24.474564       1 controllerserver.go:440] GetDiskLun returned: <nil>. Initiating attaching volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-ae723511-6f84-473f-875e-c08b1113a43a" to node "k8s-agentpool1-35271516-vmss000001".
I1005 15:41:24.474592       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
... skipping 12 lines ...
I1005 15:41:38.009642       1 utils.go:102] GRPC response: {}
I1005 15:41:38.009761       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:41:38.009826       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-35271516-vmss000001, refreshing the cache
I1005 15:41:38.114620       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-ae723511-6f84-473f-875e-c08b1113a43a" lun 0 to node "k8s-agentpool1-35271516-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-ae723511-6f84-473f-875e-c08b1113a43a:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-ae723511-6f84-473f-875e-c08b1113a43a  true false 0}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc  true false 1})]
I1005 15:41:38.114660       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:41:38.114678       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-ae723511-6f84-473f-875e-c08b1113a43a:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-ae723511-6f84-473f-875e-c08b1113a43a  true false 0}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc  true false 1})])
I1005 15:41:38.325079       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-ae723511-6f84-473f-875e-c08b1113a43a:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-ae723511-6f84-473f-875e-c08b1113a43a  true false 0}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc  true false 1})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1005 15:41:38.325348       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:41:38.325384       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-35271516-vmss000001, refreshing the cache
I1005 15:41:38.373786       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc" lun 1 to node "k8s-agentpool1-35271516-vmss000001", diskMap: map[]
I1005 15:41:38.373841       1 controllerserver.go:465] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc" attached to node "k8s-agentpool1-35271516-vmss000001".
I1005 15:41:38.373851       1 controllerserver.go:485] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc" to node "k8s-agentpool1-35271516-vmss000001" successfully
I1005 15:41:38.373864       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"1"}}
... skipping 20 lines ...
I1005 15:41:48.940448       1 utils.go:96] GRPC request: {}
I1005 15:41:48.940491       1 utils.go:102] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":9}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":10}}},{"Type":{"Rpc":{"type":13}}}]}
I1005 15:41:48.941239       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerExpandVolume
I1005 15:41:48.941260       1 utils.go:96] GRPC request: {"capacity_range":{"required_bytes":6442450944},"volume_capability":{"AccessType":{"Block":{}},"access_mode":{"mode":7}},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc"}
I1005 15:41:48.964681       1 controllerserver.go:807] begin to expand azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc) with new size(6442450944)
I1005 15:41:48.988324       1 azure_managedDiskController.go:336] azureDisk - begin to resize disk(pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc) with new size(6), old size({{5 0} {<nil>}  BinarySI})
E1005 15:41:48.988400       1 utils.go:100] GRPC error: rpc error: code = Internal desc = failed to resize disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc) with error(azureDisk - disk resize is only supported on Unattached disk, current disk state: Attached, already attached to /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-35271516-vmss/virtualMachines/k8s-agentpool1-35271516-vmss_1)
I1005 15:41:48.997391       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerGetCapabilities
I1005 15:41:48.997433       1 utils.go:96] GRPC request: {}
I1005 15:41:48.997458       1 utils.go:102] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":9}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":10}}},{"Type":{"Rpc":{"type":13}}}]}
I1005 15:41:48.997893       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerExpandVolume
I1005 15:41:48.997913       1 utils.go:96] GRPC request: {"capacity_range":{"required_bytes":6442450944},"volume_capability":{"AccessType":{"Block":{}},"access_mode":{"mode":7}},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc"}
I1005 15:41:49.025750       1 controllerserver.go:807] begin to expand azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc) with new size(6442450944)
I1005 15:41:49.050053       1 azure_managedDiskController.go:336] azureDisk - begin to resize disk(pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc) with new size(6), old size({{5 0} {<nil>}  BinarySI})
E1005 15:41:49.050103       1 utils.go:100] GRPC error: rpc error: code = Internal desc = failed to resize disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc) with error(azureDisk - disk resize is only supported on Unattached disk, current disk state: Attached, already attached to /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-35271516-vmss/virtualMachines/k8s-agentpool1-35271516-vmss_1)
I1005 15:41:49.994836       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerGetCapabilities
I1005 15:41:49.994860       1 utils.go:96] GRPC request: {}
I1005 15:41:49.994900       1 utils.go:102] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":9}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":10}}},{"Type":{"Rpc":{"type":13}}}]}
I1005 15:41:49.995460       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerExpandVolume
I1005 15:41:49.995480       1 utils.go:96] GRPC request: {"capacity_range":{"required_bytes":6442450944},"volume_capability":{"AccessType":{"Block":{}},"access_mode":{"mode":7}},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc"}
I1005 15:41:50.019366       1 controllerserver.go:807] begin to expand azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc) with new size(6442450944)
I1005 15:41:50.047650       1 azure_managedDiskController.go:336] azureDisk - begin to resize disk(pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc) with new size(6), old size({{5 0} {<nil>}  BinarySI})
E1005 15:41:50.047702       1 utils.go:100] GRPC error: rpc error: code = Internal desc = failed to resize disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc) with error(azureDisk - disk resize is only supported on Unattached disk, current disk state: Attached, already attached to /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-35271516-vmss/virtualMachines/k8s-agentpool1-35271516-vmss_1)
I1005 15:41:50.054185       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerGetCapabilities
I1005 15:41:50.054202       1 utils.go:96] GRPC request: {}
I1005 15:41:50.054234       1 utils.go:102] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":9}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":10}}},{"Type":{"Rpc":{"type":13}}}]}
I1005 15:41:50.054832       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerExpandVolume
I1005 15:41:50.054853       1 utils.go:96] GRPC request: {"capacity_range":{"required_bytes":6442450944},"volume_capability":{"AccessType":{"Block":{}},"access_mode":{"mode":7}},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc"}
I1005 15:41:50.078510       1 controllerserver.go:807] begin to expand azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc) with new size(6442450944)
I1005 15:41:50.100449       1 azure_managedDiskController.go:336] azureDisk - begin to resize disk(pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc) with new size(6), old size({{5 0} {<nil>}  BinarySI})
E1005 15:41:50.100497       1 utils.go:100] GRPC error: rpc error: code = Internal desc = failed to resize disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc) with error(azureDisk - disk resize is only supported on Unattached disk, current disk state: Attached, already attached to /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-35271516-vmss/virtualMachines/k8s-agentpool1-35271516-vmss_1)
I1005 15:41:50.142851       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerGetCapabilities
I1005 15:41:50.142874       1 utils.go:96] GRPC request: {}
I1005 15:41:50.142911       1 utils.go:102] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":9}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":10}}},{"Type":{"Rpc":{"type":13}}}]}
I1005 15:41:50.143443       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerExpandVolume
I1005 15:41:50.143501       1 utils.go:96] GRPC request: {"capacity_range":{"required_bytes":6442450944},"volume_capability":{"AccessType":{"Block":{}},"access_mode":{"mode":7}},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc"}
I1005 15:41:50.168681       1 controllerserver.go:807] begin to expand azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc) with new size(6442450944)
I1005 15:41:50.189982       1 azure_managedDiskController.go:336] azureDisk - begin to resize disk(pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc) with new size(6), old size({{5 0} {<nil>}  BinarySI})
E1005 15:41:50.190035       1 utils.go:100] GRPC error: rpc error: code = Internal desc = failed to resize disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc) with error(azureDisk - disk resize is only supported on Unattached disk, current disk state: Attached, already attached to /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-35271516-vmss/virtualMachines/k8s-agentpool1-35271516-vmss_1)
I1005 15:41:51.560672       1 azure_managedDiskController.go:286] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-72cb0e0b-687c-4961-b868-6ab79b6df0de
I1005 15:41:51.560703       1 controllerserver.go:391] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-72cb0e0b-687c-4961-b868-6ab79b6df0de) returned with <nil>
I1005 15:41:51.560719       1 utils.go:102] GRPC response: {}
I1005 15:41:52.714701       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerUnpublishVolume
I1005 15:41:52.714727       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-35271516-vmss000000","volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-66e95473-cab6-48b5-a482-48219f78732f"}
I1005 15:41:52.714823       1 controllerserver.go:524] Trying to detach volume /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-66e95473-cab6-48b5-a482-48219f78732f from node k8s-agentpool1-35271516-vmss000000
... skipping 6 lines ...
I1005 15:41:54.055366       1 utils.go:96] GRPC request: {}
I1005 15:41:54.055410       1 utils.go:102] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":9}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":10}}},{"Type":{"Rpc":{"type":13}}}]}
I1005 15:41:54.056030       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerExpandVolume
I1005 15:41:54.056048       1 utils.go:96] GRPC request: {"capacity_range":{"required_bytes":6442450944},"volume_capability":{"AccessType":{"Block":{}},"access_mode":{"mode":7}},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc"}
I1005 15:41:54.087400       1 controllerserver.go:807] begin to expand azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc) with new size(6442450944)
I1005 15:41:54.112817       1 azure_managedDiskController.go:336] azureDisk - begin to resize disk(pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc) with new size(6), old size({{5 0} {<nil>}  BinarySI})
E1005 15:41:54.112903       1 utils.go:100] GRPC error: rpc error: code = Internal desc = failed to resize disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc) with error(azureDisk - disk resize is only supported on Unattached disk, current disk state: Attached, already attached to /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-35271516-vmss/virtualMachines/k8s-agentpool1-35271516-vmss_1)
I1005 15:41:54.118181       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerGetCapabilities
I1005 15:41:54.118203       1 utils.go:96] GRPC request: {}
I1005 15:41:54.118231       1 utils.go:102] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":9}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":10}}},{"Type":{"Rpc":{"type":13}}}]}
I1005 15:41:54.118670       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerExpandVolume
I1005 15:41:54.118713       1 utils.go:96] GRPC request: {"capacity_range":{"required_bytes":6442450944},"volume_capability":{"AccessType":{"Block":{}},"access_mode":{"mode":7}},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc"}
I1005 15:41:54.149446       1 controllerserver.go:807] begin to expand azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc) with new size(6442450944)
I1005 15:41:54.170961       1 azure_managedDiskController.go:336] azureDisk - begin to resize disk(pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc) with new size(6), old size({{5 0} {<nil>}  BinarySI})
E1005 15:41:54.171010       1 utils.go:100] GRPC error: rpc error: code = Internal desc = failed to resize disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc) with error(azureDisk - disk resize is only supported on Unattached disk, current disk state: Attached, already attached to /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-35271516-vmss/virtualMachines/k8s-agentpool1-35271516-vmss_1)
I1005 15:41:56.595895       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:41:56.595924       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-99b77118-962b-4762-aa54-e5f426750803","parameters":{"csi.storage.k8s.io/pv/name":"pvc-99b77118-962b-4762-aa54-e5f426750803","csi.storage.k8s.io/pvc/name":"test.csi.azure.comf9xq9","csi.storage.k8s.io/pvc/namespace":"fsgroupchangepolicy-5853"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:41:56.615971       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-99b77118-962b-4762-aa54-e5f426750803, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-99b77118-962b-4762-aa54-e5f426750803' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:41:56.616050       1 controllerserver.go:271] begin to create azure disk(pvc-99b77118-962b-4762-aa54-e5f426750803) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:41:56.616064       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-99b77118-962b-4762-aa54-e5f426750803 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:41:59.048758       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-99b77118-962b-4762-aa54-e5f426750803 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:41:59.048812       1 controllerserver.go:348] create azure disk(pvc-99b77118-962b-4762-aa54-e5f426750803) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-99b77118-962b-4762-aa54-e5f426750803 kubernetes.io-created-for-pvc-name:test.csi.azure.comf9xq9 kubernetes.io-created-for-pvc-namespace:fsgroupchangepolicy-5853]) successfully
I1005 15:41:59.048833       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-99b77118-962b-4762-aa54-e5f426750803","csi.storage.k8s.io/pvc/name":"test.csi.azure.comf9xq9","csi.storage.k8s.io/pvc/namespace":"fsgroupchangepolicy-5853","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-99b77118-962b-4762-aa54-e5f426750803"}}
I1005 15:42:01.279323       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 12 lines ...
I1005 15:42:08.120484       1 utils.go:102] GRPC response: {}
I1005 15:42:08.120560       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:42:08.120671       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-35271516-vmss000000, refreshing the cache
I1005 15:42:08.191107       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-99b77118-962b-4762-aa54-e5f426750803" lun 0 to node "k8s-agentpool1-35271516-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-99b77118-962b-4762-aa54-e5f426750803:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-99b77118-962b-4762-aa54-e5f426750803  true false 0})]
I1005 15:42:08.191169       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:42:08.191232       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-99b77118-962b-4762-aa54-e5f426750803:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-99b77118-962b-4762-aa54-e5f426750803  true false 0})])
I1005 15:42:08.359780       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-99b77118-962b-4762-aa54-e5f426750803:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-99b77118-962b-4762-aa54-e5f426750803  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1005 15:42:08.360048       1 azure_controller_common.go:346] Trying to detach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-aa76d37f-eba5-4fb9-b42f-37049e9e4629" from node "k8s-agentpool1-35271516-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-aa76d37f-eba5-4fb9-b42f-37049e9e4629:pvc-aa76d37f-eba5-4fb9-b42f-37049e9e4629]
I1005 15:42:08.360087       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-35271516-vmss000000, refreshing the cache
I1005 15:42:08.402549       1 azure_controller_vmss.go:174] azureDisk - detach disk: name "pvc-aa76d37f-eba5-4fb9-b42f-37049e9e4629" uri "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-aa76d37f-eba5-4fb9-b42f-37049e9e4629"
I1005 15:42:08.402579       1 azure_controller_vmss.go:213] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - detach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-aa76d37f-eba5-4fb9-b42f-37049e9e4629:pvc-aa76d37f-eba5-4fb9-b42f-37049e9e4629])
I1005 15:42:20.956087       1 utils.go:95] GRPC call: /csi.v1.Controller/DeleteVolume
I1005 15:42:20.956134       1 utils.go:96] GRPC request: {"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-66e95473-cab6-48b5-a482-48219f78732f"}
... skipping 18 lines ...
I1005 15:42:26.129283       1 utils.go:102] GRPC response: {}
I1005 15:42:26.160689       1 controllerserver.go:807] begin to expand azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc) with new size(6442450944)
I1005 15:42:26.193978       1 azure_managedDiskController.go:286] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-aa76d37f-eba5-4fb9-b42f-37049e9e4629
I1005 15:42:26.194002       1 controllerserver.go:391] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-aa76d37f-eba5-4fb9-b42f-37049e9e4629) returned with <nil>
I1005 15:42:26.194033       1 utils.go:102] GRPC response: {}
I1005 15:42:26.270209       1 azure_managedDiskController.go:336] azureDisk - begin to resize disk(pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc) with new size(6), old size({{5 0} {<nil>}  BinarySI})
E1005 15:42:26.270270       1 utils.go:100] GRPC error: rpc error: code = Internal desc = failed to resize disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc) with error(azureDisk - disk resize is only supported on Unattached disk, current disk state: Attached, already attached to /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-35271516-vmss/virtualMachines/k8s-agentpool1-35271516-vmss_1)
I1005 15:42:26.950648       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerGetCapabilities
I1005 15:42:26.950684       1 utils.go:96] GRPC request: {}
I1005 15:42:26.950727       1 utils.go:102] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":9}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":10}}},{"Type":{"Rpc":{"type":13}}}]}
I1005 15:42:26.951370       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerExpandVolume
I1005 15:42:26.951391       1 utils.go:96] GRPC request: {"capacity_range":{"required_bytes":6442450944},"volume_capability":{"AccessType":{"Block":{}},"access_mode":{"mode":7}},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc"}
I1005 15:42:26.975855       1 controllerserver.go:807] begin to expand azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc) with new size(6442450944)
I1005 15:42:26.998395       1 azure_managedDiskController.go:336] azureDisk - begin to resize disk(pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc) with new size(6), old size({{5 0} {<nil>}  BinarySI})
E1005 15:42:26.998469       1 utils.go:100] GRPC error: rpc error: code = Internal desc = failed to resize disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc) with error(azureDisk - disk resize is only supported on Unattached disk, current disk state: Attached, already attached to /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-35271516-vmss/virtualMachines/k8s-agentpool1-35271516-vmss_1)
I1005 15:42:28.466228       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:42:28.466258       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-1b15c242-3e52-47e0-8f24-8f4e20525762","parameters":{"csi.storage.k8s.io/pv/name":"pvc-1b15c242-3e52-47e0-8f24-8f4e20525762","csi.storage.k8s.io/pvc/name":"test.csi.azure.comrlsjb","csi.storage.k8s.io/pvc/namespace":"provisioning-7940"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:42:28.506179       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-1b15c242-3e52-47e0-8f24-8f4e20525762, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-1b15c242-3e52-47e0-8f24-8f4e20525762' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:42:28.506256       1 controllerserver.go:271] begin to create azure disk(pvc-1b15c242-3e52-47e0-8f24-8f4e20525762) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:42:28.506287       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-1b15c242-3e52-47e0-8f24-8f4e20525762 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:42:29.644264       1 azure_vmss.go:319] Couldn't find VMSS VM with scaleSetName "k8s-agentpool1-35271516-vmss" and instanceID "0", refreshing the cache
I1005 15:42:30.845259       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-1b15c242-3e52-47e0-8f24-8f4e20525762 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:42:30.845317       1 controllerserver.go:348] create azure disk(pvc-1b15c242-3e52-47e0-8f24-8f4e20525762) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-1b15c242-3e52-47e0-8f24-8f4e20525762 kubernetes.io-created-for-pvc-name:test.csi.azure.comrlsjb kubernetes.io-created-for-pvc-namespace:provisioning-7940]) successfully
I1005 15:42:30.845341       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-1b15c242-3e52-47e0-8f24-8f4e20525762","csi.storage.k8s.io/pvc/name":"test.csi.azure.comrlsjb","csi.storage.k8s.io/pvc/namespace":"provisioning-7940","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-1b15c242-3e52-47e0-8f24-8f4e20525762"}}
I1005 15:42:32.474010       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:42:32.474057       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-800769ba-4425-4e2b-9c40-2efb332eef86","parameters":{"csi.storage.k8s.io/pv/name":"pvc-800769ba-4425-4e2b-9c40-2efb332eef86","csi.storage.k8s.io/pvc/name":"test.csi.azure.comm4q4t","csi.storage.k8s.io/pvc/namespace":"provisioning-2361"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:42:32.492154       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-800769ba-4425-4e2b-9c40-2efb332eef86, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-800769ba-4425-4e2b-9c40-2efb332eef86' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:42:32.492226       1 controllerserver.go:271] begin to create azure disk(pvc-800769ba-4425-4e2b-9c40-2efb332eef86) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:42:32.492240       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-800769ba-4425-4e2b-9c40-2efb332eef86 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:42:33.231399       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
I1005 15:42:33.231428       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-35271516-vmss000000","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":7}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-1b15c242-3e52-47e0-8f24-8f4e20525762","csi.storage.k8s.io/pvc/name":"test.csi.azure.comrlsjb","csi.storage.k8s.io/pvc/namespace":"provisioning-7940","requestedsizegib":"5","storage.kubernetes.io/csiProvisionerIdentity":"1633447947345-8081-test.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-1b15c242-3e52-47e0-8f24-8f4e20525762"}
I1005 15:42:33.260487       1 controllerserver.go:440] GetDiskLun returned: <nil>. Initiating attaching volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-1b15c242-3e52-47e0-8f24-8f4e20525762" to node "k8s-agentpool1-35271516-vmss000000".
I1005 15:42:33.260534       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:42:33.260572       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-1b15c242-3e52-47e0-8f24-8f4e20525762" to node "k8s-agentpool1-35271516-vmss000000"
I1005 15:42:33.260620       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:42:33.260631       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-1b15c242-3e52-47e0-8f24-8f4e20525762" lun 2 to node "k8s-agentpool1-35271516-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-1b15c242-3e52-47e0-8f24-8f4e20525762:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-1b15c242-3e52-47e0-8f24-8f4e20525762  true false 2})]
I1005 15:42:33.260664       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:42:33.260696       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-1b15c242-3e52-47e0-8f24-8f4e20525762:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-1b15c242-3e52-47e0-8f24-8f4e20525762  true false 2})])
I1005 15:42:33.448854       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-1b15c242-3e52-47e0-8f24-8f4e20525762:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-1b15c242-3e52-47e0-8f24-8f4e20525762  true false 2})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1005 15:42:33.531648       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerUnpublishVolume
I1005 15:42:33.531678       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-35271516-vmss000001","volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-ae723511-6f84-473f-875e-c08b1113a43a"}
I1005 15:42:33.531787       1 controllerserver.go:524] Trying to detach volume /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-ae723511-6f84-473f-875e-c08b1113a43a from node k8s-agentpool1-35271516-vmss000001
I1005 15:42:33.531796       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:42:33.531836       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:42:33.531868       1 azure_controller_common.go:346] Trying to detach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-ae723511-6f84-473f-875e-c08b1113a43a" from node "k8s-agentpool1-35271516-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-ae723511-6f84-473f-875e-c08b1113a43a:pvc-ae723511-6f84-473f-875e-c08b1113a43a]
... skipping 24 lines ...
I1005 15:42:48.765315       1 utils.go:102] GRPC response: {}
I1005 15:42:48.765400       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:42:48.765449       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-35271516-vmss000001, refreshing the cache
I1005 15:42:48.810102       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-800769ba-4425-4e2b-9c40-2efb332eef86" lun 0 to node "k8s-agentpool1-35271516-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-800769ba-4425-4e2b-9c40-2efb332eef86:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-800769ba-4425-4e2b-9c40-2efb332eef86  true false 0})]
I1005 15:42:48.810143       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:42:48.810163       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-800769ba-4425-4e2b-9c40-2efb332eef86:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-800769ba-4425-4e2b-9c40-2efb332eef86  true false 0})])
I1005 15:42:48.962020       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-800769ba-4425-4e2b-9c40-2efb332eef86:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-800769ba-4425-4e2b-9c40-2efb332eef86  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1005 15:42:53.087430       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerUnpublishVolume
I1005 15:42:53.087459       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-35271516-vmss000000","volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-99b77118-962b-4762-aa54-e5f426750803"}
I1005 15:42:53.087558       1 controllerserver.go:524] Trying to detach volume /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-99b77118-962b-4762-aa54-e5f426750803 from node k8s-agentpool1-35271516-vmss000000
I1005 15:42:53.087570       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:42:53.087610       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:42:53.087633       1 azure_controller_common.go:346] Trying to detach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-99b77118-962b-4762-aa54-e5f426750803" from node "k8s-agentpool1-35271516-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-99b77118-962b-4762-aa54-e5f426750803:pvc-99b77118-962b-4762-aa54-e5f426750803]
... skipping 21 lines ...
I1005 15:43:08.725969       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:43:08.726023       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-99b77118-962b-4762-aa54-e5f426750803" to node "k8s-agentpool1-35271516-vmss000001"
I1005 15:43:08.726037       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:43:08.726066       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-99b77118-962b-4762-aa54-e5f426750803" lun 2 to node "k8s-agentpool1-35271516-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-99b77118-962b-4762-aa54-e5f426750803:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-99b77118-962b-4762-aa54-e5f426750803  true false 2})]
I1005 15:43:08.726112       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:43:08.726161       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-99b77118-962b-4762-aa54-e5f426750803:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-99b77118-962b-4762-aa54-e5f426750803  true false 2})])
I1005 15:43:08.885399       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-99b77118-962b-4762-aa54-e5f426750803:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-99b77118-962b-4762-aa54-e5f426750803  true false 2})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1005 15:43:09.073215       1 controllerserver.go:465] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-800769ba-4425-4e2b-9c40-2efb332eef86" attached to node "k8s-agentpool1-35271516-vmss000001".
I1005 15:43:09.073270       1 controllerserver.go:485] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-800769ba-4425-4e2b-9c40-2efb332eef86" to node "k8s-agentpool1-35271516-vmss000001" successfully
I1005 15:43:09.073328       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
I1005 15:43:09.704564       1 azure_managedDiskController.go:286] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-ae723511-6f84-473f-875e-c08b1113a43a
I1005 15:43:09.704592       1 controllerserver.go:391] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-ae723511-6f84-473f-875e-c08b1113a43a) returned with <nil>
I1005 15:43:09.704608       1 utils.go:102] GRPC response: {}
... skipping 48 lines ...
I1005 15:43:53.465630       1 azure_controller_vmss.go:174] azureDisk - detach disk: name "pvc-800769ba-4425-4e2b-9c40-2efb332eef86" uri "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-800769ba-4425-4e2b-9c40-2efb332eef86"
I1005 15:43:53.465641       1 azure_controller_vmss.go:213] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - detach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-800769ba-4425-4e2b-9c40-2efb332eef86:pvc-800769ba-4425-4e2b-9c40-2efb332eef86])
I1005 15:44:00.399422       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:44:00.399451       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-1fd652e3-39bc-44c2-af30-a82d7b3f1344","parameters":{"csi.storage.k8s.io/pv/name":"pvc-1fd652e3-39bc-44c2-af30-a82d7b3f1344","csi.storage.k8s.io/pvc/name":"inline-volume-tester-8tjkq-my-volume-0","csi.storage.k8s.io/pvc/namespace":"ephemeral-6781"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:44:00.406840       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:44:00.406863       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-860db465-ee81-4288-b412-935fbe980a2f","parameters":{"csi.storage.k8s.io/pv/name":"pvc-860db465-ee81-4288-b412-935fbe980a2f","csi.storage.k8s.io/pvc/name":"inline-volume-tester-8tjkq-my-volume-1","csi.storage.k8s.io/pvc/namespace":"ephemeral-6781"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:44:00.430708       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-860db465-ee81-4288-b412-935fbe980a2f, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-860db465-ee81-4288-b412-935fbe980a2f' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:44:00.430801       1 controllerserver.go:271] begin to create azure disk(pvc-860db465-ee81-4288-b412-935fbe980a2f) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:44:00.430815       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-860db465-ee81-4288-b412-935fbe980a2f StorageAccountType:StandardSSD_LRS Size:5
I1005 15:44:00.454525       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-1fd652e3-39bc-44c2-af30-a82d7b3f1344, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-1fd652e3-39bc-44c2-af30-a82d7b3f1344' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:44:00.454630       1 controllerserver.go:271] begin to create azure disk(pvc-1fd652e3-39bc-44c2-af30-a82d7b3f1344) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:44:00.454657       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-1fd652e3-39bc-44c2-af30-a82d7b3f1344 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:44:02.765149       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-860db465-ee81-4288-b412-935fbe980a2f StorageAccountType:StandardSSD_LRS Size:5
I1005 15:44:02.765223       1 controllerserver.go:348] create azure disk(pvc-860db465-ee81-4288-b412-935fbe980a2f) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-860db465-ee81-4288-b412-935fbe980a2f kubernetes.io-created-for-pvc-name:inline-volume-tester-8tjkq-my-volume-1 kubernetes.io-created-for-pvc-namespace:ephemeral-6781]) successfully
I1005 15:44:02.765268       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-860db465-ee81-4288-b412-935fbe980a2f","csi.storage.k8s.io/pvc/name":"inline-volume-tester-8tjkq-my-volume-1","csi.storage.k8s.io/pvc/namespace":"ephemeral-6781","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-860db465-ee81-4288-b412-935fbe980a2f"}}
I1005 15:44:02.820892       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-1fd652e3-39bc-44c2-af30-a82d7b3f1344 StorageAccountType:StandardSSD_LRS Size:5
... skipping 40 lines ...
I1005 15:44:09.215672       1 controllerserver.go:440] GetDiskLun returned: <nil>. Initiating attaching volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-800769ba-4425-4e2b-9c40-2efb332eef86" to node "k8s-agentpool1-35271516-vmss000000".
I1005 15:44:09.215703       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:44:09.215775       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-800769ba-4425-4e2b-9c40-2efb332eef86" to node "k8s-agentpool1-35271516-vmss000000"
I1005 15:44:12.984882       1 utils.go:95] GRPC call: /csi.v1.Controller/DeleteVolume
I1005 15:44:12.984912       1 utils.go:96] GRPC request: {"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3"}
I1005 15:44:12.985002       1 controllerserver.go:389] deleting azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3)
I1005 15:44:12.985014       1 controllerserver.go:391] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3) returned with failed to delete disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3) since it's in attaching or detaching state
E1005 15:44:12.985032       1 utils.go:100] GRPC error: failed to delete disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3) since it's in attaching or detaching state
I1005 15:44:24.041689       1 azure_controller_vmss.go:225] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - detach disk(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-99b77118-962b-4762-aa54-e5f426750803:pvc-99b77118-962b-4762-aa54-e5f426750803]) returned with <nil>
I1005 15:44:24.041746       1 azure_controller_common.go:369] azureDisk - detach disk(pvc-99b77118-962b-4762-aa54-e5f426750803, /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-99b77118-962b-4762-aa54-e5f426750803) succeeded
I1005 15:44:24.041770       1 controllerserver.go:533] detach volume /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-99b77118-962b-4762-aa54-e5f426750803 from node k8s-agentpool1-35271516-vmss000001 successfully
I1005 15:44:24.041784       1 utils.go:102] GRPC response: {}
I1005 15:44:24.041845       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:44:24.041881       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-35271516-vmss000001, refreshing the cache
... skipping 6 lines ...
I1005 15:44:24.134757       1 utils.go:102] GRPC response: {}
I1005 15:44:24.134834       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:44:24.134854       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-35271516-vmss000000, refreshing the cache
I1005 15:44:24.179522       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-800769ba-4425-4e2b-9c40-2efb332eef86" lun 0 to node "k8s-agentpool1-35271516-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-800769ba-4425-4e2b-9c40-2efb332eef86:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-800769ba-4425-4e2b-9c40-2efb332eef86  true false 0})]
I1005 15:44:24.179553       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:44:24.179584       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-800769ba-4425-4e2b-9c40-2efb332eef86:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-800769ba-4425-4e2b-9c40-2efb332eef86  true false 0})])
I1005 15:44:24.339183       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-800769ba-4425-4e2b-9c40-2efb332eef86:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-800769ba-4425-4e2b-9c40-2efb332eef86  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1005 15:44:24.348634       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-1fd652e3-39bc-44c2-af30-a82d7b3f1344:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-1fd652e3-39bc-44c2-af30-a82d7b3f1344  true false 0}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-860db465-ee81-4288-b412-935fbe980a2f:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-860db465-ee81-4288-b412-935fbe980a2f  true false 2})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1005 15:44:24.348847       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:44:24.348879       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-35271516-vmss000001, refreshing the cache
I1005 15:44:24.443402       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-860db465-ee81-4288-b412-935fbe980a2f" lun 2 to node "k8s-agentpool1-35271516-vmss000001", diskMap: map[]
I1005 15:44:24.443469       1 controllerserver.go:465] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-860db465-ee81-4288-b412-935fbe980a2f" attached to node "k8s-agentpool1-35271516-vmss000001".
I1005 15:44:24.443479       1 controllerserver.go:485] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-860db465-ee81-4288-b412-935fbe980a2f" to node "k8s-agentpool1-35271516-vmss000001" successfully
I1005 15:44:24.443493       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"2"}}
... skipping 11 lines ...
I1005 15:44:34.289666       1 utils.go:96] GRPC request: {}
I1005 15:44:34.289733       1 utils.go:102] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":9}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":10}}},{"Type":{"Rpc":{"type":13}}}]}
I1005 15:44:34.290320       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerExpandVolume
I1005 15:44:34.290339       1 utils.go:96] GRPC request: {"capacity_range":{"required_bytes":6442450944},"volume_capability":{"AccessType":{"Block":{}},"access_mode":{"mode":7}},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc"}
I1005 15:44:34.323579       1 controllerserver.go:807] begin to expand azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc) with new size(6442450944)
I1005 15:44:34.347232       1 azure_managedDiskController.go:336] azureDisk - begin to resize disk(pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc) with new size(6), old size({{5 0} {<nil>}  BinarySI})
E1005 15:44:34.347296       1 utils.go:100] GRPC error: rpc error: code = Internal desc = failed to resize disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc) with error(azureDisk - disk resize is only supported on Unattached disk, current disk state: Attached, already attached to /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-35271516-vmss/virtualMachines/k8s-agentpool1-35271516-vmss_1)
I1005 15:44:34.451504       1 controllerserver.go:465] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-1fd652e3-39bc-44c2-af30-a82d7b3f1344" attached to node "k8s-agentpool1-35271516-vmss000001".
I1005 15:44:34.451538       1 controllerserver.go:485] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-1fd652e3-39bc-44c2-af30-a82d7b3f1344" to node "k8s-agentpool1-35271516-vmss000001" successfully
I1005 15:44:34.451577       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
I1005 15:44:34.458155       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
I1005 15:44:34.458178       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-35271516-vmss000001","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":7}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-1fd652e3-39bc-44c2-af30-a82d7b3f1344","csi.storage.k8s.io/pvc/name":"inline-volume-tester-8tjkq-my-volume-0","csi.storage.k8s.io/pvc/namespace":"ephemeral-6781","requestedsizegib":"5","storage.kubernetes.io/csiProvisionerIdentity":"1633447947345-8081-test.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-1fd652e3-39bc-44c2-af30-a82d7b3f1344"}
I1005 15:44:34.471092       1 controllerserver.go:465] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-800769ba-4425-4e2b-9c40-2efb332eef86" attached to node "k8s-agentpool1-35271516-vmss000000".
... skipping 13 lines ...
I1005 15:44:34.499843       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
I1005 15:44:36.437824       1 azure_managedDiskController.go:286] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-99b77118-962b-4762-aa54-e5f426750803
I1005 15:44:36.437853       1 controllerserver.go:391] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-99b77118-962b-4762-aa54-e5f426750803) returned with <nil>
I1005 15:44:36.437891       1 utils.go:102] GRPC response: {}
I1005 15:44:42.437804       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:44:42.437833       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-b4be9377-344f-41c0-91a7-d04b4c5599d0","parameters":{"csi.storage.k8s.io/pv/name":"pvc-b4be9377-344f-41c0-91a7-d04b4c5599d0","csi.storage.k8s.io/pvc/name":"test.csi.azure.comgfpcj","csi.storage.k8s.io/pvc/namespace":"provisioning-2013"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:44:42.456140       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-b4be9377-344f-41c0-91a7-d04b4c5599d0, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-b4be9377-344f-41c0-91a7-d04b4c5599d0' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:44:42.456228       1 controllerserver.go:271] begin to create azure disk(pvc-b4be9377-344f-41c0-91a7-d04b4c5599d0) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:44:42.456242       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-b4be9377-344f-41c0-91a7-d04b4c5599d0 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:44:44.773162       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-b4be9377-344f-41c0-91a7-d04b4c5599d0 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:44:44.773219       1 controllerserver.go:348] create azure disk(pvc-b4be9377-344f-41c0-91a7-d04b4c5599d0) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-b4be9377-344f-41c0-91a7-d04b4c5599d0 kubernetes.io-created-for-pvc-name:test.csi.azure.comgfpcj kubernetes.io-created-for-pvc-namespace:provisioning-2013]) successfully
I1005 15:44:44.773242       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-b4be9377-344f-41c0-91a7-d04b4c5599d0","csi.storage.k8s.io/pvc/name":"test.csi.azure.comgfpcj","csi.storage.k8s.io/pvc/namespace":"provisioning-2013","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-b4be9377-344f-41c0-91a7-d04b4c5599d0"}}
I1005 15:44:44.986165       1 utils.go:95] GRPC call: /csi.v1.Controller/DeleteVolume
... skipping 5 lines ...
I1005 15:44:47.183372       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:44:47.183393       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-b4be9377-344f-41c0-91a7-d04b4c5599d0" to node "k8s-agentpool1-35271516-vmss000000"
I1005 15:44:47.183406       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:44:47.183427       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-b4be9377-344f-41c0-91a7-d04b4c5599d0" lun 1 to node "k8s-agentpool1-35271516-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-b4be9377-344f-41c0-91a7-d04b4c5599d0:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-b4be9377-344f-41c0-91a7-d04b4c5599d0  true false 1})]
I1005 15:44:47.183449       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:44:47.183490       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-b4be9377-344f-41c0-91a7-d04b4c5599d0:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-b4be9377-344f-41c0-91a7-d04b4c5599d0  true false 1})])
I1005 15:44:47.325689       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-b4be9377-344f-41c0-91a7-d04b4c5599d0:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-b4be9377-344f-41c0-91a7-d04b4c5599d0  true false 1})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1005 15:44:50.256862       1 azure_managedDiskController.go:286] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3
I1005 15:44:50.256928       1 controllerserver.go:391] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-2b0d808b-95e7-4f00-ad4c-061cd03f8de3) returned with <nil>
I1005 15:44:50.256962       1 utils.go:102] GRPC response: {}
I1005 15:45:03.097302       1 controllerserver.go:465] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-b4be9377-344f-41c0-91a7-d04b4c5599d0" attached to node "k8s-agentpool1-35271516-vmss000000".
I1005 15:45:03.097335       1 controllerserver.go:485] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-b4be9377-344f-41c0-91a7-d04b4c5599d0" to node "k8s-agentpool1-35271516-vmss000000" successfully
I1005 15:45:03.097378       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"1"}}
... skipping 24 lines ...
I1005 15:45:34.125494       1 azure_controller_vmss.go:213] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - detach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-b4be9377-344f-41c0-91a7-d04b4c5599d0:pvc-b4be9377-344f-41c0-91a7-d04b4c5599d0])
I1005 15:45:36.597834       1 azure_managedDiskController.go:286] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-800769ba-4425-4e2b-9c40-2efb332eef86
I1005 15:45:36.597866       1 controllerserver.go:391] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-800769ba-4425-4e2b-9c40-2efb332eef86) returned with <nil>
I1005 15:45:36.597916       1 utils.go:102] GRPC response: {}
I1005 15:45:42.694833       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:45:42.694859       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-d420d34b-aebb-4da8-b0fe-f88f30946243","parameters":{"csi.storage.k8s.io/pv/name":"pvc-d420d34b-aebb-4da8-b0fe-f88f30946243","csi.storage.k8s.io/pvc/name":"test.csi.azure.comk86zq","csi.storage.k8s.io/pvc/namespace":"volume-expand-5212"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:45:42.713458       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-d420d34b-aebb-4da8-b0fe-f88f30946243, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-d420d34b-aebb-4da8-b0fe-f88f30946243' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:45:42.713524       1 controllerserver.go:271] begin to create azure disk(pvc-d420d34b-aebb-4da8-b0fe-f88f30946243) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:45:42.713584       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-d420d34b-aebb-4da8-b0fe-f88f30946243 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:45:44.113055       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerUnpublishVolume
I1005 15:45:44.113082       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-35271516-vmss000001","volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-860db465-ee81-4288-b412-935fbe980a2f"}
I1005 15:45:44.113177       1 controllerserver.go:524] Trying to detach volume /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-860db465-ee81-4288-b412-935fbe980a2f from node k8s-agentpool1-35271516-vmss000001
I1005 15:45:44.113188       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
... skipping 33 lines ...
I1005 15:46:04.415604       1 controllerserver.go:524] Trying to detach volume /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-b4be9377-344f-41c0-91a7-d04b4c5599d0 from node k8s-agentpool1-35271516-vmss000000
I1005 15:46:04.415622       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:46:04.451091       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-d420d34b-aebb-4da8-b0fe-f88f30946243" lun 0 to node "k8s-agentpool1-35271516-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-d420d34b-aebb-4da8-b0fe-f88f30946243:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-d420d34b-aebb-4da8-b0fe-f88f30946243  true false 0})]
I1005 15:46:04.451117       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:46:04.451150       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-d420d34b-aebb-4da8-b0fe-f88f30946243:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-d420d34b-aebb-4da8-b0fe-f88f30946243  true false 0})])
I1005 15:46:04.451323       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:46:05.277089       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-d420d34b-aebb-4da8-b0fe-f88f30946243:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-d420d34b-aebb-4da8-b0fe-f88f30946243  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1005 15:46:05.277390       1 azure_controller_common.go:346] Trying to detach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-b4be9377-344f-41c0-91a7-d04b4c5599d0" from node "k8s-agentpool1-35271516-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-b4be9377-344f-41c0-91a7-d04b4c5599d0:pvc-b4be9377-344f-41c0-91a7-d04b4c5599d0]
I1005 15:46:05.277483       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-35271516-vmss000000, refreshing the cache
E1005 15:46:05.321010       1 azure_controller_vmss.go:183] detach azure disk on node(k8s-agentpool1-35271516-vmss000000): disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-b4be9377-344f-41c0-91a7-d04b4c5599d0:pvc-b4be9377-344f-41c0-91a7-d04b4c5599d0]) not found
I1005 15:46:05.321053       1 azure_controller_vmss.go:213] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - detach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-b4be9377-344f-41c0-91a7-d04b4c5599d0:pvc-b4be9377-344f-41c0-91a7-d04b4c5599d0])
I1005 15:46:14.741900       1 utils.go:95] GRPC call: /csi.v1.Controller/DeleteVolume
I1005 15:46:14.741934       1 utils.go:96] GRPC request: {"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-860db465-ee81-4288-b412-935fbe980a2f"}
... skipping 36 lines ...
I1005 15:46:55.907467       1 utils.go:96] GRPC request: {}
I1005 15:46:55.907514       1 utils.go:102] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":9}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":10}}},{"Type":{"Rpc":{"type":13}}}]}
I1005 15:46:55.908036       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerExpandVolume
I1005 15:46:55.908054       1 utils.go:96] GRPC request: {"capacity_range":{"required_bytes":6442450944},"volume_capability":{"AccessType":{"Mount":{}},"access_mode":{"mode":7}},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-d420d34b-aebb-4da8-b0fe-f88f30946243"}
I1005 15:46:55.930993       1 controllerserver.go:807] begin to expand azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-d420d34b-aebb-4da8-b0fe-f88f30946243) with new size(6442450944)
I1005 15:46:55.953688       1 azure_managedDiskController.go:336] azureDisk - begin to resize disk(pvc-d420d34b-aebb-4da8-b0fe-f88f30946243) with new size(6), old size({{5 0} {<nil>}  BinarySI})
E1005 15:46:55.953745       1 utils.go:100] GRPC error: rpc error: code = Internal desc = failed to resize disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-d420d34b-aebb-4da8-b0fe-f88f30946243) with error(azureDisk - disk resize is only supported on Unattached disk, current disk state: Attached, already attached to /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-35271516-vmss/virtualMachines/k8s-agentpool1-35271516-vmss_0)
I1005 15:46:56.963629       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerGetCapabilities
I1005 15:46:56.963670       1 utils.go:96] GRPC request: {}
I1005 15:46:56.963720       1 utils.go:102] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":9}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":10}}},{"Type":{"Rpc":{"type":13}}}]}
I1005 15:46:56.964299       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerExpandVolume
I1005 15:46:56.964320       1 utils.go:96] GRPC request: {"capacity_range":{"required_bytes":6442450944},"volume_capability":{"AccessType":{"Mount":{}},"access_mode":{"mode":7}},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-d420d34b-aebb-4da8-b0fe-f88f30946243"}
I1005 15:46:56.990597       1 controllerserver.go:807] begin to expand azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-d420d34b-aebb-4da8-b0fe-f88f30946243) with new size(6442450944)
I1005 15:46:57.018128       1 azure_managedDiskController.go:336] azureDisk - begin to resize disk(pvc-d420d34b-aebb-4da8-b0fe-f88f30946243) with new size(6), old size({{5 0} {<nil>}  BinarySI})
E1005 15:46:57.018170       1 utils.go:100] GRPC error: rpc error: code = Internal desc = failed to resize disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-d420d34b-aebb-4da8-b0fe-f88f30946243) with error(azureDisk - disk resize is only supported on Unattached disk, current disk state: Attached, already attached to /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-35271516-vmss/virtualMachines/k8s-agentpool1-35271516-vmss_0)
I1005 15:46:57.024749       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerGetCapabilities
I1005 15:46:57.024770       1 utils.go:96] GRPC request: {}
I1005 15:46:57.024797       1 utils.go:102] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":9}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":10}}},{"Type":{"Rpc":{"type":13}}}]}
I1005 15:46:57.025346       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerExpandVolume
I1005 15:46:57.025364       1 utils.go:96] GRPC request: {"capacity_range":{"required_bytes":6442450944},"volume_capability":{"AccessType":{"Mount":{}},"access_mode":{"mode":7}},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-d420d34b-aebb-4da8-b0fe-f88f30946243"}
I1005 15:46:57.047323       1 controllerserver.go:807] begin to expand azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-d420d34b-aebb-4da8-b0fe-f88f30946243) with new size(6442450944)
I1005 15:46:57.071245       1 azure_managedDiskController.go:336] azureDisk - begin to resize disk(pvc-d420d34b-aebb-4da8-b0fe-f88f30946243) with new size(6), old size({{5 0} {<nil>}  BinarySI})
E1005 15:46:57.071299       1 utils.go:100] GRPC error: rpc error: code = Internal desc = failed to resize disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-d420d34b-aebb-4da8-b0fe-f88f30946243) with error(azureDisk - disk resize is only supported on Unattached disk, current disk state: Attached, already attached to /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-35271516-vmss/virtualMachines/k8s-agentpool1-35271516-vmss_0)
I1005 15:46:59.028630       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerGetCapabilities
I1005 15:46:59.028658       1 utils.go:96] GRPC request: {}
I1005 15:46:59.028704       1 utils.go:102] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":9}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":10}}},{"Type":{"Rpc":{"type":13}}}]}
I1005 15:46:59.029229       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerExpandVolume
I1005 15:46:59.029246       1 utils.go:96] GRPC request: {"capacity_range":{"required_bytes":6442450944},"volume_capability":{"AccessType":{"Mount":{}},"access_mode":{"mode":7}},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-d420d34b-aebb-4da8-b0fe-f88f30946243"}
I1005 15:46:59.061548       1 controllerserver.go:807] begin to expand azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-d420d34b-aebb-4da8-b0fe-f88f30946243) with new size(6442450944)
I1005 15:46:59.085062       1 azure_managedDiskController.go:336] azureDisk - begin to resize disk(pvc-d420d34b-aebb-4da8-b0fe-f88f30946243) with new size(6), old size({{5 0} {<nil>}  BinarySI})
E1005 15:46:59.085105       1 utils.go:100] GRPC error: rpc error: code = Internal desc = failed to resize disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-d420d34b-aebb-4da8-b0fe-f88f30946243) with error(azureDisk - disk resize is only supported on Unattached disk, current disk state: Attached, already attached to /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-35271516-vmss/virtualMachines/k8s-agentpool1-35271516-vmss_0)
I1005 15:46:59.099252       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerGetCapabilities
I1005 15:46:59.099275       1 utils.go:96] GRPC request: {}
I1005 15:46:59.099311       1 utils.go:102] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":9}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":10}}},{"Type":{"Rpc":{"type":13}}}]}
I1005 15:46:59.099794       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerExpandVolume
I1005 15:46:59.099814       1 utils.go:96] GRPC request: {"capacity_range":{"required_bytes":6442450944},"volume_capability":{"AccessType":{"Mount":{}},"access_mode":{"mode":7}},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-d420d34b-aebb-4da8-b0fe-f88f30946243"}
I1005 15:46:59.122992       1 controllerserver.go:807] begin to expand azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-d420d34b-aebb-4da8-b0fe-f88f30946243) with new size(6442450944)
I1005 15:46:59.145341       1 azure_managedDiskController.go:336] azureDisk - begin to resize disk(pvc-d420d34b-aebb-4da8-b0fe-f88f30946243) with new size(6), old size({{5 0} {<nil>}  BinarySI})
E1005 15:46:59.145390       1 utils.go:100] GRPC error: rpc error: code = Internal desc = failed to resize disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-d420d34b-aebb-4da8-b0fe-f88f30946243) with error(azureDisk - disk resize is only supported on Unattached disk, current disk state: Attached, already attached to /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-35271516-vmss/virtualMachines/k8s-agentpool1-35271516-vmss_0)
I1005 15:46:59.508385       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:46:59.508412       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-14f69834-4281-4972-b6d8-cfa47ff1a8c5","parameters":{"csi.storage.k8s.io/pv/name":"pvc-14f69834-4281-4972-b6d8-cfa47ff1a8c5","csi.storage.k8s.io/pvc/name":"inline-volume-tester-hvrm4-my-volume-0","csi.storage.k8s.io/pvc/namespace":"ephemeral-5575"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:46:59.527114       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-14f69834-4281-4972-b6d8-cfa47ff1a8c5, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-14f69834-4281-4972-b6d8-cfa47ff1a8c5' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:46:59.527204       1 controllerserver.go:271] begin to create azure disk(pvc-14f69834-4281-4972-b6d8-cfa47ff1a8c5) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:46:59.527245       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-14f69834-4281-4972-b6d8-cfa47ff1a8c5 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:47:01.939396       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-14f69834-4281-4972-b6d8-cfa47ff1a8c5 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:47:01.939454       1 controllerserver.go:348] create azure disk(pvc-14f69834-4281-4972-b6d8-cfa47ff1a8c5) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-14f69834-4281-4972-b6d8-cfa47ff1a8c5 kubernetes.io-created-for-pvc-name:inline-volume-tester-hvrm4-my-volume-0 kubernetes.io-created-for-pvc-namespace:ephemeral-5575]) successfully
I1005 15:47:01.939490       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-14f69834-4281-4972-b6d8-cfa47ff1a8c5","csi.storage.k8s.io/pvc/name":"inline-volume-tester-hvrm4-my-volume-0","csi.storage.k8s.io/pvc/namespace":"ephemeral-5575","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-14f69834-4281-4972-b6d8-cfa47ff1a8c5"}}
I1005 15:47:02.554364       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 2 lines ...
I1005 15:47:02.580334       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:47:02.580373       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-14f69834-4281-4972-b6d8-cfa47ff1a8c5" to node "k8s-agentpool1-35271516-vmss000000"
I1005 15:47:02.580387       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:47:02.580415       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-14f69834-4281-4972-b6d8-cfa47ff1a8c5" lun 1 to node "k8s-agentpool1-35271516-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-14f69834-4281-4972-b6d8-cfa47ff1a8c5:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-14f69834-4281-4972-b6d8-cfa47ff1a8c5  true false 1})]
I1005 15:47:02.580453       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:47:02.580486       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-14f69834-4281-4972-b6d8-cfa47ff1a8c5:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-14f69834-4281-4972-b6d8-cfa47ff1a8c5  true false 1})])
I1005 15:47:02.772601       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-14f69834-4281-4972-b6d8-cfa47ff1a8c5:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-14f69834-4281-4972-b6d8-cfa47ff1a8c5  true false 1})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1005 15:47:07.095678       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerGetCapabilities
I1005 15:47:07.095706       1 utils.go:96] GRPC request: {}
I1005 15:47:07.095771       1 utils.go:102] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":9}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":10}}},{"Type":{"Rpc":{"type":13}}}]}
I1005 15:47:07.096288       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerExpandVolume
I1005 15:47:07.096306       1 utils.go:96] GRPC request: {"capacity_range":{"required_bytes":6442450944},"volume_capability":{"AccessType":{"Mount":{}},"access_mode":{"mode":7}},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-d420d34b-aebb-4da8-b0fe-f88f30946243"}
I1005 15:47:07.120312       1 controllerserver.go:807] begin to expand azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-d420d34b-aebb-4da8-b0fe-f88f30946243) with new size(6442450944)
I1005 15:47:07.142091       1 azure_managedDiskController.go:336] azureDisk - begin to resize disk(pvc-d420d34b-aebb-4da8-b0fe-f88f30946243) with new size(6), old size({{5 0} {<nil>}  BinarySI})
E1005 15:47:07.142174       1 utils.go:100] GRPC error: rpc error: code = Internal desc = failed to resize disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-d420d34b-aebb-4da8-b0fe-f88f30946243) with error(azureDisk - disk resize is only supported on Unattached disk, current disk state: Attached, already attached to /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-35271516-vmss/virtualMachines/k8s-agentpool1-35271516-vmss_0)
I1005 15:47:17.881208       1 controllerserver.go:465] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-14f69834-4281-4972-b6d8-cfa47ff1a8c5" attached to node "k8s-agentpool1-35271516-vmss000000".
I1005 15:47:17.881246       1 controllerserver.go:485] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-14f69834-4281-4972-b6d8-cfa47ff1a8c5" to node "k8s-agentpool1-35271516-vmss000000" successfully
I1005 15:47:17.881281       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"1"}}
I1005 15:47:30.448020       1 azure_vmss.go:319] Couldn't find VMSS VM with scaleSetName "k8s-agentpool1-35271516-vmss" and instanceID "0", refreshing the cache
I1005 15:47:39.152772       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerGetCapabilities
I1005 15:47:39.152799       1 utils.go:96] GRPC request: {}
I1005 15:47:39.152842       1 utils.go:102] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":9}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":10}}},{"Type":{"Rpc":{"type":13}}}]}
I1005 15:47:39.153400       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerExpandVolume
I1005 15:47:39.153423       1 utils.go:96] GRPC request: {"capacity_range":{"required_bytes":6442450944},"volume_capability":{"AccessType":{"Mount":{}},"access_mode":{"mode":7}},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-d420d34b-aebb-4da8-b0fe-f88f30946243"}
I1005 15:47:39.186070       1 controllerserver.go:807] begin to expand azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-d420d34b-aebb-4da8-b0fe-f88f30946243) with new size(6442450944)
I1005 15:47:39.210327       1 azure_managedDiskController.go:336] azureDisk - begin to resize disk(pvc-d420d34b-aebb-4da8-b0fe-f88f30946243) with new size(6), old size({{5 0} {<nil>}  BinarySI})
E1005 15:47:39.210400       1 utils.go:100] GRPC error: rpc error: code = Internal desc = failed to resize disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-d420d34b-aebb-4da8-b0fe-f88f30946243) with error(azureDisk - disk resize is only supported on Unattached disk, current disk state: Attached, already attached to /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-35271516-vmss/virtualMachines/k8s-agentpool1-35271516-vmss_0)
I1005 15:47:39.217104       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerGetCapabilities
I1005 15:47:39.217126       1 utils.go:96] GRPC request: {}
I1005 15:47:39.217156       1 utils.go:102] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":9}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":10}}},{"Type":{"Rpc":{"type":13}}}]}
I1005 15:47:39.218712       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerExpandVolume
I1005 15:47:39.218772       1 utils.go:96] GRPC request: {"capacity_range":{"required_bytes":6442450944},"volume_capability":{"AccessType":{"Mount":{}},"access_mode":{"mode":7}},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-d420d34b-aebb-4da8-b0fe-f88f30946243"}
I1005 15:47:39.245719       1 controllerserver.go:807] begin to expand azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-d420d34b-aebb-4da8-b0fe-f88f30946243) with new size(6442450944)
I1005 15:47:39.275326       1 azure_managedDiskController.go:336] azureDisk - begin to resize disk(pvc-d420d34b-aebb-4da8-b0fe-f88f30946243) with new size(6), old size({{5 0} {<nil>}  BinarySI})
E1005 15:47:39.275393       1 utils.go:100] GRPC error: rpc error: code = Internal desc = failed to resize disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-d420d34b-aebb-4da8-b0fe-f88f30946243) with error(azureDisk - disk resize is only supported on Unattached disk, current disk state: Attached, already attached to /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-35271516-vmss/virtualMachines/k8s-agentpool1-35271516-vmss_0)
I1005 15:48:15.146434       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerUnpublishVolume
I1005 15:48:15.146462       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-35271516-vmss000000","volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-14f69834-4281-4972-b6d8-cfa47ff1a8c5"}
I1005 15:48:15.146568       1 controllerserver.go:524] Trying to detach volume /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-14f69834-4281-4972-b6d8-cfa47ff1a8c5 from node k8s-agentpool1-35271516-vmss000000
I1005 15:48:15.146587       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:48:15.146633       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:48:15.146654       1 azure_controller_common.go:346] Trying to detach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-14f69834-4281-4972-b6d8-cfa47ff1a8c5" from node "k8s-agentpool1-35271516-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-14f69834-4281-4972-b6d8-cfa47ff1a8c5:pvc-14f69834-4281-4972-b6d8-cfa47ff1a8c5]
... skipping 12 lines ...
I1005 15:48:25.730233       1 azure_controller_common.go:346] Trying to detach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-14f69834-4281-4972-b6d8-cfa47ff1a8c5" from node "k8s-agentpool1-35271516-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-14f69834-4281-4972-b6d8-cfa47ff1a8c5:pvc-14f69834-4281-4972-b6d8-cfa47ff1a8c5]
E1005 15:48:25.730276       1 azure_controller_vmss.go:183] detach azure disk on node(k8s-agentpool1-35271516-vmss000000): disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-14f69834-4281-4972-b6d8-cfa47ff1a8c5:pvc-14f69834-4281-4972-b6d8-cfa47ff1a8c5]) not found
I1005 15:48:25.730284       1 azure_controller_vmss.go:213] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - detach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-14f69834-4281-4972-b6d8-cfa47ff1a8c5:pvc-14f69834-4281-4972-b6d8-cfa47ff1a8c5])
I1005 15:48:25.934598       1 utils.go:95] GRPC call: /csi.v1.Controller/DeleteVolume
I1005 15:48:25.934621       1 utils.go:96] GRPC request: {"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-14f69834-4281-4972-b6d8-cfa47ff1a8c5"}
I1005 15:48:25.934739       1 controllerserver.go:389] deleting azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-14f69834-4281-4972-b6d8-cfa47ff1a8c5)
I1005 15:48:25.934750       1 controllerserver.go:391] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-14f69834-4281-4972-b6d8-cfa47ff1a8c5) returned with failed to delete disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-14f69834-4281-4972-b6d8-cfa47ff1a8c5) since it's in attaching or detaching state
E1005 15:48:25.934765       1 utils.go:100] GRPC error: failed to delete disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-14f69834-4281-4972-b6d8-cfa47ff1a8c5) since it's in attaching or detaching state
I1005 15:48:30.993934       1 azure_controller_vmss.go:225] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - detach disk(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-14f69834-4281-4972-b6d8-cfa47ff1a8c5:pvc-14f69834-4281-4972-b6d8-cfa47ff1a8c5]) returned with <nil>
I1005 15:48:30.994078       1 azure_controller_common.go:369] azureDisk - detach disk(pvc-14f69834-4281-4972-b6d8-cfa47ff1a8c5, /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-14f69834-4281-4972-b6d8-cfa47ff1a8c5) succeeded
I1005 15:48:30.994100       1 controllerserver.go:533] detach volume /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-14f69834-4281-4972-b6d8-cfa47ff1a8c5 from node k8s-agentpool1-35271516-vmss000000 successfully
I1005 15:48:30.994111       1 utils.go:102] GRPC response: {}
I1005 15:48:41.936598       1 utils.go:95] GRPC call: /csi.v1.Controller/DeleteVolume
I1005 15:48:41.936625       1 utils.go:96] GRPC request: {"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-14f69834-4281-4972-b6d8-cfa47ff1a8c5"}
... skipping 2 lines ...
I1005 15:48:43.229746       1 utils.go:96] GRPC request: {}
I1005 15:48:43.229793       1 utils.go:102] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":9}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":10}}},{"Type":{"Rpc":{"type":13}}}]}
I1005 15:48:43.230371       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerExpandVolume
I1005 15:48:43.230392       1 utils.go:96] GRPC request: {"capacity_range":{"required_bytes":6442450944},"volume_capability":{"AccessType":{"Mount":{}},"access_mode":{"mode":7}},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-d420d34b-aebb-4da8-b0fe-f88f30946243"}
I1005 15:48:43.257133       1 controllerserver.go:807] begin to expand azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-d420d34b-aebb-4da8-b0fe-f88f30946243) with new size(6442450944)
I1005 15:48:43.279223       1 azure_managedDiskController.go:336] azureDisk - begin to resize disk(pvc-d420d34b-aebb-4da8-b0fe-f88f30946243) with new size(6), old size({{5 0} {<nil>}  BinarySI})
E1005 15:48:43.279287       1 utils.go:100] GRPC error: rpc error: code = Internal desc = failed to resize disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-d420d34b-aebb-4da8-b0fe-f88f30946243) with error(azureDisk - disk resize is only supported on Unattached disk, current disk state: Attached, already attached to /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-35271516-vmss/virtualMachines/k8s-agentpool1-35271516-vmss_0)
I1005 15:48:47.148547       1 azure_managedDiskController.go:286] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-14f69834-4281-4972-b6d8-cfa47ff1a8c5
I1005 15:48:47.148597       1 controllerserver.go:391] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-14f69834-4281-4972-b6d8-cfa47ff1a8c5) returned with <nil>
I1005 15:48:47.148612       1 utils.go:102] GRPC response: {}
I1005 15:48:49.100879       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:48:49.100906       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-35eaaf16-29dd-4c7d-80ce-3e456b8c1b6f","parameters":{"csi.storage.k8s.io/pv/name":"pvc-35eaaf16-29dd-4c7d-80ce-3e456b8c1b6f","csi.storage.k8s.io/pvc/name":"test.csi.azure.com69d65","csi.storage.k8s.io/pvc/namespace":"provisioning-9545"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:48:49.121018       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-35eaaf16-29dd-4c7d-80ce-3e456b8c1b6f, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-35eaaf16-29dd-4c7d-80ce-3e456b8c1b6f' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:48:49.121112       1 controllerserver.go:271] begin to create azure disk(pvc-35eaaf16-29dd-4c7d-80ce-3e456b8c1b6f) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:48:49.121143       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-35eaaf16-29dd-4c7d-80ce-3e456b8c1b6f StorageAccountType:StandardSSD_LRS Size:5
I1005 15:48:51.509566       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-35eaaf16-29dd-4c7d-80ce-3e456b8c1b6f StorageAccountType:StandardSSD_LRS Size:5
I1005 15:48:51.509618       1 controllerserver.go:348] create azure disk(pvc-35eaaf16-29dd-4c7d-80ce-3e456b8c1b6f) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-35eaaf16-29dd-4c7d-80ce-3e456b8c1b6f kubernetes.io-created-for-pvc-name:test.csi.azure.com69d65 kubernetes.io-created-for-pvc-namespace:provisioning-9545]) successfully
I1005 15:48:51.509642       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-35eaaf16-29dd-4c7d-80ce-3e456b8c1b6f","csi.storage.k8s.io/pvc/name":"test.csi.azure.com69d65","csi.storage.k8s.io/pvc/namespace":"provisioning-9545","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-35eaaf16-29dd-4c7d-80ce-3e456b8c1b6f"}}
I1005 15:48:53.804904       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 2 lines ...
I1005 15:48:53.842937       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:48:53.842968       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-35eaaf16-29dd-4c7d-80ce-3e456b8c1b6f" to node "k8s-agentpool1-35271516-vmss000001"
I1005 15:48:53.842992       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:48:53.843006       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-35eaaf16-29dd-4c7d-80ce-3e456b8c1b6f" lun 0 to node "k8s-agentpool1-35271516-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-35eaaf16-29dd-4c7d-80ce-3e456b8c1b6f:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-35eaaf16-29dd-4c7d-80ce-3e456b8c1b6f  true false 0})]
I1005 15:48:53.843056       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:48:53.843073       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-35eaaf16-29dd-4c7d-80ce-3e456b8c1b6f:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-35eaaf16-29dd-4c7d-80ce-3e456b8c1b6f  true false 0})])
I1005 15:48:54.008036       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-35eaaf16-29dd-4c7d-80ce-3e456b8c1b6f:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-35eaaf16-29dd-4c7d-80ce-3e456b8c1b6f  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1005 15:49:09.146039       1 controllerserver.go:465] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-35eaaf16-29dd-4c7d-80ce-3e456b8c1b6f" attached to node "k8s-agentpool1-35271516-vmss000001".
I1005 15:49:09.146073       1 controllerserver.go:485] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-35eaaf16-29dd-4c7d-80ce-3e456b8c1b6f" to node "k8s-agentpool1-35271516-vmss000001" successfully
I1005 15:49:09.146108       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
I1005 15:49:09.159012       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
I1005 15:49:09.159074       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-35271516-vmss000001","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":7}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-35eaaf16-29dd-4c7d-80ce-3e456b8c1b6f","csi.storage.k8s.io/pvc/name":"test.csi.azure.com69d65","csi.storage.k8s.io/pvc/namespace":"provisioning-9545","requestedsizegib":"5","storage.kubernetes.io/csiProvisionerIdentity":"1633447947345-8081-test.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-35eaaf16-29dd-4c7d-80ce-3e456b8c1b6f"}
I1005 15:49:09.193340       1 controllerserver.go:440] GetDiskLun returned: <nil>. Initiating attaching volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-35eaaf16-29dd-4c7d-80ce-3e456b8c1b6f" to node "k8s-agentpool1-35271516-vmss000001".
... skipping 6 lines ...
I1005 15:49:34.359895       1 utils.go:96] GRPC request: {}
I1005 15:49:34.359955       1 utils.go:102] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":9}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":10}}},{"Type":{"Rpc":{"type":13}}}]}
I1005 15:49:34.360518       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerExpandVolume
I1005 15:49:34.360535       1 utils.go:96] GRPC request: {"capacity_range":{"required_bytes":6442450944},"volume_capability":{"AccessType":{"Block":{}},"access_mode":{"mode":7}},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc"}
I1005 15:49:34.404808       1 controllerserver.go:807] begin to expand azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc) with new size(6442450944)
I1005 15:49:34.427491       1 azure_managedDiskController.go:336] azureDisk - begin to resize disk(pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc) with new size(6), old size({{5 0} {<nil>}  BinarySI})
E1005 15:49:34.427548       1 utils.go:100] GRPC error: rpc error: code = Internal desc = failed to resize disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc) with error(azureDisk - disk resize is only supported on Unattached disk, current disk state: Attached, already attached to /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-35271516-vmss/virtualMachines/k8s-agentpool1-35271516-vmss_1)
I1005 15:49:34.436890       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerGetCapabilities
I1005 15:49:34.436920       1 utils.go:96] GRPC request: {}
I1005 15:49:34.436950       1 utils.go:102] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":9}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":10}}},{"Type":{"Rpc":{"type":13}}}]}
I1005 15:49:34.437503       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerExpandVolume
I1005 15:49:34.437525       1 utils.go:96] GRPC request: {"capacity_range":{"required_bytes":6442450944},"volume_capability":{"AccessType":{"Block":{}},"access_mode":{"mode":7}},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc"}
I1005 15:49:34.460552       1 controllerserver.go:807] begin to expand azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc) with new size(6442450944)
I1005 15:49:34.483334       1 azure_managedDiskController.go:336] azureDisk - begin to resize disk(pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc) with new size(6), old size({{5 0} {<nil>}  BinarySI})
E1005 15:49:34.483366       1 utils.go:100] GRPC error: rpc error: code = Internal desc = failed to resize disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc) with error(azureDisk - disk resize is only supported on Unattached disk, current disk state: Attached, already attached to /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-35271516-vmss/virtualMachines/k8s-agentpool1-35271516-vmss_1)
I1005 15:49:35.679564       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerUnpublishVolume
I1005 15:49:35.679614       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-35271516-vmss000001","volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-35eaaf16-29dd-4c7d-80ce-3e456b8c1b6f"}
I1005 15:49:35.679724       1 controllerserver.go:524] Trying to detach volume /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-35eaaf16-29dd-4c7d-80ce-3e456b8c1b6f from node k8s-agentpool1-35271516-vmss000001
I1005 15:49:35.679735       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:49:35.679773       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:49:35.679787       1 azure_controller_common.go:346] Trying to detach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-35eaaf16-29dd-4c7d-80ce-3e456b8c1b6f" from node "k8s-agentpool1-35271516-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-35eaaf16-29dd-4c7d-80ce-3e456b8c1b6f:pvc-35eaaf16-29dd-4c7d-80ce-3e456b8c1b6f]
... skipping 42 lines ...
I1005 15:52:26.952317       1 utils.go:96] GRPC request: {}
I1005 15:52:26.952361       1 utils.go:102] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":9}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":10}}},{"Type":{"Rpc":{"type":13}}}]}
I1005 15:52:26.952922       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerExpandVolume
I1005 15:52:26.952945       1 utils.go:96] GRPC request: {"capacity_range":{"required_bytes":6442450944},"volume_capability":{"AccessType":{"Mount":{}},"access_mode":{"mode":7}},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-d420d34b-aebb-4da8-b0fe-f88f30946243"}
I1005 15:52:26.977897       1 controllerserver.go:807] begin to expand azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-d420d34b-aebb-4da8-b0fe-f88f30946243) with new size(6442450944)
I1005 15:52:27.001372       1 azure_managedDiskController.go:336] azureDisk - begin to resize disk(pvc-d420d34b-aebb-4da8-b0fe-f88f30946243) with new size(6), old size({{5 0} {<nil>}  BinarySI})
E1005 15:52:27.001431       1 utils.go:100] GRPC error: rpc error: code = Internal desc = failed to resize disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-d420d34b-aebb-4da8-b0fe-f88f30946243) with error(azureDisk - disk resize is only supported on Unattached disk, current disk state: Attached, already attached to /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-35271516-vmss/virtualMachines/k8s-agentpool1-35271516-vmss_0)
I1005 15:52:30.038871       1 azure_managedDiskController.go:286] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc
I1005 15:52:30.038945       1 controllerserver.go:391] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-e6ca3652-0b30-4c50-8af9-06a48994e8cc) returned with <nil>
I1005 15:52:30.038960       1 utils.go:102] GRPC response: {}
I1005 15:52:38.856078       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:52:38.856107       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-64496317-bcb1-4a00-8cc7-2919d7acff43","parameters":{"csi.storage.k8s.io/pv/name":"pvc-64496317-bcb1-4a00-8cc7-2919d7acff43","csi.storage.k8s.io/pvc/name":"test.csi.azure.comf2mbf","csi.storage.k8s.io/pvc/namespace":"volume-expand-8989"},"volume_capabilities":[{"AccessType":{"Block":{}},"access_mode":{"mode":7}}]}
I1005 15:52:38.893692       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-64496317-bcb1-4a00-8cc7-2919d7acff43, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-64496317-bcb1-4a00-8cc7-2919d7acff43' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:52:38.893787       1 controllerserver.go:271] begin to create azure disk(pvc-64496317-bcb1-4a00-8cc7-2919d7acff43) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:52:38.893804       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-64496317-bcb1-4a00-8cc7-2919d7acff43 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:52:41.314826       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-64496317-bcb1-4a00-8cc7-2919d7acff43 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:52:41.314883       1 controllerserver.go:348] create azure disk(pvc-64496317-bcb1-4a00-8cc7-2919d7acff43) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-64496317-bcb1-4a00-8cc7-2919d7acff43 kubernetes.io-created-for-pvc-name:test.csi.azure.comf2mbf kubernetes.io-created-for-pvc-namespace:volume-expand-8989]) successfully
I1005 15:52:41.314923       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-64496317-bcb1-4a00-8cc7-2919d7acff43","csi.storage.k8s.io/pvc/name":"test.csi.azure.comf2mbf","csi.storage.k8s.io/pvc/namespace":"volume-expand-8989","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-64496317-bcb1-4a00-8cc7-2919d7acff43"}}
I1005 15:52:43.556133       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 3 lines ...
I1005 15:52:43.602597       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-35271516-vmss000001, refreshing the cache
I1005 15:52:43.652812       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-64496317-bcb1-4a00-8cc7-2919d7acff43" to node "k8s-agentpool1-35271516-vmss000001"
I1005 15:52:43.652855       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:52:43.652899       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-64496317-bcb1-4a00-8cc7-2919d7acff43" lun 0 to node "k8s-agentpool1-35271516-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-64496317-bcb1-4a00-8cc7-2919d7acff43:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-64496317-bcb1-4a00-8cc7-2919d7acff43  true false 0})]
I1005 15:52:43.652922       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:52:43.652957       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-64496317-bcb1-4a00-8cc7-2919d7acff43:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-64496317-bcb1-4a00-8cc7-2919d7acff43  true false 0})])
I1005 15:52:43.831387       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-64496317-bcb1-4a00-8cc7-2919d7acff43:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-64496317-bcb1-4a00-8cc7-2919d7acff43  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1005 15:52:58.957559       1 controllerserver.go:465] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-64496317-bcb1-4a00-8cc7-2919d7acff43" attached to node "k8s-agentpool1-35271516-vmss000001".
I1005 15:52:58.957595       1 controllerserver.go:485] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-64496317-bcb1-4a00-8cc7-2919d7acff43" to node "k8s-agentpool1-35271516-vmss000001" successfully
I1005 15:52:58.957630       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
I1005 15:52:59.287974       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerGetCapabilities
I1005 15:52:59.288001       1 utils.go:96] GRPC request: {}
I1005 15:52:59.288062       1 utils.go:102] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":9}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":10}}},{"Type":{"Rpc":{"type":13}}}]}
I1005 15:52:59.288652       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerExpandVolume
I1005 15:52:59.288688       1 utils.go:96] GRPC request: {"capacity_range":{"required_bytes":6442450944},"volume_capability":{"AccessType":{"Mount":{}},"access_mode":{"mode":7}},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-d420d34b-aebb-4da8-b0fe-f88f30946243"}
I1005 15:52:59.318873       1 controllerserver.go:807] begin to expand azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-d420d34b-aebb-4da8-b0fe-f88f30946243) with new size(6442450944)
I1005 15:52:59.344473       1 azure_managedDiskController.go:336] azureDisk - begin to resize disk(pvc-d420d34b-aebb-4da8-b0fe-f88f30946243) with new size(6), old size({{5 0} {<nil>}  BinarySI})
E1005 15:52:59.344532       1 utils.go:100] GRPC error: rpc error: code = Internal desc = failed to resize disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-d420d34b-aebb-4da8-b0fe-f88f30946243) with error(azureDisk - disk resize is only supported on Unattached disk, current disk state: Attached, already attached to /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-35271516-vmss/virtualMachines/k8s-agentpool1-35271516-vmss_0)
I1005 15:52:59.351197       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerGetCapabilities
I1005 15:52:59.351217       1 utils.go:96] GRPC request: {}
I1005 15:52:59.351245       1 utils.go:102] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":9}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":10}}},{"Type":{"Rpc":{"type":13}}}]}
I1005 15:52:59.351673       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerExpandVolume
I1005 15:52:59.351693       1 utils.go:96] GRPC request: {"capacity_range":{"required_bytes":6442450944},"volume_capability":{"AccessType":{"Mount":{}},"access_mode":{"mode":7}},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-d420d34b-aebb-4da8-b0fe-f88f30946243"}
I1005 15:52:59.376060       1 controllerserver.go:807] begin to expand azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-d420d34b-aebb-4da8-b0fe-f88f30946243) with new size(6442450944)
I1005 15:52:59.397787       1 azure_managedDiskController.go:336] azureDisk - begin to resize disk(pvc-d420d34b-aebb-4da8-b0fe-f88f30946243) with new size(6), old size({{5 0} {<nil>}  BinarySI})
E1005 15:52:59.397823       1 utils.go:100] GRPC error: rpc error: code = Internal desc = failed to resize disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-d420d34b-aebb-4da8-b0fe-f88f30946243) with error(azureDisk - disk resize is only supported on Unattached disk, current disk state: Attached, already attached to /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-35271516-vmss/virtualMachines/k8s-agentpool1-35271516-vmss_0)
I1005 15:53:08.384468       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerGetCapabilities
I1005 15:53:08.384495       1 utils.go:96] GRPC request: {}
I1005 15:53:08.384536       1 utils.go:102] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":9}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":10}}},{"Type":{"Rpc":{"type":13}}}]}
I1005 15:53:08.385129       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerExpandVolume
I1005 15:53:08.385166       1 utils.go:96] GRPC request: {"capacity_range":{"required_bytes":6442450944},"volume_capability":{"AccessType":{"Block":{}},"access_mode":{"mode":7}},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-64496317-bcb1-4a00-8cc7-2919d7acff43"}
I1005 15:53:08.409728       1 controllerserver.go:807] begin to expand azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-64496317-bcb1-4a00-8cc7-2919d7acff43) with new size(6442450944)
I1005 15:53:08.432720       1 azure_managedDiskController.go:336] azureDisk - begin to resize disk(pvc-64496317-bcb1-4a00-8cc7-2919d7acff43) with new size(6), old size({{5 0} {<nil>}  BinarySI})
E1005 15:53:08.432757       1 utils.go:100] GRPC error: rpc error: code = Internal desc = failed to resize disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-64496317-bcb1-4a00-8cc7-2919d7acff43) with error(azureDisk - disk resize is only supported on Unattached disk, current disk state: Attached, already attached to /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-35271516-vmss/virtualMachines/k8s-agentpool1-35271516-vmss_1)
I1005 15:53:08.442882       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerGetCapabilities
I1005 15:53:08.442902       1 utils.go:96] GRPC request: {}
I1005 15:53:08.442929       1 utils.go:102] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":9}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":10}}},{"Type":{"Rpc":{"type":13}}}]}
I1005 15:53:08.443406       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerExpandVolume
I1005 15:53:08.443439       1 utils.go:96] GRPC request: {"capacity_range":{"required_bytes":6442450944},"volume_capability":{"AccessType":{"Block":{}},"access_mode":{"mode":7}},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-64496317-bcb1-4a00-8cc7-2919d7acff43"}
I1005 15:53:08.466392       1 controllerserver.go:807] begin to expand azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-64496317-bcb1-4a00-8cc7-2919d7acff43) with new size(6442450944)
I1005 15:53:08.487753       1 azure_managedDiskController.go:336] azureDisk - begin to resize disk(pvc-64496317-bcb1-4a00-8cc7-2919d7acff43) with new size(6), old size({{5 0} {<nil>}  BinarySI})
E1005 15:53:08.487848       1 utils.go:100] GRPC error: rpc error: code = Internal desc = failed to resize disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-64496317-bcb1-4a00-8cc7-2919d7acff43) with error(azureDisk - disk resize is only supported on Unattached disk, current disk state: Attached, already attached to /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-35271516-vmss/virtualMachines/k8s-agentpool1-35271516-vmss_1)
I1005 15:53:09.444050       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerGetCapabilities
I1005 15:53:09.444099       1 utils.go:96] GRPC request: {}
I1005 15:53:09.444148       1 utils.go:102] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":9}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":10}}},{"Type":{"Rpc":{"type":13}}}]}
I1005 15:53:09.444734       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerExpandVolume
I1005 15:53:09.444753       1 utils.go:96] GRPC request: {"capacity_range":{"required_bytes":6442450944},"volume_capability":{"AccessType":{"Block":{}},"access_mode":{"mode":7}},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-64496317-bcb1-4a00-8cc7-2919d7acff43"}
I1005 15:53:09.482098       1 controllerserver.go:807] begin to expand azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-64496317-bcb1-4a00-8cc7-2919d7acff43) with new size(6442450944)
I1005 15:53:09.504820       1 azure_managedDiskController.go:336] azureDisk - begin to resize disk(pvc-64496317-bcb1-4a00-8cc7-2919d7acff43) with new size(6), old size({{5 0} {<nil>}  BinarySI})
E1005 15:53:09.504880       1 utils.go:100] GRPC error: rpc error: code = Internal desc = failed to resize disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-64496317-bcb1-4a00-8cc7-2919d7acff43) with error(azureDisk - disk resize is only supported on Unattached disk, current disk state: Attached, already attached to /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-35271516-vmss/virtualMachines/k8s-agentpool1-35271516-vmss_1)
I1005 15:53:13.520971       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerGetCapabilities
I1005 15:53:13.520999       1 utils.go:96] GRPC request: {}
I1005 15:53:13.521042       1 utils.go:102] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":9}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":10}}},{"Type":{"Rpc":{"type":13}}}]}
I1005 15:53:13.521624       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerExpandVolume
I1005 15:53:13.521646       1 utils.go:96] GRPC request: {"capacity_range":{"required_bytes":6442450944},"volume_capability":{"AccessType":{"Block":{}},"access_mode":{"mode":7}},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-64496317-bcb1-4a00-8cc7-2919d7acff43"}
I1005 15:53:13.547703       1 controllerserver.go:807] begin to expand azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-64496317-bcb1-4a00-8cc7-2919d7acff43) with new size(6442450944)
I1005 15:53:13.572397       1 azure_managedDiskController.go:336] azureDisk - begin to resize disk(pvc-64496317-bcb1-4a00-8cc7-2919d7acff43) with new size(6), old size({{5 0} {<nil>}  BinarySI})
E1005 15:53:13.572459       1 utils.go:100] GRPC error: rpc error: code = Internal desc = failed to resize disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-64496317-bcb1-4a00-8cc7-2919d7acff43) with error(azureDisk - disk resize is only supported on Unattached disk, current disk state: Attached, already attached to /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-35271516-vmss/virtualMachines/k8s-agentpool1-35271516-vmss_1)
I1005 15:53:13.579942       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerGetCapabilities
I1005 15:53:13.579963       1 utils.go:96] GRPC request: {}
I1005 15:53:13.579999       1 utils.go:102] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":9}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":10}}},{"Type":{"Rpc":{"type":13}}}]}
I1005 15:53:13.580532       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerExpandVolume
I1005 15:53:13.580560       1 utils.go:96] GRPC request: {"capacity_range":{"required_bytes":6442450944},"volume_capability":{"AccessType":{"Block":{}},"access_mode":{"mode":7}},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-64496317-bcb1-4a00-8cc7-2919d7acff43"}
I1005 15:53:13.604401       1 controllerserver.go:807] begin to expand azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-64496317-bcb1-4a00-8cc7-2919d7acff43) with new size(6442450944)
I1005 15:53:13.647047       1 azure_managedDiskController.go:336] azureDisk - begin to resize disk(pvc-64496317-bcb1-4a00-8cc7-2919d7acff43) with new size(6), old size({{5 0} {<nil>}  BinarySI})
E1005 15:53:13.647094       1 utils.go:100] GRPC error: rpc error: code = Internal desc = failed to resize disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-64496317-bcb1-4a00-8cc7-2919d7acff43) with error(azureDisk - disk resize is only supported on Unattached disk, current disk state: Attached, already attached to /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-35271516-vmss/virtualMachines/k8s-agentpool1-35271516-vmss_1)
I1005 15:53:17.097946       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerUnpublishVolume
I1005 15:53:17.097974       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-35271516-vmss000001","volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-64496317-bcb1-4a00-8cc7-2919d7acff43"}
I1005 15:53:17.098085       1 controllerserver.go:524] Trying to detach volume /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-64496317-bcb1-4a00-8cc7-2919d7acff43 from node k8s-agentpool1-35271516-vmss000001
I1005 15:53:17.098114       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:53:17.098135       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-35271516-vmss000001, refreshing the cache
I1005 15:53:17.221176       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
... skipping 4 lines ...
I1005 15:53:21.591671       1 utils.go:96] GRPC request: {}
I1005 15:53:21.591731       1 utils.go:102] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":9}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":10}}},{"Type":{"Rpc":{"type":13}}}]}
I1005 15:53:21.592296       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerExpandVolume
I1005 15:53:21.592316       1 utils.go:96] GRPC request: {"capacity_range":{"required_bytes":6442450944},"volume_capability":{"AccessType":{"Block":{}},"access_mode":{"mode":7}},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-64496317-bcb1-4a00-8cc7-2919d7acff43"}
I1005 15:53:21.623616       1 controllerserver.go:807] begin to expand azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-64496317-bcb1-4a00-8cc7-2919d7acff43) with new size(6442450944)
I1005 15:53:21.646361       1 azure_managedDiskController.go:336] azureDisk - begin to resize disk(pvc-64496317-bcb1-4a00-8cc7-2919d7acff43) with new size(6), old size({{5 0} {<nil>}  BinarySI})
E1005 15:53:21.646423       1 utils.go:100] GRPC error: rpc error: code = Internal desc = failed to resize disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-64496317-bcb1-4a00-8cc7-2919d7acff43) with error(azureDisk - disk resize is only supported on Unattached disk, current disk state: Attached, already attached to /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-35271516-vmss/virtualMachines/k8s-agentpool1-35271516-vmss_1)
I1005 15:53:21.653638       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerGetCapabilities
I1005 15:53:21.653660       1 utils.go:96] GRPC request: {}
I1005 15:53:21.653690       1 utils.go:102] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":9}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":10}}},{"Type":{"Rpc":{"type":13}}}]}
I1005 15:53:21.654237       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerExpandVolume
I1005 15:53:21.654258       1 utils.go:96] GRPC request: {"capacity_range":{"required_bytes":6442450944},"volume_capability":{"AccessType":{"Block":{}},"access_mode":{"mode":7}},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-64496317-bcb1-4a00-8cc7-2919d7acff43"}
I1005 15:53:21.684155       1 controllerserver.go:807] begin to expand azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-64496317-bcb1-4a00-8cc7-2919d7acff43) with new size(6442450944)
I1005 15:53:21.716776       1 azure_managedDiskController.go:336] azureDisk - begin to resize disk(pvc-64496317-bcb1-4a00-8cc7-2919d7acff43) with new size(6), old size({{5 0} {<nil>}  BinarySI})
E1005 15:53:21.716809       1 utils.go:100] GRPC error: rpc error: code = Internal desc = failed to resize disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-64496317-bcb1-4a00-8cc7-2919d7acff43) with error(azureDisk - disk resize is only supported on Unattached disk, current disk state: Attached, already attached to /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-35271516-vmss/virtualMachines/k8s-agentpool1-35271516-vmss_1)
I1005 15:53:37.569476       1 azure_controller_vmss.go:225] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - detach disk(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-64496317-bcb1-4a00-8cc7-2919d7acff43:pvc-64496317-bcb1-4a00-8cc7-2919d7acff43]) returned with <nil>
I1005 15:53:37.569549       1 azure_controller_common.go:369] azureDisk - detach disk(pvc-64496317-bcb1-4a00-8cc7-2919d7acff43, /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-64496317-bcb1-4a00-8cc7-2919d7acff43) succeeded
I1005 15:53:37.569562       1 controllerserver.go:533] detach volume /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-64496317-bcb1-4a00-8cc7-2919d7acff43 from node k8s-agentpool1-35271516-vmss000001 successfully
I1005 15:53:37.569573       1 utils.go:102] GRPC response: {}
I1005 15:53:53.670204       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerGetCapabilities
I1005 15:53:53.670233       1 utils.go:96] GRPC request: {}
... skipping 12 lines ...
I1005 15:53:56.891741       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-35271516-vmss000001, refreshing the cache
I1005 15:53:56.954839       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-64496317-bcb1-4a00-8cc7-2919d7acff43" to node "k8s-agentpool1-35271516-vmss000001"
I1005 15:53:56.954890       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:53:56.954907       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-64496317-bcb1-4a00-8cc7-2919d7acff43" lun 0 to node "k8s-agentpool1-35271516-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-64496317-bcb1-4a00-8cc7-2919d7acff43:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-64496317-bcb1-4a00-8cc7-2919d7acff43  true false 0})]
I1005 15:53:56.954922       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:53:56.954934       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-64496317-bcb1-4a00-8cc7-2919d7acff43:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-64496317-bcb1-4a00-8cc7-2919d7acff43  true false 0})])
I1005 15:53:57.094100       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-64496317-bcb1-4a00-8cc7-2919d7acff43:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-64496317-bcb1-4a00-8cc7-2919d7acff43  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1005 15:54:07.195538       1 controllerserver.go:465] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-64496317-bcb1-4a00-8cc7-2919d7acff43" attached to node "k8s-agentpool1-35271516-vmss000001".
I1005 15:54:07.195576       1 controllerserver.go:485] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-64496317-bcb1-4a00-8cc7-2919d7acff43" to node "k8s-agentpool1-35271516-vmss000001" successfully
I1005 15:54:07.195594       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
I1005 15:54:07.204014       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
I1005 15:54:07.204035       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-35271516-vmss000001","volume_capability":{"AccessType":{"Block":{}},"access_mode":{"mode":7}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-64496317-bcb1-4a00-8cc7-2919d7acff43","csi.storage.k8s.io/pvc/name":"test.csi.azure.comf2mbf","csi.storage.k8s.io/pvc/namespace":"volume-expand-8989","requestedsizegib":"5","storage.kubernetes.io/csiProvisionerIdentity":"1633447947345-8081-test.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-64496317-bcb1-4a00-8cc7-2919d7acff43"}
I1005 15:54:07.229304       1 controllerserver.go:440] GetDiskLun returned: <nil>. Initiating attaching volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-64496317-bcb1-4a00-8cc7-2919d7acff43" to node "k8s-agentpool1-35271516-vmss000001".
... skipping 19 lines ...
I1005 15:54:55.028531       1 controllerserver.go:389] deleting azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-64496317-bcb1-4a00-8cc7-2919d7acff43)
I1005 15:55:00.234775       1 azure_managedDiskController.go:286] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-64496317-bcb1-4a00-8cc7-2919d7acff43
I1005 15:55:00.234801       1 controllerserver.go:391] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-64496317-bcb1-4a00-8cc7-2919d7acff43) returned with <nil>
I1005 15:55:00.234835       1 utils.go:102] GRPC response: {}
I1005 15:55:08.001785       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:55:08.001811       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-51d1519e-cfd4-4a0d-ad2b-d84d77ef430d","parameters":{"csi.storage.k8s.io/pv/name":"pvc-51d1519e-cfd4-4a0d-ad2b-d84d77ef430d","csi.storage.k8s.io/pvc/name":"inline-volume-tester-2vzrd-my-volume-0","csi.storage.k8s.io/pvc/namespace":"ephemeral-3904"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:55:08.045146       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-51d1519e-cfd4-4a0d-ad2b-d84d77ef430d, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-51d1519e-cfd4-4a0d-ad2b-d84d77ef430d' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:55:08.045204       1 controllerserver.go:271] begin to create azure disk(pvc-51d1519e-cfd4-4a0d-ad2b-d84d77ef430d) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:55:08.045216       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-51d1519e-cfd4-4a0d-ad2b-d84d77ef430d StorageAccountType:StandardSSD_LRS Size:5
I1005 15:55:10.490152       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-51d1519e-cfd4-4a0d-ad2b-d84d77ef430d StorageAccountType:StandardSSD_LRS Size:5
I1005 15:55:10.490211       1 controllerserver.go:348] create azure disk(pvc-51d1519e-cfd4-4a0d-ad2b-d84d77ef430d) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-51d1519e-cfd4-4a0d-ad2b-d84d77ef430d kubernetes.io-created-for-pvc-name:inline-volume-tester-2vzrd-my-volume-0 kubernetes.io-created-for-pvc-namespace:ephemeral-3904]) successfully
I1005 15:55:10.490235       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-51d1519e-cfd4-4a0d-ad2b-d84d77ef430d","csi.storage.k8s.io/pvc/name":"inline-volume-tester-2vzrd-my-volume-0","csi.storage.k8s.io/pvc/namespace":"ephemeral-3904","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-51d1519e-cfd4-4a0d-ad2b-d84d77ef430d"}}
I1005 15:55:11.913562       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 3 lines ...
I1005 15:55:12.017567       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-35271516-vmss000001, refreshing the cache
I1005 15:55:12.098130       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-51d1519e-cfd4-4a0d-ad2b-d84d77ef430d" to node "k8s-agentpool1-35271516-vmss000001"
I1005 15:55:12.098168       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:55:12.098203       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-51d1519e-cfd4-4a0d-ad2b-d84d77ef430d" lun 0 to node "k8s-agentpool1-35271516-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-51d1519e-cfd4-4a0d-ad2b-d84d77ef430d:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-51d1519e-cfd4-4a0d-ad2b-d84d77ef430d  true false 0})]
I1005 15:55:12.098239       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:55:12.098259       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-51d1519e-cfd4-4a0d-ad2b-d84d77ef430d:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-51d1519e-cfd4-4a0d-ad2b-d84d77ef430d  true false 0})])
I1005 15:55:12.239859       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-51d1519e-cfd4-4a0d-ad2b-d84d77ef430d:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-51d1519e-cfd4-4a0d-ad2b-d84d77ef430d  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1005 15:55:22.353697       1 controllerserver.go:465] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-51d1519e-cfd4-4a0d-ad2b-d84d77ef430d" attached to node "k8s-agentpool1-35271516-vmss000001".
I1005 15:55:22.353735       1 controllerserver.go:485] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-51d1519e-cfd4-4a0d-ad2b-d84d77ef430d" to node "k8s-agentpool1-35271516-vmss000001" successfully
I1005 15:55:22.353761       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
I1005 15:55:22.369933       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
I1005 15:55:22.369978       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-35271516-vmss000001","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":7}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-51d1519e-cfd4-4a0d-ad2b-d84d77ef430d","csi.storage.k8s.io/pvc/name":"inline-volume-tester-2vzrd-my-volume-0","csi.storage.k8s.io/pvc/namespace":"ephemeral-3904","requestedsizegib":"5","storage.kubernetes.io/csiProvisionerIdentity":"1633447947345-8081-test.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-51d1519e-cfd4-4a0d-ad2b-d84d77ef430d"}
I1005 15:55:22.401610       1 controllerserver.go:440] GetDiskLun returned: <nil>. Initiating attaching volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-51d1519e-cfd4-4a0d-ad2b-d84d77ef430d" to node "k8s-agentpool1-35271516-vmss000001".
... skipping 14 lines ...
I1005 15:56:23.507976       1 azure_controller_common.go:369] azureDisk - detach disk(pvc-51d1519e-cfd4-4a0d-ad2b-d84d77ef430d, /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-51d1519e-cfd4-4a0d-ad2b-d84d77ef430d) succeeded
I1005 15:56:23.507990       1 controllerserver.go:533] detach volume /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-51d1519e-cfd4-4a0d-ad2b-d84d77ef430d from node k8s-agentpool1-35271516-vmss000001 successfully
I1005 15:56:23.508002       1 utils.go:102] GRPC response: {}
I1005 15:56:36.063045       1 utils.go:95] GRPC call: /csi.v1.Controller/DeleteVolume
I1005 15:56:36.063073       1 utils.go:96] GRPC request: {"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-51d1519e-cfd4-4a0d-ad2b-d84d77ef430d"}
I1005 15:56:36.063148       1 controllerserver.go:389] deleting azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-51d1519e-cfd4-4a0d-ad2b-d84d77ef430d)
I1005 15:56:51.063816       1 azure_armclient.go:304] Received error in WaitForCompletionRef: 'Future#WaitForCompletion: context has been cancelled: StatusCode=200 -- Original Error: context canceled'
I1005 15:56:51.063858       1 azure_armclient.go:634] Received error in delete.wait: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-51d1519e-cfd4-4a0d-ad2b-d84d77ef430d, error: %!s(<nil>)
I1005 15:56:51.063906       1 controllerserver.go:391] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-51d1519e-cfd4-4a0d-ad2b-d84d77ef430d) returned with Retriable: true, RetryAfter: 0s, HTTPStatusCode: 0, RawError: Future#WaitForCompletion: context has been cancelled: StatusCode=200 -- Original Error: context canceled
E1005 15:56:51.063932       1 utils.go:100] GRPC error: Retriable: true, RetryAfter: 0s, HTTPStatusCode: 0, RawError: Future#WaitForCompletion: context has been cancelled: StatusCode=200 -- Original Error: context canceled
I1005 15:56:58.636387       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerUnpublishVolume
I1005 15:56:58.636414       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-35271516-vmss000000","volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-d420d34b-aebb-4da8-b0fe-f88f30946243"}
I1005 15:56:58.636529       1 controllerserver.go:524] Trying to detach volume /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-d420d34b-aebb-4da8-b0fe-f88f30946243 from node k8s-agentpool1-35271516-vmss000000
I1005 15:56:58.636540       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:56:58.636597       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:56:58.636620       1 azure_controller_common.go:346] Trying to detach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-d420d34b-aebb-4da8-b0fe-f88f30946243" from node "k8s-agentpool1-35271516-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-d420d34b-aebb-4da8-b0fe-f88f30946243:pvc-d420d34b-aebb-4da8-b0fe-f88f30946243]
... skipping 3 lines ...
I1005 15:57:19.408871       1 azure_controller_common.go:369] azureDisk - detach disk(pvc-d420d34b-aebb-4da8-b0fe-f88f30946243, /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-d420d34b-aebb-4da8-b0fe-f88f30946243) succeeded
I1005 15:57:19.408884       1 controllerserver.go:533] detach volume /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-d420d34b-aebb-4da8-b0fe-f88f30946243 from node k8s-agentpool1-35271516-vmss000000 successfully
I1005 15:57:19.408895       1 utils.go:102] GRPC response: {}
I1005 15:57:23.064592       1 utils.go:95] GRPC call: /csi.v1.Controller/DeleteVolume
I1005 15:57:23.064629       1 utils.go:96] GRPC request: {"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-51d1519e-cfd4-4a0d-ad2b-d84d77ef430d"}
I1005 15:57:23.064730       1 controllerserver.go:389] deleting azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-51d1519e-cfd4-4a0d-ad2b-d84d77ef430d)
I1005 15:57:23.084713       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-51d1519e-cfd4-4a0d-ad2b-d84d77ef430d, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-51d1519e-cfd4-4a0d-ad2b-d84d77ef430d' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:57:23.084770       1 azure_managedDiskController.go:268] azureDisk - disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-51d1519e-cfd4-4a0d-ad2b-d84d77ef430d) is already deleted
I1005 15:57:23.084800       1 controllerserver.go:391] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-51d1519e-cfd4-4a0d-ad2b-d84d77ef430d) returned with <nil>
I1005 15:57:23.084820       1 utils.go:102] GRPC response: {}
I1005 15:57:29.072725       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:57:29.072759       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-8bab8be7-0cdf-463a-ab7d-d07cdeedf723","parameters":{"csi.storage.k8s.io/pv/name":"pvc-8bab8be7-0cdf-463a-ab7d-d07cdeedf723","csi.storage.k8s.io/pvc/name":"test.csi.azure.comk4fz2","csi.storage.k8s.io/pvc/namespace":"volume-expand-5717"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:57:29.090570       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-8bab8be7-0cdf-463a-ab7d-d07cdeedf723, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-8bab8be7-0cdf-463a-ab7d-d07cdeedf723' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:57:29.090650       1 controllerserver.go:271] begin to create azure disk(pvc-8bab8be7-0cdf-463a-ab7d-d07cdeedf723) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:57:29.090666       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-8bab8be7-0cdf-463a-ab7d-d07cdeedf723 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:57:29.792216       1 utils.go:95] GRPC call: /csi.v1.Controller/DeleteVolume
I1005 15:57:29.792243       1 utils.go:96] GRPC request: {"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-d420d34b-aebb-4da8-b0fe-f88f30946243"}
I1005 15:57:29.792332       1 controllerserver.go:389] deleting azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-d420d34b-aebb-4da8-b0fe-f88f30946243)
I1005 15:57:31.675569       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-8bab8be7-0cdf-463a-ab7d-d07cdeedf723 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:57:31.675623       1 controllerserver.go:348] create azure disk(pvc-8bab8be7-0cdf-463a-ab7d-d07cdeedf723) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-8bab8be7-0cdf-463a-ab7d-d07cdeedf723 kubernetes.io-created-for-pvc-name:test.csi.azure.comk4fz2 kubernetes.io-created-for-pvc-namespace:volume-expand-5717]) successfully
I1005 15:57:31.675661       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-8bab8be7-0cdf-463a-ab7d-d07cdeedf723","csi.storage.k8s.io/pvc/name":"test.csi.azure.comk4fz2","csi.storage.k8s.io/pvc/namespace":"volume-expand-5717","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-8bab8be7-0cdf-463a-ab7d-d07cdeedf723"}}
I1005 15:57:34.973152       1 azure_managedDiskController.go:286] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-d420d34b-aebb-4da8-b0fe-f88f30946243
I1005 15:57:34.973188       1 controllerserver.go:391] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-d420d34b-aebb-4da8-b0fe-f88f30946243) returned with <nil>
I1005 15:57:34.973224       1 utils.go:102] GRPC response: {}
I1005 15:57:43.873929       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:57:43.873980       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-922e1dd4-7955-4310-8196-5d9b10737407","parameters":{"csi.storage.k8s.io/pv/name":"pvc-922e1dd4-7955-4310-8196-5d9b10737407","csi.storage.k8s.io/pvc/name":"pvc-257tf","csi.storage.k8s.io/pvc/namespace":"provisioning-2279"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:57:43.896538       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-922e1dd4-7955-4310-8196-5d9b10737407, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-922e1dd4-7955-4310-8196-5d9b10737407' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:57:43.896616       1 controllerserver.go:271] begin to create azure disk(pvc-922e1dd4-7955-4310-8196-5d9b10737407) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:57:43.896638       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-922e1dd4-7955-4310-8196-5d9b10737407 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:57:46.313441       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-922e1dd4-7955-4310-8196-5d9b10737407 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:57:46.313515       1 controllerserver.go:348] create azure disk(pvc-922e1dd4-7955-4310-8196-5d9b10737407) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-922e1dd4-7955-4310-8196-5d9b10737407 kubernetes.io-created-for-pvc-name:pvc-257tf kubernetes.io-created-for-pvc-namespace:provisioning-2279]) successfully
I1005 15:57:46.313546       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-922e1dd4-7955-4310-8196-5d9b10737407","csi.storage.k8s.io/pvc/name":"pvc-257tf","csi.storage.k8s.io/pvc/namespace":"provisioning-2279","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-922e1dd4-7955-4310-8196-5d9b10737407"}}
I1005 15:57:49.004603       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 3 lines ...
I1005 15:57:49.028061       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-35271516-vmss000001, refreshing the cache
I1005 15:57:49.163515       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-922e1dd4-7955-4310-8196-5d9b10737407" to node "k8s-agentpool1-35271516-vmss000001"
I1005 15:57:49.163587       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:57:49.163604       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-922e1dd4-7955-4310-8196-5d9b10737407" lun 0 to node "k8s-agentpool1-35271516-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-922e1dd4-7955-4310-8196-5d9b10737407:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-922e1dd4-7955-4310-8196-5d9b10737407  true false 0})]
I1005 15:57:49.163620       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:57:49.163631       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-922e1dd4-7955-4310-8196-5d9b10737407:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-922e1dd4-7955-4310-8196-5d9b10737407  true false 0})])
I1005 15:57:49.628521       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-922e1dd4-7955-4310-8196-5d9b10737407:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-922e1dd4-7955-4310-8196-5d9b10737407  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1005 15:58:04.382033       1 utils.go:95] GRPC call: /csi.v1.Controller/DeleteVolume
I1005 15:58:04.382061       1 utils.go:96] GRPC request: {"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-8bab8be7-0cdf-463a-ab7d-d07cdeedf723"}
I1005 15:58:04.382150       1 controllerserver.go:389] deleting azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-8bab8be7-0cdf-463a-ab7d-d07cdeedf723)
I1005 15:58:04.820935       1 controllerserver.go:465] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-922e1dd4-7955-4310-8196-5d9b10737407" attached to node "k8s-agentpool1-35271516-vmss000001".
I1005 15:58:04.820968       1 controllerserver.go:485] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-922e1dd4-7955-4310-8196-5d9b10737407" to node "k8s-agentpool1-35271516-vmss000001" successfully
I1005 15:58:04.821003       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
... skipping 7 lines ...
I1005 15:58:04.932165       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
I1005 15:58:09.650447       1 azure_managedDiskController.go:286] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-8bab8be7-0cdf-463a-ab7d-d07cdeedf723
I1005 15:58:09.650477       1 controllerserver.go:391] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-8bab8be7-0cdf-463a-ab7d-d07cdeedf723) returned with <nil>
I1005 15:58:09.650517       1 utils.go:102] GRPC response: {}
I1005 15:58:15.952775       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:58:15.952802       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-72457220-10bb-4391-a3bc-5033e2dc63a7","parameters":{"csi.storage.k8s.io/pv/name":"pvc-72457220-10bb-4391-a3bc-5033e2dc63a7","csi.storage.k8s.io/pvc/name":"test.csi.azure.comkmbzd","csi.storage.k8s.io/pvc/namespace":"provisioning-6705"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:58:15.972737       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-72457220-10bb-4391-a3bc-5033e2dc63a7, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-72457220-10bb-4391-a3bc-5033e2dc63a7' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:58:15.972821       1 controllerserver.go:271] begin to create azure disk(pvc-72457220-10bb-4391-a3bc-5033e2dc63a7) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:58:15.972835       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-72457220-10bb-4391-a3bc-5033e2dc63a7 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:58:18.320553       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-72457220-10bb-4391-a3bc-5033e2dc63a7 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:58:18.320631       1 controllerserver.go:348] create azure disk(pvc-72457220-10bb-4391-a3bc-5033e2dc63a7) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-72457220-10bb-4391-a3bc-5033e2dc63a7 kubernetes.io-created-for-pvc-name:test.csi.azure.comkmbzd kubernetes.io-created-for-pvc-namespace:provisioning-6705]) successfully
I1005 15:58:18.320654       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-72457220-10bb-4391-a3bc-5033e2dc63a7","csi.storage.k8s.io/pvc/name":"test.csi.azure.comkmbzd","csi.storage.k8s.io/pvc/namespace":"provisioning-6705","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-72457220-10bb-4391-a3bc-5033e2dc63a7"}}
I1005 15:58:20.630348       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 2 lines ...
I1005 15:58:20.710873       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:58:20.710928       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-72457220-10bb-4391-a3bc-5033e2dc63a7" to node "k8s-agentpool1-35271516-vmss000000"
I1005 15:58:20.710951       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:58:20.710962       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-72457220-10bb-4391-a3bc-5033e2dc63a7" lun 0 to node "k8s-agentpool1-35271516-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-72457220-10bb-4391-a3bc-5033e2dc63a7:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-72457220-10bb-4391-a3bc-5033e2dc63a7  true false 0})]
I1005 15:58:20.710995       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:58:20.711008       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-72457220-10bb-4391-a3bc-5033e2dc63a7:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-72457220-10bb-4391-a3bc-5033e2dc63a7  true false 0})])
I1005 15:58:21.128695       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-72457220-10bb-4391-a3bc-5033e2dc63a7:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-72457220-10bb-4391-a3bc-5033e2dc63a7  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1005 15:58:32.616219       1 azure_vmss.go:319] Couldn't find VMSS VM with scaleSetName "k8s-agentpool1-35271516-vmss" and instanceID "0", refreshing the cache
I1005 15:58:35.878847       1 utils.go:95] GRPC call: /csi.v1.Identity/GetPluginInfo
I1005 15:58:35.878874       1 utils.go:96] GRPC request: {}
I1005 15:58:35.878926       1 utils.go:102] GRPC response: {"name":"test.csi.azure.com","vendor_version":"v1.8.0-8412a9b9582277d9ca97974b5d2601e9b23694a4"}
I1005 15:58:35.879294       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateSnapshot
I1005 15:58:35.879313       1 utils.go:96] GRPC request: {"name":"snapshot-1cc81af6-8d44-44ff-ac7d-ac8de5d7e96b","source_volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-922e1dd4-7955-4310-8196-5d9b10737407"}
... skipping 17 lines ...
I1005 15:58:39.172422       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:58:39.172443       1 azure_controller_common.go:346] Trying to detach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-922e1dd4-7955-4310-8196-5d9b10737407" from node "k8s-agentpool1-35271516-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-922e1dd4-7955-4310-8196-5d9b10737407:pvc-922e1dd4-7955-4310-8196-5d9b10737407]
I1005 15:58:39.172472       1 azure_controller_vmss.go:174] azureDisk - detach disk: name "pvc-922e1dd4-7955-4310-8196-5d9b10737407" uri "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-922e1dd4-7955-4310-8196-5d9b10737407"
I1005 15:58:39.172489       1 azure_controller_vmss.go:213] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - detach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-922e1dd4-7955-4310-8196-5d9b10737407:pvc-922e1dd4-7955-4310-8196-5d9b10737407])
I1005 15:58:40.609712       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:58:40.609742       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-944dfcaf-61fa-4ca1-b1b9-1d76081eda12","parameters":{"csi.storage.k8s.io/pv/name":"pvc-944dfcaf-61fa-4ca1-b1b9-1d76081eda12","csi.storage.k8s.io/pvc/name":"pvc-glpbw","csi.storage.k8s.io/pvc/namespace":"provisioning-2279"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}],"volume_content_source":{"Type":{"Snapshot":{"snapshot_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/snapshots/snapshot-1cc81af6-8d44-44ff-ac7d-ac8de5d7e96b"}}}}
I1005 15:58:40.643650       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-944dfcaf-61fa-4ca1-b1b9-1d76081eda12, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-944dfcaf-61fa-4ca1-b1b9-1d76081eda12' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:58:40.643724       1 controllerserver.go:271] begin to create azure disk(pvc-944dfcaf-61fa-4ca1-b1b9-1d76081eda12) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:58:40.643747       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-944dfcaf-61fa-4ca1-b1b9-1d76081eda12 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:58:43.259526       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-944dfcaf-61fa-4ca1-b1b9-1d76081eda12 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:58:43.259678       1 controllerserver.go:348] create azure disk(pvc-944dfcaf-61fa-4ca1-b1b9-1d76081eda12) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-944dfcaf-61fa-4ca1-b1b9-1d76081eda12 kubernetes.io-created-for-pvc-name:pvc-glpbw kubernetes.io-created-for-pvc-namespace:provisioning-2279]) successfully
I1005 15:58:43.259725       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":{"Snapshot":{"snapshot_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/snapshots/snapshot-1cc81af6-8d44-44ff-ac7d-ac8de5d7e96b"}}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-944dfcaf-61fa-4ca1-b1b9-1d76081eda12","csi.storage.k8s.io/pvc/name":"pvc-glpbw","csi.storage.k8s.io/pvc/namespace":"provisioning-2279","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-944dfcaf-61fa-4ca1-b1b9-1d76081eda12"}}
I1005 15:58:46.025222       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 12 lines ...
I1005 15:58:59.425770       1 controllerserver.go:524] Trying to detach volume /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-922e1dd4-7955-4310-8196-5d9b10737407 from node k8s-agentpool1-35271516-vmss000001
I1005 15:58:59.425785       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:58:59.475973       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-944dfcaf-61fa-4ca1-b1b9-1d76081eda12" lun 0 to node "k8s-agentpool1-35271516-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-944dfcaf-61fa-4ca1-b1b9-1d76081eda12:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-944dfcaf-61fa-4ca1-b1b9-1d76081eda12  true false 0})]
I1005 15:58:59.476003       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:58:59.476035       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-944dfcaf-61fa-4ca1-b1b9-1d76081eda12:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-944dfcaf-61fa-4ca1-b1b9-1d76081eda12  true false 0})])
I1005 15:58:59.476090       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:58:59.629352       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-944dfcaf-61fa-4ca1-b1b9-1d76081eda12:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-944dfcaf-61fa-4ca1-b1b9-1d76081eda12  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1005 15:58:59.629564       1 azure_controller_common.go:346] Trying to detach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-922e1dd4-7955-4310-8196-5d9b10737407" from node "k8s-agentpool1-35271516-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-922e1dd4-7955-4310-8196-5d9b10737407:pvc-922e1dd4-7955-4310-8196-5d9b10737407]
I1005 15:58:59.629615       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-35271516-vmss000001, refreshing the cache
E1005 15:58:59.677169       1 azure_controller_vmss.go:183] detach azure disk on node(k8s-agentpool1-35271516-vmss000001): disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-922e1dd4-7955-4310-8196-5d9b10737407:pvc-922e1dd4-7955-4310-8196-5d9b10737407]) not found
I1005 15:58:59.677196       1 azure_controller_vmss.go:213] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - detach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-922e1dd4-7955-4310-8196-5d9b10737407:pvc-922e1dd4-7955-4310-8196-5d9b10737407])
I1005 15:59:09.399676       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerUnpublishVolume
I1005 15:59:09.399704       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-35271516-vmss000000","volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-72457220-10bb-4391-a3bc-5033e2dc63a7"}
... skipping 28 lines ...
I1005 15:59:30.521037       1 controllerserver.go:389] deleting azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-72457220-10bb-4391-a3bc-5033e2dc63a7)
I1005 15:59:35.746651       1 azure_managedDiskController.go:286] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-72457220-10bb-4391-a3bc-5033e2dc63a7
I1005 15:59:35.746688       1 controllerserver.go:391] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-72457220-10bb-4391-a3bc-5033e2dc63a7) returned with <nil>
I1005 15:59:35.746722       1 utils.go:102] GRPC response: {}
I1005 15:59:41.761669       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 15:59:41.761712       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-40f445a6-c1f8-4f91-b339-297015aaaa74","parameters":{"csi.storage.k8s.io/pv/name":"pvc-40f445a6-c1f8-4f91-b339-297015aaaa74","csi.storage.k8s.io/pvc/name":"test.csi.azure.com2tcl9","csi.storage.k8s.io/pvc/namespace":"volumemode-6628"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 15:59:41.779556       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-40f445a6-c1f8-4f91-b339-297015aaaa74, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-40f445a6-c1f8-4f91-b339-297015aaaa74' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 15:59:41.779729       1 controllerserver.go:271] begin to create azure disk(pvc-40f445a6-c1f8-4f91-b339-297015aaaa74) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 15:59:41.779761       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-40f445a6-c1f8-4f91-b339-297015aaaa74 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:59:44.175594       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-40f445a6-c1f8-4f91-b339-297015aaaa74 StorageAccountType:StandardSSD_LRS Size:5
I1005 15:59:44.175637       1 controllerserver.go:348] create azure disk(pvc-40f445a6-c1f8-4f91-b339-297015aaaa74) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-40f445a6-c1f8-4f91-b339-297015aaaa74 kubernetes.io-created-for-pvc-name:test.csi.azure.com2tcl9 kubernetes.io-created-for-pvc-namespace:volumemode-6628]) successfully
I1005 15:59:44.175662       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-40f445a6-c1f8-4f91-b339-297015aaaa74","csi.storage.k8s.io/pvc/name":"test.csi.azure.com2tcl9","csi.storage.k8s.io/pvc/namespace":"volumemode-6628","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-40f445a6-c1f8-4f91-b339-297015aaaa74"}}
I1005 15:59:44.786061       1 azure_controller_vmss.go:225] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - detach disk(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-944dfcaf-61fa-4ca1-b1b9-1d76081eda12:pvc-944dfcaf-61fa-4ca1-b1b9-1d76081eda12]) returned with <nil>
... skipping 20 lines ...
I1005 15:59:50.104467       1 utils.go:102] GRPC response: {}
I1005 15:59:50.104542       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:59:50.104559       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-35271516-vmss000001, refreshing the cache
I1005 15:59:50.148593       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-40f445a6-c1f8-4f91-b339-297015aaaa74" lun 0 to node "k8s-agentpool1-35271516-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-40f445a6-c1f8-4f91-b339-297015aaaa74:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-40f445a6-c1f8-4f91-b339-297015aaaa74  true false 0})]
I1005 15:59:50.148624       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 15:59:50.148640       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-40f445a6-c1f8-4f91-b339-297015aaaa74:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-40f445a6-c1f8-4f91-b339-297015aaaa74  true false 0})])
I1005 15:59:50.329384       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-40f445a6-c1f8-4f91-b339-297015aaaa74:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-40f445a6-c1f8-4f91-b339-297015aaaa74  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1005 15:59:59.712983       1 utils.go:95] GRPC call: /csi.v1.Controller/DeleteVolume
I1005 15:59:59.713014       1 utils.go:96] GRPC request: {"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-944dfcaf-61fa-4ca1-b1b9-1d76081eda12"}
I1005 15:59:59.713094       1 controllerserver.go:389] deleting azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-944dfcaf-61fa-4ca1-b1b9-1d76081eda12)
I1005 16:00:00.453798       1 controllerserver.go:465] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-40f445a6-c1f8-4f91-b339-297015aaaa74" attached to node "k8s-agentpool1-35271516-vmss000001".
I1005 16:00:00.453848       1 controllerserver.go:485] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-40f445a6-c1f8-4f91-b339-297015aaaa74" to node "k8s-agentpool1-35271516-vmss000001" successfully
I1005 16:00:00.453865       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
... skipping 42 lines ...
I1005 16:00:27.502979       1 controllerserver.go:389] deleting azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-40f445a6-c1f8-4f91-b339-297015aaaa74)
I1005 16:00:32.679221       1 azure_managedDiskController.go:286] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-40f445a6-c1f8-4f91-b339-297015aaaa74
I1005 16:00:32.679286       1 controllerserver.go:391] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-40f445a6-c1f8-4f91-b339-297015aaaa74) returned with <nil>
I1005 16:00:32.679332       1 utils.go:102] GRPC response: {}
I1005 16:00:38.892308       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 16:00:38.892333       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-1659726f-1c0c-4759-8d46-5fc8a080c40c","parameters":{"csi.storage.k8s.io/pv/name":"pvc-1659726f-1c0c-4759-8d46-5fc8a080c40c","csi.storage.k8s.io/pvc/name":"test.csi.azure.comnhr6v","csi.storage.k8s.io/pvc/namespace":"volumemode-6752"},"volume_capabilities":[{"AccessType":{"Block":{}},"access_mode":{"mode":7}}]}
I1005 16:00:38.911464       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-1659726f-1c0c-4759-8d46-5fc8a080c40c, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-1659726f-1c0c-4759-8d46-5fc8a080c40c' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 16:00:38.911522       1 controllerserver.go:271] begin to create azure disk(pvc-1659726f-1c0c-4759-8d46-5fc8a080c40c) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) diskZone() maxShares(0)
I1005 16:00:38.911552       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-1659726f-1c0c-4759-8d46-5fc8a080c40c StorageAccountType:StandardSSD_LRS Size:5
I1005 16:00:41.458246       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-1659726f-1c0c-4759-8d46-5fc8a080c40c StorageAccountType:StandardSSD_LRS Size:5
I1005 16:00:41.458309       1 controllerserver.go:348] create azure disk(pvc-1659726f-1c0c-4759-8d46-5fc8a080c40c) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(5) tags(map[kubernetes.io-created-for-pv-name:pvc-1659726f-1c0c-4759-8d46-5fc8a080c40c kubernetes.io-created-for-pvc-name:test.csi.azure.comnhr6v kubernetes.io-created-for-pvc-namespace:volumemode-6752]) successfully
I1005 16:00:41.458334       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":5368709120,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-1659726f-1c0c-4759-8d46-5fc8a080c40c","csi.storage.k8s.io/pvc/name":"test.csi.azure.comnhr6v","csi.storage.k8s.io/pvc/namespace":"volumemode-6752","requestedsizegib":"5"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-1659726f-1c0c-4759-8d46-5fc8a080c40c"}}
I1005 16:00:43.665715       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 3 lines ...
I1005 16:00:43.693334       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-35271516-vmss000001, refreshing the cache
I1005 16:00:43.764827       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-1659726f-1c0c-4759-8d46-5fc8a080c40c" to node "k8s-agentpool1-35271516-vmss000001"
I1005 16:00:43.764877       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 16:00:43.764892       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-1659726f-1c0c-4759-8d46-5fc8a080c40c" lun 0 to node "k8s-agentpool1-35271516-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-1659726f-1c0c-4759-8d46-5fc8a080c40c:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-1659726f-1c0c-4759-8d46-5fc8a080c40c  true false 0})]
I1005 16:00:43.764907       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 16:00:43.764918       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-1659726f-1c0c-4759-8d46-5fc8a080c40c:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-1659726f-1c0c-4759-8d46-5fc8a080c40c  true false 0})])
I1005 16:00:43.941202       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-1659726f-1c0c-4759-8d46-5fc8a080c40c:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-1659726f-1c0c-4759-8d46-5fc8a080c40c  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1005 16:00:54.016265       1 controllerserver.go:465] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-1659726f-1c0c-4759-8d46-5fc8a080c40c" attached to node "k8s-agentpool1-35271516-vmss000001".
I1005 16:00:54.016300       1 controllerserver.go:485] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-1659726f-1c0c-4759-8d46-5fc8a080c40c" to node "k8s-agentpool1-35271516-vmss000001" successfully
I1005 16:00:54.016317       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
I1005 16:00:55.161221       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerUnpublishVolume
I1005 16:00:55.161249       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-35271516-vmss000001","volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-1659726f-1c0c-4759-8d46-5fc8a080c40c"}
I1005 16:00:55.161351       1 controllerserver.go:524] Trying to detach volume /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-1659726f-1c0c-4759-8d46-5fc8a080c40c from node k8s-agentpool1-35271516-vmss000001
... skipping 12 lines ...
I1005 16:01:26.643688       1 controllerserver.go:389] deleting azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-1659726f-1c0c-4759-8d46-5fc8a080c40c)
I1005 16:01:31.877755       1 azure_managedDiskController.go:286] azureDisk - deleted a managed disk: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-1659726f-1c0c-4759-8d46-5fc8a080c40c
I1005 16:01:31.877785       1 controllerserver.go:391] delete azure disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-1659726f-1c0c-4759-8d46-5fc8a080c40c) returned with <nil>
I1005 16:01:31.877802       1 utils.go:102] GRPC response: {}
I1005 16:01:39.348940       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 16:01:39.348968       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":10737418240},"name":"pvc-fe08b26d-ee64-4eef-b696-7e7e4a73ee60","parameters":{"csi.storage.k8s.io/pv/name":"pvc-fe08b26d-ee64-4eef-b696-7e7e4a73ee60","csi.storage.k8s.io/pvc/name":"pvc-azuredisk","csi.storage.k8s.io/pvc/namespace":"default","skuName":"StandardSSD_LRS"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 16:01:39.373474       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-fe08b26d-ee64-4eef-b696-7e7e4a73ee60, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-fe08b26d-ee64-4eef-b696-7e7e4a73ee60' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 16:01:39.373573       1 controllerserver.go:271] begin to create azure disk(pvc-fe08b26d-ee64-4eef-b696-7e7e4a73ee60) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(10) diskZone() maxShares(0)
I1005 16:01:39.373604       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-fe08b26d-ee64-4eef-b696-7e7e4a73ee60 StorageAccountType:StandardSSD_LRS Size:10
I1005 16:01:41.713702       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-fe08b26d-ee64-4eef-b696-7e7e4a73ee60 StorageAccountType:StandardSSD_LRS Size:10
I1005 16:01:41.713774       1 controllerserver.go:348] create azure disk(pvc-fe08b26d-ee64-4eef-b696-7e7e4a73ee60) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(10) tags(map[kubernetes.io-created-for-pv-name:pvc-fe08b26d-ee64-4eef-b696-7e7e4a73ee60 kubernetes.io-created-for-pvc-name:pvc-azuredisk kubernetes.io-created-for-pvc-namespace:default]) successfully
I1005 16:01:41.713796       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":10737418240,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-fe08b26d-ee64-4eef-b696-7e7e4a73ee60","csi.storage.k8s.io/pvc/name":"pvc-azuredisk","csi.storage.k8s.io/pvc/namespace":"default","requestedsizegib":"10","skuName":"StandardSSD_LRS"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-fe08b26d-ee64-4eef-b696-7e7e4a73ee60"}}
I1005 16:01:44.181317       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 3 lines ...
I1005 16:01:44.216150       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-35271516-vmss000001, refreshing the cache
I1005 16:01:44.290241       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-fe08b26d-ee64-4eef-b696-7e7e4a73ee60" to node "k8s-agentpool1-35271516-vmss000001"
I1005 16:01:44.290294       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 16:01:44.290322       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-fe08b26d-ee64-4eef-b696-7e7e4a73ee60" lun 0 to node "k8s-agentpool1-35271516-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-fe08b26d-ee64-4eef-b696-7e7e4a73ee60:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-fe08b26d-ee64-4eef-b696-7e7e4a73ee60  true false 0})]
I1005 16:01:44.290338       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 16:01:44.290378       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-fe08b26d-ee64-4eef-b696-7e7e4a73ee60:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-fe08b26d-ee64-4eef-b696-7e7e4a73ee60  true false 0})])
I1005 16:01:44.451152       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-fe08b26d-ee64-4eef-b696-7e7e4a73ee60:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-fe08b26d-ee64-4eef-b696-7e7e4a73ee60  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1005 16:01:54.591819       1 controllerserver.go:465] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-fe08b26d-ee64-4eef-b696-7e7e4a73ee60" attached to node "k8s-agentpool1-35271516-vmss000001".
I1005 16:01:54.591875       1 controllerserver.go:485] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-fe08b26d-ee64-4eef-b696-7e7e4a73ee60" to node "k8s-agentpool1-35271516-vmss000001" successfully
I1005 16:01:54.591892       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
I1005 16:02:08.809374       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 16:02:08.809402       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":10737418240},"name":"pvc-e82caceb-7796-4a99-8b5c-647047106e5f","parameters":{"csi.storage.k8s.io/pv/name":"pvc-e82caceb-7796-4a99-8b5c-647047106e5f","csi.storage.k8s.io/pvc/name":"persistent-storage-statefulset-azuredisk-0","csi.storage.k8s.io/pvc/namespace":"default","skuName":"StandardSSD_LRS"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 16:02:08.834545       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-e82caceb-7796-4a99-8b5c-647047106e5f, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-e82caceb-7796-4a99-8b5c-647047106e5f' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 16:02:08.834627       1 controllerserver.go:271] begin to create azure disk(pvc-e82caceb-7796-4a99-8b5c-647047106e5f) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(10) diskZone() maxShares(0)
I1005 16:02:08.834661       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-e82caceb-7796-4a99-8b5c-647047106e5f StorageAccountType:StandardSSD_LRS Size:10
I1005 16:02:11.188671       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-e82caceb-7796-4a99-8b5c-647047106e5f StorageAccountType:StandardSSD_LRS Size:10
I1005 16:02:11.188728       1 controllerserver.go:348] create azure disk(pvc-e82caceb-7796-4a99-8b5c-647047106e5f) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(10) tags(map[kubernetes.io-created-for-pv-name:pvc-e82caceb-7796-4a99-8b5c-647047106e5f kubernetes.io-created-for-pvc-name:persistent-storage-statefulset-azuredisk-0 kubernetes.io-created-for-pvc-namespace:default]) successfully
I1005 16:02:11.188766       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":10737418240,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-e82caceb-7796-4a99-8b5c-647047106e5f","csi.storage.k8s.io/pvc/name":"persistent-storage-statefulset-azuredisk-0","csi.storage.k8s.io/pvc/namespace":"default","requestedsizegib":"10","skuName":"StandardSSD_LRS"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-e82caceb-7796-4a99-8b5c-647047106e5f"}}
I1005 16:02:12.162049       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 2 lines ...
I1005 16:02:12.186666       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 16:02:12.186703       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-e82caceb-7796-4a99-8b5c-647047106e5f" to node "k8s-agentpool1-35271516-vmss000000"
I1005 16:02:12.186718       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 16:02:12.186730       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-e82caceb-7796-4a99-8b5c-647047106e5f" lun 0 to node "k8s-agentpool1-35271516-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-e82caceb-7796-4a99-8b5c-647047106e5f:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-e82caceb-7796-4a99-8b5c-647047106e5f  true false 0})]
I1005 16:02:12.186764       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 16:02:12.186795       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-e82caceb-7796-4a99-8b5c-647047106e5f:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-e82caceb-7796-4a99-8b5c-647047106e5f  true false 0})])
I1005 16:02:12.363897       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-e82caceb-7796-4a99-8b5c-647047106e5f:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-e82caceb-7796-4a99-8b5c-647047106e5f  true false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1005 16:02:22.463440       1 controllerserver.go:465] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-e82caceb-7796-4a99-8b5c-647047106e5f" attached to node "k8s-agentpool1-35271516-vmss000000".
I1005 16:02:22.463473       1 controllerserver.go:485] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-e82caceb-7796-4a99-8b5c-647047106e5f" to node "k8s-agentpool1-35271516-vmss000000" successfully
I1005 16:02:22.463508       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"0"}}
I1005 16:02:32.876299       1 azure_vmss.go:319] Couldn't find VMSS VM with scaleSetName "k8s-agentpool1-35271516-vmss" and instanceID "0", refreshing the cache
I1005 16:02:38.279550       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 16:02:38.279577       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":10737418240},"name":"pvc-008b7fe2-2202-4c51-afa3-54cd75621535","parameters":{"csi.storage.k8s.io/pv/name":"pvc-008b7fe2-2202-4c51-afa3-54cd75621535","csi.storage.k8s.io/pvc/name":"persistent-storage-statefulset-azuredisk-nonroot-0","csi.storage.k8s.io/pvc/namespace":"default","skuName":"StandardSSD_LRS"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 16:02:38.329580       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-008b7fe2-2202-4c51-afa3-54cd75621535, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-008b7fe2-2202-4c51-afa3-54cd75621535' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 16:02:38.329674       1 controllerserver.go:271] begin to create azure disk(pvc-008b7fe2-2202-4c51-afa3-54cd75621535) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(10) diskZone() maxShares(0)
I1005 16:02:38.329688       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-008b7fe2-2202-4c51-afa3-54cd75621535 StorageAccountType:StandardSSD_LRS Size:10
I1005 16:02:40.667849       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-008b7fe2-2202-4c51-afa3-54cd75621535 StorageAccountType:StandardSSD_LRS Size:10
I1005 16:02:40.667923       1 controllerserver.go:348] create azure disk(pvc-008b7fe2-2202-4c51-afa3-54cd75621535) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(10) tags(map[kubernetes.io-created-for-pv-name:pvc-008b7fe2-2202-4c51-afa3-54cd75621535 kubernetes.io-created-for-pvc-name:persistent-storage-statefulset-azuredisk-nonroot-0 kubernetes.io-created-for-pvc-namespace:default]) successfully
I1005 16:02:40.667967       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":10737418240,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-008b7fe2-2202-4c51-afa3-54cd75621535","csi.storage.k8s.io/pvc/name":"persistent-storage-statefulset-azuredisk-nonroot-0","csi.storage.k8s.io/pvc/namespace":"default","requestedsizegib":"10","skuName":"StandardSSD_LRS"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-008b7fe2-2202-4c51-afa3-54cd75621535"}}
I1005 16:02:43.192243       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 2 lines ...
I1005 16:02:43.215913       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 16:02:43.215966       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-008b7fe2-2202-4c51-afa3-54cd75621535" to node "k8s-agentpool1-35271516-vmss000000"
I1005 16:02:43.215980       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 16:02:43.216009       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-008b7fe2-2202-4c51-afa3-54cd75621535" lun 1 to node "k8s-agentpool1-35271516-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-008b7fe2-2202-4c51-afa3-54cd75621535:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-008b7fe2-2202-4c51-afa3-54cd75621535  true false 1})]
I1005 16:02:43.216063       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 16:02:43.216077       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-008b7fe2-2202-4c51-afa3-54cd75621535:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-008b7fe2-2202-4c51-afa3-54cd75621535  true false 1})])
I1005 16:02:43.408129       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-008b7fe2-2202-4c51-afa3-54cd75621535:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-008b7fe2-2202-4c51-afa3-54cd75621535  true false 1})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1005 16:02:53.533189       1 controllerserver.go:465] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-008b7fe2-2202-4c51-afa3-54cd75621535" attached to node "k8s-agentpool1-35271516-vmss000000".
I1005 16:02:53.533222       1 controllerserver.go:485] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-008b7fe2-2202-4c51-afa3-54cd75621535" to node "k8s-agentpool1-35271516-vmss000000" successfully
I1005 16:02:53.533257       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"1"}}
I1005 16:02:53.555162       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
I1005 16:02:53.555184       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-35271516-vmss000000","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":7}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-008b7fe2-2202-4c51-afa3-54cd75621535","csi.storage.k8s.io/pvc/name":"persistent-storage-statefulset-azuredisk-nonroot-0","csi.storage.k8s.io/pvc/namespace":"default","requestedsizegib":"10","skuName":"StandardSSD_LRS","storage.kubernetes.io/csiProvisionerIdentity":"1633447947345-8081-test.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-008b7fe2-2202-4c51-afa3-54cd75621535"}
I1005 16:02:53.590038       1 controllerserver.go:440] GetDiskLun returned: <nil>. Initiating attaching volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-008b7fe2-2202-4c51-afa3-54cd75621535" to node "k8s-agentpool1-35271516-vmss000000".
I1005 16:02:53.590097       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 16:02:53.590133       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-35271516-vmss000000, refreshing the cache
I1005 16:02:53.660846       1 azure_controller_common.go:457] azureDisk - find disk: lun 1 name "pvc-008b7fe2-2202-4c51-afa3-54cd75621535" uri "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-008b7fe2-2202-4c51-afa3-54cd75621535"
I1005 16:02:53.660949       1 controllerserver.go:455] Attach operation is successful. volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-008b7fe2-2202-4c51-afa3-54cd75621535" is already attached to node "k8s-agentpool1-35271516-vmss000000" at lun 1.
I1005 16:02:53.661113       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"1"}}
I1005 16:03:02.649764       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 16:03:02.649791       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":10737418240},"name":"pvc-5e051fd5-af0f-465e-8e38-0e9bd413252f","parameters":{"csi.storage.k8s.io/pv/name":"pvc-5e051fd5-af0f-465e-8e38-0e9bd413252f","csi.storage.k8s.io/pvc/name":"nginx-azuredisk-ephemeral-azuredisk01","csi.storage.k8s.io/pvc/namespace":"default","skuName":"StandardSSD_LRS"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 16:03:02.672183       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-5e051fd5-af0f-465e-8e38-0e9bd413252f, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-5e051fd5-af0f-465e-8e38-0e9bd413252f' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 16:03:02.672240       1 controllerserver.go:271] begin to create azure disk(pvc-5e051fd5-af0f-465e-8e38-0e9bd413252f) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(10) diskZone() maxShares(0)
I1005 16:03:02.672255       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-5e051fd5-af0f-465e-8e38-0e9bd413252f StorageAccountType:StandardSSD_LRS Size:10
I1005 16:03:05.018134       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-5e051fd5-af0f-465e-8e38-0e9bd413252f StorageAccountType:StandardSSD_LRS Size:10
I1005 16:03:05.018190       1 controllerserver.go:348] create azure disk(pvc-5e051fd5-af0f-465e-8e38-0e9bd413252f) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(10) tags(map[kubernetes.io-created-for-pv-name:pvc-5e051fd5-af0f-465e-8e38-0e9bd413252f kubernetes.io-created-for-pvc-name:nginx-azuredisk-ephemeral-azuredisk01 kubernetes.io-created-for-pvc-namespace:default]) successfully
I1005 16:03:05.018214       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":10737418240,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-5e051fd5-af0f-465e-8e38-0e9bd413252f","csi.storage.k8s.io/pvc/name":"nginx-azuredisk-ephemeral-azuredisk01","csi.storage.k8s.io/pvc/namespace":"default","requestedsizegib":"10","skuName":"StandardSSD_LRS"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-5e051fd5-af0f-465e-8e38-0e9bd413252f"}}
I1005 16:03:06.244889       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
... skipping 2 lines ...
I1005 16:03:06.288680       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 16:03:06.288733       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-5e051fd5-af0f-465e-8e38-0e9bd413252f" to node "k8s-agentpool1-35271516-vmss000001"
I1005 16:03:06.288783       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 16:03:06.288795       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-5e051fd5-af0f-465e-8e38-0e9bd413252f" lun 1 to node "k8s-agentpool1-35271516-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-5e051fd5-af0f-465e-8e38-0e9bd413252f:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-5e051fd5-af0f-465e-8e38-0e9bd413252f  true false 1})]
I1005 16:03:06.288827       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 16:03:06.288867       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-5e051fd5-af0f-465e-8e38-0e9bd413252f:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-5e051fd5-af0f-465e-8e38-0e9bd413252f  true false 1})])
I1005 16:03:06.444549       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-5e051fd5-af0f-465e-8e38-0e9bd413252f:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-5e051fd5-af0f-465e-8e38-0e9bd413252f  true false 1})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1005 16:03:16.521217       1 controllerserver.go:465] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-5e051fd5-af0f-465e-8e38-0e9bd413252f" attached to node "k8s-agentpool1-35271516-vmss000001".
I1005 16:03:16.521253       1 controllerserver.go:485] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-5e051fd5-af0f-465e-8e38-0e9bd413252f" to node "k8s-agentpool1-35271516-vmss000001" successfully
I1005 16:03:16.521288       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"1"}}
I1005 16:03:25.616699       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 16:03:25.616744       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":10737418240},"name":"pvc-318e926c-730f-45cf-943b-7edd328fd2d7","parameters":{"csi.storage.k8s.io/pv/name":"pvc-318e926c-730f-45cf-943b-7edd328fd2d7","csi.storage.k8s.io/pvc/name":"daemonset-azuredisk-ephemeral-8cr2b-azuredisk","csi.storage.k8s.io/pvc/namespace":"default","skuName":"StandardSSD_LRS"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 16:03:25.625463       1 utils.go:95] GRPC call: /csi.v1.Controller/CreateVolume
I1005 16:03:25.625485       1 utils.go:96] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"requisite":[{"segments":{"topology.test.csi.azure.com/zone":""}}]},"capacity_range":{"required_bytes":10737418240},"name":"pvc-0e66415e-d26c-44e5-97fd-7f6d7be2d48f","parameters":{"csi.storage.k8s.io/pv/name":"pvc-0e66415e-d26c-44e5-97fd-7f6d7be2d48f","csi.storage.k8s.io/pvc/name":"daemonset-azuredisk-ephemeral-4jnlt-azuredisk","csi.storage.k8s.io/pvc/namespace":"default","skuName":"StandardSSD_LRS"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{"mode":7}}]}
I1005 16:03:25.644744       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-318e926c-730f-45cf-943b-7edd328fd2d7, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-318e926c-730f-45cf-943b-7edd328fd2d7' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 16:03:25.644845       1 controllerserver.go:271] begin to create azure disk(pvc-318e926c-730f-45cf-943b-7edd328fd2d7) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(10) diskZone() maxShares(0)
I1005 16:03:25.644869       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-318e926c-730f-45cf-943b-7edd328fd2d7 StorageAccountType:StandardSSD_LRS Size:10
I1005 16:03:25.671276       1 azure_diskclient.go:135] Received error in disk.get.request: resourceID: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-0e66415e-d26c-44e5-97fd-7f6d7be2d48f, error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 404, RawError: {"error":{"code":"ResourceNotFound","message":"The Resource 'Microsoft.Compute/disks/pvc-0e66415e-d26c-44e5-97fd-7f6d7be2d48f' under resource group 'kubetest-4edgu0dt' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"}}
I1005 16:03:25.671354       1 controllerserver.go:271] begin to create azure disk(pvc-0e66415e-d26c-44e5-97fd-7f6d7be2d48f) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(10) diskZone() maxShares(0)
I1005 16:03:25.671371       1 azure_managedDiskController.go:88] azureDisk - creating new managed Name:pvc-0e66415e-d26c-44e5-97fd-7f6d7be2d48f StorageAccountType:StandardSSD_LRS Size:10
I1005 16:03:28.063141       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-0e66415e-d26c-44e5-97fd-7f6d7be2d48f StorageAccountType:StandardSSD_LRS Size:10
I1005 16:03:28.063185       1 controllerserver.go:348] create azure disk(pvc-0e66415e-d26c-44e5-97fd-7f6d7be2d48f) account type(StandardSSD_LRS) rg(kubetest-4edgu0dt) location() size(10) tags(map[kubernetes.io-created-for-pv-name:pvc-0e66415e-d26c-44e5-97fd-7f6d7be2d48f kubernetes.io-created-for-pvc-name:daemonset-azuredisk-ephemeral-4jnlt-azuredisk kubernetes.io-created-for-pvc-namespace:default]) successfully
I1005 16:03:28.063210       1 utils.go:102] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.test.csi.azure.com/zone":""}}],"capacity_bytes":10737418240,"content_source":{"Type":null},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-0e66415e-d26c-44e5-97fd-7f6d7be2d48f","csi.storage.k8s.io/pvc/name":"daemonset-azuredisk-ephemeral-4jnlt-azuredisk","csi.storage.k8s.io/pvc/namespace":"default","requestedsizegib":"10","skuName":"StandardSSD_LRS"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-0e66415e-d26c-44e5-97fd-7f6d7be2d48f"}}
I1005 16:03:28.093269       1 azure_managedDiskController.go:249] azureDisk - created new MD Name:pvc-318e926c-730f-45cf-943b-7edd328fd2d7 StorageAccountType:StandardSSD_LRS Size:10
... skipping 6 lines ...
I1005 16:03:29.278132       1 azure_vmss.go:198] Couldn't find VMSS VM with nodeName k8s-agentpool1-35271516-vmss000001, refreshing the cache
I1005 16:03:29.342606       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-318e926c-730f-45cf-943b-7edd328fd2d7" to node "k8s-agentpool1-35271516-vmss000001"
I1005 16:03:29.342656       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 16:03:29.342671       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-318e926c-730f-45cf-943b-7edd328fd2d7" lun 2 to node "k8s-agentpool1-35271516-vmss000001", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-318e926c-730f-45cf-943b-7edd328fd2d7:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-318e926c-730f-45cf-943b-7edd328fd2d7  true false 2})]
I1005 16:03:29.342686       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000001" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 16:03:29.342698       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-318e926c-730f-45cf-943b-7edd328fd2d7:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-318e926c-730f-45cf-943b-7edd328fd2d7  true false 2})])
I1005 16:03:29.565807       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-318e926c-730f-45cf-943b-7edd328fd2d7:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-318e926c-730f-45cf-943b-7edd328fd2d7  true false 2})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1005 16:03:30.247276       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
I1005 16:03:30.247302       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-35271516-vmss000000","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":7}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-0e66415e-d26c-44e5-97fd-7f6d7be2d48f","csi.storage.k8s.io/pvc/name":"daemonset-azuredisk-ephemeral-4jnlt-azuredisk","csi.storage.k8s.io/pvc/namespace":"default","requestedsizegib":"10","skuName":"StandardSSD_LRS","storage.kubernetes.io/csiProvisionerIdentity":"1633447947345-8081-test.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-0e66415e-d26c-44e5-97fd-7f6d7be2d48f"}
I1005 16:03:30.268637       1 controllerserver.go:440] GetDiskLun returned: <nil>. Initiating attaching volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-0e66415e-d26c-44e5-97fd-7f6d7be2d48f" to node "k8s-agentpool1-35271516-vmss000000".
I1005 16:03:30.268681       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 16:03:30.268703       1 controllerserver.go:461] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-0e66415e-d26c-44e5-97fd-7f6d7be2d48f" to node "k8s-agentpool1-35271516-vmss000000"
I1005 16:03:30.268736       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 16:03:30.268787       1 azure_controller_common.go:242] Trying to attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-0e66415e-d26c-44e5-97fd-7f6d7be2d48f" lun 2 to node "k8s-agentpool1-35271516-vmss000000", diskMap: map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-0e66415e-d26c-44e5-97fd-7f6d7be2d48f:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-0e66415e-d26c-44e5-97fd-7f6d7be2d48f  true false 2})]
I1005 16:03:30.268826       1 azure_vmss_cache.go:320] Assuming node "k8s-agentpool1-35271516-vmss000000" is managed by VMSS since DisableAvailabilitySetNodes is set to true
I1005 16:03:30.268858       1 azure_controller_vmss.go:122] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-0e66415e-d26c-44e5-97fd-7f6d7be2d48f:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-0e66415e-d26c-44e5-97fd-7f6d7be2d48f  true false 2})])
I1005 16:03:30.431169       1 azure_controller_vmss.go:134] azureDisk - update(kubetest-4edgu0dt): vm(k8s-agentpool1-35271516-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-4edgu0dt/providers/microsoft.compute/disks/pvc-0e66415e-d26c-44e5-97fd-7f6d7be2d48f:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-0e66415e-d26c-44e5-97fd-7f6d7be2d48f  true false 2})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I1005 16:03:33.005401       1 azure_vmss.go:319] Couldn't find VMSS VM with scaleSetName "k8s-agentpool1-35271516-vmss" and instanceID "0", refreshing the cache
I1005 16:03:44.709388       1 controllerserver.go:465] Attach operation successful: volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-318e926c-730f-45cf-943b-7edd328fd2d7" attached to node "k8s-agentpool1-35271516-vmss000001".
I1005 16:03:44.709429       1 controllerserver.go:485] attach volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-318e926c-730f-45cf-943b-7edd328fd2d7" to node "k8s-agentpool1-35271516-vmss000001" successfully
I1005 16:03:44.709466       1 utils.go:102] GRPC response: {"publish_context":{"LUN":"2"}}
I1005 16:03:44.722386       1 utils.go:95] GRPC call: /csi.v1.Controller/ControllerPublishVolume
I1005 16:03:44.722406       1 utils.go:96] GRPC request: {"node_id":"k8s-agentpool1-35271516-vmss000001","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":7}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-318e926c-730f-45cf-943b-7edd328fd2d7","csi.storage.k8s.io/pvc/name":"daemonset-azuredisk-ephemeral-8cr2b-azuredisk","csi.storage.k8s.io/pvc/namespace":"default","requestedsizegib":"10","skuName":"StandardSSD_LRS","storage.kubernetes.io/csiProvisionerIdentity":"1633447947345-8081-test.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-4edgu0dt/providers/Microsoft.Compute/disks/pvc-318e926c-730f-45cf-943b-7edd328fd2d7"}
... skipping 28 lines ...
Platform: linux/amd64
Topology Key: topology.test.csi.azure.com/zone

Streaming logs below:
I1005 15:32:27.226581       1 azuredisk.go:139] driver userAgent: test.csi.azure.com/v1.8.0-8412a9b9582277d9ca97974b5d2601e9b23694a4 gc/go1.17.1 (amd64-linux) e2e-test
I1005 15:32:27.228001       1 azure_disk_utils.go:137] reading cloud config from secret kube-system/azure-cloud-provider
W1005 15:32:27.251495       1 azure_disk_utils.go:144] InitializeCloudFromSecret: failed to get cloud config from secret kube-system/azure-cloud-provider: failed to get secret kube-system/azure-cloud-provider: secrets "azure-cloud-provider" not found
I1005 15:32:27.251526       1 azure_disk_utils.go:149] could not read cloud config from secret kube-system/azure-cloud-provider
I1005 15:32:27.251535       1 azure_disk_utils.go:159] use default AZURE_CREDENTIAL_FILE env var: /etc/kubernetes/azure.json
I1005 15:32:27.251562       1 azure_disk_utils.go:167] read cloud config from file: /etc/kubernetes/azure.json successfully
I1005 15:32:27.252653       1 azure_auth.go:234] Using AzurePublicCloud environment
I1005 15:32:27.252683       1 azure_auth.go:96] azure: using managed identity extension to retrieve access token
I1005 15:32:27.252708       1 azure_auth.go:102] azure: using User Assigned MSI ID to retrieve access token
... skipping 1068 lines ...
Platform: linux/amd64
Topology Key: topology.test.csi.azure.com/zone

Streaming logs below:
I1005 15:32:19.945960       1 azuredisk.go:139] driver userAgent: test.csi.azure.com/v1.8.0-8412a9b9582277d9ca97974b5d2601e9b23694a4 gc/go1.17.1 (amd64-linux) e2e-test
I1005 15:32:19.947160       1 azure_disk_utils.go:137] reading cloud config from secret kube-system/azure-cloud-provider
W1005 15:32:19.973867       1 azure_disk_utils.go:144] InitializeCloudFromSecret: failed to get cloud config from secret kube-system/azure-cloud-provider: failed to get secret kube-system/azure-cloud-provider: secrets "azure-cloud-provider" not found
I1005 15:32:19.973913       1 azure_disk_utils.go:149] could not read cloud config from secret kube-system/azure-cloud-provider
I1005 15:32:19.973924       1 azure_disk_utils.go:159] use default AZURE_CREDENTIAL_FILE env var: /etc/kubernetes/azure.json
I1005 15:32:19.973954       1 azure_disk_utils.go:167] read cloud config from file: /etc/kubernetes/azure.json successfully
I1005 15:32:19.974635       1 azure_auth.go:234] Using AzurePublicCloud environment
I1005 15:32:19.974657       1 azure_auth.go:96] azure: using managed identity extension to retrieve access token
I1005 15:32:19.974662       1 azure_auth.go:102] azure: using User Assigned MSI ID to retrieve access token
... skipping 1972 lines ...
Platform: linux/amd64
Topology Key: topology.test.csi.azure.com/zone

Streaming logs below:
I1005 15:32:13.549255       1 azuredisk.go:139] driver userAgent: test.csi.azure.com/v1.8.0-8412a9b9582277d9ca97974b5d2601e9b23694a4 gc/go1.17.1 (amd64-linux) e2e-test
I1005 15:32:13.550202       1 azure_disk_utils.go:137] reading cloud config from secret kube-system/azure-cloud-provider
W1005 15:32:13.579459       1 azure_disk_utils.go:144] InitializeCloudFromSecret: failed to get cloud config from secret kube-system/azure-cloud-provider: failed to get secret kube-system/azure-cloud-provider: secrets "azure-cloud-provider" not found
I1005 15:32:13.579479       1 azure_disk_utils.go:149] could not read cloud config from secret kube-system/azure-cloud-provider
I1005 15:32:13.579483       1 azure_disk_utils.go:159] use default AZURE_CREDENTIAL_FILE env var: /etc/kubernetes/azure.json
I1005 15:32:13.579498       1 azure_disk_utils.go:167] read cloud config from file: /etc/kubernetes/azure.json successfully
I1005 15:32:13.580049       1 azure_auth.go:234] Using AzurePublicCloud environment
I1005 15:32:13.580072       1 azure_auth.go:96] azure: using managed identity extension to retrieve access token
I1005 15:32:13.580076       1 azure_auth.go:102] azure: using User Assigned MSI ID to retrieve access token
... skipping 175 lines ...
# HELP process_virtual_memory_bytes Virtual memory size in bytes.
# TYPE process_virtual_memory_bytes gauge
process_virtual_memory_bytes 7.62290176e+08
# HELP process_virtual_memory_max_bytes Maximum amount of virtual memory available in bytes.
# TYPE process_virtual_memory_max_bytes gauge
process_virtual_memory_max_bytes -1
make: *** [Makefile:254: e2e-test] Error 1
2021/10/05 16:04:04 process.go:155: Step 'make e2e-test' finished in 42m35.041029662s
2021/10/05 16:04:04 aksengine_helpers.go:425: downloading /root/tmp1967779287/log-dump.sh from https://raw.githubusercontent.com/kubernetes-sigs/cloud-provider-azure/master/hack/log-dump/log-dump.sh
2021/10/05 16:04:04 util.go:68: curl https://raw.githubusercontent.com/kubernetes-sigs/cloud-provider-azure/master/hack/log-dump/log-dump.sh
2021/10/05 16:04:04 process.go:153: Running: chmod +x /root/tmp1967779287/log-dump.sh
2021/10/05 16:04:04 process.go:155: Step 'chmod +x /root/tmp1967779287/log-dump.sh' finished in 1.545738ms
2021/10/05 16:04:04 aksengine_helpers.go:425: downloading /root/tmp1967779287/log-dump-daemonset.yaml from https://raw.githubusercontent.com/kubernetes-sigs/cloud-provider-azure/master/hack/log-dump/log-dump-daemonset.yaml
... skipping 53 lines ...
ssh key file /root/.ssh/id_rsa does not exist. Exiting.
2021/10/05 16:04:53 process.go:155: Step 'bash -c /root/tmp1967779287/win-ci-logs-collector.sh kubetest-4edgu0dt.westeurope.cloudapp.azure.com /root/tmp1967779287 /root/.ssh/id_rsa' finished in 4.004323ms
2021/10/05 16:04:53 aksengine.go:1141: Deleting resource group: kubetest-4edgu0dt.
2021/10/05 16:12:07 process.go:96: Saved XML output to /logs/artifacts/junit_runner.xml.
2021/10/05 16:12:07 process.go:153: Running: bash -c . hack/lib/version.sh && KUBE_ROOT=. kube::version::get_version_vars && echo "${KUBE_GIT_VERSION-}"
2021/10/05 16:12:08 process.go:155: Step 'bash -c . hack/lib/version.sh && KUBE_ROOT=. kube::version::get_version_vars && echo "${KUBE_GIT_VERSION-}"' finished in 239.458683ms
2021/10/05 16:12:08 main.go:331: Something went wrong: encountered 1 errors: [error during make e2e-test: exit status 2]
+ EXIT_VALUE=1
+ set +o xtrace
Cleaning up after docker in docker.
================================================================================
Cleaning up after docker
8b46f92858bc
... skipping 4 lines ...