pull-azuredisk-csi-driver-external-e2e-single-az #1514198256928690176 Results

Error lines from build-log.txt

Raw build-log.txt
... skipping 222 lines ...

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100 11156  100 11156    0     0   198k      0 --:--:-- --:--:-- --:--:--  198k
Downloading https://get.helm.sh/helm-v3.8.1-linux-amd64.tar.gz
Verifying checksum... Done.
Preparing to install helm into /usr/local/bin
helm installed into /usr/local/bin/helm
docker pull k8sprow.azurecr.io/azuredisk-csi:v1.16.0-eb7e0710ddbc5984b82c0c8453e3a2427fa2a635 || make container-all push-manifest
Error response from daemon: manifest for k8sprow.azurecr.io/azuredisk-csi:v1.16.0-eb7e0710ddbc5984b82c0c8453e3a2427fa2a635 not found: manifest unknown: manifest tagged by "v1.16.0-eb7e0710ddbc5984b82c0c8453e3a2427fa2a635" is not found
make[2]: Entering directory '/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver'
CGO_ENABLED=0 GOOS=windows go build -a -ldflags "-X sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk.driverVersion=v1.16.0-eb7e0710ddbc5984b82c0c8453e3a2427fa2a635 -X sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk.gitCommit=eb7e0710ddbc5984b82c0c8453e3a2427fa2a635 -X sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk.buildDate=2022-04-13T11:13:12Z -extldflags "-static""  -mod vendor -o _output/amd64/azurediskplugin.exe ./pkg/azurediskplugin
docker buildx rm container-builder || true
error: no builder "container-builder" found
docker buildx create --use --name=container-builder
container-builder
# enable qemu for arm64 build
# https://github.com/docker/buildx/issues/464#issuecomment-741507760
docker run --privileged --rm tonistiigi/binfmt --uninstall qemu-aarch64
Unable to find image 'tonistiigi/binfmt:latest' locally
... skipping 1736 lines ...
                    type: string
                type: object
                oneOf:
                - required: ["persistentVolumeClaimName"]
                - required: ["volumeSnapshotContentName"]
              volumeSnapshotClassName:
                description: 'VolumeSnapshotClassName is the name of the VolumeSnapshotClass requested by the VolumeSnapshot. VolumeSnapshotClassName may be left nil to indicate that the default SnapshotClass should be used. A given cluster may have multiple default Volume SnapshotClasses: one default per CSI Driver. If a VolumeSnapshot does not specify a SnapshotClass, VolumeSnapshotSource will be checked to figure out what the associated CSI Driver is, and the default VolumeSnapshotClass associated with that CSI Driver will be used. If more than one VolumeSnapshotClass exist for a given CSI Driver and more than one have been marked as default, CreateSnapshot will fail and generate an event. Empty string is not allowed for this field.'
                type: string
            required:
            - source
            type: object
          status:
            description: status represents the current information of a snapshot. Consumers must verify binding between VolumeSnapshot and VolumeSnapshotContent objects is successful (by validating that both VolumeSnapshot and VolumeSnapshotContent point at each other) before using this object.
... skipping 2 lines ...
                description: 'boundVolumeSnapshotContentName is the name of the VolumeSnapshotContent object to which this VolumeSnapshot object intends to bind to. If not specified, it indicates that the VolumeSnapshot object has not been successfully bound to a VolumeSnapshotContent object yet. NOTE: To avoid possible security issues, consumers must verify binding between VolumeSnapshot and VolumeSnapshotContent objects is successful (by validating that both VolumeSnapshot and VolumeSnapshotContent point at each other) before using this object.'
                type: string
              creationTime:
                description: creationTime is the timestamp when the point-in-time snapshot is taken by the underlying storage system. In dynamic snapshot creation case, this field will be filled in by the snapshot controller with the "creation_time" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "creation_time" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it. If not specified, it may indicate that the creation time of the snapshot is unknown.
                format: date-time
                type: string
              error:
                description: error is the last observed error during snapshot creation, if any. This field could be helpful to upper level controllers(i.e., application controller) to decide whether they should continue on waiting for the snapshot to be created based on the type of error reported. The snapshot controller will keep retrying when an error occurrs during the snapshot creation. Upon success, this error field will be cleared.
                properties:
                  message:
                    description: 'message is a string detailing the encountered error during snapshot creation if specified. NOTE: message may be logged, and it should not contain sensitive information.'
                    type: string
                  time:
                    description: time is the timestamp when the error was encountered.
                    format: date-time
                    type: string
                type: object
              readyToUse:
                description: readyToUse indicates if the snapshot is ready to be used to restore a volume. In dynamic snapshot creation case, this field will be filled in by the snapshot controller with the "ready_to_use" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "ready_to_use" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it, otherwise, this field will be set to "True". If not specified, it means the readiness of a snapshot is unknown.
                type: boolean
              restoreSize:
                type: string
                description: restoreSize represents the minimum size of volume required to create a volume from this snapshot. In dynamic snapshot creation case, this field will be filled in by the snapshot controller with the "size_bytes" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "size_bytes" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it. When restoring a volume from this snapshot, the size of the volume MUST NOT be smaller than the restoreSize if it is specified, otherwise the restoration will fail. If not specified, it indicates that the size is unknown.
                pattern: ^(\+|-)?(([0-9]+(\.[0-9]*)?)|(\.[0-9]+))(([KMGTPE]i)|[numkMGTPE]|([eE](\+|-)?(([0-9]+(\.[0-9]*)?)|(\.[0-9]+))))?$
                x-kubernetes-int-or-string: true
            type: object
        required:
        - spec
        type: object
... skipping 60 lines ...
                    type: string
                  volumeSnapshotContentName:
                    description: volumeSnapshotContentName specifies the name of a pre-existing VolumeSnapshotContent object representing an existing volume snapshot. This field should be set if the snapshot already exists and only needs a representation in Kubernetes. This field is immutable.
                    type: string
                type: object
              volumeSnapshotClassName:
                description: 'VolumeSnapshotClassName is the name of the VolumeSnapshotClass requested by the VolumeSnapshot. VolumeSnapshotClassName may be left nil to indicate that the default SnapshotClass should be used. A given cluster may have multiple default Volume SnapshotClasses: one default per CSI Driver. If a VolumeSnapshot does not specify a SnapshotClass, VolumeSnapshotSource will be checked to figure out what the associated CSI Driver is, and the default VolumeSnapshotClass associated with that CSI Driver will be used. If more than one VolumeSnapshotClass exist for a given CSI Driver and more than one have been marked as default, CreateSnapshot will fail and generate an event. Empty string is not allowed for this field.'
                type: string
            required:
            - source
            type: object
          status:
            description: status represents the current information of a snapshot. Consumers must verify binding between VolumeSnapshot and VolumeSnapshotContent objects is successful (by validating that both VolumeSnapshot and VolumeSnapshotContent point at each other) before using this object.
... skipping 2 lines ...
                description: 'boundVolumeSnapshotContentName is the name of the VolumeSnapshotContent object to which this VolumeSnapshot object intends to bind to. If not specified, it indicates that the VolumeSnapshot object has not been successfully bound to a VolumeSnapshotContent object yet. NOTE: To avoid possible security issues, consumers must verify binding between VolumeSnapshot and VolumeSnapshotContent objects is successful (by validating that both VolumeSnapshot and VolumeSnapshotContent point at each other) before using this object.'
                type: string
              creationTime:
                description: creationTime is the timestamp when the point-in-time snapshot is taken by the underlying storage system. In dynamic snapshot creation case, this field will be filled in by the snapshot controller with the "creation_time" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "creation_time" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it. If not specified, it may indicate that the creation time of the snapshot is unknown.
                format: date-time
                type: string
              error:
                description: error is the last observed error during snapshot creation, if any. This field could be helpful to upper level controllers(i.e., application controller) to decide whether they should continue on waiting for the snapshot to be created based on the type of error reported. The snapshot controller will keep retrying when an error occurrs during the snapshot creation. Upon success, this error field will be cleared.
                properties:
                  message:
                    description: 'message is a string detailing the encountered error during snapshot creation if specified. NOTE: message may be logged, and it should not contain sensitive information.'
                    type: string
                  time:
                    description: time is the timestamp when the error was encountered.
                    format: date-time
                    type: string
                type: object
              readyToUse:
                description: readyToUse indicates if the snapshot is ready to be used to restore a volume. In dynamic snapshot creation case, this field will be filled in by the snapshot controller with the "ready_to_use" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "ready_to_use" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it, otherwise, this field will be set to "True". If not specified, it means the readiness of a snapshot is unknown.
                type: boolean
              restoreSize:
                type: string
                description: restoreSize represents the minimum size of volume required to create a volume from this snapshot. In dynamic snapshot creation case, this field will be filled in by the snapshot controller with the "size_bytes" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "size_bytes" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it. When restoring a volume from this snapshot, the size of the volume MUST NOT be smaller than the restoreSize if it is specified, otherwise the restoration will fail. If not specified, it indicates that the size is unknown.
                pattern: ^(\+|-)?(([0-9]+(\.[0-9]*)?)|(\.[0-9]+))(([KMGTPE]i)|[numkMGTPE]|([eE](\+|-)?(([0-9]+(\.[0-9]*)?)|(\.[0-9]+))))?$
                x-kubernetes-int-or-string: true
            type: object
        required:
        - spec
        type: object
... skipping 254 lines ...
            description: status represents the current information of a snapshot.
            properties:
              creationTime:
                description: creationTime is the timestamp when the point-in-time snapshot is taken by the underlying storage system. In dynamic snapshot creation case, this field will be filled in by the CSI snapshotter sidecar with the "creation_time" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "creation_time" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it. If not specified, it indicates the creation time is unknown. The format of this field is a Unix nanoseconds time encoded as an int64. On Unix, the command `date +%s%N` returns the current time in nanoseconds since 1970-01-01 00:00:00 UTC.
                format: int64
                type: integer
              error:
                description: error is the last observed error during snapshot creation, if any. Upon success after retry, this error field will be cleared.
                properties:
                  message:
                    description: 'message is a string detailing the encountered error during snapshot creation if specified. NOTE: message may be logged, and it should not contain sensitive information.'
                    type: string
                  time:
                    description: time is the timestamp when the error was encountered.
                    format: date-time
                    type: string
                type: object
              readyToUse:
                description: readyToUse indicates if a snapshot is ready to be used to restore a volume. In dynamic snapshot creation case, this field will be filled in by the CSI snapshotter sidecar with the "ready_to_use" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "ready_to_use" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it, otherwise, this field will be set to "True". If not specified, it means the readiness of a snapshot is unknown.
                type: boolean
              restoreSize:
                description: restoreSize represents the complete size of the snapshot in bytes. In dynamic snapshot creation case, this field will be filled in by the CSI snapshotter sidecar with the "size_bytes" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "size_bytes" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it. When restoring a volume from this snapshot, the size of the volume MUST NOT be smaller than the restoreSize if it is specified, otherwise the restoration will fail. If not specified, it indicates that the size is unknown.
                format: int64
                minimum: 0
                type: integer
              snapshotHandle:
                description: snapshotHandle is the CSI "snapshot_id" of a snapshot on the underlying storage system. If not specified, it indicates that dynamic snapshot creation has either failed or it is still in progress.
                type: string
            type: object
        required:
        - spec
        type: object
    served: true
... skipping 108 lines ...
            description: status represents the current information of a snapshot.
            properties:
              creationTime:
                description: creationTime is the timestamp when the point-in-time snapshot is taken by the underlying storage system. In dynamic snapshot creation case, this field will be filled in by the CSI snapshotter sidecar with the "creation_time" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "creation_time" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it. If not specified, it indicates the creation time is unknown. The format of this field is a Unix nanoseconds time encoded as an int64. On Unix, the command `date +%s%N` returns the current time in nanoseconds since 1970-01-01 00:00:00 UTC.
                format: int64
                type: integer
              error:
                description: error is the last observed error during snapshot creation, if any. Upon success after retry, this error field will be cleared.
                properties:
                  message:
                    description: 'message is a string detailing the encountered error during snapshot creation if specified. NOTE: message may be logged, and it should not contain sensitive information.'
                    type: string
                  time:
                    description: time is the timestamp when the error was encountered.
                    format: date-time
                    type: string
                type: object
              readyToUse:
                description: readyToUse indicates if a snapshot is ready to be used to restore a volume. In dynamic snapshot creation case, this field will be filled in by the CSI snapshotter sidecar with the "ready_to_use" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "ready_to_use" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it, otherwise, this field will be set to "True". If not specified, it means the readiness of a snapshot is unknown.
                type: boolean
              restoreSize:
                description: restoreSize represents the complete size of the snapshot in bytes. In dynamic snapshot creation case, this field will be filled in by the CSI snapshotter sidecar with the "size_bytes" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "size_bytes" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it. When restoring a volume from this snapshot, the size of the volume MUST NOT be smaller than the restoreSize if it is specified, otherwise the restoration will fail. If not specified, it indicates that the size is unknown.
                format: int64
                minimum: 0
                type: integer
              snapshotHandle:
                description: snapshotHandle is the CSI "snapshot_id" of a snapshot on the underlying storage system. If not specified, it indicates that dynamic snapshot creation has either failed or it is still in progress.
                type: string
            type: object
        required:
        - spec
        type: object
    served: true
... skipping 861 lines ...
          image: "mcr.microsoft.com/oss/kubernetes-csi/csi-resizer:v1.4.0"
          args:
            - "-csi-address=$(ADDRESS)"
            - "-v=2"
            - "-leader-election"
            - "--leader-election-namespace=kube-system"
            - '-handle-volume-inuse-error=false'
            - '-feature-gates=RecoverVolumeExpansionFailure=true'
            - "-timeout=240s"
          env:
            - name: ADDRESS
              value: /csi/csi.sock
          volumeMounts:
... skipping 538 lines ...
Apr 13 11:24:12.972: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.compx4bb] to have phase Bound
Apr 13 11:24:13.082: INFO: PersistentVolumeClaim test.csi.azure.compx4bb found but phase is Pending instead of Bound.
Apr 13 11:24:15.192: INFO: PersistentVolumeClaim test.csi.azure.compx4bb found but phase is Pending instead of Bound.
Apr 13 11:24:17.302: INFO: PersistentVolumeClaim test.csi.azure.compx4bb found and phase=Bound (4.329460927s)
[1mSTEP[0m: Creating pod exec-volume-test-dynamicpv-x2p4
[1mSTEP[0m: Creating a pod to test exec-volume-test
Apr 13 11:24:17.636: INFO: Waiting up to 5m0s for pod "exec-volume-test-dynamicpv-x2p4" in namespace "volume-5230" to be "Succeeded or Failed"
Apr 13 11:24:17.746: INFO: Pod "exec-volume-test-dynamicpv-x2p4": Phase="Pending", Reason="", readiness=false. Elapsed: 109.691661ms
Apr 13 11:24:19.857: INFO: Pod "exec-volume-test-dynamicpv-x2p4": Phase="Pending", Reason="", readiness=false. Elapsed: 2.220589087s
Apr 13 11:24:21.967: INFO: Pod "exec-volume-test-dynamicpv-x2p4": Phase="Pending", Reason="", readiness=false. Elapsed: 4.331073831s
Apr 13 11:24:24.078: INFO: Pod "exec-volume-test-dynamicpv-x2p4": Phase="Pending", Reason="", readiness=false. Elapsed: 6.44188572s
Apr 13 11:24:26.190: INFO: Pod "exec-volume-test-dynamicpv-x2p4": Phase="Pending", Reason="", readiness=false. Elapsed: 8.553602786s
Apr 13 11:24:28.300: INFO: Pod "exec-volume-test-dynamicpv-x2p4": Phase="Pending", Reason="", readiness=false. Elapsed: 10.66439479s
... skipping 8 lines ...
Apr 13 11:24:47.302: INFO: Pod "exec-volume-test-dynamicpv-x2p4": Phase="Pending", Reason="", readiness=false. Elapsed: 29.665551281s
Apr 13 11:24:49.412: INFO: Pod "exec-volume-test-dynamicpv-x2p4": Phase="Pending", Reason="", readiness=false. Elapsed: 31.775844406s
Apr 13 11:24:51.523: INFO: Pod "exec-volume-test-dynamicpv-x2p4": Phase="Pending", Reason="", readiness=false. Elapsed: 33.886678764s
Apr 13 11:24:53.633: INFO: Pod "exec-volume-test-dynamicpv-x2p4": Phase="Pending", Reason="", readiness=false. Elapsed: 35.996669371s
Apr 13 11:24:55.744: INFO: Pod "exec-volume-test-dynamicpv-x2p4": Phase="Succeeded", Reason="", readiness=false. Elapsed: 38.107484471s
[1mSTEP[0m: Saw pod success
Apr 13 11:24:55.744: INFO: Pod "exec-volume-test-dynamicpv-x2p4" satisfied condition "Succeeded or Failed"
Apr 13 11:24:55.861: INFO: Trying to get logs from node k8s-agentpool1-19736391-vmss000001 pod exec-volume-test-dynamicpv-x2p4 container exec-container-dynamicpv-x2p4: <nil>
[1mSTEP[0m: delete the pod
Apr 13 11:24:56.123: INFO: Waiting for pod exec-volume-test-dynamicpv-x2p4 to disappear
Apr 13 11:24:56.232: INFO: Pod exec-volume-test-dynamicpv-x2p4 no longer exists
[1mSTEP[0m: Deleting pod exec-volume-test-dynamicpv-x2p4
Apr 13 11:24:56.232: INFO: Deleting pod "exec-volume-test-dynamicpv-x2p4" in namespace "volume-5230"
... skipping 27 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (xfs)][Slow] volumes
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should allow exec of files on the volume
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:196[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (xfs)][Slow] volumes should allow exec of files on the volume","total":27,"completed":1,"skipped":90,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[0mExternal Storage [Driver: test.csi.azure.com][0m [90m[Testpattern: Ephemeral Snapshot (delete policy)] snapshottable[Feature:VolumeSnapshotDataSource][0m [0mvolume snapshot controller[0m [90m[0m 
  [1mshould check snapshot fields, check restore correctly works, check deletion (ephemeral)[0m
  [37m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:174[0m
... skipping 12 lines ...
[It] should check snapshot fields, check restore correctly works, check deletion (ephemeral)
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:174
Apr 13 11:24:12.287: INFO: Creating resource for dynamic PV
Apr 13 11:24:12.287: INFO: Using claimSize:5Gi, test suite supported size:{ 1Mi}, driver(test.csi.azure.com) supported size:{ 1Mi} 
[1mSTEP[0m: creating a StorageClass snapshotting-4615-e2e-scnjhcj
[1mSTEP[0m: [init] starting a pod to use the claim
Apr 13 11:24:12.507: INFO: Waiting up to 15m0s for pod "pvc-snapshottable-tester-946m2" in namespace "snapshotting-4615" to be "Succeeded or Failed"
Apr 13 11:24:12.615: INFO: Pod "pvc-snapshottable-tester-946m2": Phase="Pending", Reason="", readiness=false. Elapsed: 108.349801ms
Apr 13 11:24:14.724: INFO: Pod "pvc-snapshottable-tester-946m2": Phase="Pending", Reason="", readiness=false. Elapsed: 2.217593807s
Apr 13 11:24:16.834: INFO: Pod "pvc-snapshottable-tester-946m2": Phase="Pending", Reason="", readiness=false. Elapsed: 4.327304559s
Apr 13 11:24:18.945: INFO: Pod "pvc-snapshottable-tester-946m2": Phase="Pending", Reason="", readiness=false. Elapsed: 6.437924222s
Apr 13 11:24:21.054: INFO: Pod "pvc-snapshottable-tester-946m2": Phase="Pending", Reason="", readiness=false. Elapsed: 8.547572029s
Apr 13 11:24:23.165: INFO: Pod "pvc-snapshottable-tester-946m2": Phase="Pending", Reason="", readiness=false. Elapsed: 10.657887785s
... skipping 3 lines ...
Apr 13 11:24:31.605: INFO: Pod "pvc-snapshottable-tester-946m2": Phase="Pending", Reason="", readiness=false. Elapsed: 19.098471227s
Apr 13 11:24:33.716: INFO: Pod "pvc-snapshottable-tester-946m2": Phase="Pending", Reason="", readiness=false. Elapsed: 21.209104536s
Apr 13 11:24:35.839: INFO: Pod "pvc-snapshottable-tester-946m2": Phase="Pending", Reason="", readiness=false. Elapsed: 23.332027682s
Apr 13 11:24:37.948: INFO: Pod "pvc-snapshottable-tester-946m2": Phase="Pending", Reason="", readiness=false. Elapsed: 25.441386352s
Apr 13 11:24:40.059: INFO: Pod "pvc-snapshottable-tester-946m2": Phase="Succeeded", Reason="", readiness=false. Elapsed: 27.551893861s
[1mSTEP[0m: Saw pod success
Apr 13 11:24:40.059: INFO: Pod "pvc-snapshottable-tester-946m2" satisfied condition "Succeeded or Failed"
[1mSTEP[0m: [init] checking the claim
[1mSTEP[0m: creating a SnapshotClass
[1mSTEP[0m: creating a dynamic VolumeSnapshot
Apr 13 11:24:40.500: INFO: Waiting up to 5m0s for VolumeSnapshot snapshot-ntkd8 to become ready
Apr 13 11:24:40.609: INFO: VolumeSnapshot snapshot-ntkd8 found but is not ready.
Apr 13 11:24:42.719: INFO: VolumeSnapshot snapshot-ntkd8 found but is not ready.
... skipping 49 lines ...
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:110[0m
      
      [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:173[0m
        should check snapshot fields, check restore correctly works, check deletion (ephemeral)
        [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:174[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Ephemeral Snapshot (delete policy)] snapshottable[Feature:VolumeSnapshotDataSource] volume snapshot controller  should check snapshot fields, check restore correctly works, check deletion (ephemeral)","total":37,"completed":1,"skipped":46,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Apr 13 11:26:18.310: INFO: Driver "test.csi.azure.com" does not support volume type "PreprovisionedPV" - skipping
... skipping 24 lines ...

[36m[1mS [SKIPPING] in Spec Setup (BeforeEach) [0.001 seconds][0m
External Storage [Driver: test.csi.azure.com]
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Inline-volume (default fs)] subPath
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    [36m[1mshould fail if non-existent subpath is outside the volume [Slow][LinuxOnly] [BeforeEach][0m
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:267[0m

    [36mDriver "test.csi.azure.com" does not support volume type "InlineVolume" - skipping[0m

    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:262
[90m------------------------------[0m
... skipping 169 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (default fs)] provisioning
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should provision storage with pvc data source
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/provisioning.go:239[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with pvc data source","total":38,"completed":1,"skipped":55,"failed":0}
[BeforeEach] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Apr 13 11:27:01.026: INFO: Driver "test.csi.azure.com" does not support volume type "PreprovisionedPV" - skipping
[AfterEach] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 130 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (xfs)][Slow] volumes
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should store data
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:159[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (xfs)][Slow] volumes should store data","total":32,"completed":1,"skipped":0,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Apr 13 11:27:08.383: INFO: Distro debian doesn't support ntfs -- skipping
... skipping 151 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow]
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/multivolume.go:321[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]","total":36,"completed":1,"skipped":32,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Apr 13 11:28:00.783: INFO: Driver "test.csi.azure.com" does not support volume type "PreprovisionedPV" - skipping
... skipping 3 lines ...

[36m[1mS [SKIPPING] in Spec Setup (BeforeEach) [0.001 seconds][0m
External Storage [Driver: test.csi.azure.com]
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Pre-provisioned PV (default fs)] subPath
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    [36m[1mshould fail if non-existent subpath is outside the volume [Slow][LinuxOnly] [BeforeEach][0m
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:267[0m

    [36mDriver "test.csi.azure.com" does not support volume type "PreprovisionedPV" - skipping[0m

    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:262
[90m------------------------------[0m
... skipping 18 lines ...

    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:262
[90m------------------------------[0m
[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[0mExternal Storage [Driver: test.csi.azure.com][0m [90m[Testpattern: Dynamic PV (default fs)] subPath[0m 
  [1mshould fail if subpath with backstepping is outside the volume [Slow][LinuxOnly][0m
  [37m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:278[0m

[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
[1mSTEP[0m: Creating a kubernetes client
Apr 13 11:26:08.802: INFO: >>> kubeConfig: /root/tmp1956769959/kubeconfig/kubeconfig.westeurope.json
[1mSTEP[0m: Building a namespace api object, basename provisioning
[1mSTEP[0m: Waiting for a default service account to be provisioned in namespace
[It] should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:278
Apr 13 11:26:09.350: INFO: Creating resource for dynamic PV
Apr 13 11:26:09.350: INFO: Using claimSize:5Gi, test suite supported size:{ 1Mi}, driver(test.csi.azure.com) supported size:{ 1Mi} 
[1mSTEP[0m: creating a StorageClass provisioning-3663-e2e-scfl8tr
[1mSTEP[0m: creating a claim
Apr 13 11:26:09.461: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
Apr 13 11:26:09.574: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.compkx2q] to have phase Bound
Apr 13 11:26:09.683: INFO: PersistentVolumeClaim test.csi.azure.compkx2q found but phase is Pending instead of Bound.
Apr 13 11:26:11.793: INFO: PersistentVolumeClaim test.csi.azure.compkx2q found but phase is Pending instead of Bound.
Apr 13 11:26:13.903: INFO: PersistentVolumeClaim test.csi.azure.compkx2q found and phase=Bound (4.32922804s)
[1mSTEP[0m: Creating pod pod-subpath-test-dynamicpv-g5dh
[1mSTEP[0m: Checking for subpath error in container status
Apr 13 11:27:06.463: INFO: Deleting pod "pod-subpath-test-dynamicpv-g5dh" in namespace "provisioning-3663"
Apr 13 11:27:06.575: INFO: Wait up to 5m0s for pod "pod-subpath-test-dynamicpv-g5dh" to be fully deleted
[1mSTEP[0m: Deleting pod
Apr 13 11:27:08.797: INFO: Deleting pod "pod-subpath-test-dynamicpv-g5dh" in namespace "provisioning-3663"
[1mSTEP[0m: Deleting pvc
Apr 13 11:27:08.906: INFO: Deleting PersistentVolumeClaim "test.csi.azure.compkx2q"
... skipping 22 lines ...

[32m• [SLOW TEST:132.455 seconds][0m
External Storage [Driver: test.csi.azure.com]
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (default fs)] subPath
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:278[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]","total":27,"completed":2,"skipped":218,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Apr 13 11:28:21.333: INFO: Distro debian doesn't support ntfs -- skipping
... skipping 37 lines ...
Apr 13 11:27:01.854: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.com68b2m] to have phase Bound
Apr 13 11:27:01.963: INFO: PersistentVolumeClaim test.csi.azure.com68b2m found but phase is Pending instead of Bound.
Apr 13 11:27:04.072: INFO: PersistentVolumeClaim test.csi.azure.com68b2m found but phase is Pending instead of Bound.
Apr 13 11:27:06.184: INFO: PersistentVolumeClaim test.csi.azure.com68b2m found and phase=Bound (4.329217371s)
[1mSTEP[0m: Creating pod pod-subpath-test-dynamicpv-5hrr
[1mSTEP[0m: Creating a pod to test subpath
Apr 13 11:27:06.511: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-5hrr" in namespace "provisioning-6474" to be "Succeeded or Failed"
Apr 13 11:27:06.619: INFO: Pod "pod-subpath-test-dynamicpv-5hrr": Phase="Pending", Reason="", readiness=false. Elapsed: 108.57363ms
Apr 13 11:27:08.730: INFO: Pod "pod-subpath-test-dynamicpv-5hrr": Phase="Pending", Reason="", readiness=false. Elapsed: 2.218804163s
Apr 13 11:27:10.839: INFO: Pod "pod-subpath-test-dynamicpv-5hrr": Phase="Pending", Reason="", readiness=false. Elapsed: 4.328268851s
Apr 13 11:27:12.949: INFO: Pod "pod-subpath-test-dynamicpv-5hrr": Phase="Pending", Reason="", readiness=false. Elapsed: 6.438500788s
Apr 13 11:27:15.059: INFO: Pod "pod-subpath-test-dynamicpv-5hrr": Phase="Pending", Reason="", readiness=false. Elapsed: 8.547808405s
Apr 13 11:27:17.168: INFO: Pod "pod-subpath-test-dynamicpv-5hrr": Phase="Pending", Reason="", readiness=false. Elapsed: 10.657243593s
... skipping 6 lines ...
Apr 13 11:27:31.934: INFO: Pod "pod-subpath-test-dynamicpv-5hrr": Phase="Pending", Reason="", readiness=false. Elapsed: 25.423417674s
Apr 13 11:27:34.043: INFO: Pod "pod-subpath-test-dynamicpv-5hrr": Phase="Pending", Reason="", readiness=false. Elapsed: 27.532665625s
Apr 13 11:27:36.152: INFO: Pod "pod-subpath-test-dynamicpv-5hrr": Phase="Pending", Reason="", readiness=false. Elapsed: 29.641739626s
Apr 13 11:27:38.262: INFO: Pod "pod-subpath-test-dynamicpv-5hrr": Phase="Pending", Reason="", readiness=false. Elapsed: 31.750841538s
Apr 13 11:27:40.371: INFO: Pod "pod-subpath-test-dynamicpv-5hrr": Phase="Succeeded", Reason="", readiness=false. Elapsed: 33.860307442s
[1mSTEP[0m: Saw pod success
Apr 13 11:27:40.371: INFO: Pod "pod-subpath-test-dynamicpv-5hrr" satisfied condition "Succeeded or Failed"
Apr 13 11:27:40.480: INFO: Trying to get logs from node k8s-agentpool1-19736391-vmss000002 pod pod-subpath-test-dynamicpv-5hrr container test-container-volume-dynamicpv-5hrr: <nil>
[1mSTEP[0m: delete the pod
Apr 13 11:27:40.738: INFO: Waiting for pod pod-subpath-test-dynamicpv-5hrr to disappear
Apr 13 11:27:40.846: INFO: Pod pod-subpath-test-dynamicpv-5hrr no longer exists
[1mSTEP[0m: Deleting pod pod-subpath-test-dynamicpv-5hrr
Apr 13 11:27:40.846: INFO: Deleting pod "pod-subpath-test-dynamicpv-5hrr" in namespace "provisioning-6474"
... skipping 23 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (default fs)] subPath
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should support existing directory
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:205[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath should support existing directory","total":38,"completed":2,"skipped":111,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[0mExternal Storage [Driver: test.csi.azure.com][0m [90m[Testpattern: Dynamic PV (default fs)] subPath[0m 
  [1mshould support restarting containers using file as subpath [Slow][LinuxOnly][0m
  [37m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:331[0m
... skipping 74 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (default fs)] subPath
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should support restarting containers using file as subpath [Slow][LinuxOnly]
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:331[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath should support restarting containers using file as subpath [Slow][LinuxOnly]","total":38,"completed":1,"skipped":221,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[0mExternal Storage [Driver: test.csi.azure.com][0m [90m[Testpattern: Dynamic PV (ext4)] volumes[0m 
  [1mshould store data[0m
  [37m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:159[0m
... skipping 129 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (ext4)] volumes
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should store data
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:159[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (ext4)] volumes should store data","total":23,"completed":1,"skipped":231,"failed":0}

[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] volumeIO
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Apr 13 11:28:42.402: INFO: Distro debian doesn't support ntfs -- skipping
... skipping 125 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (block volmode)] volumes
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should store data
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:159[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (block volmode)] volumes should store data","total":37,"completed":2,"skipped":127,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Apr 13 11:28:56.503: INFO: Distro debian doesn't support ntfs -- skipping
... skipping 108 lines ...

[36m[1mS [SKIPPING] in Spec Setup (BeforeEach) [0.001 seconds][0m
External Storage [Driver: test.csi.azure.com]
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Inline-volume (default fs)] subPath
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    [36m[1mshould fail if subpath directory is outside the volume [Slow][LinuxOnly] [BeforeEach][0m
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:240[0m

    [36mDriver "test.csi.azure.com" does not support volume type "InlineVolume" - skipping[0m

    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:262
[90m------------------------------[0m
... skipping 114 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow]
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/multivolume.go:321[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]","total":32,"completed":2,"skipped":62,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[0mExternal Storage [Driver: test.csi.azure.com][0m [90m[Testpattern: Ephemeral Snapshot (retain policy)] snapshottable[Feature:VolumeSnapshotDataSource][0m [0mvolume snapshot controller[0m [90m[0m 
  [1mshould check snapshot fields, check restore correctly works, check deletion (ephemeral)[0m
  [37m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:174[0m
... skipping 9 lines ...
[It] should check snapshot fields, check restore correctly works, check deletion (ephemeral)
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:174
Apr 13 11:28:42.982: INFO: Creating resource for dynamic PV
Apr 13 11:28:42.982: INFO: Using claimSize:5Gi, test suite supported size:{ 1Mi}, driver(test.csi.azure.com) supported size:{ 1Mi} 
[1mSTEP[0m: creating a StorageClass snapshotting-7602-e2e-sc6k49s
[1mSTEP[0m: [init] starting a pod to use the claim
Apr 13 11:28:43.205: INFO: Waiting up to 15m0s for pod "pvc-snapshottable-tester-bq2wl" in namespace "snapshotting-7602" to be "Succeeded or Failed"
Apr 13 11:28:43.315: INFO: Pod "pvc-snapshottable-tester-bq2wl": Phase="Pending", Reason="", readiness=false. Elapsed: 109.345436ms
Apr 13 11:28:45.426: INFO: Pod "pvc-snapshottable-tester-bq2wl": Phase="Pending", Reason="", readiness=false. Elapsed: 2.220597089s
Apr 13 11:28:47.536: INFO: Pod "pvc-snapshottable-tester-bq2wl": Phase="Pending", Reason="", readiness=false. Elapsed: 4.330255014s
Apr 13 11:28:49.645: INFO: Pod "pvc-snapshottable-tester-bq2wl": Phase="Pending", Reason="", readiness=false. Elapsed: 6.439565741s
Apr 13 11:28:51.755: INFO: Pod "pvc-snapshottable-tester-bq2wl": Phase="Pending", Reason="", readiness=false. Elapsed: 8.550114857s
Apr 13 11:28:53.867: INFO: Pod "pvc-snapshottable-tester-bq2wl": Phase="Pending", Reason="", readiness=false. Elapsed: 10.661990952s
... skipping 3 lines ...
Apr 13 11:29:02.308: INFO: Pod "pvc-snapshottable-tester-bq2wl": Phase="Pending", Reason="", readiness=false. Elapsed: 19.102707606s
Apr 13 11:29:04.419: INFO: Pod "pvc-snapshottable-tester-bq2wl": Phase="Pending", Reason="", readiness=false. Elapsed: 21.213281318s
Apr 13 11:29:06.528: INFO: Pod "pvc-snapshottable-tester-bq2wl": Phase="Pending", Reason="", readiness=false. Elapsed: 23.322818545s
Apr 13 11:29:08.638: INFO: Pod "pvc-snapshottable-tester-bq2wl": Phase="Pending", Reason="", readiness=false. Elapsed: 25.432654661s
Apr 13 11:29:10.747: INFO: Pod "pvc-snapshottable-tester-bq2wl": Phase="Succeeded", Reason="", readiness=false. Elapsed: 27.542008133s
[1mSTEP[0m: Saw pod success
Apr 13 11:29:10.747: INFO: Pod "pvc-snapshottable-tester-bq2wl" satisfied condition "Succeeded or Failed"
[1mSTEP[0m: [init] checking the claim
[1mSTEP[0m: creating a SnapshotClass
[1mSTEP[0m: creating a dynamic VolumeSnapshot
Apr 13 11:29:11.203: INFO: Waiting up to 5m0s for VolumeSnapshot snapshot-4jxgs to become ready
Apr 13 11:29:11.311: INFO: VolumeSnapshot snapshot-4jxgs found but is not ready.
Apr 13 11:29:13.422: INFO: VolumeSnapshot snapshot-4jxgs found but is not ready.
... skipping 40 lines ...
Apr 13 11:30:05.405: INFO: volumesnapshotcontents snapcontent-051985a4-340d-4c66-8b8b-ab0819d49fa9 has been found and is not deleted
Apr 13 11:30:06.516: INFO: volumesnapshotcontents snapcontent-051985a4-340d-4c66-8b8b-ab0819d49fa9 has been found and is not deleted
Apr 13 11:30:07.626: INFO: volumesnapshotcontents snapcontent-051985a4-340d-4c66-8b8b-ab0819d49fa9 has been found and is not deleted
Apr 13 11:30:08.737: INFO: volumesnapshotcontents snapcontent-051985a4-340d-4c66-8b8b-ab0819d49fa9 has been found and is not deleted
Apr 13 11:30:09.847: INFO: volumesnapshotcontents snapcontent-051985a4-340d-4c66-8b8b-ab0819d49fa9 has been found and is not deleted
Apr 13 11:30:10.958: INFO: volumesnapshotcontents snapcontent-051985a4-340d-4c66-8b8b-ab0819d49fa9 has been found and is not deleted
Apr 13 11:30:11.959: INFO: WaitUntil failed after reaching the timeout 30s
[AfterEach] volume snapshot controller
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:169
Apr 13 11:30:12.094: INFO: Pod restored-pvc-tester-9kb9r has the following logs: 
Apr 13 11:30:12.094: INFO: Deleting pod "restored-pvc-tester-9kb9r" in namespace "snapshotting-7602"
Apr 13 11:30:12.207: INFO: Wait up to 5m0s for pod "restored-pvc-tester-9kb9r" to be fully deleted
Apr 13 11:30:44.426: INFO: deleting snapshot "snapshotting-7602"/"snapshot-4jxgs"
... skipping 26 lines ...
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:110[0m
      
      [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:173[0m
        should check snapshot fields, check restore correctly works, check deletion (ephemeral)
        [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:174[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Ephemeral Snapshot (retain policy)] snapshottable[Feature:VolumeSnapshotDataSource] volume snapshot controller  should check snapshot fields, check restore correctly works, check deletion (ephemeral)","total":23,"completed":2,"skipped":265,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[0mExternal Storage [Driver: test.csi.azure.com][0m [90m[Testpattern: Dynamic PV (default fs)] subPath[0m 
  [1mshould support existing directories when readOnly specified in the volumeSource[0m
  [37m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:395[0m
... skipping 16 lines ...
Apr 13 11:28:22.142: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.comn6wtj] to have phase Bound
Apr 13 11:28:22.252: INFO: PersistentVolumeClaim test.csi.azure.comn6wtj found but phase is Pending instead of Bound.
Apr 13 11:28:24.362: INFO: PersistentVolumeClaim test.csi.azure.comn6wtj found but phase is Pending instead of Bound.
Apr 13 11:28:26.473: INFO: PersistentVolumeClaim test.csi.azure.comn6wtj found and phase=Bound (4.33095656s)
[1mSTEP[0m: Creating pod pod-subpath-test-dynamicpv-5g7p
[1mSTEP[0m: Creating a pod to test subpath
Apr 13 11:28:26.806: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-5g7p" in namespace "provisioning-7744" to be "Succeeded or Failed"
Apr 13 11:28:26.917: INFO: Pod "pod-subpath-test-dynamicpv-5g7p": Phase="Pending", Reason="", readiness=false. Elapsed: 110.10301ms
Apr 13 11:28:29.027: INFO: Pod "pod-subpath-test-dynamicpv-5g7p": Phase="Pending", Reason="", readiness=false. Elapsed: 2.221005147s
Apr 13 11:28:31.139: INFO: Pod "pod-subpath-test-dynamicpv-5g7p": Phase="Pending", Reason="", readiness=false. Elapsed: 4.332351623s
Apr 13 11:28:33.251: INFO: Pod "pod-subpath-test-dynamicpv-5g7p": Phase="Pending", Reason="", readiness=false. Elapsed: 6.444513817s
Apr 13 11:28:35.363: INFO: Pod "pod-subpath-test-dynamicpv-5g7p": Phase="Pending", Reason="", readiness=false. Elapsed: 8.556973251s
Apr 13 11:28:37.475: INFO: Pod "pod-subpath-test-dynamicpv-5g7p": Phase="Pending", Reason="", readiness=false. Elapsed: 10.668409101s
... skipping 4 lines ...
Apr 13 11:28:48.031: INFO: Pod "pod-subpath-test-dynamicpv-5g7p": Phase="Pending", Reason="", readiness=false. Elapsed: 21.224817026s
Apr 13 11:28:50.143: INFO: Pod "pod-subpath-test-dynamicpv-5g7p": Phase="Pending", Reason="", readiness=false. Elapsed: 23.336642183s
Apr 13 11:28:52.255: INFO: Pod "pod-subpath-test-dynamicpv-5g7p": Phase="Pending", Reason="", readiness=false. Elapsed: 25.448698993s
Apr 13 11:28:54.368: INFO: Pod "pod-subpath-test-dynamicpv-5g7p": Phase="Pending", Reason="", readiness=false. Elapsed: 27.561963747s
Apr 13 11:28:56.480: INFO: Pod "pod-subpath-test-dynamicpv-5g7p": Phase="Succeeded", Reason="", readiness=false. Elapsed: 29.673212376s
[1mSTEP[0m: Saw pod success
Apr 13 11:28:56.480: INFO: Pod "pod-subpath-test-dynamicpv-5g7p" satisfied condition "Succeeded or Failed"
Apr 13 11:28:56.589: INFO: Trying to get logs from node k8s-agentpool1-19736391-vmss000002 pod pod-subpath-test-dynamicpv-5g7p container test-container-subpath-dynamicpv-5g7p: <nil>
[1mSTEP[0m: delete the pod
Apr 13 11:28:56.824: INFO: Waiting for pod pod-subpath-test-dynamicpv-5g7p to disappear
Apr 13 11:28:56.934: INFO: Pod pod-subpath-test-dynamicpv-5g7p no longer exists
[1mSTEP[0m: Deleting pod pod-subpath-test-dynamicpv-5g7p
Apr 13 11:28:56.934: INFO: Deleting pod "pod-subpath-test-dynamicpv-5g7p" in namespace "provisioning-7744"
[1mSTEP[0m: Creating pod pod-subpath-test-dynamicpv-5g7p
[1mSTEP[0m: Creating a pod to test subpath
Apr 13 11:28:57.157: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-5g7p" in namespace "provisioning-7744" to be "Succeeded or Failed"
Apr 13 11:28:57.267: INFO: Pod "pod-subpath-test-dynamicpv-5g7p": Phase="Pending", Reason="", readiness=false. Elapsed: 110.14759ms
Apr 13 11:28:59.378: INFO: Pod "pod-subpath-test-dynamicpv-5g7p": Phase="Pending", Reason="", readiness=false. Elapsed: 2.220774263s
Apr 13 11:29:01.489: INFO: Pod "pod-subpath-test-dynamicpv-5g7p": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.331458797s
[1mSTEP[0m: Saw pod success
Apr 13 11:29:01.489: INFO: Pod "pod-subpath-test-dynamicpv-5g7p" satisfied condition "Succeeded or Failed"
Apr 13 11:29:01.599: INFO: Trying to get logs from node k8s-agentpool1-19736391-vmss000002 pod pod-subpath-test-dynamicpv-5g7p container test-container-subpath-dynamicpv-5g7p: <nil>
[1mSTEP[0m: delete the pod
Apr 13 11:29:01.832: INFO: Waiting for pod pod-subpath-test-dynamicpv-5g7p to disappear
Apr 13 11:29:01.942: INFO: Pod pod-subpath-test-dynamicpv-5g7p no longer exists
[1mSTEP[0m: Deleting pod pod-subpath-test-dynamicpv-5g7p
Apr 13 11:29:01.942: INFO: Deleting pod "pod-subpath-test-dynamicpv-5g7p" in namespace "provisioning-7744"
... skipping 41 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (default fs)] subPath
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should support existing directories when readOnly specified in the volumeSource
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:395[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath should support existing directories when readOnly specified in the volumeSource","total":27,"completed":3,"skipped":318,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: Inline-volume (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Apr 13 11:31:15.826: INFO: Driver "test.csi.azure.com" does not support volume type "InlineVolume" - skipping
... skipping 102 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (ext4)] multiVolume [Slow]
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should concurrently access the single read-only volume from pods on the same node
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/multivolume.go:421[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node","total":38,"completed":3,"skipped":149,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Apr 13 11:32:53.133: INFO: Driver "test.csi.azure.com" does not support volume type "PreprovisionedPV" - skipping
... skipping 210 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (ext4)] multiVolume [Slow]
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should access to two volumes with the same volume mode and retain data across pod recreation on different node
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/multivolume.go:166[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node","total":36,"completed":2,"skipped":55,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[0mExternal Storage [Driver: test.csi.azure.com][0m [90m[Testpattern: Dynamic PV (ext4)] multiVolume [Slow][0m 
  [1mshould concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS][0m
  [37m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/multivolume.go:321[0m
... skipping 120 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (ext4)] multiVolume [Slow]
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/multivolume.go:321[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]","total":38,"completed":2,"skipped":227,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[0mExternal Storage [Driver: test.csi.azure.com][0m [90m[Testpattern: Dynamic PV (filesystem volmode)] volumeMode[0m 
  [1mshould fail to use a volume in a pod with mismatched mode [Slow][0m
  [37m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:297[0m

[BeforeEach] [Testpattern: Dynamic PV (filesystem volmode)] volumeMode
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (filesystem volmode)] volumeMode
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
[1mSTEP[0m: Creating a kubernetes client
Apr 13 11:30:26.075: INFO: >>> kubeConfig: /root/tmp1956769959/kubeconfig/kubeconfig.westeurope.json
[1mSTEP[0m: Building a namespace api object, basename volumemode
[1mSTEP[0m: Waiting for a default service account to be provisioned in namespace
[It] should fail to use a volume in a pod with mismatched mode [Slow]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:297
Apr 13 11:30:26.621: INFO: Creating resource for dynamic PV
Apr 13 11:30:26.621: INFO: Using claimSize:5Gi, test suite supported size:{ 1Mi}, driver(test.csi.azure.com) supported size:{ 1Mi} 
[1mSTEP[0m: creating a StorageClass volumemode-5569-e2e-scvl928
[1mSTEP[0m: creating a claim
Apr 13 11:30:26.847: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.comvwr5j] to have phase Bound
Apr 13 11:30:26.955: INFO: PersistentVolumeClaim test.csi.azure.comvwr5j found but phase is Pending instead of Bound.
Apr 13 11:30:29.065: INFO: PersistentVolumeClaim test.csi.azure.comvwr5j found but phase is Pending instead of Bound.
Apr 13 11:30:31.179: INFO: PersistentVolumeClaim test.csi.azure.comvwr5j found and phase=Bound (4.332374003s)
[1mSTEP[0m: Creating pod
[1mSTEP[0m: Waiting for the pod to fail
Apr 13 11:30:31.725: INFO: Deleting pod "pod-e503f160-4d6c-4cb4-b87f-06dc3267d345" in namespace "volumemode-5569"
Apr 13 11:30:31.837: INFO: Wait up to 5m0s for pod "pod-e503f160-4d6c-4cb4-b87f-06dc3267d345" to be fully deleted
[1mSTEP[0m: Deleting pvc
Apr 13 11:30:34.056: INFO: Deleting PersistentVolumeClaim "test.csi.azure.comvwr5j"
Apr 13 11:30:34.168: INFO: Waiting up to 5m0s for PersistentVolume pvc-f2db8801-4c28-43e1-b653-c2b1c8f5830b to get deleted
Apr 13 11:30:34.278: INFO: PersistentVolume pvc-f2db8801-4c28-43e1-b653-c2b1c8f5830b found and phase=Released (109.857285ms)
... skipping 57 lines ...

[32m• [SLOW TEST:269.431 seconds][0m
External Storage [Driver: test.csi.azure.com]
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (filesystem volmode)] volumeMode
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should fail to use a volume in a pod with mismatched mode [Slow]
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:297[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (filesystem volmode)] volumeMode should fail to use a volume in a pod with mismatched mode [Slow]","total":32,"completed":3,"skipped":110,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[0mExternal Storage [Driver: test.csi.azure.com][0m [90m[Testpattern: Dynamic PV (block volmode)] multiVolume [Slow][0m 
  [1mshould access to two volumes with different volume mode and retain data across pod recreation on the same node[0m
  [37m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/multivolume.go:207[0m
... skipping 205 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow]
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should access to two volumes with different volume mode and retain data across pod recreation on the same node
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/multivolume.go:207[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node","total":37,"completed":3,"skipped":299,"failed":0}

[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Apr 13 11:35:32.266: INFO: Driver "test.csi.azure.com" does not support volume type "PreprovisionedPV" - skipping
... skipping 103 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (default fs)] subPath
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should support restarting containers using directory as subpath [Slow]
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:320[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath should support restarting containers using directory as subpath [Slow]","total":27,"completed":4,"skipped":345,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[0mExternal Storage [Driver: test.csi.azure.com][0m [90m[Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow][0m 
  [1mshould access to two volumes with different volume mode and retain data across pod recreation on different node[0m
  [37m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/multivolume.go:246[0m
... skipping 206 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow]
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should access to two volumes with different volume mode and retain data across pod recreation on different node
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/multivolume.go:246[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node","total":23,"completed":3,"skipped":324,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[0mExternal Storage [Driver: test.csi.azure.com][0m [90m[Testpattern: Dynamic PV (default fs)] subPath[0m 
  [1mshould support file as subpath [LinuxOnly][0m
  [37m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:230[0m
... skipping 16 lines ...
Apr 13 11:33:04.329: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.com7929h] to have phase Bound
Apr 13 11:33:04.438: INFO: PersistentVolumeClaim test.csi.azure.com7929h found but phase is Pending instead of Bound.
Apr 13 11:33:06.553: INFO: PersistentVolumeClaim test.csi.azure.com7929h found but phase is Pending instead of Bound.
Apr 13 11:33:08.663: INFO: PersistentVolumeClaim test.csi.azure.com7929h found and phase=Bound (4.333531489s)
[1mSTEP[0m: Creating pod pod-subpath-test-dynamicpv-ztpk
[1mSTEP[0m: Creating a pod to test atomic-volume-subpath
Apr 13 11:33:08.992: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-ztpk" in namespace "provisioning-8940" to be "Succeeded or Failed"
Apr 13 11:33:09.101: INFO: Pod "pod-subpath-test-dynamicpv-ztpk": Phase="Pending", Reason="", readiness=false. Elapsed: 109.176149ms
Apr 13 11:33:11.211: INFO: Pod "pod-subpath-test-dynamicpv-ztpk": Phase="Pending", Reason="", readiness=false. Elapsed: 2.219163911s
Apr 13 11:33:13.322: INFO: Pod "pod-subpath-test-dynamicpv-ztpk": Phase="Pending", Reason="", readiness=false. Elapsed: 4.330812098s
Apr 13 11:33:15.433: INFO: Pod "pod-subpath-test-dynamicpv-ztpk": Phase="Pending", Reason="", readiness=false. Elapsed: 6.441677291s
Apr 13 11:33:17.545: INFO: Pod "pod-subpath-test-dynamicpv-ztpk": Phase="Pending", Reason="", readiness=false. Elapsed: 8.552977005s
Apr 13 11:33:19.655: INFO: Pod "pod-subpath-test-dynamicpv-ztpk": Phase="Pending", Reason="", readiness=false. Elapsed: 10.663249821s
... skipping 19 lines ...
Apr 13 11:34:01.869: INFO: Pod "pod-subpath-test-dynamicpv-ztpk": Phase="Running", Reason="", readiness=true. Elapsed: 52.877687119s
Apr 13 11:34:03.979: INFO: Pod "pod-subpath-test-dynamicpv-ztpk": Phase="Running", Reason="", readiness=true. Elapsed: 54.987450765s
Apr 13 11:34:06.089: INFO: Pod "pod-subpath-test-dynamicpv-ztpk": Phase="Running", Reason="", readiness=true. Elapsed: 57.097333223s
Apr 13 11:34:08.199: INFO: Pod "pod-subpath-test-dynamicpv-ztpk": Phase="Running", Reason="", readiness=true. Elapsed: 59.207022071s
Apr 13 11:34:10.309: INFO: Pod "pod-subpath-test-dynamicpv-ztpk": Phase="Succeeded", Reason="", readiness=false. Elapsed: 1m1.317480546s
[1mSTEP[0m: Saw pod success
Apr 13 11:34:10.309: INFO: Pod "pod-subpath-test-dynamicpv-ztpk" satisfied condition "Succeeded or Failed"
Apr 13 11:34:10.418: INFO: Trying to get logs from node k8s-agentpool1-19736391-vmss000002 pod pod-subpath-test-dynamicpv-ztpk container test-container-subpath-dynamicpv-ztpk: <nil>
[1mSTEP[0m: delete the pod
Apr 13 11:34:10.677: INFO: Waiting for pod pod-subpath-test-dynamicpv-ztpk to disappear
Apr 13 11:34:10.786: INFO: Pod pod-subpath-test-dynamicpv-ztpk no longer exists
[1mSTEP[0m: Deleting pod pod-subpath-test-dynamicpv-ztpk
Apr 13 11:34:10.786: INFO: Deleting pod "pod-subpath-test-dynamicpv-ztpk" in namespace "provisioning-8940"
... skipping 41 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (default fs)] subPath
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should support file as subpath [LinuxOnly]
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:230[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath should support file as subpath [LinuxOnly]","total":36,"completed":3,"skipped":81,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: Inline-volume (ext3)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Apr 13 11:36:24.647: INFO: Driver "test.csi.azure.com" does not support volume type "InlineVolume" - skipping
... skipping 375 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (default fs)] provisioning
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should provision storage with pvc data source in parallel [Slow]
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/provisioning.go:275[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with pvc data source in parallel [Slow]","total":38,"completed":4,"skipped":167,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[0mExternal Storage [Driver: test.csi.azure.com][0m [90m[Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral[0m 
  [1mshould create read-only inline ephemeral volume[0m
  [37m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/ephemeral.go:173[0m
... skipping 44 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should create read-only inline ephemeral volume
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/ephemeral.go:173[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should create read-only inline ephemeral volume","total":38,"completed":3,"skipped":236,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow]
... skipping 34 lines ...

[36m[1mS [SKIPPING] in Spec Setup (BeforeEach) [0.001 seconds][0m
External Storage [Driver: test.csi.azure.com]
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    [36m[1mshould fail if subpath file is outside the volume [Slow][LinuxOnly] [BeforeEach][0m
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:256[0m

    [36mDistro debian doesn't support ntfs -- skipping[0m

    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:127
[90m------------------------------[0m
... skipping 58 lines ...

[36m[1mS [SKIPPING] in Spec Setup (BeforeEach) [0.001 seconds][0m
External Storage [Driver: test.csi.azure.com]
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    [36m[1mshould fail if subpath with backstepping is outside the volume [Slow][LinuxOnly] [BeforeEach][0m
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:278[0m

    [36mDistro debian doesn't support ntfs -- skipping[0m

    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:127
[90m------------------------------[0m
... skipping 49 lines ...

    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:262
[90m------------------------------[0m
[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[0mExternal Storage [Driver: test.csi.azure.com][0m [90m[Testpattern: Dynamic PV (default fs)] subPath[0m 
  [1mshould fail if subpath file is outside the volume [Slow][LinuxOnly][0m
  [37m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:256[0m

[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
[1mSTEP[0m: Creating a kubernetes client
Apr 13 11:36:23.283: INFO: >>> kubeConfig: /root/tmp1956769959/kubeconfig/kubeconfig.westeurope.json
[1mSTEP[0m: Building a namespace api object, basename provisioning
[1mSTEP[0m: Waiting for a default service account to be provisioned in namespace
[It] should fail if subpath file is outside the volume [Slow][LinuxOnly]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:256
Apr 13 11:36:23.832: INFO: Creating resource for dynamic PV
Apr 13 11:36:23.832: INFO: Using claimSize:5Gi, test suite supported size:{ 1Mi}, driver(test.csi.azure.com) supported size:{ 1Mi} 
[1mSTEP[0m: creating a StorageClass provisioning-7723-e2e-sc9vfbj
[1mSTEP[0m: creating a claim
Apr 13 11:36:23.943: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
Apr 13 11:36:24.054: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.comjf9bx] to have phase Bound
Apr 13 11:36:24.166: INFO: PersistentVolumeClaim test.csi.azure.comjf9bx found but phase is Pending instead of Bound.
Apr 13 11:36:26.275: INFO: PersistentVolumeClaim test.csi.azure.comjf9bx found but phase is Pending instead of Bound.
Apr 13 11:36:28.386: INFO: PersistentVolumeClaim test.csi.azure.comjf9bx found and phase=Bound (4.331424449s)
[1mSTEP[0m: Creating pod pod-subpath-test-dynamicpv-zrtw
[1mSTEP[0m: Checking for subpath error in container status
Apr 13 11:36:50.933: INFO: Deleting pod "pod-subpath-test-dynamicpv-zrtw" in namespace "provisioning-7723"
Apr 13 11:36:51.046: INFO: Wait up to 5m0s for pod "pod-subpath-test-dynamicpv-zrtw" to be fully deleted
[1mSTEP[0m: Deleting pod
Apr 13 11:36:53.264: INFO: Deleting pod "pod-subpath-test-dynamicpv-zrtw" in namespace "provisioning-7723"
[1mSTEP[0m: Deleting pvc
Apr 13 11:36:53.372: INFO: Deleting PersistentVolumeClaim "test.csi.azure.comjf9bx"
... skipping 16 lines ...

[32m• [SLOW TEST:71.741 seconds][0m
External Storage [Driver: test.csi.azure.com]
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (default fs)] subPath
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should fail if subpath file is outside the volume [Slow][LinuxOnly]
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:256[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath should fail if subpath file is outside the volume [Slow][LinuxOnly]","total":23,"completed":4,"skipped":333,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[0mExternal Storage [Driver: test.csi.azure.com][0m [90m[Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow][0m 
  [1mshould access to two volumes with different volume mode and retain data across pod recreation on the same node[0m
  [37m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/multivolume.go:207[0m
... skipping 188 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow]
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should access to two volumes with different volume mode and retain data across pod recreation on the same node
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/multivolume.go:207[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node","total":32,"completed":4,"skipped":139,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] volume-stress
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Apr 13 11:37:40.493: INFO: Driver test.csi.azure.com doesn't specify stress test options -- skipping
... skipping 24 lines ...

[36m[1mS [SKIPPING] in Spec Setup (BeforeEach) [0.001 seconds][0m
External Storage [Driver: test.csi.azure.com]
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    [36m[1mshould fail to use a volume in a pod with mismatched mode [Slow] [BeforeEach][0m
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:297[0m

    [36mDriver "test.csi.azure.com" does not support volume type "PreprovisionedPV" - skipping[0m

    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:262
[90m------------------------------[0m
... skipping 29 lines ...

[36m[1mS [SKIPPING] in Spec Setup (BeforeEach) [0.002 seconds][0m
External Storage [Driver: test.csi.azure.com]
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Inline-volume (default fs)] subPath
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    [36m[1mshould fail if subpath file is outside the volume [Slow][LinuxOnly] [BeforeEach][0m
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:256[0m

    [36mDriver "test.csi.azure.com" does not support volume type "InlineVolume" - skipping[0m

    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:262
[90m------------------------------[0m
... skipping 135 lines ...
Apr 13 11:35:32.939: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
Apr 13 11:35:33.050: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.comv54l9] to have phase Bound
Apr 13 11:35:33.158: INFO: PersistentVolumeClaim test.csi.azure.comv54l9 found but phase is Pending instead of Bound.
Apr 13 11:35:35.267: INFO: PersistentVolumeClaim test.csi.azure.comv54l9 found but phase is Pending instead of Bound.
Apr 13 11:35:37.377: INFO: PersistentVolumeClaim test.csi.azure.comv54l9 found and phase=Bound (4.327199364s)
[1mSTEP[0m: Creating pod to format volume volume-prep-provisioning-8956
Apr 13 11:35:37.701: INFO: Waiting up to 5m0s for pod "volume-prep-provisioning-8956" in namespace "provisioning-8956" to be "Succeeded or Failed"
Apr 13 11:35:37.810: INFO: Pod "volume-prep-provisioning-8956": Phase="Pending", Reason="", readiness=false. Elapsed: 108.245683ms
Apr 13 11:35:39.919: INFO: Pod "volume-prep-provisioning-8956": Phase="Pending", Reason="", readiness=false. Elapsed: 2.217513851s
Apr 13 11:35:42.028: INFO: Pod "volume-prep-provisioning-8956": Phase="Pending", Reason="", readiness=false. Elapsed: 4.326756603s
Apr 13 11:35:44.138: INFO: Pod "volume-prep-provisioning-8956": Phase="Pending", Reason="", readiness=false. Elapsed: 6.436173279s
Apr 13 11:35:46.247: INFO: Pod "volume-prep-provisioning-8956": Phase="Pending", Reason="", readiness=false. Elapsed: 8.545409539s
Apr 13 11:35:48.355: INFO: Pod "volume-prep-provisioning-8956": Phase="Pending", Reason="", readiness=false. Elapsed: 10.653805998s
... skipping 5 lines ...
Apr 13 11:36:01.014: INFO: Pod "volume-prep-provisioning-8956": Phase="Pending", Reason="", readiness=false. Elapsed: 23.312686369s
Apr 13 11:36:03.123: INFO: Pod "volume-prep-provisioning-8956": Phase="Pending", Reason="", readiness=false. Elapsed: 25.421736391s
Apr 13 11:36:05.235: INFO: Pod "volume-prep-provisioning-8956": Phase="Pending", Reason="", readiness=false. Elapsed: 27.533380018s
Apr 13 11:36:07.344: INFO: Pod "volume-prep-provisioning-8956": Phase="Pending", Reason="", readiness=false. Elapsed: 29.64227875s
Apr 13 11:36:09.454: INFO: Pod "volume-prep-provisioning-8956": Phase="Succeeded", Reason="", readiness=false. Elapsed: 31.752275487s
[1mSTEP[0m: Saw pod success
Apr 13 11:36:09.454: INFO: Pod "volume-prep-provisioning-8956" satisfied condition "Succeeded or Failed"
Apr 13 11:36:09.454: INFO: Deleting pod "volume-prep-provisioning-8956" in namespace "provisioning-8956"
Apr 13 11:36:09.569: INFO: Wait up to 5m0s for pod "volume-prep-provisioning-8956" to be fully deleted
[1mSTEP[0m: Creating pod pod-subpath-test-dynamicpv-9rv2
[1mSTEP[0m: Checking for subpath error in container status
Apr 13 11:36:48.010: INFO: Deleting pod "pod-subpath-test-dynamicpv-9rv2" in namespace "provisioning-8956"
Apr 13 11:36:48.130: INFO: Wait up to 5m0s for pod "pod-subpath-test-dynamicpv-9rv2" to be fully deleted
[1mSTEP[0m: Deleting pod
Apr 13 11:36:48.238: INFO: Deleting pod "pod-subpath-test-dynamicpv-9rv2" in namespace "provisioning-8956"
[1mSTEP[0m: Deleting pvc
Apr 13 11:36:48.345: INFO: Deleting PersistentVolumeClaim "test.csi.azure.comv54l9"
... skipping 25 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (default fs)] subPath
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should verify container cannot write to subpath readonly volumes [Slow]
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:423[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath should verify container cannot write to subpath readonly volumes [Slow]","total":37,"completed":4,"skipped":322,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Apr 13 11:38:00.982: INFO: Driver "test.csi.azure.com" does not support volume type "PreprovisionedPV" - skipping
... skipping 3 lines ...

[36m[1mS [SKIPPING] in Spec Setup (BeforeEach) [0.001 seconds][0m
External Storage [Driver: test.csi.azure.com]
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Pre-provisioned PV (default fs)] subPath
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    [36m[1mshould fail if subpath file is outside the volume [Slow][LinuxOnly] [BeforeEach][0m
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:256[0m

    [36mDriver "test.csi.azure.com" does not support volume type "PreprovisionedPV" - skipping[0m

    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:262
[90m------------------------------[0m
... skipping 97 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow]
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should concurrently access the single read-only volume from pods on the same node
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/multivolume.go:421[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node","total":38,"completed":5,"skipped":173,"failed":0}

[36mS[0m
[90m------------------------------[0m
[0mExternal Storage [Driver: test.csi.azure.com][0m [90m[Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral[0m 
  [1mshould support multiple inline ephemeral volumes[0m
  [37m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/ephemeral.go:252[0m
... skipping 56 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should support multiple inline ephemeral volumes
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/ephemeral.go:252[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral should support multiple inline ephemeral volumes","total":36,"completed":4,"skipped":184,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Apr 13 11:39:10.706: INFO: Distro debian doesn't support ntfs -- skipping
... skipping 243 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow]
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should access to two volumes with the same volume mode and retain data across pod recreation on the same node
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/multivolume.go:136[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node","total":27,"completed":5,"skipped":437,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow]
... skipping 47 lines ...
Apr 13 11:38:01.777: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.comsm7jc] to have phase Bound
Apr 13 11:38:01.885: INFO: PersistentVolumeClaim test.csi.azure.comsm7jc found but phase is Pending instead of Bound.
Apr 13 11:38:03.994: INFO: PersistentVolumeClaim test.csi.azure.comsm7jc found but phase is Pending instead of Bound.
Apr 13 11:38:06.106: INFO: PersistentVolumeClaim test.csi.azure.comsm7jc found and phase=Bound (4.329741982s)
[1mSTEP[0m: Creating pod pod-subpath-test-dynamicpv-dl79
[1mSTEP[0m: Creating a pod to test multi_subpath
Apr 13 11:38:06.434: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-dl79" in namespace "provisioning-843" to be "Succeeded or Failed"
Apr 13 11:38:06.542: INFO: Pod "pod-subpath-test-dynamicpv-dl79": Phase="Pending", Reason="", readiness=false. Elapsed: 108.36229ms
Apr 13 11:38:08.653: INFO: Pod "pod-subpath-test-dynamicpv-dl79": Phase="Pending", Reason="", readiness=false. Elapsed: 2.219089687s
Apr 13 11:38:10.763: INFO: Pod "pod-subpath-test-dynamicpv-dl79": Phase="Pending", Reason="", readiness=false. Elapsed: 4.329553118s
Apr 13 11:38:12.873: INFO: Pod "pod-subpath-test-dynamicpv-dl79": Phase="Pending", Reason="", readiness=false. Elapsed: 6.438876719s
Apr 13 11:38:14.982: INFO: Pod "pod-subpath-test-dynamicpv-dl79": Phase="Pending", Reason="", readiness=false. Elapsed: 8.54848172s
Apr 13 11:38:17.092: INFO: Pod "pod-subpath-test-dynamicpv-dl79": Phase="Pending", Reason="", readiness=false. Elapsed: 10.657776441s
... skipping 6 lines ...
Apr 13 11:38:31.858: INFO: Pod "pod-subpath-test-dynamicpv-dl79": Phase="Pending", Reason="", readiness=false. Elapsed: 25.424600411s
Apr 13 11:38:33.968: INFO: Pod "pod-subpath-test-dynamicpv-dl79": Phase="Pending", Reason="", readiness=false. Elapsed: 27.534239194s
Apr 13 11:38:36.078: INFO: Pod "pod-subpath-test-dynamicpv-dl79": Phase="Pending", Reason="", readiness=false. Elapsed: 29.644122321s
Apr 13 11:38:38.187: INFO: Pod "pod-subpath-test-dynamicpv-dl79": Phase="Pending", Reason="", readiness=false. Elapsed: 31.7537265s
Apr 13 11:38:40.298: INFO: Pod "pod-subpath-test-dynamicpv-dl79": Phase="Succeeded", Reason="", readiness=false. Elapsed: 33.864303237s
[1mSTEP[0m: Saw pod success
Apr 13 11:38:40.298: INFO: Pod "pod-subpath-test-dynamicpv-dl79" satisfied condition "Succeeded or Failed"
Apr 13 11:38:40.407: INFO: Trying to get logs from node k8s-agentpool1-19736391-vmss000002 pod pod-subpath-test-dynamicpv-dl79 container test-container-subpath-dynamicpv-dl79: <nil>
[1mSTEP[0m: delete the pod
Apr 13 11:38:41.140: INFO: Waiting for pod pod-subpath-test-dynamicpv-dl79 to disappear
Apr 13 11:38:41.248: INFO: Pod pod-subpath-test-dynamicpv-dl79 no longer exists
[1mSTEP[0m: Deleting pod
Apr 13 11:38:41.248: INFO: Deleting pod "pod-subpath-test-dynamicpv-dl79" in namespace "provisioning-843"
... skipping 33 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (default fs)] subPath
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should support creating multiple subpath from same volumes [Slow]
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:294[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath should support creating multiple subpath from same volumes [Slow]","total":37,"completed":5,"skipped":352,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Apr 13 11:40:24.346: INFO: Driver "test.csi.azure.com" does not support volume type "InlineVolume" - skipping
... skipping 211 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (ext4)] multiVolume [Slow]
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should access to two volumes with different volume mode and retain data across pod recreation on the same node
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/multivolume.go:207[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node","total":38,"completed":4,"skipped":379,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Apr 13 11:40:24.578: INFO: Distro debian doesn't support ntfs -- skipping
... skipping 180 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow]
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should concurrently access the single read-only volume from pods on the same node
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/multivolume.go:421[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node","total":23,"completed":5,"skipped":401,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Apr 13 11:40:29.580: INFO: Driver "test.csi.azure.com" does not support volume type "PreprovisionedPV" - skipping
... skipping 37 lines ...
Apr 13 11:39:08.968: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.comfnjtk] to have phase Bound
Apr 13 11:39:09.077: INFO: PersistentVolumeClaim test.csi.azure.comfnjtk found but phase is Pending instead of Bound.
Apr 13 11:39:11.195: INFO: PersistentVolumeClaim test.csi.azure.comfnjtk found but phase is Pending instead of Bound.
Apr 13 11:39:13.303: INFO: PersistentVolumeClaim test.csi.azure.comfnjtk found and phase=Bound (4.334384408s)
[1mSTEP[0m: Creating pod exec-volume-test-dynamicpv-m9ff
[1mSTEP[0m: Creating a pod to test exec-volume-test
Apr 13 11:39:13.629: INFO: Waiting up to 5m0s for pod "exec-volume-test-dynamicpv-m9ff" in namespace "volume-902" to be "Succeeded or Failed"
Apr 13 11:39:13.737: INFO: Pod "exec-volume-test-dynamicpv-m9ff": Phase="Pending", Reason="", readiness=false. Elapsed: 107.925669ms
Apr 13 11:39:15.846: INFO: Pod "exec-volume-test-dynamicpv-m9ff": Phase="Pending", Reason="", readiness=false. Elapsed: 2.217017261s
Apr 13 11:39:17.955: INFO: Pod "exec-volume-test-dynamicpv-m9ff": Phase="Pending", Reason="", readiness=false. Elapsed: 4.326844733s
Apr 13 11:39:20.065: INFO: Pod "exec-volume-test-dynamicpv-m9ff": Phase="Pending", Reason="", readiness=false. Elapsed: 6.43634138s
Apr 13 11:39:22.175: INFO: Pod "exec-volume-test-dynamicpv-m9ff": Phase="Pending", Reason="", readiness=false. Elapsed: 8.546262211s
Apr 13 11:39:24.285: INFO: Pod "exec-volume-test-dynamicpv-m9ff": Phase="Pending", Reason="", readiness=false. Elapsed: 10.656488546s
... skipping 10 lines ...
Apr 13 11:39:47.489: INFO: Pod "exec-volume-test-dynamicpv-m9ff": Phase="Pending", Reason="", readiness=false. Elapsed: 33.860257224s
Apr 13 11:39:49.599: INFO: Pod "exec-volume-test-dynamicpv-m9ff": Phase="Pending", Reason="", readiness=false. Elapsed: 35.969929435s
Apr 13 11:39:51.711: INFO: Pod "exec-volume-test-dynamicpv-m9ff": Phase="Pending", Reason="", readiness=false. Elapsed: 38.081971729s
Apr 13 11:39:53.821: INFO: Pod "exec-volume-test-dynamicpv-m9ff": Phase="Pending", Reason="", readiness=false. Elapsed: 40.192551043s
Apr 13 11:39:55.931: INFO: Pod "exec-volume-test-dynamicpv-m9ff": Phase="Succeeded", Reason="", readiness=false. Elapsed: 42.302611133s
[1mSTEP[0m: Saw pod success
Apr 13 11:39:55.931: INFO: Pod "exec-volume-test-dynamicpv-m9ff" satisfied condition "Succeeded or Failed"
Apr 13 11:39:56.041: INFO: Trying to get logs from node k8s-agentpool1-19736391-vmss000002 pod exec-volume-test-dynamicpv-m9ff container exec-container-dynamicpv-m9ff: <nil>
[1mSTEP[0m: delete the pod
Apr 13 11:39:56.270: INFO: Waiting for pod exec-volume-test-dynamicpv-m9ff to disappear
Apr 13 11:39:56.379: INFO: Pod exec-volume-test-dynamicpv-m9ff no longer exists
[1mSTEP[0m: Deleting pod exec-volume-test-dynamicpv-m9ff
Apr 13 11:39:56.379: INFO: Deleting pod "exec-volume-test-dynamicpv-m9ff" in namespace "volume-902"
... skipping 21 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (default fs)] volumes
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should allow exec of files on the volume
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:196[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] volumes should allow exec of files on the volume","total":38,"completed":6,"skipped":174,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Apr 13 11:40:38.160: INFO: Driver "test.csi.azure.com" does not support volume type "PreprovisionedPV" - skipping
... skipping 43 lines ...

[36m[1mS [SKIPPING] in Spec Setup (BeforeEach) [0.001 seconds][0m
External Storage [Driver: test.csi.azure.com]
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    [36m[1mshould fail if non-existent subpath is outside the volume [Slow][LinuxOnly] [BeforeEach][0m
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:267[0m

    [36mDistro debian doesn't support ntfs -- skipping[0m

    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:127
[90m------------------------------[0m
... skipping 8 lines ...

[36m[1mS [SKIPPING] in Spec Setup (BeforeEach) [0.001 seconds][0m
External Storage [Driver: test.csi.azure.com]
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Pre-provisioned PV (default fs)] subPath
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    [36m[1mshould fail if subpath with backstepping is outside the volume [Slow][LinuxOnly] [BeforeEach][0m
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:278[0m

    [36mDriver "test.csi.azure.com" does not support volume type "PreprovisionedPV" - skipping[0m

    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:262
[90m------------------------------[0m
... skipping 91 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow]
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/multivolume.go:376[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]","total":32,"completed":5,"skipped":403,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Apr 13 11:41:12.832: INFO: Driver "test.csi.azure.com" does not support volume type "PreprovisionedPV" - skipping
... skipping 37 lines ...
Apr 13 11:40:26.189: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.com7pws4] to have phase Bound
Apr 13 11:40:26.301: INFO: PersistentVolumeClaim test.csi.azure.com7pws4 found but phase is Pending instead of Bound.
Apr 13 11:40:28.410: INFO: PersistentVolumeClaim test.csi.azure.com7pws4 found but phase is Pending instead of Bound.
Apr 13 11:40:30.519: INFO: PersistentVolumeClaim test.csi.azure.com7pws4 found and phase=Bound (4.329981989s)
[1mSTEP[0m: Creating pod exec-volume-test-dynamicpv-rd8q
[1mSTEP[0m: Creating a pod to test exec-volume-test
Apr 13 11:40:30.849: INFO: Waiting up to 5m0s for pod "exec-volume-test-dynamicpv-rd8q" in namespace "volume-3412" to be "Succeeded or Failed"
Apr 13 11:40:30.958: INFO: Pod "exec-volume-test-dynamicpv-rd8q": Phase="Pending", Reason="", readiness=false. Elapsed: 108.980121ms
Apr 13 11:40:33.067: INFO: Pod "exec-volume-test-dynamicpv-rd8q": Phase="Pending", Reason="", readiness=false. Elapsed: 2.218896582s
Apr 13 11:40:35.178: INFO: Pod "exec-volume-test-dynamicpv-rd8q": Phase="Pending", Reason="", readiness=false. Elapsed: 4.329474816s
Apr 13 11:40:37.288: INFO: Pod "exec-volume-test-dynamicpv-rd8q": Phase="Pending", Reason="", readiness=false. Elapsed: 6.43913489s
Apr 13 11:40:39.398: INFO: Pod "exec-volume-test-dynamicpv-rd8q": Phase="Pending", Reason="", readiness=false. Elapsed: 8.549240572s
Apr 13 11:40:41.510: INFO: Pod "exec-volume-test-dynamicpv-rd8q": Phase="Pending", Reason="", readiness=false. Elapsed: 10.661346221s
Apr 13 11:40:43.619: INFO: Pod "exec-volume-test-dynamicpv-rd8q": Phase="Pending", Reason="", readiness=false. Elapsed: 12.770758849s
Apr 13 11:40:45.729: INFO: Pod "exec-volume-test-dynamicpv-rd8q": Phase="Pending", Reason="", readiness=false. Elapsed: 14.880562517s
Apr 13 11:40:47.839: INFO: Pod "exec-volume-test-dynamicpv-rd8q": Phase="Pending", Reason="", readiness=false. Elapsed: 16.990570654s
Apr 13 11:40:49.949: INFO: Pod "exec-volume-test-dynamicpv-rd8q": Phase="Pending", Reason="", readiness=false. Elapsed: 19.100035814s
Apr 13 11:40:52.059: INFO: Pod "exec-volume-test-dynamicpv-rd8q": Phase="Pending", Reason="", readiness=false. Elapsed: 21.210032763s
Apr 13 11:40:54.169: INFO: Pod "exec-volume-test-dynamicpv-rd8q": Phase="Succeeded", Reason="", readiness=false. Elapsed: 23.320829895s
[1mSTEP[0m: Saw pod success
Apr 13 11:40:54.170: INFO: Pod "exec-volume-test-dynamicpv-rd8q" satisfied condition "Succeeded or Failed"
Apr 13 11:40:54.279: INFO: Trying to get logs from node k8s-agentpool1-19736391-vmss000001 pod exec-volume-test-dynamicpv-rd8q container exec-container-dynamicpv-rd8q: <nil>
[1mSTEP[0m: delete the pod
Apr 13 11:40:54.526: INFO: Waiting for pod exec-volume-test-dynamicpv-rd8q to disappear
Apr 13 11:40:54.641: INFO: Pod exec-volume-test-dynamicpv-rd8q no longer exists
[1mSTEP[0m: Deleting pod exec-volume-test-dynamicpv-rd8q
Apr 13 11:40:54.641: INFO: Deleting pod "exec-volume-test-dynamicpv-rd8q" in namespace "volume-3412"
... skipping 21 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (ext3)] volumes
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should allow exec of files on the volume
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:196[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (ext3)] volumes should allow exec of files on the volume","total":38,"completed":5,"skipped":511,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[0mExternal Storage [Driver: test.csi.azure.com][0m [90m[Testpattern: Dynamic PV (default fs)] subPath[0m 
  [1mshould fail if subpath directory is outside the volume [Slow][LinuxOnly][0m
  [37m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:240[0m

[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
[1mSTEP[0m: Creating a kubernetes client
Apr 13 11:40:29.608: INFO: >>> kubeConfig: /root/tmp1956769959/kubeconfig/kubeconfig.westeurope.json
[1mSTEP[0m: Building a namespace api object, basename provisioning
[1mSTEP[0m: Waiting for a default service account to be provisioned in namespace
[It] should fail if subpath directory is outside the volume [Slow][LinuxOnly]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:240
Apr 13 11:40:30.151: INFO: Creating resource for dynamic PV
Apr 13 11:40:30.152: INFO: Using claimSize:5Gi, test suite supported size:{ 1Mi}, driver(test.csi.azure.com) supported size:{ 1Mi} 
[1mSTEP[0m: creating a StorageClass provisioning-9375-e2e-scdjnz5
[1mSTEP[0m: creating a claim
Apr 13 11:40:30.262: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
Apr 13 11:40:30.382: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.comb4tfd] to have phase Bound
Apr 13 11:40:30.490: INFO: PersistentVolumeClaim test.csi.azure.comb4tfd found but phase is Pending instead of Bound.
Apr 13 11:40:32.599: INFO: PersistentVolumeClaim test.csi.azure.comb4tfd found but phase is Pending instead of Bound.
Apr 13 11:40:34.711: INFO: PersistentVolumeClaim test.csi.azure.comb4tfd found and phase=Bound (4.329566313s)
[1mSTEP[0m: Creating pod pod-subpath-test-dynamicpv-vfrp
[1mSTEP[0m: Checking for subpath error in container status
Apr 13 11:40:57.261: INFO: Deleting pod "pod-subpath-test-dynamicpv-vfrp" in namespace "provisioning-9375"
Apr 13 11:40:57.373: INFO: Wait up to 5m0s for pod "pod-subpath-test-dynamicpv-vfrp" to be fully deleted
[1mSTEP[0m: Deleting pod
Apr 13 11:40:59.593: INFO: Deleting pod "pod-subpath-test-dynamicpv-vfrp" in namespace "provisioning-9375"
[1mSTEP[0m: Deleting pvc
Apr 13 11:40:59.702: INFO: Deleting PersistentVolumeClaim "test.csi.azure.comb4tfd"
... skipping 16 lines ...

[32m• [SLOW TEST:71.763 seconds][0m
External Storage [Driver: test.csi.azure.com]
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (default fs)] subPath
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should fail if subpath directory is outside the volume [Slow][LinuxOnly]
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:240[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath should fail if subpath directory is outside the volume [Slow][LinuxOnly]","total":23,"completed":6,"skipped":494,"failed":0}

[36mS[0m[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Apr 13 11:41:41.376: INFO: Driver "test.csi.azure.com" does not support volume type "PreprovisionedPV" - skipping
... skipping 45 lines ...

[36m[1mS [SKIPPING] in Spec Setup (BeforeEach) [0.001 seconds][0m
External Storage [Driver: test.csi.azure.com]
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    [36m[1mshould fail if subpath directory is outside the volume [Slow][LinuxOnly] [BeforeEach][0m
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:240[0m

    [36mDistro debian doesn't support ntfs -- skipping[0m

    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:127
[90m------------------------------[0m
... skipping 42 lines ...
Apr 13 11:39:22.344: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.comsj46m] to have phase Bound
Apr 13 11:39:22.453: INFO: PersistentVolumeClaim test.csi.azure.comsj46m found but phase is Pending instead of Bound.
Apr 13 11:39:24.562: INFO: PersistentVolumeClaim test.csi.azure.comsj46m found but phase is Pending instead of Bound.
Apr 13 11:39:26.672: INFO: PersistentVolumeClaim test.csi.azure.comsj46m found and phase=Bound (4.328475672s)
[1mSTEP[0m: Creating pod pod-subpath-test-dynamicpv-589r
[1mSTEP[0m: Creating a pod to test subpath
Apr 13 11:39:27.003: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-589r" in namespace "provisioning-5800" to be "Succeeded or Failed"
Apr 13 11:39:27.113: INFO: Pod "pod-subpath-test-dynamicpv-589r": Phase="Pending", Reason="", readiness=false. Elapsed: 109.720229ms
Apr 13 11:39:29.224: INFO: Pod "pod-subpath-test-dynamicpv-589r": Phase="Pending", Reason="", readiness=false. Elapsed: 2.221172423s
Apr 13 11:39:31.334: INFO: Pod "pod-subpath-test-dynamicpv-589r": Phase="Pending", Reason="", readiness=false. Elapsed: 4.33060786s
Apr 13 11:39:33.444: INFO: Pod "pod-subpath-test-dynamicpv-589r": Phase="Pending", Reason="", readiness=false. Elapsed: 6.44050644s
Apr 13 11:39:35.553: INFO: Pod "pod-subpath-test-dynamicpv-589r": Phase="Pending", Reason="", readiness=false. Elapsed: 8.549848925s
Apr 13 11:39:37.662: INFO: Pod "pod-subpath-test-dynamicpv-589r": Phase="Pending", Reason="", readiness=false. Elapsed: 10.658731699s
... skipping 27 lines ...
Apr 13 11:40:36.745: INFO: Pod "pod-subpath-test-dynamicpv-589r": Phase="Pending", Reason="", readiness=false. Elapsed: 1m9.741915588s
Apr 13 11:40:38.856: INFO: Pod "pod-subpath-test-dynamicpv-589r": Phase="Pending", Reason="", readiness=false. Elapsed: 1m11.852690923s
Apr 13 11:40:40.967: INFO: Pod "pod-subpath-test-dynamicpv-589r": Phase="Pending", Reason="", readiness=false. Elapsed: 1m13.963395653s
Apr 13 11:40:43.076: INFO: Pod "pod-subpath-test-dynamicpv-589r": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.07279225s
Apr 13 11:40:45.186: INFO: Pod "pod-subpath-test-dynamicpv-589r": Phase="Succeeded", Reason="", readiness=false. Elapsed: 1m18.182186s
[1mSTEP[0m: Saw pod success
Apr 13 11:40:45.186: INFO: Pod "pod-subpath-test-dynamicpv-589r" satisfied condition "Succeeded or Failed"
Apr 13 11:40:45.295: INFO: Trying to get logs from node k8s-agentpool1-19736391-vmss000000 pod pod-subpath-test-dynamicpv-589r container test-container-subpath-dynamicpv-589r: <nil>
[1mSTEP[0m: delete the pod
Apr 13 11:40:45.563: INFO: Waiting for pod pod-subpath-test-dynamicpv-589r to disappear
Apr 13 11:40:45.672: INFO: Pod pod-subpath-test-dynamicpv-589r no longer exists
[1mSTEP[0m: Deleting pod pod-subpath-test-dynamicpv-589r
Apr 13 11:40:45.672: INFO: Deleting pod "pod-subpath-test-dynamicpv-589r" in namespace "provisioning-5800"
... skipping 41 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (default fs)] subPath
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should support readOnly file specified in the volumeMount [LinuxOnly]
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:380[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath should support readOnly file specified in the volumeMount [LinuxOnly]","total":27,"completed":6,"skipped":493,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Apr 13 11:42:59.577: INFO: Distro debian doesn't support ntfs -- skipping
... skipping 73 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Apr 13 11:43:01.372: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[1mSTEP[0m: Destroying namespace "volumelimits-6392" for this suite.

[32m•[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Generic Ephemeral-volume (default fs)] volumeLimits should verify that all csinodes have volume limits","total":27,"completed":7,"skipped":581,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral
... skipping 46 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Apr 13 11:43:03.518: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[1mSTEP[0m: Destroying namespace "volumelimits-4143" for this suite.

[32m•[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (filesystem volmode)] volumeLimits should verify that all csinodes have volume limits","total":27,"completed":8,"skipped":753,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[0mExternal Storage [Driver: test.csi.azure.com][0m [90m[Testpattern: Dynamic PV (block volmode)] volumeMode[0m 
  [1mshould fail to use a volume in a pod with mismatched mode [Slow][0m
  [37m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:297[0m

[BeforeEach] [Testpattern: Dynamic PV (block volmode)] volumeMode
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] volumeMode
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
[1mSTEP[0m: Creating a kubernetes client
Apr 13 11:41:41.611: INFO: >>> kubeConfig: /root/tmp1956769959/kubeconfig/kubeconfig.westeurope.json
[1mSTEP[0m: Building a namespace api object, basename volumemode
[1mSTEP[0m: Waiting for a default service account to be provisioned in namespace
[It] should fail to use a volume in a pod with mismatched mode [Slow]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:297
Apr 13 11:41:42.159: INFO: Creating resource for dynamic PV
Apr 13 11:41:42.159: INFO: Using claimSize:5Gi, test suite supported size:{ 1Mi}, driver(test.csi.azure.com) supported size:{ 1Mi} 
[1mSTEP[0m: creating a StorageClass volumemode-2981-e2e-scdchcr
[1mSTEP[0m: creating a claim
Apr 13 11:41:42.381: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.com5flqg] to have phase Bound
Apr 13 11:41:42.490: INFO: PersistentVolumeClaim test.csi.azure.com5flqg found but phase is Pending instead of Bound.
Apr 13 11:41:44.599: INFO: PersistentVolumeClaim test.csi.azure.com5flqg found but phase is Pending instead of Bound.
Apr 13 11:41:46.709: INFO: PersistentVolumeClaim test.csi.azure.com5flqg found and phase=Bound (4.32831931s)
[1mSTEP[0m: Creating pod
[1mSTEP[0m: Waiting for the pod to fail
Apr 13 11:41:49.365: INFO: Deleting pod "pod-6a419a46-855a-4265-82d7-fc8857f61abc" in namespace "volumemode-2981"
Apr 13 11:41:49.476: INFO: Wait up to 5m0s for pod "pod-6a419a46-855a-4265-82d7-fc8857f61abc" to be fully deleted
[1mSTEP[0m: Deleting pvc
Apr 13 11:41:51.695: INFO: Deleting PersistentVolumeClaim "test.csi.azure.com5flqg"
Apr 13 11:41:51.804: INFO: Waiting up to 5m0s for PersistentVolume pvc-c574ad44-4da3-403c-a638-a33e0a9bd911 to get deleted
Apr 13 11:41:51.913: INFO: PersistentVolume pvc-c574ad44-4da3-403c-a638-a33e0a9bd911 found and phase=Released (108.976096ms)
... skipping 20 lines ...

[32m• [SLOW TEST:82.392 seconds][0m
External Storage [Driver: test.csi.azure.com]
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (block volmode)] volumeMode
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should fail to use a volume in a pod with mismatched mode [Slow]
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:297[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (block volmode)] volumeMode should fail to use a volume in a pod with mismatched mode [Slow]","total":23,"completed":7,"skipped":708,"failed":0}

[36mS[0m[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral
... skipping 191 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (default fs)] provisioning
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource]
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/provisioning.go:201[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource]","total":36,"completed":5,"skipped":267,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: CSI Ephemeral-volume (default fs)] ephemeral
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Apr 13 11:43:14.067: INFO: Driver "test.csi.azure.com" does not support volume type "CSIInlineVolume" - skipping
... skipping 66 lines ...

[36m[1mS [SKIPPING] in Spec Setup (BeforeEach) [0.001 seconds][0m
External Storage [Driver: test.csi.azure.com]
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Inline-volume (default fs)] subPath
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    [36m[1mshould fail if subpath with backstepping is outside the volume [Slow][LinuxOnly] [BeforeEach][0m
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:278[0m

    [36mDriver "test.csi.azure.com" does not support volume type "InlineVolume" - skipping[0m

    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:262
[90m------------------------------[0m
... skipping 62 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (default fs)] volumeIO
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should write files of various sizes, verify size, validate content [Slow]
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volume_io.go:147[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] volumeIO should write files of various sizes, verify size, validate content [Slow]","total":38,"completed":6,"skipped":539,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Apr 13 11:43:37.573: INFO: Driver "test.csi.azure.com" does not support volume type "PreprovisionedPV" - skipping
... skipping 161 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (block volmode)] provisioning
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should provision storage with pvc data source
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/provisioning.go:239[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with pvc data source","total":37,"completed":6,"skipped":396,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[0mExternal Storage [Driver: test.csi.azure.com][0m [90m[Testpattern: Dynamic PV (block volmode)] multiVolume [Slow][0m 
  [1mshould access to two volumes with the same volume mode and retain data across pod recreation on different node[0m
  [37m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/multivolume.go:166[0m
... skipping 205 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow]
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should access to two volumes with the same volume mode and retain data across pod recreation on different node
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/multivolume.go:166[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node","total":38,"completed":7,"skipped":318,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: Dynamic PV (delayed binding)] topology
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (delayed binding)] topology
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
[1mSTEP[0m: Creating a kubernetes client
Apr 13 11:46:13.282: INFO: >>> kubeConfig: /root/tmp1956769959/kubeconfig/kubeconfig.westeurope.json
[1mSTEP[0m: Building a namespace api object, basename topology
[1mSTEP[0m: Waiting for a default service account to be provisioned in namespace
[It] should fail to schedule a pod which has topologies that conflict with AllowedTopologies
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192
Apr 13 11:46:13.824: INFO: Driver didn't provide topology keys -- skipping
[AfterEach] [Testpattern: Dynamic PV (delayed binding)] topology
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Apr 13 11:46:13.825: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[1mSTEP[0m: Destroying namespace "topology-1414" for this suite.


[36m[1mS [SKIPPING] [0.868 seconds][0m
External Storage [Driver: test.csi.azure.com]
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (delayed binding)] topology
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    [36m[1mshould fail to schedule a pod which has topologies that conflict with AllowedTopologies [Measurement][0m
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192[0m

    [36mDriver didn't provide topology keys -- skipping[0m

    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:124
[90m------------------------------[0m
... skipping 140 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should create read/write inline ephemeral volume
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/ephemeral.go:194[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral should create read/write inline ephemeral volume","total":36,"completed":6,"skipped":439,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Apr 13 11:46:55.950: INFO: Distro debian doesn't support ntfs -- skipping
... skipping 58 lines ...
Apr 13 11:45:19.359: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.comht87h] to have phase Bound
Apr 13 11:45:19.468: INFO: PersistentVolumeClaim test.csi.azure.comht87h found but phase is Pending instead of Bound.
Apr 13 11:45:21.576: INFO: PersistentVolumeClaim test.csi.azure.comht87h found but phase is Pending instead of Bound.
Apr 13 11:45:23.685: INFO: PersistentVolumeClaim test.csi.azure.comht87h found and phase=Bound (4.326179386s)
[1mSTEP[0m: Creating pod pod-subpath-test-dynamicpv-4tqv
[1mSTEP[0m: Creating a pod to test subpath
Apr 13 11:45:24.016: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-4tqv" in namespace "provisioning-7994" to be "Succeeded or Failed"
Apr 13 11:45:24.125: INFO: Pod "pod-subpath-test-dynamicpv-4tqv": Phase="Pending", Reason="", readiness=false. Elapsed: 108.847933ms
Apr 13 11:45:26.235: INFO: Pod "pod-subpath-test-dynamicpv-4tqv": Phase="Pending", Reason="", readiness=false. Elapsed: 2.218345208s
Apr 13 11:45:28.344: INFO: Pod "pod-subpath-test-dynamicpv-4tqv": Phase="Pending", Reason="", readiness=false. Elapsed: 4.327477896s
Apr 13 11:45:30.453: INFO: Pod "pod-subpath-test-dynamicpv-4tqv": Phase="Pending", Reason="", readiness=false. Elapsed: 6.43662381s
Apr 13 11:45:32.562: INFO: Pod "pod-subpath-test-dynamicpv-4tqv": Phase="Pending", Reason="", readiness=false. Elapsed: 8.546043968s
Apr 13 11:45:34.672: INFO: Pod "pod-subpath-test-dynamicpv-4tqv": Phase="Pending", Reason="", readiness=false. Elapsed: 10.655719936s
... skipping 16 lines ...
Apr 13 11:46:10.541: INFO: Pod "pod-subpath-test-dynamicpv-4tqv": Phase="Pending", Reason="", readiness=false. Elapsed: 46.525140542s
Apr 13 11:46:12.652: INFO: Pod "pod-subpath-test-dynamicpv-4tqv": Phase="Pending", Reason="", readiness=false. Elapsed: 48.635352544s
Apr 13 11:46:14.760: INFO: Pod "pod-subpath-test-dynamicpv-4tqv": Phase="Pending", Reason="", readiness=false. Elapsed: 50.744325473s
Apr 13 11:46:16.870: INFO: Pod "pod-subpath-test-dynamicpv-4tqv": Phase="Pending", Reason="", readiness=false. Elapsed: 52.853530842s
Apr 13 11:46:18.979: INFO: Pod "pod-subpath-test-dynamicpv-4tqv": Phase="Succeeded", Reason="", readiness=false. Elapsed: 54.963321653s
[1mSTEP[0m: Saw pod success
Apr 13 11:46:18.980: INFO: Pod "pod-subpath-test-dynamicpv-4tqv" satisfied condition "Succeeded or Failed"
Apr 13 11:46:19.088: INFO: Trying to get logs from node k8s-agentpool1-19736391-vmss000002 pod pod-subpath-test-dynamicpv-4tqv container test-container-subpath-dynamicpv-4tqv: <nil>
[1mSTEP[0m: delete the pod
Apr 13 11:46:19.356: INFO: Waiting for pod pod-subpath-test-dynamicpv-4tqv to disappear
Apr 13 11:46:19.463: INFO: Pod pod-subpath-test-dynamicpv-4tqv no longer exists
[1mSTEP[0m: Deleting pod pod-subpath-test-dynamicpv-4tqv
Apr 13 11:46:19.464: INFO: Deleting pod "pod-subpath-test-dynamicpv-4tqv" in namespace "provisioning-7994"
... skipping 29 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (default fs)] subPath
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should support existing single file [LinuxOnly]
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:219[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath should support existing single file [LinuxOnly]","total":37,"completed":7,"skipped":465,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Apr 13 11:47:32.071: INFO: Driver "test.csi.azure.com" does not support volume type "PreprovisionedPV" - skipping
... skipping 79 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Generic Ephemeral-volume (default fs)] volumeLimits
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should support volume limits [Serial]
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumelimits.go:125[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Generic Ephemeral-volume (default fs)] volumeLimits should support volume limits [Serial]","total":32,"completed":6,"skipped":435,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[0mExternal Storage [Driver: test.csi.azure.com][0m [90m[Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy[0m 
  [1m(OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed via chgrp in first pod, new pod with same fsgroup skips ownership changes to the volume contents[0m
  [37m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/fsgroupchangepolicy.go:214[0m
... skipping 118 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed via chgrp in first pod, new pod with same fsgroup skips ownership changes to the volume contents
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/fsgroupchangepolicy.go:214[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed via chgrp in first pod, new pod with same fsgroup skips ownership changes to the volume contents","total":23,"completed":8,"skipped":756,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: Inline-volume (ext3)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Apr 13 11:48:03.144: INFO: Driver "test.csi.azure.com" does not support volume type "InlineVolume" - skipping
... skipping 137 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed via chgrp in first pod, new pod with same fsgroup applied to the volume contents
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/fsgroupchangepolicy.go:214[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed via chgrp in first pod, new pod with same fsgroup applied to the volume contents","total":38,"completed":7,"skipped":615,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Apr 13 11:48:03.876: INFO: Driver "test.csi.azure.com" does not support volume type "InlineVolume" - skipping
... skipping 110 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow]
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/multivolume.go:376[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]","total":27,"completed":9,"skipped":758,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[0mExternal Storage [Driver: test.csi.azure.com][0m [90m[Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow][0m 
  [1mshould concurrently access the single read-only volume from pods on the same node[0m
  [37m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/multivolume.go:421[0m
... skipping 81 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow]
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should concurrently access the single read-only volume from pods on the same node
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/multivolume.go:421[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node","total":38,"completed":8,"skipped":507,"failed":0}

[36mS[0m
[90m------------------------------[0m
[0mExternal Storage [Driver: test.csi.azure.com][0m [90m[Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow][0m 
  [1mshould concurrently access the single volume from pods on the same node[0m
  [37m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/multivolume.go:296[0m
... skipping 164 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow]
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should concurrently access the single volume from pods on the same node
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/multivolume.go:296[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single volume from pods on the same node","total":36,"completed":7,"skipped":503,"failed":0}

[36mS[0m[36mS[0m
[90m------------------------------[0m
[0mExternal Storage [Driver: test.csi.azure.com][0m [90m[Testpattern: Dynamic PV (ext4)] volumes[0m 
  [1mshould allow exec of files on the volume[0m
  [37m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:196[0m
... skipping 16 lines ...
Apr 13 11:48:03.913: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.comc9c9m] to have phase Bound
Apr 13 11:48:04.023: INFO: PersistentVolumeClaim test.csi.azure.comc9c9m found but phase is Pending instead of Bound.
Apr 13 11:48:06.133: INFO: PersistentVolumeClaim test.csi.azure.comc9c9m found but phase is Pending instead of Bound.
Apr 13 11:48:08.243: INFO: PersistentVolumeClaim test.csi.azure.comc9c9m found and phase=Bound (4.329819405s)
[1mSTEP[0m: Creating pod exec-volume-test-dynamicpv-rsbf
[1mSTEP[0m: Creating a pod to test exec-volume-test
Apr 13 11:48:08.571: INFO: Waiting up to 5m0s for pod "exec-volume-test-dynamicpv-rsbf" in namespace "volume-1003" to be "Succeeded or Failed"
Apr 13 11:48:08.681: INFO: Pod "exec-volume-test-dynamicpv-rsbf": Phase="Pending", Reason="", readiness=false. Elapsed: 109.243103ms
Apr 13 11:48:10.791: INFO: Pod "exec-volume-test-dynamicpv-rsbf": Phase="Pending", Reason="", readiness=false. Elapsed: 2.219622236s
Apr 13 11:48:12.902: INFO: Pod "exec-volume-test-dynamicpv-rsbf": Phase="Pending", Reason="", readiness=false. Elapsed: 4.330511032s
Apr 13 11:48:15.012: INFO: Pod "exec-volume-test-dynamicpv-rsbf": Phase="Pending", Reason="", readiness=false. Elapsed: 6.440334153s
Apr 13 11:48:17.121: INFO: Pod "exec-volume-test-dynamicpv-rsbf": Phase="Pending", Reason="", readiness=false. Elapsed: 8.550032663s
Apr 13 11:48:19.230: INFO: Pod "exec-volume-test-dynamicpv-rsbf": Phase="Pending", Reason="", readiness=false. Elapsed: 10.658563694s
... skipping 27 lines ...
Apr 13 11:49:18.317: INFO: Pod "exec-volume-test-dynamicpv-rsbf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m9.746170673s
Apr 13 11:49:20.427: INFO: Pod "exec-volume-test-dynamicpv-rsbf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m11.855451565s
Apr 13 11:49:22.536: INFO: Pod "exec-volume-test-dynamicpv-rsbf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m13.964561416s
Apr 13 11:49:24.646: INFO: Pod "exec-volume-test-dynamicpv-rsbf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.074412637s
Apr 13 11:49:26.755: INFO: Pod "exec-volume-test-dynamicpv-rsbf": Phase="Succeeded", Reason="", readiness=false. Elapsed: 1m18.184123092s
[1mSTEP[0m: Saw pod success
Apr 13 11:49:26.755: INFO: Pod "exec-volume-test-dynamicpv-rsbf" satisfied condition "Succeeded or Failed"
Apr 13 11:49:26.864: INFO: Trying to get logs from node k8s-agentpool1-19736391-vmss000000 pod exec-volume-test-dynamicpv-rsbf container exec-container-dynamicpv-rsbf: <nil>
[1mSTEP[0m: delete the pod
Apr 13 11:49:27.116: INFO: Waiting for pod exec-volume-test-dynamicpv-rsbf to disappear
Apr 13 11:49:27.224: INFO: Pod exec-volume-test-dynamicpv-rsbf no longer exists
[1mSTEP[0m: Deleting pod exec-volume-test-dynamicpv-rsbf
Apr 13 11:49:27.224: INFO: Deleting pod "exec-volume-test-dynamicpv-rsbf" in namespace "volume-1003"
... skipping 39 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (ext4)] volumes
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should allow exec of files on the volume
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:196[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (ext4)] volumes should allow exec of files on the volume","total":23,"completed":9,"skipped":844,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Apr 13 11:51:41.040: INFO: Distro debian doesn't support ntfs -- skipping
... skipping 139 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/fsgroupchangepolicy.go:214[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents","total":37,"completed":8,"skipped":635,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: Dynamic PV (immediate binding)] topology
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (immediate binding)] topology
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
[1mSTEP[0m: Creating a kubernetes client
Apr 13 11:51:42.405: INFO: >>> kubeConfig: /root/tmp1956769959/kubeconfig/kubeconfig.westeurope.json
[1mSTEP[0m: Building a namespace api object, basename topology
[1mSTEP[0m: Waiting for a default service account to be provisioned in namespace
[It] should fail to schedule a pod which has topologies that conflict with AllowedTopologies
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192
Apr 13 11:51:42.949: INFO: Driver didn't provide topology keys -- skipping
[AfterEach] [Testpattern: Dynamic PV (immediate binding)] topology
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Apr 13 11:51:42.950: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[1mSTEP[0m: Destroying namespace "topology-1736" for this suite.


[36m[1mS [SKIPPING] [1.009 seconds][0m
External Storage [Driver: test.csi.azure.com]
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (immediate binding)] topology
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    [36m[1mshould fail to schedule a pod which has topologies that conflict with AllowedTopologies [Measurement][0m
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192[0m

    [36mDriver didn't provide topology keys -- skipping[0m

    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:124
[90m------------------------------[0m
... skipping 218 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (ext4)] multiVolume [Slow]
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should access to two volumes with the same volume mode and retain data across pod recreation on the same node
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/multivolume.go:136[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node","total":32,"completed":7,"skipped":507,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Apr 13 11:52:01.437: INFO: Distro debian doesn't support ntfs -- skipping
... skipping 146 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (block volmode)] provisioning
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource]
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/provisioning.go:201[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource]","total":38,"completed":8,"skipped":633,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: CSI Ephemeral-volume (default fs)] ephemeral
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Apr 13 11:52:47.570: INFO: Driver "test.csi.azure.com" does not support volume type "CSIInlineVolume" - skipping
... skipping 24 lines ...

[36m[1mS [SKIPPING] in Spec Setup (BeforeEach) [0.001 seconds][0m
External Storage [Driver: test.csi.azure.com]
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Pre-provisioned PV (default fs)] subPath
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    [36m[1mshould fail if subpath directory is outside the volume [Slow][LinuxOnly] [BeforeEach][0m
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:240[0m

    [36mDriver "test.csi.azure.com" does not support volume type "PreprovisionedPV" - skipping[0m

    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:262
[90m------------------------------[0m
... skipping 129 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (default fs)] volumes
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should store data
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:159[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] volumes should store data","total":38,"completed":9,"skipped":508,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: CSI Ephemeral-volume (default fs)] ephemeral
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Apr 13 11:52:52.216: INFO: Driver "test.csi.azure.com" does not support volume type "CSIInlineVolume" - skipping
... skipping 113 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (default fs)] subPath
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should be able to unmount after the subpath directory is deleted [LinuxOnly]
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:445[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]","total":37,"completed":9,"skipped":652,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[0mExternal Storage [Driver: test.csi.azure.com][0m [90m[Testpattern: Dynamic PV (block volmode)] multiVolume [Slow][0m 
  [1mshould concurrently access the single volume from pods on the same node[0m
  [37m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/multivolume.go:296[0m
... skipping 163 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow]
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should concurrently access the single volume from pods on the same node
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/multivolume.go:296[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should concurrently access the single volume from pods on the same node","total":36,"completed":8,"skipped":505,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Apr 13 11:54:08.829: INFO: Distro debian doesn't support ntfs -- skipping
... skipping 133 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed via chgrp in first pod, new pod with different fsgroup applied to the volume contents
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/fsgroupchangepolicy.go:214[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed via chgrp in first pod, new pod with different fsgroup applied to the volume contents","total":38,"completed":9,"skipped":814,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[0mExternal Storage [Driver: test.csi.azure.com][0m [90m[Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral[0m 
  [1mshould create read-only inline ephemeral volume[0m
  [37m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/ephemeral.go:173[0m
... skipping 49 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should create read-only inline ephemeral volume
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/ephemeral.go:173[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should create read-only inline ephemeral volume","total":38,"completed":10,"skipped":634,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Apr 13 11:55:01.629: INFO: Driver "test.csi.azure.com" does not support volume type "PreprovisionedPV" - skipping
... skipping 98 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (filesystem volmode)] volumeMode
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should not mount / map unused volumes in a pod [LinuxOnly]
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:352[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (filesystem volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]","total":37,"completed":10,"skipped":683,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: Pre-provisioned PV (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Apr 13 11:55:52.117: INFO: Driver "test.csi.azure.com" does not support volume type "PreprovisionedPV" - skipping
... skipping 153 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    (Always)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/fsgroupchangepolicy.go:214[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents","total":36,"completed":9,"skipped":611,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[0mExternal Storage [Driver: test.csi.azure.com][0m [90m[Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral[0m 
  [1mshould create read/write inline ephemeral volume[0m
  [37m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/ephemeral.go:194[0m
... skipping 51 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should create read/write inline ephemeral volume
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/ephemeral.go:194[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should create read/write inline ephemeral volume","total":38,"completed":10,"skipped":846,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Apr 13 11:56:42.719: INFO: Distro debian doesn't support ntfs -- skipping
... skipping 239 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow]
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should access to two volumes with the same volume mode and retain data across pod recreation on the same node
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/multivolume.go:136[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node","total":32,"completed":8,"skipped":660,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Apr 13 11:56:49.172: INFO: Driver "test.csi.azure.com" does not support volume type "InlineVolume" - skipping
... skipping 239 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow]
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should access to two volumes with different volume mode and retain data across pod recreation on different node
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/multivolume.go:246[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node","total":27,"completed":10,"skipped":797,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] volume-expand
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Apr 13 11:57:00.292: INFO: Driver "test.csi.azure.com" does not support volume expansion - skipping
... skipping 133 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed via chgrp in first pod, new pod with different fsgroup applied to the volume contents
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/fsgroupchangepolicy.go:214[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed via chgrp in first pod, new pod with different fsgroup applied to the volume contents","total":38,"completed":11,"skipped":671,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: Inline-volume (default fs)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Apr 13 11:57:17.307: INFO: Driver "test.csi.azure.com" does not support volume type "InlineVolume" - skipping
... skipping 83 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should support multiple inline ephemeral volumes
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/ephemeral.go:252[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should support multiple inline ephemeral volumes","total":36,"completed":10,"skipped":647,"failed":0}

[36mS[0m[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Apr 13 11:59:47.812: INFO: Distro debian doesn't support ntfs -- skipping
... skipping 237 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (block volmode)] volumeMode
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should not mount / map unused volumes in a pod [LinuxOnly]
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:352[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (block volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]","total":38,"completed":12,"skipped":747,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Apr 13 11:59:50.145: INFO: Distro debian doesn't support ntfs -- skipping
... skipping 190 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (ext3)] volumes
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should store data
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:159[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (ext3)] volumes should store data","total":37,"completed":11,"skipped":771,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Apr 13 12:00:17.621: INFO: Driver "test.csi.azure.com" does not support volume type "PreprovisionedPV" - skipping
... skipping 300 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow]
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should access to two volumes with the same volume mode and retain data across pod recreation on different node
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/multivolume.go:166[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node","total":38,"completed":11,"skipped":902,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: Pre-provisioned PV (block volmode)] volumeMode
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Apr 13 12:00:51.087: INFO: Driver "test.csi.azure.com" does not support volume type "PreprovisionedPV" - skipping
... skipping 3 lines ...

[36m[1mS [SKIPPING] in Spec Setup (BeforeEach) [0.001 seconds][0m
External Storage [Driver: test.csi.azure.com]
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Pre-provisioned PV (block volmode)] volumeMode
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    [36m[1mshould fail to use a volume in a pod with mismatched mode [Slow] [BeforeEach][0m
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:297[0m

    [36mDriver "test.csi.azure.com" does not support volume type "PreprovisionedPV" - skipping[0m

    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:262
[90m------------------------------[0m
... skipping 56 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should create read/write inline ephemeral volume
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/ephemeral.go:194[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should create read/write inline ephemeral volume","total":38,"completed":12,"skipped":934,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Apr 13 12:02:58.690: INFO: Driver "test.csi.azure.com" does not support volume type "PreprovisionedPV" - skipping
... skipping 245 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow]
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should access to two volumes with the same volume mode and retain data across pod recreation on the same node
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/multivolume.go:136[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node","total":37,"completed":12,"skipped":905,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] provisioning
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] provisioning
... skipping 119 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should support two pods which have the same volume definition
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/ephemeral.go:214[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should support two pods which have the same volume definition","total":27,"completed":11,"skipped":838,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[0mExternal Storage [Driver: test.csi.azure.com][0m [90m[Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow][0m 
  [1mshould concurrently access the single volume from pods on the same node[0m
  [37m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/multivolume.go:296[0m
... skipping 165 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow]
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should concurrently access the single volume from pods on the same node
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/multivolume.go:296[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should concurrently access the single volume from pods on the same node","total":36,"completed":11,"skipped":852,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
[1mSTEP[0m: Creating a kubernetes client
Apr 13 12:03:25.421: INFO: >>> kubeConfig: /root/tmp1956769959/kubeconfig/kubeconfig.westeurope.json
... skipping 253 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (ext4)] multiVolume [Slow]
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should access to two volumes with different volume mode and retain data across pod recreation on different node
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/multivolume.go:246[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node","total":32,"completed":9,"skipped":788,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow]
... skipping 98 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should support two pods which have the same volume definition
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/ephemeral.go:214[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral should support two pods which have the same volume definition","total":38,"completed":13,"skipped":794,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] volumeIO
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Apr 13 12:04:33.739: INFO: Driver "test.csi.azure.com" does not support volume type "PreprovisionedPV" - skipping
... skipping 76 lines ...

    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:262
[90m------------------------------[0m
[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[0mExternal Storage [Driver: test.csi.azure.com][0m [90m[Testpattern: Dynamic PV (default fs)] subPath[0m 
  [1mshould fail if non-existent subpath is outside the volume [Slow][LinuxOnly][0m
  [37m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:267[0m

[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
[1mSTEP[0m: Creating a kubernetes client
Apr 13 12:03:26.206: INFO: >>> kubeConfig: /root/tmp1956769959/kubeconfig/kubeconfig.westeurope.json
[1mSTEP[0m: Building a namespace api object, basename provisioning
[1mSTEP[0m: Waiting for a default service account to be provisioned in namespace
[It] should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:267
Apr 13 12:03:26.758: INFO: Creating resource for dynamic PV
Apr 13 12:03:26.758: INFO: Using claimSize:5Gi, test suite supported size:{ 1Mi}, driver(test.csi.azure.com) supported size:{ 1Mi} 
[1mSTEP[0m: creating a StorageClass provisioning-1615-e2e-scxzh2h
[1mSTEP[0m: creating a claim
Apr 13 12:03:26.869: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
Apr 13 12:03:26.982: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.comdg8v6] to have phase Bound
Apr 13 12:03:27.092: INFO: PersistentVolumeClaim test.csi.azure.comdg8v6 found but phase is Pending instead of Bound.
Apr 13 12:03:29.206: INFO: PersistentVolumeClaim test.csi.azure.comdg8v6 found but phase is Pending instead of Bound.
Apr 13 12:03:31.316: INFO: PersistentVolumeClaim test.csi.azure.comdg8v6 found and phase=Bound (4.333952995s)
[1mSTEP[0m: Creating pod pod-subpath-test-dynamicpv-w7b7
[1mSTEP[0m: Checking for subpath error in container status
Apr 13 12:04:03.874: INFO: Deleting pod "pod-subpath-test-dynamicpv-w7b7" in namespace "provisioning-1615"
Apr 13 12:04:03.987: INFO: Wait up to 5m0s for pod "pod-subpath-test-dynamicpv-w7b7" to be fully deleted
[1mSTEP[0m: Deleting pod
Apr 13 12:04:06.208: INFO: Deleting pod "pod-subpath-test-dynamicpv-w7b7" in namespace "provisioning-1615"
[1mSTEP[0m: Deleting pvc
Apr 13 12:04:06.318: INFO: Deleting PersistentVolumeClaim "test.csi.azure.comdg8v6"
... skipping 22 lines ...

[32m• [SLOW TEST:112.442 seconds][0m
External Storage [Driver: test.csi.azure.com]
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (default fs)] subPath
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:267[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]","total":36,"completed":12,"skipped":857,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Apr 13 12:05:18.681: INFO: Distro debian doesn't support ntfs -- skipping
... skipping 137 lines ...
Apr 13 12:09:24.092: INFO: PersistentVolume pvc-88a75255-8309-4275-9abf-6dac51d7a421 found and phase=Released (4m36.08635498s)
Apr 13 12:09:29.202: INFO: PersistentVolume pvc-88a75255-8309-4275-9abf-6dac51d7a421 found and phase=Released (4m41.196413419s)
Apr 13 12:09:34.313: INFO: PersistentVolume pvc-88a75255-8309-4275-9abf-6dac51d7a421 found and phase=Released (4m46.306727315s)
Apr 13 12:09:39.423: INFO: PersistentVolume pvc-88a75255-8309-4275-9abf-6dac51d7a421 found and phase=Released (4m51.416838568s)
Apr 13 12:09:44.532: INFO: PersistentVolume pvc-88a75255-8309-4275-9abf-6dac51d7a421 found and phase=Released (4m56.526526236s)
[1mSTEP[0m: Deleting sc
Apr 13 12:09:49.644: FAIL: while cleanup resource
Unexpected error:
    <errors.aggregate | len:1, cap:1>: [
        [
            {
                msg: "persistent Volume pvc-88a75255-8309-4275-9abf-6dac51d7a421 not deleted by dynamic provisioner: PersistentVolume pvc-88a75255-8309-4275-9abf-6dac51d7a421 still exists within 5m0s",
                err: {
                    s: "PersistentVolume pvc-88a75255-8309-4275-9abf-6dac51d7a421 still exists within 5m0s",
... skipping 43 lines ...
Apr 13 12:09:49.861: INFO: At 2022-04-13 12:04:36 +0000 UTC - event for pod-5074296f-a956-46a9-94e0-f49a55fc9656: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-4ff58721-3364-4ebb-81fe-f30e255224bb" 
Apr 13 12:09:49.861: INFO: At 2022-04-13 12:04:37 +0000 UTC - event for pod-5074296f-a956-46a9-94e0-f49a55fc9656: {kubelet k8s-agentpool1-19736391-vmss000001} Pulling: Pulling image "k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5"
Apr 13 12:09:49.861: INFO: At 2022-04-13 12:04:38 +0000 UTC - event for pod-5074296f-a956-46a9-94e0-f49a55fc9656: {kubelet k8s-agentpool1-19736391-vmss000001} Created: Created container write-pod
Apr 13 12:09:49.861: INFO: At 2022-04-13 12:04:38 +0000 UTC - event for pod-5074296f-a956-46a9-94e0-f49a55fc9656: {kubelet k8s-agentpool1-19736391-vmss000001} Pulled: Successfully pulled image "k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5" in 328.498088ms
Apr 13 12:09:49.861: INFO: At 2022-04-13 12:04:38 +0000 UTC - event for pod-5074296f-a956-46a9-94e0-f49a55fc9656: {kubelet k8s-agentpool1-19736391-vmss000001} Started: Started container write-pod
Apr 13 12:09:49.861: INFO: At 2022-04-13 12:04:43 +0000 UTC - event for pod-5074296f-a956-46a9-94e0-f49a55fc9656: {kubelet k8s-agentpool1-19736391-vmss000001} Killing: Stopping container write-pod
Apr 13 12:09:49.861: INFO: At 2022-04-13 12:04:44 +0000 UTC - event for pod-5074296f-a956-46a9-94e0-f49a55fc9656: {kubelet k8s-agentpool1-19736391-vmss000001} FailedKillPod: error killing pod: failed to "KillContainer" for "write-pod" with KillContainerError: "rpc error: code = Unknown desc = Error response from daemon: No such container: 519d2923ca930eac3af2f1c26138e0d66c624a0f49f1d18fd2d384b3c695997a"
Apr 13 12:09:49.861: INFO: At 2022-04-13 12:04:45 +0000 UTC - event for pod-c4c05a4b-3777-4508-aba6-7ec86e640f6c: {kubelet k8s-agentpool1-19736391-vmss000001} Killing: Stopping container write-pod
Apr 13 12:09:49.970: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Apr 13 12:09:49.970: INFO: 
Apr 13 12:09:50.187: INFO: 
Logging node info for node k8s-agentpool1-19736391-vmss000000
Apr 13 12:09:50.296: INFO: Node Info: &Node{ObjectMeta:{k8s-agentpool1-19736391-vmss000000    3af310e8-35f7-4b37-bdd3-247c6fe4ef9e 21849 0 2022-04-13 11:10:34 +0000 UTC <nil> <nil> map[agentpool:agentpool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D8s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westeurope failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-rdni2sdm kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:k8s-agentpool1-19736391-vmss000000 kubernetes.io/os:linux kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D8s_v3 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:westeurope topology.kubernetes.io/zone:0 topology.test.csi.azure.com/zone:] map[csi.volume.kubernetes.io/nodeid:{"test.csi.azure.com":"k8s-agentpool1-19736391-vmss000000"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  [{Go-http-client Update v1 2022-04-13 11:10:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:storageprofile":{},"f:storagetier":{}}}} } {kubectl-label Update v1 2022-04-13 11:10:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}} } {kube-controller-manager Update v1 2022-04-13 11:10:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}}}} } {cloud-controller-manager Update v1 2022-04-13 11:11:40 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {cloud-node-manager Update v1 2022-04-13 11:12:12 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {Go-http-client Update v1 2022-04-13 12:06:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.test.csi.azure.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-rdni2sdm/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-19736391-vmss/virtualMachines/0,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{31036686336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{33672699904 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{27933017657 0} {<nil>} 27933017657 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{32886267904 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-04-13 11:11:40 +0000 UTC,LastTransitionTime:2022-04-13 11:11:40 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-04-13 12:06:08 +0000 UTC,LastTransitionTime:2022-04-13 11:10:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-04-13 12:06:08 +0000 UTC,LastTransitionTime:2022-04-13 11:10:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-04-13 12:06:08 +0000 UTC,LastTransitionTime:2022-04-13 11:10:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-04-13 12:06:08 +0000 UTC,LastTransitionTime:2022-04-13 11:10:50 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.240.0.4,},NodeAddress{Type:Hostname,Address:k8s-agentpool1-19736391-vmss000000,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e716e235ec814a7fb3b0ac083f9dc382,SystemUUID:140f23e2-f7f7-d449-b4d3-e7c24fbe93ca,BootID:0e7ea254-2933-4dc3-9abc-e762ba49d8ce,KernelVersion:5.4.0-1074-azure,OSImage:Ubuntu 18.04.6 LTS,ContainerRuntimeVersion:docker://20.10.11+azure-3,KubeletVersion:v1.23.4,KubeProxyVersion:v1.23.4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8sprow.azurecr.io/azuredisk-csi@sha256:5340006cdb009cca9c71016ff7916dcedceb5811fbd82263cdb8ee490a0e1cb2 k8sprow.azurecr.io/azuredisk-csi:v1.16.0-eb7e0710ddbc5984b82c0c8453e3a2427fa2a635],SizeBytes:260029022,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/azuredisk-csi@sha256:423eb6cf602c064c8b2deefead5ceadd6324ed41b3d995dab5d0f6f0f4d4710f mcr.microsoft.com/oss/kubernetes-csi/azuredisk-csi:v1.10.0],SizeBytes:245959792,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/azurefile-csi@sha256:9e2ecabcf9dd9943e6600eb9fb460f45b4dc61af7cabe95d115082a029db2aaf mcr.microsoft.com/oss/kubernetes-csi/azurefile-csi:v1.9.0],SizeBytes:230470852,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/azure-npm@sha256:106f669f48e5e80c4ec0afb49858ead72cf4b901cd8664e7bf81f8d789e56e12 mcr.microsoft.com/containernetworking/azure-npm:v1.2.2_hotfix],SizeBytes:175230380,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:d342e90a94c0ab05c3ae91928003ba63e0c28e1ba004070cf14ea2b2af128b2f mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.23.4],SizeBytes:135131005,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:d9cca16cbbcf06ef2e4b8c5036c78d21067c932c5b52b0803be635af1b9623fd mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.23.4],SizeBytes:124940480,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:5b3a9f1c71c09c00649d8374224642ff7029ce91a721ec9132e6ed45fa73fd43 k8s.gcr.io/e2e-test-images/agnhost:2.33],SizeBytes:124717420,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver@sha256:c0d040a1c4fbfceb65663e31c09ea40f4f78e356437610cbc3fbb4bb409bd6f1 mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver:v0.0.19],SizeBytes:123229697,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:fedcc4ef0f998031928815d63c82c3f2bcae67c89acad31c5cb2da2a849cbe6a mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.23.4],SizeBytes:112312797,},ContainerImage{Names:[mcr.microsoft.com/oss/azure/secrets-store/provider-azure@sha256:6f67f3d0c7cdde5702f8ce7f101b6519daa0237f0c34fecb7c058b6af8c22ad1 mcr.microsoft.com/oss/azure/secrets-store/provider-azure:0.0.12],SizeBytes:101061355,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:6f0c680d375c62e74351f8ff3ed6ddb9b72ca759e0645c329b95f64264654a6d mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.22.1],SizeBytes:99962810,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-addon-manager@sha256:32e2836018c96e73533bd4642fe438e465b81dcbfa8b7b61935a6f4d0246c7ae mcr.microsoft.com/oss/kubernetes/kube-addon-manager:v9.1.3],SizeBytes:86832059,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-addon-manager@sha256:92c2c5aad9012ee32d2a43a74966cc0adc6ccb1705ad15abb10485ecf406d88b mcr.microsoft.com/oss/kubernetes/kube-addon-manager:v9.1.5],SizeBytes:84094027,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/metrics-server@sha256:1ef9d57ce41ffcc328b92494c3bfafe401e0b9a1694a295301a1385337d52815 mcr.microsoft.com/oss/kubernetes/metrics-server:v0.5.2],SizeBytes:64327621,},ContainerImage{Names:[mcr.microsoft.com/oss/nvidia/k8s-device-plugin@sha256:0f5b52bf28239234e831697d96db63ac03cde70fe68058f964504ab7564ee810 mcr.microsoft.com/oss/nvidia/k8s-device-plugin:1.0.0-beta6],SizeBytes:64160241,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner@sha256:542c9258a1441e4927883ea73425e21f9a14043a649686bf6b51700f34c64f8e mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner:v3.1.0],SizeBytes:57858438,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner@sha256:e9ddadc44ba87a4a27f67e54760a14f9986885b534b3dff170a14eae1e35d213 mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner:v3.0.0],SizeBytes:56881280,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-resizer@sha256:ab6c2e18a4d943f2bf8688e1779622277a1d14c355c9d4bfc0d761d86c5108b3 mcr.microsoft.com/oss/kubernetes-csi/csi-resizer:v1.4.0],SizeBytes:55577322,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter@sha256:a889e925e15f9423f7842f1b769f64cbcf6a20b6956122836fc835cf22d9073f mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter:v5.0.1],SizeBytes:55314459,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-attacher@sha256:19fbca01394f7ed80151731180cfde0a3367f038beae2a97cda7928034010057 mcr.microsoft.com/oss/kubernetes-csi/csi-attacher:v3.4.0],SizeBytes:54954134,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-resizer@sha256:c5bb71ceaac60b1a4b58739fa07b709f6248c452ff6272a384d2f7648895a750 mcr.microsoft.com/oss/kubernetes-csi/csi-resizer:v1.3.0],SizeBytes:54313772,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter@sha256:61849a026511cf332c87d73d0a7aed803b510c3ede197ec755389686d490de72 mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter:v4.2.1],SizeBytes:54210936,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-attacher@sha256:6b41e7153ebdfdc1501aa65184624bc15fd33a52d93f88ec3a758d0f8c9b8c10 mcr.microsoft.com/oss/kubernetes-csi/csi-attacher:v3.3.0],SizeBytes:53842561,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:027ae89899f04c04c891d605b215e0c0e2bfd92a60ad6cdd77a2fa15afb063e6 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.23.4],SizeBytes:53461183,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/snapshot-controller@sha256:8c3fc3c2667004ad6bbdf723bb64c5da66a5cb8b11d4ee59b67179b686223b13 mcr.microsoft.com/oss/kubernetes-csi/snapshot-controller:v5.0.1],SizeBytes:52732401,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/snapshot-controller@sha256:be5a8dc1f990828f653c77bd0a0f1bbd13197c3019f6e1d99d590389bac36705 mcr.microsoft.com/oss/kubernetes-csi/snapshot-controller:v4.2.1],SizeBytes:51575245,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager@sha256:0ad67f9919522a07318034641ae09bf2079b417e9944c65914410594ce645468 mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager:v1.1.4],SizeBytes:51478397,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager@sha256:31ec4f7daccd3e7a8504e12657d7830651ecacbe4a487daca1b1b7695a64b070 mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager:v1.23.1],SizeBytes:51249021,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:011712ed90fb8efcf27928b0a47ed04b98baebb31cb1b2d8ab676977ec18eedc mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v1.1.4],SizeBytes:50868093,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:0f9a8fbaed65192ed7dd795be4f9c1dc48ebdef0a241fb62d456f4bed40d9875 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v1.23.1],SizeBytes:50679677,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/ip-masq-agent@sha256:1244155f2ed3f33ff154cc343b8ad285f3391d95afd7d4b1c6dcc420bc0ba3cf mcr.microsoft.com/oss/kubernetes/ip-masq-agent:v2.5.0],SizeBytes:50146762,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager@sha256:7c907ff70b90a0bdf8fae63bd744018469dd9839cde1fd0515b93e0bbd14b34e mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager:v1.0.8],SizeBytes:48963453,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:3987d7a8c6922ce1952ee19c5cb6ea75aac7b7c1b07aa79277ad038c69fb7a31 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v1.0.8],SizeBytes:48349053,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/coredns@sha256:f873bf7f0928461efe10697fa76cf0ad7a1ae3041c5b57b50dd3d0b72d273f8c mcr.microsoft.com/oss/kubernetes/coredns:1.8.6],SizeBytes:46804601,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager@sha256:8073113a20882642a980b338635cdc5945e5673a18aef192090e6fde2b89a75c mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager:v0.6.0],SizeBytes:45909032,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:6a32329628bdea3c6d75e98aad6155b65d2e2b98ca616eb33f9ac562912804c6 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.6.0],SizeBytes:45229096,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager@sha256:ef6c4ba564b4d11d270f7d1563c50fbeb30ccc3b94146e5059228c49f95875f5 mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager:v0.7.11],SizeBytes:44916605,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:dbcc384758ba5ca6d249596d471292ed3785e31cdb854d48b84d70794b669b4c mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.7.11],SizeBytes:43679613,},ContainerImage{Names:[mcr.microsoft.com/oss/etcd-io/etcd@sha256:cf587862e3f1b6fa4d9a2565520a34f164bdf72c50f37af8c3c668160593246e mcr.microsoft.com/oss/etcd-io/etcd:v3.3.25],SizeBytes:41832119,},ContainerImage{Names:[mcr.microsoft.com/k8s/aad-pod-identity/mic@sha256:bd9465be94966b9a917e1e3904fa5e63dd91772ccadf304e18ffd8e4ad8ccedd mcr.microsoft.com/k8s/aad-pod-identity/mic:1.6.1],SizeBytes:41374894,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-proportional-autoscaler@sha256:c849d75d61943ce7f51b4c049f1a79d19a08253966c8f49c4cfb6414cc33db8b mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-proportional-autoscaler:1.8.5],SizeBytes:40661903,},ContainerImage{Names:[mcr.microsoft.com/k8s/aad-pod-identity/nmi@sha256:02128fefcdb7593ac53fc342e2c53a0fc6fabd813036bf60457bf43cc2940116 mcr.microsoft.com/k8s/aad-pod-identity/nmi:1.6.1],SizeBytes:38007982,},ContainerImage{Names:[mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume@sha256:921f301c44dda06a325164accf22e78ecc570b5c7d9d6ee4c66bd8cbb2b60b9a mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume:v0.0.16],SizeBytes:26970670,},ContainerImage{Names:[mcr.microsoft.com/k8s/kms/keyvault@sha256:1a27e175f8c125209e32d2957b5509fe20757bd8cb309ff9da598799b56326fb mcr.microsoft.com/k8s/kms/keyvault:v0.0.10],SizeBytes:23077387,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:dbec3a8166686b09b242176ab5b99e993da4126438bbce68147c3fd654f35662 mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v2.4.0],SizeBytes:19547289,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:c96a6255c42766f6b8bb1a7cda02b0060ab1b20b2e2dafcc64ec09e7646745a6 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.5.0],SizeBytes:17573341,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:16028126,},ContainerImage{Names:[mcr.microsoft.com/oss/busybox/busybox@sha256:582a641242b49809af3a1a522f9aae8c3f047d1c6ca1dd9d8cdabd349e45b1a9 mcr.microsoft.com/oss/busybox/busybox:1.33.1],SizeBytes:1235829,},ContainerImage{Names:[mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume@sha256:23d8c6033f02a1ecad05127ebdc931bb871264228661bc122704b0974e4d9fdd mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume:1.0.8],SizeBytes:1159025,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:1154361,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
... skipping 113 lines ...
  [Testpattern: Dynamic PV (ext4)] multiVolume [Slow]
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    [91m[1mshould concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS] [Measurement][0m
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/multivolume.go:376[0m

    [91mApr 13 12:09:49.644: while cleanup resource
    Unexpected error:
        <errors.aggregate | len:1, cap:1>: [
            [
                {
                    msg: "persistent Volume pvc-88a75255-8309-4275-9abf-6dac51d7a421 not deleted by dynamic provisioner: PersistentVolume pvc-88a75255-8309-4275-9abf-6dac51d7a421 still exists within 5m0s",
                    err: {
                        s: "PersistentVolume pvc-88a75255-8309-4275-9abf-6dac51d7a421 still exists within 5m0s",
... skipping 3 lines ...
        ]
        persistent Volume pvc-88a75255-8309-4275-9abf-6dac51d7a421 not deleted by dynamic provisioner: PersistentVolume pvc-88a75255-8309-4275-9abf-6dac51d7a421 still exists within 5m0s
    occurred[0m

    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/multivolume.go:127
[90m------------------------------[0m
{"msg":"FAILED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]","total":27,"completed":11,"skipped":865,"failed":1,"failures":["External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]"]}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[0mExternal Storage [Driver: test.csi.azure.com][0m [90m[Testpattern: Dynamic PV (default fs)] subPath[0m 
  [1mshould support readOnly directory specified in the volumeMount[0m
  [37m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:365[0m
... skipping 16 lines ...
Apr 13 12:05:19.603: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.comfzf5k] to have phase Bound
Apr 13 12:05:19.712: INFO: PersistentVolumeClaim test.csi.azure.comfzf5k found but phase is Pending instead of Bound.
Apr 13 12:05:21.823: INFO: PersistentVolumeClaim test.csi.azure.comfzf5k found but phase is Pending instead of Bound.
Apr 13 12:05:23.933: INFO: PersistentVolumeClaim test.csi.azure.comfzf5k found and phase=Bound (4.330093336s)
[1mSTEP[0m: Creating pod pod-subpath-test-dynamicpv-zw2r
[1mSTEP[0m: Creating a pod to test subpath
Apr 13 12:05:24.278: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-zw2r" in namespace "provisioning-9982" to be "Succeeded or Failed"
Apr 13 12:05:24.388: INFO: Pod "pod-subpath-test-dynamicpv-zw2r": Phase="Pending", Reason="", readiness=false. Elapsed: 110.03591ms
Apr 13 12:05:26.500: INFO: Pod "pod-subpath-test-dynamicpv-zw2r": Phase="Pending", Reason="", readiness=false. Elapsed: 2.221188675s
Apr 13 12:05:28.610: INFO: Pod "pod-subpath-test-dynamicpv-zw2r": Phase="Pending", Reason="", readiness=false. Elapsed: 4.331703296s
Apr 13 12:05:30.721: INFO: Pod "pod-subpath-test-dynamicpv-zw2r": Phase="Pending", Reason="", readiness=false. Elapsed: 6.442365508s
Apr 13 12:05:32.831: INFO: Pod "pod-subpath-test-dynamicpv-zw2r": Phase="Pending", Reason="", readiness=false. Elapsed: 8.553043757s
Apr 13 12:05:34.944: INFO: Pod "pod-subpath-test-dynamicpv-zw2r": Phase="Pending", Reason="", readiness=false. Elapsed: 10.665192458s
... skipping 3 lines ...
Apr 13 12:05:43.389: INFO: Pod "pod-subpath-test-dynamicpv-zw2r": Phase="Pending", Reason="", readiness=false. Elapsed: 19.110978504s
Apr 13 12:05:45.500: INFO: Pod "pod-subpath-test-dynamicpv-zw2r": Phase="Pending", Reason="", readiness=false. Elapsed: 21.221933418s
Apr 13 12:05:47.611: INFO: Pod "pod-subpath-test-dynamicpv-zw2r": Phase="Pending", Reason="", readiness=false. Elapsed: 23.332806617s
Apr 13 12:05:49.723: INFO: Pod "pod-subpath-test-dynamicpv-zw2r": Phase="Pending", Reason="", readiness=false. Elapsed: 25.444477928s
Apr 13 12:05:51.838: INFO: Pod "pod-subpath-test-dynamicpv-zw2r": Phase="Succeeded", Reason="", readiness=false. Elapsed: 27.559961628s
[1mSTEP[0m: Saw pod success
Apr 13 12:05:51.838: INFO: Pod "pod-subpath-test-dynamicpv-zw2r" satisfied condition "Succeeded or Failed"
Apr 13 12:05:51.948: INFO: Trying to get logs from node k8s-agentpool1-19736391-vmss000002 pod pod-subpath-test-dynamicpv-zw2r container test-container-subpath-dynamicpv-zw2r: <nil>
[1mSTEP[0m: delete the pod
Apr 13 12:05:52.207: INFO: Waiting for pod pod-subpath-test-dynamicpv-zw2r to disappear
Apr 13 12:05:52.317: INFO: Pod pod-subpath-test-dynamicpv-zw2r no longer exists
[1mSTEP[0m: Deleting pod pod-subpath-test-dynamicpv-zw2r
Apr 13 12:05:52.317: INFO: Deleting pod "pod-subpath-test-dynamicpv-zw2r" in namespace "provisioning-9982"
... skipping 59 lines ...
Apr 13 12:10:28.766: INFO: PersistentVolume pvc-938c3782-1d90-471e-bff4-35d3edd12d83 found and phase=Released (4m36.117776515s)
Apr 13 12:10:33.879: INFO: PersistentVolume pvc-938c3782-1d90-471e-bff4-35d3edd12d83 found and phase=Released (4m41.230712669s)
Apr 13 12:10:38.990: INFO: PersistentVolume pvc-938c3782-1d90-471e-bff4-35d3edd12d83 found and phase=Released (4m46.342258965s)
Apr 13 12:10:44.100: INFO: PersistentVolume pvc-938c3782-1d90-471e-bff4-35d3edd12d83 found and phase=Released (4m51.452580354s)
Apr 13 12:10:49.211: INFO: PersistentVolume pvc-938c3782-1d90-471e-bff4-35d3edd12d83 found and phase=Released (4m56.563474471s)
[1mSTEP[0m: Deleting sc
Apr 13 12:10:54.324: FAIL: while cleaning up resource
Unexpected error:
    <errors.aggregate | len:1, cap:1>: [
        [
            {
                msg: "persistent Volume pvc-938c3782-1d90-471e-bff4-35d3edd12d83 not deleted by dynamic provisioner: PersistentVolume pvc-938c3782-1d90-471e-bff4-35d3edd12d83 still exists within 5m0s",
                err: {
                    s: "PersistentVolume pvc-938c3782-1d90-471e-bff4-35d3edd12d83 still exists within 5m0s",
... skipping 35 lines ...
Apr 13 12:10:54.543: INFO: At 2022-04-13 12:05:49 +0000 UTC - event for pod-subpath-test-dynamicpv-zw2r: {kubelet k8s-agentpool1-19736391-vmss000002} Created: Created container test-init-volume-dynamicpv-zw2r
Apr 13 12:10:54.543: INFO: At 2022-04-13 12:05:49 +0000 UTC - event for pod-subpath-test-dynamicpv-zw2r: {kubelet k8s-agentpool1-19736391-vmss000002} Started: Started container test-init-volume-dynamicpv-zw2r
Apr 13 12:10:54.543: INFO: At 2022-04-13 12:05:50 +0000 UTC - event for pod-subpath-test-dynamicpv-zw2r: {kubelet k8s-agentpool1-19736391-vmss000002} Created: Created container test-container-subpath-dynamicpv-zw2r
Apr 13 12:10:54.543: INFO: At 2022-04-13 12:05:50 +0000 UTC - event for pod-subpath-test-dynamicpv-zw2r: {kubelet k8s-agentpool1-19736391-vmss000002} Pulling: Pulling image "k8s.gcr.io/e2e-test-images/agnhost:2.33"
Apr 13 12:10:54.543: INFO: At 2022-04-13 12:05:50 +0000 UTC - event for pod-subpath-test-dynamicpv-zw2r: {kubelet k8s-agentpool1-19736391-vmss000002} Pulled: Successfully pulled image "k8s.gcr.io/e2e-test-images/agnhost:2.33" in 305.347568ms
Apr 13 12:10:54.543: INFO: At 2022-04-13 12:05:51 +0000 UTC - event for pod-subpath-test-dynamicpv-zw2r: {kubelet k8s-agentpool1-19736391-vmss000002} Started: Started container test-container-subpath-dynamicpv-zw2r
Apr 13 12:10:54.543: INFO: At 2022-04-13 12:05:51 +0000 UTC - event for pod-subpath-test-dynamicpv-zw2r: {kubelet k8s-agentpool1-19736391-vmss000002} FailedMount: MountVolume.SetUp failed for volume "kube-api-access-845dx" : object "provisioning-9982"/"kube-root-ca.crt" not registered
Apr 13 12:10:54.654: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Apr 13 12:10:54.654: INFO: 
Apr 13 12:10:54.873: INFO: 
Logging node info for node k8s-agentpool1-19736391-vmss000000
Apr 13 12:10:54.983: INFO: Node Info: &Node{ObjectMeta:{k8s-agentpool1-19736391-vmss000000    3af310e8-35f7-4b37-bdd3-247c6fe4ef9e 22318 0 2022-04-13 11:10:34 +0000 UTC <nil> <nil> map[agentpool:agentpool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D8s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westeurope failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-rdni2sdm kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:k8s-agentpool1-19736391-vmss000000 kubernetes.io/os:linux kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D8s_v3 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:westeurope topology.kubernetes.io/zone:0 topology.test.csi.azure.com/zone:] map[csi.volume.kubernetes.io/nodeid:{"test.csi.azure.com":"k8s-agentpool1-19736391-vmss000000"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  [{Go-http-client Update v1 2022-04-13 11:10:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:storageprofile":{},"f:storagetier":{}}}} } {kubectl-label Update v1 2022-04-13 11:10:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}} } {kube-controller-manager Update v1 2022-04-13 11:10:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}}}} } {cloud-controller-manager Update v1 2022-04-13 11:11:40 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {cloud-node-manager Update v1 2022-04-13 11:12:12 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {Go-http-client Update v1 2022-04-13 12:10:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.test.csi.azure.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-rdni2sdm/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-19736391-vmss/virtualMachines/0,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{31036686336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{33672699904 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{27933017657 0} {<nil>} 27933017657 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{32886267904 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-04-13 11:11:40 +0000 UTC,LastTransitionTime:2022-04-13 11:11:40 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-04-13 12:10:02 +0000 UTC,LastTransitionTime:2022-04-13 11:10:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-04-13 12:10:02 +0000 UTC,LastTransitionTime:2022-04-13 11:10:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-04-13 12:10:02 +0000 UTC,LastTransitionTime:2022-04-13 11:10:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-04-13 12:10:02 +0000 UTC,LastTransitionTime:2022-04-13 11:10:50 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.240.0.4,},NodeAddress{Type:Hostname,Address:k8s-agentpool1-19736391-vmss000000,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e716e235ec814a7fb3b0ac083f9dc382,SystemUUID:140f23e2-f7f7-d449-b4d3-e7c24fbe93ca,BootID:0e7ea254-2933-4dc3-9abc-e762ba49d8ce,KernelVersion:5.4.0-1074-azure,OSImage:Ubuntu 18.04.6 LTS,ContainerRuntimeVersion:docker://20.10.11+azure-3,KubeletVersion:v1.23.4,KubeProxyVersion:v1.23.4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8sprow.azurecr.io/azuredisk-csi@sha256:5340006cdb009cca9c71016ff7916dcedceb5811fbd82263cdb8ee490a0e1cb2 k8sprow.azurecr.io/azuredisk-csi:v1.16.0-eb7e0710ddbc5984b82c0c8453e3a2427fa2a635],SizeBytes:260029022,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/azuredisk-csi@sha256:423eb6cf602c064c8b2deefead5ceadd6324ed41b3d995dab5d0f6f0f4d4710f mcr.microsoft.com/oss/kubernetes-csi/azuredisk-csi:v1.10.0],SizeBytes:245959792,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/azurefile-csi@sha256:9e2ecabcf9dd9943e6600eb9fb460f45b4dc61af7cabe95d115082a029db2aaf mcr.microsoft.com/oss/kubernetes-csi/azurefile-csi:v1.9.0],SizeBytes:230470852,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/azure-npm@sha256:106f669f48e5e80c4ec0afb49858ead72cf4b901cd8664e7bf81f8d789e56e12 mcr.microsoft.com/containernetworking/azure-npm:v1.2.2_hotfix],SizeBytes:175230380,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:d342e90a94c0ab05c3ae91928003ba63e0c28e1ba004070cf14ea2b2af128b2f mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.23.4],SizeBytes:135131005,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:d9cca16cbbcf06ef2e4b8c5036c78d21067c932c5b52b0803be635af1b9623fd mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.23.4],SizeBytes:124940480,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:5b3a9f1c71c09c00649d8374224642ff7029ce91a721ec9132e6ed45fa73fd43 k8s.gcr.io/e2e-test-images/agnhost:2.33],SizeBytes:124717420,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver@sha256:c0d040a1c4fbfceb65663e31c09ea40f4f78e356437610cbc3fbb4bb409bd6f1 mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver:v0.0.19],SizeBytes:123229697,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:fedcc4ef0f998031928815d63c82c3f2bcae67c89acad31c5cb2da2a849cbe6a mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.23.4],SizeBytes:112312797,},ContainerImage{Names:[mcr.microsoft.com/oss/azure/secrets-store/provider-azure@sha256:6f67f3d0c7cdde5702f8ce7f101b6519daa0237f0c34fecb7c058b6af8c22ad1 mcr.microsoft.com/oss/azure/secrets-store/provider-azure:0.0.12],SizeBytes:101061355,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:6f0c680d375c62e74351f8ff3ed6ddb9b72ca759e0645c329b95f64264654a6d mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.22.1],SizeBytes:99962810,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-addon-manager@sha256:32e2836018c96e73533bd4642fe438e465b81dcbfa8b7b61935a6f4d0246c7ae mcr.microsoft.com/oss/kubernetes/kube-addon-manager:v9.1.3],SizeBytes:86832059,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-addon-manager@sha256:92c2c5aad9012ee32d2a43a74966cc0adc6ccb1705ad15abb10485ecf406d88b mcr.microsoft.com/oss/kubernetes/kube-addon-manager:v9.1.5],SizeBytes:84094027,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/metrics-server@sha256:1ef9d57ce41ffcc328b92494c3bfafe401e0b9a1694a295301a1385337d52815 mcr.microsoft.com/oss/kubernetes/metrics-server:v0.5.2],SizeBytes:64327621,},ContainerImage{Names:[mcr.microsoft.com/oss/nvidia/k8s-device-plugin@sha256:0f5b52bf28239234e831697d96db63ac03cde70fe68058f964504ab7564ee810 mcr.microsoft.com/oss/nvidia/k8s-device-plugin:1.0.0-beta6],SizeBytes:64160241,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner@sha256:542c9258a1441e4927883ea73425e21f9a14043a649686bf6b51700f34c64f8e mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner:v3.1.0],SizeBytes:57858438,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner@sha256:e9ddadc44ba87a4a27f67e54760a14f9986885b534b3dff170a14eae1e35d213 mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner:v3.0.0],SizeBytes:56881280,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-resizer@sha256:ab6c2e18a4d943f2bf8688e1779622277a1d14c355c9d4bfc0d761d86c5108b3 mcr.microsoft.com/oss/kubernetes-csi/csi-resizer:v1.4.0],SizeBytes:55577322,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter@sha256:a889e925e15f9423f7842f1b769f64cbcf6a20b6956122836fc835cf22d9073f mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter:v5.0.1],SizeBytes:55314459,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-attacher@sha256:19fbca01394f7ed80151731180cfde0a3367f038beae2a97cda7928034010057 mcr.microsoft.com/oss/kubernetes-csi/csi-attacher:v3.4.0],SizeBytes:54954134,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-resizer@sha256:c5bb71ceaac60b1a4b58739fa07b709f6248c452ff6272a384d2f7648895a750 mcr.microsoft.com/oss/kubernetes-csi/csi-resizer:v1.3.0],SizeBytes:54313772,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter@sha256:61849a026511cf332c87d73d0a7aed803b510c3ede197ec755389686d490de72 mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter:v4.2.1],SizeBytes:54210936,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-attacher@sha256:6b41e7153ebdfdc1501aa65184624bc15fd33a52d93f88ec3a758d0f8c9b8c10 mcr.microsoft.com/oss/kubernetes-csi/csi-attacher:v3.3.0],SizeBytes:53842561,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:027ae89899f04c04c891d605b215e0c0e2bfd92a60ad6cdd77a2fa15afb063e6 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.23.4],SizeBytes:53461183,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/snapshot-controller@sha256:8c3fc3c2667004ad6bbdf723bb64c5da66a5cb8b11d4ee59b67179b686223b13 mcr.microsoft.com/oss/kubernetes-csi/snapshot-controller:v5.0.1],SizeBytes:52732401,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/snapshot-controller@sha256:be5a8dc1f990828f653c77bd0a0f1bbd13197c3019f6e1d99d590389bac36705 mcr.microsoft.com/oss/kubernetes-csi/snapshot-controller:v4.2.1],SizeBytes:51575245,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager@sha256:0ad67f9919522a07318034641ae09bf2079b417e9944c65914410594ce645468 mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager:v1.1.4],SizeBytes:51478397,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager@sha256:31ec4f7daccd3e7a8504e12657d7830651ecacbe4a487daca1b1b7695a64b070 mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager:v1.23.1],SizeBytes:51249021,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:011712ed90fb8efcf27928b0a47ed04b98baebb31cb1b2d8ab676977ec18eedc mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v1.1.4],SizeBytes:50868093,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:0f9a8fbaed65192ed7dd795be4f9c1dc48ebdef0a241fb62d456f4bed40d9875 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v1.23.1],SizeBytes:50679677,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/ip-masq-agent@sha256:1244155f2ed3f33ff154cc343b8ad285f3391d95afd7d4b1c6dcc420bc0ba3cf mcr.microsoft.com/oss/kubernetes/ip-masq-agent:v2.5.0],SizeBytes:50146762,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager@sha256:7c907ff70b90a0bdf8fae63bd744018469dd9839cde1fd0515b93e0bbd14b34e mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager:v1.0.8],SizeBytes:48963453,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:3987d7a8c6922ce1952ee19c5cb6ea75aac7b7c1b07aa79277ad038c69fb7a31 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v1.0.8],SizeBytes:48349053,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/coredns@sha256:f873bf7f0928461efe10697fa76cf0ad7a1ae3041c5b57b50dd3d0b72d273f8c mcr.microsoft.com/oss/kubernetes/coredns:1.8.6],SizeBytes:46804601,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager@sha256:8073113a20882642a980b338635cdc5945e5673a18aef192090e6fde2b89a75c mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager:v0.6.0],SizeBytes:45909032,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:6a32329628bdea3c6d75e98aad6155b65d2e2b98ca616eb33f9ac562912804c6 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.6.0],SizeBytes:45229096,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager@sha256:ef6c4ba564b4d11d270f7d1563c50fbeb30ccc3b94146e5059228c49f95875f5 mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager:v0.7.11],SizeBytes:44916605,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:dbcc384758ba5ca6d249596d471292ed3785e31cdb854d48b84d70794b669b4c mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.7.11],SizeBytes:43679613,},ContainerImage{Names:[mcr.microsoft.com/oss/etcd-io/etcd@sha256:cf587862e3f1b6fa4d9a2565520a34f164bdf72c50f37af8c3c668160593246e mcr.microsoft.com/oss/etcd-io/etcd:v3.3.25],SizeBytes:41832119,},ContainerImage{Names:[mcr.microsoft.com/k8s/aad-pod-identity/mic@sha256:bd9465be94966b9a917e1e3904fa5e63dd91772ccadf304e18ffd8e4ad8ccedd mcr.microsoft.com/k8s/aad-pod-identity/mic:1.6.1],SizeBytes:41374894,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-proportional-autoscaler@sha256:c849d75d61943ce7f51b4c049f1a79d19a08253966c8f49c4cfb6414cc33db8b mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-proportional-autoscaler:1.8.5],SizeBytes:40661903,},ContainerImage{Names:[mcr.microsoft.com/k8s/aad-pod-identity/nmi@sha256:02128fefcdb7593ac53fc342e2c53a0fc6fabd813036bf60457bf43cc2940116 mcr.microsoft.com/k8s/aad-pod-identity/nmi:1.6.1],SizeBytes:38007982,},ContainerImage{Names:[mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume@sha256:921f301c44dda06a325164accf22e78ecc570b5c7d9d6ee4c66bd8cbb2b60b9a mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume:v0.0.16],SizeBytes:26970670,},ContainerImage{Names:[mcr.microsoft.com/k8s/kms/keyvault@sha256:1a27e175f8c125209e32d2957b5509fe20757bd8cb309ff9da598799b56326fb mcr.microsoft.com/k8s/kms/keyvault:v0.0.10],SizeBytes:23077387,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:dbec3a8166686b09b242176ab5b99e993da4126438bbce68147c3fd654f35662 mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v2.4.0],SizeBytes:19547289,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:c96a6255c42766f6b8bb1a7cda02b0060ab1b20b2e2dafcc64ec09e7646745a6 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.5.0],SizeBytes:17573341,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:16028126,},ContainerImage{Names:[mcr.microsoft.com/oss/busybox/busybox@sha256:582a641242b49809af3a1a522f9aae8c3f047d1c6ca1dd9d8cdabd349e45b1a9 mcr.microsoft.com/oss/busybox/busybox:1.33.1],SizeBytes:1235829,},ContainerImage{Names:[mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume@sha256:23d8c6033f02a1ecad05127ebdc931bb871264228661bc122704b0974e4d9fdd mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume:1.0.8],SizeBytes:1159025,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:1154361,},},VolumesInUse:[kubernetes.io/csi/test.csi.azure.com^/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-rdni2sdm/providers/Microsoft.Compute/disks/pvc-ea38d7e9-6ee6-4d3c-b304-e86b5f0cb1ee],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Apr 13 12:10:54.984: INFO: 
... skipping 114 lines ...
  [Testpattern: Dynamic PV (default fs)] subPath
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    [91m[1mshould support readOnly directory specified in the volumeMount [Measurement][0m
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:365[0m

    [91mApr 13 12:10:54.324: while cleaning up resource
    Unexpected error:
        <errors.aggregate | len:1, cap:1>: [
            [
                {
                    msg: "persistent Volume pvc-938c3782-1d90-471e-bff4-35d3edd12d83 not deleted by dynamic provisioner: PersistentVolume pvc-938c3782-1d90-471e-bff4-35d3edd12d83 still exists within 5m0s",
                    err: {
                        s: "PersistentVolume pvc-938c3782-1d90-471e-bff4-35d3edd12d83 still exists within 5m0s",
... skipping 3 lines ...
        ]
        persistent Volume pvc-938c3782-1d90-471e-bff4-35d3edd12d83 not deleted by dynamic provisioner: PersistentVolume pvc-938c3782-1d90-471e-bff4-35d3edd12d83 still exists within 5m0s
    occurred[0m

    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:183
[90m------------------------------[0m
{"msg":"FAILED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath should support readOnly directory specified in the volumeMount","total":36,"completed":12,"skipped":1023,"failed":1,"failures":["External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath should support readOnly directory specified in the volumeMount"]}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
Apr 13 12:10:57.985: INFO: Running AfterSuite actions on all nodes
Apr 13 12:10:57.985: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage.glob..func18.2
Apr 13 12:10:57.986: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage.glob..func8.2
... skipping 34 lines ...
Apr 13 12:04:39.547: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
Apr 13 12:04:39.656: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.comxtvqz] to have phase Bound
Apr 13 12:04:39.765: INFO: PersistentVolumeClaim test.csi.azure.comxtvqz found but phase is Pending instead of Bound.
Apr 13 12:04:41.876: INFO: PersistentVolumeClaim test.csi.azure.comxtvqz found but phase is Pending instead of Bound.
Apr 13 12:04:43.989: INFO: PersistentVolumeClaim test.csi.azure.comxtvqz found and phase=Bound (4.332271975s)
[1mSTEP[0m: Creating pod on {Name: Selector:map[] Affinity:nil} with multiple volumes
Apr 13 12:09:44.651: FAIL: Unexpected error:
    <*errors.errorString | 0xc002b64690>: {
        s: "pod \"pod-d95045d8-028e-4bea-850f-753b4b0881fc\" is not Running: timed out waiting for the condition",
    }
    pod "pod-d95045d8-028e-4bea-850f-753b4b0881fc" is not Running: timed out waiting for the condition
occurred

... skipping 61 lines ...
Apr 13 12:13:48.834: INFO: At 2022-04-13 12:04:37 +0000 UTC - event for test.csi.azure.comzlmc7: {test.csi.azure.com_k8s-agentpool1-19736391-vmss000000_a46bf991-1f5d-486f-9b8e-da06129981a2 } ProvisioningSucceeded: Successfully provisioned volume pvc-31c27f73-4be7-4729-9645-3d0bae5151d5
Apr 13 12:13:48.834: INFO: At 2022-04-13 12:04:39 +0000 UTC - event for test.csi.azure.comxtvqz: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "test.csi.azure.com" or manually created by system administrator
Apr 13 12:13:48.834: INFO: At 2022-04-13 12:04:39 +0000 UTC - event for test.csi.azure.comxtvqz: {test.csi.azure.com_k8s-agentpool1-19736391-vmss000000_a46bf991-1f5d-486f-9b8e-da06129981a2 } Provisioning: External provisioner is provisioning volume for claim "multivolume-3796/test.csi.azure.comxtvqz"
Apr 13 12:13:48.834: INFO: At 2022-04-13 12:04:42 +0000 UTC - event for test.csi.azure.comxtvqz: {test.csi.azure.com_k8s-agentpool1-19736391-vmss000000_a46bf991-1f5d-486f-9b8e-da06129981a2 } ProvisioningSucceeded: Successfully provisioned volume pvc-f6389b41-bcb4-4984-8f72-225aad664670
Apr 13 12:13:48.834: INFO: At 2022-04-13 12:04:44 +0000 UTC - event for pod-d95045d8-028e-4bea-850f-753b4b0881fc: {default-scheduler } Scheduled: Successfully assigned multivolume-3796/pod-d95045d8-028e-4bea-850f-753b4b0881fc to k8s-agentpool1-19736391-vmss000001
Apr 13 12:13:48.834: INFO: At 2022-04-13 12:05:48 +0000 UTC - event for pod-d95045d8-028e-4bea-850f-753b4b0881fc: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-31c27f73-4be7-4729-9645-3d0bae5151d5" 
Apr 13 12:13:48.834: INFO: At 2022-04-13 12:06:44 +0000 UTC - event for pod-d95045d8-028e-4bea-850f-753b4b0881fc: {attachdetach-controller } FailedAttachVolume: AttachVolume.Attach failed for volume "pvc-f6389b41-bcb4-4984-8f72-225aad664670" : Attach timeout for volume /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-rdni2sdm/providers/Microsoft.Compute/disks/pvc-f6389b41-bcb4-4984-8f72-225aad664670
Apr 13 12:13:48.834: INFO: At 2022-04-13 12:06:47 +0000 UTC - event for pod-d95045d8-028e-4bea-850f-753b4b0881fc: {kubelet k8s-agentpool1-19736391-vmss000001} FailedMount: Unable to attach or mount volumes: unmounted volumes=[volume2], unattached volumes=[volume2 kube-api-access-xsgmn volume1]: timed out waiting for the condition
Apr 13 12:13:48.834: INFO: At 2022-04-13 12:09:04 +0000 UTC - event for pod-d95045d8-028e-4bea-850f-753b4b0881fc: {kubelet k8s-agentpool1-19736391-vmss000001} FailedMount: Unable to attach or mount volumes: unmounted volumes=[volume2], unattached volumes=[kube-api-access-xsgmn volume1 volume2]: timed out waiting for the condition
Apr 13 12:13:48.834: INFO: At 2022-04-13 12:11:22 +0000 UTC - event for pod-d95045d8-028e-4bea-850f-753b4b0881fc: {kubelet k8s-agentpool1-19736391-vmss000001} FailedMount: Unable to attach or mount volumes: unmounted volumes=[volume2], unattached volumes=[volume1 volume2 kube-api-access-xsgmn]: timed out waiting for the condition
Apr 13 12:13:48.942: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Apr 13 12:13:48.942: INFO: 
Apr 13 12:13:49.163: INFO: 
... skipping 110 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow]
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    [91m[1mshould access to two volumes with the same volume mode and retain data across pod recreation on different node [Measurement][0m
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/multivolume.go:166[0m

    [91mApr 13 12:09:44.651: Unexpected error:
        <*errors.errorString | 0xc002b64690>: {
            s: "pod \"pod-d95045d8-028e-4bea-850f-753b4b0881fc\" is not Running: timed out waiting for the condition",
        }
        pod "pod-d95045d8-028e-4bea-850f-753b4b0881fc" is not Running: timed out waiting for the condition
    occurred[0m

    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/multivolume.go:495
[90m------------------------------[0m
{"msg":"FAILED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node","total":38,"completed":13,"skipped":940,"failed":1,"failures":["External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node"]}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
Apr 13 12:13:52.361: INFO: Running AfterSuite actions on all nodes
Apr 13 12:13:52.361: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage.glob..func18.2
Apr 13 12:13:52.361: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage.glob..func8.2
... skipping 49 lines ...
Apr 13 12:03:30.544: INFO: Waiting for pod external-injector to disappear
Apr 13 12:03:30.653: INFO: Pod external-injector still exists
Apr 13 12:03:32.653: INFO: Waiting for pod external-injector to disappear
Apr 13 12:03:32.762: INFO: Pod external-injector no longer exists
[1mSTEP[0m: Creating pod1 with a volume on {Name: Selector:map[] Affinity:nil}
[1mSTEP[0m: Creating pod2 with a volume on {Name: Selector:map[] Affinity:&Affinity{NodeAffinity:&NodeAffinity{RequiredDuringSchedulingIgnoredDuringExecution:&NodeSelector{NodeSelectorTerms:[]NodeSelectorTerm{NodeSelectorTerm{MatchExpressions:[]NodeSelectorRequirement{},MatchFields:[]NodeSelectorRequirement{NodeSelectorRequirement{Key:metadata.name,Operator:In,Values:[k8s-agentpool1-19736391-vmss000001],},},},},},PreferredDuringSchedulingIgnoredDuringExecution:[]PreferredSchedulingTerm{},},PodAffinity:nil,PodAntiAffinity:nil,}}
Apr 13 12:10:19.755: FAIL: Unexpected error:
    <*errors.errorString | 0xc003a51070>: {
        s: "pod \"pod-3cb674d5-76d9-4dac-8b9e-b0c626c496eb\" is not Running: timed out waiting for the condition",
    }
    pod "pod-3cb674d5-76d9-4dac-8b9e-b0c626c496eb" is not Running: timed out waiting for the condition
occurred

... skipping 58 lines ...
Apr 13 12:14:10.032: INFO: At 2022-04-13 12:03:23 +0000 UTC - event for external-injector: {kubelet k8s-agentpool1-19736391-vmss000000} Started: Started container external-injector
Apr 13 12:14:10.032: INFO: At 2022-04-13 12:03:23 +0000 UTC - event for external-injector: {kubelet k8s-agentpool1-19736391-vmss000000} Pulled: Successfully pulled image "k8s.gcr.io/e2e-test-images/busybox:1.29-2" in 380.986845ms
Apr 13 12:14:10.032: INFO: At 2022-04-13 12:03:23 +0000 UTC - event for external-injector: {kubelet k8s-agentpool1-19736391-vmss000000} Pulling: Pulling image "k8s.gcr.io/e2e-test-images/busybox:1.29-2"
Apr 13 12:14:10.032: INFO: At 2022-04-13 12:03:23 +0000 UTC - event for external-injector: {kubelet k8s-agentpool1-19736391-vmss000000} Created: Created container external-injector
Apr 13 12:14:10.032: INFO: At 2022-04-13 12:03:30 +0000 UTC - event for external-injector: {kubelet k8s-agentpool1-19736391-vmss000000} Killing: Stopping container external-injector
Apr 13 12:14:10.032: INFO: At 2022-04-13 12:03:32 +0000 UTC - event for pod-94c2d43a-142d-46c1-9368-841a396b4434: {default-scheduler } Scheduled: Successfully assigned multivolume-3358/pod-94c2d43a-142d-46c1-9368-841a396b4434 to k8s-agentpool1-19736391-vmss000001
Apr 13 12:14:10.032: INFO: At 2022-04-13 12:03:32 +0000 UTC - event for pod-94c2d43a-142d-46c1-9368-841a396b4434: {attachdetach-controller } FailedAttachVolume: Multi-Attach error for volume "pvc-d8c58c2e-d36b-4536-ad4d-27287210fed6" Volume is already exclusively attached to one node and can't be attached to another
Apr 13 12:14:10.032: INFO: At 2022-04-13 12:03:32 +0000 UTC - event for test.csi.azure.com2vz9j-cloned: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "test.csi.azure.com" or manually created by system administrator
Apr 13 12:14:10.032: INFO: At 2022-04-13 12:03:32 +0000 UTC - event for test.csi.azure.com2vz9j-cloned: {test.csi.azure.com_k8s-agentpool1-19736391-vmss000000_a46bf991-1f5d-486f-9b8e-da06129981a2 } Provisioning: External provisioner is provisioning volume for claim "multivolume-3358/test.csi.azure.com2vz9j-cloned"
Apr 13 12:14:10.032: INFO: At 2022-04-13 12:03:33 +0000 UTC - event for external-injector: {kubelet k8s-agentpool1-19736391-vmss000000} FailedKillPod: error killing pod: failed to "KillContainer" for "external-injector" with KillContainerError: "rpc error: code = Unknown desc = Error response from daemon: No such container: 2592e82d3f46d3f78cd21d8d5079a360573be8f959161b851d5cb88a23da37ed"
Apr 13 12:14:10.032: INFO: At 2022-04-13 12:03:35 +0000 UTC - event for test.csi.azure.com2vz9j-cloned: {test.csi.azure.com_k8s-agentpool1-19736391-vmss000000_a46bf991-1f5d-486f-9b8e-da06129981a2 } ProvisioningSucceeded: Successfully provisioned volume pvc-2cd3b3d9-a284-4b05-8954-d83965b71fcd
Apr 13 12:14:10.032: INFO: At 2022-04-13 12:05:09 +0000 UTC - event for pod-94c2d43a-142d-46c1-9368-841a396b4434: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-d8c58c2e-d36b-4536-ad4d-27287210fed6" 
Apr 13 12:14:10.032: INFO: At 2022-04-13 12:05:11 +0000 UTC - event for pod-94c2d43a-142d-46c1-9368-841a396b4434: {kubelet k8s-agentpool1-19736391-vmss000001} Pulling: Pulling image "k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5"
Apr 13 12:14:10.032: INFO: At 2022-04-13 12:05:16 +0000 UTC - event for pod-94c2d43a-142d-46c1-9368-841a396b4434: {kubelet k8s-agentpool1-19736391-vmss000001} Pulled: Successfully pulled image "k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5" in 5.426014711s
Apr 13 12:14:10.032: INFO: At 2022-04-13 12:05:17 +0000 UTC - event for pod-94c2d43a-142d-46c1-9368-841a396b4434: {kubelet k8s-agentpool1-19736391-vmss000001} Started: Started container write-pod
Apr 13 12:14:10.032: INFO: At 2022-04-13 12:05:17 +0000 UTC - event for pod-94c2d43a-142d-46c1-9368-841a396b4434: {kubelet k8s-agentpool1-19736391-vmss000001} Created: Created container write-pod
Apr 13 12:14:10.032: INFO: At 2022-04-13 12:05:19 +0000 UTC - event for pod-3cb674d5-76d9-4dac-8b9e-b0c626c496eb: {default-scheduler } Scheduled: Successfully assigned multivolume-3358/pod-3cb674d5-76d9-4dac-8b9e-b0c626c496eb to k8s-agentpool1-19736391-vmss000001
Apr 13 12:14:10.032: INFO: At 2022-04-13 12:07:19 +0000 UTC - event for pod-3cb674d5-76d9-4dac-8b9e-b0c626c496eb: {attachdetach-controller } FailedAttachVolume: AttachVolume.Attach failed for volume "pvc-2cd3b3d9-a284-4b05-8954-d83965b71fcd" : Attach timeout for volume /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-rdni2sdm/providers/Microsoft.Compute/disks/pvc-2cd3b3d9-a284-4b05-8954-d83965b71fcd
Apr 13 12:14:10.032: INFO: At 2022-04-13 12:07:22 +0000 UTC - event for pod-3cb674d5-76d9-4dac-8b9e-b0c626c496eb: {kubelet k8s-agentpool1-19736391-vmss000001} FailedMount: Unable to attach or mount volumes: unmounted volumes=[volume1], unattached volumes=[volume1 kube-api-access-dfw94]: timed out waiting for the condition
Apr 13 12:14:10.032: INFO: At 2022-04-13 12:11:54 +0000 UTC - event for pod-94c2d43a-142d-46c1-9368-841a396b4434: {kubelet k8s-agentpool1-19736391-vmss000001} Killing: Stopping container write-pod
Apr 13 12:14:10.032: INFO: At 2022-04-13 12:11:56 +0000 UTC - event for pod-94c2d43a-142d-46c1-9368-841a396b4434: {kubelet k8s-agentpool1-19736391-vmss000001} FailedKillPod: error killing pod: failed to "KillContainer" for "write-pod" with KillContainerError: "rpc error: code = Unknown desc = Error response from daemon: No such container: 0b585ed38d0ab29b019457b8d3b7b7e1e35d0274fe32e16c7c29787c83288d29"
Apr 13 12:14:10.140: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Apr 13 12:14:10.140: INFO: 
Apr 13 12:14:10.355: INFO: 
Logging node info for node k8s-agentpool1-19736391-vmss000000
Apr 13 12:14:10.464: INFO: Node Info: &Node{ObjectMeta:{k8s-agentpool1-19736391-vmss000000    3af310e8-35f7-4b37-bdd3-247c6fe4ef9e 22856 0 2022-04-13 11:10:34 +0000 UTC <nil> <nil> map[agentpool:agentpool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D8s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westeurope failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-rdni2sdm kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:k8s-agentpool1-19736391-vmss000000 kubernetes.io/os:linux kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D8s_v3 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:westeurope topology.kubernetes.io/zone:0 topology.test.csi.azure.com/zone:] map[csi.volume.kubernetes.io/nodeid:{"test.csi.azure.com":"k8s-agentpool1-19736391-vmss000000"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  [{Go-http-client Update v1 2022-04-13 11:10:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:storageprofile":{},"f:storagetier":{}}}} } {kubectl-label Update v1 2022-04-13 11:10:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}} } {kube-controller-manager Update v1 2022-04-13 11:10:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}}}} } {cloud-controller-manager Update v1 2022-04-13 11:11:40 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {cloud-node-manager Update v1 2022-04-13 11:12:12 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {Go-http-client Update v1 2022-04-13 12:10:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.test.csi.azure.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2022-04-13 12:12:29 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-rdni2sdm/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool1-19736391-vmss/virtualMachines/0,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{31036686336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{33672699904 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{27933017657 0} {<nil>} 27933017657 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{32886267904 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-04-13 11:11:40 +0000 UTC,LastTransitionTime:2022-04-13 11:11:40 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-04-13 12:10:02 +0000 UTC,LastTransitionTime:2022-04-13 11:10:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-04-13 12:10:02 +0000 UTC,LastTransitionTime:2022-04-13 11:10:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-04-13 12:10:02 +0000 UTC,LastTransitionTime:2022-04-13 11:10:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-04-13 12:10:02 +0000 UTC,LastTransitionTime:2022-04-13 11:10:50 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.240.0.4,},NodeAddress{Type:Hostname,Address:k8s-agentpool1-19736391-vmss000000,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e716e235ec814a7fb3b0ac083f9dc382,SystemUUID:140f23e2-f7f7-d449-b4d3-e7c24fbe93ca,BootID:0e7ea254-2933-4dc3-9abc-e762ba49d8ce,KernelVersion:5.4.0-1074-azure,OSImage:Ubuntu 18.04.6 LTS,ContainerRuntimeVersion:docker://20.10.11+azure-3,KubeletVersion:v1.23.4,KubeProxyVersion:v1.23.4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8sprow.azurecr.io/azuredisk-csi@sha256:5340006cdb009cca9c71016ff7916dcedceb5811fbd82263cdb8ee490a0e1cb2 k8sprow.azurecr.io/azuredisk-csi:v1.16.0-eb7e0710ddbc5984b82c0c8453e3a2427fa2a635],SizeBytes:260029022,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/azuredisk-csi@sha256:423eb6cf602c064c8b2deefead5ceadd6324ed41b3d995dab5d0f6f0f4d4710f mcr.microsoft.com/oss/kubernetes-csi/azuredisk-csi:v1.10.0],SizeBytes:245959792,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/azurefile-csi@sha256:9e2ecabcf9dd9943e6600eb9fb460f45b4dc61af7cabe95d115082a029db2aaf mcr.microsoft.com/oss/kubernetes-csi/azurefile-csi:v1.9.0],SizeBytes:230470852,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/azure-npm@sha256:106f669f48e5e80c4ec0afb49858ead72cf4b901cd8664e7bf81f8d789e56e12 mcr.microsoft.com/containernetworking/azure-npm:v1.2.2_hotfix],SizeBytes:175230380,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:d342e90a94c0ab05c3ae91928003ba63e0c28e1ba004070cf14ea2b2af128b2f mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.23.4],SizeBytes:135131005,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:d9cca16cbbcf06ef2e4b8c5036c78d21067c932c5b52b0803be635af1b9623fd mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.23.4],SizeBytes:124940480,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:5b3a9f1c71c09c00649d8374224642ff7029ce91a721ec9132e6ed45fa73fd43 k8s.gcr.io/e2e-test-images/agnhost:2.33],SizeBytes:124717420,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver@sha256:c0d040a1c4fbfceb65663e31c09ea40f4f78e356437610cbc3fbb4bb409bd6f1 mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver:v0.0.19],SizeBytes:123229697,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:fedcc4ef0f998031928815d63c82c3f2bcae67c89acad31c5cb2da2a849cbe6a mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.23.4],SizeBytes:112312797,},ContainerImage{Names:[mcr.microsoft.com/oss/azure/secrets-store/provider-azure@sha256:6f67f3d0c7cdde5702f8ce7f101b6519daa0237f0c34fecb7c058b6af8c22ad1 mcr.microsoft.com/oss/azure/secrets-store/provider-azure:0.0.12],SizeBytes:101061355,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:6f0c680d375c62e74351f8ff3ed6ddb9b72ca759e0645c329b95f64264654a6d mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.22.1],SizeBytes:99962810,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-addon-manager@sha256:32e2836018c96e73533bd4642fe438e465b81dcbfa8b7b61935a6f4d0246c7ae mcr.microsoft.com/oss/kubernetes/kube-addon-manager:v9.1.3],SizeBytes:86832059,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-addon-manager@sha256:92c2c5aad9012ee32d2a43a74966cc0adc6ccb1705ad15abb10485ecf406d88b mcr.microsoft.com/oss/kubernetes/kube-addon-manager:v9.1.5],SizeBytes:84094027,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/metrics-server@sha256:1ef9d57ce41ffcc328b92494c3bfafe401e0b9a1694a295301a1385337d52815 mcr.microsoft.com/oss/kubernetes/metrics-server:v0.5.2],SizeBytes:64327621,},ContainerImage{Names:[mcr.microsoft.com/oss/nvidia/k8s-device-plugin@sha256:0f5b52bf28239234e831697d96db63ac03cde70fe68058f964504ab7564ee810 mcr.microsoft.com/oss/nvidia/k8s-device-plugin:1.0.0-beta6],SizeBytes:64160241,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner@sha256:542c9258a1441e4927883ea73425e21f9a14043a649686bf6b51700f34c64f8e mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner:v3.1.0],SizeBytes:57858438,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner@sha256:e9ddadc44ba87a4a27f67e54760a14f9986885b534b3dff170a14eae1e35d213 mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner:v3.0.0],SizeBytes:56881280,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-resizer@sha256:ab6c2e18a4d943f2bf8688e1779622277a1d14c355c9d4bfc0d761d86c5108b3 mcr.microsoft.com/oss/kubernetes-csi/csi-resizer:v1.4.0],SizeBytes:55577322,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter@sha256:a889e925e15f9423f7842f1b769f64cbcf6a20b6956122836fc835cf22d9073f mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter:v5.0.1],SizeBytes:55314459,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-attacher@sha256:19fbca01394f7ed80151731180cfde0a3367f038beae2a97cda7928034010057 mcr.microsoft.com/oss/kubernetes-csi/csi-attacher:v3.4.0],SizeBytes:54954134,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-resizer@sha256:c5bb71ceaac60b1a4b58739fa07b709f6248c452ff6272a384d2f7648895a750 mcr.microsoft.com/oss/kubernetes-csi/csi-resizer:v1.3.0],SizeBytes:54313772,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter@sha256:61849a026511cf332c87d73d0a7aed803b510c3ede197ec755389686d490de72 mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter:v4.2.1],SizeBytes:54210936,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-attacher@sha256:6b41e7153ebdfdc1501aa65184624bc15fd33a52d93f88ec3a758d0f8c9b8c10 mcr.microsoft.com/oss/kubernetes-csi/csi-attacher:v3.3.0],SizeBytes:53842561,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:027ae89899f04c04c891d605b215e0c0e2bfd92a60ad6cdd77a2fa15afb063e6 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.23.4],SizeBytes:53461183,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/snapshot-controller@sha256:8c3fc3c2667004ad6bbdf723bb64c5da66a5cb8b11d4ee59b67179b686223b13 mcr.microsoft.com/oss/kubernetes-csi/snapshot-controller:v5.0.1],SizeBytes:52732401,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/snapshot-controller@sha256:be5a8dc1f990828f653c77bd0a0f1bbd13197c3019f6e1d99d590389bac36705 mcr.microsoft.com/oss/kubernetes-csi/snapshot-controller:v4.2.1],SizeBytes:51575245,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager@sha256:0ad67f9919522a07318034641ae09bf2079b417e9944c65914410594ce645468 mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager:v1.1.4],SizeBytes:51478397,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager@sha256:31ec4f7daccd3e7a8504e12657d7830651ecacbe4a487daca1b1b7695a64b070 mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager:v1.23.1],SizeBytes:51249021,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:011712ed90fb8efcf27928b0a47ed04b98baebb31cb1b2d8ab676977ec18eedc mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v1.1.4],SizeBytes:50868093,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:0f9a8fbaed65192ed7dd795be4f9c1dc48ebdef0a241fb62d456f4bed40d9875 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v1.23.1],SizeBytes:50679677,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/ip-masq-agent@sha256:1244155f2ed3f33ff154cc343b8ad285f3391d95afd7d4b1c6dcc420bc0ba3cf mcr.microsoft.com/oss/kubernetes/ip-masq-agent:v2.5.0],SizeBytes:50146762,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager@sha256:7c907ff70b90a0bdf8fae63bd744018469dd9839cde1fd0515b93e0bbd14b34e mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager:v1.0.8],SizeBytes:48963453,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:3987d7a8c6922ce1952ee19c5cb6ea75aac7b7c1b07aa79277ad038c69fb7a31 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v1.0.8],SizeBytes:48349053,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/coredns@sha256:f873bf7f0928461efe10697fa76cf0ad7a1ae3041c5b57b50dd3d0b72d273f8c mcr.microsoft.com/oss/kubernetes/coredns:1.8.6],SizeBytes:46804601,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager@sha256:8073113a20882642a980b338635cdc5945e5673a18aef192090e6fde2b89a75c mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager:v0.6.0],SizeBytes:45909032,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:6a32329628bdea3c6d75e98aad6155b65d2e2b98ca616eb33f9ac562912804c6 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.6.0],SizeBytes:45229096,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager@sha256:ef6c4ba564b4d11d270f7d1563c50fbeb30ccc3b94146e5059228c49f95875f5 mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager:v0.7.11],SizeBytes:44916605,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:dbcc384758ba5ca6d249596d471292ed3785e31cdb854d48b84d70794b669b4c mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.7.11],SizeBytes:43679613,},ContainerImage{Names:[mcr.microsoft.com/oss/etcd-io/etcd@sha256:cf587862e3f1b6fa4d9a2565520a34f164bdf72c50f37af8c3c668160593246e mcr.microsoft.com/oss/etcd-io/etcd:v3.3.25],SizeBytes:41832119,},ContainerImage{Names:[mcr.microsoft.com/k8s/aad-pod-identity/mic@sha256:bd9465be94966b9a917e1e3904fa5e63dd91772ccadf304e18ffd8e4ad8ccedd mcr.microsoft.com/k8s/aad-pod-identity/mic:1.6.1],SizeBytes:41374894,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-proportional-autoscaler@sha256:c849d75d61943ce7f51b4c049f1a79d19a08253966c8f49c4cfb6414cc33db8b mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-proportional-autoscaler:1.8.5],SizeBytes:40661903,},ContainerImage{Names:[mcr.microsoft.com/k8s/aad-pod-identity/nmi@sha256:02128fefcdb7593ac53fc342e2c53a0fc6fabd813036bf60457bf43cc2940116 mcr.microsoft.com/k8s/aad-pod-identity/nmi:1.6.1],SizeBytes:38007982,},ContainerImage{Names:[mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume@sha256:921f301c44dda06a325164accf22e78ecc570b5c7d9d6ee4c66bd8cbb2b60b9a mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume:v0.0.16],SizeBytes:26970670,},ContainerImage{Names:[mcr.microsoft.com/k8s/kms/keyvault@sha256:1a27e175f8c125209e32d2957b5509fe20757bd8cb309ff9da598799b56326fb mcr.microsoft.com/k8s/kms/keyvault:v0.0.10],SizeBytes:23077387,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:dbec3a8166686b09b242176ab5b99e993da4126438bbce68147c3fd654f35662 mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v2.4.0],SizeBytes:19547289,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:c96a6255c42766f6b8bb1a7cda02b0060ab1b20b2e2dafcc64ec09e7646745a6 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.5.0],SizeBytes:17573341,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:16028126,},ContainerImage{Names:[mcr.microsoft.com/oss/busybox/busybox@sha256:582a641242b49809af3a1a522f9aae8c3f047d1c6ca1dd9d8cdabd349e45b1a9 mcr.microsoft.com/oss/busybox/busybox:1.33.1],SizeBytes:1235829,},ContainerImage{Names:[mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume@sha256:23d8c6033f02a1ecad05127ebdc931bb871264228661bc122704b0974e4d9fdd mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume:1.0.8],SizeBytes:1159025,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:1154361,},},VolumesInUse:[kubernetes.io/csi/test.csi.azure.com^/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-rdni2sdm/providers/Microsoft.Compute/disks/pvc-ea38d7e9-6ee6-4d3c-b304-e86b5f0cb1ee],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/test.csi.azure.com^/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-rdni2sdm/providers/Microsoft.Compute/disks/pvc-ea38d7e9-6ee6-4d3c-b304-e86b5f0cb1ee,DevicePath:,},},Config:nil,},}
Apr 13 12:14:10.465: INFO: 
... skipping 107 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow]
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    [91m[1mshould concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS] [Measurement][0m
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/multivolume.go:376[0m

    [91mApr 13 12:10:19.755: Unexpected error:
        <*errors.errorString | 0xc003a51070>: {
            s: "pod \"pod-3cb674d5-76d9-4dac-8b9e-b0c626c496eb\" is not Running: timed out waiting for the condition",
        }
        pod "pod-3cb674d5-76d9-4dac-8b9e-b0c626c496eb" is not Running: timed out waiting for the condition
    occurred[0m

    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/multivolume.go:694
[90m------------------------------[0m
{"msg":"FAILED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]","total":37,"completed":12,"skipped":1022,"failed":1,"failures":["External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]"]}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[0mExternal Storage [Driver: test.csi.azure.com][0m [90m[Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral[0m 
  [1mshould support two pods which have the same volume definition[0m
  [37m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/ephemeral.go:214[0m
... skipping 62 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should support two pods which have the same volume definition
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/ephemeral.go:214[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should support two pods which have the same volume definition","total":27,"completed":12,"skipped":885,"failed":1,"failures":["External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]"]}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Apr 13 12:15:23.392: INFO: Distro debian doesn't support ntfs -- skipping
... skipping 857 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (block volmode)] provisioning
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should provision storage with pvc data source in parallel [Slow]
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/provisioning.go:275[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with pvc data source in parallel [Slow]","total":32,"completed":10,"skipped":836,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[0mExternal Storage [Driver: test.csi.azure.com][0m [90m[Testpattern: Dynamic PV (default fs)] subPath[0m 
  [1mshould support non-existent path[0m
  [37m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:194[0m
... skipping 16 lines ...
Apr 13 12:15:24.191: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.comcd4qq] to have phase Bound
Apr 13 12:15:24.301: INFO: PersistentVolumeClaim test.csi.azure.comcd4qq found but phase is Pending instead of Bound.
Apr 13 12:15:26.410: INFO: PersistentVolumeClaim test.csi.azure.comcd4qq found but phase is Pending instead of Bound.
Apr 13 12:15:28.521: INFO: PersistentVolumeClaim test.csi.azure.comcd4qq found and phase=Bound (4.330391858s)
[1mSTEP[0m: Creating pod pod-subpath-test-dynamicpv-vrrj
[1mSTEP[0m: Creating a pod to test subpath
Apr 13 12:15:28.850: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-vrrj" in namespace "provisioning-9967" to be "Succeeded or Failed"
Apr 13 12:15:28.959: INFO: Pod "pod-subpath-test-dynamicpv-vrrj": Phase="Pending", Reason="", readiness=false. Elapsed: 108.686513ms
Apr 13 12:15:31.069: INFO: Pod "pod-subpath-test-dynamicpv-vrrj": Phase="Pending", Reason="", readiness=false. Elapsed: 2.219072895s
Apr 13 12:15:33.179: INFO: Pod "pod-subpath-test-dynamicpv-vrrj": Phase="Pending", Reason="", readiness=false. Elapsed: 4.328799121s
Apr 13 12:15:35.288: INFO: Pod "pod-subpath-test-dynamicpv-vrrj": Phase="Pending", Reason="", readiness=false. Elapsed: 6.438465163s
Apr 13 12:15:37.416: INFO: Pod "pod-subpath-test-dynamicpv-vrrj": Phase="Pending", Reason="", readiness=false. Elapsed: 8.565693942s
Apr 13 12:15:39.526: INFO: Pod "pod-subpath-test-dynamicpv-vrrj": Phase="Pending", Reason="", readiness=false. Elapsed: 10.676342136s
Apr 13 12:15:41.636: INFO: Pod "pod-subpath-test-dynamicpv-vrrj": Phase="Pending", Reason="", readiness=false. Elapsed: 12.786607105s
Apr 13 12:15:43.746: INFO: Pod "pod-subpath-test-dynamicpv-vrrj": Phase="Pending", Reason="", readiness=false. Elapsed: 14.896172224s
Apr 13 12:15:46.190: INFO: Pod "pod-subpath-test-dynamicpv-vrrj": Phase="Pending", Reason="", readiness=false. Elapsed: 17.339718886s
Apr 13 12:15:48.300: INFO: Pod "pod-subpath-test-dynamicpv-vrrj": Phase="Succeeded", Reason="", readiness=false. Elapsed: 19.450593365s
[1mSTEP[0m: Saw pod success
Apr 13 12:15:48.300: INFO: Pod "pod-subpath-test-dynamicpv-vrrj" satisfied condition "Succeeded or Failed"
Apr 13 12:15:48.414: INFO: Trying to get logs from node k8s-agentpool1-19736391-vmss000001 pod pod-subpath-test-dynamicpv-vrrj container test-container-volume-dynamicpv-vrrj: <nil>
[1mSTEP[0m: delete the pod
Apr 13 12:15:48.697: INFO: Waiting for pod pod-subpath-test-dynamicpv-vrrj to disappear
Apr 13 12:15:48.805: INFO: Pod pod-subpath-test-dynamicpv-vrrj no longer exists
[1mSTEP[0m: Deleting pod pod-subpath-test-dynamicpv-vrrj
Apr 13 12:15:48.805: INFO: Deleting pod "pod-subpath-test-dynamicpv-vrrj" in namespace "provisioning-9967"
... skipping 29 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (default fs)] subPath
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should support non-existent path
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:194[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath should support non-existent path","total":27,"completed":13,"skipped":948,"failed":1,"failures":["External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]"]}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: Dynamic Snapshot (delete policy)] snapshottable-stress[Feature:VolumeSnapshotDataSource]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Apr 13 12:17:01.519: INFO: Driver test.csi.azure.com doesn't specify snapshot stress test options -- skipping
... skipping 93 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (filesystem volmode)] volumeLimits
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should support volume limits [Serial]
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumelimits.go:125[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (filesystem volmode)] volumeLimits should support volume limits [Serial]","total":32,"completed":11,"skipped":850,"failed":0}

[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Apr 13 12:18:28.355: INFO: Driver "test.csi.azure.com" does not support volume type "InlineVolume" - skipping
... skipping 210 lines ...
[90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174[0m
  [Testpattern: Dynamic PV (ext4)] multiVolume [Slow]
  [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50[0m
    should concurrently access the single volume from pods on the same node
    [90m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/multivolume.go:296[0m
[90m------------------------------[0m
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should concurrently access the single volume from pods on the same node","total":32,"completed":12,"skipped":960,"failed":0}

[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m[36mS[0m
[90m------------------------------[0m
[BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] volume-expand
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Apr 13 12:20:07.296: INFO: Distro debian doesn't support ntfs -- skipping
... skipping 57 lines ...
Apr 13 12:20:07.355: INFO: Running AfterSuite actions on node 1



[91m[1mSummarizing 4 Failures:[0m

[91m[1m[Fail] [0m[90mExternal Storage [Driver: test.csi.azure.com] [0m[0m[Testpattern: Dynamic PV (ext4)] multiVolume [Slow] [0m[91m[1m[Measurement] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS] [0m
[37m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/multivolume.go:127[0m

[91m[1m[Fail] [0m[90mExternal Storage [Driver: test.csi.azure.com] [0m[0m[Testpattern: Dynamic PV (default fs)] subPath [0m[91m[1m[Measurement] should support readOnly directory specified in the volumeMount [0m
[37m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:183[0m

[91m[1m[Fail] [0m[90mExternal Storage [Driver: test.csi.azure.com] [0m[0m[Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] [0m[91m[1m[Measurement] should access to two volumes with the same volume mode and retain data across pod recreation on different node [0m
[37m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/multivolume.go:495[0m

[91m[1m[Fail] [0m[90mExternal Storage [Driver: test.csi.azure.com] [0m[0m[Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] [0m[91m[1m[Measurement] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS] [0m
[37m/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/multivolume.go:694[0m

[1m[91mRan 87 of 7298 Specs in 3357.398 seconds[0m
[1m[91mFAIL![0m -- [32m[1m83 Passed[0m | [91m[1m4 Failed[0m | [33m[1m0 Pending[0m | [36m[1m7211 Skipped[0m 

Ginkgo ran 1 suite in 56m1.623352185s
Test Suite Failed
+ print_logs
+ sed -i s/disk.csi.azure.com/test.csi.azure.com/g deploy/example/storageclass-azuredisk-csi.yaml
+ bash ./hack/verify-examples.sh linux azurepubliccloud ephemeral test
begin to create deployment examples ...
storageclass.storage.k8s.io/managed-csi created
Applying config "deploy/example/deployment.yaml"
... skipping 80 lines ...
Platform: linux/amd64
Topology Key: topology.test.csi.azure.com/zone

Streaming logs below:
I0413 11:24:00.313015       1 azuredisk.go:165] driver userAgent: test.csi.azure.com/v1.16.0-eb7e0710ddbc5984b82c0c8453e3a2427fa2a635 gc/go1.18 (amd64-linux) e2e-test
I0413 11:24:00.313473       1 azure_disk_utils.go:158] reading cloud config from secret kube-system/azure-cloud-provider
W0413 11:24:00.341285       1 azure_disk_utils.go:165] InitializeCloudFromSecret: failed to get cloud config from secret kube-system/azure-cloud-provider: failed to get secret kube-system/azure-cloud-provider: secrets "azure-cloud-provider" not found
I0413 11:24:00.341332       1 azure_disk_utils.go:170] could not read cloud config from secret kube-system/azure-cloud-provider
I0413 11:24:00.341339       1 azure_disk_utils.go:180] use default AZURE_CREDENTIAL_FILE env var: /etc/kubernetes/azure.json
I0413 11:24:00.341399       1 azure_disk_utils.go:188] read cloud config from file: /etc/kubernetes/azure.json successfully
I0413 11:24:00.343440       1 azure_auth.go:245] Using AzurePublicCloud environment
I0413 11:24:00.343465       1 azure_auth.go:96] azure: using managed identity extension to retrieve access token
I0413 11:24:00.343488       1 azure_auth.go:102] azure: using User Assigned MSI ID to retrieve access token
I0413 11:24:00.343533       1 azure_auth.go:113] azure: User Assigned MSI ID is client ID. Resource ID parsing error: %+vparsing failed for d836aae9-bfe2-46f5-9585-40c7ce533911. Invalid resource Id format
(2022-04-13T11:24:00.3435384Z) INFO: Managed identity environment is IMDS, endpoint is http://169.254.169.254/metadata/identity/oauth2/token
(2022-04-13T11:24:00.3435641Z) INFO: Managed identity custom endpoint is http://169.254.169.254/metadata/identity/oauth2/token
I0413 11:24:00.343609       1 azure.go:738] Azure cloudprovider using try backoff: retries=6, exponent=1.500000, duration=5, jitter=1.000000
I0413 11:24:00.343643       1 azure_interfaceclient.go:70] Azure InterfacesClient (read ops) using rate limit config: QPS=6, bucket=20
I0413 11:24:00.343657       1 azure_interfaceclient.go:73] Azure InterfacesClient (write ops) using rate limit config: QPS=100, bucket=1000
I0413 11:24:00.343670       1 azure_vmsizeclient.go:68] Azure VirtualMachineSizesClient (read ops) using rate limit config: QPS=6, bucket=20
... skipping 739 lines ...
Strict-Transport-Security: max-age=31536000; includeSubDomains
X-Content-Type-Options: nosniff
Date: Wed, 13 Apr 2022 11:24:16 GMT
Expires: -1
X-Ms-Request-Charge: 1
X-Ms-Ratelimit-Remaining-Subscription-Writes: 1198
I0413 11:24:16.645388       1 azure_controller_vmss.go:121] azureDisk - update(kubetest-rdni2sdm): vm(k8s-agentpool1-19736391-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-rdni2sdm/providers/microsoft.compute/disks/pvc-d556508f-8d06-4306-a1e8-fb3f8c072f4e:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-d556508f-8d06-4306-a1e8-fb3f8c072f4e  false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
(2022-04-13T11:24:16.6454905Z) INFO: REQUEST: GET https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/providers/Microsoft.Compute/locations/westeurope/operations/424eebce-374d-4a2b-8917-ea8669ba391f?p=b44bdf61-1160-44df-9ef4-720d272442db&api-version=2020-12-01
Authorization: **REDACTED**
User-Agent: Go/go1.18 (amd64-linux) go-autorest/v14.2.1 test.csi.azure.com/v1.16.0-eb7e0710ddbc5984b82c0c8453e3a2427fa2a635 gc/go1.18 (amd64-linux) e2e-test
(2022-04-13T11:24:16.7041350Z) INFO: RESPONSE: 200 https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/providers/Microsoft.Compute/locations/westeurope/operations/424eebce-374d-4a2b-8917-ea8669ba391f?p=b44bdf61-1160-44df-9ef4-720d272442db&api-version=2020-12-01
Date: Wed, 13 Apr 2022 11:24:16 GMT
Cache-Control: no-cache
... skipping 155 lines ...
X-Ms-Correlation-Request-Id: 73ccff72-56b9-403a-82b7-a07c2d2717f6
X-Ms-Ratelimit-Remaining-Resource: Microsoft.Compute/VMScaleSetActions3Min;238,Microsoft.Compute/VMScaleSetActions30Min;1198,Microsoft.Compute/VMScaleSetBatchedVMRequests5Min;2428,Microsoft.Compute/VmssQueuedVMOperations;0
X-Ms-Request-Id: c83f5de6-9ae3-4057-a7ca-4b87a9378fab
X-Ms-Ratelimit-Remaining-Subscription-Writes: 1197
X-Content-Type-Options: nosniff
Pragma: no-cache
I0413 11:24:17.687016       1 azure_controller_vmss.go:121] azureDisk - update(kubetest-rdni2sdm): vm(k8s-agentpool1-19736391-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-rdni2sdm/providers/microsoft.compute/disks/pvc-1f2cbb73-e147-4926-a228-f9e5dda5b561:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-1f2cbb73-e147-4926-a228-f9e5dda5b561  false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
I0413 11:24:17.687064       1 utils.go:77] GRPC call: /csi.v1.Controller/ControllerPublishVolume
(2022-04-13T11:24:17.6870916Z) INFO: REQUEST: GET https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/providers/Microsoft.Compute/locations/westeurope/operations/c83f5de6-9ae3-4057-a7ca-4b87a9378fab?p=b44bdf61-1160-44df-9ef4-720d272442db&api-version=2020-12-01
User-Agent: Go/go1.18 (amd64-linux) go-autorest/v14.2.1 test.csi.azure.com/v1.16.0-eb7e0710ddbc5984b82c0c8453e3a2427fa2a635 gc/go1.18 (amd64-linux) e2e-test
Authorization: **REDACTED**
I0413 11:24:17.687096       1 utils.go:78] GRPC request: {"node_id":"k8s-agentpool1-19736391-vmss000000","volume_capability":{"AccessType":{"Block":{}},"access_mode":{"mode":7}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-4b5709ec-4b65-4b36-9852-344dd6330066","csi.storage.k8s.io/pvc/name":"test.csi.azure.comq9w7l","csi.storage.k8s.io/pvc/namespace":"multivolume-6175","requestedsizegib":"5","storage.kubernetes.io/csiProvisionerIdentity":"1649849041185-8081-test.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-rdni2sdm/providers/Microsoft.Compute/disks/pvc-4b5709ec-4b65-4b36-9852-344dd6330066"}
(2022-04-13T11:24:17.6872839Z) INFO: REQUEST: GET https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-rdni2sdm/providers/Microsoft.Compute/disks/pvc-4b5709ec-4b65-4b36-9852-344dd6330066?api-version=2021-04-01
... skipping 112 lines ...
Server: Microsoft-HTTPAPI/2.0,Microsoft-HTTPAPI/2.0
Expires: -1
Content-Type: application/json; charset=utf-8
Azure-Asyncoperation: https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/providers/Microsoft.Compute/locations/westeurope/operations/c983d7f6-ee7a-44cb-b582-bd634a3d1388?p=b44bdf61-1160-44df-9ef4-720d272442db&api-version=2020-12-01
X-Ms-Request-Charge: 1
Date: Wed, 13 Apr 2022 11:24:18 GMT
I0413 11:24:18.799192       1 azure_controller_vmss.go:121] azureDisk - update(kubetest-rdni2sdm): vm(k8s-agentpool1-19736391-vmss000002) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-rdni2sdm/providers/microsoft.compute/disks/pvc-e340610c-8170-44e7-b006-6ee81eb18a1d:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-e340610c-8170-44e7-b006-6ee81eb18a1d  false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
(2022-04-13T11:24:18.7992545Z) INFO: REQUEST: GET https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/providers/Microsoft.Compute/locations/westeurope/operations/c983d7f6-ee7a-44cb-b582-bd634a3d1388?p=b44bdf61-1160-44df-9ef4-720d272442db&api-version=2020-12-01
User-Agent: Go/go1.18 (amd64-linux) go-autorest/v14.2.1 test.csi.azure.com/v1.16.0-eb7e0710ddbc5984b82c0c8453e3a2427fa2a635 gc/go1.18 (amd64-linux) e2e-test
Authorization: **REDACTED**
(2022-04-13T11:24:18.8200779Z) INFO: RESPONSE: 200 https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/providers/Microsoft.Compute/locations/westeurope/operations/c983d7f6-ee7a-44cb-b582-bd634a3d1388?p=b44bdf61-1160-44df-9ef4-720d272442db&api-version=2020-12-01
X-Ms-Ratelimit-Remaining-Resource: Microsoft.Compute/GetOperation3Min;14987,Microsoft.Compute/GetOperation30Min;29975
Server: Microsoft-HTTPAPI/2.0,Microsoft-HTTPAPI/2.0
... skipping 238 lines ...
Strict-Transport-Security: max-age=31536000; includeSubDomains
Vary: Accept-Encoding
X-Ms-Ratelimit-Remaining-Resource: Microsoft.Compute/VMScaleSetActions3Min;236,Microsoft.Compute/VMScaleSetActions30Min;1196,Microsoft.Compute/VMScaleSetBatchedVMRequests5Min;2426,Microsoft.Compute/VmssQueuedVMOperations;0
X-Ms-Request-Charge: 1
X-Ms-Request-Id: 5a329d13-796e-4a31-a67c-8792b7d1ec0c
Date: Wed, 13 Apr 2022 11:24:31 GMT
I0413 11:24:32.100369       1 azure_controller_vmss.go:121] azureDisk - update(kubetest-rdni2sdm): vm(k8s-agentpool1-19736391-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-rdni2sdm/providers/microsoft.compute/disks/pvc-4b5709ec-4b65-4b36-9852-344dd6330066:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-4b5709ec-4b65-4b36-9852-344dd6330066  false 1})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
(2022-04-13T11:24:32.1004552Z) INFO: REQUEST: GET https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/providers/Microsoft.Compute/locations/westeurope/operations/5a329d13-796e-4a31-a67c-8792b7d1ec0c?p=b44bdf61-1160-44df-9ef4-720d272442db&api-version=2020-12-01
User-Agent: Go/go1.18 (amd64-linux) go-autorest/v14.2.1 test.csi.azure.com/v1.16.0-eb7e0710ddbc5984b82c0c8453e3a2427fa2a635 gc/go1.18 (amd64-linux) e2e-test
Authorization: **REDACTED**
(2022-04-13T11:24:32.1258190Z) INFO: RESPONSE: 200 https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/providers/Microsoft.Compute/locations/westeurope/operations/5a329d13-796e-4a31-a67c-8792b7d1ec0c?p=b44bdf61-1160-44df-9ef4-720d272442db&api-version=2020-12-01
X-Ms-Ratelimit-Remaining-Subscription-Reads: 11975
X-Ms-Correlation-Request-Id: f5066eda-7bd9-4400-8af7-8c2e151f3838
... skipping 74 lines ...
Content-Type: application/json; charset=utf-8
X-Ms-Request-Charge: 1
Cache-Control: no-cache
Pragma: no-cache
X-Ms-Ratelimit-Remaining-Subscription-Writes: 1196
Date: Wed, 13 Apr 2022 11:24:32 GMT
I0413 11:24:33.060885       1 azure_controller_vmss.go:121] azureDisk - update(kubetest-rdni2sdm): vm(k8s-agentpool1-19736391-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-rdni2sdm/providers/microsoft.compute/disks/pvc-19688ea0-b6c7-41b1-88a0-34aca1038e27:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-19688ea0-b6c7-41b1-88a0-34aca1038e27  false 1}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-rdni2sdm/providers/microsoft.compute/disks/pvc-c05d73f7-14b8-4147-85df-9c73fd3a73fb:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-c05d73f7-14b8-4147-85df-9c73fd3a73fb  false 2})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
(2022-04-13T11:24:33.0609434Z) INFO: REQUEST: GET https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/providers/Microsoft.Compute/locations/westeurope/operations/f47c6d38-b7e2-4e6e-ad63-1dc2efcea5ea?p=b44bdf61-1160-44df-9ef4-720d272442db&api-version=2020-12-01
User-Agent: Go/go1.18 (amd64-linux) go-autorest/v14.2.1 test.csi.azure.com/v1.16.0-eb7e0710ddbc5984b82c0c8453e3a2427fa2a635 gc/go1.18 (amd64-linux) e2e-test
Authorization: **REDACTED**
(2022-04-13T11:24:33.0774057Z) INFO: RESPONSE: 200 https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/providers/Microsoft.Compute/locations/westeurope/operations/f47c6d38-b7e2-4e6e-ad63-1dc2efcea5ea?p=b44bdf61-1160-44df-9ef4-720d272442db&api-version=2020-12-01
Expires: -1
X-Ms-Request-Id: c85932e4-ea2c-434d-b3ce-796725a5e144
... skipping 101 lines ...
Vary: Accept-Encoding
X-Ms-Ratelimit-Remaining-Subscription-Writes: 1195
X-Ms-Routing-Request-Id: WESTEUROPE:20220413T112434Z:111e890d-5562-40be-9273-1e3ad40acaa6
Date: Wed, 13 Apr 2022 11:24:33 GMT
Expires: -1
X-Ms-Ratelimit-Remaining-Resource: Microsoft.Compute/VMScaleSetActions3Min;234,Microsoft.Compute/VMScaleSetActions30Min;1194,Microsoft.Compute/VMScaleSetBatchedVMRequests5Min;2424,Microsoft.Compute/VmssQueuedVMOperations;0
I0413 11:24:34.153095       1 azure_controller_vmss.go:121] azureDisk - update(kubetest-rdni2sdm): vm(k8s-agentpool1-19736391-vmss000002) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-rdni2sdm/providers/microsoft.compute/disks/pvc-d2af40ff-5f30-4e26-ae7f-7c1183a1d045:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-d2af40ff-5f30-4e26-ae7f-7c1183a1d045  false 1})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
(2022-04-13T11:24:34.1531532Z) INFO: REQUEST: GET https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/providers/Microsoft.Compute/locations/westeurope/operations/ac1a7d70-18fa-45ad-9e65-f27a42c81d78?p=b44bdf61-1160-44df-9ef4-720d272442db&api-version=2020-12-01
User-Agent: Go/go1.18 (amd64-linux) go-autorest/v14.2.1 test.csi.azure.com/v1.16.0-eb7e0710ddbc5984b82c0c8453e3a2427fa2a635 gc/go1.18 (amd64-linux) e2e-test
Authorization: **REDACTED**
(2022-04-13T11:24:34.1749776Z) INFO: RESPONSE: 200 https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/providers/Microsoft.Compute/locations/westeurope/operations/ac1a7d70-18fa-45ad-9e65-f27a42c81d78?p=b44bdf61-1160-44df-9ef4-720d272442db&api-version=2020-12-01
Pragma: no-cache
Cache-Control: no-cache
... skipping 88347 lines ...
Azure-Asyncoperation: https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/providers/Microsoft.Compute/locations/westeurope/operations/d577abf5-e0ae-46ae-a18a-158e989236a7?p=b44bdf61-1160-44df-9ef4-720d272442db&api-version=2020-12-01
X-Ms-Ratelimit-Remaining-Resource: Microsoft.Compute/VMScaleSetActions3Min;236,Microsoft.Compute/VMScaleSetActions30Min;1086,Microsoft.Compute/VMScaleSetBatchedVMRequests5Min;2433,Microsoft.Compute/VmssQueuedVMOperations;0
X-Ms-Request-Charge: 1
Strict-Transport-Security: max-age=31536000; includeSubDomains
Server: Microsoft-HTTPAPI/2.0,Microsoft-HTTPAPI/2.0
Date: Wed, 13 Apr 2022 12:15:50 GMT
I0413 12:15:50.229273       1 azure_controller_vmss.go:121] azureDisk - update(kubetest-rdni2sdm): vm(k8s-agentpool1-19736391-vmss000002) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-rdni2sdm/providers/microsoft.compute/disks/pvc-96df3ab2-4f4b-42e8-bed4-7641112b21fc:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-96df3ab2-4f4b-42e8-bed4-7641112b21fc  false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
(2022-04-13T12:15:50.2293617Z) INFO: REQUEST: GET https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/providers/Microsoft.Compute/locations/westeurope/operations/d577abf5-e0ae-46ae-a18a-158e989236a7?p=b44bdf61-1160-44df-9ef4-720d272442db&api-version=2020-12-01
User-Agent: Go/go1.18 (amd64-linux) go-autorest/v14.2.1 test.csi.azure.com/v1.16.0-eb7e0710ddbc5984b82c0c8453e3a2427fa2a635 gc/go1.18 (amd64-linux) e2e-test
Authorization: **REDACTED**
(2022-04-13T12:15:50.2396833Z) INFO: RESPONSE: 200 https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-rdni2sdm/providers/Microsoft.Compute/disks/pvc-9e66ab56-d6ed-4fe9-b8e3-28dc26e0b175?api-version=2021-04-01
X-Ms-Ratelimit-Remaining-Resource: Microsoft.Compute/LowCostGet3Min;4832,Microsoft.Compute/LowCostGet30Min;39100
X-Ms-Ratelimit-Remaining-Subscription-Reads: 11554
... skipping 518 lines ...
Azure-Asyncoperation: https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/providers/Microsoft.Compute/locations/westeurope/operations/b2ae5547-6571-4ed4-9c3a-4e7bfa8c55ea?p=b44bdf61-1160-44df-9ef4-720d272442db&api-version=2020-12-01
Strict-Transport-Security: max-age=31536000; includeSubDomains
X-Ms-Request-Id: b2ae5547-6571-4ed4-9c3a-4e7bfa8c55ea
X-Ms-Ratelimit-Remaining-Resource: Microsoft.Compute/VMScaleSetActions3Min;234,Microsoft.Compute/VMScaleSetActions30Min;1084,Microsoft.Compute/VMScaleSetBatchedVMRequests5Min;2434,Microsoft.Compute/VmssQueuedVMOperations;0
X-Ms-Routing-Request-Id: WESTEUROPE:20220413T121601Z:c577eb3f-29db-41c7-8d70-0485ae8ac4f5
X-Content-Type-Options: nosniff
I0413 12:16:01.221016       1 azure_controller_vmss.go:121] azureDisk - update(kubetest-rdni2sdm): vm(k8s-agentpool1-19736391-vmss000002) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-rdni2sdm/providers/microsoft.compute/disks/pvc-09756100-2ba5-4f63-acc6-9fecfcd9f525:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-09756100-2ba5-4f63-acc6-9fecfcd9f525  false 4}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-rdni2sdm/providers/microsoft.compute/disks/pvc-0a74449a-654e-415a-8ba1-3d2dc45c8527:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-0a74449a-654e-415a-8ba1-3d2dc45c8527  false 15}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-rdni2sdm/providers/microsoft.compute/disks/pvc-11c360e4-6dc4-4b8b-91b9-b3f5170b5e1a:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-11c360e4-6dc4-4b8b-91b9-b3f5170b5e1a  false 5}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-rdni2sdm/providers/microsoft.compute/disks/pvc-1bbbc790-50f3-484f-a67d-3df2752f0afd:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-1bbbc790-50f3-484f-a67d-3df2752f0afd  false 3}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-rdni2sdm/providers/microsoft.compute/disks/pvc-24b131c8-d537-48af-ae1c-2ec7ff8346aa:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-24b131c8-d537-48af-ae1c-2ec7ff8346aa  false 8}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-rdni2sdm/providers/microsoft.compute/disks/pvc-3b8147d0-0c61-4e6d-9ff8-9db347b8397e:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-3b8147d0-0c61-4e6d-9ff8-9db347b8397e  false 7}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-rdni2sdm/providers/microsoft.compute/disks/pvc-40c8e798-70a0-4fb2-abe1-17edeaecfffd:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-40c8e798-70a0-4fb2-abe1-17edeaecfffd  false 11}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-rdni2sdm/providers/microsoft.compute/disks/pvc-4f34451a-ce24-446c-b5f5-87ebf4861a72:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-4f34451a-ce24-446c-b5f5-87ebf4861a72  false 13}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-rdni2sdm/providers/microsoft.compute/disks/pvc-7739c980-acf8-4085-a4c1-599e7dcd2d16:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-7739c980-acf8-4085-a4c1-599e7dcd2d16  false 6}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-rdni2sdm/providers/microsoft.compute/disks/pvc-9e66ab56-d6ed-4fe9-b8e3-28dc26e0b175:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-9e66ab56-d6ed-4fe9-b8e3-28dc26e0b175  false 1}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-rdni2sdm/providers/microsoft.compute/disks/pvc-9fb20d06-b57d-42e9-9154-08fe14aec896:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-9fb20d06-b57d-42e9-9154-08fe14aec896  false 2}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-rdni2sdm/providers/microsoft.compute/disks/pvc-aaf469a6-8988-4a54-88bf-f66eb54e9008:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-aaf469a6-8988-4a54-88bf-f66eb54e9008  false 14}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-rdni2sdm/providers/microsoft.compute/disks/pvc-aca63f2a-3d79-4829-bd50-1bbd68cd6ff4:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-aca63f2a-3d79-4829-bd50-1bbd68cd6ff4  false 9}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-rdni2sdm/providers/microsoft.compute/disks/pvc-e915a4e5-d7f7-432a-8311-aebdff7eb523:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-e915a4e5-d7f7-432a-8311-aebdff7eb523  false 12}) /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-rdni2sdm/providers/microsoft.compute/disks/pvc-fd0a2507-b633-44ed-9fa1-1c99dd591721:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-fd0a2507-b633-44ed-9fa1-1c99dd591721  false 10})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
(2022-04-13T12:16:01.2211364Z) INFO: REQUEST: GET https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/providers/Microsoft.Compute/locations/westeurope/operations/b2ae5547-6571-4ed4-9c3a-4e7bfa8c55ea?p=b44bdf61-1160-44df-9ef4-720d272442db&api-version=2020-12-01
User-Agent: Go/go1.18 (amd64-linux) go-autorest/v14.2.1 test.csi.azure.com/v1.16.0-eb7e0710ddbc5984b82c0c8453e3a2427fa2a635 gc/go1.18 (amd64-linux) e2e-test
Authorization: **REDACTED**
(2022-04-13T12:16:01.2398303Z) INFO: RESPONSE: 200 https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/providers/Microsoft.Compute/locations/westeurope/operations/b2ae5547-6571-4ed4-9c3a-4e7bfa8c55ea?p=b44bdf61-1160-44df-9ef4-720d272442db&api-version=2020-12-01
Content-Type: application/json; charset=utf-8
Pragma: no-cache
... skipping 3003 lines ...
Expires: -1
X-Ms-Routing-Request-Id: WESTEUROPE:20220413T121835Z:9efb1e9d-e9ed-4d17-a4da-85a6a9f13e85
Cache-Control: no-cache
X-Ms-Ratelimit-Remaining-Subscription-Writes: 1190
Content-Type: application/json; charset=utf-8
Server: Microsoft-HTTPAPI/2.0,Microsoft-HTTPAPI/2.0
I0413 12:18:35.188284       1 azure_controller_vmss.go:121] azureDisk - update(kubetest-rdni2sdm): vm(k8s-agentpool1-19736391-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-rdni2sdm/providers/microsoft.compute/disks/pvc-601bef47-2e55-4b3a-b8f0-261984cd1e9a:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-601bef47-2e55-4b3a-b8f0-261984cd1e9a  false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
(2022-04-13T12:18:35.1883850Z) INFO: REQUEST: GET https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/providers/Microsoft.Compute/locations/westeurope/operations/d9ec57f0-825b-4d52-996c-9a3bf16c1e8c?p=b44bdf61-1160-44df-9ef4-720d272442db&api-version=2020-12-01
User-Agent: Go/go1.18 (amd64-linux) go-autorest/v14.2.1 test.csi.azure.com/v1.16.0-eb7e0710ddbc5984b82c0c8453e3a2427fa2a635 gc/go1.18 (amd64-linux) e2e-test
Authorization: **REDACTED**
(2022-04-13T12:18:35.2176913Z) INFO: RESPONSE: 200 https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/providers/Microsoft.Compute/locations/westeurope/operations/d9ec57f0-825b-4d52-996c-9a3bf16c1e8c?p=b44bdf61-1160-44df-9ef4-720d272442db&api-version=2020-12-01
Vary: Accept-Encoding
X-Ms-Ratelimit-Remaining-Subscription-Reads: 11917
... skipping 465 lines ...
X-Ms-Ratelimit-Remaining-Resource: Microsoft.Compute/VMScaleSetActions3Min;235,Microsoft.Compute/VMScaleSetActions30Min;1107,Microsoft.Compute/VMScaleSetBatchedVMRequests5Min;2438,Microsoft.Compute/VmssQueuedVMOperations;0
Content-Type: application/json; charset=utf-8
X-Ms-Request-Charge: 1
Server: Microsoft-HTTPAPI/2.0,Microsoft-HTTPAPI/2.0
X-Content-Type-Options: nosniff
Date: Wed, 13 Apr 2022 12:20:13 GMT
I0413 12:20:13.672646       1 azure_controller_vmss.go:121] azureDisk - update(kubetest-rdni2sdm): vm(k8s-agentpool1-19736391-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-rdni2sdm/providers/microsoft.compute/disks/pvc-78f8a5ec-3dad-4c21-a705-5d0424a1342d:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-78f8a5ec-3dad-4c21-a705-5d0424a1342d  false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
(2022-04-13T12:20:13.6727162Z) INFO: REQUEST: GET https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/providers/Microsoft.Compute/locations/westeurope/operations/3e9e6503-67e7-4ca1-b6be-310562fddd46?p=b44bdf61-1160-44df-9ef4-720d272442db&api-version=2020-12-01
User-Agent: Go/go1.18 (amd64-linux) go-autorest/v14.2.1 test.csi.azure.com/v1.16.0-eb7e0710ddbc5984b82c0c8453e3a2427fa2a635 gc/go1.18 (amd64-linux) e2e-test
Authorization: **REDACTED**
(2022-04-13T12:20:13.7175282Z) INFO: RESPONSE: 200 https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/providers/Microsoft.Compute/locations/westeurope/operations/3e9e6503-67e7-4ca1-b6be-310562fddd46?p=b44bdf61-1160-44df-9ef4-720d272442db&api-version=2020-12-01
Content-Type: application/json; charset=utf-8
Expires: -1
... skipping 208 lines ...
Azure-Asyncoperation: https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/providers/Microsoft.Compute/locations/westeurope/operations/13b6ca60-aaad-4f80-96c6-ad7c72355bc8?p=b44bdf61-1160-44df-9ef4-720d272442db&api-version=2020-12-01
X-Ms-Ratelimit-Remaining-Resource: Microsoft.Compute/VMScaleSetActions3Min;236,Microsoft.Compute/VMScaleSetActions30Min;1106,Microsoft.Compute/VMScaleSetBatchedVMRequests5Min;2437,Microsoft.Compute/VmssQueuedVMOperations;0
Date: Wed, 13 Apr 2022 12:20:34 GMT
Cache-Control: no-cache
X-Ms-Request-Id: 13b6ca60-aaad-4f80-96c6-ad7c72355bc8
X-Ms-Ratelimit-Remaining-Subscription-Writes: 1185
I0413 12:20:35.493268       1 azure_controller_vmss.go:121] azureDisk - update(kubetest-rdni2sdm): vm(k8s-agentpool1-19736391-vmss000002) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-rdni2sdm/providers/microsoft.compute/disks/pvc-980696cb-7fb2-4bde-a48a-0940bc79c067:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-980696cb-7fb2-4bde-a48a-0940bc79c067  false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
(2022-04-13T12:20:35.4933516Z) INFO: REQUEST: GET https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/providers/Microsoft.Compute/locations/westeurope/operations/13b6ca60-aaad-4f80-96c6-ad7c72355bc8?p=b44bdf61-1160-44df-9ef4-720d272442db&api-version=2020-12-01
User-Agent: Go/go1.18 (amd64-linux) go-autorest/v14.2.1 test.csi.azure.com/v1.16.0-eb7e0710ddbc5984b82c0c8453e3a2427fa2a635 gc/go1.18 (amd64-linux) e2e-test
Authorization: **REDACTED**
(2022-04-13T12:20:35.5101724Z) INFO: RESPONSE: 200 https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/providers/Microsoft.Compute/locations/westeurope/operations/13b6ca60-aaad-4f80-96c6-ad7c72355bc8?p=b44bdf61-1160-44df-9ef4-720d272442db&api-version=2020-12-01
X-Ms-Ratelimit-Remaining-Resource: Microsoft.Compute/GetOperation3Min;14988,Microsoft.Compute/GetOperation30Min;29311
Content-Type: application/json; charset=utf-8
... skipping 228 lines ...
X-Ms-Ratelimit-Remaining-Resource: Microsoft.Compute/VMScaleSetActions3Min;235,Microsoft.Compute/VMScaleSetActions30Min;1105,Microsoft.Compute/VMScaleSetBatchedVMRequests5Min;2436,Microsoft.Compute/VmssQueuedVMOperations;0
X-Ms-Request-Id: 1fe1d88d-51de-45c8-b842-f1b5eee8673d
Content-Type: application/json; charset=utf-8
Expires: -1
Vary: Accept-Encoding
Date: Wed, 13 Apr 2022 12:20:58 GMT
I0413 12:20:58.765995       1 azure_controller_vmss.go:121] azureDisk - update(kubetest-rdni2sdm): vm(k8s-agentpool1-19736391-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-rdni2sdm/providers/microsoft.compute/disks/pvc-0f0b9900-4749-4d11-adc6-dd06c7ee308a:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-0f0b9900-4749-4d11-adc6-dd06c7ee308a  false 0})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
(2022-04-13T12:20:58.7661119Z) INFO: REQUEST: GET https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/providers/Microsoft.Compute/locations/westeurope/operations/1fe1d88d-51de-45c8-b842-f1b5eee8673d?p=b44bdf61-1160-44df-9ef4-720d272442db&api-version=2020-12-01
User-Agent: Go/go1.18 (amd64-linux) go-autorest/v14.2.1 test.csi.azure.com/v1.16.0-eb7e0710ddbc5984b82c0c8453e3a2427fa2a635 gc/go1.18 (amd64-linux) e2e-test
Authorization: **REDACTED**
(2022-04-13T12:20:58.7838443Z) INFO: RESPONSE: 200 https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/providers/Microsoft.Compute/locations/westeurope/operations/1fe1d88d-51de-45c8-b842-f1b5eee8673d?p=b44bdf61-1160-44df-9ef4-720d272442db&api-version=2020-12-01
Pragma: no-cache
Vary: Accept-Encoding
... skipping 208 lines ...
X-Ms-Request-Charge: 1
X-Content-Type-Options: nosniff
Date: Wed, 13 Apr 2022 12:21:23 GMT
Cache-Control: no-cache
Pragma: no-cache
Server: Microsoft-HTTPAPI/2.0,Microsoft-HTTPAPI/2.0
I0413 12:21:24.044732       1 azure_controller_vmss.go:121] azureDisk - update(kubetest-rdni2sdm): vm(k8s-agentpool1-19736391-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-rdni2sdm/providers/microsoft.compute/disks/pvc-2088a5cc-4313-4d6b-b0ca-a80803e0b1e9:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-2088a5cc-4313-4d6b-b0ca-a80803e0b1e9  false 1})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
(2022-04-13T12:21:24.0447981Z) INFO: REQUEST: GET https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/providers/Microsoft.Compute/locations/westeurope/operations/86096836-b783-42bc-a5d9-d0d04790333a?p=b44bdf61-1160-44df-9ef4-720d272442db&api-version=2020-12-01
User-Agent: Go/go1.18 (amd64-linux) go-autorest/v14.2.1 test.csi.azure.com/v1.16.0-eb7e0710ddbc5984b82c0c8453e3a2427fa2a635 gc/go1.18 (amd64-linux) e2e-test
Authorization: **REDACTED**
(2022-04-13T12:21:24.0628522Z) INFO: RESPONSE: 200 https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/providers/Microsoft.Compute/locations/westeurope/operations/86096836-b783-42bc-a5d9-d0d04790333a?p=b44bdf61-1160-44df-9ef4-720d272442db&api-version=2020-12-01
Date: Wed, 13 Apr 2022 12:21:23 GMT
X-Ms-Routing-Request-Id: WESTEUROPE:20220413T122124Z:dec6b80d-7bf5-45fa-aa4f-10290224f8b8
... skipping 408 lines ...
Strict-Transport-Security: max-age=31536000; includeSubDomains
X-Ms-Correlation-Request-Id: 0694a6a3-8875-4534-94f3-7c456a09a865
X-Ms-Ratelimit-Remaining-Subscription-Writes: 1129
X-Content-Type-Options: nosniff
Vary: Accept-Encoding
X-Ms-Request-Id: deca8696-9fe8-4de6-b879-7436f37a1b2e
I0413 12:21:43.658096       1 azure_controller_vmss.go:121] azureDisk - update(kubetest-rdni2sdm): vm(k8s-agentpool1-19736391-vmss000000) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-rdni2sdm/providers/microsoft.compute/disks/pvc-25dbcb39-8aeb-48e2-9636-31939c16c4b8:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-25dbcb39-8aeb-48e2-9636-31939c16c4b8  false 2})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
(2022-04-13T12:21:43.6582062Z) INFO: REQUEST: GET https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/providers/Microsoft.Compute/locations/westeurope/operations/deca8696-9fe8-4de6-b879-7436f37a1b2e?p=b44bdf61-1160-44df-9ef4-720d272442db&api-version=2020-12-01
User-Agent: Go/go1.18 (amd64-linux) go-autorest/v14.2.1 test.csi.azure.com/v1.16.0-eb7e0710ddbc5984b82c0c8453e3a2427fa2a635 gc/go1.18 (amd64-linux) e2e-test
Authorization: **REDACTED**
I0413 12:21:43.693801       1 utils.go:77] GRPC call: /csi.v1.Controller/ControllerPublishVolume
I0413 12:21:43.693856       1 utils.go:78] GRPC request: {"node_id":"k8s-agentpool1-19736391-vmss000001","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":7}},"volume_context":{"csi.storage.k8s.io/pv/name":"pvc-a9df4924-06f8-4433-a2c5-73f70d7cff9c","csi.storage.k8s.io/pvc/name":"daemonset-azuredisk-ephemeral-jlgs5-azuredisk","csi.storage.k8s.io/pvc/namespace":"default","requestedsizegib":"10","skuName":"StandardSSD_LRS","storage.kubernetes.io/csiProvisionerIdentity":"1649849041185-8081-test.csi.azure.com"},"volume_id":"/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-rdni2sdm/providers/Microsoft.Compute/disks/pvc-a9df4924-06f8-4433-a2c5-73f70d7cff9c"}
(2022-04-13T12:21:43.6940900Z) INFO: REQUEST: GET https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-rdni2sdm/providers/Microsoft.Compute/disks/pvc-a9df4924-06f8-4433-a2c5-73f70d7cff9c?api-version=2021-04-01
... skipping 89 lines ...
X-Ms-Ratelimit-Remaining-Resource: Microsoft.Compute/VMScaleSetActions3Min;233,Microsoft.Compute/VMScaleSetActions30Min;1102,Microsoft.Compute/VMScaleSetBatchedVMRequests5Min;2435,Microsoft.Compute/VmssQueuedVMOperations;0
X-Ms-Request-Charge: 1
X-Ms-Correlation-Request-Id: 0bd58223-97e0-4bdb-bbf7-802f53976406
Date: Wed, 13 Apr 2022 12:21:42 GMT
Pragma: no-cache
X-Ms-Ratelimit-Remaining-Subscription-Writes: 1128
I0413 12:21:43.916615       1 azure_controller_vmss.go:121] azureDisk - update(kubetest-rdni2sdm): vm(k8s-agentpool1-19736391-vmss000002) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-rdni2sdm/providers/microsoft.compute/disks/pvc-a399058e-8f34-4859-8aef-b6365de69316:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-a399058e-8f34-4859-8aef-b6365de69316  false 1})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
(2022-04-13T12:21:43.9166938Z) INFO: REQUEST: GET https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/providers/Microsoft.Compute/locations/westeurope/operations/a1676d3d-dc1d-4986-9f24-7886d2dfe87f?p=b44bdf61-1160-44df-9ef4-720d272442db&api-version=2020-12-01
Authorization: **REDACTED**
User-Agent: Go/go1.18 (amd64-linux) go-autorest/v14.2.1 test.csi.azure.com/v1.16.0-eb7e0710ddbc5984b82c0c8453e3a2427fa2a635 gc/go1.18 (amd64-linux) e2e-test
(2022-04-13T12:21:43.9546779Z) INFO: RESPONSE: 200 https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/providers/Microsoft.Compute/locations/westeurope/operations/a1676d3d-dc1d-4986-9f24-7886d2dfe87f?p=b44bdf61-1160-44df-9ef4-720d272442db&api-version=2020-12-01
Strict-Transport-Security: max-age=31536000; includeSubDomains
X-Ms-Routing-Request-Id: WESTEUROPE:20220413T122143Z:51a4dd8e-9f9c-411b-9471-03916a5badb0
... skipping 25 lines ...
X-Ms-Request-Id: 9e653bef-44f1-4774-a1e6-0df6791b042a
Server: Microsoft-HTTPAPI/2.0,Microsoft-HTTPAPI/2.0
X-Ms-Ratelimit-Remaining-Resource: Microsoft.Compute/VMScaleSetActions3Min;232,Microsoft.Compute/VMScaleSetActions30Min;1101,Microsoft.Compute/VMScaleSetBatchedVMRequests5Min;2434,Microsoft.Compute/VmssQueuedVMOperations;0
X-Ms-Ratelimit-Remaining-Subscription-Writes: 1178
Expires: -1
X-Ms-Request-Charge: 1
I0413 12:21:43.978853       1 azure_controller_vmss.go:121] azureDisk - update(kubetest-rdni2sdm): vm(k8s-agentpool1-19736391-vmss000001) - attach disk list(map[/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourcegroups/kubetest-rdni2sdm/providers/microsoft.compute/disks/pvc-a9df4924-06f8-4433-a2c5-73f70d7cff9c:%!s(*provider.AttachDiskOptions=&{ReadOnly pvc-a9df4924-06f8-4433-a2c5-73f70d7cff9c  false 1})], %!s(*retry.Error=<nil>)) returned with %!v(MISSING)
(2022-04-13T12:21:43.9789325Z) INFO: REQUEST: GET https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/providers/Microsoft.Compute/locations/westeurope/operations/9e653bef-44f1-4774-a1e6-0df6791b042a?p=b44bdf61-1160-44df-9ef4-720d272442db&api-version=2020-12-01
User-Agent: Go/go1.18 (amd64-linux) go-autorest/v14.2.1 test.csi.azure.com/v1.16.0-eb7e0710ddbc5984b82c0c8453e3a2427fa2a635 gc/go1.18 (amd64-linux) e2e-test
Authorization: **REDACTED**
(2022-04-13T12:21:44.0141272Z) INFO: RESPONSE: 200 https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/providers/Microsoft.Compute/locations/westeurope/operations/9e653bef-44f1-4774-a1e6-0df6791b042a?p=b44bdf61-1160-44df-9ef4-720d272442db&api-version=2020-12-01
Strict-Transport-Security: max-age=31536000; includeSubDomains
X-Ms-Request-Id: 34e277ae-b4f7-44f8-8b9f-41e8ec7c2d9e
... skipping 317 lines ...
Platform: linux/amd64
Topology Key: topology.test.csi.azure.com/zone

Streaming logs below:
I0413 11:23:48.138547       1 azuredisk.go:165] driver userAgent: test.csi.azure.com/v1.16.0-eb7e0710ddbc5984b82c0c8453e3a2427fa2a635 gc/go1.18 (amd64-linux) e2e-test
I0413 11:23:48.139014       1 azure_disk_utils.go:158] reading cloud config from secret kube-system/azure-cloud-provider
W0413 11:23:48.158635       1 azure_disk_utils.go:165] InitializeCloudFromSecret: failed to get cloud config from secret kube-system/azure-cloud-provider: failed to get secret kube-system/azure-cloud-provider: secrets "azure-cloud-provider" not found
I0413 11:23:48.158684       1 azure_disk_utils.go:170] could not read cloud config from secret kube-system/azure-cloud-provider
I0413 11:23:48.158696       1 azure_disk_utils.go:180] use default AZURE_CREDENTIAL_FILE env var: /etc/kubernetes/azure.json
I0413 11:23:48.158724       1 azure_disk_utils.go:188] read cloud config from file: /etc/kubernetes/azure.json successfully
I0413 11:23:48.160494       1 azure_auth.go:245] Using AzurePublicCloud environment
I0413 11:23:48.160520       1 azure_auth.go:96] azure: using managed identity extension to retrieve access token
I0413 11:23:48.160527       1 azure_auth.go:102] azure: using User Assigned MSI ID to retrieve access token
I0413 11:23:48.160589       1 azure_auth.go:113] azure: User Assigned MSI ID is client ID. Resource ID parsing error: %+vparsing failed for d836aae9-bfe2-46f5-9585-40c7ce533911. Invalid resource Id format
(2022-04-13T11:23:48.1605969Z) INFO: Managed identity environment is IMDS, endpoint is http://169.254.169.254/metadata/identity/oauth2/token
(2022-04-13T11:23:48.1606324Z) INFO: Managed identity custom endpoint is http://169.254.169.254/metadata/identity/oauth2/token
I0413 11:23:48.160665       1 azure.go:738] Azure cloudprovider using try backoff: retries=6, exponent=1.500000, duration=5, jitter=1.000000
I0413 11:23:48.160714       1 azure_interfaceclient.go:70] Azure InterfacesClient (read ops) using rate limit config: QPS=6, bucket=20
I0413 11:23:48.160733       1 azure_interfaceclient.go:73] Azure InterfacesClient (write ops) using rate limit config: QPS=100, bucket=1000
I0413 11:23:48.160750       1 azure_vmsizeclient.go:68] Azure VirtualMachineSizesClient (read ops) using rate limit config: QPS=6, bucket=20
... skipping 2476 lines ...
Platform: linux/amd64
Topology Key: topology.test.csi.azure.com/zone

Streaming logs below:
I0413 11:23:49.096858       1 azuredisk.go:165] driver userAgent: test.csi.azure.com/v1.16.0-eb7e0710ddbc5984b82c0c8453e3a2427fa2a635 gc/go1.18 (amd64-linux) e2e-test
I0413 11:23:49.097257       1 azure_disk_utils.go:158] reading cloud config from secret kube-system/azure-cloud-provider
W0413 11:23:49.116415       1 azure_disk_utils.go:165] InitializeCloudFromSecret: failed to get cloud config from secret kube-system/azure-cloud-provider: failed to get secret kube-system/azure-cloud-provider: secrets "azure-cloud-provider" not found
I0413 11:23:49.116440       1 azure_disk_utils.go:170] could not read cloud config from secret kube-system/azure-cloud-provider
I0413 11:23:49.116448       1 azure_disk_utils.go:180] use default AZURE_CREDENTIAL_FILE env var: /etc/kubernetes/azure.json
I0413 11:23:49.116472       1 azure_disk_utils.go:188] read cloud config from file: /etc/kubernetes/azure.json successfully
I0413 11:23:49.118024       1 azure_auth.go:245] Using AzurePublicCloud environment
I0413 11:23:49.118052       1 azure_auth.go:96] azure: using managed identity extension to retrieve access token
I0413 11:23:49.118063       1 azure_auth.go:102] azure: using User Assigned MSI ID to retrieve access token
I0413 11:23:49.118100       1 azure_auth.go:113] azure: User Assigned MSI ID is client ID. Resource ID parsing error: %+vparsing failed for d836aae9-bfe2-46f5-9585-40c7ce533911. Invalid resource Id format
(2022-04-13T11:23:49.1181191Z) INFO: Managed identity environment is IMDS, endpoint is http://169.254.169.254/metadata/identity/oauth2/token
(2022-04-13T11:23:49.1181589Z) INFO: Managed identity custom endpoint is http://169.254.169.254/metadata/identity/oauth2/token
I0413 11:23:49.118195       1 azure.go:738] Azure cloudprovider using try backoff: retries=6, exponent=1.500000, duration=5, jitter=1.000000
I0413 11:23:49.118251       1 azure_interfaceclient.go:70] Azure InterfacesClient (read ops) using rate limit config: QPS=6, bucket=20
I0413 11:23:49.118268       1 azure_interfaceclient.go:73] Azure InterfacesClient (write ops) using rate limit config: QPS=100, bucket=1000
I0413 11:23:49.118282       1 azure_vmsizeclient.go:68] Azure VirtualMachineSizesClient (read ops) using rate limit config: QPS=6, bucket=20
... skipping 2128 lines ...
Platform: linux/amd64
Topology Key: topology.test.csi.azure.com/zone

Streaming logs below:
I0413 11:23:54.615246       1 azuredisk.go:165] driver userAgent: test.csi.azure.com/v1.16.0-eb7e0710ddbc5984b82c0c8453e3a2427fa2a635 gc/go1.18 (amd64-linux) e2e-test
I0413 11:23:54.615700       1 azure_disk_utils.go:158] reading cloud config from secret kube-system/azure-cloud-provider
W0413 11:23:54.641004       1 azure_disk_utils.go:165] InitializeCloudFromSecret: failed to get cloud config from secret kube-system/azure-cloud-provider: failed to get secret kube-system/azure-cloud-provider: secrets "azure-cloud-provider" not found
I0413 11:23:54.641029       1 azure_disk_utils.go:170] could not read cloud config from secret kube-system/azure-cloud-provider
I0413 11:23:54.641037       1 azure_disk_utils.go:180] use default AZURE_CREDENTIAL_FILE env var: /etc/kubernetes/azure.json
I0413 11:23:54.641064       1 azure_disk_utils.go:188] read cloud config from file: /etc/kubernetes/azure.json successfully
I0413 11:23:54.641875       1 azure_auth.go:245] Using AzurePublicCloud environment
I0413 11:23:54.641922       1 azure_auth.go:96] azure: using managed identity extension to retrieve access token
I0413 11:23:54.641928       1 azure_auth.go:102] azure: using User Assigned MSI ID to retrieve access token
I0413 11:23:54.641991       1 azure_auth.go:113] azure: User Assigned MSI ID is client ID. Resource ID parsing error: %+vparsing failed for d836aae9-bfe2-46f5-9585-40c7ce533911. Invalid resource Id format
(2022-04-13T11:23:54.6419986Z) INFO: Managed identity environment is IMDS, endpoint is http://169.254.169.254/metadata/identity/oauth2/token
(2022-04-13T11:23:54.6420445Z) INFO: Managed identity custom endpoint is http://169.254.169.254/metadata/identity/oauth2/token
I0413 11:23:54.642351       1 azure.go:738] Azure cloudprovider using try backoff: retries=6, exponent=1.500000, duration=5, jitter=1.000000
I0413 11:23:54.642451       1 azure_interfaceclient.go:70] Azure InterfacesClient (read ops) using rate limit config: QPS=6, bucket=20
I0413 11:23:54.642486       1 azure_interfaceclient.go:73] Azure InterfacesClient (write ops) using rate limit config: QPS=100, bucket=1000
I0413 11:23:54.642510       1 azure_vmsizeclient.go:68] Azure VirtualMachineSizesClient (read ops) using rate limit config: QPS=6, bucket=20
... skipping 2770 lines ...
Platform: linux/amd64
Topology Key: topology.test.csi.azure.com/zone

Streaming logs below:
I0413 11:23:48.500861       1 azuredisk.go:165] driver userAgent: test.csi.azure.com/v1.16.0-eb7e0710ddbc5984b82c0c8453e3a2427fa2a635 gc/go1.18 (amd64-linux) e2e-test
I0413 11:23:48.501331       1 azure_disk_utils.go:158] reading cloud config from secret kube-system/azure-cloud-provider
W0413 11:23:48.538541       1 azure_disk_utils.go:165] InitializeCloudFromSecret: failed to get cloud config from secret kube-system/azure-cloud-provider: failed to get secret kube-system/azure-cloud-provider: secrets "azure-cloud-provider" not found
I0413 11:23:48.538775       1 azure_disk_utils.go:170] could not read cloud config from secret kube-system/azure-cloud-provider
I0413 11:23:48.538868       1 azure_disk_utils.go:180] use default AZURE_CREDENTIAL_FILE env var: /etc/kubernetes/azure.json
I0413 11:23:48.538970       1 azure_disk_utils.go:188] read cloud config from file: /etc/kubernetes/azure.json successfully
I0413 11:23:48.540322       1 azure_auth.go:245] Using AzurePublicCloud environment
I0413 11:23:48.540493       1 azure_auth.go:96] azure: using managed identity extension to retrieve access token
I0413 11:23:48.540598       1 azure_auth.go:102] azure: using User Assigned MSI ID to retrieve access token
I0413 11:23:48.540739       1 azure_auth.go:113] azure: User Assigned MSI ID is client ID. Resource ID parsing error: %+vparsing failed for d836aae9-bfe2-46f5-9585-40c7ce533911. Invalid resource Id format
(2022-04-13T11:23:48.5407516Z) INFO: Managed identity environment is IMDS, endpoint is http://169.254.169.254/metadata/identity/oauth2/token
(2022-04-13T11:23:48.5407751Z) INFO: Managed identity custom endpoint is http://169.254.169.254/metadata/identity/oauth2/token
I0413 11:23:48.540917       1 azure.go:738] Azure cloudprovider using try backoff: retries=6, exponent=1.500000, duration=5, jitter=1.000000
I0413 11:23:48.541153       1 azure_interfaceclient.go:70] Azure InterfacesClient (read ops) using rate limit config: QPS=6, bucket=20
I0413 11:23:48.541167       1 azure_interfaceclient.go:73] Azure InterfacesClient (write ops) using rate limit config: QPS=100, bucket=1000
I0413 11:23:48.541184       1 azure_vmsizeclient.go:68] Azure VirtualMachineSizesClient (read ops) using rate limit config: QPS=6, bucket=20
... skipping 51 lines ...
I0413 11:23:49.782866       1 nodeserver.go:352] NodeGetInfo, nodeName: k8s-master-19736391-0, failureDomain: 0
I0413 11:23:49.782890       1 nodeserver.go:410] got a matching size in getMaxDataDiskCount, VM Size: STANDARD_D2S_V3, MaxDataDiskCount: 4
I0413 11:23:49.783013       1 utils.go:84] GRPC response: {"accessible_topology":{"segments":{"topology.test.csi.azure.com/zone":""}},"max_volumes_per_node":4,"node_id":"k8s-master-19736391-0"}
print out csi-test-node-win logs ...
======================================================================================
No resources found in kube-system namespace.
make: *** [Makefile:260: e2e-test] Error 1
2022/04/13 12:22:17 process.go:155: Step 'make e2e-test' finished in 1h9m27.622514773s
2022/04/13 12:22:17 aksengine_helpers.go:426: downloading /root/tmp1956769959/log-dump.sh from https://raw.githubusercontent.com/kubernetes-sigs/cloud-provider-azure/master/hack/log-dump/log-dump.sh
2022/04/13 12:22:17 util.go:71: curl https://raw.githubusercontent.com/kubernetes-sigs/cloud-provider-azure/master/hack/log-dump/log-dump.sh
2022/04/13 12:22:17 process.go:153: Running: chmod +x /root/tmp1956769959/log-dump.sh
2022/04/13 12:22:17 process.go:155: Step 'chmod +x /root/tmp1956769959/log-dump.sh' finished in 1.462774ms
2022/04/13 12:22:17 aksengine_helpers.go:426: downloading /root/tmp1956769959/log-dump-daemonset.yaml from https://raw.githubusercontent.com/kubernetes-sigs/cloud-provider-azure/master/hack/log-dump/log-dump-daemonset.yaml
... skipping 63 lines ...
ssh key file /root/.ssh/id_rsa does not exist. Exiting.
2022/04/13 12:23:16 process.go:155: Step 'bash -c /root/tmp1956769959/win-ci-logs-collector.sh kubetest-rdni2sdm.westeurope.cloudapp.azure.com /root/tmp1956769959 /root/.ssh/id_rsa' finished in 3.61173ms
2022/04/13 12:23:16 aksengine.go:1141: Deleting resource group: kubetest-rdni2sdm.
2022/04/13 12:31:27 process.go:96: Saved XML output to /logs/artifacts/junit_runner.xml.
2022/04/13 12:31:27 process.go:153: Running: bash -c . hack/lib/version.sh && KUBE_ROOT=. kube::version::get_version_vars && echo "${KUBE_GIT_VERSION-}"
2022/04/13 12:31:27 process.go:155: Step 'bash -c . hack/lib/version.sh && KUBE_ROOT=. kube::version::get_version_vars && echo "${KUBE_GIT_VERSION-}"' finished in 264.824565ms
2022/04/13 12:31:27 main.go:331: Something went wrong: encountered 1 errors: [error during make e2e-test: exit status 2]
+ EXIT_VALUE=1
+ set +o xtrace
Cleaning up after docker in docker.
================================================================================
Cleaning up after docker
bdc6fdab2f62
... skipping 4 lines ...
PR	andyzhangx: test: support Win2022 test on capz
Result	FAILURE
Tests	1 failed / 13 succeeded
Started	2022-04-13 11:08
Elapsed	1h23m
Revision	d7600c07bbfa811ac4d88920710966de02038df5
Refs	1280
job-version	v1.24.0-beta.0.115+65178fec72df62
kubetest-version
revision	v1.24.0-beta.0.115+65178fec72df62
kubernetes-sigs/azuredisk-csi-driver PR #1280 pull-azuredisk-csi-driver-external-e2e-single-az #1514198256928690176

Test Failures

kubetest Test 1h9m

Passed

Error lines from build-log.txt
