This job view page is being replaced by Spyglass soon. Check out the new job view.
PRandyzhangx: feat: support disabling CreateVolume in CSI migration
ResultFAILURE
Tests 0 failed / 0 succeeded
Started2021-07-19 04:12
Elapsed2h15m
Revision1e7bc364e422972100e83324165a5160324163ba
Refs 944

No Test Failures!


Error lines from build-log.txt

... skipping 69 lines ...

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100 11248  100 11248    0     0   192k      0 --:--:-- --:--:-- --:--:--  192k
Downloading https://get.helm.sh/helm-v3.6.3-linux-amd64.tar.gz
Verifying checksum... Done.
Preparing to install helm into /usr/local/bin
helm installed into /usr/local/bin/helm
docker pull k8sprow.azurecr.io/azuredisk-csi:v1.5.0-715e2992cf5195fa8c444ee96493975db3499a24 || make container-all push-manifest
Error response from daemon: manifest for k8sprow.azurecr.io/azuredisk-csi:v1.5.0-715e2992cf5195fa8c444ee96493975db3499a24 not found: manifest unknown: manifest tagged by "v1.5.0-715e2992cf5195fa8c444ee96493975db3499a24" is not found
make[2]: Entering directory '/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver'
CGO_ENABLED=0 GOOS=windows go build -a -ldflags "-X sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk.driverVersion=v1.5.0-715e2992cf5195fa8c444ee96493975db3499a24 -X sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk.gitCommit=715e2992cf5195fa8c444ee96493975db3499a24 -X sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk.buildDate=2021-07-19T04:19:34Z -extldflags "-static""  -mod vendor -o _output/amd64/azurediskplugin.exe ./pkg/azurediskplugin
docker buildx rm container-builder || true
error: no builder "container-builder" found
docker buildx create --use --name=container-builder
container-builder
# enable qemu for arm64 build
# https://github.com/docker/buildx/issues/464#issuecomment-741507760
docker run --privileged --rm tonistiigi/binfmt --uninstall qemu-aarch64
Unable to find image 'tonistiigi/binfmt:latest' locally
... skipping 1549 lines ...
                    type: string
                type: object
              volumeSnapshotClassName:
                description: 'volumeSnapshotClassName is the name of the VolumeSnapshotClass
                  requested by the VolumeSnapshot. If not specified, the default snapshot
                  class will be used if one exists. If not specified, and there is
                  no default snapshot class, dynamic snapshot creation will fail.
                  Empty string is not allowed for this field. TODO(xiangqian): a webhook
                  validation on empty string. More info: https://kubernetes.io/docs/concepts/storage/volume-snapshot-classes'
                type: string
            required:
            - source
            type: object
... skipping 22 lines ...
                  pre-existing snapshot, this field will be filled with the "creation_time"
                  value returned from the CSI "ListSnapshots" gRPC call if the driver
                  supports it. If not specified, it indicates that the creation time
                  of the snapshot is unknown.
                format: date-time
                type: string
              error:
                description: error is the last observed error during snapshot creation,
                  if any. This field could be helpful to upper level controllers(i.e.,
                  application controller) to decide whether they should continue on
                  waiting for the snapshot to be created based on the type of error
                  reported.
                properties:
                  message:
                    description: 'message is a string detailing the encountered error
                      during snapshot creation if specified. NOTE: message may be
                      logged, and it should not contain sensitive information.'
                    type: string
                  time:
                    description: time is the timestamp when the error was encountered.
                    format: date-time
                    type: string
                type: object
              readyToUse:
                description: readyToUse indicates if a snapshot is ready to be used
                  to restore a volume. In dynamic snapshot creation case, this field
... skipping 10 lines ...
                  in bytes. In dynamic snapshot creation case, this field will be
                  filled in with the "size_bytes" value returned from CSI "CreateSnapshotRequest"
                  gRPC call. For a pre-existing snapshot, this field will be filled
                  with the "size_bytes" value returned from the CSI "ListSnapshots"
                  gRPC call if the driver supports it. When restoring a volume from
                  this snapshot, the size of the volume MUST NOT be smaller than the
                  restoreSize if it is specified, otherwise the restoration will fail.
                  If not specified, it indicates that the size is unknown.
                pattern: ^(\+|-)?(([0-9]+(\.[0-9]*)?)|(\.[0-9]+))(([KMGTPE]i)|[numkMGTPE]|([eE](\+|-)?(([0-9]+(\.[0-9]*)?)|(\.[0-9]+))))?$
                x-kubernetes-int-or-string: true
            type: object
        required:
        - spec
... skipping 265 lines ...
                  supports it. If not specified, it indicates the creation time is
                  unknown. The format of this field is a Unix nanoseconds time encoded
                  as an int64. On Unix, the command `date +%s%N` returns the current
                  time in nanoseconds since 1970-01-01 00:00:00 UTC.
                format: int64
                type: integer
              error:
                description: error is the latest observed error during snapshot creation,
                  if any.
                properties:
                  message:
                    description: 'message is a string detailing the encountered error
                      during snapshot creation if specified. NOTE: message may be
                      logged, and it should not contain sensitive information.'
                    type: string
                  time:
                    description: time is the timestamp when the error was encountered.
                    format: date-time
                    type: string
                type: object
              readyToUse:
                description: readyToUse indicates if a snapshot is ready to be used
                  to restore a volume. In dynamic snapshot creation case, this field
... skipping 9 lines ...
                  in bytes. In dynamic snapshot creation case, this field will be
                  filled in with the "size_bytes" value returned from CSI "CreateSnapshotRequest"
                  gRPC call. For a pre-existing snapshot, this field will be filled
                  with the "size_bytes" value returned from the CSI "ListSnapshots"
                  gRPC call if the driver supports it. When restoring a volume from
                  this snapshot, the size of the volume MUST NOT be smaller than the
                  restoreSize if it is specified, otherwise the restoration will fail.
                  If not specified, it indicates that the size is unknown.
                format: int64
                minimum: 0
                type: integer
              snapshotHandle:
                description: snapshotHandle is the CSI "snapshot_id" of a snapshot
                  on the underlying storage system. If not specified, it indicates
                  that dynamic snapshot creation has either failed or it is still
                  in progress.
                type: string
            type: object
        required:
        - spec
        type: object
... skipping 819 lines ...
        - name: csi-resizer
          image: "mcr.microsoft.com/oss/kubernetes-csi/csi-resizer:v1.1.0"
          args:
            - "-csi-address=$(ADDRESS)"
            - "-v=2"
            - "-leader-election"
            - '-handle-volume-inuse-error=true'
          env:
            - name: ADDRESS
              value: /csi/csi.sock
          volumeMounts:
            - name: socket-dir
              mountPath: /csi
... skipping 174 lines ...
Go Version: go1.16.6
Platform: linux/amd64
Topology Key: topology.disk.csi.azure.com/zone

Streaming logs below:
STEP: Building a namespace api object, basename azuredisk
E0719 04:28:46.753663   13949 azure_config.go:45] Failed to get cloud-config from secret: failed to get secret /: resource name may not be empty
W0719 04:28:46.759170   13949 azuredisk.go:207] DisableAvailabilitySetNodes for controller is set as false while current VMType is vmss
I0719 04:28:46.764095   13949 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME
I0719 04:28:46.764147   13949 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME
I0719 04:28:46.764154   13949 driver.go:81] Enabling controller service capability: CREATE_DELETE_SNAPSHOT
I0719 04:28:46.764159   13949 driver.go:81] Enabling controller service capability: LIST_SNAPSHOTS
I0719 04:28:46.764165   13949 driver.go:81] Enabling controller service capability: CLONE_VOLUME
... skipping 65 lines ...

    test case is only available for CSI drivers

    /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/suite_test.go:263
------------------------------
Pre-Provisioned [single-az] 
  should fail when maxShares is invalid [disk.csi.azure.com][windows]
  /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/pre_provisioning_test.go:158
STEP: Creating a kubernetes client
Jul 19 04:28:48.187: INFO: >>> kubeConfig: /root/tmp410476636/kubeconfig/kubeconfig.westus2.json
STEP: Building a namespace api object, basename azuredisk
STEP: Waiting for a default service account to be provisioned in namespace
I0719 04:28:48.446701   13949 azuredisk_driver.go:57] Using azure disk driver: kubernetes.io/azure-disk
... skipping 2 lines ...

S [SKIPPING] [0.367 seconds]
Pre-Provisioned
/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/pre_provisioning_test.go:37
  [single-az]
  /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/pre_provisioning_test.go:67
    should fail when maxShares is invalid [disk.csi.azure.com][windows] [It]
    /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/pre_provisioning_test.go:158

    test case is only available for CSI drivers

    /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/suite_test.go:263
------------------------------
... skipping 51 lines ...
STEP: Building a namespace api object, basename azuredisk
STEP: Waiting for a default service account to be provisioned in namespace
I0719 04:28:49.536940   13949 azuredisk_driver.go:57] Using azure disk driver: kubernetes.io/azure-disk
STEP: Successfully provisioned AzureDisk volume: "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-63v4hea7/providers/Microsoft.Compute/disks/pre-provisioned-inline-volume"

STEP: deploying the pod
STEP: checking that the pod's command exits with no error
Jul 19 04:28:53.721: INFO: Waiting up to 15m0s for pod "azuredisk-volume-tester-5dhp8" in namespace "azuredisk-5541" to be "Succeeded or Failed"
Jul 19 04:28:53.774: INFO: Pod "azuredisk-volume-tester-5dhp8": Phase="Pending", Reason="", readiness=false. Elapsed: 52.864325ms
Jul 19 04:28:55.826: INFO: Pod "azuredisk-volume-tester-5dhp8": Phase="Pending", Reason="", readiness=false. Elapsed: 2.10476444s
Jul 19 04:28:57.878: INFO: Pod "azuredisk-volume-tester-5dhp8": Phase="Pending", Reason="", readiness=false. Elapsed: 4.156635345s
Jul 19 04:28:59.931: INFO: Pod "azuredisk-volume-tester-5dhp8": Phase="Pending", Reason="", readiness=false. Elapsed: 6.209680562s
Jul 19 04:29:01.984: INFO: Pod "azuredisk-volume-tester-5dhp8": Phase="Pending", Reason="", readiness=false. Elapsed: 8.263155092s
Jul 19 04:29:04.036: INFO: Pod "azuredisk-volume-tester-5dhp8": Phase="Pending", Reason="", readiness=false. Elapsed: 10.314682495s
... skipping 9 lines ...
Jul 19 04:29:24.565: INFO: Pod "azuredisk-volume-tester-5dhp8": Phase="Pending", Reason="", readiness=false. Elapsed: 30.843621923s
Jul 19 04:29:26.616: INFO: Pod "azuredisk-volume-tester-5dhp8": Phase="Pending", Reason="", readiness=false. Elapsed: 32.895333091s
Jul 19 04:29:28.670: INFO: Pod "azuredisk-volume-tester-5dhp8": Phase="Pending", Reason="", readiness=false. Elapsed: 34.948397264s
Jul 19 04:29:30.721: INFO: Pod "azuredisk-volume-tester-5dhp8": Phase="Pending", Reason="", readiness=false. Elapsed: 37.000250335s
Jul 19 04:29:32.774: INFO: Pod "azuredisk-volume-tester-5dhp8": Phase="Succeeded", Reason="", readiness=false. Elapsed: 39.052539162s
STEP: Saw pod success
Jul 19 04:29:32.775: INFO: Pod "azuredisk-volume-tester-5dhp8" satisfied condition "Succeeded or Failed"
Jul 19 04:29:32.775: INFO: deleting Pod "azuredisk-5541"/"azuredisk-volume-tester-5dhp8"
Jul 19 04:29:32.855: INFO: Pod azuredisk-volume-tester-5dhp8 has the following logs: hello world

STEP: Deleting pod azuredisk-volume-tester-5dhp8 in namespace azuredisk-5541
Jul 19 04:29:32.915: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "azuredisk-5541" for this suite.
... skipping 21 lines ...
STEP: setting up the StorageClass
STEP: creating a StorageClass 
STEP: setting up the PVC and PV
STEP: creating a PVC
STEP: setting up the pod
STEP: deploying the pod
STEP: checking that the pod's command exits with no error
Jul 19 04:29:34.434: INFO: Waiting up to 15m0s for pod "azuredisk-volume-tester-4qwgh" in namespace "azuredisk-5356" to be "Succeeded or Failed"
Jul 19 04:29:34.485: INFO: Pod "azuredisk-volume-tester-4qwgh": Phase="Pending", Reason="", readiness=false. Elapsed: 50.555481ms
Jul 19 04:29:36.536: INFO: Pod "azuredisk-volume-tester-4qwgh": Phase="Pending", Reason="", readiness=false. Elapsed: 2.101503789s
Jul 19 04:29:38.589: INFO: Pod "azuredisk-volume-tester-4qwgh": Phase="Pending", Reason="", readiness=false. Elapsed: 4.154713893s
Jul 19 04:29:40.641: INFO: Pod "azuredisk-volume-tester-4qwgh": Phase="Pending", Reason="", readiness=false. Elapsed: 6.206337515s
Jul 19 04:29:42.694: INFO: Pod "azuredisk-volume-tester-4qwgh": Phase="Pending", Reason="", readiness=false. Elapsed: 8.259691263s
Jul 19 04:29:44.746: INFO: Pod "azuredisk-volume-tester-4qwgh": Phase="Pending", Reason="", readiness=false. Elapsed: 10.311526964s
... skipping 437 lines ...
Jul 19 04:44:35.848: INFO: deleting StorageClass azuredisk-5356-kubernetes.io-azure-disk-dynamic-sc-ckrkx
STEP: Collecting events from namespace "azuredisk-5356".
STEP: Found 6 events.
Jul 19 04:44:35.952: INFO: At 2021-07-19 04:29:34 +0000 UTC - event for pvc-pp76r: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding
Jul 19 04:44:35.952: INFO: At 2021-07-19 04:29:34 +0000 UTC - event for pvc-pp76r: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "disk.csi.azure.com" or manually created by system administrator
Jul 19 04:44:35.952: INFO: At 2021-07-19 04:29:34 +0000 UTC - event for pvc-pp76r: {disk.csi.azure.com_k8s-agentpool1-31572070-1_214d4adb-f4ee-4bdc-b841-59cb1c336fe1 } Provisioning: External provisioner is provisioning volume for claim "azuredisk-5356/pvc-pp76r"
Jul 19 04:44:35.952: INFO: At 2021-07-19 04:29:34 +0000 UTC - event for pvc-pp76r: {disk.csi.azure.com_k8s-agentpool1-31572070-1_214d4adb-f4ee-4bdc-b841-59cb1c336fe1 } ProvisioningFailed: failed to provision volume with StorageClass "azuredisk-5356-kubernetes.io-azure-disk-dynamic-sc-ckrkx": rpc error: code = Unknown desc = invalid parameter csi-migration in storage class
Jul 19 04:44:35.952: INFO: At 2021-07-19 04:39:34 +0000 UTC - event for azuredisk-volume-tester-4qwgh: {default-scheduler } FailedScheduling: running PreBind plugin "VolumeBinding": binding volumes: timed out waiting for the condition
Jul 19 04:44:35.952: INFO: At 2021-07-19 04:44:35 +0000 UTC - event for azuredisk-volume-tester-4qwgh: {default-scheduler } FailedScheduling: skip schedule deleting pod: azuredisk-5356/azuredisk-volume-tester-4qwgh
Jul 19 04:44:36.002: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Jul 19 04:44:36.002: INFO: 
Jul 19 04:44:36.102: INFO: 
Logging node info for node k8s-agentpool1-31572070-0
... skipping 87 lines ...
/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:40
  [single-az]
  /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:43
    should create a volume on demand with mount options [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows] [It]
    /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:101

    Unexpected error:
        <*errors.errorString | 0xc000a5cfc0>: {
            s: "Gave up after waiting 15m0s for pod \"azuredisk-volume-tester-4qwgh\" to be \"Succeeded or Failed\"",
        }
        Gave up after waiting 15m0s for pod "azuredisk-volume-tester-4qwgh" to be "Succeeded or Failed"
    occurred

    /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/testsuites.go:729
------------------------------
Dynamic Provisioning [single-az] 
  should create a pod with volume mount subpath [disk.csi.azure.com] [Windows]
... skipping 75 lines ...
Jul 19 04:49:42.398: INFO: deleting StorageClass azuredisk-1957-kubernetes.io-azure-disk-dynamic-sc-vwznx
STEP: Collecting events from namespace "azuredisk-1957".
STEP: Found 5 events.
Jul 19 04:49:42.506: INFO: At 2021-07-19 04:44:42 +0000 UTC - event for pvc-r72k7: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding
Jul 19 04:49:42.506: INFO: At 2021-07-19 04:44:42 +0000 UTC - event for pvc-r72k7: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "disk.csi.azure.com" or manually created by system administrator
Jul 19 04:49:42.506: INFO: At 2021-07-19 04:44:42 +0000 UTC - event for pvc-r72k7: {disk.csi.azure.com_k8s-agentpool1-31572070-1_214d4adb-f4ee-4bdc-b841-59cb1c336fe1 } Provisioning: External provisioner is provisioning volume for claim "azuredisk-1957/pvc-r72k7"
Jul 19 04:49:42.506: INFO: At 2021-07-19 04:44:42 +0000 UTC - event for pvc-r72k7: {disk.csi.azure.com_k8s-agentpool1-31572070-1_214d4adb-f4ee-4bdc-b841-59cb1c336fe1 } ProvisioningFailed: failed to provision volume with StorageClass "azuredisk-1957-kubernetes.io-azure-disk-dynamic-sc-vwznx": rpc error: code = Unknown desc = invalid parameter csi-migration in storage class
Jul 19 04:49:42.506: INFO: At 2021-07-19 04:49:42 +0000 UTC - event for azuredisk-volume-tester-t564q: {default-scheduler } FailedScheduling: skip schedule deleting pod: azuredisk-1957/azuredisk-volume-tester-t564q
Jul 19 04:49:42.556: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Jul 19 04:49:42.556: INFO: 
Jul 19 04:49:42.699: INFO: 
Logging node info for node k8s-agentpool1-31572070-0
Jul 19 04:49:42.750: INFO: Node Info: &Node{ObjectMeta:{k8s-agentpool1-31572070-0    0e5b2e71-1ed9-486a-b60a-99df122131aa 4281 0 2021-07-19 04:17:09 +0000 UTC <nil> <nil> map[agentpool:agentpool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_DS2_v2 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:1 kubernetes.azure.com/cluster:kubetest-63v4hea7 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:k8s-agentpool1-31572070-0 kubernetes.io/os:linux kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_DS2_v2 storageprofile:managed storagetier:Premium_LRS topology.disk.csi.azure.com/zone: topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:1] map[csi.volume.kubernetes.io/nodeid:{"disk.csi.azure.com":"k8s-agentpool1-31572070-0"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  [{kubectl-label Update v1 2021-07-19 04:17:42 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}} {kube-controller-manager Update v1 2021-07-19 04:29:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kubelet Update v1 2021-07-19 04:29:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.disk.csi.azure.com/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-63v4hea7/providers/Microsoft.Compute/virtualMachines/k8s-agentpool1-31572070-0,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{31036686336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7292153856 0} {<nil>} 7121244Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{27933017657 0} {<nil>} 27933017657 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{6505721856 0} {<nil>} 6353244Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-07-19 04:17:40 +0000 UTC,LastTransitionTime:2021-07-19 04:17:40 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-07-19 04:44:48 +0000 UTC,LastTransitionTime:2021-07-19 04:17:09 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-07-19 04:44:48 +0000 UTC,LastTransitionTime:2021-07-19 04:17:09 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-07-19 04:44:48 +0000 UTC,LastTransitionTime:2021-07-19 04:17:09 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-07-19 04:44:48 +0000 UTC,LastTransitionTime:2021-07-19 04:17:19 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:k8s-agentpool1-31572070-0,},NodeAddress{Type:InternalIP,Address:10.240.0.4,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:51b59e019a86412998e1c173ce955b93,SystemUUID:0658397c-ab99-8146-bd5b-151b3734f71f,BootID:02daf884-da82-4b50-b158-47b533d58d4d,KernelVersion:5.4.0-1049-azure,OSImage:Ubuntu 18.04.5 LTS,ContainerRuntimeVersion:docker://20.10.7+azure,KubeletVersion:v1.20.9,KubeProxyVersion:v1.20.9,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azurefile-csi@sha256:558b9ac2bb6cf988252222039c506da0e4703d28480b21788687b111fde9e59d mcr.microsoft.com/k8s/csi/azurefile-csi:v0.6.0],SizeBytes:346393977,},ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azuredisk-csi@sha256:2536d09114a6be2b9e9a64542990996f24e66586933b02c2a4fa41331c333b55 mcr.microsoft.com/k8s/csi/azuredisk-csi:v0.7.0],SizeBytes:286182075,},ContainerImage{Names:[k8sprow.azurecr.io/azuredisk-csi@sha256:79d824c22f2646a97a23315d87cef8783b06d5c12ad8965e7ac3c72df31ae70a k8sprow.azurecr.io/azuredisk-csi:v1.5.0-715e2992cf5195fa8c444ee96493975db3499a24],SizeBytes:211439924,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/azure-npm@sha256:106f669f48e5e80c4ec0afb49858ead72cf4b901cd8664e7bf81f8d789e56e12 mcr.microsoft.com/containernetworking/azure-npm:v1.2.2_hotfix],SizeBytes:175248091,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver@sha256:c0d040a1c4fbfceb65663e31c09ea40f4f78e356437610cbc3fbb4bb409bd6f1 mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver:v0.0.19],SizeBytes:123243922,},ContainerImage{Names:[mcr.microsoft.com/oss/azure/secrets-store/provider-azure@sha256:6f67f3d0c7cdde5702f8ce7f101b6519daa0237f0c34fecb7c058b6af8c22ad1 mcr.microsoft.com/oss/azure/secrets-store/provider-azure:0.0.12],SizeBytes:101075580,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:e1343903466b1de10eeae9876beb5430329e3d07aa195ba1ddba663af012a193 mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.20.0],SizeBytes:99677469,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:82d95608b2fa5073d3e957c7189eff6cafd2c3028b493900291ceab314a6f56a mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.9],SizeBytes:99656407,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager@sha256:0085ffc5930e0d47b388ee3446a9c72ac434117944552a5c47dbdf64d34c00a0 mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager:v0.5.1],SizeBytes:88868427,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:0f0c53b4d1231c7ff062ec4453fa6bb5fe1a9df81379207ad87c734eff635604 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.5.1],SizeBytes:88168005,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-addon-manager@sha256:32e2836018c96e73533bd4642fe438e465b81dcbfa8b7b61935a6f4d0246c7ae mcr.microsoft.com/oss/kubernetes/kube-addon-manager:v9.1.3],SizeBytes:86833441,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-addon-manager@sha256:92c2c5aad9012ee32d2a43a74966cc0adc6ccb1705ad15abb10485ecf406d88b mcr.microsoft.com/oss/kubernetes/kube-addon-manager:v9.1.5],SizeBytes:84095409,},ContainerImage{Names:[mcr.microsoft.com/oss/nvidia/k8s-device-plugin@sha256:0f5b52bf28239234e831697d96db63ac03cde70fe68058f964504ab7564ee810 mcr.microsoft.com/oss/nvidia/k8s-device-plugin:1.0.0-beta6],SizeBytes:64178257,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/metrics-server@sha256:682d3a1a48abbe03df05e1084923ab668a6651fd80327f9694b0cf302cc49f90 mcr.microsoft.com/oss/kubernetes/metrics-server:v0.5.0],SizeBytes:63517663,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner@sha256:21fae82e312b135c9b09f75041922a4e189ce6d86d23c83a7e1be48dbe172a74 mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner:v1.5.0],SizeBytes:56671460,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner@sha256:3e1695221da4da4744e7eea688ff6acaf4a8724650a10fda66c4cdea931a134b mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner:v1.4.0],SizeBytes:54470728,},ContainerImage{Names:[andyzhangx/csi-provisioner@sha256:8d88d7044617582c089178821677f307a77a444f48e5a45c57f4e014100bf4c9 andyzhangx/csi-provisioner:v2.1.1],SizeBytes:51152358,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/ip-masq-agent@sha256:bddf19be25644c7176e8c501465dbad07d032288334f135877b984660b0d3ee6 mcr.microsoft.com/oss/kubernetes/ip-masq-agent:v2.5.0],SizeBytes:50148508,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-attacher@sha256:d685e7294432c4308131d44781bb1e1f00ddd02d7a10f0d61caed5963ba7ae39 mcr.microsoft.com/oss/kubernetes-csi/csi-attacher:v3.1.0],SizeBytes:49334622,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-resizer@sha256:7997e0f236bc291101433ccd43704cac27ad87d6bdbcf480487d0799514aedc1 mcr.microsoft.com/oss/kubernetes-csi/csi-resizer:v1.1.0],SizeBytes:49299352,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter@sha256:19f29f0f54cf915e751c1c0e685a457fce73666bd0c98898671ae1313b755d1c mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter:v3.0.3],SizeBytes:47957733,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter@sha256:7d4825b057634e815ba0fb21b528b58781ab83b1199c1fb6211c2ef56c66e41a mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter:v1.1.0],SizeBytes:47628159,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter@sha256:f714d2a97234ad53cab35c201a2f2f503e9707e107c6e741777a9ead190760e3 mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter:v2.0.0],SizeBytes:46308973,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-attacher@sha256:5321c1199ed7cc0920ce09cea2158f93644b72bebb0517958e30afaf2392e572 mcr.microsoft.com/oss/kubernetes-csi/csi-attacher:v1.2.0],SizeBytes:46229106,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-resizer@sha256:89ad3037cdce5b7501add15265f37faf1e21adec27b7727087fe3e1826da640a mcr.microsoft.com/oss/kubernetes-csi/csi-resizer:v0.3.0],SizeBytes:46020585,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/coredns@sha256:1c23b17c78ffbc90c068ee088b77456284b9649952fa127b0f86a0ccff575539 mcr.microsoft.com/oss/kubernetes/coredns:1.7.0],SizeBytes:45245990,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/snapshot-controller@sha256:7188322cbe5bf7fddb6adcdc946ad45ad3c2fbfc365a55005d0160d9c5accfe5 mcr.microsoft.com/oss/kubernetes-csi/snapshot-controller:v3.0.3],SizeBytes:43154924,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/snapshot-controller@sha256:da80086fff8b98c58e6ff0403a5835cf7ea7dc0b8fdb504cc55601c4b6881066 mcr.microsoft.com/oss/kubernetes-csi/snapshot-controller:v2.0.0],SizeBytes:41429109,},ContainerImage{Names:[mcr.microsoft.com/k8s/aad-pod-identity/mic@sha256:bd9465be94966b9a917e1e3904fa5e63dd91772ccadf304e18ffd8e4ad8ccedd mcr.microsoft.com/k8s/aad-pod-identity/mic:1.6.1],SizeBytes:41395977,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-proportional-autoscaler@sha256:753e3ca79dc833feed24ee4107ff4f06a96abbd6cefba8d41d7dec6f4d3e75f0 mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-proportional-autoscaler:1.7.1],SizeBytes:40067731,},ContainerImage{Names:[mcr.microsoft.com/k8s/aad-pod-identity/nmi@sha256:02128fefcdb7593ac53fc342e2c53a0fc6fabd813036bf60457bf43cc2940116 mcr.microsoft.com/k8s/aad-pod-identity/nmi:1.6.1],SizeBytes:38029065,},ContainerImage{Names:[mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume@sha256:921f301c44dda06a325164accf22e78ecc570b5c7d9d6ee4c66bd8cbb2b60b9a mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume:v0.0.16],SizeBytes:26975508,},ContainerImage{Names:[mcr.microsoft.com/k8s/kms/keyvault@sha256:1a27e175f8c125209e32d2957b5509fe20757bd8cb309ff9da598799b56326fb mcr.microsoft.com/k8s/kms/keyvault:v0.0.10],SizeBytes:23081748,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:60b7645ece041ce343e5f74017e39b72c6703661bd147d225772a81c4d18f4e3 mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v2.1.0],SizeBytes:19679271,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:8863840b419194a408ab8fa21961f4a317fb4e7ad8a8b783fe65677c0c7e4f0a mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v2.2.0],SizeBytes:18710308,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:b7d82802cca8523df1d5973332c64d558fe352617926fd01707b17e2f022755f mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.2.0],SizeBytes:17768771,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:aae4d193ef1480387294e07d164d48c70be090f7f95f03a6f70ef1bac225e9cc mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.3.0],SizeBytes:17113770,},ContainerImage{Names:[busybox@sha256:930490f97e5b921535c153e0e7110d251134cc4b72bbb8133c6a5065cc68580d busybox:latest],SizeBytes:1235821,},ContainerImage{Names:[mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume@sha256:23d8c6033f02a1ecad05127ebdc931bb871264228661bc122704b0974e4d9fdd mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume:1.0.8],SizeBytes:1159025,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:1154361,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:e3b8c20681593c21b344ad801fbb8abaf564427ee3a57a9fcfa3b455f917ce46 mcr.microsoft.com/oss/kubernetes/pause:3.4.1],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
... skipping 86 lines ...
/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:40
  [single-az]
  /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:43
    should receive FailedMount event with invalid mount options [kubernetes.io/azure-disk] [disk.csi.azure.com] [It]
    /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:218

    Unexpected error:
        <*errors.errorString | 0xc00037a350>: {
            s: "timed out waiting for the condition",
        }
        timed out waiting for the condition
    occurred

... skipping 14 lines ...
STEP: setting up the StorageClass
STEP: creating a StorageClass 
STEP: setting up the PVC and PV
STEP: creating a PVC
STEP: setting up the pod
STEP: deploying the pod
STEP: checking that the pod's command exits with no error
Jul 19 04:49:45.684: INFO: Waiting up to 15m0s for pod "azuredisk-volume-tester-bmvpf" in namespace "azuredisk-8705" to be "Succeeded or Failed"
Jul 19 04:49:45.735: INFO: Pod "azuredisk-volume-tester-bmvpf": Phase="Pending", Reason="", readiness=false. Elapsed: 50.637241ms
Jul 19 04:49:47.786: INFO: Pod "azuredisk-volume-tester-bmvpf": Phase="Pending", Reason="", readiness=false. Elapsed: 2.102065276s
Jul 19 04:49:49.839: INFO: Pod "azuredisk-volume-tester-bmvpf": Phase="Pending", Reason="", readiness=false. Elapsed: 4.154636359s
Jul 19 04:49:51.891: INFO: Pod "azuredisk-volume-tester-bmvpf": Phase="Pending", Reason="", readiness=false. Elapsed: 6.207061573s
Jul 19 04:49:53.944: INFO: Pod "azuredisk-volume-tester-bmvpf": Phase="Pending", Reason="", readiness=false. Elapsed: 8.259495114s
Jul 19 04:49:55.995: INFO: Pod "azuredisk-volume-tester-bmvpf": Phase="Pending", Reason="", readiness=false. Elapsed: 10.311407868s
... skipping 437 lines ...
Jul 19 05:04:47.539: INFO: deleting StorageClass azuredisk-8705-kubernetes.io-azure-disk-dynamic-sc-lls8q
STEP: Collecting events from namespace "azuredisk-8705".
STEP: Found 6 events.
Jul 19 05:04:47.642: INFO: At 2021-07-19 04:49:45 +0000 UTC - event for pvc-4gdd9: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding
Jul 19 05:04:47.642: INFO: At 2021-07-19 04:49:45 +0000 UTC - event for pvc-4gdd9: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "disk.csi.azure.com" or manually created by system administrator
Jul 19 05:04:47.642: INFO: At 2021-07-19 04:49:45 +0000 UTC - event for pvc-4gdd9: {disk.csi.azure.com_k8s-agentpool1-31572070-1_214d4adb-f4ee-4bdc-b841-59cb1c336fe1 } Provisioning: External provisioner is provisioning volume for claim "azuredisk-8705/pvc-4gdd9"
Jul 19 05:04:47.642: INFO: At 2021-07-19 04:49:45 +0000 UTC - event for pvc-4gdd9: {disk.csi.azure.com_k8s-agentpool1-31572070-1_214d4adb-f4ee-4bdc-b841-59cb1c336fe1 } ProvisioningFailed: failed to provision volume with StorageClass "azuredisk-8705-kubernetes.io-azure-disk-dynamic-sc-lls8q": rpc error: code = Unknown desc = invalid parameter csi-migration in storage class
Jul 19 05:04:47.642: INFO: At 2021-07-19 04:59:45 +0000 UTC - event for azuredisk-volume-tester-bmvpf: {default-scheduler } FailedScheduling: running PreBind plugin "VolumeBinding": binding volumes: timed out waiting for the condition
Jul 19 05:04:47.642: INFO: At 2021-07-19 05:04:47 +0000 UTC - event for azuredisk-volume-tester-bmvpf: {default-scheduler } FailedScheduling: skip schedule deleting pod: azuredisk-8705/azuredisk-volume-tester-bmvpf
Jul 19 05:04:47.692: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Jul 19 05:04:47.692: INFO: 
Jul 19 05:04:47.792: INFO: 
Logging node info for node k8s-agentpool1-31572070-0
... skipping 87 lines ...
/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:40
  [single-az]
  /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:43
    should create a raw block volume on demand [kubernetes.io/azure-disk] [disk.csi.azure.com] [It]
    /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:254

    Unexpected error:
        <*errors.errorString | 0xc000b90760>: {
            s: "Gave up after waiting 15m0s for pod \"azuredisk-volume-tester-bmvpf\" to be \"Succeeded or Failed\"",
        }
        Gave up after waiting 15m0s for pod "azuredisk-volume-tester-bmvpf" to be "Succeeded or Failed"
    occurred

    /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/testsuites.go:729
------------------------------
Dynamic Provisioning [single-az] 
  should create a volume on demand and mount it as readOnly in a pod [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows]
... skipping 10 lines ...
STEP: setting up the StorageClass
STEP: creating a StorageClass 
STEP: setting up the PVC and PV
STEP: creating a PVC
STEP: setting up the pod
STEP: deploying the pod
STEP: checking that the pod's command exits with an error
Jul 19 05:04:50.881: INFO: Waiting up to 10m0s for pod "azuredisk-volume-tester-zs54q" in namespace "azuredisk-2451" to be "Error status code"
Jul 19 05:04:50.932: INFO: Pod "azuredisk-volume-tester-zs54q": Phase="Pending", Reason="", readiness=false. Elapsed: 50.415383ms
Jul 19 05:04:52.985: INFO: Pod "azuredisk-volume-tester-zs54q": Phase="Pending", Reason="", readiness=false. Elapsed: 2.103882283s
Jul 19 05:04:55.038: INFO: Pod "azuredisk-volume-tester-zs54q": Phase="Pending", Reason="", readiness=false. Elapsed: 4.157074076s
Jul 19 05:04:57.091: INFO: Pod "azuredisk-volume-tester-zs54q": Phase="Pending", Reason="", readiness=false. Elapsed: 6.209827847s
Jul 19 05:04:59.143: INFO: Pod "azuredisk-volume-tester-zs54q": Phase="Pending", Reason="", readiness=false. Elapsed: 8.261178846s
Jul 19 05:05:01.196: INFO: Pod "azuredisk-volume-tester-zs54q": Phase="Pending", Reason="", readiness=false. Elapsed: 10.314396859s
... skipping 288 lines ...
Jul 19 05:14:52.755: INFO: Pod azuredisk-volume-tester-zs54q has the following logs: 
STEP: Deleting pod azuredisk-volume-tester-zs54q in namespace azuredisk-2451
STEP: validating provisioned PV
Jul 19 05:14:52.874: INFO: deleting StorageClass azuredisk-2451-kubernetes.io-azure-disk-dynamic-sc-w5zpq
STEP: Collecting events from namespace "azuredisk-2451".
STEP: Found 7 events.
Jul 19 05:14:52.990: INFO: At 2021-07-19 05:04:50 +0000 UTC - event for pvc-bzp2g: {disk.csi.azure.com_k8s-agentpool1-31572070-1_214d4adb-f4ee-4bdc-b841-59cb1c336fe1 } ProvisioningFailed: failed to provision volume with StorageClass "azuredisk-2451-kubernetes.io-azure-disk-dynamic-sc-w5zpq": rpc error: code = Unknown desc = invalid parameter csi-migration in storage class
Jul 19 05:14:52.990: INFO: At 2021-07-19 05:04:50 +0000 UTC - event for pvc-bzp2g: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding
Jul 19 05:14:52.990: INFO: At 2021-07-19 05:04:50 +0000 UTC - event for pvc-bzp2g: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "disk.csi.azure.com" or manually created by system administrator
Jul 19 05:14:52.990: INFO: At 2021-07-19 05:04:50 +0000 UTC - event for pvc-bzp2g: {disk.csi.azure.com_k8s-agentpool1-31572070-1_214d4adb-f4ee-4bdc-b841-59cb1c336fe1 } Provisioning: External provisioner is provisioning volume for claim "azuredisk-2451/pvc-bzp2g"
Jul 19 05:14:52.990: INFO: At 2021-07-19 05:14:50 +0000 UTC - event for azuredisk-volume-tester-zs54q: {default-scheduler } FailedScheduling: running PreBind plugin "VolumeBinding": binding volumes: timed out waiting for the condition
Jul 19 05:14:52.990: INFO: At 2021-07-19 05:14:52 +0000 UTC - event for azuredisk-volume-tester-zs54q: {default-scheduler } FailedScheduling: skip schedule deleting pod: azuredisk-2451/azuredisk-volume-tester-zs54q
Jul 19 05:14:52.990: INFO: At 2021-07-19 05:14:52 +0000 UTC - event for azuredisk-volume-tester-zs54q: {default-scheduler } FailedScheduling: running PreBind plugin "VolumeBinding": binding volumes: pod does not exist any more: pod "azuredisk-volume-tester-zs54q" not found
... skipping 91 lines ...
/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:40
  [single-az]
  /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:43
    should create a volume on demand and mount it as readOnly in a pod [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows] [It]
    /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:285

    Unexpected error:
        <*errors.errorString | 0xc000cd99a0>: {
            s: "Gave up after waiting 10m0s for pod \"azuredisk-volume-tester-zs54q\" to be \"Error status code\"",
        }
        Gave up after waiting 10m0s for pod "azuredisk-volume-tester-zs54q" to be "Error status code"
    occurred

    /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/testsuites.go:768
------------------------------
Dynamic Provisioning [single-az] 
  should create multiple PV objects, bind to PVCs and attach all to different pods on the same node [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows]
... skipping 21 lines ...
Jul 19 05:19:56.710: INFO: deleting StorageClass azuredisk-9828-kubernetes.io-azure-disk-dynamic-sc-s2xl8
STEP: Collecting events from namespace "azuredisk-9828".
STEP: Found 5 events.
Jul 19 05:19:56.821: INFO: At 2021-07-19 05:14:56 +0000 UTC - event for pvc-w47q8: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding
Jul 19 05:19:56.821: INFO: At 2021-07-19 05:14:56 +0000 UTC - event for pvc-w47q8: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "disk.csi.azure.com" or manually created by system administrator
Jul 19 05:19:56.821: INFO: At 2021-07-19 05:14:56 +0000 UTC - event for pvc-w47q8: {disk.csi.azure.com_k8s-agentpool1-31572070-1_214d4adb-f4ee-4bdc-b841-59cb1c336fe1 } Provisioning: External provisioner is provisioning volume for claim "azuredisk-9828/pvc-w47q8"
Jul 19 05:19:56.821: INFO: At 2021-07-19 05:14:56 +0000 UTC - event for pvc-w47q8: {disk.csi.azure.com_k8s-agentpool1-31572070-1_214d4adb-f4ee-4bdc-b841-59cb1c336fe1 } ProvisioningFailed: failed to provision volume with StorageClass "azuredisk-9828-kubernetes.io-azure-disk-dynamic-sc-s2xl8": rpc error: code = Unknown desc = invalid parameter csi-migration in storage class
Jul 19 05:19:56.821: INFO: At 2021-07-19 05:19:56 +0000 UTC - event for azuredisk-volume-tester-rhzzw: {default-scheduler } FailedScheduling: skip schedule deleting pod: azuredisk-9828/azuredisk-volume-tester-rhzzw
Jul 19 05:19:56.874: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Jul 19 05:19:56.874: INFO: 
Jul 19 05:19:57.021: INFO: 
Logging node info for node k8s-agentpool1-31572070-0
Jul 19 05:19:57.075: INFO: Node Info: &Node{ObjectMeta:{k8s-agentpool1-31572070-0    0e5b2e71-1ed9-486a-b60a-99df122131aa 8490 0 2021-07-19 04:17:09 +0000 UTC <nil> <nil> map[agentpool:agentpool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_DS2_v2 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:1 kubernetes.azure.com/cluster:kubetest-63v4hea7 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:k8s-agentpool1-31572070-0 kubernetes.io/os:linux kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_DS2_v2 storageprofile:managed storagetier:Premium_LRS topology.disk.csi.azure.com/zone: topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:1] map[csi.volume.kubernetes.io/nodeid:{"disk.csi.azure.com":"k8s-agentpool1-31572070-0"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  [{kubectl-label Update v1 2021-07-19 04:17:42 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}} {kube-controller-manager Update v1 2021-07-19 04:29:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kubelet Update v1 2021-07-19 04:29:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.disk.csi.azure.com/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-63v4hea7/providers/Microsoft.Compute/virtualMachines/k8s-agentpool1-31572070-0,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{31036686336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7292153856 0} {<nil>} 7121244Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{27933017657 0} {<nil>} 27933017657 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{6505721856 0} {<nil>} 6353244Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-07-19 04:17:40 +0000 UTC,LastTransitionTime:2021-07-19 04:17:40 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-07-19 05:15:00 +0000 UTC,LastTransitionTime:2021-07-19 04:17:09 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-07-19 05:15:00 +0000 UTC,LastTransitionTime:2021-07-19 04:17:09 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-07-19 05:15:00 +0000 UTC,LastTransitionTime:2021-07-19 04:17:09 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-07-19 05:15:00 +0000 UTC,LastTransitionTime:2021-07-19 04:17:19 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:k8s-agentpool1-31572070-0,},NodeAddress{Type:InternalIP,Address:10.240.0.4,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:51b59e019a86412998e1c173ce955b93,SystemUUID:0658397c-ab99-8146-bd5b-151b3734f71f,BootID:02daf884-da82-4b50-b158-47b533d58d4d,KernelVersion:5.4.0-1049-azure,OSImage:Ubuntu 18.04.5 LTS,ContainerRuntimeVersion:docker://20.10.7+azure,KubeletVersion:v1.20.9,KubeProxyVersion:v1.20.9,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azurefile-csi@sha256:558b9ac2bb6cf988252222039c506da0e4703d28480b21788687b111fde9e59d mcr.microsoft.com/k8s/csi/azurefile-csi:v0.6.0],SizeBytes:346393977,},ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azuredisk-csi@sha256:2536d09114a6be2b9e9a64542990996f24e66586933b02c2a4fa41331c333b55 mcr.microsoft.com/k8s/csi/azuredisk-csi:v0.7.0],SizeBytes:286182075,},ContainerImage{Names:[k8sprow.azurecr.io/azuredisk-csi@sha256:79d824c22f2646a97a23315d87cef8783b06d5c12ad8965e7ac3c72df31ae70a k8sprow.azurecr.io/azuredisk-csi:v1.5.0-715e2992cf5195fa8c444ee96493975db3499a24],SizeBytes:211439924,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/azure-npm@sha256:106f669f48e5e80c4ec0afb49858ead72cf4b901cd8664e7bf81f8d789e56e12 mcr.microsoft.com/containernetworking/azure-npm:v1.2.2_hotfix],SizeBytes:175248091,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver@sha256:c0d040a1c4fbfceb65663e31c09ea40f4f78e356437610cbc3fbb4bb409bd6f1 mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver:v0.0.19],SizeBytes:123243922,},ContainerImage{Names:[mcr.microsoft.com/oss/azure/secrets-store/provider-azure@sha256:6f67f3d0c7cdde5702f8ce7f101b6519daa0237f0c34fecb7c058b6af8c22ad1 mcr.microsoft.com/oss/azure/secrets-store/provider-azure:0.0.12],SizeBytes:101075580,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:e1343903466b1de10eeae9876beb5430329e3d07aa195ba1ddba663af012a193 mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.20.0],SizeBytes:99677469,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:82d95608b2fa5073d3e957c7189eff6cafd2c3028b493900291ceab314a6f56a mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.9],SizeBytes:99656407,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager@sha256:0085ffc5930e0d47b388ee3446a9c72ac434117944552a5c47dbdf64d34c00a0 mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager:v0.5.1],SizeBytes:88868427,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:0f0c53b4d1231c7ff062ec4453fa6bb5fe1a9df81379207ad87c734eff635604 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.5.1],SizeBytes:88168005,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-addon-manager@sha256:32e2836018c96e73533bd4642fe438e465b81dcbfa8b7b61935a6f4d0246c7ae mcr.microsoft.com/oss/kubernetes/kube-addon-manager:v9.1.3],SizeBytes:86833441,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-addon-manager@sha256:92c2c5aad9012ee32d2a43a74966cc0adc6ccb1705ad15abb10485ecf406d88b mcr.microsoft.com/oss/kubernetes/kube-addon-manager:v9.1.5],SizeBytes:84095409,},ContainerImage{Names:[mcr.microsoft.com/oss/nvidia/k8s-device-plugin@sha256:0f5b52bf28239234e831697d96db63ac03cde70fe68058f964504ab7564ee810 mcr.microsoft.com/oss/nvidia/k8s-device-plugin:1.0.0-beta6],SizeBytes:64178257,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/metrics-server@sha256:682d3a1a48abbe03df05e1084923ab668a6651fd80327f9694b0cf302cc49f90 mcr.microsoft.com/oss/kubernetes/metrics-server:v0.5.0],SizeBytes:63517663,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner@sha256:21fae82e312b135c9b09f75041922a4e189ce6d86d23c83a7e1be48dbe172a74 mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner:v1.5.0],SizeBytes:56671460,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner@sha256:3e1695221da4da4744e7eea688ff6acaf4a8724650a10fda66c4cdea931a134b mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner:v1.4.0],SizeBytes:54470728,},ContainerImage{Names:[andyzhangx/csi-provisioner@sha256:8d88d7044617582c089178821677f307a77a444f48e5a45c57f4e014100bf4c9 andyzhangx/csi-provisioner:v2.1.1],SizeBytes:51152358,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/ip-masq-agent@sha256:bddf19be25644c7176e8c501465dbad07d032288334f135877b984660b0d3ee6 mcr.microsoft.com/oss/kubernetes/ip-masq-agent:v2.5.0],SizeBytes:50148508,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-attacher@sha256:d685e7294432c4308131d44781bb1e1f00ddd02d7a10f0d61caed5963ba7ae39 mcr.microsoft.com/oss/kubernetes-csi/csi-attacher:v3.1.0],SizeBytes:49334622,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-resizer@sha256:7997e0f236bc291101433ccd43704cac27ad87d6bdbcf480487d0799514aedc1 mcr.microsoft.com/oss/kubernetes-csi/csi-resizer:v1.1.0],SizeBytes:49299352,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter@sha256:19f29f0f54cf915e751c1c0e685a457fce73666bd0c98898671ae1313b755d1c mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter:v3.0.3],SizeBytes:47957733,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter@sha256:7d4825b057634e815ba0fb21b528b58781ab83b1199c1fb6211c2ef56c66e41a mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter:v1.1.0],SizeBytes:47628159,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter@sha256:f714d2a97234ad53cab35c201a2f2f503e9707e107c6e741777a9ead190760e3 mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter:v2.0.0],SizeBytes:46308973,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-attacher@sha256:5321c1199ed7cc0920ce09cea2158f93644b72bebb0517958e30afaf2392e572 mcr.microsoft.com/oss/kubernetes-csi/csi-attacher:v1.2.0],SizeBytes:46229106,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-resizer@sha256:89ad3037cdce5b7501add15265f37faf1e21adec27b7727087fe3e1826da640a mcr.microsoft.com/oss/kubernetes-csi/csi-resizer:v0.3.0],SizeBytes:46020585,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/coredns@sha256:1c23b17c78ffbc90c068ee088b77456284b9649952fa127b0f86a0ccff575539 mcr.microsoft.com/oss/kubernetes/coredns:1.7.0],SizeBytes:45245990,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/snapshot-controller@sha256:7188322cbe5bf7fddb6adcdc946ad45ad3c2fbfc365a55005d0160d9c5accfe5 mcr.microsoft.com/oss/kubernetes-csi/snapshot-controller:v3.0.3],SizeBytes:43154924,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/snapshot-controller@sha256:da80086fff8b98c58e6ff0403a5835cf7ea7dc0b8fdb504cc55601c4b6881066 mcr.microsoft.com/oss/kubernetes-csi/snapshot-controller:v2.0.0],SizeBytes:41429109,},ContainerImage{Names:[mcr.microsoft.com/k8s/aad-pod-identity/mic@sha256:bd9465be94966b9a917e1e3904fa5e63dd91772ccadf304e18ffd8e4ad8ccedd mcr.microsoft.com/k8s/aad-pod-identity/mic:1.6.1],SizeBytes:41395977,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-proportional-autoscaler@sha256:753e3ca79dc833feed24ee4107ff4f06a96abbd6cefba8d41d7dec6f4d3e75f0 mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-proportional-autoscaler:1.7.1],SizeBytes:40067731,},ContainerImage{Names:[mcr.microsoft.com/k8s/aad-pod-identity/nmi@sha256:02128fefcdb7593ac53fc342e2c53a0fc6fabd813036bf60457bf43cc2940116 mcr.microsoft.com/k8s/aad-pod-identity/nmi:1.6.1],SizeBytes:38029065,},ContainerImage{Names:[mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume@sha256:921f301c44dda06a325164accf22e78ecc570b5c7d9d6ee4c66bd8cbb2b60b9a mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume:v0.0.16],SizeBytes:26975508,},ContainerImage{Names:[mcr.microsoft.com/k8s/kms/keyvault@sha256:1a27e175f8c125209e32d2957b5509fe20757bd8cb309ff9da598799b56326fb mcr.microsoft.com/k8s/kms/keyvault:v0.0.10],SizeBytes:23081748,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:60b7645ece041ce343e5f74017e39b72c6703661bd147d225772a81c4d18f4e3 mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v2.1.0],SizeBytes:19679271,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:8863840b419194a408ab8fa21961f4a317fb4e7ad8a8b783fe65677c0c7e4f0a mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v2.2.0],SizeBytes:18710308,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:b7d82802cca8523df1d5973332c64d558fe352617926fd01707b17e2f022755f mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.2.0],SizeBytes:17768771,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:aae4d193ef1480387294e07d164d48c70be090f7f95f03a6f70ef1bac225e9cc mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.3.0],SizeBytes:17113770,},ContainerImage{Names:[busybox@sha256:930490f97e5b921535c153e0e7110d251134cc4b72bbb8133c6a5065cc68580d busybox:latest],SizeBytes:1235821,},ContainerImage{Names:[mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume@sha256:23d8c6033f02a1ecad05127ebdc931bb871264228661bc122704b0974e4d9fdd mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume:1.0.8],SizeBytes:1159025,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:1154361,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:e3b8c20681593c21b344ad801fbb8abaf564427ee3a57a9fcfa3b455f917ce46 mcr.microsoft.com/oss/kubernetes/pause:3.4.1],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
... skipping 86 lines ...
/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:40
  [single-az]
  /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:43
    should create multiple PV objects, bind to PVCs and attach all to different pods on the same node [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows] [It]
    /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:317

    Unexpected error:
        <*errors.errorString | 0xc00037a350>: {
            s: "timed out waiting for the condition",
        }
        timed out waiting for the condition
    occurred

... skipping 167 lines ...
Jul 19 05:24:53.996: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63762268799, loc:(*time.Location)(0x3333cc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63762268799, loc:(*time.Location)(0x3333cc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63762268799, loc:(*time.Location)(0x3333cc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63762268799, loc:(*time.Location)(0x3333cc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-9b9nl-65d9758f64\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jul 19 05:24:55.997: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63762268799, loc:(*time.Location)(0x3333cc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63762268799, loc:(*time.Location)(0x3333cc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63762268799, loc:(*time.Location)(0x3333cc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63762268799, loc:(*time.Location)(0x3333cc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-9b9nl-65d9758f64\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jul 19 05:24:57.997: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63762268799, loc:(*time.Location)(0x3333cc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63762268799, loc:(*time.Location)(0x3333cc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63762268799, loc:(*time.Location)(0x3333cc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63762268799, loc:(*time.Location)(0x3333cc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-9b9nl-65d9758f64\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jul 19 05:24:59.997: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63762268799, loc:(*time.Location)(0x3333cc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63762268799, loc:(*time.Location)(0x3333cc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63762268799, loc:(*time.Location)(0x3333cc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63762268799, loc:(*time.Location)(0x3333cc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-9b9nl-65d9758f64\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jul 19 05:25:00.050: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63762268799, loc:(*time.Location)(0x3333cc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63762268799, loc:(*time.Location)(0x3333cc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63762268799, loc:(*time.Location)(0x3333cc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63762268799, loc:(*time.Location)(0x3333cc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-9b9nl-65d9758f64\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jul 19 05:25:00.051: INFO: deleting Deployment "azuredisk-1563"/"azuredisk-volume-tester-9b9nl"
Jul 19 05:25:00.051: INFO: Error getting logs for pod : resource name may not be empty
STEP: validating provisioned PV
Jul 19 05:25:00.160: INFO: deleting StorageClass azuredisk-1563-kubernetes.io-azure-disk-dynamic-sc-pd9df
STEP: Collecting events from namespace "azuredisk-1563".
STEP: Found 6 events.
Jul 19 05:25:00.272: INFO: At 2021-07-19 05:19:59 +0000 UTC - event for azuredisk-volume-tester-9b9nl: {deployment-controller } ScalingReplicaSet: Scaled up replica set azuredisk-volume-tester-9b9nl-65d9758f64 to 1
Jul 19 05:25:00.272: INFO: At 2021-07-19 05:19:59 +0000 UTC - event for azuredisk-volume-tester-9b9nl-65d9758f64: {replicaset-controller } SuccessfulCreate: Created pod: azuredisk-volume-tester-9b9nl-65d9758f64-96qrj
Jul 19 05:25:00.272: INFO: At 2021-07-19 05:19:59 +0000 UTC - event for pvc-z6fbt: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding
Jul 19 05:25:00.272: INFO: At 2021-07-19 05:19:59 +0000 UTC - event for pvc-z6fbt: {disk.csi.azure.com_k8s-agentpool1-31572070-1_214d4adb-f4ee-4bdc-b841-59cb1c336fe1 } Provisioning: External provisioner is provisioning volume for claim "azuredisk-1563/pvc-z6fbt"
Jul 19 05:25:00.272: INFO: At 2021-07-19 05:19:59 +0000 UTC - event for pvc-z6fbt: {disk.csi.azure.com_k8s-agentpool1-31572070-1_214d4adb-f4ee-4bdc-b841-59cb1c336fe1 } ProvisioningFailed: failed to provision volume with StorageClass "azuredisk-1563-kubernetes.io-azure-disk-dynamic-sc-pd9df": rpc error: code = Unknown desc = invalid parameter csi-migration in storage class
Jul 19 05:25:00.272: INFO: At 2021-07-19 05:19:59 +0000 UTC - event for pvc-z6fbt: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "disk.csi.azure.com" or manually created by system administrator
Jul 19 05:25:00.327: INFO: POD                                             NODE  PHASE    GRACE  CONDITIONS
Jul 19 05:25:00.327: INFO: azuredisk-volume-tester-9b9nl-65d9758f64-96qrj        Pending         []
Jul 19 05:25:00.327: INFO: 
Jul 19 05:25:00.432: INFO: 
Logging node info for node k8s-agentpool1-31572070-0
... skipping 87 lines ...
/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:40
  [single-az]
  /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:43
    should create a deployment object, write and read to it, delete the pod and write and read to it again [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows] [It]
    /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:375

    Unexpected error:
        <*errors.errorString | 0xc001058280>: {
            s: "error waiting for deployment \"azuredisk-volume-tester-9b9nl\" status to match expectation: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:\"Available\", Status:\"False\", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63762268799, loc:(*time.Location)(0x3333cc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63762268799, loc:(*time.Location)(0x3333cc0)}}, Reason:\"MinimumReplicasUnavailable\", Message:\"Deployment does not have minimum availability.\"}, v1.DeploymentCondition{Type:\"Progressing\", Status:\"True\", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63762268799, loc:(*time.Location)(0x3333cc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63762268799, loc:(*time.Location)(0x3333cc0)}}, Reason:\"ReplicaSetUpdated\", Message:\"ReplicaSet \\\"azuredisk-volume-tester-9b9nl-65d9758f64\\\" is progressing.\"}}, CollisionCount:(*int32)(nil)}",
        }
        error waiting for deployment "azuredisk-volume-tester-9b9nl" status to match expectation: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63762268799, loc:(*time.Location)(0x3333cc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63762268799, loc:(*time.Location)(0x3333cc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63762268799, loc:(*time.Location)(0x3333cc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63762268799, loc:(*time.Location)(0x3333cc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-9b9nl-65d9758f64\" is progressing."}}, CollisionCount:(*int32)(nil)}
    occurred

    /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/testsuites.go:474
------------------------------
Dynamic Provisioning [single-az] 
  should delete PV with reclaimPolicy "Delete" [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows]
... skipping 160 lines ...
Jul 19 05:29:59.497: INFO: PersistentVolumeClaim pvc-2lxp2 found but phase is Pending instead of Bound.
Jul 19 05:30:01.552: INFO: PersistentVolumeClaim pvc-2lxp2 found but phase is Pending instead of Bound.
STEP: Collecting events from namespace "azuredisk-1577".
STEP: Found 3 events.
Jul 19 05:30:03.609: INFO: At 2021-07-19 05:25:03 +0000 UTC - event for pvc-2lxp2: {disk.csi.azure.com_k8s-agentpool1-31572070-1_214d4adb-f4ee-4bdc-b841-59cb1c336fe1 } Provisioning: External provisioner is provisioning volume for claim "azuredisk-1577/pvc-2lxp2"
Jul 19 05:30:03.609: INFO: At 2021-07-19 05:25:03 +0000 UTC - event for pvc-2lxp2: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "disk.csi.azure.com" or manually created by system administrator
Jul 19 05:30:03.609: INFO: At 2021-07-19 05:25:03 +0000 UTC - event for pvc-2lxp2: {disk.csi.azure.com_k8s-agentpool1-31572070-1_214d4adb-f4ee-4bdc-b841-59cb1c336fe1 } ProvisioningFailed: failed to provision volume with StorageClass "azuredisk-1577-kubernetes.io-azure-disk-dynamic-sc-zl67b": rpc error: code = Unknown desc = invalid parameter csi-migration in storage class
Jul 19 05:30:03.666: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Jul 19 05:30:03.666: INFO: 
Jul 19 05:30:03.779: INFO: 
Logging node info for node k8s-agentpool1-31572070-0
Jul 19 05:30:03.835: INFO: Node Info: &Node{ObjectMeta:{k8s-agentpool1-31572070-0    0e5b2e71-1ed9-486a-b60a-99df122131aa 9950 0 2021-07-19 04:17:09 +0000 UTC <nil> <nil> map[agentpool:agentpool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_DS2_v2 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:1 kubernetes.azure.com/cluster:kubetest-63v4hea7 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:k8s-agentpool1-31572070-0 kubernetes.io/os:linux kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_DS2_v2 storageprofile:managed storagetier:Premium_LRS topology.disk.csi.azure.com/zone: topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:1] map[csi.volume.kubernetes.io/nodeid:{"disk.csi.azure.com":"k8s-agentpool1-31572070-0"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  [{kubectl-label Update v1 2021-07-19 04:17:42 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}} {kube-controller-manager Update v1 2021-07-19 04:29:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kubelet Update v1 2021-07-19 04:29:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.disk.csi.azure.com/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-63v4hea7/providers/Microsoft.Compute/virtualMachines/k8s-agentpool1-31572070-0,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{31036686336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7292153856 0} {<nil>} 7121244Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{27933017657 0} {<nil>} 27933017657 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{6505721856 0} {<nil>} 6353244Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-07-19 04:17:40 +0000 UTC,LastTransitionTime:2021-07-19 04:17:40 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-07-19 05:25:04 +0000 UTC,LastTransitionTime:2021-07-19 04:17:09 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-07-19 05:25:04 +0000 UTC,LastTransitionTime:2021-07-19 04:17:09 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-07-19 05:25:04 +0000 UTC,LastTransitionTime:2021-07-19 04:17:09 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-07-19 05:25:04 +0000 UTC,LastTransitionTime:2021-07-19 04:17:19 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:k8s-agentpool1-31572070-0,},NodeAddress{Type:InternalIP,Address:10.240.0.4,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:51b59e019a86412998e1c173ce955b93,SystemUUID:0658397c-ab99-8146-bd5b-151b3734f71f,BootID:02daf884-da82-4b50-b158-47b533d58d4d,KernelVersion:5.4.0-1049-azure,OSImage:Ubuntu 18.04.5 LTS,ContainerRuntimeVersion:docker://20.10.7+azure,KubeletVersion:v1.20.9,KubeProxyVersion:v1.20.9,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azurefile-csi@sha256:558b9ac2bb6cf988252222039c506da0e4703d28480b21788687b111fde9e59d mcr.microsoft.com/k8s/csi/azurefile-csi:v0.6.0],SizeBytes:346393977,},ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azuredisk-csi@sha256:2536d09114a6be2b9e9a64542990996f24e66586933b02c2a4fa41331c333b55 mcr.microsoft.com/k8s/csi/azuredisk-csi:v0.7.0],SizeBytes:286182075,},ContainerImage{Names:[k8sprow.azurecr.io/azuredisk-csi@sha256:79d824c22f2646a97a23315d87cef8783b06d5c12ad8965e7ac3c72df31ae70a k8sprow.azurecr.io/azuredisk-csi:v1.5.0-715e2992cf5195fa8c444ee96493975db3499a24],SizeBytes:211439924,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/azure-npm@sha256:106f669f48e5e80c4ec0afb49858ead72cf4b901cd8664e7bf81f8d789e56e12 mcr.microsoft.com/containernetworking/azure-npm:v1.2.2_hotfix],SizeBytes:175248091,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver@sha256:c0d040a1c4fbfceb65663e31c09ea40f4f78e356437610cbc3fbb4bb409bd6f1 mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver:v0.0.19],SizeBytes:123243922,},ContainerImage{Names:[mcr.microsoft.com/oss/azure/secrets-store/provider-azure@sha256:6f67f3d0c7cdde5702f8ce7f101b6519daa0237f0c34fecb7c058b6af8c22ad1 mcr.microsoft.com/oss/azure/secrets-store/provider-azure:0.0.12],SizeBytes:101075580,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:e1343903466b1de10eeae9876beb5430329e3d07aa195ba1ddba663af012a193 mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.20.0],SizeBytes:99677469,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:82d95608b2fa5073d3e957c7189eff6cafd2c3028b493900291ceab314a6f56a mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.9],SizeBytes:99656407,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager@sha256:0085ffc5930e0d47b388ee3446a9c72ac434117944552a5c47dbdf64d34c00a0 mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager:v0.5.1],SizeBytes:88868427,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:0f0c53b4d1231c7ff062ec4453fa6bb5fe1a9df81379207ad87c734eff635604 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.5.1],SizeBytes:88168005,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-addon-manager@sha256:32e2836018c96e73533bd4642fe438e465b81dcbfa8b7b61935a6f4d0246c7ae mcr.microsoft.com/oss/kubernetes/kube-addon-manager:v9.1.3],SizeBytes:86833441,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-addon-manager@sha256:92c2c5aad9012ee32d2a43a74966cc0adc6ccb1705ad15abb10485ecf406d88b mcr.microsoft.com/oss/kubernetes/kube-addon-manager:v9.1.5],SizeBytes:84095409,},ContainerImage{Names:[mcr.microsoft.com/oss/nvidia/k8s-device-plugin@sha256:0f5b52bf28239234e831697d96db63ac03cde70fe68058f964504ab7564ee810 mcr.microsoft.com/oss/nvidia/k8s-device-plugin:1.0.0-beta6],SizeBytes:64178257,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/metrics-server@sha256:682d3a1a48abbe03df05e1084923ab668a6651fd80327f9694b0cf302cc49f90 mcr.microsoft.com/oss/kubernetes/metrics-server:v0.5.0],SizeBytes:63517663,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner@sha256:21fae82e312b135c9b09f75041922a4e189ce6d86d23c83a7e1be48dbe172a74 mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner:v1.5.0],SizeBytes:56671460,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner@sha256:3e1695221da4da4744e7eea688ff6acaf4a8724650a10fda66c4cdea931a134b mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner:v1.4.0],SizeBytes:54470728,},ContainerImage{Names:[andyzhangx/csi-provisioner@sha256:8d88d7044617582c089178821677f307a77a444f48e5a45c57f4e014100bf4c9 andyzhangx/csi-provisioner:v2.1.1],SizeBytes:51152358,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/ip-masq-agent@sha256:bddf19be25644c7176e8c501465dbad07d032288334f135877b984660b0d3ee6 mcr.microsoft.com/oss/kubernetes/ip-masq-agent:v2.5.0],SizeBytes:50148508,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-attacher@sha256:d685e7294432c4308131d44781bb1e1f00ddd02d7a10f0d61caed5963ba7ae39 mcr.microsoft.com/oss/kubernetes-csi/csi-attacher:v3.1.0],SizeBytes:49334622,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-resizer@sha256:7997e0f236bc291101433ccd43704cac27ad87d6bdbcf480487d0799514aedc1 mcr.microsoft.com/oss/kubernetes-csi/csi-resizer:v1.1.0],SizeBytes:49299352,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter@sha256:19f29f0f54cf915e751c1c0e685a457fce73666bd0c98898671ae1313b755d1c mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter:v3.0.3],SizeBytes:47957733,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter@sha256:7d4825b057634e815ba0fb21b528b58781ab83b1199c1fb6211c2ef56c66e41a mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter:v1.1.0],SizeBytes:47628159,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter@sha256:f714d2a97234ad53cab35c201a2f2f503e9707e107c6e741777a9ead190760e3 mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter:v2.0.0],SizeBytes:46308973,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-attacher@sha256:5321c1199ed7cc0920ce09cea2158f93644b72bebb0517958e30afaf2392e572 mcr.microsoft.com/oss/kubernetes-csi/csi-attacher:v1.2.0],SizeBytes:46229106,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-resizer@sha256:89ad3037cdce5b7501add15265f37faf1e21adec27b7727087fe3e1826da640a mcr.microsoft.com/oss/kubernetes-csi/csi-resizer:v0.3.0],SizeBytes:46020585,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/coredns@sha256:1c23b17c78ffbc90c068ee088b77456284b9649952fa127b0f86a0ccff575539 mcr.microsoft.com/oss/kubernetes/coredns:1.7.0],SizeBytes:45245990,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/snapshot-controller@sha256:7188322cbe5bf7fddb6adcdc946ad45ad3c2fbfc365a55005d0160d9c5accfe5 mcr.microsoft.com/oss/kubernetes-csi/snapshot-controller:v3.0.3],SizeBytes:43154924,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/snapshot-controller@sha256:da80086fff8b98c58e6ff0403a5835cf7ea7dc0b8fdb504cc55601c4b6881066 mcr.microsoft.com/oss/kubernetes-csi/snapshot-controller:v2.0.0],SizeBytes:41429109,},ContainerImage{Names:[mcr.microsoft.com/k8s/aad-pod-identity/mic@sha256:bd9465be94966b9a917e1e3904fa5e63dd91772ccadf304e18ffd8e4ad8ccedd mcr.microsoft.com/k8s/aad-pod-identity/mic:1.6.1],SizeBytes:41395977,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-proportional-autoscaler@sha256:753e3ca79dc833feed24ee4107ff4f06a96abbd6cefba8d41d7dec6f4d3e75f0 mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-proportional-autoscaler:1.7.1],SizeBytes:40067731,},ContainerImage{Names:[mcr.microsoft.com/k8s/aad-pod-identity/nmi@sha256:02128fefcdb7593ac53fc342e2c53a0fc6fabd813036bf60457bf43cc2940116 mcr.microsoft.com/k8s/aad-pod-identity/nmi:1.6.1],SizeBytes:38029065,},ContainerImage{Names:[mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume@sha256:921f301c44dda06a325164accf22e78ecc570b5c7d9d6ee4c66bd8cbb2b60b9a mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume:v0.0.16],SizeBytes:26975508,},ContainerImage{Names:[mcr.microsoft.com/k8s/kms/keyvault@sha256:1a27e175f8c125209e32d2957b5509fe20757bd8cb309ff9da598799b56326fb mcr.microsoft.com/k8s/kms/keyvault:v0.0.10],SizeBytes:23081748,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:60b7645ece041ce343e5f74017e39b72c6703661bd147d225772a81c4d18f4e3 mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v2.1.0],SizeBytes:19679271,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:8863840b419194a408ab8fa21961f4a317fb4e7ad8a8b783fe65677c0c7e4f0a mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v2.2.0],SizeBytes:18710308,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:b7d82802cca8523df1d5973332c64d558fe352617926fd01707b17e2f022755f mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.2.0],SizeBytes:17768771,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:aae4d193ef1480387294e07d164d48c70be090f7f95f03a6f70ef1bac225e9cc mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.3.0],SizeBytes:17113770,},ContainerImage{Names:[busybox@sha256:930490f97e5b921535c153e0e7110d251134cc4b72bbb8133c6a5065cc68580d busybox:latest],SizeBytes:1235821,},ContainerImage{Names:[mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume@sha256:23d8c6033f02a1ecad05127ebdc931bb871264228661bc122704b0974e4d9fdd mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume:1.0.8],SizeBytes:1159025,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:1154361,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:e3b8c20681593c21b344ad801fbb8abaf564427ee3a57a9fcfa3b455f917ce46 mcr.microsoft.com/oss/kubernetes/pause:3.4.1],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jul 19 05:30:03.836: INFO: 
... skipping 85 lines ...
/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:40
  [single-az]
  /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:43
    should delete PV with reclaimPolicy "Delete" [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows] [It]
    /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:409

    Unexpected error:
        <*errors.errorString | 0xc000c5ea00>: {
            s: "PersistentVolumeClaims [pvc-2lxp2] not all in phase Bound within 5m0s",
        }
        PersistentVolumeClaims [pvc-2lxp2] not all in phase Bound within 5m0s
    occurred

... skipping 105 lines ...
STEP: setting up the StorageClass
STEP: creating a StorageClass 
STEP: setting up the PVC and PV
STEP: creating a PVC
STEP: setting up the pod
STEP: deploying the pod
STEP: checking that the pod's command exits with no error
Jul 19 05:30:12.869: INFO: Waiting up to 15m0s for pod "azuredisk-volume-tester-gsfrv" in namespace "azuredisk-552" to be "Succeeded or Failed"
Jul 19 05:30:12.928: INFO: Pod "azuredisk-volume-tester-gsfrv": Phase="Pending", Reason="", readiness=false. Elapsed: 58.785898ms
Jul 19 05:30:14.983: INFO: Pod "azuredisk-volume-tester-gsfrv": Phase="Pending", Reason="", readiness=false. Elapsed: 2.11409073s
Jul 19 05:30:17.037: INFO: Pod "azuredisk-volume-tester-gsfrv": Phase="Pending", Reason="", readiness=false. Elapsed: 4.168456514s
Jul 19 05:30:19.093: INFO: Pod "azuredisk-volume-tester-gsfrv": Phase="Pending", Reason="", readiness=false. Elapsed: 6.224014123s
Jul 19 05:30:21.148: INFO: Pod "azuredisk-volume-tester-gsfrv": Phase="Pending", Reason="", readiness=false. Elapsed: 8.279170705s
Jul 19 05:30:23.203: INFO: Pod "azuredisk-volume-tester-gsfrv": Phase="Pending", Reason="", readiness=false. Elapsed: 10.334504122s
... skipping 438 lines ...
STEP: validating provisioned PV
Jul 19 05:45:14.939: INFO: deleting StorageClass azuredisk-552-kubernetes.io-azure-disk-dynamic-sc-g6s5v
STEP: validating provisioned PV
Jul 19 05:45:15.043: INFO: deleting StorageClass azuredisk-552-kubernetes.io-azure-disk-dynamic-sc-kk7mx
STEP: Collecting events from namespace "azuredisk-552".
STEP: Found 15 events.
Jul 19 05:45:15.148: INFO: At 2021-07-19 05:30:12 +0000 UTC - event for pvc-2tlxh: {disk.csi.azure.com_k8s-agentpool1-31572070-1_214d4adb-f4ee-4bdc-b841-59cb1c336fe1 } ProvisioningFailed: failed to provision volume with StorageClass "azuredisk-552-kubernetes.io-azure-disk-dynamic-sc-fgknt": rpc error: code = Unknown desc = invalid parameter csi-migration in storage class
Jul 19 05:45:15.148: INFO: At 2021-07-19 05:30:12 +0000 UTC - event for pvc-2tlxh: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding
Jul 19 05:45:15.148: INFO: At 2021-07-19 05:30:12 +0000 UTC - event for pvc-2tlxh: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "disk.csi.azure.com" or manually created by system administrator
Jul 19 05:45:15.148: INFO: At 2021-07-19 05:30:12 +0000 UTC - event for pvc-2tlxh: {disk.csi.azure.com_k8s-agentpool1-31572070-1_214d4adb-f4ee-4bdc-b841-59cb1c336fe1 } Provisioning: External provisioner is provisioning volume for claim "azuredisk-552/pvc-2tlxh"
Jul 19 05:45:15.148: INFO: At 2021-07-19 05:30:12 +0000 UTC - event for pvc-f9fqq: {disk.csi.azure.com_k8s-agentpool1-31572070-1_214d4adb-f4ee-4bdc-b841-59cb1c336fe1 } ProvisioningFailed: failed to provision volume with StorageClass "azuredisk-552-kubernetes.io-azure-disk-dynamic-sc-kk7mx": rpc error: code = Unknown desc = invalid parameter csi-migration in storage class
Jul 19 05:45:15.148: INFO: At 2021-07-19 05:30:12 +0000 UTC - event for pvc-f9fqq: {disk.csi.azure.com_k8s-agentpool1-31572070-1_214d4adb-f4ee-4bdc-b841-59cb1c336fe1 } Provisioning: External provisioner is provisioning volume for claim "azuredisk-552/pvc-f9fqq"
Jul 19 05:45:15.148: INFO: At 2021-07-19 05:30:12 +0000 UTC - event for pvc-f9fqq: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "disk.csi.azure.com" or manually created by system administrator
Jul 19 05:45:15.148: INFO: At 2021-07-19 05:30:12 +0000 UTC - event for pvc-f9fqq: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding
Jul 19 05:45:15.148: INFO: At 2021-07-19 05:30:12 +0000 UTC - event for pvc-sjj8g: {disk.csi.azure.com_k8s-agentpool1-31572070-1_214d4adb-f4ee-4bdc-b841-59cb1c336fe1 } ProvisioningFailed: failed to provision volume with StorageClass "azuredisk-552-kubernetes.io-azure-disk-dynamic-sc-g6s5v": rpc error: code = Unknown desc = invalid parameter csi-migration in storage class
Jul 19 05:45:15.148: INFO: At 2021-07-19 05:30:12 +0000 UTC - event for pvc-sjj8g: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "disk.csi.azure.com" or manually created by system administrator
Jul 19 05:45:15.148: INFO: At 2021-07-19 05:30:12 +0000 UTC - event for pvc-sjj8g: {disk.csi.azure.com_k8s-agentpool1-31572070-1_214d4adb-f4ee-4bdc-b841-59cb1c336fe1 } Provisioning: External provisioner is provisioning volume for claim "azuredisk-552/pvc-sjj8g"
Jul 19 05:45:15.148: INFO: At 2021-07-19 05:30:12 +0000 UTC - event for pvc-sjj8g: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding
Jul 19 05:45:15.148: INFO: At 2021-07-19 05:40:12 +0000 UTC - event for azuredisk-volume-tester-gsfrv: {default-scheduler } FailedScheduling: running PreBind plugin "VolumeBinding": binding volumes: timed out waiting for the condition
Jul 19 05:45:15.148: INFO: At 2021-07-19 05:45:14 +0000 UTC - event for azuredisk-volume-tester-gsfrv: {default-scheduler } FailedScheduling: running PreBind plugin "VolumeBinding": binding volumes: pod does not exist any more: pod "azuredisk-volume-tester-gsfrv" not found
Jul 19 05:45:15.148: INFO: At 2021-07-19 05:45:14 +0000 UTC - event for azuredisk-volume-tester-gsfrv: {default-scheduler } FailedScheduling: skip schedule deleting pod: azuredisk-552/azuredisk-volume-tester-gsfrv
... skipping 91 lines ...
/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:40
  [single-az]
  /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:43
    should create multiple PV objects, bind to PVCs and attach all to a single pod [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows] [It]
    /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:527

    Unexpected error:
        <*errors.errorString | 0xc0001347e0>: {
            s: "Gave up after waiting 15m0s for pod \"azuredisk-volume-tester-gsfrv\" to be \"Succeeded or Failed\"",
        }
        Gave up after waiting 15m0s for pod "azuredisk-volume-tester-gsfrv" to be "Succeeded or Failed"
    occurred

    /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/testsuites.go:729
------------------------------
Dynamic Provisioning [single-az] 
  should create a raw block volume and a filesystem volume on demand and bind to the same pod [kubernetes.io/azure-disk] [disk.csi.azure.com]
... skipping 15 lines ...
STEP: setting up the StorageClass
STEP: creating a StorageClass 
STEP: setting up the PVC and PV
STEP: creating a PVC
STEP: setting up the pod
STEP: deploying the pod
STEP: checking that the pod's command exits with no error
Jul 19 05:45:18.495: INFO: Waiting up to 15m0s for pod "azuredisk-volume-tester-b8z8x" in namespace "azuredisk-1351" to be "Succeeded or Failed"
Jul 19 05:45:18.545: INFO: Pod "azuredisk-volume-tester-b8z8x": Phase="Pending", Reason="", readiness=false. Elapsed: 50.527477ms
Jul 19 05:45:20.597: INFO: Pod "azuredisk-volume-tester-b8z8x": Phase="Pending", Reason="", readiness=false. Elapsed: 2.10199852s
Jul 19 05:45:22.649: INFO: Pod "azuredisk-volume-tester-b8z8x": Phase="Pending", Reason="", readiness=false. Elapsed: 4.153847915s
Jul 19 05:45:24.701: INFO: Pod "azuredisk-volume-tester-b8z8x": Phase="Pending", Reason="", readiness=false. Elapsed: 6.205649253s
Jul 19 05:45:26.752: INFO: Pod "azuredisk-volume-tester-b8z8x": Phase="Pending", Reason="", readiness=false. Elapsed: 8.257567728s
Jul 19 05:45:28.804: INFO: Pod "azuredisk-volume-tester-b8z8x": Phase="Pending", Reason="", readiness=false. Elapsed: 10.309480125s
... skipping 438 lines ...
Jul 19 06:00:19.146: INFO: deleting StorageClass azuredisk-1351-kubernetes.io-azure-disk-dynamic-sc-c8m44
STEP: Collecting events from namespace "azuredisk-1351".
STEP: Found 10 events.
Jul 19 06:00:19.256: INFO: At 2021-07-19 05:45:18 +0000 UTC - event for pvc-npcsf: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding
Jul 19 06:00:19.256: INFO: At 2021-07-19 05:45:18 +0000 UTC - event for pvc-npcsf: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "disk.csi.azure.com" or manually created by system administrator
Jul 19 06:00:19.256: INFO: At 2021-07-19 05:45:18 +0000 UTC - event for pvc-npcsf: {disk.csi.azure.com_k8s-agentpool1-31572070-1_214d4adb-f4ee-4bdc-b841-59cb1c336fe1 } Provisioning: External provisioner is provisioning volume for claim "azuredisk-1351/pvc-npcsf"
Jul 19 06:00:19.256: INFO: At 2021-07-19 05:45:18 +0000 UTC - event for pvc-npcsf: {disk.csi.azure.com_k8s-agentpool1-31572070-1_214d4adb-f4ee-4bdc-b841-59cb1c336fe1 } ProvisioningFailed: failed to provision volume with StorageClass "azuredisk-1351-kubernetes.io-azure-disk-dynamic-sc-6snkv": rpc error: code = Unknown desc = invalid parameter csi-migration in storage class
Jul 19 06:00:19.256: INFO: At 2021-07-19 05:45:18 +0000 UTC - event for pvc-vx7j4: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding
Jul 19 06:00:19.256: INFO: At 2021-07-19 05:45:18 +0000 UTC - event for pvc-vx7j4: {disk.csi.azure.com_k8s-agentpool1-31572070-1_214d4adb-f4ee-4bdc-b841-59cb1c336fe1 } Provisioning: External provisioner is provisioning volume for claim "azuredisk-1351/pvc-vx7j4"
Jul 19 06:00:19.256: INFO: At 2021-07-19 05:45:18 +0000 UTC - event for pvc-vx7j4: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "disk.csi.azure.com" or manually created by system administrator
Jul 19 06:00:19.256: INFO: At 2021-07-19 05:45:18 +0000 UTC - event for pvc-vx7j4: {disk.csi.azure.com_k8s-agentpool1-31572070-1_214d4adb-f4ee-4bdc-b841-59cb1c336fe1 } ProvisioningFailed: failed to provision volume with StorageClass "azuredisk-1351-kubernetes.io-azure-disk-dynamic-sc-c8m44": rpc error: code = Unknown desc = invalid parameter csi-migration in storage class
Jul 19 06:00:19.256: INFO: At 2021-07-19 05:55:18 +0000 UTC - event for azuredisk-volume-tester-b8z8x: {default-scheduler } FailedScheduling: running PreBind plugin "VolumeBinding": binding volumes: timed out waiting for the condition
Jul 19 06:00:19.256: INFO: At 2021-07-19 06:00:18 +0000 UTC - event for azuredisk-volume-tester-b8z8x: {default-scheduler } FailedScheduling: skip schedule deleting pod: azuredisk-1351/azuredisk-volume-tester-b8z8x
Jul 19 06:00:19.310: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Jul 19 06:00:19.310: INFO: 
Jul 19 06:00:19.415: INFO: 
Logging node info for node k8s-agentpool1-31572070-0
... skipping 87 lines ...
/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:40
  [single-az]
  /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:43
    should create a raw block volume and a filesystem volume on demand and bind to the same pod [kubernetes.io/azure-disk] [disk.csi.azure.com] [It]
    /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:574

    Unexpected error:
        <*errors.errorString | 0xc000f04b20>: {
            s: "Gave up after waiting 15m0s for pod \"azuredisk-volume-tester-b8z8x\" to be \"Succeeded or Failed\"",
        }
        Gave up after waiting 15m0s for pod "azuredisk-volume-tester-b8z8x" to be "Succeeded or Failed"
    occurred

    /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/testsuites.go:729
------------------------------
Dynamic Provisioning [single-az] 
  should create a pod, write and read to it, take a volume snapshot, and create another pod from the snapshot [disk.csi.azure.com]
... skipping 71 lines ...
STEP: creating a PVC
STEP: setting up the StorageClass
STEP: creating a StorageClass 
STEP: setting up the PVC and PV
STEP: creating a PVC
STEP: deploying the pod
STEP: checking that the pod's command exits with no error
Jul 19 06:00:25.356: INFO: Waiting up to 15m0s for pod "azuredisk-volume-tester-gswnm" in namespace "azuredisk-9267" to be "Succeeded or Failed"
Jul 19 06:00:25.409: INFO: Pod "azuredisk-volume-tester-gswnm": Phase="Pending", Reason="", readiness=false. Elapsed: 52.659581ms
Jul 19 06:00:27.468: INFO: Pod "azuredisk-volume-tester-gswnm": Phase="Pending", Reason="", readiness=false. Elapsed: 2.111846541s
Jul 19 06:00:29.522: INFO: Pod "azuredisk-volume-tester-gswnm": Phase="Pending", Reason="", readiness=false. Elapsed: 4.166196951s
Jul 19 06:00:31.578: INFO: Pod "azuredisk-volume-tester-gswnm": Phase="Pending", Reason="", readiness=false. Elapsed: 6.222548441s
Jul 19 06:00:33.639: INFO: Pod "azuredisk-volume-tester-gswnm": Phase="Pending", Reason="", readiness=false. Elapsed: 8.283078765s
Jul 19 06:00:35.693: INFO: Pod "azuredisk-volume-tester-gswnm": Phase="Pending", Reason="", readiness=false. Elapsed: 10.337481587s
... skipping 340 lines ...
Jul 19 06:12:16.836: INFO: Pod "azuredisk-volume-tester-gswnm": Phase="Pending", Reason="", readiness=false. Elapsed: 11m51.480261431s
Jul 19 06:12:18.891: INFO: Pod "azuredisk-volume-tester-gswnm": Phase="Pending", Reason="", readiness=false. Elapsed: 11m53.535007768s
Jul 19 06:12:20.949: INFO: Pod "azuredisk-volume-tester-gswnm": Phase="Pending", Reason="", readiness=false. Elapsed: 11m55.593474444s
Jul 19 06:12:23.004: INFO: Pod "azuredisk-volume-tester-gswnm": Phase="Pending", Reason="", readiness=false. Elapsed: 11m57.648064652s
Jul 19 06:12:25.060: INFO: Pod "azuredisk-volume-tester-gswnm": Phase="Pending", Reason="", readiness=false. Elapsed: 11m59.703821489s
Jul 19 06:12:27.115: INFO: Pod "azuredisk-volume-tester-gswnm": Phase="Pending", Reason="", readiness=false. Elapsed: 12m1.759489162s
{"component":"entrypoint","file":"prow/entrypoint/run.go:165","func":"k8s.io/test-infra/prow/entrypoint.Options.ExecuteProcess","level":"error","msg":"Process did not finish before 2h0m0s timeout","severity":"error","time":"2021-07-19T06:12:28Z"}
++ early_exit_handler
++ '[' -n 188 ']'
++ kill -TERM 188
++ cleanup_dind
++ [[ true == \t\r\u\e ]]
++ echo 'Cleaning up after docker'
... skipping 107 lines ...
STEP: validating provisioned PV
Jul 19 06:15:26.193: INFO: deleting StorageClass azuredisk-9267-kubernetes.io-azure-disk-dynamic-sc-5jks9
STEP: validating provisioned PV
Jul 19 06:15:26.304: INFO: deleting StorageClass azuredisk-9267-kubernetes.io-azure-disk-dynamic-sc-b5sqj
STEP: Collecting events from namespace "azuredisk-9267".
STEP: Found 15 events.
Jul 19 06:15:26.414: INFO: At 2021-07-19 06:00:25 +0000 UTC - event for pvc-9zh6t: {disk.csi.azure.com_k8s-agentpool1-31572070-1_214d4adb-f4ee-4bdc-b841-59cb1c336fe1 } ProvisioningFailed: failed to provision volume with StorageClass "azuredisk-9267-kubernetes.io-azure-disk-dynamic-sc-b5sqj": rpc error: code = Unknown desc = invalid parameter csi-migration in storage class
Jul 19 06:15:26.414: INFO: At 2021-07-19 06:00:25 +0000 UTC - event for pvc-9zh6t: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding
Jul 19 06:15:26.414: INFO: At 2021-07-19 06:00:25 +0000 UTC - event for pvc-9zh6t: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "disk.csi.azure.com" or manually created by system administrator
Jul 19 06:15:26.414: INFO: At 2021-07-19 06:00:25 +0000 UTC - event for pvc-9zh6t: {disk.csi.azure.com_k8s-agentpool1-31572070-1_214d4adb-f4ee-4bdc-b841-59cb1c336fe1 } Provisioning: External provisioner is provisioning volume for claim "azuredisk-9267/pvc-9zh6t"
Jul 19 06:15:26.414: INFO: At 2021-07-19 06:00:25 +0000 UTC - event for pvc-lgsht: {disk.csi.azure.com_k8s-agentpool1-31572070-1_214d4adb-f4ee-4bdc-b841-59cb1c336fe1 } ProvisioningFailed: failed to provision volume with StorageClass "azuredisk-9267-kubernetes.io-azure-disk-dynamic-sc-46n6p": rpc error: code = Unknown desc = invalid parameter csi-migration in storage class
Jul 19 06:15:26.414: INFO: At 2021-07-19 06:00:25 +0000 UTC - event for pvc-lgsht: {disk.csi.azure.com_k8s-agentpool1-31572070-1_214d4adb-f4ee-4bdc-b841-59cb1c336fe1 } Provisioning: External provisioner is provisioning volume for claim "azuredisk-9267/pvc-lgsht"
Jul 19 06:15:26.414: INFO: At 2021-07-19 06:00:25 +0000 UTC - event for pvc-lgsht: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "disk.csi.azure.com" or manually created by system administrator
Jul 19 06:15:26.414: INFO: At 2021-07-19 06:00:25 +0000 UTC - event for pvc-lgsht: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding
Jul 19 06:15:26.414: INFO: At 2021-07-19 06:00:25 +0000 UTC - event for pvc-tk9w8: {disk.csi.azure.com_k8s-agentpool1-31572070-1_214d4adb-f4ee-4bdc-b841-59cb1c336fe1 } ProvisioningFailed: failed to provision volume with StorageClass "azuredisk-9267-kubernetes.io-azure-disk-dynamic-sc-5jks9": rpc error: code = Unknown desc = invalid parameter csi-migration in storage class
Jul 19 06:15:26.414: INFO: At 2021-07-19 06:00:25 +0000 UTC - event for pvc-tk9w8: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "disk.csi.azure.com" or manually created by system administrator
Jul 19 06:15:26.414: INFO: At 2021-07-19 06:00:25 +0000 UTC - event for pvc-tk9w8: {disk.csi.azure.com_k8s-agentpool1-31572070-1_214d4adb-f4ee-4bdc-b841-59cb1c336fe1 } Provisioning: External provisioner is provisioning volume for claim "azuredisk-9267/pvc-tk9w8"
Jul 19 06:15:26.414: INFO: At 2021-07-19 06:00:25 +0000 UTC - event for pvc-tk9w8: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding
Jul 19 06:15:26.414: INFO: At 2021-07-19 06:10:25 +0000 UTC - event for azuredisk-volume-tester-gswnm: {default-scheduler } FailedScheduling: running PreBind plugin "VolumeBinding": binding volumes: timed out waiting for the condition
Jul 19 06:15:26.414: INFO: At 2021-07-19 06:15:25 +0000 UTC - event for azuredisk-volume-tester-gswnm: {default-scheduler } FailedScheduling: skip schedule deleting pod: azuredisk-9267/azuredisk-volume-tester-gswnm
Jul 19 06:15:26.414: INFO: At 2021-07-19 06:15:26 +0000 UTC - event for azuredisk-volume-tester-gswnm: {default-scheduler } FailedScheduling: running PreBind plugin "VolumeBinding": binding volumes: pod does not exist any more: pod "azuredisk-volume-tester-gswnm" not found
... skipping 91 lines ...
/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:40
  [single-az]
  /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:43
    should create a pod with multiple volumes [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows] [It]
    /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:692

    Unexpected error:
        <*errors.errorString | 0xc000ab4f40>: {
            s: "Gave up after waiting 15m0s for pod \"azuredisk-volume-tester-gswnm\" to be \"Succeeded or Failed\"",
        }
        Gave up after waiting 15m0s for pod "azuredisk-volume-tester-gswnm" to be "Succeeded or Failed"
    occurred

    /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/testsuites.go:729
------------------------------
Dynamic Provisioning [single-az] 
  should create a volume on demand and resize it [disk.csi.azure.com] [Windows]
... skipping 70 lines ...
STEP: checking that the pod is running
STEP: Collecting events from namespace "azuredisk-7175".
STEP: Found 4 events.
Jul 19 06:20:32.642: INFO: At 2021-07-19 06:15:32 +0000 UTC - event for pvc-2rnnd: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding
Jul 19 06:20:32.642: INFO: At 2021-07-19 06:15:32 +0000 UTC - event for pvc-2rnnd: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "disk.csi.azure.com" or manually created by system administrator
Jul 19 06:20:32.642: INFO: At 2021-07-19 06:15:32 +0000 UTC - event for pvc-2rnnd: {disk.csi.azure.com_k8s-agentpool1-31572070-1_214d4adb-f4ee-4bdc-b841-59cb1c336fe1 } Provisioning: External provisioner is provisioning volume for claim "azuredisk-7175/pvc-2rnnd"
Jul 19 06:20:32.643: INFO: At 2021-07-19 06:15:32 +0000 UTC - event for pvc-2rnnd: {disk.csi.azure.com_k8s-agentpool1-31572070-1_214d4adb-f4ee-4bdc-b841-59cb1c336fe1 } ProvisioningFailed: failed to provision volume with StorageClass "azuredisk-7175-kubernetes.io-azure-disk-dynamic-sc-rzbr4": rpc error: code = Unknown desc = invalid parameter csi-migration in storage class
Jul 19 06:20:32.697: INFO: POD                            NODE  PHASE    GRACE  CONDITIONS
Jul 19 06:20:32.697: INFO: azuredisk-volume-tester-2ntht        Pending         []
Jul 19 06:20:32.697: INFO: 
Jul 19 06:20:32.846: INFO: 
Logging node info for node k8s-agentpool1-31572070-0
Jul 19 06:20:32.901: INFO: Node Info: &Node{ObjectMeta:{k8s-agentpool1-31572070-0    0e5b2e71-1ed9-486a-b60a-99df122131aa 18005 0 2021-07-19 04:17:09 +0000 UTC <nil> <nil> map[agentpool:agentpool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_DS2_v2 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:1 kubernetes.azure.com/cluster:kubetest-63v4hea7 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:k8s-agentpool1-31572070-0 kubernetes.io/os:linux kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_DS2_v2 storageprofile:managed storagetier:Premium_LRS topology.disk.csi.azure.com/zone: topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:1] map[csi.volume.kubernetes.io/nodeid:{"disk.csi.azure.com":"k8s-agentpool1-31572070-0"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  [{kubectl-label Update v1 2021-07-19 04:17:42 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}} {kube-controller-manager Update v1 2021-07-19 04:29:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kubelet Update v1 2021-07-19 04:29:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.disk.csi.azure.com/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-63v4hea7/providers/Microsoft.Compute/virtualMachines/k8s-agentpool1-31572070-0,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{31036686336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7292153856 0} {<nil>} 7121244Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{27933017657 0} {<nil>} 27933017657 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{6505721856 0} {<nil>} 6353244Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-07-19 04:17:40 +0000 UTC,LastTransitionTime:2021-07-19 04:17:40 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-07-19 06:20:26 +0000 UTC,LastTransitionTime:2021-07-19 04:17:09 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-07-19 06:20:26 +0000 UTC,LastTransitionTime:2021-07-19 04:17:09 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-07-19 06:20:26 +0000 UTC,LastTransitionTime:2021-07-19 04:17:09 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-07-19 06:20:26 +0000 UTC,LastTransitionTime:2021-07-19 04:17:19 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:k8s-agentpool1-31572070-0,},NodeAddress{Type:InternalIP,Address:10.240.0.4,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:51b59e019a86412998e1c173ce955b93,SystemUUID:0658397c-ab99-8146-bd5b-151b3734f71f,BootID:02daf884-da82-4b50-b158-47b533d58d4d,KernelVersion:5.4.0-1049-azure,OSImage:Ubuntu 18.04.5 LTS,ContainerRuntimeVersion:docker://20.10.7+azure,KubeletVersion:v1.20.9,KubeProxyVersion:v1.20.9,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azurefile-csi@sha256:558b9ac2bb6cf988252222039c506da0e4703d28480b21788687b111fde9e59d mcr.microsoft.com/k8s/csi/azurefile-csi:v0.6.0],SizeBytes:346393977,},ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azuredisk-csi@sha256:2536d09114a6be2b9e9a64542990996f24e66586933b02c2a4fa41331c333b55 mcr.microsoft.com/k8s/csi/azuredisk-csi:v0.7.0],SizeBytes:286182075,},ContainerImage{Names:[k8sprow.azurecr.io/azuredisk-csi@sha256:79d824c22f2646a97a23315d87cef8783b06d5c12ad8965e7ac3c72df31ae70a k8sprow.azurecr.io/azuredisk-csi:v1.5.0-715e2992cf5195fa8c444ee96493975db3499a24],SizeBytes:211439924,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/azure-npm@sha256:106f669f48e5e80c4ec0afb49858ead72cf4b901cd8664e7bf81f8d789e56e12 mcr.microsoft.com/containernetworking/azure-npm:v1.2.2_hotfix],SizeBytes:175248091,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver@sha256:c0d040a1c4fbfceb65663e31c09ea40f4f78e356437610cbc3fbb4bb409bd6f1 mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver:v0.0.19],SizeBytes:123243922,},ContainerImage{Names:[mcr.microsoft.com/oss/azure/secrets-store/provider-azure@sha256:6f67f3d0c7cdde5702f8ce7f101b6519daa0237f0c34fecb7c058b6af8c22ad1 mcr.microsoft.com/oss/azure/secrets-store/provider-azure:0.0.12],SizeBytes:101075580,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:e1343903466b1de10eeae9876beb5430329e3d07aa195ba1ddba663af012a193 mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.20.0],SizeBytes:99677469,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:82d95608b2fa5073d3e957c7189eff6cafd2c3028b493900291ceab314a6f56a mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.9],SizeBytes:99656407,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager@sha256:0085ffc5930e0d47b388ee3446a9c72ac434117944552a5c47dbdf64d34c00a0 mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager:v0.5.1],SizeBytes:88868427,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:0f0c53b4d1231c7ff062ec4453fa6bb5fe1a9df81379207ad87c734eff635604 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.5.1],SizeBytes:88168005,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-addon-manager@sha256:32e2836018c96e73533bd4642fe438e465b81dcbfa8b7b61935a6f4d0246c7ae mcr.microsoft.com/oss/kubernetes/kube-addon-manager:v9.1.3],SizeBytes:86833441,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-addon-manager@sha256:92c2c5aad9012ee32d2a43a74966cc0adc6ccb1705ad15abb10485ecf406d88b mcr.microsoft.com/oss/kubernetes/kube-addon-manager:v9.1.5],SizeBytes:84095409,},ContainerImage{Names:[mcr.microsoft.com/oss/nvidia/k8s-device-plugin@sha256:0f5b52bf28239234e831697d96db63ac03cde70fe68058f964504ab7564ee810 mcr.microsoft.com/oss/nvidia/k8s-device-plugin:1.0.0-beta6],SizeBytes:64178257,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/metrics-server@sha256:682d3a1a48abbe03df05e1084923ab668a6651fd80327f9694b0cf302cc49f90 mcr.microsoft.com/oss/kubernetes/metrics-server:v0.5.0],SizeBytes:63517663,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner@sha256:21fae82e312b135c9b09f75041922a4e189ce6d86d23c83a7e1be48dbe172a74 mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner:v1.5.0],SizeBytes:56671460,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner@sha256:3e1695221da4da4744e7eea688ff6acaf4a8724650a10fda66c4cdea931a134b mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner:v1.4.0],SizeBytes:54470728,},ContainerImage{Names:[andyzhangx/csi-provisioner@sha256:8d88d7044617582c089178821677f307a77a444f48e5a45c57f4e014100bf4c9 andyzhangx/csi-provisioner:v2.1.1],SizeBytes:51152358,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/ip-masq-agent@sha256:bddf19be25644c7176e8c501465dbad07d032288334f135877b984660b0d3ee6 mcr.microsoft.com/oss/kubernetes/ip-masq-agent:v2.5.0],SizeBytes:50148508,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-attacher@sha256:d685e7294432c4308131d44781bb1e1f00ddd02d7a10f0d61caed5963ba7ae39 mcr.microsoft.com/oss/kubernetes-csi/csi-attacher:v3.1.0],SizeBytes:49334622,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-resizer@sha256:7997e0f236bc291101433ccd43704cac27ad87d6bdbcf480487d0799514aedc1 mcr.microsoft.com/oss/kubernetes-csi/csi-resizer:v1.1.0],SizeBytes:49299352,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter@sha256:19f29f0f54cf915e751c1c0e685a457fce73666bd0c98898671ae1313b755d1c mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter:v3.0.3],SizeBytes:47957733,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter@sha256:7d4825b057634e815ba0fb21b528b58781ab83b1199c1fb6211c2ef56c66e41a mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter:v1.1.0],SizeBytes:47628159,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter@sha256:f714d2a97234ad53cab35c201a2f2f503e9707e107c6e741777a9ead190760e3 mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter:v2.0.0],SizeBytes:46308973,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-attacher@sha256:5321c1199ed7cc0920ce09cea2158f93644b72bebb0517958e30afaf2392e572 mcr.microsoft.com/oss/kubernetes-csi/csi-attacher:v1.2.0],SizeBytes:46229106,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-resizer@sha256:89ad3037cdce5b7501add15265f37faf1e21adec27b7727087fe3e1826da640a mcr.microsoft.com/oss/kubernetes-csi/csi-resizer:v0.3.0],SizeBytes:46020585,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/coredns@sha256:1c23b17c78ffbc90c068ee088b77456284b9649952fa127b0f86a0ccff575539 mcr.microsoft.com/oss/kubernetes/coredns:1.7.0],SizeBytes:45245990,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/snapshot-controller@sha256:7188322cbe5bf7fddb6adcdc946ad45ad3c2fbfc365a55005d0160d9c5accfe5 mcr.microsoft.com/oss/kubernetes-csi/snapshot-controller:v3.0.3],SizeBytes:43154924,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/snapshot-controller@sha256:da80086fff8b98c58e6ff0403a5835cf7ea7dc0b8fdb504cc55601c4b6881066 mcr.microsoft.com/oss/kubernetes-csi/snapshot-controller:v2.0.0],SizeBytes:41429109,},ContainerImage{Names:[mcr.microsoft.com/k8s/aad-pod-identity/mic@sha256:bd9465be94966b9a917e1e3904fa5e63dd91772ccadf304e18ffd8e4ad8ccedd mcr.microsoft.com/k8s/aad-pod-identity/mic:1.6.1],SizeBytes:41395977,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-proportional-autoscaler@sha256:753e3ca79dc833feed24ee4107ff4f06a96abbd6cefba8d41d7dec6f4d3e75f0 mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-proportional-autoscaler:1.7.1],SizeBytes:40067731,},ContainerImage{Names:[mcr.microsoft.com/k8s/aad-pod-identity/nmi@sha256:02128fefcdb7593ac53fc342e2c53a0fc6fabd813036bf60457bf43cc2940116 mcr.microsoft.com/k8s/aad-pod-identity/nmi:1.6.1],SizeBytes:38029065,},ContainerImage{Names:[mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume@sha256:921f301c44dda06a325164accf22e78ecc570b5c7d9d6ee4c66bd8cbb2b60b9a mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume:v0.0.16],SizeBytes:26975508,},ContainerImage{Names:[mcr.microsoft.com/k8s/kms/keyvault@sha256:1a27e175f8c125209e32d2957b5509fe20757bd8cb309ff9da598799b56326fb mcr.microsoft.com/k8s/kms/keyvault:v0.0.10],SizeBytes:23081748,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:60b7645ece041ce343e5f74017e39b72c6703661bd147d225772a81c4d18f4e3 mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v2.1.0],SizeBytes:19679271,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:8863840b419194a408ab8fa21961f4a317fb4e7ad8a8b783fe65677c0c7e4f0a mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v2.2.0],SizeBytes:18710308,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:b7d82802cca8523df1d5973332c64d558fe352617926fd01707b17e2f022755f mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.2.0],SizeBytes:17768771,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:aae4d193ef1480387294e07d164d48c70be090f7f95f03a6f70ef1bac225e9cc mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.3.0],SizeBytes:17113770,},ContainerImage{Names:[busybox@sha256:930490f97e5b921535c153e0e7110d251134cc4b72bbb8133c6a5065cc68580d busybox:latest],SizeBytes:1235821,},ContainerImage{Names:[mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume@sha256:23d8c6033f02a1ecad05127ebdc931bb871264228661bc122704b0974e4d9fdd mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume:1.0.8],SizeBytes:1159025,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:1154361,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:e3b8c20681593c21b344ad801fbb8abaf564427ee3a57a9fcfa3b455f917ce46 mcr.microsoft.com/oss/kubernetes/pause:3.4.1],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
... skipping 86 lines ...
/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:40
  [single-az]
  /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:43
    should detach disk after pod deleted [disk.csi.azure.com] [Windows] [It]
    /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:790

    Unexpected error:
        <*errors.errorString | 0xc00037a350>: {
            s: "timed out waiting for the condition",
        }
        timed out waiting for the condition
    occurred

... skipping 220 lines ...
I0719 06:27:18.139371   13949 testsuites.go:669] 0/1 replicas in the StatefulSet are ready
I0719 06:27:20.139985   13949 testsuites.go:669] 0/1 replicas in the StatefulSet are ready
I0719 06:27:22.140226   13949 testsuites.go:669] 0/1 replicas in the StatefulSet are ready
I0719 06:27:24.138427   13949 testsuites.go:669] 0/1 replicas in the StatefulSet are ready
I0719 06:27:26.139781   13949 testsuites.go:669] 0/1 replicas in the StatefulSet are ready
I0719 06:27:28.140158   13949 testsuites.go:669] 0/1 replicas in the StatefulSet are ready
{"component":"entrypoint","file":"prow/entrypoint/run.go:255","func":"k8s.io/test-infra/prow/entrypoint.gracefullyTerminate","level":"error","msg":"Process did not exit before 15m0s grace period","severity":"error","time":"2021-07-19T06:27:28Z"}
{"component":"entrypoint","error":"os: process already finished","file":"prow/entrypoint/run.go:257","func":"k8s.io/test-infra/prow/entrypoint.gracefullyTerminate","level":"error","msg":"Could not kill process after grace period","severity":"error","time":"2021-07-19T06:27:28Z"}