This job view page is being replaced by Spyglass soon. Check out the new job view.
PRsunpa93: [V2] feat: update volume attachment with publish context upon attachment completion
ResultFAILURE
Tests 0 failed / 0 succeeded
Started2022-06-13 22:21
Elapsed3h15m
Revisione33a1ac2b731428342329aedfa3f89af703cfb43
Refs 1361

No Test Failures!


Error lines from build-log.txt

... skipping 85 lines ...

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100 11156  100 11156    0     0   231k      0 --:--:-- --:--:-- --:--:--  231k
Downloading https://get.helm.sh/helm-v3.9.0-linux-amd64.tar.gz
Verifying checksum... Done.
Preparing to install helm into /usr/local/bin
helm installed into /usr/local/bin/helm
docker pull k8sprow.azurecr.io/azuredisk-csi:latest-v2-c117aa793cbdc4445c2959c60f3a5bcf7a2aaacb || make container-all push-manifest
Error response from daemon: manifest for k8sprow.azurecr.io/azuredisk-csi:latest-v2-c117aa793cbdc4445c2959c60f3a5bcf7a2aaacb not found: manifest unknown: manifest tagged by "latest-v2-c117aa793cbdc4445c2959c60f3a5bcf7a2aaacb" is not found
make[2]: Entering directory '/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver'
CGO_ENABLED=0 GOOS=windows go build -a -ldflags "-X sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk.driverVersion=latest-v2-c117aa793cbdc4445c2959c60f3a5bcf7a2aaacb -X sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk.gitCommit=c117aa793cbdc4445c2959c60f3a5bcf7a2aaacb -X sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk.buildDate=2022-06-13T22:28:05Z -extldflags "-static"" -tags azurediskv2 -mod vendor -o _output/amd64/azurediskpluginv2.exe ./pkg/azurediskplugin
docker buildx rm container-builder || true
error: no builder "container-builder" found
docker buildx create --use --name=container-builder
container-builder
# enable qemu for arm64 build
# https://github.com/docker/buildx/issues/464#issuecomment-741507760
docker run --privileged --rm tonistiigi/binfmt --uninstall qemu-aarch64
Unable to find image 'tonistiigi/binfmt:latest' locally
... skipping 694 lines ...
         }
      }
   ]
}
make[2]: Leaving directory '/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver'
docker pull k8sprow.azurecr.io/azdiskschedulerextender-csi:latest-v2-c117aa793cbdc4445c2959c60f3a5bcf7a2aaacb || make azdiskschedulerextender-all push-manifest-azdiskschedulerextender
Error response from daemon: manifest for k8sprow.azurecr.io/azdiskschedulerextender-csi:latest-v2-c117aa793cbdc4445c2959c60f3a5bcf7a2aaacb not found: manifest unknown: manifest tagged by "latest-v2-c117aa793cbdc4445c2959c60f3a5bcf7a2aaacb" is not found
make[2]: Entering directory '/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver'
docker buildx rm container-builder || true
docker buildx create --use --name=container-builder
container-builder
# enable qemu for arm64 build
# https://github.com/docker/buildx/issues/464#issuecomment-741507760
... skipping 865 lines ...
                    type: string
                type: object
                oneOf:
                - required: ["persistentVolumeClaimName"]
                - required: ["volumeSnapshotContentName"]
              volumeSnapshotClassName:
                description: 'VolumeSnapshotClassName is the name of the VolumeSnapshotClass requested by the VolumeSnapshot. VolumeSnapshotClassName may be left nil to indicate that the default SnapshotClass should be used. A given cluster may have multiple default Volume SnapshotClasses: one default per CSI Driver. If a VolumeSnapshot does not specify a SnapshotClass, VolumeSnapshotSource will be checked to figure out what the associated CSI Driver is, and the default VolumeSnapshotClass associated with that CSI Driver will be used. If more than one VolumeSnapshotClass exist for a given CSI Driver and more than one have been marked as default, CreateSnapshot will fail and generate an event. Empty string is not allowed for this field.'
                type: string
            required:
            - source
            type: object
          status:
            description: status represents the current information of a snapshot. Consumers must verify binding between VolumeSnapshot and VolumeSnapshotContent objects is successful (by validating that both VolumeSnapshot and VolumeSnapshotContent point at each other) before using this object.
... skipping 2 lines ...
                description: 'boundVolumeSnapshotContentName is the name of the VolumeSnapshotContent object to which this VolumeSnapshot object intends to bind to. If not specified, it indicates that the VolumeSnapshot object has not been successfully bound to a VolumeSnapshotContent object yet. NOTE: To avoid possible security issues, consumers must verify binding between VolumeSnapshot and VolumeSnapshotContent objects is successful (by validating that both VolumeSnapshot and VolumeSnapshotContent point at each other) before using this object.'
                type: string
              creationTime:
                description: creationTime is the timestamp when the point-in-time snapshot is taken by the underlying storage system. In dynamic snapshot creation case, this field will be filled in by the snapshot controller with the "creation_time" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "creation_time" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it. If not specified, it may indicate that the creation time of the snapshot is unknown.
                format: date-time
                type: string
              error:
                description: error is the last observed error during snapshot creation, if any. This field could be helpful to upper level controllers(i.e., application controller) to decide whether they should continue on waiting for the snapshot to be created based on the type of error reported. The snapshot controller will keep retrying when an error occurrs during the snapshot creation. Upon success, this error field will be cleared.
                properties:
                  message:
                    description: 'message is a string detailing the encountered error during snapshot creation if specified. NOTE: message may be logged, and it should not contain sensitive information.'
                    type: string
                  time:
                    description: time is the timestamp when the error was encountered.
                    format: date-time
                    type: string
                type: object
              readyToUse:
                description: readyToUse indicates if the snapshot is ready to be used to restore a volume. In dynamic snapshot creation case, this field will be filled in by the snapshot controller with the "ready_to_use" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "ready_to_use" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it, otherwise, this field will be set to "True". If not specified, it means the readiness of a snapshot is unknown.
                type: boolean
              restoreSize:
                type: string
                description: restoreSize represents the minimum size of volume required to create a volume from this snapshot. In dynamic snapshot creation case, this field will be filled in by the snapshot controller with the "size_bytes" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "size_bytes" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it. When restoring a volume from this snapshot, the size of the volume MUST NOT be smaller than the restoreSize if it is specified, otherwise the restoration will fail. If not specified, it indicates that the size is unknown.
                pattern: ^(\+|-)?(([0-9]+(\.[0-9]*)?)|(\.[0-9]+))(([KMGTPE]i)|[numkMGTPE]|([eE](\+|-)?(([0-9]+(\.[0-9]*)?)|(\.[0-9]+))))?$
                x-kubernetes-int-or-string: true
            type: object
        required:
        - spec
        type: object
... skipping 60 lines ...
                    type: string
                  volumeSnapshotContentName:
                    description: volumeSnapshotContentName specifies the name of a pre-existing VolumeSnapshotContent object representing an existing volume snapshot. This field should be set if the snapshot already exists and only needs a representation in Kubernetes. This field is immutable.
                    type: string
                type: object
              volumeSnapshotClassName:
                description: 'VolumeSnapshotClassName is the name of the VolumeSnapshotClass requested by the VolumeSnapshot. VolumeSnapshotClassName may be left nil to indicate that the default SnapshotClass should be used. A given cluster may have multiple default Volume SnapshotClasses: one default per CSI Driver. If a VolumeSnapshot does not specify a SnapshotClass, VolumeSnapshotSource will be checked to figure out what the associated CSI Driver is, and the default VolumeSnapshotClass associated with that CSI Driver will be used. If more than one VolumeSnapshotClass exist for a given CSI Driver and more than one have been marked as default, CreateSnapshot will fail and generate an event. Empty string is not allowed for this field.'
                type: string
            required:
            - source
            type: object
          status:
            description: status represents the current information of a snapshot. Consumers must verify binding between VolumeSnapshot and VolumeSnapshotContent objects is successful (by validating that both VolumeSnapshot and VolumeSnapshotContent point at each other) before using this object.
... skipping 2 lines ...
                description: 'boundVolumeSnapshotContentName is the name of the VolumeSnapshotContent object to which this VolumeSnapshot object intends to bind to. If not specified, it indicates that the VolumeSnapshot object has not been successfully bound to a VolumeSnapshotContent object yet. NOTE: To avoid possible security issues, consumers must verify binding between VolumeSnapshot and VolumeSnapshotContent objects is successful (by validating that both VolumeSnapshot and VolumeSnapshotContent point at each other) before using this object.'
                type: string
              creationTime:
                description: creationTime is the timestamp when the point-in-time snapshot is taken by the underlying storage system. In dynamic snapshot creation case, this field will be filled in by the snapshot controller with the "creation_time" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "creation_time" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it. If not specified, it may indicate that the creation time of the snapshot is unknown.
                format: date-time
                type: string
              error:
                description: error is the last observed error during snapshot creation, if any. This field could be helpful to upper level controllers(i.e., application controller) to decide whether they should continue on waiting for the snapshot to be created based on the type of error reported. The snapshot controller will keep retrying when an error occurrs during the snapshot creation. Upon success, this error field will be cleared.
                properties:
                  message:
                    description: 'message is a string detailing the encountered error during snapshot creation if specified. NOTE: message may be logged, and it should not contain sensitive information.'
                    type: string
                  time:
                    description: time is the timestamp when the error was encountered.
                    format: date-time
                    type: string
                type: object
              readyToUse:
                description: readyToUse indicates if the snapshot is ready to be used to restore a volume. In dynamic snapshot creation case, this field will be filled in by the snapshot controller with the "ready_to_use" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "ready_to_use" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it, otherwise, this field will be set to "True". If not specified, it means the readiness of a snapshot is unknown.
                type: boolean
              restoreSize:
                type: string
                description: restoreSize represents the minimum size of volume required to create a volume from this snapshot. In dynamic snapshot creation case, this field will be filled in by the snapshot controller with the "size_bytes" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "size_bytes" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it. When restoring a volume from this snapshot, the size of the volume MUST NOT be smaller than the restoreSize if it is specified, otherwise the restoration will fail. If not specified, it indicates that the size is unknown.
                pattern: ^(\+|-)?(([0-9]+(\.[0-9]*)?)|(\.[0-9]+))(([KMGTPE]i)|[numkMGTPE]|([eE](\+|-)?(([0-9]+(\.[0-9]*)?)|(\.[0-9]+))))?$
                x-kubernetes-int-or-string: true
            type: object
        required:
        - spec
        type: object
... skipping 254 lines ...
            description: status represents the current information of a snapshot.
            properties:
              creationTime:
                description: creationTime is the timestamp when the point-in-time snapshot is taken by the underlying storage system. In dynamic snapshot creation case, this field will be filled in by the CSI snapshotter sidecar with the "creation_time" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "creation_time" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it. If not specified, it indicates the creation time is unknown. The format of this field is a Unix nanoseconds time encoded as an int64. On Unix, the command `date +%s%N` returns the current time in nanoseconds since 1970-01-01 00:00:00 UTC.
                format: int64
                type: integer
              error:
                description: error is the last observed error during snapshot creation, if any. Upon success after retry, this error field will be cleared.
                properties:
                  message:
                    description: 'message is a string detailing the encountered error during snapshot creation if specified. NOTE: message may be logged, and it should not contain sensitive information.'
                    type: string
                  time:
                    description: time is the timestamp when the error was encountered.
                    format: date-time
                    type: string
                type: object
              readyToUse:
                description: readyToUse indicates if a snapshot is ready to be used to restore a volume. In dynamic snapshot creation case, this field will be filled in by the CSI snapshotter sidecar with the "ready_to_use" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "ready_to_use" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it, otherwise, this field will be set to "True". If not specified, it means the readiness of a snapshot is unknown.
                type: boolean
              restoreSize:
                description: restoreSize represents the complete size of the snapshot in bytes. In dynamic snapshot creation case, this field will be filled in by the CSI snapshotter sidecar with the "size_bytes" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "size_bytes" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it. When restoring a volume from this snapshot, the size of the volume MUST NOT be smaller than the restoreSize if it is specified, otherwise the restoration will fail. If not specified, it indicates that the size is unknown.
                format: int64
                minimum: 0
                type: integer
              snapshotHandle:
                description: snapshotHandle is the CSI "snapshot_id" of a snapshot on the underlying storage system. If not specified, it indicates that dynamic snapshot creation has either failed or it is still in progress.
                type: string
            type: object
        required:
        - spec
        type: object
    served: true
... skipping 108 lines ...
            description: status represents the current information of a snapshot.
            properties:
              creationTime:
                description: creationTime is the timestamp when the point-in-time snapshot is taken by the underlying storage system. In dynamic snapshot creation case, this field will be filled in by the CSI snapshotter sidecar with the "creation_time" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "creation_time" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it. If not specified, it indicates the creation time is unknown. The format of this field is a Unix nanoseconds time encoded as an int64. On Unix, the command `date +%s%N` returns the current time in nanoseconds since 1970-01-01 00:00:00 UTC.
                format: int64
                type: integer
              error:
                description: error is the last observed error during snapshot creation, if any. Upon success after retry, this error field will be cleared.
                properties:
                  message:
                    description: 'message is a string detailing the encountered error during snapshot creation if specified. NOTE: message may be logged, and it should not contain sensitive information.'
                    type: string
                  time:
                    description: time is the timestamp when the error was encountered.
                    format: date-time
                    type: string
                type: object
              readyToUse:
                description: readyToUse indicates if a snapshot is ready to be used to restore a volume. In dynamic snapshot creation case, this field will be filled in by the CSI snapshotter sidecar with the "ready_to_use" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "ready_to_use" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it, otherwise, this field will be set to "True". If not specified, it means the readiness of a snapshot is unknown.
                type: boolean
              restoreSize:
                description: restoreSize represents the complete size of the snapshot in bytes. In dynamic snapshot creation case, this field will be filled in by the CSI snapshotter sidecar with the "size_bytes" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "size_bytes" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it. When restoring a volume from this snapshot, the size of the volume MUST NOT be smaller than the restoreSize if it is specified, otherwise the restoration will fail. If not specified, it indicates that the size is unknown.
                format: int64
                minimum: 0
                type: integer
              snapshotHandle:
                description: snapshotHandle is the CSI "snapshot_id" of a snapshot on the underlying storage system. If not specified, it indicates that dynamic snapshot creation has either failed or it is still in progress.
                type: string
            type: object
        required:
        - spec
        type: object
    served: true
... skipping 244 lines ...
            - volumeName
            - volume_context
            - volume_id
            type: object
          status:
            description: status represents the current state of AzVolumeAttachment.
              includes error, state, and attachment status
            properties:
              annotation:
                additionalProperties:
                  type: string
                description: Annotations contains additional resource information
                  to guide driver actions
... skipping 13 lines ...
                  role:
                    description: The current attachment role.
                    type: string
                required:
                - role
                type: object
              error:
                description: Error occurred during attach/detach of volume
                properties:
                  code:
                    type: string
                  message:
                    type: string
                  parameters:
... skipping 173 lines ...
            - maxMountReplicaCount
            - volumeCapability
            - volumeName
            type: object
          status:
            description: status represents the current state of AzVolume. includes
              error, state, and volume status
            properties:
              annotation:
                additionalProperties:
                  type: string
                description: Annotations contains additional resource information
                  to guide driver actions
... skipping 34 lines ...
                    type: string
                required:
                - capacity_bytes
                - node_expansion_required
                - volume_id
                type: object
              error:
                description: Error occurred during creation/deletion of volume
                properties:
                  code:
                    type: string
                  message:
                    type: string
                  parameters:
... skipping 1061 lines ...
          image: "mcr.microsoft.com/oss/kubernetes-csi/csi-resizer:v1.4.0"
          args:
            - "-csi-address=$(ADDRESS)"
            - "-v=2"
            - "-leader-election"
            - "--leader-election-namespace=kube-system"
            - '-handle-volume-inuse-error=false'
            - '-feature-gates=RecoverVolumeExpansionFailure=true'
            - "-timeout=240s"
          env:
            - name: ADDRESS
              value: /csi/csi.sock
          volumeMounts:
... skipping 429 lines ...
STEP: setting up the StorageClass
STEP: creating a StorageClass 
STEP: setting up the PVC and PV
STEP: creating a PVC
STEP: setting up the pod
STEP: deploying the pod
STEP: checking that the pod's command exits with no error
Jun 13 22:36:37.232: INFO: Waiting up to 15m0s for pod "azuredisk-volume-tester-qm2pr" in namespace "azuredisk-173" to be "Succeeded or Failed"
Jun 13 22:36:37.341: INFO: Pod "azuredisk-volume-tester-qm2pr": Phase="Pending", Reason="", readiness=false. Elapsed: 108.807019ms
Jun 13 22:36:39.449: INFO: Pod "azuredisk-volume-tester-qm2pr": Phase="Pending", Reason="", readiness=false. Elapsed: 2.217532138s
Jun 13 22:36:41.559: INFO: Pod "azuredisk-volume-tester-qm2pr": Phase="Pending", Reason="", readiness=false. Elapsed: 4.327353361s
Jun 13 22:36:43.669: INFO: Pod "azuredisk-volume-tester-qm2pr": Phase="Pending", Reason="", readiness=false. Elapsed: 6.437042942s
Jun 13 22:36:45.778: INFO: Pod "azuredisk-volume-tester-qm2pr": Phase="Pending", Reason="", readiness=false. Elapsed: 8.546309523s
Jun 13 22:36:47.888: INFO: Pod "azuredisk-volume-tester-qm2pr": Phase="Pending", Reason="", readiness=false. Elapsed: 10.655848529s
... skipping 416 lines ...
Jun 13 22:51:27.824: INFO: Pod "azuredisk-volume-tester-qm2pr": Phase="Pending", Reason="", readiness=false. Elapsed: 14m50.592602336s
Jun 13 22:51:29.935: INFO: Pod "azuredisk-volume-tester-qm2pr": Phase="Pending", Reason="", readiness=false. Elapsed: 14m52.703277083s
Jun 13 22:51:32.044: INFO: Pod "azuredisk-volume-tester-qm2pr": Phase="Pending", Reason="", readiness=false. Elapsed: 14m54.812567645s
Jun 13 22:51:34.155: INFO: Pod "azuredisk-volume-tester-qm2pr": Phase="Pending", Reason="", readiness=false. Elapsed: 14m56.923159348s
Jun 13 22:51:36.264: INFO: Pod "azuredisk-volume-tester-qm2pr": Phase="Pending", Reason="", readiness=false. Elapsed: 14m59.032272452s
Jun 13 22:51:38.266: INFO: deleting Pod "azuredisk-173"/"azuredisk-volume-tester-qm2pr"
Jun 13 22:51:38.407: INFO: Error getting logs for pod azuredisk-volume-tester-qm2pr: the server rejected our request for an unknown reason (get pods azuredisk-volume-tester-qm2pr)
STEP: Deleting pod azuredisk-volume-tester-qm2pr in namespace azuredisk-173
STEP: validating provisioned PV
STEP: checking the PV
Jun 13 22:51:38.738: INFO: deleting PVC "azuredisk-173"/"pvc-h6x7j"
Jun 13 22:51:38.738: INFO: Deleting PersistentVolumeClaim "pvc-h6x7j"
STEP: waiting for claim's PV "pvc-a1486788-8b37-4f2d-95c6-35ee5cf8fe2d" to be deleted
... skipping 122 lines ...
Jun 13 23:01:42.226: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for azuredisk-volume-tester-qm2pr: { } Scheduled: Successfully assigned azuredisk-173/azuredisk-volume-tester-qm2pr to k8s-agentpool1-21748613-1
Jun 13 23:01:42.226: INFO: At 2022-06-13 22:36:37 +0000 UTC - event for pvc-h6x7j: {disk.csi.azure.com_k8s-agentpool1-21748613-0_28b70215-f943-4330-871f-8d56a7f0eb33 } Provisioning: External provisioner is provisioning volume for claim "azuredisk-173/pvc-h6x7j"
Jun 13 23:01:42.226: INFO: At 2022-06-13 22:36:37 +0000 UTC - event for pvc-h6x7j: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding
Jun 13 23:01:42.226: INFO: At 2022-06-13 22:36:37 +0000 UTC - event for pvc-h6x7j: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "disk.csi.azure.com" or manually created by system administrator
Jun 13 23:01:42.226: INFO: At 2022-06-13 22:36:39 +0000 UTC - event for pvc-h6x7j: {disk.csi.azure.com_k8s-agentpool1-21748613-0_28b70215-f943-4330-871f-8d56a7f0eb33 } ProvisioningSucceeded: Successfully provisioned volume pvc-a1486788-8b37-4f2d-95c6-35ee5cf8fe2d
Jun 13 23:01:42.226: INFO: At 2022-06-13 22:36:41 +0000 UTC - event for azuredisk-volume-tester-qm2pr: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-a1486788-8b37-4f2d-95c6-35ee5cf8fe2d" 
Jun 13 23:01:42.226: INFO: At 2022-06-13 22:38:43 +0000 UTC - event for azuredisk-volume-tester-qm2pr: {kubelet k8s-agentpool1-21748613-1} FailedMount: MountVolume.MountDevice failed for volume "pvc-a1486788-8b37-4f2d-95c6-35ee5cf8fe2d" : rpc error: code = DeadlineExceeded desc = context deadline exceeded
Jun 13 23:01:42.226: INFO: At 2022-06-13 22:38:43 +0000 UTC - event for azuredisk-volume-tester-qm2pr: {kubelet k8s-agentpool1-21748613-1} FailedMount: Unable to attach or mount volumes: unmounted volumes=[test-volume-1], unattached volumes=[test-volume-1 kube-api-access-slsjt]: timed out waiting for the condition
Jun 13 23:01:42.226: INFO: At 2022-06-13 22:40:58 +0000 UTC - event for azuredisk-volume-tester-qm2pr: {kubelet k8s-agentpool1-21748613-1} FailedMount: Unable to attach or mount volumes: unmounted volumes=[test-volume-1], unattached volumes=[kube-api-access-slsjt test-volume-1]: timed out waiting for the condition
Jun 13 23:01:42.334: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Jun 13 23:01:42.334: INFO: 
Jun 13 23:01:42.551: INFO: 
Logging node info for node k8s-agentpool1-21748613-0
... skipping 92 lines ...
/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:40
  [single-az]
  /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:44
    should create a volume on demand with mount options [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows] [csi-azuredisk-scheduler-extender] [It]
    /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:102

    Unexpected error:
        <*errors.errorString | 0xc0009f3540>: {
            s: "Gave up after waiting 15m0s for pod \"azuredisk-volume-tester-qm2pr\" to be \"Succeeded or Failed\"",
        }
        Gave up after waiting 15m0s for pod "azuredisk-volume-tester-qm2pr" to be "Succeeded or Failed"
    occurred

    /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pod.go:89
------------------------------
Dynamic Provisioning [single-az] 
  should create a pod with volume mount subpath [disk.csi.azure.com] [Windows]
... skipping 97 lines ...
STEP: setting up the PVC and PV
STEP: creating a PVC
STEP: setting up the pod
STEP: deploying the pod
STEP: checking that the pod has 'FailedMount' event
Jun 13 23:03:58.992: INFO: deleting Pod "azuredisk-5463"/"azuredisk-volume-tester-nvxcg"
Jun 13 23:03:59.134: INFO: Error getting logs for pod azuredisk-volume-tester-nvxcg: the server rejected our request for an unknown reason (get pods azuredisk-volume-tester-nvxcg)
STEP: Deleting pod azuredisk-volume-tester-nvxcg in namespace azuredisk-5463
STEP: validating provisioned PV
STEP: checking the PV
Jun 13 23:03:59.469: INFO: deleting PVC "azuredisk-5463"/"pvc-mssnh"
Jun 13 23:03:59.469: INFO: Deleting PersistentVolumeClaim "pvc-mssnh"
STEP: waiting for claim's PV "pvc-1a676212-0ad3-4630-9b1d-be5a839d44ee" to be deleted
... skipping 122 lines ...
Jun 13 23:14:02.940: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for azuredisk-volume-tester-nvxcg: { } Scheduled: Successfully assigned azuredisk-5463/azuredisk-volume-tester-nvxcg to k8s-agentpool1-21748613-0
Jun 13 23:14:02.940: INFO: At 2022-06-13 23:01:52 +0000 UTC - event for pvc-mssnh: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding
Jun 13 23:14:02.940: INFO: At 2022-06-13 23:01:52 +0000 UTC - event for pvc-mssnh: {disk.csi.azure.com_k8s-agentpool1-21748613-0_28b70215-f943-4330-871f-8d56a7f0eb33 } Provisioning: External provisioner is provisioning volume for claim "azuredisk-5463/pvc-mssnh"
Jun 13 23:14:02.940: INFO: At 2022-06-13 23:01:52 +0000 UTC - event for pvc-mssnh: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "disk.csi.azure.com" or manually created by system administrator
Jun 13 23:14:02.940: INFO: At 2022-06-13 23:01:55 +0000 UTC - event for pvc-mssnh: {disk.csi.azure.com_k8s-agentpool1-21748613-0_28b70215-f943-4330-871f-8d56a7f0eb33 } ProvisioningSucceeded: Successfully provisioned volume pvc-1a676212-0ad3-4630-9b1d-be5a839d44ee
Jun 13 23:14:02.940: INFO: At 2022-06-13 23:01:57 +0000 UTC - event for azuredisk-volume-tester-nvxcg: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-1a676212-0ad3-4630-9b1d-be5a839d44ee" 
Jun 13 23:14:02.940: INFO: At 2022-06-13 23:03:57 +0000 UTC - event for azuredisk-volume-tester-nvxcg: {kubelet k8s-agentpool1-21748613-0} FailedMount: MountVolume.MountDevice failed for volume "pvc-1a676212-0ad3-4630-9b1d-be5a839d44ee" : rpc error: code = DeadlineExceeded desc = context deadline exceeded
Jun 13 23:14:02.940: INFO: At 2022-06-13 23:03:58 +0000 UTC - event for azuredisk-volume-tester-nvxcg: {kubelet k8s-agentpool1-21748613-0} FailedMount: Unable to attach or mount volumes: unmounted volumes=[test-volume-1], unattached volumes=[test-volume-1 kube-api-access-c5dkn]: timed out waiting for the condition
Jun 13 23:14:03.049: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Jun 13 23:14:03.049: INFO: 
Jun 13 23:14:03.265: INFO: 
Logging node info for node k8s-agentpool1-21748613-0
Jun 13 23:14:03.373: INFO: Node Info: &Node{ObjectMeta:{k8s-agentpool1-21748613-0    fa68479d-f6ae-468f-a3ed-be7981963e75 9745 0 2022-06-13 22:24:59 +0000 UTC <nil> <nil> map[agentpool:agentpool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_DS2_v2 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westeurope failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-fpcu74iw kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:k8s-agentpool1-21748613-0 kubernetes.io/os:linux kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_DS2_v2 storageprofile:managed storagetier:Premium_LRS topology.disk.csi.azure.com/zone: topology.kubernetes.io/region:westeurope topology.kubernetes.io/zone:0] map[csi.volume.kubernetes.io/nodeid:{"disk.csi.azure.com":"k8s-agentpool1-21748613-0"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  [{kubelet Update v1 2022-06-13 22:24:59 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubectl-label Update v1 2022-06-13 22:25:06 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}} } {kube-controller-manager Update v1 2022-06-13 22:25:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}} } {kubelet Update v1 2022-06-13 23:06:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.disk.csi.azure.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {kube-controller-manager Update v1 2022-06-13 23:12:04 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-fpcu74iw/providers/Microsoft.Compute/virtualMachines/k8s-agentpool1-21748613-0,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{31036686336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7287771136 0} {<nil>} 7116964Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{27933017657 0} {<nil>} 27933017657 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{6501339136 0} {<nil>} 6348964Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-13 22:25:34 +0000 UTC,LastTransitionTime:2022-06-13 22:25:34 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-13 23:11:08 +0000 UTC,LastTransitionTime:2022-06-13 22:24:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-13 23:11:08 +0000 UTC,LastTransitionTime:2022-06-13 22:24:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-13 23:11:08 +0000 UTC,LastTransitionTime:2022-06-13 22:24:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-13 23:11:08 +0000 UTC,LastTransitionTime:2022-06-13 22:25:13 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:k8s-agentpool1-21748613-0,},NodeAddress{Type:InternalIP,Address:10.240.0.5,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a70924ba292b40ada44db0c707163fc1,SystemUUID:6d4ba5a8-f967-1544-a7fc-cdcf3ad6c2bf,BootID:91c2fb2a-52f5-435f-890c-b7e7b55e3fd3,KernelVersion:5.4.0-1074-azure,OSImage:Ubuntu 18.04.6 LTS,ContainerRuntimeVersion:docker://20.10.11+azure-3,KubeletVersion:v1.23.7,KubeProxyVersion:v1.23.7,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/azuredisk-csi@sha256:423eb6cf602c064c8b2deefead5ceadd6324ed41b3d995dab5d0f6f0f4d4710f mcr.microsoft.com/oss/kubernetes-csi/azuredisk-csi:v1.10.0],SizeBytes:245959792,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/azurefile-csi@sha256:9e2ecabcf9dd9943e6600eb9fb460f45b4dc61af7cabe95d115082a029db2aaf mcr.microsoft.com/oss/kubernetes-csi/azurefile-csi:v1.9.0],SizeBytes:230470852,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/azure-npm@sha256:106f669f48e5e80c4ec0afb49858ead72cf4b901cd8664e7bf81f8d789e56e12 mcr.microsoft.com/containernetworking/azure-npm:v1.2.2_hotfix],SizeBytes:175230380,},ContainerImage{Names:[k8sprow.azurecr.io/azuredisk-csi@sha256:1c927d283c1beb5dfb8fd9bb39197190d8feddb8c672986361c22a216168b5a7 k8sprow.azurecr.io/azuredisk-csi:latest-v2-c117aa793cbdc4445c2959c60f3a5bcf7a2aaacb],SizeBytes:136456062,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver@sha256:c0d040a1c4fbfceb65663e31c09ea40f4f78e356437610cbc3fbb4bb409bd6f1 mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver:v0.0.19],SizeBytes:123229697,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:0c890e918d42c158fab68867bade2ab1db04c3408452db9611a264ba3e43e6b3 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.23.7],SizeBytes:112296063,},ContainerImage{Names:[mcr.microsoft.com/oss/azure/secrets-store/provider-azure@sha256:6f67f3d0c7cdde5702f8ce7f101b6519daa0237f0c34fecb7c058b6af8c22ad1 mcr.microsoft.com/oss/azure/secrets-store/provider-azure:0.0.12],SizeBytes:101061355,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:6f0c680d375c62e74351f8ff3ed6ddb9b72ca759e0645c329b95f64264654a6d mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.22.1],SizeBytes:99962810,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-addon-manager@sha256:32e2836018c96e73533bd4642fe438e465b81dcbfa8b7b61935a6f4d0246c7ae mcr.microsoft.com/oss/kubernetes/kube-addon-manager:v9.1.3],SizeBytes:86832059,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-addon-manager@sha256:92c2c5aad9012ee32d2a43a74966cc0adc6ccb1705ad15abb10485ecf406d88b mcr.microsoft.com/oss/kubernetes/kube-addon-manager:v9.1.5],SizeBytes:84094027,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/metrics-server@sha256:1ef9d57ce41ffcc328b92494c3bfafe401e0b9a1694a295301a1385337d52815 mcr.microsoft.com/oss/kubernetes/metrics-server:v0.5.2],SizeBytes:64327621,},ContainerImage{Names:[mcr.microsoft.com/oss/nvidia/k8s-device-plugin@sha256:0f5b52bf28239234e831697d96db63ac03cde70fe68058f964504ab7564ee810 mcr.microsoft.com/oss/nvidia/k8s-device-plugin:1.0.0-beta6],SizeBytes:64160241,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner@sha256:542c9258a1441e4927883ea73425e21f9a14043a649686bf6b51700f34c64f8e mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner:v3.1.0],SizeBytes:57858438,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner@sha256:e9ddadc44ba87a4a27f67e54760a14f9986885b534b3dff170a14eae1e35d213 mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner:v3.0.0],SizeBytes:56881280,},ContainerImage{Names:[k8sprow.azurecr.io/azdiskschedulerextender-csi@sha256:070683970ab8a72265d998412367c05c407c2c5c64334210318b1bf4905c581d k8sprow.azurecr.io/azdiskschedulerextender-csi:latest-v2-c117aa793cbdc4445c2959c60f3a5bcf7a2aaacb],SizeBytes:56760067,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-resizer@sha256:ab6c2e18a4d943f2bf8688e1779622277a1d14c355c9d4bfc0d761d86c5108b3 mcr.microsoft.com/oss/kubernetes-csi/csi-resizer:v1.4.0],SizeBytes:55577322,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter@sha256:a889e925e15f9423f7842f1b769f64cbcf6a20b6956122836fc835cf22d9073f mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter:v5.0.1],SizeBytes:55314459,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-attacher@sha256:19fbca01394f7ed80151731180cfde0a3367f038beae2a97cda7928034010057 mcr.microsoft.com/oss/kubernetes-csi/csi-attacher:v3.4.0],SizeBytes:54954134,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-resizer@sha256:c5bb71ceaac60b1a4b58739fa07b709f6248c452ff6272a384d2f7648895a750 mcr.microsoft.com/oss/kubernetes-csi/csi-resizer:v1.3.0],SizeBytes:54313772,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter@sha256:61849a026511cf332c87d73d0a7aed803b510c3ede197ec755389686d490de72 mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter:v4.2.1],SizeBytes:54210936,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-attacher@sha256:6b41e7153ebdfdc1501aa65184624bc15fd33a52d93f88ec3a758d0f8c9b8c10 mcr.microsoft.com/oss/kubernetes-csi/csi-attacher:v3.3.0],SizeBytes:53842561,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/snapshot-controller@sha256:8c3fc3c2667004ad6bbdf723bb64c5da66a5cb8b11d4ee59b67179b686223b13 mcr.microsoft.com/oss/kubernetes-csi/snapshot-controller:v5.0.1],SizeBytes:52732401,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/snapshot-controller@sha256:be5a8dc1f990828f653c77bd0a0f1bbd13197c3019f6e1d99d590389bac36705 mcr.microsoft.com/oss/kubernetes-csi/snapshot-controller:v4.2.1],SizeBytes:51575245,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager@sha256:0ad67f9919522a07318034641ae09bf2079b417e9944c65914410594ce645468 mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager:v1.1.4],SizeBytes:51478397,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager@sha256:31ec4f7daccd3e7a8504e12657d7830651ecacbe4a487daca1b1b7695a64b070 mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager:v1.23.1],SizeBytes:51249021,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:011712ed90fb8efcf27928b0a47ed04b98baebb31cb1b2d8ab676977ec18eedc mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v1.1.4],SizeBytes:50868093,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:0f9a8fbaed65192ed7dd795be4f9c1dc48ebdef0a241fb62d456f4bed40d9875 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v1.23.1],SizeBytes:50679677,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:c35f45e8dfaa30363e589296415a057f9d32813920fc3820d6557491657f199a mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.21.2],SizeBytes:50607491,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/ip-masq-agent@sha256:1244155f2ed3f33ff154cc343b8ad285f3391d95afd7d4b1c6dcc420bc0ba3cf mcr.microsoft.com/oss/kubernetes/ip-masq-agent:v2.5.0],SizeBytes:50146762,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager@sha256:7c907ff70b90a0bdf8fae63bd744018469dd9839cde1fd0515b93e0bbd14b34e mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager:v1.0.8],SizeBytes:48963453,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:3987d7a8c6922ce1952ee19c5cb6ea75aac7b7c1b07aa79277ad038c69fb7a31 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v1.0.8],SizeBytes:48349053,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/coredns@sha256:f873bf7f0928461efe10697fa76cf0ad7a1ae3041c5b57b50dd3d0b72d273f8c mcr.microsoft.com/oss/kubernetes/coredns:1.8.6],SizeBytes:46804601,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager@sha256:8073113a20882642a980b338635cdc5945e5673a18aef192090e6fde2b89a75c mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager:v0.6.0],SizeBytes:45909032,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:6a32329628bdea3c6d75e98aad6155b65d2e2b98ca616eb33f9ac562912804c6 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.6.0],SizeBytes:45229096,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager@sha256:ef6c4ba564b4d11d270f7d1563c50fbeb30ccc3b94146e5059228c49f95875f5 mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager:v0.7.11],SizeBytes:44916605,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:dbcc384758ba5ca6d249596d471292ed3785e31cdb854d48b84d70794b669b4c mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.7.11],SizeBytes:43679613,},ContainerImage{Names:[mcr.microsoft.com/oss/etcd-io/etcd@sha256:cf587862e3f1b6fa4d9a2565520a34f164bdf72c50f37af8c3c668160593246e mcr.microsoft.com/oss/etcd-io/etcd:v3.3.25],SizeBytes:41832119,},ContainerImage{Names:[mcr.microsoft.com/k8s/aad-pod-identity/mic@sha256:bd9465be94966b9a917e1e3904fa5e63dd91772ccadf304e18ffd8e4ad8ccedd mcr.microsoft.com/k8s/aad-pod-identity/mic:1.6.1],SizeBytes:41374894,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-proportional-autoscaler@sha256:c849d75d61943ce7f51b4c049f1a79d19a08253966c8f49c4cfb6414cc33db8b mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-proportional-autoscaler:1.8.5],SizeBytes:40661903,},ContainerImage{Names:[mcr.microsoft.com/k8s/aad-pod-identity/nmi@sha256:02128fefcdb7593ac53fc342e2c53a0fc6fabd813036bf60457bf43cc2940116 mcr.microsoft.com/k8s/aad-pod-identity/nmi:1.6.1],SizeBytes:38007982,},ContainerImage{Names:[mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume@sha256:921f301c44dda06a325164accf22e78ecc570b5c7d9d6ee4c66bd8cbb2b60b9a mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume:v0.0.16],SizeBytes:26970670,},ContainerImage{Names:[mcr.microsoft.com/k8s/kms/keyvault@sha256:1a27e175f8c125209e32d2957b5509fe20757bd8cb309ff9da598799b56326fb mcr.microsoft.com/k8s/kms/keyvault:v0.0.10],SizeBytes:23077387,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:dbec3a8166686b09b242176ab5b99e993da4126438bbce68147c3fd654f35662 mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v2.4.0],SizeBytes:19547289,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:c96a6255c42766f6b8bb1a7cda02b0060ab1b20b2e2dafcc64ec09e7646745a6 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.5.0],SizeBytes:17573341,},ContainerImage{Names:[mcr.microsoft.com/oss/busybox/busybox@sha256:582a641242b49809af3a1a522f9aae8c3f047d1c6ca1dd9d8cdabd349e45b1a9 mcr.microsoft.com/oss/busybox/busybox:1.33.1],SizeBytes:1235829,},ContainerImage{Names:[mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume@sha256:23d8c6033f02a1ecad05127ebdc931bb871264228661bc122704b0974e4d9fdd mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume:1.0.8],SizeBytes:1159025,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:e3b8c20681593c21b344ad801fbb8abaf564427ee3a57a9fcfa3b455f917ce46 mcr.microsoft.com/oss/kubernetes/pause:3.4.1],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
... skipping 91 lines ...
/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:40
  [single-az]
  /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:44
    should receive FailedMount event with invalid mount options [kubernetes.io/azure-disk] [disk.csi.azure.com] [csi-azuredisk-scheduler-extender] [It]
    /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:269

    Unexpected error:
        <*errors.errorString | 0xc000ddc1d0>: {
            s: "PersistentVolume pvc-1a676212-0ad3-4630-9b1d-be5a839d44ee still exists within 10m0s",
        }
        PersistentVolume pvc-1a676212-0ad3-4630-9b1d-be5a839d44ee still exists within 10m0s
    occurred

... skipping 15 lines ...
STEP: setting up the StorageClass
STEP: creating a StorageClass 
STEP: setting up the PVC and PV
STEP: creating a PVC
STEP: setting up the pod
STEP: deploying the pod
STEP: checking that the pod's command exits with no error
Jun 13 23:14:07.666: INFO: Waiting up to 15m0s for pod "azuredisk-volume-tester-tqhst" in namespace "azuredisk-4299" to be "Succeeded or Failed"
Jun 13 23:14:07.775: INFO: Pod "azuredisk-volume-tester-tqhst": Phase="Pending", Reason="", readiness=false. Elapsed: 108.972573ms
Jun 13 23:14:09.884: INFO: Pod "azuredisk-volume-tester-tqhst": Phase="Pending", Reason="", readiness=false. Elapsed: 2.218158153s
Jun 13 23:14:11.995: INFO: Pod "azuredisk-volume-tester-tqhst": Phase="Pending", Reason="", readiness=false. Elapsed: 4.3290571s
Jun 13 23:14:14.104: INFO: Pod "azuredisk-volume-tester-tqhst": Phase="Pending", Reason="", readiness=false. Elapsed: 6.438074782s
Jun 13 23:14:16.215: INFO: Pod "azuredisk-volume-tester-tqhst": Phase="Pending", Reason="", readiness=false. Elapsed: 8.548487789s
Jun 13 23:14:18.324: INFO: Pod "azuredisk-volume-tester-tqhst": Phase="Pending", Reason="", readiness=false. Elapsed: 10.657418313s
... skipping 416 lines ...
Jun 13 23:28:58.577: INFO: Pod "azuredisk-volume-tester-tqhst": Phase="Pending", Reason="", readiness=false. Elapsed: 14m50.911193451s
Jun 13 23:29:00.689: INFO: Pod "azuredisk-volume-tester-tqhst": Phase="Pending", Reason="", readiness=false. Elapsed: 14m53.022213476s
Jun 13 23:29:02.799: INFO: Pod "azuredisk-volume-tester-tqhst": Phase="Pending", Reason="", readiness=false. Elapsed: 14m55.132352675s
Jun 13 23:29:04.911: INFO: Pod "azuredisk-volume-tester-tqhst": Phase="Pending", Reason="", readiness=false. Elapsed: 14m57.244249744s
Jun 13 23:29:07.022: INFO: Pod "azuredisk-volume-tester-tqhst": Phase="Pending", Reason="", readiness=false. Elapsed: 14m59.355715653s
Jun 13 23:29:09.024: INFO: deleting Pod "azuredisk-4299"/"azuredisk-volume-tester-tqhst"
Jun 13 23:29:09.163: INFO: Error getting logs for pod azuredisk-volume-tester-tqhst: the server rejected our request for an unknown reason (get pods azuredisk-volume-tester-tqhst)
STEP: Deleting pod azuredisk-volume-tester-tqhst in namespace azuredisk-4299
STEP: validating provisioned PV
STEP: checking the PV
Jun 13 23:29:09.495: INFO: deleting PVC "azuredisk-4299"/"pvc-v2bbs"
Jun 13 23:29:09.495: INFO: Deleting PersistentVolumeClaim "pvc-v2bbs"
STEP: waiting for claim's PV "pvc-9bd708e0-98b6-4fc1-91b9-c4f4e2ca62ca" to be deleted
... skipping 122 lines ...
Jun 13 23:39:13.067: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for azuredisk-volume-tester-tqhst: { } Scheduled: Successfully assigned azuredisk-4299/azuredisk-volume-tester-tqhst to k8s-agentpool1-21748613-1
Jun 13 23:39:13.067: INFO: At 2022-06-13 23:14:07 +0000 UTC - event for pvc-v2bbs: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "disk.csi.azure.com" or manually created by system administrator
Jun 13 23:39:13.067: INFO: At 2022-06-13 23:14:07 +0000 UTC - event for pvc-v2bbs: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding
Jun 13 23:39:13.067: INFO: At 2022-06-13 23:14:07 +0000 UTC - event for pvc-v2bbs: {disk.csi.azure.com_k8s-agentpool1-21748613-0_28b70215-f943-4330-871f-8d56a7f0eb33 } Provisioning: External provisioner is provisioning volume for claim "azuredisk-4299/pvc-v2bbs"
Jun 13 23:39:13.067: INFO: At 2022-06-13 23:14:10 +0000 UTC - event for pvc-v2bbs: {disk.csi.azure.com_k8s-agentpool1-21748613-0_28b70215-f943-4330-871f-8d56a7f0eb33 } ProvisioningSucceeded: Successfully provisioned volume pvc-9bd708e0-98b6-4fc1-91b9-c4f4e2ca62ca
Jun 13 23:39:13.067: INFO: At 2022-06-13 23:14:12 +0000 UTC - event for azuredisk-volume-tester-tqhst: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-9bd708e0-98b6-4fc1-91b9-c4f4e2ca62ca" 
Jun 13 23:39:13.067: INFO: At 2022-06-13 23:16:12 +0000 UTC - event for azuredisk-volume-tester-tqhst: {kubelet k8s-agentpool1-21748613-1} FailedMapVolume: MapVolume.SetUpDevice failed for volume "pvc-9bd708e0-98b6-4fc1-91b9-c4f4e2ca62ca" : rpc error: code = DeadlineExceeded desc = context deadline exceeded
Jun 13 23:39:13.067: INFO: At 2022-06-13 23:16:13 +0000 UTC - event for azuredisk-volume-tester-tqhst: {kubelet k8s-agentpool1-21748613-1} FailedMount: Unable to attach or mount volumes: unmounted volumes=[test-volume-1], unattached volumes=[kube-api-access-t2724 test-volume-1]: timed out waiting for the condition
Jun 13 23:39:13.067: INFO: At 2022-06-13 23:18:28 +0000 UTC - event for azuredisk-volume-tester-tqhst: {kubelet k8s-agentpool1-21748613-1} FailedMount: Unable to attach or mount volumes: unmounted volumes=[test-volume-1], unattached volumes=[test-volume-1 kube-api-access-t2724]: timed out waiting for the condition
Jun 13 23:39:13.176: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Jun 13 23:39:13.176: INFO: 
Jun 13 23:39:13.394: INFO: 
Logging node info for node k8s-agentpool1-21748613-0
... skipping 92 lines ...
/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:40
  [single-az]
  /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:44
    should create a raw block volume on demand [kubernetes.io/azure-disk] [disk.csi.azure.com] [csi-azuredisk-scheduler-extender] [It]
    /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:306

    Unexpected error:
        <*errors.errorString | 0xc00050d100>: {
            s: "Gave up after waiting 15m0s for pod \"azuredisk-volume-tester-tqhst\" to be \"Succeeded or Failed\"",
        }
        Gave up after waiting 15m0s for pod "azuredisk-volume-tester-tqhst" to be "Succeeded or Failed"
    occurred

    /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pod.go:89
------------------------------
Dynamic Provisioning [single-az] 
  should create a volume on demand and mount it as readOnly in a pod [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows] [csi-azuredisk-scheduler-extender]
... skipping 11 lines ...
STEP: setting up the StorageClass
STEP: creating a StorageClass 
STEP: setting up the PVC and PV
STEP: creating a PVC
STEP: setting up the pod
STEP: deploying the pod
STEP: checking that the pod's command exits with an error
Jun 13 23:39:17.802: INFO: Waiting up to 10m0s for pod "azuredisk-volume-tester-djmxg" in namespace "azuredisk-5600" to be "Error status code"
Jun 13 23:39:17.911: INFO: Pod "azuredisk-volume-tester-djmxg": Phase="Pending", Reason="", readiness=false. Elapsed: 109.50282ms
Jun 13 23:39:20.022: INFO: Pod "azuredisk-volume-tester-djmxg": Phase="Pending", Reason="", readiness=false. Elapsed: 2.220183488s
Jun 13 23:39:22.134: INFO: Pod "azuredisk-volume-tester-djmxg": Phase="Pending", Reason="", readiness=false. Elapsed: 4.331988249s
Jun 13 23:39:24.243: INFO: Pod "azuredisk-volume-tester-djmxg": Phase="Pending", Reason="", readiness=false. Elapsed: 6.44176808s
Jun 13 23:39:26.354: INFO: Pod "azuredisk-volume-tester-djmxg": Phase="Pending", Reason="", readiness=false. Elapsed: 8.552130736s
Jun 13 23:39:28.464: INFO: Pod "azuredisk-volume-tester-djmxg": Phase="Pending", Reason="", readiness=false. Elapsed: 10.662094047s
... skipping 274 lines ...
Jun 13 23:49:09.010: INFO: Pod "azuredisk-volume-tester-djmxg": Phase="Pending", Reason="", readiness=false. Elapsed: 9m51.20838557s
Jun 13 23:49:11.120: INFO: Pod "azuredisk-volume-tester-djmxg": Phase="Pending", Reason="", readiness=false. Elapsed: 9m53.318812065s
Jun 13 23:49:13.231: INFO: Pod "azuredisk-volume-tester-djmxg": Phase="Pending", Reason="", readiness=false. Elapsed: 9m55.429231863s
Jun 13 23:49:15.341: INFO: Pod "azuredisk-volume-tester-djmxg": Phase="Pending", Reason="", readiness=false. Elapsed: 9m57.539849181s
Jun 13 23:49:17.453: INFO: Pod "azuredisk-volume-tester-djmxg": Phase="Pending", Reason="", readiness=false. Elapsed: 9m59.650864211s
Jun 13 23:49:19.453: INFO: deleting Pod "azuredisk-5600"/"azuredisk-volume-tester-djmxg"
Jun 13 23:49:19.597: INFO: Error getting logs for pod azuredisk-volume-tester-djmxg: the server rejected our request for an unknown reason (get pods azuredisk-volume-tester-djmxg)
STEP: Deleting pod azuredisk-volume-tester-djmxg in namespace azuredisk-5600
STEP: validating provisioned PV
STEP: checking the PV
Jun 13 23:49:19.927: INFO: deleting PVC "azuredisk-5600"/"pvc-chwsv"
Jun 13 23:49:19.927: INFO: Deleting PersistentVolumeClaim "pvc-chwsv"
STEP: waiting for claim's PV "pvc-770f592e-29c2-4a0f-ba44-54aea2c0b476" to be deleted
... skipping 123 lines ...
Jun 13 23:59:23.497: INFO: At 2022-06-13 23:39:17 +0000 UTC - event for pvc-chwsv: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "disk.csi.azure.com" or manually created by system administrator
Jun 13 23:59:23.497: INFO: At 2022-06-13 23:39:17 +0000 UTC - event for pvc-chwsv: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding
Jun 13 23:59:23.497: INFO: At 2022-06-13 23:39:17 +0000 UTC - event for pvc-chwsv: {disk.csi.azure.com_k8s-agentpool1-21748613-0_28b70215-f943-4330-871f-8d56a7f0eb33 } Provisioning: External provisioner is provisioning volume for claim "azuredisk-5600/pvc-chwsv"
Jun 13 23:59:23.497: INFO: At 2022-06-13 23:39:20 +0000 UTC - event for pvc-chwsv: {disk.csi.azure.com_k8s-agentpool1-21748613-0_28b70215-f943-4330-871f-8d56a7f0eb33 } ProvisioningSucceeded: Successfully provisioned volume pvc-770f592e-29c2-4a0f-ba44-54aea2c0b476
Jun 13 23:59:23.497: INFO: At 2022-06-13 23:39:22 +0000 UTC - event for azuredisk-volume-tester-djmxg: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-770f592e-29c2-4a0f-ba44-54aea2c0b476" 
Jun 13 23:59:23.497: INFO: At 2022-06-13 23:41:23 +0000 UTC - event for azuredisk-volume-tester-djmxg: {kubelet k8s-agentpool1-21748613-0} FailedMount: Unable to attach or mount volumes: unmounted volumes=[test-volume-1], unattached volumes=[test-volume-1 kube-api-access-xwhnm]: timed out waiting for the condition
Jun 13 23:59:23.497: INFO: At 2022-06-13 23:41:26 +0000 UTC - event for azuredisk-volume-tester-djmxg: {kubelet k8s-agentpool1-21748613-0} FailedMount: MountVolume.MountDevice failed for volume "pvc-770f592e-29c2-4a0f-ba44-54aea2c0b476" : rpc error: code = DeadlineExceeded desc = context deadline exceeded
Jun 13 23:59:23.497: INFO: At 2022-06-13 23:50:31 +0000 UTC - event for azuredisk-volume-tester-djmxg: {kubelet k8s-agentpool1-21748613-0} FailedMount: Unable to attach or mount volumes: unmounted volumes=[test-volume-1], unattached volumes=[kube-api-access-xwhnm test-volume-1]: timed out waiting for the condition
Jun 13 23:59:23.607: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Jun 13 23:59:23.607: INFO: 
Jun 13 23:59:23.825: INFO: 
Logging node info for node k8s-agentpool1-21748613-0
Jun 13 23:59:23.935: INFO: Node Info: &Node{ObjectMeta:{k8s-agentpool1-21748613-0    fa68479d-f6ae-468f-a3ed-be7981963e75 19931 0 2022-06-13 22:24:59 +0000 UTC <nil> <nil> map[agentpool:agentpool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_DS2_v2 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westeurope failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-fpcu74iw kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:k8s-agentpool1-21748613-0 kubernetes.io/os:linux kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_DS2_v2 storageprofile:managed storagetier:Premium_LRS topology.disk.csi.azure.com/zone: topology.kubernetes.io/region:westeurope topology.kubernetes.io/zone:0] map[csi.volume.kubernetes.io/nodeid:{"disk.csi.azure.com":"k8s-agentpool1-21748613-0"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  [{kubelet Update v1 2022-06-13 22:24:59 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubectl-label Update v1 2022-06-13 22:25:06 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}} } {kube-controller-manager Update v1 2022-06-13 22:25:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}} } {kubelet Update v1 2022-06-13 23:51:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.disk.csi.azure.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {kube-controller-manager Update v1 2022-06-13 23:58:59 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-fpcu74iw/providers/Microsoft.Compute/virtualMachines/k8s-agentpool1-21748613-0,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{31036686336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7287771136 0} {<nil>} 7116964Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{27933017657 0} {<nil>} 27933017657 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{6501339136 0} {<nil>} 6348964Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-13 22:25:34 +0000 UTC,LastTransitionTime:2022-06-13 22:25:34 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-13 23:56:58 +0000 UTC,LastTransitionTime:2022-06-13 22:24:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-13 23:56:58 +0000 UTC,LastTransitionTime:2022-06-13 22:24:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-13 23:56:58 +0000 UTC,LastTransitionTime:2022-06-13 22:24:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-13 23:56:58 +0000 UTC,LastTransitionTime:2022-06-13 22:25:13 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:k8s-agentpool1-21748613-0,},NodeAddress{Type:InternalIP,Address:10.240.0.5,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a70924ba292b40ada44db0c707163fc1,SystemUUID:6d4ba5a8-f967-1544-a7fc-cdcf3ad6c2bf,BootID:91c2fb2a-52f5-435f-890c-b7e7b55e3fd3,KernelVersion:5.4.0-1074-azure,OSImage:Ubuntu 18.04.6 LTS,ContainerRuntimeVersion:docker://20.10.11+azure-3,KubeletVersion:v1.23.7,KubeProxyVersion:v1.23.7,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/azuredisk-csi@sha256:423eb6cf602c064c8b2deefead5ceadd6324ed41b3d995dab5d0f6f0f4d4710f mcr.microsoft.com/oss/kubernetes-csi/azuredisk-csi:v1.10.0],SizeBytes:245959792,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/azurefile-csi@sha256:9e2ecabcf9dd9943e6600eb9fb460f45b4dc61af7cabe95d115082a029db2aaf mcr.microsoft.com/oss/kubernetes-csi/azurefile-csi:v1.9.0],SizeBytes:230470852,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/azure-npm@sha256:106f669f48e5e80c4ec0afb49858ead72cf4b901cd8664e7bf81f8d789e56e12 mcr.microsoft.com/containernetworking/azure-npm:v1.2.2_hotfix],SizeBytes:175230380,},ContainerImage{Names:[k8sprow.azurecr.io/azuredisk-csi@sha256:1c927d283c1beb5dfb8fd9bb39197190d8feddb8c672986361c22a216168b5a7 k8sprow.azurecr.io/azuredisk-csi:latest-v2-c117aa793cbdc4445c2959c60f3a5bcf7a2aaacb],SizeBytes:136456062,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver@sha256:c0d040a1c4fbfceb65663e31c09ea40f4f78e356437610cbc3fbb4bb409bd6f1 mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver:v0.0.19],SizeBytes:123229697,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:0c890e918d42c158fab68867bade2ab1db04c3408452db9611a264ba3e43e6b3 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.23.7],SizeBytes:112296063,},ContainerImage{Names:[mcr.microsoft.com/oss/azure/secrets-store/provider-azure@sha256:6f67f3d0c7cdde5702f8ce7f101b6519daa0237f0c34fecb7c058b6af8c22ad1 mcr.microsoft.com/oss/azure/secrets-store/provider-azure:0.0.12],SizeBytes:101061355,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:6f0c680d375c62e74351f8ff3ed6ddb9b72ca759e0645c329b95f64264654a6d mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.22.1],SizeBytes:99962810,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-addon-manager@sha256:32e2836018c96e73533bd4642fe438e465b81dcbfa8b7b61935a6f4d0246c7ae mcr.microsoft.com/oss/kubernetes/kube-addon-manager:v9.1.3],SizeBytes:86832059,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-addon-manager@sha256:92c2c5aad9012ee32d2a43a74966cc0adc6ccb1705ad15abb10485ecf406d88b mcr.microsoft.com/oss/kubernetes/kube-addon-manager:v9.1.5],SizeBytes:84094027,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/metrics-server@sha256:1ef9d57ce41ffcc328b92494c3bfafe401e0b9a1694a295301a1385337d52815 mcr.microsoft.com/oss/kubernetes/metrics-server:v0.5.2],SizeBytes:64327621,},ContainerImage{Names:[mcr.microsoft.com/oss/nvidia/k8s-device-plugin@sha256:0f5b52bf28239234e831697d96db63ac03cde70fe68058f964504ab7564ee810 mcr.microsoft.com/oss/nvidia/k8s-device-plugin:1.0.0-beta6],SizeBytes:64160241,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner@sha256:542c9258a1441e4927883ea73425e21f9a14043a649686bf6b51700f34c64f8e mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner:v3.1.0],SizeBytes:57858438,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner@sha256:e9ddadc44ba87a4a27f67e54760a14f9986885b534b3dff170a14eae1e35d213 mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner:v3.0.0],SizeBytes:56881280,},ContainerImage{Names:[k8sprow.azurecr.io/azdiskschedulerextender-csi@sha256:070683970ab8a72265d998412367c05c407c2c5c64334210318b1bf4905c581d k8sprow.azurecr.io/azdiskschedulerextender-csi:latest-v2-c117aa793cbdc4445c2959c60f3a5bcf7a2aaacb],SizeBytes:56760067,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-resizer@sha256:ab6c2e18a4d943f2bf8688e1779622277a1d14c355c9d4bfc0d761d86c5108b3 mcr.microsoft.com/oss/kubernetes-csi/csi-resizer:v1.4.0],SizeBytes:55577322,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter@sha256:a889e925e15f9423f7842f1b769f64cbcf6a20b6956122836fc835cf22d9073f mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter:v5.0.1],SizeBytes:55314459,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-attacher@sha256:19fbca01394f7ed80151731180cfde0a3367f038beae2a97cda7928034010057 mcr.microsoft.com/oss/kubernetes-csi/csi-attacher:v3.4.0],SizeBytes:54954134,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-resizer@sha256:c5bb71ceaac60b1a4b58739fa07b709f6248c452ff6272a384d2f7648895a750 mcr.microsoft.com/oss/kubernetes-csi/csi-resizer:v1.3.0],SizeBytes:54313772,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter@sha256:61849a026511cf332c87d73d0a7aed803b510c3ede197ec755389686d490de72 mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter:v4.2.1],SizeBytes:54210936,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-attacher@sha256:6b41e7153ebdfdc1501aa65184624bc15fd33a52d93f88ec3a758d0f8c9b8c10 mcr.microsoft.com/oss/kubernetes-csi/csi-attacher:v3.3.0],SizeBytes:53842561,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/snapshot-controller@sha256:8c3fc3c2667004ad6bbdf723bb64c5da66a5cb8b11d4ee59b67179b686223b13 mcr.microsoft.com/oss/kubernetes-csi/snapshot-controller:v5.0.1],SizeBytes:52732401,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/snapshot-controller@sha256:be5a8dc1f990828f653c77bd0a0f1bbd13197c3019f6e1d99d590389bac36705 mcr.microsoft.com/oss/kubernetes-csi/snapshot-controller:v4.2.1],SizeBytes:51575245,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager@sha256:0ad67f9919522a07318034641ae09bf2079b417e9944c65914410594ce645468 mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager:v1.1.4],SizeBytes:51478397,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager@sha256:31ec4f7daccd3e7a8504e12657d7830651ecacbe4a487daca1b1b7695a64b070 mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager:v1.23.1],SizeBytes:51249021,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:011712ed90fb8efcf27928b0a47ed04b98baebb31cb1b2d8ab676977ec18eedc mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v1.1.4],SizeBytes:50868093,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:0f9a8fbaed65192ed7dd795be4f9c1dc48ebdef0a241fb62d456f4bed40d9875 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v1.23.1],SizeBytes:50679677,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:c35f45e8dfaa30363e589296415a057f9d32813920fc3820d6557491657f199a mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.21.2],SizeBytes:50607491,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/ip-masq-agent@sha256:1244155f2ed3f33ff154cc343b8ad285f3391d95afd7d4b1c6dcc420bc0ba3cf mcr.microsoft.com/oss/kubernetes/ip-masq-agent:v2.5.0],SizeBytes:50146762,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager@sha256:7c907ff70b90a0bdf8fae63bd744018469dd9839cde1fd0515b93e0bbd14b34e mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager:v1.0.8],SizeBytes:48963453,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:3987d7a8c6922ce1952ee19c5cb6ea75aac7b7c1b07aa79277ad038c69fb7a31 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v1.0.8],SizeBytes:48349053,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/coredns@sha256:f873bf7f0928461efe10697fa76cf0ad7a1ae3041c5b57b50dd3d0b72d273f8c mcr.microsoft.com/oss/kubernetes/coredns:1.8.6],SizeBytes:46804601,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager@sha256:8073113a20882642a980b338635cdc5945e5673a18aef192090e6fde2b89a75c mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager:v0.6.0],SizeBytes:45909032,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:6a32329628bdea3c6d75e98aad6155b65d2e2b98ca616eb33f9ac562912804c6 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.6.0],SizeBytes:45229096,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager@sha256:ef6c4ba564b4d11d270f7d1563c50fbeb30ccc3b94146e5059228c49f95875f5 mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager:v0.7.11],SizeBytes:44916605,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:dbcc384758ba5ca6d249596d471292ed3785e31cdb854d48b84d70794b669b4c mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.7.11],SizeBytes:43679613,},ContainerImage{Names:[mcr.microsoft.com/oss/etcd-io/etcd@sha256:cf587862e3f1b6fa4d9a2565520a34f164bdf72c50f37af8c3c668160593246e mcr.microsoft.com/oss/etcd-io/etcd:v3.3.25],SizeBytes:41832119,},ContainerImage{Names:[mcr.microsoft.com/k8s/aad-pod-identity/mic@sha256:bd9465be94966b9a917e1e3904fa5e63dd91772ccadf304e18ffd8e4ad8ccedd mcr.microsoft.com/k8s/aad-pod-identity/mic:1.6.1],SizeBytes:41374894,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-proportional-autoscaler@sha256:c849d75d61943ce7f51b4c049f1a79d19a08253966c8f49c4cfb6414cc33db8b mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-proportional-autoscaler:1.8.5],SizeBytes:40661903,},ContainerImage{Names:[mcr.microsoft.com/k8s/aad-pod-identity/nmi@sha256:02128fefcdb7593ac53fc342e2c53a0fc6fabd813036bf60457bf43cc2940116 mcr.microsoft.com/k8s/aad-pod-identity/nmi:1.6.1],SizeBytes:38007982,},ContainerImage{Names:[mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume@sha256:921f301c44dda06a325164accf22e78ecc570b5c7d9d6ee4c66bd8cbb2b60b9a mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume:v0.0.16],SizeBytes:26970670,},ContainerImage{Names:[mcr.microsoft.com/k8s/kms/keyvault@sha256:1a27e175f8c125209e32d2957b5509fe20757bd8cb309ff9da598799b56326fb mcr.microsoft.com/k8s/kms/keyvault:v0.0.10],SizeBytes:23077387,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:dbec3a8166686b09b242176ab5b99e993da4126438bbce68147c3fd654f35662 mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v2.4.0],SizeBytes:19547289,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:c96a6255c42766f6b8bb1a7cda02b0060ab1b20b2e2dafcc64ec09e7646745a6 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.5.0],SizeBytes:17573341,},ContainerImage{Names:[mcr.microsoft.com/oss/busybox/busybox@sha256:582a641242b49809af3a1a522f9aae8c3f047d1c6ca1dd9d8cdabd349e45b1a9 mcr.microsoft.com/oss/busybox/busybox:1.33.1],SizeBytes:1235829,},ContainerImage{Names:[mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume@sha256:23d8c6033f02a1ecad05127ebdc931bb871264228661bc122704b0974e4d9fdd mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume:1.0.8],SizeBytes:1159025,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:e3b8c20681593c21b344ad801fbb8abaf564427ee3a57a9fcfa3b455f917ce46 mcr.microsoft.com/oss/kubernetes/pause:3.4.1],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/disk.csi.azure.com^/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-fpcu74iw/providers/Microsoft.Compute/disks/pvc-1a676212-0ad3-4630-9b1d-be5a839d44ee,DevicePath:,},},Config:nil,},}
... skipping 91 lines ...
/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:40
  [single-az]
  /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:44
    should create a volume on demand and mount it as readOnly in a pod [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows] [csi-azuredisk-scheduler-extender] [It]
    /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:338

    Unexpected error:
        <*errors.errorString | 0xc0003214b0>: {
            s: "Gave up after waiting 10m0s for pod \"azuredisk-volume-tester-djmxg\" to be \"Error status code\"",
        }
        Gave up after waiting 10m0s for pod "azuredisk-volume-tester-djmxg" to be "Error status code"
    occurred

    /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pod.go:114
------------------------------
Dynamic Provisioning [single-az] 
  should create multiple PV objects, bind to PVCs and attach all to different pods on the same node [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows] [csi-azuredisk-scheduler-extender]
... skipping 13 lines ...
STEP: setting up the PVC and PV
STEP: creating a PVC
STEP: setting up the pod
STEP: deploying the pod
STEP: checking that the pod is running
Jun 14 00:14:28.437: INFO: deleting Pod "azuredisk-6055"/"azuredisk-volume-tester-z7zhl"
Jun 14 00:14:28.579: INFO: Error getting logs for pod azuredisk-volume-tester-z7zhl: the server rejected our request for an unknown reason (get pods azuredisk-volume-tester-z7zhl)
STEP: Deleting pod azuredisk-volume-tester-z7zhl in namespace azuredisk-6055
STEP: validating provisioned PV
STEP: checking the PV
Jun 14 00:14:28.907: INFO: deleting PVC "azuredisk-6055"/"pvc-sxn5z"
Jun 14 00:14:28.907: INFO: Deleting PersistentVolumeClaim "pvc-sxn5z"
STEP: waiting for claim's PV "pvc-7f3c5498-361f-43e5-99cd-8ed6da557db0" to be deleted
... skipping 123 lines ...
Jun 14 00:24:32.345: INFO: At 2022-06-13 23:59:27 +0000 UTC - event for pvc-sxn5z: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding
Jun 14 00:24:32.345: INFO: At 2022-06-13 23:59:28 +0000 UTC - event for pvc-sxn5z: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "disk.csi.azure.com" or manually created by system administrator
Jun 14 00:24:32.345: INFO: At 2022-06-13 23:59:28 +0000 UTC - event for pvc-sxn5z: {disk.csi.azure.com_k8s-agentpool1-21748613-0_28b70215-f943-4330-871f-8d56a7f0eb33 } Provisioning: External provisioner is provisioning volume for claim "azuredisk-6055/pvc-sxn5z"
Jun 14 00:24:32.345: INFO: At 2022-06-13 23:59:30 +0000 UTC - event for pvc-sxn5z: {disk.csi.azure.com_k8s-agentpool1-21748613-0_28b70215-f943-4330-871f-8d56a7f0eb33 } ProvisioningSucceeded: Successfully provisioned volume pvc-7f3c5498-361f-43e5-99cd-8ed6da557db0
Jun 14 00:24:32.345: INFO: At 2022-06-13 23:59:32 +0000 UTC - event for azuredisk-volume-tester-z7zhl: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-7f3c5498-361f-43e5-99cd-8ed6da557db0" 
Jun 14 00:24:32.345: INFO: At 2022-06-14 00:01:34 +0000 UTC - event for azuredisk-volume-tester-z7zhl: {kubelet k8s-agentpool1-21748613-1} FailedMount: Unable to attach or mount volumes: unmounted volumes=[test-volume-1], unattached volumes=[test-volume-1 kube-api-access-rf492]: timed out waiting for the condition
Jun 14 00:24:32.345: INFO: At 2022-06-14 00:01:38 +0000 UTC - event for azuredisk-volume-tester-z7zhl: {kubelet k8s-agentpool1-21748613-1} FailedMount: MountVolume.MountDevice failed for volume "pvc-7f3c5498-361f-43e5-99cd-8ed6da557db0" : rpc error: code = DeadlineExceeded desc = context deadline exceeded
Jun 14 00:24:32.346: INFO: At 2022-06-14 00:03:48 +0000 UTC - event for azuredisk-volume-tester-z7zhl: {kubelet k8s-agentpool1-21748613-1} FailedMount: Unable to attach or mount volumes: unmounted volumes=[test-volume-1], unattached volumes=[kube-api-access-rf492 test-volume-1]: timed out waiting for the condition
Jun 14 00:24:32.346: INFO: At 2022-06-14 00:09:46 +0000 UTC - event for azuredisk-volume-tester-z7zhl: {kubelet k8s-agentpool1-21748613-1} FailedMount: MountVolume.MountDevice failed for volume "pvc-7f3c5498-361f-43e5-99cd-8ed6da557db0" : rpc error: code = Internal desc = failed to wait for volume (/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-fpcu74iw/providers/Microsoft.Compute/disks/pvc-7f3c5498-361f-43e5-99cd-8ed6da557db0) to be attached to node (k8s-agentpool1-21748613-1): context deadline exceeded
Jun 14 00:24:32.453: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Jun 14 00:24:32.453: INFO: 
Jun 14 00:24:32.669: INFO: 
Logging node info for node k8s-agentpool1-21748613-0
Jun 14 00:24:32.777: INFO: Node Info: &Node{ObjectMeta:{k8s-agentpool1-21748613-0    fa68479d-f6ae-468f-a3ed-be7981963e75 25503 0 2022-06-13 22:24:59 +0000 UTC <nil> <nil> map[agentpool:agentpool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_DS2_v2 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westeurope failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-fpcu74iw kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:k8s-agentpool1-21748613-0 kubernetes.io/os:linux kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_DS2_v2 storageprofile:managed storagetier:Premium_LRS topology.disk.csi.azure.com/zone: topology.kubernetes.io/region:westeurope topology.kubernetes.io/zone:0] map[csi.volume.kubernetes.io/nodeid:{"disk.csi.azure.com":"k8s-agentpool1-21748613-0"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  [{kubelet Update v1 2022-06-13 22:24:59 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubectl-label Update v1 2022-06-13 22:25:06 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}} } {kube-controller-manager Update v1 2022-06-13 22:25:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}} } {kubelet Update v1 2022-06-13 23:51:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.disk.csi.azure.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {kube-controller-manager Update v1 2022-06-14 00:01:02 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-fpcu74iw/providers/Microsoft.Compute/virtualMachines/k8s-agentpool1-21748613-0,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{31036686336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7287771136 0} {<nil>} 7116964Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{27933017657 0} {<nil>} 27933017657 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{6501339136 0} {<nil>} 6348964Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-13 22:25:34 +0000 UTC,LastTransitionTime:2022-06-13 22:25:34 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-14 00:22:31 +0000 UTC,LastTransitionTime:2022-06-13 22:24:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-14 00:22:31 +0000 UTC,LastTransitionTime:2022-06-13 22:24:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-14 00:22:31 +0000 UTC,LastTransitionTime:2022-06-13 22:24:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-14 00:22:31 +0000 UTC,LastTransitionTime:2022-06-13 22:25:13 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:k8s-agentpool1-21748613-0,},NodeAddress{Type:InternalIP,Address:10.240.0.5,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a70924ba292b40ada44db0c707163fc1,SystemUUID:6d4ba5a8-f967-1544-a7fc-cdcf3ad6c2bf,BootID:91c2fb2a-52f5-435f-890c-b7e7b55e3fd3,KernelVersion:5.4.0-1074-azure,OSImage:Ubuntu 18.04.6 LTS,ContainerRuntimeVersion:docker://20.10.11+azure-3,KubeletVersion:v1.23.7,KubeProxyVersion:v1.23.7,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/azuredisk-csi@sha256:423eb6cf602c064c8b2deefead5ceadd6324ed41b3d995dab5d0f6f0f4d4710f mcr.microsoft.com/oss/kubernetes-csi/azuredisk-csi:v1.10.0],SizeBytes:245959792,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/azurefile-csi@sha256:9e2ecabcf9dd9943e6600eb9fb460f45b4dc61af7cabe95d115082a029db2aaf mcr.microsoft.com/oss/kubernetes-csi/azurefile-csi:v1.9.0],SizeBytes:230470852,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/azure-npm@sha256:106f669f48e5e80c4ec0afb49858ead72cf4b901cd8664e7bf81f8d789e56e12 mcr.microsoft.com/containernetworking/azure-npm:v1.2.2_hotfix],SizeBytes:175230380,},ContainerImage{Names:[k8sprow.azurecr.io/azuredisk-csi@sha256:1c927d283c1beb5dfb8fd9bb39197190d8feddb8c672986361c22a216168b5a7 k8sprow.azurecr.io/azuredisk-csi:latest-v2-c117aa793cbdc4445c2959c60f3a5bcf7a2aaacb],SizeBytes:136456062,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver@sha256:c0d040a1c4fbfceb65663e31c09ea40f4f78e356437610cbc3fbb4bb409bd6f1 mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver:v0.0.19],SizeBytes:123229697,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:0c890e918d42c158fab68867bade2ab1db04c3408452db9611a264ba3e43e6b3 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.23.7],SizeBytes:112296063,},ContainerImage{Names:[mcr.microsoft.com/oss/azure/secrets-store/provider-azure@sha256:6f67f3d0c7cdde5702f8ce7f101b6519daa0237f0c34fecb7c058b6af8c22ad1 mcr.microsoft.com/oss/azure/secrets-store/provider-azure:0.0.12],SizeBytes:101061355,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:6f0c680d375c62e74351f8ff3ed6ddb9b72ca759e0645c329b95f64264654a6d mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.22.1],SizeBytes:99962810,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-addon-manager@sha256:32e2836018c96e73533bd4642fe438e465b81dcbfa8b7b61935a6f4d0246c7ae mcr.microsoft.com/oss/kubernetes/kube-addon-manager:v9.1.3],SizeBytes:86832059,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-addon-manager@sha256:92c2c5aad9012ee32d2a43a74966cc0adc6ccb1705ad15abb10485ecf406d88b mcr.microsoft.com/oss/kubernetes/kube-addon-manager:v9.1.5],SizeBytes:84094027,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/metrics-server@sha256:1ef9d57ce41ffcc328b92494c3bfafe401e0b9a1694a295301a1385337d52815 mcr.microsoft.com/oss/kubernetes/metrics-server:v0.5.2],SizeBytes:64327621,},ContainerImage{Names:[mcr.microsoft.com/oss/nvidia/k8s-device-plugin@sha256:0f5b52bf28239234e831697d96db63ac03cde70fe68058f964504ab7564ee810 mcr.microsoft.com/oss/nvidia/k8s-device-plugin:1.0.0-beta6],SizeBytes:64160241,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner@sha256:542c9258a1441e4927883ea73425e21f9a14043a649686bf6b51700f34c64f8e mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner:v3.1.0],SizeBytes:57858438,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner@sha256:e9ddadc44ba87a4a27f67e54760a14f9986885b534b3dff170a14eae1e35d213 mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner:v3.0.0],SizeBytes:56881280,},ContainerImage{Names:[k8sprow.azurecr.io/azdiskschedulerextender-csi@sha256:070683970ab8a72265d998412367c05c407c2c5c64334210318b1bf4905c581d k8sprow.azurecr.io/azdiskschedulerextender-csi:latest-v2-c117aa793cbdc4445c2959c60f3a5bcf7a2aaacb],SizeBytes:56760067,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-resizer@sha256:ab6c2e18a4d943f2bf8688e1779622277a1d14c355c9d4bfc0d761d86c5108b3 mcr.microsoft.com/oss/kubernetes-csi/csi-resizer:v1.4.0],SizeBytes:55577322,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter@sha256:a889e925e15f9423f7842f1b769f64cbcf6a20b6956122836fc835cf22d9073f mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter:v5.0.1],SizeBytes:55314459,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-attacher@sha256:19fbca01394f7ed80151731180cfde0a3367f038beae2a97cda7928034010057 mcr.microsoft.com/oss/kubernetes-csi/csi-attacher:v3.4.0],SizeBytes:54954134,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-resizer@sha256:c5bb71ceaac60b1a4b58739fa07b709f6248c452ff6272a384d2f7648895a750 mcr.microsoft.com/oss/kubernetes-csi/csi-resizer:v1.3.0],SizeBytes:54313772,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter@sha256:61849a026511cf332c87d73d0a7aed803b510c3ede197ec755389686d490de72 mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter:v4.2.1],SizeBytes:54210936,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-attacher@sha256:6b41e7153ebdfdc1501aa65184624bc15fd33a52d93f88ec3a758d0f8c9b8c10 mcr.microsoft.com/oss/kubernetes-csi/csi-attacher:v3.3.0],SizeBytes:53842561,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/snapshot-controller@sha256:8c3fc3c2667004ad6bbdf723bb64c5da66a5cb8b11d4ee59b67179b686223b13 mcr.microsoft.com/oss/kubernetes-csi/snapshot-controller:v5.0.1],SizeBytes:52732401,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/snapshot-controller@sha256:be5a8dc1f990828f653c77bd0a0f1bbd13197c3019f6e1d99d590389bac36705 mcr.microsoft.com/oss/kubernetes-csi/snapshot-controller:v4.2.1],SizeBytes:51575245,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager@sha256:0ad67f9919522a07318034641ae09bf2079b417e9944c65914410594ce645468 mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager:v1.1.4],SizeBytes:51478397,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager@sha256:31ec4f7daccd3e7a8504e12657d7830651ecacbe4a487daca1b1b7695a64b070 mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager:v1.23.1],SizeBytes:51249021,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:011712ed90fb8efcf27928b0a47ed04b98baebb31cb1b2d8ab676977ec18eedc mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v1.1.4],SizeBytes:50868093,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:0f9a8fbaed65192ed7dd795be4f9c1dc48ebdef0a241fb62d456f4bed40d9875 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v1.23.1],SizeBytes:50679677,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:c35f45e8dfaa30363e589296415a057f9d32813920fc3820d6557491657f199a mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.21.2],SizeBytes:50607491,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/ip-masq-agent@sha256:1244155f2ed3f33ff154cc343b8ad285f3391d95afd7d4b1c6dcc420bc0ba3cf mcr.microsoft.com/oss/kubernetes/ip-masq-agent:v2.5.0],SizeBytes:50146762,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager@sha256:7c907ff70b90a0bdf8fae63bd744018469dd9839cde1fd0515b93e0bbd14b34e mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager:v1.0.8],SizeBytes:48963453,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:3987d7a8c6922ce1952ee19c5cb6ea75aac7b7c1b07aa79277ad038c69fb7a31 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v1.0.8],SizeBytes:48349053,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/coredns@sha256:f873bf7f0928461efe10697fa76cf0ad7a1ae3041c5b57b50dd3d0b72d273f8c mcr.microsoft.com/oss/kubernetes/coredns:1.8.6],SizeBytes:46804601,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager@sha256:8073113a20882642a980b338635cdc5945e5673a18aef192090e6fde2b89a75c mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager:v0.6.0],SizeBytes:45909032,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:6a32329628bdea3c6d75e98aad6155b65d2e2b98ca616eb33f9ac562912804c6 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.6.0],SizeBytes:45229096,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager@sha256:ef6c4ba564b4d11d270f7d1563c50fbeb30ccc3b94146e5059228c49f95875f5 mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager:v0.7.11],SizeBytes:44916605,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:dbcc384758ba5ca6d249596d471292ed3785e31cdb854d48b84d70794b669b4c mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.7.11],SizeBytes:43679613,},ContainerImage{Names:[mcr.microsoft.com/oss/etcd-io/etcd@sha256:cf587862e3f1b6fa4d9a2565520a34f164bdf72c50f37af8c3c668160593246e mcr.microsoft.com/oss/etcd-io/etcd:v3.3.25],SizeBytes:41832119,},ContainerImage{Names:[mcr.microsoft.com/k8s/aad-pod-identity/mic@sha256:bd9465be94966b9a917e1e3904fa5e63dd91772ccadf304e18ffd8e4ad8ccedd mcr.microsoft.com/k8s/aad-pod-identity/mic:1.6.1],SizeBytes:41374894,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-proportional-autoscaler@sha256:c849d75d61943ce7f51b4c049f1a79d19a08253966c8f49c4cfb6414cc33db8b mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-proportional-autoscaler:1.8.5],SizeBytes:40661903,},ContainerImage{Names:[mcr.microsoft.com/k8s/aad-pod-identity/nmi@sha256:02128fefcdb7593ac53fc342e2c53a0fc6fabd813036bf60457bf43cc2940116 mcr.microsoft.com/k8s/aad-pod-identity/nmi:1.6.1],SizeBytes:38007982,},ContainerImage{Names:[mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume@sha256:921f301c44dda06a325164accf22e78ecc570b5c7d9d6ee4c66bd8cbb2b60b9a mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume:v0.0.16],SizeBytes:26970670,},ContainerImage{Names:[mcr.microsoft.com/k8s/kms/keyvault@sha256:1a27e175f8c125209e32d2957b5509fe20757bd8cb309ff9da598799b56326fb mcr.microsoft.com/k8s/kms/keyvault:v0.0.10],SizeBytes:23077387,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:dbec3a8166686b09b242176ab5b99e993da4126438bbce68147c3fd654f35662 mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v2.4.0],SizeBytes:19547289,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:c96a6255c42766f6b8bb1a7cda02b0060ab1b20b2e2dafcc64ec09e7646745a6 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.5.0],SizeBytes:17573341,},ContainerImage{Names:[mcr.microsoft.com/oss/busybox/busybox@sha256:582a641242b49809af3a1a522f9aae8c3f047d1c6ca1dd9d8cdabd349e45b1a9 mcr.microsoft.com/oss/busybox/busybox:1.33.1],SizeBytes:1235829,},ContainerImage{Names:[mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume@sha256:23d8c6033f02a1ecad05127ebdc931bb871264228661bc122704b0974e4d9fdd mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume:1.0.8],SizeBytes:1159025,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:e3b8c20681593c21b344ad801fbb8abaf564427ee3a57a9fcfa3b455f917ce46 mcr.microsoft.com/oss/kubernetes/pause:3.4.1],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/disk.csi.azure.com^/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-fpcu74iw/providers/Microsoft.Compute/disks/pvc-1a676212-0ad3-4630-9b1d-be5a839d44ee,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/disk.csi.azure.com^/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-fpcu74iw/providers/Microsoft.Compute/disks/pvc-770f592e-29c2-4a0f-ba44-54aea2c0b476,DevicePath:,},},Config:nil,},}
Jun 14 00:24:32.778: INFO: 
... skipping 90 lines ...
/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:40
  [single-az]
  /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:44
    should create multiple PV objects, bind to PVCs and attach all to different pods on the same node [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows] [csi-azuredisk-scheduler-extender] [It]
    /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:372

    Unexpected error:
        <*errors.errorString | 0xc000321250>: {
            s: "timed out waiting for the condition",
        }
        timed out waiting for the condition
    occurred

... skipping 304 lines ...
Jun 14 00:39:41.179: INFO: At 2022-06-14 00:24:37 +0000 UTC - event for azuredisk-volume-tester-4rj7k-8b7985f7c: {replicaset-controller } SuccessfulCreate: Created pod: azuredisk-volume-tester-4rj7k-8b7985f7c-vvfgl
Jun 14 00:39:41.179: INFO: At 2022-06-14 00:24:37 +0000 UTC - event for pvc-sl8hk: {disk.csi.azure.com_k8s-agentpool1-21748613-0_28b70215-f943-4330-871f-8d56a7f0eb33 } Provisioning: External provisioner is provisioning volume for claim "azuredisk-5144/pvc-sl8hk"
Jun 14 00:39:41.179: INFO: At 2022-06-14 00:24:37 +0000 UTC - event for pvc-sl8hk: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "disk.csi.azure.com" or manually created by system administrator
Jun 14 00:39:41.179: INFO: At 2022-06-14 00:24:40 +0000 UTC - event for pvc-sl8hk: {disk.csi.azure.com_k8s-agentpool1-21748613-0_28b70215-f943-4330-871f-8d56a7f0eb33 } ProvisioningSucceeded: Successfully provisioned volume pvc-44985f67-a552-4cb1-a56e-6ae87b397dca
Jun 14 00:39:41.179: INFO: At 2022-06-14 00:24:42 +0000 UTC - event for azuredisk-volume-tester-4rj7k-8b7985f7c-vvfgl: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-44985f67-a552-4cb1-a56e-6ae87b397dca" 
Jun 14 00:39:41.179: INFO: At 2022-06-14 00:26:44 +0000 UTC - event for azuredisk-volume-tester-4rj7k-8b7985f7c-vvfgl: {kubelet k8s-agentpool1-21748613-0} FailedMount: Unable to attach or mount volumes: unmounted volumes=[test-volume-1], unattached volumes=[test-volume-1 kube-api-access-k4rsr]: timed out waiting for the condition
Jun 14 00:39:41.179: INFO: At 2022-06-14 00:26:44 +0000 UTC - event for azuredisk-volume-tester-4rj7k-8b7985f7c-vvfgl: {kubelet k8s-agentpool1-21748613-0} FailedMount: MountVolume.MountDevice failed for volume "pvc-44985f67-a552-4cb1-a56e-6ae87b397dca" : rpc error: code = DeadlineExceeded desc = context deadline exceeded
Jun 14 00:39:41.287: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Jun 14 00:39:41.287: INFO: 
Jun 14 00:39:41.503: INFO: 
Logging node info for node k8s-agentpool1-21748613-0
Jun 14 00:39:41.612: INFO: Node Info: &Node{ObjectMeta:{k8s-agentpool1-21748613-0    fa68479d-f6ae-468f-a3ed-be7981963e75 28762 0 2022-06-13 22:24:59 +0000 UTC <nil> <nil> map[agentpool:agentpool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_DS2_v2 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westeurope failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-fpcu74iw kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:k8s-agentpool1-21748613-0 kubernetes.io/os:linux kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_DS2_v2 storageprofile:managed storagetier:Premium_LRS topology.disk.csi.azure.com/zone: topology.kubernetes.io/region:westeurope topology.kubernetes.io/zone:0] map[csi.volume.kubernetes.io/nodeid:{"disk.csi.azure.com":"k8s-agentpool1-21748613-0"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  [{kubelet Update v1 2022-06-13 22:24:59 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubectl-label Update v1 2022-06-13 22:25:06 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}} } {kube-controller-manager Update v1 2022-06-13 22:25:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-06-14 00:01:02 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2022-06-14 00:32:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.disk.csi.azure.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-fpcu74iw/providers/Microsoft.Compute/virtualMachines/k8s-agentpool1-21748613-0,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{31036686336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7287771136 0} {<nil>} 7116964Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{27933017657 0} {<nil>} 27933017657 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{6501339136 0} {<nil>} 6348964Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-13 22:25:34 +0000 UTC,LastTransitionTime:2022-06-13 22:25:34 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-14 00:38:02 +0000 UTC,LastTransitionTime:2022-06-13 22:24:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-14 00:38:02 +0000 UTC,LastTransitionTime:2022-06-13 22:24:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-14 00:38:02 +0000 UTC,LastTransitionTime:2022-06-13 22:24:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-14 00:38:02 +0000 UTC,LastTransitionTime:2022-06-13 22:25:13 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:k8s-agentpool1-21748613-0,},NodeAddress{Type:InternalIP,Address:10.240.0.5,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a70924ba292b40ada44db0c707163fc1,SystemUUID:6d4ba5a8-f967-1544-a7fc-cdcf3ad6c2bf,BootID:91c2fb2a-52f5-435f-890c-b7e7b55e3fd3,KernelVersion:5.4.0-1074-azure,OSImage:Ubuntu 18.04.6 LTS,ContainerRuntimeVersion:docker://20.10.11+azure-3,KubeletVersion:v1.23.7,KubeProxyVersion:v1.23.7,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/azuredisk-csi@sha256:423eb6cf602c064c8b2deefead5ceadd6324ed41b3d995dab5d0f6f0f4d4710f mcr.microsoft.com/oss/kubernetes-csi/azuredisk-csi:v1.10.0],SizeBytes:245959792,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/azurefile-csi@sha256:9e2ecabcf9dd9943e6600eb9fb460f45b4dc61af7cabe95d115082a029db2aaf mcr.microsoft.com/oss/kubernetes-csi/azurefile-csi:v1.9.0],SizeBytes:230470852,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/azure-npm@sha256:106f669f48e5e80c4ec0afb49858ead72cf4b901cd8664e7bf81f8d789e56e12 mcr.microsoft.com/containernetworking/azure-npm:v1.2.2_hotfix],SizeBytes:175230380,},ContainerImage{Names:[k8sprow.azurecr.io/azuredisk-csi@sha256:1c927d283c1beb5dfb8fd9bb39197190d8feddb8c672986361c22a216168b5a7 k8sprow.azurecr.io/azuredisk-csi:latest-v2-c117aa793cbdc4445c2959c60f3a5bcf7a2aaacb],SizeBytes:136456062,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver@sha256:c0d040a1c4fbfceb65663e31c09ea40f4f78e356437610cbc3fbb4bb409bd6f1 mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver:v0.0.19],SizeBytes:123229697,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:0c890e918d42c158fab68867bade2ab1db04c3408452db9611a264ba3e43e6b3 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.23.7],SizeBytes:112296063,},ContainerImage{Names:[mcr.microsoft.com/oss/azure/secrets-store/provider-azure@sha256:6f67f3d0c7cdde5702f8ce7f101b6519daa0237f0c34fecb7c058b6af8c22ad1 mcr.microsoft.com/oss/azure/secrets-store/provider-azure:0.0.12],SizeBytes:101061355,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:6f0c680d375c62e74351f8ff3ed6ddb9b72ca759e0645c329b95f64264654a6d mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.22.1],SizeBytes:99962810,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-addon-manager@sha256:32e2836018c96e73533bd4642fe438e465b81dcbfa8b7b61935a6f4d0246c7ae mcr.microsoft.com/oss/kubernetes/kube-addon-manager:v9.1.3],SizeBytes:86832059,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-addon-manager@sha256:92c2c5aad9012ee32d2a43a74966cc0adc6ccb1705ad15abb10485ecf406d88b mcr.microsoft.com/oss/kubernetes/kube-addon-manager:v9.1.5],SizeBytes:84094027,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/metrics-server@sha256:1ef9d57ce41ffcc328b92494c3bfafe401e0b9a1694a295301a1385337d52815 mcr.microsoft.com/oss/kubernetes/metrics-server:v0.5.2],SizeBytes:64327621,},ContainerImage{Names:[mcr.microsoft.com/oss/nvidia/k8s-device-plugin@sha256:0f5b52bf28239234e831697d96db63ac03cde70fe68058f964504ab7564ee810 mcr.microsoft.com/oss/nvidia/k8s-device-plugin:1.0.0-beta6],SizeBytes:64160241,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner@sha256:542c9258a1441e4927883ea73425e21f9a14043a649686bf6b51700f34c64f8e mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner:v3.1.0],SizeBytes:57858438,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner@sha256:e9ddadc44ba87a4a27f67e54760a14f9986885b534b3dff170a14eae1e35d213 mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner:v3.0.0],SizeBytes:56881280,},ContainerImage{Names:[k8sprow.azurecr.io/azdiskschedulerextender-csi@sha256:070683970ab8a72265d998412367c05c407c2c5c64334210318b1bf4905c581d k8sprow.azurecr.io/azdiskschedulerextender-csi:latest-v2-c117aa793cbdc4445c2959c60f3a5bcf7a2aaacb],SizeBytes:56760067,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-resizer@sha256:ab6c2e18a4d943f2bf8688e1779622277a1d14c355c9d4bfc0d761d86c5108b3 mcr.microsoft.com/oss/kubernetes-csi/csi-resizer:v1.4.0],SizeBytes:55577322,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter@sha256:a889e925e15f9423f7842f1b769f64cbcf6a20b6956122836fc835cf22d9073f mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter:v5.0.1],SizeBytes:55314459,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-attacher@sha256:19fbca01394f7ed80151731180cfde0a3367f038beae2a97cda7928034010057 mcr.microsoft.com/oss/kubernetes-csi/csi-attacher:v3.4.0],SizeBytes:54954134,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-resizer@sha256:c5bb71ceaac60b1a4b58739fa07b709f6248c452ff6272a384d2f7648895a750 mcr.microsoft.com/oss/kubernetes-csi/csi-resizer:v1.3.0],SizeBytes:54313772,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter@sha256:61849a026511cf332c87d73d0a7aed803b510c3ede197ec755389686d490de72 mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter:v4.2.1],SizeBytes:54210936,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-attacher@sha256:6b41e7153ebdfdc1501aa65184624bc15fd33a52d93f88ec3a758d0f8c9b8c10 mcr.microsoft.com/oss/kubernetes-csi/csi-attacher:v3.3.0],SizeBytes:53842561,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/snapshot-controller@sha256:8c3fc3c2667004ad6bbdf723bb64c5da66a5cb8b11d4ee59b67179b686223b13 mcr.microsoft.com/oss/kubernetes-csi/snapshot-controller:v5.0.1],SizeBytes:52732401,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/snapshot-controller@sha256:be5a8dc1f990828f653c77bd0a0f1bbd13197c3019f6e1d99d590389bac36705 mcr.microsoft.com/oss/kubernetes-csi/snapshot-controller:v4.2.1],SizeBytes:51575245,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager@sha256:0ad67f9919522a07318034641ae09bf2079b417e9944c65914410594ce645468 mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager:v1.1.4],SizeBytes:51478397,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager@sha256:31ec4f7daccd3e7a8504e12657d7830651ecacbe4a487daca1b1b7695a64b070 mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager:v1.23.1],SizeBytes:51249021,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:011712ed90fb8efcf27928b0a47ed04b98baebb31cb1b2d8ab676977ec18eedc mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v1.1.4],SizeBytes:50868093,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:0f9a8fbaed65192ed7dd795be4f9c1dc48ebdef0a241fb62d456f4bed40d9875 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v1.23.1],SizeBytes:50679677,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:c35f45e8dfaa30363e589296415a057f9d32813920fc3820d6557491657f199a mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.21.2],SizeBytes:50607491,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/ip-masq-agent@sha256:1244155f2ed3f33ff154cc343b8ad285f3391d95afd7d4b1c6dcc420bc0ba3cf mcr.microsoft.com/oss/kubernetes/ip-masq-agent:v2.5.0],SizeBytes:50146762,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager@sha256:7c907ff70b90a0bdf8fae63bd744018469dd9839cde1fd0515b93e0bbd14b34e mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager:v1.0.8],SizeBytes:48963453,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:3987d7a8c6922ce1952ee19c5cb6ea75aac7b7c1b07aa79277ad038c69fb7a31 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v1.0.8],SizeBytes:48349053,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/coredns@sha256:f873bf7f0928461efe10697fa76cf0ad7a1ae3041c5b57b50dd3d0b72d273f8c mcr.microsoft.com/oss/kubernetes/coredns:1.8.6],SizeBytes:46804601,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager@sha256:8073113a20882642a980b338635cdc5945e5673a18aef192090e6fde2b89a75c mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager:v0.6.0],SizeBytes:45909032,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:6a32329628bdea3c6d75e98aad6155b65d2e2b98ca616eb33f9ac562912804c6 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.6.0],SizeBytes:45229096,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager@sha256:ef6c4ba564b4d11d270f7d1563c50fbeb30ccc3b94146e5059228c49f95875f5 mcr.microsoft.com/oss/kubernetes/azure-cloud-controller-manager:v0.7.11],SizeBytes:44916605,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:dbcc384758ba5ca6d249596d471292ed3785e31cdb854d48b84d70794b669b4c mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.7.11],SizeBytes:43679613,},ContainerImage{Names:[mcr.microsoft.com/oss/etcd-io/etcd@sha256:cf587862e3f1b6fa4d9a2565520a34f164bdf72c50f37af8c3c668160593246e mcr.microsoft.com/oss/etcd-io/etcd:v3.3.25],SizeBytes:41832119,},ContainerImage{Names:[mcr.microsoft.com/k8s/aad-pod-identity/mic@sha256:bd9465be94966b9a917e1e3904fa5e63dd91772ccadf304e18ffd8e4ad8ccedd mcr.microsoft.com/k8s/aad-pod-identity/mic:1.6.1],SizeBytes:41374894,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-proportional-autoscaler@sha256:c849d75d61943ce7f51b4c049f1a79d19a08253966c8f49c4cfb6414cc33db8b mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-proportional-autoscaler:1.8.5],SizeBytes:40661903,},ContainerImage{Names:[mcr.microsoft.com/k8s/aad-pod-identity/nmi@sha256:02128fefcdb7593ac53fc342e2c53a0fc6fabd813036bf60457bf43cc2940116 mcr.microsoft.com/k8s/aad-pod-identity/nmi:1.6.1],SizeBytes:38007982,},ContainerImage{Names:[mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume@sha256:921f301c44dda06a325164accf22e78ecc570b5c7d9d6ee4c66bd8cbb2b60b9a mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume:v0.0.16],SizeBytes:26970670,},ContainerImage{Names:[mcr.microsoft.com/k8s/kms/keyvault@sha256:1a27e175f8c125209e32d2957b5509fe20757bd8cb309ff9da598799b56326fb mcr.microsoft.com/k8s/kms/keyvault:v0.0.10],SizeBytes:23077387,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:dbec3a8166686b09b242176ab5b99e993da4126438bbce68147c3fd654f35662 mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v2.4.0],SizeBytes:19547289,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:c96a6255c42766f6b8bb1a7cda02b0060ab1b20b2e2dafcc64ec09e7646745a6 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.5.0],SizeBytes:17573341,},ContainerImage{Names:[mcr.microsoft.com/oss/busybox/busybox@sha256:582a641242b49809af3a1a522f9aae8c3f047d1c6ca1dd9d8cdabd349e45b1a9 mcr.microsoft.com/oss/busybox/busybox:1.33.1],SizeBytes:1235829,},ContainerImage{Names:[mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume@sha256:23d8c6033f02a1ecad05127ebdc931bb871264228661bc122704b0974e4d9fdd mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume:1.0.8],SizeBytes:1159025,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:e3b8c20681593c21b344ad801fbb8abaf564427ee3a57a9fcfa3b455f917ce46 mcr.microsoft.com/oss/kubernetes/pause:3.4.1],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/disk.csi.azure.com^/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-fpcu74iw/providers/Microsoft.Compute/disks/pvc-1a676212-0ad3-4630-9b1d-be5a839d44ee,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/disk.csi.azure.com^/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-fpcu74iw/providers/Microsoft.Compute/disks/pvc-770f592e-29c2-4a0f-ba44-54aea2c0b476,DevicePath:,},},Config:nil,},}
Jun 14 00:39:41.613: INFO: 
... skipping 90 lines ...
/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:40
  [single-az]
  /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:44
    should create a deployment object, write and read to it, delete the pod and write and read to it again [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows] [csi-azuredisk-scheduler-extender] [It]
    /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:436

    Unexpected error:
        <*errors.errorString | 0xc000e12930>: {
            s: "error waiting for deployment \"azuredisk-volume-tester-4rj7k\" status to match expectation: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:\"Available\", Status:\"False\", LastUpdateTime:time.Date(2022, time.June, 14, 0, 24, 37, 0, time.Local), LastTransitionTime:time.Date(2022, time.June, 14, 0, 24, 37, 0, time.Local), Reason:\"MinimumReplicasUnavailable\", Message:\"Deployment does not have minimum availability.\"}, v1.DeploymentCondition{Type:\"Progressing\", Status:\"True\", LastUpdateTime:time.Date(2022, time.June, 14, 0, 24, 37, 0, time.Local), LastTransitionTime:time.Date(2022, time.June, 14, 0, 24, 37, 0, time.Local), Reason:\"ReplicaSetUpdated\", Message:\"ReplicaSet \\\"azuredisk-volume-tester-4rj7k-8b7985f7c\\\" is progressing.\"}}, CollisionCount:(*int32)(nil)}",
        }
        error waiting for deployment "azuredisk-volume-tester-4rj7k" status to match expectation: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.June, 14, 0, 24, 37, 0, time.Local), LastTransitionTime:time.Date(2022, time.June, 14, 0, 24, 37, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.June, 14, 0, 24, 37, 0, time.Local), LastTransitionTime:time.Date(2022, time.June, 14, 0, 24, 37, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-4rj7k-8b7985f7c\" is progressing."}}, CollisionCount:(*int32)(nil)}
    occurred

    /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/deployment.go:126
------------------------------
Dynamic Provisioning [single-az] 
  should delete PV with reclaimPolicy "Delete" [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows]
... skipping 149 lines ...
STEP: setting up the StorageClass
STEP: creating a StorageClass 
STEP: setting up the PVC and PV
STEP: creating a PVC
STEP: setting up the pod
STEP: deploying the pod
STEP: checking that the pod's command exits with no error
Jun 14 00:40:04.431: INFO: Waiting up to 15m0s for pod "azuredisk-volume-tester-h5n6r" in namespace "azuredisk-1252" to be "Succeeded or Failed"
Jun 14 00:40:04.540: INFO: Pod "azuredisk-volume-tester-h5n6r": Phase="Pending", Reason="", readiness=false. Elapsed: 108.248081ms
Jun 14 00:40:06.648: INFO: Pod "azuredisk-volume-tester-h5n6r": Phase="Pending", Reason="", readiness=false. Elapsed: 2.21658942s
Jun 14 00:40:08.757: INFO: Pod "azuredisk-volume-tester-h5n6r": Phase="Pending", Reason="", readiness=false. Elapsed: 4.325392727s
Jun 14 00:40:10.867: INFO: Pod "azuredisk-volume-tester-h5n6r": Phase="Pending", Reason="", readiness=false. Elapsed: 6.435680165s
Jun 14 00:40:12.977: INFO: Pod "azuredisk-volume-tester-h5n6r": Phase="Pending", Reason="", readiness=false. Elapsed: 8.545353117s
Jun 14 00:40:15.087: INFO: Pod "azuredisk-volume-tester-h5n6r": Phase="Pending", Reason="", readiness=false. Elapsed: 10.655847725s
... skipping 416 lines ...
Jun 14 00:54:55.045: INFO: Pod "azuredisk-volume-tester-h5n6r": Phase="Pending", Reason="", readiness=false. Elapsed: 14m50.613863573s
Jun 14 00:54:57.155: INFO: Pod "azuredisk-volume-tester-h5n6r": Phase="Pending", Reason="", readiness=false. Elapsed: 14m52.723497269s
Jun 14 00:54:59.264: INFO: Pod "azuredisk-volume-tester-h5n6r": Phase="Pending", Reason="", readiness=false. Elapsed: 14m54.83294218s
Jun 14 00:55:01.374: INFO: Pod "azuredisk-volume-tester-h5n6r": Phase="Pending", Reason="", readiness=false. Elapsed: 14m56.942266454s
Jun 14 00:55:03.484: INFO: Pod "azuredisk-volume-tester-h5n6r": Phase="Pending", Reason="", readiness=false. Elapsed: 14m59.052801143s
Jun 14 00:55:05.485: INFO: deleting Pod "azuredisk-1252"/"azuredisk-volume-tester-h5n6r"
Jun 14 00:55:05.627: INFO: Error getting logs for pod azuredisk-volume-tester-h5n6r: the server rejected our request for an unknown reason (get pods azuredisk-volume-tester-h5n6r)
STEP: Deleting pod azuredisk-volume-tester-h5n6r in namespace azuredisk-1252
STEP: validating provisioned PV
STEP: checking the PV
Jun 14 00:55:05.957: INFO: deleting PVC "azuredisk-1252"/"pvc-bdx5j"
Jun 14 00:55:05.957: INFO: Deleting PersistentVolumeClaim "pvc-bdx5j"
STEP: waiting for claim's PV "pvc-7b020461-29f1-4fcf-9fe8-6d4d7d9e1891" to be deleted
... skipping 324 lines ...
Jun 14 01:21:26.695: INFO: PersistentVolume pvc-60c7a63c-ecad-4a99-8a66-e354c633ed17 found and phase=Released (6m13.284415685s)
Jun 14 01:21:31.806: INFO: PersistentVolume pvc-60c7a63c-ecad-4a99-8a66-e354c633ed17 found and phase=Released (6m18.395556898s)
Jun 14 01:21:36.916: INFO: PersistentVolume pvc-60c7a63c-ecad-4a99-8a66-e354c633ed17 found and phase=Released (6m23.505116887s)
Jun 14 01:21:42.027: INFO: PersistentVolume pvc-60c7a63c-ecad-4a99-8a66-e354c633ed17 found and phase=Released (6m28.616088155s)
Jun 14 01:21:47.137: INFO: PersistentVolume pvc-60c7a63c-ecad-4a99-8a66-e354c633ed17 found and phase=Released (6m33.7259353s)
Jun 14 01:21:52.246: INFO: PersistentVolume pvc-60c7a63c-ecad-4a99-8a66-e354c633ed17 found and phase=Released (6m38.835780577s)
{"component":"entrypoint","file":"k8s.io/test-infra/prow/entrypoint/run.go:165","func":"k8s.io/test-infra/prow/entrypoint.Options.ExecuteProcess","level":"error","msg":"Process did not finish before 3h0m0s timeout","severity":"error","time":"2022-06-14T01:21:54Z"}
++ early_exit_handler
++ '[' -n 181 ']'
++ kill -TERM 181
++ cleanup_dind
++ [[ true == \t\r\u\e ]]
++ echo 'Cleaning up after docker'
... skipping 68 lines ...
Jun 14 01:25:16.944: INFO: At 2022-06-14 00:40:07 +0000 UTC - event for pvc-6x99b: {disk.csi.azure.com_k8s-agentpool1-21748613-0_28b70215-f943-4330-871f-8d56a7f0eb33 } ProvisioningSucceeded: Successfully provisioned volume pvc-60c7a63c-ecad-4a99-8a66-e354c633ed17
Jun 14 01:25:16.944: INFO: At 2022-06-14 00:40:07 +0000 UTC - event for pvc-8brbj: {disk.csi.azure.com_k8s-agentpool1-21748613-0_28b70215-f943-4330-871f-8d56a7f0eb33 } ProvisioningSucceeded: Successfully provisioned volume pvc-d470cdd9-e7c9-4c4e-bca9-b88bad70f7eb
Jun 14 01:25:16.944: INFO: At 2022-06-14 00:40:07 +0000 UTC - event for pvc-bdx5j: {disk.csi.azure.com_k8s-agentpool1-21748613-0_28b70215-f943-4330-871f-8d56a7f0eb33 } ProvisioningSucceeded: Successfully provisioned volume pvc-7b020461-29f1-4fcf-9fe8-6d4d7d9e1891
Jun 14 01:25:16.944: INFO: At 2022-06-14 00:40:09 +0000 UTC - event for azuredisk-volume-tester-h5n6r: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-60c7a63c-ecad-4a99-8a66-e354c633ed17" 
Jun 14 01:25:16.944: INFO: At 2022-06-14 00:40:09 +0000 UTC - event for azuredisk-volume-tester-h5n6r: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-7b020461-29f1-4fcf-9fe8-6d4d7d9e1891" 
Jun 14 01:25:16.944: INFO: At 2022-06-14 00:40:09 +0000 UTC - event for azuredisk-volume-tester-h5n6r: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-d470cdd9-e7c9-4c4e-bca9-b88bad70f7eb" 
Jun 14 01:25:16.944: INFO: At 2022-06-14 00:42:09 +0000 UTC - event for azuredisk-volume-tester-h5n6r: {kubelet k8s-agentpool1-21748613-1} FailedMount: MountVolume.MountDevice failed for volume "pvc-7b020461-29f1-4fcf-9fe8-6d4d7d9e1891" : rpc error: code = DeadlineExceeded desc = context deadline exceeded
Jun 14 01:25:16.944: INFO: At 2022-06-14 00:42:09 +0000 UTC - event for azuredisk-volume-tester-h5n6r: {kubelet k8s-agentpool1-21748613-1} FailedMount: MountVolume.MountDevice failed for volume "pvc-60c7a63c-ecad-4a99-8a66-e354c633ed17" : rpc error: code = DeadlineExceeded desc = context deadline exceeded
Jun 14 01:25:16.944: INFO: At 2022-06-14 00:42:09 +0000 UTC - event for azuredisk-volume-tester-h5n6r: {kubelet k8s-agentpool1-21748613-1} FailedMount: MountVolume.MountDevice failed for volume "pvc-d470cdd9-e7c9-4c4e-bca9-b88bad70f7eb" : rpc error: code = DeadlineExceeded desc = context deadline exceeded
Jun 14 01:25:16.944: INFO: At 2022-06-14 00:42:10 +0000 UTC - event for azuredisk-volume-tester-h5n6r: {kubelet k8s-agentpool1-21748613-1} FailedMount: Unable to attach or mount volumes: unmounted volumes=[test-volume-3 test-volume-1 test-volume-2], unattached volumes=[test-volume-3 kube-api-access-fvwgv test-volume-1 test-volume-2]: timed out waiting for the condition
Jun 14 01:25:16.944: INFO: At 2022-06-14 00:44:26 +0000 UTC - event for azuredisk-volume-tester-h5n6r: {kubelet k8s-agentpool1-21748613-1} FailedMount: Unable to attach or mount volumes: unmounted volumes=[test-volume-1 test-volume-2 test-volume-3], unattached volumes=[test-volume-1 test-volume-2 test-volume-3 kube-api-access-fvwgv]: timed out waiting for the condition
Jun 14 01:25:17.052: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Jun 14 01:25:17.052: INFO: 
Jun 14 01:25:17.268: INFO: 
Logging node info for node k8s-agentpool1-21748613-0
... skipping 92 lines ...
/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:40
  [single-az]
  /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:44
    should create multiple PV objects, bind to PVCs and attach all to a single pod [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows] [csi-azuredisk-scheduler-extender] [It]
    /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:589

    Unexpected error:
        <*errors.errorString | 0xc000a00850>: {
            s: "Gave up after waiting 15m0s for pod \"azuredisk-volume-tester-h5n6r\" to be \"Succeeded or Failed\"",
        }
        Gave up after waiting 15m0s for pod "azuredisk-volume-tester-h5n6r" to be "Succeeded or Failed"
    occurred

    /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pod.go:89
------------------------------
Dynamic Provisioning [single-az] 
  should create a raw block volume and a filesystem volume on demand and bind to the same pod [kubernetes.io/azure-disk] [disk.csi.azure.com] [csi-azuredisk-scheduler-extender]
... skipping 16 lines ...
STEP: setting up the StorageClass
STEP: creating a StorageClass 
STEP: setting up the PVC and PV
STEP: creating a PVC
STEP: setting up the pod
STEP: deploying the pod
STEP: checking that the pod's command exits with no error
Jun 14 01:25:21.787: INFO: Waiting up to 15m0s for pod "azuredisk-volume-tester-7f5kl" in namespace "azuredisk-8474" to be "Succeeded or Failed"
Jun 14 01:25:21.896: INFO: Pod "azuredisk-volume-tester-7f5kl": Phase="Pending", Reason="", readiness=false. Elapsed: 108.853499ms
Jun 14 01:25:24.006: INFO: Pod "azuredisk-volume-tester-7f5kl": Phase="Pending", Reason="", readiness=false. Elapsed: 2.219355643s
Jun 14 01:25:26.117: INFO: Pod "azuredisk-volume-tester-7f5kl": Phase="Pending", Reason="", readiness=false. Elapsed: 4.330386237s
Jun 14 01:25:28.228: INFO: Pod "azuredisk-volume-tester-7f5kl": Phase="Pending", Reason="", readiness=false. Elapsed: 6.441290209s
Jun 14 01:25:30.338: INFO: Pod "azuredisk-volume-tester-7f5kl": Phase="Pending", Reason="", readiness=false. Elapsed: 8.551593458s
Jun 14 01:25:32.449: INFO: Pod "azuredisk-volume-tester-7f5kl": Phase="Pending", Reason="", readiness=false. Elapsed: 10.66256657s
... skipping 317 lines ...
Jun 14 01:36:43.598: INFO: Pod "azuredisk-volume-tester-7f5kl": Phase="Pending", Reason="", readiness=false. Elapsed: 11m21.811437832s
Jun 14 01:36:45.708: INFO: Pod "azuredisk-volume-tester-7f5kl": Phase="Pending", Reason="", readiness=false. Elapsed: 11m23.921180648s
Jun 14 01:36:47.818: INFO: Pod "azuredisk-volume-tester-7f5kl": Phase="Pending", Reason="", readiness=false. Elapsed: 11m26.031187259s
Jun 14 01:36:49.929: INFO: Pod "azuredisk-volume-tester-7f5kl": Phase="Pending", Reason="", readiness=false. Elapsed: 11m28.142203435s
Jun 14 01:36:52.039: INFO: Pod "azuredisk-volume-tester-7f5kl": Phase="Pending", Reason="", readiness=false. Elapsed: 11m30.252061113s
Jun 14 01:36:54.149: INFO: Pod "azuredisk-volume-tester-7f5kl": Phase="Pending", Reason="", readiness=false. Elapsed: 11m32.362531956s
{"component":"entrypoint","file":"k8s.io/test-infra/prow/entrypoint/run.go:255","func":"k8s.io/test-infra/prow/entrypoint.gracefullyTerminate","level":"error","msg":"Process did not exit before 15m0s grace period","severity":"error","time":"2022-06-14T01:36:54Z"}
{"component":"entrypoint","error":"os: process already finished","file":"k8s.io/test-infra/prow/entrypoint/run.go:257","func":"k8s.io/test-infra/prow/entrypoint.gracefullyTerminate","level":"error","msg":"Could not kill process after grace period","severity":"error","time":"2022-06-14T01:36:54Z"}