kubernetes-sigs/azuredisk-csi-driver PR #1676 pull-azuredisk-csi-driver-verify #1608655629432393728
Recent runs || View in Spyglass
Recent runs || View in Spyglass
| PR | andyzhangx: fix: set ForceAttemptHTTP2 as false to increase ARM throttling limit |
| Result | FAILURE |
| Tests | 0 failed / 0 succeeded |
| Started | |
| Elapsed | 3m45s |
| Revision | d9d8b72c6cc8290accd670bd9068d9074c59dddd |
| Refs |
1676 |
... skipping 3 lines ... + make verify go test -v -cover ./pkg/... ./test/utils/credentials ? sigs.k8s.io/azuredisk-csi-driver/pkg/azureconstants [no test files] === RUN TestRescanAllVolumes --- PASS: TestRescanAllVolumes (0.00s) === RUN TestFindDiskByLun W1230 02:48:40.676736 11430 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/azure/scsi1/ failed, error: read /dev/disk/azure/scsi1/ error: bad dir W1230 02:48:40.676834 11430 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/by-id/ failed, error: read /dev/disk/by-id/ error: bad dir --- PASS: TestFindDiskByLun (0.00s) === RUN TestStrFirstLetterToUpper --- PASS: TestStrFirstLetterToUpper (0.00s) === RUN TestNewDriverV1 --- PASS: TestNewDriverV1 (0.00s) === RUN TestCheckDiskCapacity ... skipping 28 lines ... Git Commit: N/A Go Version: go1.19.4 Platform: linux/amd64 Topology Key: topology.disk.csi.azure.com/zone Streaming logs below: W1230 02:48:40.685436 11430 azure_disk_utils.go:230] get kubeconfig() failed with error: open /var/run/secrets/kubernetes.io/serviceaccount/token: no such file or directory I1230 02:48:40.690236 11430 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME I1230 02:48:40.690283 11430 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME I1230 02:48:40.690289 11430 driver.go:81] Enabling controller service capability: CREATE_DELETE_SNAPSHOT I1230 02:48:40.690293 11430 driver.go:81] Enabling controller service capability: CLONE_VOLUME I1230 02:48:40.690298 11430 driver.go:81] Enabling controller service capability: EXPAND_VOLUME I1230 02:48:40.690302 11430 driver.go:81] Enabling controller service capability: SINGLE_NODE_MULTI_WRITER ... skipping 22 lines ... Git Commit: N/A Go Version: go1.19.4 Platform: linux/amd64 Topology Key: topology.disk.csi.azure.com/zone Streaming logs below: W1230 02:48:40.695965 11430 azure_disk_utils.go:230] get kubeconfig() failed with error: open /var/run/secrets/kubernetes.io/serviceaccount/token: no such file or directory I1230 02:48:40.699701 11430 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME I1230 02:48:40.699736 11430 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME I1230 02:48:40.699743 11430 driver.go:81] Enabling controller service capability: CREATE_DELETE_SNAPSHOT I1230 02:48:40.699749 11430 driver.go:81] Enabling controller service capability: CLONE_VOLUME I1230 02:48:40.699755 11430 driver.go:81] Enabling controller service capability: EXPAND_VOLUME I1230 02:48:40.699763 11430 driver.go:81] Enabling controller service capability: SINGLE_NODE_MULTI_WRITER ... skipping 13 lines ... Git Commit: N/A Go Version: go1.19.4 Platform: linux/amd64 Topology Key: topology.disk.csi.azure.com/zone Streaming logs below: W1230 02:48:40.701191 11430 azure_disk_utils.go:230] get kubeconfig() failed with error: open /var/run/secrets/kubernetes.io/serviceaccount/token: no such file or directory E1230 02:48:41.081884 11430 util.go:138] Send.sendRequest: error in parsing response body string "": unexpected end of JSON input, Skip retrying regional host E1230 02:48:41.082028 11430 azure_standard.go:587] as.GetInstanceTypeByNodeName() failed: as.getVirtualMachine() err=Retriable: false, RetryAfter: 0s, HTTPStatusCode: 400, RawError: azure.BearerAuthorizer#WithAuthorization: Failed to refresh the Token for request to https://management.azure.com/subscriptions/12345/resourceGroups/rg1/providers/Microsoft.Compute/virtualMachines/?%24expand=instanceView&api-version=2022-03-01: StatusCode=400 -- Original Error: adal: Refresh request failed. Status Code = '400'. Response body: {"error":"invalid_request","error_description":"AADSTS90002: Tenant '1234' not found. Check to make sure you have the correct tenant ID and are signing into the correct cloud. Check with your subscription administrator, this may happen if there are no active subscriptions for the tenant.\r\nTrace ID: b4ce7bc7-20f6-46d6-aa15-dedea3a80c02\r\nCorrelation ID: 84396330-e141-4139-b83a-a870d043fd15\r\nTimestamp: 2022-12-30 02:48:41Z","error_codes":[90002],"timestamp":"2022-12-30 02:48:41Z","trace_id":"b4ce7bc7-20f6-46d6-aa15-dedea3a80c02","correlation_id":"84396330-e141-4139-b83a-a870d043fd15","error_uri":"https://login.microsoftonline.com/error?code=90002"} Endpoint https://login.microsoftonline.com/1234/oauth2/token W1230 02:48:41.082067 11430 azuredisk.go:220] Failed to get node info. Error: NewNodeInfo: Failed to get instance type from Azure cloud provider, nodeName: , error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 400, RawError: azure.BearerAuthorizer#WithAuthorization: Failed to refresh the Token for request to https://management.azure.com/subscriptions/12345/resourceGroups/rg1/providers/Microsoft.Compute/virtualMachines/?%24expand=instanceView&api-version=2022-03-01: StatusCode=400 -- Original Error: adal: Refresh request failed. Status Code = '400'. Response body: {"error":"invalid_request","error_description":"AADSTS90002: Tenant '1234' not found. Check to make sure you have the correct tenant ID and are signing into the correct cloud. Check with your subscription administrator, this may happen if there are no active subscriptions for the tenant.\r\nTrace ID: b4ce7bc7-20f6-46d6-aa15-dedea3a80c02\r\nCorrelation ID: 84396330-e141-4139-b83a-a870d043fd15\r\nTimestamp: 2022-12-30 02:48:41Z","error_codes":[90002],"timestamp":"2022-12-30 02:48:41Z","trace_id":"b4ce7bc7-20f6-46d6-aa15-dedea3a80c02","correlation_id":"84396330-e141-4139-b83a-a870d043fd15","error_uri":"https://login.microsoftonline.com/error?code=90002"} Endpoint https://login.microsoftonline.com/1234/oauth2/token I1230 02:48:41.085667 11430 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME I1230 02:48:41.085720 11430 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME I1230 02:48:41.085728 11430 driver.go:81] Enabling controller service capability: CREATE_DELETE_SNAPSHOT I1230 02:48:41.085733 11430 driver.go:81] Enabling controller service capability: CLONE_VOLUME I1230 02:48:41.085739 11430 driver.go:81] Enabling controller service capability: EXPAND_VOLUME I1230 02:48:41.085749 11430 driver.go:81] Enabling controller service capability: SINGLE_NODE_MULTI_WRITER ... skipping 258 lines ... I1230 02:48:41.167662 11430 driver.go:81] Enabling controller service capability: LIST_SNAPSHOTS I1230 02:48:41.167675 11430 driver.go:81] Enabling controller service capability: CLONE_VOLUME I1230 02:48:41.167709 11430 driver.go:81] Enabling controller service capability: EXPAND_VOLUME I1230 02:48:41.167735 11430 driver.go:81] Enabling controller service capability: LIST_VOLUMES I1230 02:48:41.167752 11430 driver.go:81] Enabling controller service capability: LIST_VOLUMES_PUBLISHED_NODES I1230 02:48:41.167767 11430 driver.go:100] Enabling volume access mode: SINGLE_NODE_WRITER E1230 02:48:41.167958 11430 controllerserver.go:302] validateDiskURI(123) in DeleteVolume failed with error: invalid DiskURI: 123, correct format: [/subscriptions/{sub-id}/resourcegroups/{group-name}/providers/microsoft.compute/disks/{disk-id}] --- PASS: TestDeleteVolume (0.00s) === RUN TestControllerGetVolume I1230 02:48:41.171457 11430 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME I1230 02:48:41.171602 11430 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME I1230 02:48:41.171629 11430 driver.go:81] Enabling controller service capability: CREATE_DELETE_SNAPSHOT I1230 02:48:41.171702 11430 driver.go:81] Enabling controller service capability: LIST_SNAPSHOTS ... skipping 54 lines ... I1230 02:48:41.190649 11430 driver.go:81] Enabling controller service capability: LIST_VOLUMES I1230 02:48:41.190668 11430 driver.go:81] Enabling controller service capability: LIST_VOLUMES_PUBLISHED_NODES I1230 02:48:41.190706 11430 driver.go:100] Enabling volume access mode: SINGLE_NODE_WRITER === RUN TestControllerPublishVolume/diskName_error === RUN TestControllerPublishVolume/NodeID_missing === RUN TestControllerPublishVolume/failed_provisioning_state W1230 02:48:41.191641 11430 controllerserver.go:392] VM(unit-test-node) is in failed state, update VM first === RUN TestControllerPublishVolume/Volume_already_attached_success I1230 02:48:41.196157 11430 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME I1230 02:48:41.196273 11430 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME I1230 02:48:41.196299 11430 driver.go:81] Enabling controller service capability: CREATE_DELETE_SNAPSHOT I1230 02:48:41.196319 11430 driver.go:81] Enabling controller service capability: LIST_SNAPSHOTS I1230 02:48:41.196360 11430 driver.go:81] Enabling controller service capability: CLONE_VOLUME ... skipping 671 lines ... I1230 02:48:41.433462 11430 driver.go:81] Enabling controller service capability: LIST_SNAPSHOTS I1230 02:48:41.433468 11430 driver.go:81] Enabling controller service capability: CLONE_VOLUME I1230 02:48:41.433475 11430 driver.go:81] Enabling controller service capability: EXPAND_VOLUME I1230 02:48:41.433480 11430 driver.go:81] Enabling controller service capability: LIST_VOLUMES I1230 02:48:41.433486 11430 driver.go:81] Enabling controller service capability: LIST_VOLUMES_PUBLISHED_NODES I1230 02:48:41.433493 11430 driver.go:100] Enabling volume access mode: SINGLE_NODE_WRITER E1230 02:48:41.433585 11430 nodeserver.go:558] mkdir failed on target: /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk/azuredisk.go (mkdir /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk/azuredisk.go: not a directory) --- PASS: TestEnsureMountPoint (0.00s) === RUN TestNodeGetInfo === RUN TestNodeGetInfo/[Success]_Get_node_information_for_existing_VM I1230 02:48:41.437056 11430 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME I1230 02:48:41.437091 11430 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME I1230 02:48:41.437111 11430 driver.go:81] Enabling controller service capability: CREATE_DELETE_SNAPSHOT ... skipping 11 lines ... I1230 02:48:41.441703 11430 driver.go:81] Enabling controller service capability: CLONE_VOLUME I1230 02:48:41.441710 11430 driver.go:81] Enabling controller service capability: EXPAND_VOLUME I1230 02:48:41.441716 11430 driver.go:81] Enabling controller service capability: LIST_VOLUMES I1230 02:48:41.441722 11430 driver.go:81] Enabling controller service capability: LIST_VOLUMES_PUBLISHED_NODES I1230 02:48:41.441734 11430 driver.go:100] Enabling volume access mode: SINGLE_NODE_WRITER W1230 02:48:41.441897 11430 azure_wrap.go:77] Unable to find node 1a3bf870-87ec-11ed-a5e9-0a6881d479c8: instance not found W1230 02:48:41.441917 11430 nodeserver.go:339] get zone(fakeNodeID) failed with: instance not found, fall back to get zone from node labels --- PASS: TestNodeGetInfo (0.01s) --- PASS: TestNodeGetInfo/[Success]_Get_node_information_for_existing_VM (0.00s) --- PASS: TestNodeGetInfo/[Failure]_Get_node_information_for_non-existing_VM (0.00s) === RUN TestNodeGetVolumeStats I1230 02:48:41.445080 11430 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME I1230 02:48:41.445171 11430 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME ... skipping 12 lines ... I1230 02:48:41.450288 11430 driver.go:81] Enabling controller service capability: LIST_SNAPSHOTS I1230 02:48:41.450294 11430 driver.go:81] Enabling controller service capability: CLONE_VOLUME I1230 02:48:41.450301 11430 driver.go:81] Enabling controller service capability: EXPAND_VOLUME I1230 02:48:41.450307 11430 driver.go:81] Enabling controller service capability: LIST_VOLUMES I1230 02:48:41.450312 11430 driver.go:81] Enabling controller service capability: LIST_VOLUMES_PUBLISHED_NODES I1230 02:48:41.450320 11430 driver.go:100] Enabling volume access mode: SINGLE_NODE_WRITER W1230 02:48:41.450587 11430 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/azure/scsi1/ failed, error: read /dev/disk/azure/scsi1/ error: bad dir W1230 02:48:41.450612 11430 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/by-id/ failed, error: read /dev/disk/by-id/ error: bad dir E1230 02:48:41.450667 11430 nodeserver.go:169] NodeStageVolume: could not determine if volume vol_1 needs to be resized: Failed readonly device check. Expected 1 or 0, got '16106127360' W1230 02:48:41.450707 11430 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/azure/scsi1/ failed, error: read /dev/disk/azure/scsi1/ error: bad dir W1230 02:48:41.450734 11430 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/by-id/ failed, error: read /dev/disk/by-id/ error: bad dir W1230 02:48:41.450791 11430 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/azure/scsi1/ failed, error: read /dev/disk/azure/scsi1/ error: bad dir W1230 02:48:41.450809 11430 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/by-id/ failed, error: read /dev/disk/by-id/ error: bad dir W1230 02:48:41.450892 11430 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/azure/scsi1/ failed, error: read /dev/disk/azure/scsi1/ error: bad dir W1230 02:48:41.450911 11430 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/by-id/ failed, error: read /dev/disk/by-id/ error: bad dir I1230 02:48:41.450996 11430 mount_linux.go:529] Disk "/dev/sdd" appears to be unformatted, attempting to format as type: "ext4" with options: [-F -m0 /dev/sdd] I1230 02:48:41.451021 11430 mount_linux.go:539] Disk successfully formatted (mkfs): ext4 - /dev/sdd /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk/source_test E1230 02:48:41.451044 11430 nodeserver.go:169] NodeStageVolume: could not determine if volume vol_1 needs to be resized: Failed readonly device check. Expected 1 or 0, got '' W1230 02:48:41.451110 11430 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/azure/scsi1/ failed, error: read /dev/disk/azure/scsi1/ error: bad dir W1230 02:48:41.451134 11430 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/by-id/ failed, error: read /dev/disk/by-id/ error: bad dir W1230 02:48:41.451193 11430 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/azure/scsi1/ failed, error: read /dev/disk/azure/scsi1/ error: bad dir W1230 02:48:41.451212 11430 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/by-id/ failed, error: read /dev/disk/by-id/ error: bad dir E1230 02:48:41.451279 11430 nodeserver.go:169] NodeStageVolume: could not determine if volume vol_1 needs to be resized: Failed readonly device check. Expected 1 or 0, got '16106127360' --- PASS: TestNodeStageVolume (0.01s) === RUN TestNodeUnstageVolume I1230 02:48:41.458129 11430 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME I1230 02:48:41.458165 11430 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME I1230 02:48:41.458173 11430 driver.go:81] Enabling controller service capability: CREATE_DELETE_SNAPSHOT I1230 02:48:41.458179 11430 driver.go:81] Enabling controller service capability: LIST_SNAPSHOTS ... skipping 11 lines ... I1230 02:48:41.463614 11430 driver.go:81] Enabling controller service capability: LIST_SNAPSHOTS I1230 02:48:41.463643 11430 driver.go:81] Enabling controller service capability: CLONE_VOLUME I1230 02:48:41.463667 11430 driver.go:81] Enabling controller service capability: EXPAND_VOLUME I1230 02:48:41.463689 11430 driver.go:81] Enabling controller service capability: LIST_VOLUMES I1230 02:48:41.463711 11430 driver.go:81] Enabling controller service capability: LIST_VOLUMES_PUBLISHED_NODES I1230 02:48:41.463734 11430 driver.go:100] Enabling volume access mode: SINGLE_NODE_WRITER E1230 02:48:41.463980 11430 nodeserver.go:558] mkdir failed on target: /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk/azuredisk.go (mkdir /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk/azuredisk.go: not a directory) --- PASS: TestNodePublishVolume (0.01s) === RUN TestNodeUnpublishVolume I1230 02:48:41.467469 11430 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME I1230 02:48:41.467556 11430 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME I1230 02:48:41.467583 11430 driver.go:81] Enabling controller service capability: CREATE_DELETE_SNAPSHOT I1230 02:48:41.467606 11430 driver.go:81] Enabling controller service capability: LIST_SNAPSHOTS ... skipping 33 lines ... I1230 02:48:41.487030 11430 driver.go:81] Enabling controller service capability: LIST_SNAPSHOTS I1230 02:48:41.487036 11430 driver.go:81] Enabling controller service capability: CLONE_VOLUME I1230 02:48:41.487043 11430 driver.go:81] Enabling controller service capability: EXPAND_VOLUME I1230 02:48:41.487049 11430 driver.go:81] Enabling controller service capability: LIST_VOLUMES I1230 02:48:41.487055 11430 driver.go:81] Enabling controller service capability: LIST_VOLUMES_PUBLISHED_NODES I1230 02:48:41.487074 11430 driver.go:100] Enabling volume access mode: SINGLE_NODE_WRITER E1230 02:48:41.488140 11430 nodeserver.go:558] mkdir failed on target: /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk/test (mkdir /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk/test: not a directory) --- PASS: TestEnsureBlockTargetFile (0.00s) === RUN TestMakeDir --- PASS: TestMakeDir (0.00s) === RUN TestGetDevicePathWithLUN I1230 02:48:41.493613 11430 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME I1230 02:48:41.493660 11430 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME ... skipping 44 lines ... --- PASS: TestCheckDiskName (0.00s) === RUN TestGetCachingMode --- PASS: TestGetCachingMode (0.00s) === RUN TestGetKubeConfig --- PASS: TestGetKubeConfig (0.00s) === RUN TestGetCloudProvider W1230 02:48:37.891841 11420 azure_disk_utils.go:189] load azure config from file(/etc/kubernetes/azure.json) failed with open /etc/kubernetes/azure.json: no such file or directory W1230 02:48:37.894501 11420 azure_disk_utils.go:230] get kubeconfig(/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/pkg/azureutils/empty-kube-config) failed with error: invalid configuration: no configuration has been provided, try setting KUBERNETES_MASTER environment variable W1230 02:48:37.894730 11420 azure_disk_utils.go:230] get kubeconfig() failed with error: open /var/run/secrets/kubernetes.io/serviceaccount/token: no such file or directory --- PASS: TestGetCloudProvider (0.01s) === RUN TestGetDiskLUN --- PASS: TestGetDiskLUN (0.00s) === RUN TestGetDiskName --- PASS: TestGetDiskName (0.00s) === RUN TestGetFStype ... skipping 426 lines ... coverage: 78.0% of statements ok sigs.k8s.io/azuredisk-csi-driver/test/utils/credentials 0.009s coverage: 78.0% of statements go test -v -cover -tags azurediskv2 ./pkg/azuredisk --temp-use-driver-v2 === RUN TestRescanAllVolumes --- PASS: TestRescanAllVolumes (0.00s) === RUN TestFindDiskByLun W1230 02:48:48.363538 11788 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/azure/scsi1/ failed, error: read /dev/disk/azure/scsi1/ error: bad dir W1230 02:48:48.363648 11788 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/by-id/ failed, error: read /dev/disk/by-id/ error: bad dir --- PASS: TestFindDiskByLun (0.00s) === RUN TestStrFirstLetterToUpper --- PASS: TestStrFirstLetterToUpper (0.00s) === RUN TestNewDriverV1 --- PASS: TestNewDriverV1 (0.00s) === RUN TestCheckDiskCapacity ... skipping 30 lines ... Git Commit: N/A Go Version: go1.19.4 Platform: linux/amd64 Topology Key: topology.disk.csi.azure.com/zone Streaming logs below: W1230 02:48:48.378941 11788 azure_disk_utils.go:230] get kubeconfig() failed with error: open /var/run/secrets/kubernetes.io/serviceaccount/token: no such file or directory I1230 02:48:48.384899 11788 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME I1230 02:48:48.384939 11788 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME I1230 02:48:48.384946 11788 driver.go:81] Enabling controller service capability: CREATE_DELETE_SNAPSHOT I1230 02:48:48.384954 11788 driver.go:81] Enabling controller service capability: LIST_SNAPSHOTS I1230 02:48:48.384961 11788 driver.go:81] Enabling controller service capability: CLONE_VOLUME I1230 02:48:48.384968 11788 driver.go:81] Enabling controller service capability: EXPAND_VOLUME ... skipping 26 lines ... Git Commit: N/A Go Version: go1.19.4 Platform: linux/amd64 Topology Key: topology.disk.csi.azure.com/zone Streaming logs below: W1230 02:48:48.390333 11788 azure_disk_utils.go:230] get kubeconfig() failed with error: open /var/run/secrets/kubernetes.io/serviceaccount/token: no such file or directory I1230 02:48:48.396318 11788 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME I1230 02:48:48.396356 11788 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME I1230 02:48:48.396363 11788 driver.go:81] Enabling controller service capability: CREATE_DELETE_SNAPSHOT I1230 02:48:48.396369 11788 driver.go:81] Enabling controller service capability: LIST_SNAPSHOTS I1230 02:48:48.396375 11788 driver.go:81] Enabling controller service capability: CLONE_VOLUME I1230 02:48:48.396382 11788 driver.go:81] Enabling controller service capability: EXPAND_VOLUME ... skipping 16 lines ... Git Commit: N/A Go Version: go1.19.4 Platform: linux/amd64 Topology Key: topology.disk.csi.azure.com/zone Streaming logs below: W1230 02:48:48.397414 11788 azure_disk_utils.go:230] get kubeconfig() failed with error: open /var/run/secrets/kubernetes.io/serviceaccount/token: no such file or directory E1230 02:48:48.665089 11788 util.go:138] Send.sendRequest: error in parsing response body string "": unexpected end of JSON input, Skip retrying regional host E1230 02:48:48.665414 11788 azure_standard.go:587] as.GetInstanceTypeByNodeName() failed: as.getVirtualMachine() err=Retriable: false, RetryAfter: 0s, HTTPStatusCode: 400, RawError: azure.BearerAuthorizer#WithAuthorization: Failed to refresh the Token for request to https://management.azure.com/subscriptions/12345/resourceGroups/rg1/providers/Microsoft.Compute/virtualMachines/?%24expand=instanceView&api-version=2022-03-01: StatusCode=400 -- Original Error: adal: Refresh request failed. Status Code = '400'. Response body: {"error":"invalid_request","error_description":"AADSTS90002: Tenant '1234' not found. Check to make sure you have the correct tenant ID and are signing into the correct cloud. Check with your subscription administrator, this may happen if there are no active subscriptions for the tenant.\r\nTrace ID: 5617d681-53e9-424c-ae1e-24ae0a8d2001\r\nCorrelation ID: c11c2c95-78b3-412f-912b-bc621396593b\r\nTimestamp: 2022-12-30 02:48:48Z","error_codes":[90002],"timestamp":"2022-12-30 02:48:48Z","trace_id":"5617d681-53e9-424c-ae1e-24ae0a8d2001","correlation_id":"c11c2c95-78b3-412f-912b-bc621396593b","error_uri":"https://login.microsoftonline.com/error?code=90002"} Endpoint https://login.microsoftonline.com/1234/oauth2/token W1230 02:48:48.665517 11788 azuredisk.go:220] Failed to get node info. Error: NewNodeInfo: Failed to get instance type from Azure cloud provider, nodeName: , error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 400, RawError: azure.BearerAuthorizer#WithAuthorization: Failed to refresh the Token for request to https://management.azure.com/subscriptions/12345/resourceGroups/rg1/providers/Microsoft.Compute/virtualMachines/?%24expand=instanceView&api-version=2022-03-01: StatusCode=400 -- Original Error: adal: Refresh request failed. Status Code = '400'. Response body: {"error":"invalid_request","error_description":"AADSTS90002: Tenant '1234' not found. Check to make sure you have the correct tenant ID and are signing into the correct cloud. Check with your subscription administrator, this may happen if there are no active subscriptions for the tenant.\r\nTrace ID: 5617d681-53e9-424c-ae1e-24ae0a8d2001\r\nCorrelation ID: c11c2c95-78b3-412f-912b-bc621396593b\r\nTimestamp: 2022-12-30 02:48:48Z","error_codes":[90002],"timestamp":"2022-12-30 02:48:48Z","trace_id":"5617d681-53e9-424c-ae1e-24ae0a8d2001","correlation_id":"c11c2c95-78b3-412f-912b-bc621396593b","error_uri":"https://login.microsoftonline.com/error?code=90002"} Endpoint https://login.microsoftonline.com/1234/oauth2/token I1230 02:48:48.669396 11788 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME I1230 02:48:48.669596 11788 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME I1230 02:48:48.669679 11788 driver.go:81] Enabling controller service capability: CREATE_DELETE_SNAPSHOT I1230 02:48:48.669749 11788 driver.go:81] Enabling controller service capability: CLONE_VOLUME I1230 02:48:48.669825 11788 driver.go:81] Enabling controller service capability: EXPAND_VOLUME I1230 02:48:48.669897 11788 driver.go:81] Enabling controller service capability: SINGLE_NODE_MULTI_WRITER ... skipping 254 lines ... I1230 02:48:48.760873 11788 driver.go:81] Enabling controller service capability: LIST_SNAPSHOTS I1230 02:48:48.760879 11788 driver.go:81] Enabling controller service capability: CLONE_VOLUME I1230 02:48:48.760938 11788 driver.go:81] Enabling controller service capability: EXPAND_VOLUME I1230 02:48:48.760962 11788 driver.go:81] Enabling controller service capability: LIST_VOLUMES I1230 02:48:48.760984 11788 driver.go:81] Enabling controller service capability: LIST_VOLUMES_PUBLISHED_NODES I1230 02:48:48.760993 11788 driver.go:100] Enabling volume access mode: SINGLE_NODE_WRITER E1230 02:48:48.761208 11788 controllerserver_v2.go:256] validateDiskURI(123) in DeleteVolume failed with error: invalid DiskURI: 123, correct format: [/subscriptions/{sub-id}/resourcegroups/{group-name}/providers/microsoft.compute/disks/{disk-id}] --- PASS: TestDeleteVolume (0.00s) === RUN TestControllerGetVolume W1230 02:48:48.761301 11788 fake_azuredisk_v2.go:57] Using DriverV2 I1230 02:48:48.765076 11788 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME I1230 02:48:48.765108 11788 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME I1230 02:48:48.765146 11788 driver.go:81] Enabling controller service capability: CREATE_DELETE_SNAPSHOT ... skipping 60 lines ... I1230 02:48:48.785985 11788 driver.go:81] Enabling controller service capability: LIST_VOLUMES I1230 02:48:48.785994 11788 driver.go:81] Enabling controller service capability: LIST_VOLUMES_PUBLISHED_NODES I1230 02:48:48.786001 11788 driver.go:100] Enabling volume access mode: SINGLE_NODE_WRITER === RUN TestControllerPublishVolume/diskName_error === RUN TestControllerPublishVolume/NodeID_missing === RUN TestControllerPublishVolume/failed_provisioning_state W1230 02:48:48.786639 11788 controllerserver_v2.go:341] VM(unit-test-node) is in failed state, update VM first === RUN TestControllerPublishVolume/Volume_already_attached_success W1230 02:48:48.786805 11788 fake_azuredisk_v2.go:57] Using DriverV2 I1230 02:48:48.791371 11788 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME I1230 02:48:48.791404 11788 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME I1230 02:48:48.791505 11788 driver.go:81] Enabling controller service capability: CREATE_DELETE_SNAPSHOT I1230 02:48:48.795278 11788 driver.go:81] Enabling controller service capability: LIST_SNAPSHOTS ... skipping 731 lines ... I1230 02:48:49.076737 11788 driver.go:81] Enabling controller service capability: LIST_SNAPSHOTS I1230 02:48:49.076743 11788 driver.go:81] Enabling controller service capability: CLONE_VOLUME I1230 02:48:49.076749 11788 driver.go:81] Enabling controller service capability: EXPAND_VOLUME I1230 02:48:49.076754 11788 driver.go:81] Enabling controller service capability: LIST_VOLUMES I1230 02:48:49.076759 11788 driver.go:81] Enabling controller service capability: LIST_VOLUMES_PUBLISHED_NODES I1230 02:48:49.076767 11788 driver.go:100] Enabling volume access mode: SINGLE_NODE_WRITER E1230 02:48:49.076852 11788 nodeserver_v2.go:543] mkdir failed on target: /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk/azuredisk.go (mkdir /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk/azuredisk.go: not a directory) --- PASS: TestEnsureMountPoint (0.00s) === RUN TestNodeGetInfo === RUN TestNodeGetInfo/[Success]_Get_node_information_for_existing_VM W1230 02:48:49.077174 11788 fake_azuredisk_v2.go:57] Using DriverV2 I1230 02:48:49.080352 11788 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME I1230 02:48:49.080377 11788 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME ... skipping 13 lines ... I1230 02:48:49.088883 11788 driver.go:81] Enabling controller service capability: CLONE_VOLUME I1230 02:48:49.088887 11788 driver.go:81] Enabling controller service capability: EXPAND_VOLUME I1230 02:48:49.088891 11788 driver.go:81] Enabling controller service capability: LIST_VOLUMES I1230 02:48:49.088894 11788 driver.go:81] Enabling controller service capability: LIST_VOLUMES_PUBLISHED_NODES I1230 02:48:49.088899 11788 driver.go:100] Enabling volume access mode: SINGLE_NODE_WRITER W1230 02:48:49.088996 11788 azure_wrap.go:77] Unable to find node 1a3bf870-87ec-11ed-a5e9-0a6881d479c8: instance not found W1230 02:48:49.089006 11788 nodeserver_v2.go:336] get zone(fakeNodeID) failed with: instance not found, fall back to get zone from node labels --- PASS: TestNodeGetInfo (0.01s) --- PASS: TestNodeGetInfo/[Success]_Get_node_information_for_existing_VM (0.00s) --- PASS: TestNodeGetInfo/[Failure]_Get_node_information_for_non-existing_VM (0.01s) === RUN TestNodeGetVolumeStats W1230 02:48:49.089226 11788 fake_azuredisk_v2.go:57] Using DriverV2 I1230 02:48:49.092424 11788 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME ... skipping 14 lines ... I1230 02:48:49.097293 11788 driver.go:81] Enabling controller service capability: LIST_SNAPSHOTS I1230 02:48:49.097297 11788 driver.go:81] Enabling controller service capability: CLONE_VOLUME I1230 02:48:49.097302 11788 driver.go:81] Enabling controller service capability: EXPAND_VOLUME I1230 02:48:49.097305 11788 driver.go:81] Enabling controller service capability: LIST_VOLUMES I1230 02:48:49.097309 11788 driver.go:81] Enabling controller service capability: LIST_VOLUMES_PUBLISHED_NODES I1230 02:48:49.097314 11788 driver.go:100] Enabling volume access mode: SINGLE_NODE_WRITER W1230 02:48:49.097621 11788 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/azure/scsi1/ failed, error: read /dev/disk/azure/scsi1/ error: bad dir W1230 02:48:49.097659 11788 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/by-id/ failed, error: read /dev/disk/by-id/ error: bad dir E1230 02:48:49.097704 11788 nodeserver_v2.go:157] NodeStageVolume: could not determine if volume vol_1 needs to be resized: Failed readonly device check. Expected 1 or 0, got '16106127360' W1230 02:48:49.097732 11788 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/azure/scsi1/ failed, error: read /dev/disk/azure/scsi1/ error: bad dir W1230 02:48:49.097744 11788 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/by-id/ failed, error: read /dev/disk/by-id/ error: bad dir W1230 02:48:49.097868 11788 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/azure/scsi1/ failed, error: read /dev/disk/azure/scsi1/ error: bad dir W1230 02:48:49.098004 11788 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/by-id/ failed, error: read /dev/disk/by-id/ error: bad dir W1230 02:48:49.098203 11788 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/azure/scsi1/ failed, error: read /dev/disk/azure/scsi1/ error: bad dir W1230 02:48:49.098227 11788 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/by-id/ failed, error: read /dev/disk/by-id/ error: bad dir I1230 02:48:49.098306 11788 mount_linux.go:529] Disk "/dev/sdd" appears to be unformatted, attempting to format as type: "ext4" with options: [-F -m0 /dev/sdd] I1230 02:48:49.098356 11788 mount_linux.go:539] Disk successfully formatted (mkfs): ext4 - /dev/sdd /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk/source_test E1230 02:48:49.098397 11788 nodeserver_v2.go:157] NodeStageVolume: could not determine if volume vol_1 needs to be resized: Failed readonly device check. Expected 1 or 0, got '' W1230 02:48:49.098475 11788 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/azure/scsi1/ failed, error: read /dev/disk/azure/scsi1/ error: bad dir W1230 02:48:49.098492 11788 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/by-id/ failed, error: read /dev/disk/by-id/ error: bad dir W1230 02:48:49.098581 11788 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/azure/scsi1/ failed, error: read /dev/disk/azure/scsi1/ error: bad dir W1230 02:48:49.098603 11788 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/by-id/ failed, error: read /dev/disk/by-id/ error: bad dir E1230 02:48:49.098668 11788 nodeserver_v2.go:157] NodeStageVolume: could not determine if volume vol_1 needs to be resized: Failed readonly device check. Expected 1 or 0, got '16106127360' --- PASS: TestNodeStageVolume (0.01s) === RUN TestNodeUnstageVolume W1230 02:48:49.098921 11788 fake_azuredisk_v2.go:57] Using DriverV2 I1230 02:48:49.104720 11788 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME I1230 02:48:49.104754 11788 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME I1230 02:48:49.104758 11788 driver.go:81] Enabling controller service capability: CREATE_DELETE_SNAPSHOT ... skipping 13 lines ... I1230 02:48:49.109550 11788 driver.go:81] Enabling controller service capability: LIST_SNAPSHOTS I1230 02:48:49.109572 11788 driver.go:81] Enabling controller service capability: CLONE_VOLUME I1230 02:48:49.109595 11788 driver.go:81] Enabling controller service capability: EXPAND_VOLUME I1230 02:48:49.109610 11788 driver.go:81] Enabling controller service capability: LIST_VOLUMES I1230 02:48:49.109616 11788 driver.go:81] Enabling controller service capability: LIST_VOLUMES_PUBLISHED_NODES I1230 02:48:49.109624 11788 driver.go:100] Enabling volume access mode: SINGLE_NODE_WRITER E1230 02:48:49.109879 11788 nodeserver_v2.go:543] mkdir failed on target: /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk/azuredisk.go (mkdir /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk/azuredisk.go: not a directory) --- PASS: TestNodePublishVolume (0.00s) === RUN TestNodeUnpublishVolume W1230 02:48:49.110224 11788 fake_azuredisk_v2.go:57] Using DriverV2 I1230 02:48:49.114911 11788 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME I1230 02:48:49.114944 11788 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME I1230 02:48:49.114949 11788 driver.go:81] Enabling controller service capability: CREATE_DELETE_SNAPSHOT ... skipping 37 lines ... I1230 02:48:49.130071 11788 driver.go:81] Enabling controller service capability: LIST_SNAPSHOTS I1230 02:48:49.130075 11788 driver.go:81] Enabling controller service capability: CLONE_VOLUME I1230 02:48:49.130079 11788 driver.go:81] Enabling controller service capability: EXPAND_VOLUME I1230 02:48:49.130082 11788 driver.go:81] Enabling controller service capability: LIST_VOLUMES I1230 02:48:49.130086 11788 driver.go:81] Enabling controller service capability: LIST_VOLUMES_PUBLISHED_NODES I1230 02:48:49.130091 11788 driver.go:100] Enabling volume access mode: SINGLE_NODE_WRITER E1230 02:48:49.131234 11788 nodeserver_v2.go:543] mkdir failed on target: /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk/test (mkdir /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk/test: not a directory) --- PASS: TestEnsureBlockTargetFile (0.01s) === RUN TestMakeDir --- PASS: TestMakeDir (0.00s) === RUN TestGetDevicePathWithLUN W1230 02:48:49.131640 11788 fake_azuredisk_v2.go:57] Using DriverV2 I1230 02:48:49.135532 11788 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME ... skipping 185 lines ... - ForceAttemptHTTP2: false, // respect custom dialer (default is true) + ForceAttemptHTTP2: true, // always attempt HTTP/2 even though custom dialer is provided MaxIdleConns: 100, // Zero means no limit, the same as default transport MaxIdleConnsPerHost: 100, // Default is 2, ref:https://cs.opensource.google/go/go/+/go1.18.4:src/net/http/transport.go;l=58 IdleConnTimeout: 90 * time.Second, // the same as default transport error make: *** [Makefile:85: verify] Error 1 + EXIT_VALUE=2 + set +o xtrace