kubernetes-sigs/azuredisk-csi-driver PR #1676 pull-azuredisk-csi-driver-verify #1608812559580794880
Recent runs || View in Spyglass
Recent runs || View in Spyglass
| PR | andyzhangx: fix: set ForceAttemptHTTP2 as false to increase ARM throttling limit |
| Result | FAILURE |
| Tests | 0 failed / 0 succeeded |
| Started | |
| Elapsed | 2m28s |
| Revision | d9d8b72c6cc8290accd670bd9068d9074c59dddd |
| Refs |
1676 |
... skipping 3 lines ... + make verify go test -v -cover ./pkg/... ./test/utils/credentials ? sigs.k8s.io/azuredisk-csi-driver/pkg/azureconstants [no test files] === RUN TestRescanAllVolumes --- PASS: TestRescanAllVolumes (0.00s) === RUN TestFindDiskByLun W1230 13:11:14.254244 11486 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/azure/scsi1/ failed, error: read /dev/disk/azure/scsi1/ error: bad dir W1230 13:11:14.254356 11486 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/by-id/ failed, error: read /dev/disk/by-id/ error: bad dir --- PASS: TestFindDiskByLun (0.00s) === RUN TestStrFirstLetterToUpper --- PASS: TestStrFirstLetterToUpper (0.00s) === RUN TestNewDriverV1 --- PASS: TestNewDriverV1 (0.00s) === RUN TestCheckDiskCapacity ... skipping 28 lines ... Git Commit: N/A Go Version: go1.19.4 Platform: linux/amd64 Topology Key: topology.disk.csi.azure.com/zone Streaming logs below: W1230 13:11:14.261399 11486 azure_disk_utils.go:230] get kubeconfig() failed with error: open /var/run/secrets/kubernetes.io/serviceaccount/token: no such file or directory I1230 13:11:14.264893 11486 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME I1230 13:11:14.264924 11486 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME I1230 13:11:14.264932 11486 driver.go:81] Enabling controller service capability: CREATE_DELETE_SNAPSHOT I1230 13:11:14.264944 11486 driver.go:81] Enabling controller service capability: CLONE_VOLUME I1230 13:11:14.264949 11486 driver.go:81] Enabling controller service capability: EXPAND_VOLUME I1230 13:11:14.264955 11486 driver.go:81] Enabling controller service capability: SINGLE_NODE_MULTI_WRITER ... skipping 22 lines ... Git Commit: N/A Go Version: go1.19.4 Platform: linux/amd64 Topology Key: topology.disk.csi.azure.com/zone Streaming logs below: W1230 13:11:14.268630 11486 azure_disk_utils.go:230] get kubeconfig() failed with error: open /var/run/secrets/kubernetes.io/serviceaccount/token: no such file or directory I1230 13:11:14.271450 11486 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME I1230 13:11:14.271477 11486 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME I1230 13:11:14.271481 11486 driver.go:81] Enabling controller service capability: CREATE_DELETE_SNAPSHOT I1230 13:11:14.271485 11486 driver.go:81] Enabling controller service capability: CLONE_VOLUME I1230 13:11:14.271489 11486 driver.go:81] Enabling controller service capability: EXPAND_VOLUME I1230 13:11:14.271493 11486 driver.go:81] Enabling controller service capability: SINGLE_NODE_MULTI_WRITER ... skipping 13 lines ... Git Commit: N/A Go Version: go1.19.4 Platform: linux/amd64 Topology Key: topology.disk.csi.azure.com/zone Streaming logs below: W1230 13:11:14.273695 11486 azure_disk_utils.go:230] get kubeconfig() failed with error: open /var/run/secrets/kubernetes.io/serviceaccount/token: no such file or directory E1230 13:11:14.490175 11486 util.go:138] Send.sendRequest: error in parsing response body string "": unexpected end of JSON input, Skip retrying regional host E1230 13:11:14.490313 11486 azure_standard.go:587] as.GetInstanceTypeByNodeName() failed: as.getVirtualMachine() err=Retriable: false, RetryAfter: 0s, HTTPStatusCode: 400, RawError: azure.BearerAuthorizer#WithAuthorization: Failed to refresh the Token for request to https://management.azure.com/subscriptions/12345/resourceGroups/rg1/providers/Microsoft.Compute/virtualMachines/?%24expand=instanceView&api-version=2022-03-01: StatusCode=400 -- Original Error: adal: Refresh request failed. Status Code = '400'. Response body: {"error":"invalid_request","error_description":"AADSTS90002: Tenant '1234' not found. Check to make sure you have the correct tenant ID and are signing into the correct cloud. Check with your subscription administrator, this may happen if there are no active subscriptions for the tenant.\r\nTrace ID: 3e41c796-ef83-46d2-a0ef-d61d69a5ae01\r\nCorrelation ID: 491fbea2-21cf-41b1-a44f-c07c8a328431\r\nTimestamp: 2022-12-30 13:11:14Z","error_codes":[90002],"timestamp":"2022-12-30 13:11:14Z","trace_id":"3e41c796-ef83-46d2-a0ef-d61d69a5ae01","correlation_id":"491fbea2-21cf-41b1-a44f-c07c8a328431","error_uri":"https://login.microsoftonline.com/error?code=90002"} Endpoint https://login.microsoftonline.com/1234/oauth2/token W1230 13:11:14.490354 11486 azuredisk.go:220] Failed to get node info. Error: NewNodeInfo: Failed to get instance type from Azure cloud provider, nodeName: , error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 400, RawError: azure.BearerAuthorizer#WithAuthorization: Failed to refresh the Token for request to https://management.azure.com/subscriptions/12345/resourceGroups/rg1/providers/Microsoft.Compute/virtualMachines/?%24expand=instanceView&api-version=2022-03-01: StatusCode=400 -- Original Error: adal: Refresh request failed. Status Code = '400'. Response body: {"error":"invalid_request","error_description":"AADSTS90002: Tenant '1234' not found. Check to make sure you have the correct tenant ID and are signing into the correct cloud. Check with your subscription administrator, this may happen if there are no active subscriptions for the tenant.\r\nTrace ID: 3e41c796-ef83-46d2-a0ef-d61d69a5ae01\r\nCorrelation ID: 491fbea2-21cf-41b1-a44f-c07c8a328431\r\nTimestamp: 2022-12-30 13:11:14Z","error_codes":[90002],"timestamp":"2022-12-30 13:11:14Z","trace_id":"3e41c796-ef83-46d2-a0ef-d61d69a5ae01","correlation_id":"491fbea2-21cf-41b1-a44f-c07c8a328431","error_uri":"https://login.microsoftonline.com/error?code=90002"} Endpoint https://login.microsoftonline.com/1234/oauth2/token I1230 13:11:14.493402 11486 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME I1230 13:11:14.493496 11486 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME I1230 13:11:14.493516 11486 driver.go:81] Enabling controller service capability: CREATE_DELETE_SNAPSHOT I1230 13:11:14.493527 11486 driver.go:81] Enabling controller service capability: CLONE_VOLUME I1230 13:11:14.493531 11486 driver.go:81] Enabling controller service capability: EXPAND_VOLUME I1230 13:11:14.493536 11486 driver.go:81] Enabling controller service capability: SINGLE_NODE_MULTI_WRITER ... skipping 258 lines ... I1230 13:11:14.554458 11486 driver.go:81] Enabling controller service capability: LIST_SNAPSHOTS I1230 13:11:14.554462 11486 driver.go:81] Enabling controller service capability: CLONE_VOLUME I1230 13:11:14.554466 11486 driver.go:81] Enabling controller service capability: EXPAND_VOLUME I1230 13:11:14.554470 11486 driver.go:81] Enabling controller service capability: LIST_VOLUMES I1230 13:11:14.554475 11486 driver.go:81] Enabling controller service capability: LIST_VOLUMES_PUBLISHED_NODES I1230 13:11:14.554480 11486 driver.go:100] Enabling volume access mode: SINGLE_NODE_WRITER E1230 13:11:14.554617 11486 controllerserver.go:302] validateDiskURI(123) in DeleteVolume failed with error: invalid DiskURI: 123, correct format: [/subscriptions/{sub-id}/resourcegroups/{group-name}/providers/microsoft.compute/disks/{disk-id}] --- PASS: TestDeleteVolume (0.00s) === RUN TestControllerGetVolume I1230 13:11:14.557092 11486 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME I1230 13:11:14.557117 11486 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME I1230 13:11:14.557123 11486 driver.go:81] Enabling controller service capability: CREATE_DELETE_SNAPSHOT I1230 13:11:14.557127 11486 driver.go:81] Enabling controller service capability: LIST_SNAPSHOTS ... skipping 54 lines ... I1230 13:11:14.570383 11486 driver.go:81] Enabling controller service capability: LIST_VOLUMES I1230 13:11:14.570387 11486 driver.go:81] Enabling controller service capability: LIST_VOLUMES_PUBLISHED_NODES I1230 13:11:14.570391 11486 driver.go:100] Enabling volume access mode: SINGLE_NODE_WRITER === RUN TestControllerPublishVolume/diskName_error === RUN TestControllerPublishVolume/NodeID_missing === RUN TestControllerPublishVolume/failed_provisioning_state W1230 13:11:14.570748 11486 controllerserver.go:392] VM(unit-test-node) is in failed state, update VM first === RUN TestControllerPublishVolume/Volume_already_attached_success I1230 13:11:14.573294 11486 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME I1230 13:11:14.573314 11486 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME I1230 13:11:14.573319 11486 driver.go:81] Enabling controller service capability: CREATE_DELETE_SNAPSHOT I1230 13:11:14.573323 11486 driver.go:81] Enabling controller service capability: LIST_SNAPSHOTS I1230 13:11:14.573326 11486 driver.go:81] Enabling controller service capability: CLONE_VOLUME ... skipping 671 lines ... I1230 13:11:14.733108 11486 driver.go:81] Enabling controller service capability: LIST_SNAPSHOTS I1230 13:11:14.733113 11486 driver.go:81] Enabling controller service capability: CLONE_VOLUME I1230 13:11:14.733119 11486 driver.go:81] Enabling controller service capability: EXPAND_VOLUME I1230 13:11:14.733124 11486 driver.go:81] Enabling controller service capability: LIST_VOLUMES I1230 13:11:14.733128 11486 driver.go:81] Enabling controller service capability: LIST_VOLUMES_PUBLISHED_NODES I1230 13:11:14.733133 11486 driver.go:100] Enabling volume access mode: SINGLE_NODE_WRITER E1230 13:11:14.733216 11486 nodeserver.go:558] mkdir failed on target: /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk/azuredisk.go (mkdir /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk/azuredisk.go: not a directory) --- PASS: TestEnsureMountPoint (0.00s) === RUN TestNodeGetInfo === RUN TestNodeGetInfo/[Success]_Get_node_information_for_existing_VM I1230 13:11:14.736419 11486 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME I1230 13:11:14.736451 11486 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME I1230 13:11:14.736458 11486 driver.go:81] Enabling controller service capability: CREATE_DELETE_SNAPSHOT ... skipping 11 lines ... I1230 13:11:14.739987 11486 driver.go:81] Enabling controller service capability: CLONE_VOLUME I1230 13:11:14.740018 11486 driver.go:81] Enabling controller service capability: EXPAND_VOLUME I1230 13:11:14.740048 11486 driver.go:81] Enabling controller service capability: LIST_VOLUMES I1230 13:11:14.740063 11486 driver.go:81] Enabling controller service capability: LIST_VOLUMES_PUBLISHED_NODES I1230 13:11:14.740078 11486 driver.go:100] Enabling volume access mode: SINGLE_NODE_WRITER W1230 13:11:14.740218 11486 azure_wrap.go:77] Unable to find node 375d1a42-8843-11ed-a5e9-0a6881d479c8: instance not found W1230 13:11:14.740266 11486 nodeserver.go:339] get zone(fakeNodeID) failed with: instance not found, fall back to get zone from node labels --- PASS: TestNodeGetInfo (0.01s) --- PASS: TestNodeGetInfo/[Success]_Get_node_information_for_existing_VM (0.00s) --- PASS: TestNodeGetInfo/[Failure]_Get_node_information_for_non-existing_VM (0.00s) === RUN TestNodeGetVolumeStats I1230 13:11:14.743178 11486 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME I1230 13:11:14.743245 11486 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME ... skipping 12 lines ... I1230 13:11:14.746656 11486 driver.go:81] Enabling controller service capability: LIST_SNAPSHOTS I1230 13:11:14.746671 11486 driver.go:81] Enabling controller service capability: CLONE_VOLUME I1230 13:11:14.746685 11486 driver.go:81] Enabling controller service capability: EXPAND_VOLUME I1230 13:11:14.746699 11486 driver.go:81] Enabling controller service capability: LIST_VOLUMES I1230 13:11:14.746712 11486 driver.go:81] Enabling controller service capability: LIST_VOLUMES_PUBLISHED_NODES I1230 13:11:14.746726 11486 driver.go:100] Enabling volume access mode: SINGLE_NODE_WRITER W1230 13:11:14.746958 11486 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/azure/scsi1/ failed, error: read /dev/disk/azure/scsi1/ error: bad dir W1230 13:11:14.747007 11486 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/by-id/ failed, error: read /dev/disk/by-id/ error: bad dir E1230 13:11:14.747058 11486 nodeserver.go:169] NodeStageVolume: could not determine if volume vol_1 needs to be resized: Failed readonly device check. Expected 1 or 0, got '16106127360' W1230 13:11:14.747092 11486 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/azure/scsi1/ failed, error: read /dev/disk/azure/scsi1/ error: bad dir W1230 13:11:14.747110 11486 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/by-id/ failed, error: read /dev/disk/by-id/ error: bad dir W1230 13:11:14.747157 11486 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/azure/scsi1/ failed, error: read /dev/disk/azure/scsi1/ error: bad dir W1230 13:11:14.747188 11486 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/by-id/ failed, error: read /dev/disk/by-id/ error: bad dir W1230 13:11:14.747255 11486 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/azure/scsi1/ failed, error: read /dev/disk/azure/scsi1/ error: bad dir W1230 13:11:14.747296 11486 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/by-id/ failed, error: read /dev/disk/by-id/ error: bad dir I1230 13:11:14.747367 11486 mount_linux.go:529] Disk "/dev/sdd" appears to be unformatted, attempting to format as type: "ext4" with options: [-F -m0 /dev/sdd] I1230 13:11:14.747409 11486 mount_linux.go:539] Disk successfully formatted (mkfs): ext4 - /dev/sdd /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk/source_test E1230 13:11:14.747438 11486 nodeserver.go:169] NodeStageVolume: could not determine if volume vol_1 needs to be resized: Failed readonly device check. Expected 1 or 0, got '' W1230 13:11:14.747489 11486 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/azure/scsi1/ failed, error: read /dev/disk/azure/scsi1/ error: bad dir W1230 13:11:14.747518 11486 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/by-id/ failed, error: read /dev/disk/by-id/ error: bad dir W1230 13:11:14.747567 11486 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/azure/scsi1/ failed, error: read /dev/disk/azure/scsi1/ error: bad dir W1230 13:11:14.747586 11486 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/by-id/ failed, error: read /dev/disk/by-id/ error: bad dir E1230 13:11:14.747636 11486 nodeserver.go:169] NodeStageVolume: could not determine if volume vol_1 needs to be resized: Failed readonly device check. Expected 1 or 0, got '16106127360' --- PASS: TestNodeStageVolume (0.00s) === RUN TestNodeUnstageVolume I1230 13:11:14.750554 11486 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME I1230 13:11:14.750621 11486 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME I1230 13:11:14.750639 11486 driver.go:81] Enabling controller service capability: CREATE_DELETE_SNAPSHOT I1230 13:11:14.750654 11486 driver.go:81] Enabling controller service capability: LIST_SNAPSHOTS ... skipping 11 lines ... I1230 13:11:14.753691 11486 driver.go:81] Enabling controller service capability: LIST_SNAPSHOTS I1230 13:11:14.753705 11486 driver.go:81] Enabling controller service capability: CLONE_VOLUME I1230 13:11:14.753719 11486 driver.go:81] Enabling controller service capability: EXPAND_VOLUME I1230 13:11:14.753733 11486 driver.go:81] Enabling controller service capability: LIST_VOLUMES I1230 13:11:14.753746 11486 driver.go:81] Enabling controller service capability: LIST_VOLUMES_PUBLISHED_NODES I1230 13:11:14.753769 11486 driver.go:100] Enabling volume access mode: SINGLE_NODE_WRITER E1230 13:11:14.753912 11486 nodeserver.go:558] mkdir failed on target: /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk/azuredisk.go (mkdir /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk/azuredisk.go: not a directory) --- PASS: TestNodePublishVolume (0.00s) === RUN TestNodeUnpublishVolume I1230 13:11:14.756865 11486 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME I1230 13:11:14.756936 11486 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME I1230 13:11:14.756954 11486 driver.go:81] Enabling controller service capability: CREATE_DELETE_SNAPSHOT I1230 13:11:14.756968 11486 driver.go:81] Enabling controller service capability: LIST_SNAPSHOTS ... skipping 33 lines ... I1230 13:11:14.769831 11486 driver.go:81] Enabling controller service capability: LIST_SNAPSHOTS I1230 13:11:14.769836 11486 driver.go:81] Enabling controller service capability: CLONE_VOLUME I1230 13:11:14.769840 11486 driver.go:81] Enabling controller service capability: EXPAND_VOLUME I1230 13:11:14.769844 11486 driver.go:81] Enabling controller service capability: LIST_VOLUMES I1230 13:11:14.769848 11486 driver.go:81] Enabling controller service capability: LIST_VOLUMES_PUBLISHED_NODES I1230 13:11:14.769853 11486 driver.go:100] Enabling volume access mode: SINGLE_NODE_WRITER E1230 13:11:14.770430 11486 nodeserver.go:558] mkdir failed on target: /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk/test (mkdir /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk/test: not a directory) --- PASS: TestEnsureBlockTargetFile (0.00s) === RUN TestMakeDir --- PASS: TestMakeDir (0.00s) === RUN TestGetDevicePathWithLUN I1230 13:11:14.773013 11486 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME I1230 13:11:14.773037 11486 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME ... skipping 44 lines ... --- PASS: TestCheckDiskName (0.00s) === RUN TestGetCachingMode --- PASS: TestGetCachingMode (0.00s) === RUN TestGetKubeConfig --- PASS: TestGetKubeConfig (0.00s) === RUN TestGetCloudProvider W1230 13:11:12.400814 11477 azure_disk_utils.go:189] load azure config from file(/etc/kubernetes/azure.json) failed with open /etc/kubernetes/azure.json: no such file or directory W1230 13:11:12.401166 11477 azure_disk_utils.go:230] get kubeconfig(/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/pkg/azureutils/empty-kube-config) failed with error: invalid configuration: no configuration has been provided, try setting KUBERNETES_MASTER environment variable W1230 13:11:12.401344 11477 azure_disk_utils.go:230] get kubeconfig() failed with error: open /var/run/secrets/kubernetes.io/serviceaccount/token: no such file or directory --- PASS: TestGetCloudProvider (0.00s) === RUN TestGetDiskLUN --- PASS: TestGetDiskLUN (0.00s) === RUN TestGetDiskName --- PASS: TestGetDiskName (0.00s) === RUN TestGetFStype ... skipping 426 lines ... coverage: 78.0% of statements ok sigs.k8s.io/azuredisk-csi-driver/test/utils/credentials 0.009s coverage: 78.0% of statements go test -v -cover -tags azurediskv2 ./pkg/azuredisk --temp-use-driver-v2 === RUN TestRescanAllVolumes --- PASS: TestRescanAllVolumes (0.00s) === RUN TestFindDiskByLun W1230 13:11:20.334549 11843 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/azure/scsi1/ failed, error: read /dev/disk/azure/scsi1/ error: bad dir W1230 13:11:20.334664 11843 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/by-id/ failed, error: read /dev/disk/by-id/ error: bad dir --- PASS: TestFindDiskByLun (0.00s) === RUN TestStrFirstLetterToUpper --- PASS: TestStrFirstLetterToUpper (0.00s) === RUN TestNewDriverV1 --- PASS: TestNewDriverV1 (0.00s) === RUN TestCheckDiskCapacity ... skipping 30 lines ... Git Commit: N/A Go Version: go1.19.4 Platform: linux/amd64 Topology Key: topology.disk.csi.azure.com/zone Streaming logs below: W1230 13:11:20.341661 11843 azure_disk_utils.go:230] get kubeconfig() failed with error: open /var/run/secrets/kubernetes.io/serviceaccount/token: no such file or directory I1230 13:11:20.345227 11843 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME I1230 13:11:20.345253 11843 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME I1230 13:11:20.345259 11843 driver.go:81] Enabling controller service capability: CREATE_DELETE_SNAPSHOT I1230 13:11:20.345265 11843 driver.go:81] Enabling controller service capability: LIST_SNAPSHOTS I1230 13:11:20.345271 11843 driver.go:81] Enabling controller service capability: CLONE_VOLUME I1230 13:11:20.345278 11843 driver.go:81] Enabling controller service capability: EXPAND_VOLUME ... skipping 26 lines ... Git Commit: N/A Go Version: go1.19.4 Platform: linux/amd64 Topology Key: topology.disk.csi.azure.com/zone Streaming logs below: W1230 13:11:20.349621 11843 azure_disk_utils.go:230] get kubeconfig() failed with error: open /var/run/secrets/kubernetes.io/serviceaccount/token: no such file or directory I1230 13:11:20.352646 11843 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME I1230 13:11:20.352670 11843 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME I1230 13:11:20.352674 11843 driver.go:81] Enabling controller service capability: CREATE_DELETE_SNAPSHOT I1230 13:11:20.352678 11843 driver.go:81] Enabling controller service capability: LIST_SNAPSHOTS I1230 13:11:20.352682 11843 driver.go:81] Enabling controller service capability: CLONE_VOLUME I1230 13:11:20.352686 11843 driver.go:81] Enabling controller service capability: EXPAND_VOLUME ... skipping 16 lines ... Git Commit: N/A Go Version: go1.19.4 Platform: linux/amd64 Topology Key: topology.disk.csi.azure.com/zone Streaming logs below: W1230 13:11:20.353761 11843 azure_disk_utils.go:230] get kubeconfig() failed with error: open /var/run/secrets/kubernetes.io/serviceaccount/token: no such file or directory E1230 13:11:20.613220 11843 util.go:138] Send.sendRequest: error in parsing response body string "": unexpected end of JSON input, Skip retrying regional host E1230 13:11:20.613480 11843 azure_standard.go:587] as.GetInstanceTypeByNodeName() failed: as.getVirtualMachine() err=Retriable: false, RetryAfter: 0s, HTTPStatusCode: 400, RawError: azure.BearerAuthorizer#WithAuthorization: Failed to refresh the Token for request to https://management.azure.com/subscriptions/12345/resourceGroups/rg1/providers/Microsoft.Compute/virtualMachines/?%24expand=instanceView&api-version=2022-03-01: StatusCode=400 -- Original Error: adal: Refresh request failed. Status Code = '400'. Response body: {"error":"invalid_request","error_description":"AADSTS90002: Tenant '1234' not found. Check to make sure you have the correct tenant ID and are signing into the correct cloud. Check with your subscription administrator, this may happen if there are no active subscriptions for the tenant.\r\nTrace ID: b4675363-d3ce-42df-bcca-d505921e9802\r\nCorrelation ID: 01d907d6-7d78-4b11-b24a-64a1fca07e75\r\nTimestamp: 2022-12-30 13:11:20Z","error_codes":[90002],"timestamp":"2022-12-30 13:11:20Z","trace_id":"b4675363-d3ce-42df-bcca-d505921e9802","correlation_id":"01d907d6-7d78-4b11-b24a-64a1fca07e75","error_uri":"https://login.microsoftonline.com/error?code=90002"} Endpoint https://login.microsoftonline.com/1234/oauth2/token W1230 13:11:20.613521 11843 azuredisk.go:220] Failed to get node info. Error: NewNodeInfo: Failed to get instance type from Azure cloud provider, nodeName: , error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 400, RawError: azure.BearerAuthorizer#WithAuthorization: Failed to refresh the Token for request to https://management.azure.com/subscriptions/12345/resourceGroups/rg1/providers/Microsoft.Compute/virtualMachines/?%24expand=instanceView&api-version=2022-03-01: StatusCode=400 -- Original Error: adal: Refresh request failed. Status Code = '400'. Response body: {"error":"invalid_request","error_description":"AADSTS90002: Tenant '1234' not found. Check to make sure you have the correct tenant ID and are signing into the correct cloud. Check with your subscription administrator, this may happen if there are no active subscriptions for the tenant.\r\nTrace ID: b4675363-d3ce-42df-bcca-d505921e9802\r\nCorrelation ID: 01d907d6-7d78-4b11-b24a-64a1fca07e75\r\nTimestamp: 2022-12-30 13:11:20Z","error_codes":[90002],"timestamp":"2022-12-30 13:11:20Z","trace_id":"b4675363-d3ce-42df-bcca-d505921e9802","correlation_id":"01d907d6-7d78-4b11-b24a-64a1fca07e75","error_uri":"https://login.microsoftonline.com/error?code=90002"} Endpoint https://login.microsoftonline.com/1234/oauth2/token I1230 13:11:20.616887 11843 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME I1230 13:11:20.616921 11843 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME I1230 13:11:20.616926 11843 driver.go:81] Enabling controller service capability: CREATE_DELETE_SNAPSHOT I1230 13:11:20.616930 11843 driver.go:81] Enabling controller service capability: CLONE_VOLUME I1230 13:11:20.616934 11843 driver.go:81] Enabling controller service capability: EXPAND_VOLUME I1230 13:11:20.616938 11843 driver.go:81] Enabling controller service capability: SINGLE_NODE_MULTI_WRITER ... skipping 254 lines ... I1230 13:11:20.676564 11843 driver.go:81] Enabling controller service capability: LIST_SNAPSHOTS I1230 13:11:20.676580 11843 driver.go:81] Enabling controller service capability: CLONE_VOLUME I1230 13:11:20.676602 11843 driver.go:81] Enabling controller service capability: EXPAND_VOLUME I1230 13:11:20.676639 11843 driver.go:81] Enabling controller service capability: LIST_VOLUMES I1230 13:11:20.676761 11843 driver.go:81] Enabling controller service capability: LIST_VOLUMES_PUBLISHED_NODES I1230 13:11:20.676802 11843 driver.go:100] Enabling volume access mode: SINGLE_NODE_WRITER E1230 13:11:20.677036 11843 controllerserver_v2.go:256] validateDiskURI(123) in DeleteVolume failed with error: invalid DiskURI: 123, correct format: [/subscriptions/{sub-id}/resourcegroups/{group-name}/providers/microsoft.compute/disks/{disk-id}] --- PASS: TestDeleteVolume (0.00s) === RUN TestControllerGetVolume W1230 13:11:20.677142 11843 fake_azuredisk_v2.go:57] Using DriverV2 I1230 13:11:20.679620 11843 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME I1230 13:11:20.679723 11843 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME I1230 13:11:20.679744 11843 driver.go:81] Enabling controller service capability: CREATE_DELETE_SNAPSHOT ... skipping 60 lines ... I1230 13:11:20.694118 11843 driver.go:81] Enabling controller service capability: LIST_VOLUMES I1230 13:11:20.694121 11843 driver.go:81] Enabling controller service capability: LIST_VOLUMES_PUBLISHED_NODES I1230 13:11:20.694126 11843 driver.go:100] Enabling volume access mode: SINGLE_NODE_WRITER === RUN TestControllerPublishVolume/diskName_error === RUN TestControllerPublishVolume/NodeID_missing === RUN TestControllerPublishVolume/failed_provisioning_state W1230 13:11:20.694585 11843 controllerserver_v2.go:341] VM(unit-test-node) is in failed state, update VM first === RUN TestControllerPublishVolume/Volume_already_attached_success W1230 13:11:20.694725 11843 fake_azuredisk_v2.go:57] Using DriverV2 I1230 13:11:20.697451 11843 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME I1230 13:11:20.697478 11843 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME I1230 13:11:20.697483 11843 driver.go:81] Enabling controller service capability: CREATE_DELETE_SNAPSHOT I1230 13:11:20.697487 11843 driver.go:81] Enabling controller service capability: LIST_SNAPSHOTS ... skipping 731 lines ... I1230 13:11:20.864349 11843 driver.go:81] Enabling controller service capability: LIST_SNAPSHOTS I1230 13:11:20.864353 11843 driver.go:81] Enabling controller service capability: CLONE_VOLUME I1230 13:11:20.864358 11843 driver.go:81] Enabling controller service capability: EXPAND_VOLUME I1230 13:11:20.864361 11843 driver.go:81] Enabling controller service capability: LIST_VOLUMES I1230 13:11:20.864364 11843 driver.go:81] Enabling controller service capability: LIST_VOLUMES_PUBLISHED_NODES I1230 13:11:20.864369 11843 driver.go:100] Enabling volume access mode: SINGLE_NODE_WRITER E1230 13:11:20.864452 11843 nodeserver_v2.go:543] mkdir failed on target: /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk/azuredisk.go (mkdir /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk/azuredisk.go: not a directory) --- PASS: TestEnsureMountPoint (0.00s) === RUN TestNodeGetInfo === RUN TestNodeGetInfo/[Success]_Get_node_information_for_existing_VM W1230 13:11:20.864959 11843 fake_azuredisk_v2.go:57] Using DriverV2 I1230 13:11:20.867565 11843 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME I1230 13:11:20.867633 11843 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME ... skipping 13 lines ... I1230 13:11:20.870818 11843 driver.go:81] Enabling controller service capability: CLONE_VOLUME I1230 13:11:20.870822 11843 driver.go:81] Enabling controller service capability: EXPAND_VOLUME I1230 13:11:20.870825 11843 driver.go:81] Enabling controller service capability: LIST_VOLUMES I1230 13:11:20.870829 11843 driver.go:81] Enabling controller service capability: LIST_VOLUMES_PUBLISHED_NODES I1230 13:11:20.870833 11843 driver.go:100] Enabling volume access mode: SINGLE_NODE_WRITER W1230 13:11:20.870927 11843 azure_wrap.go:77] Unable to find node 375d1a42-8843-11ed-a5e9-0a6881d479c8: instance not found W1230 13:11:20.871109 11843 nodeserver_v2.go:336] get zone(fakeNodeID) failed with: instance not found, fall back to get zone from node labels --- PASS: TestNodeGetInfo (0.01s) --- PASS: TestNodeGetInfo/[Success]_Get_node_information_for_existing_VM (0.00s) --- PASS: TestNodeGetInfo/[Failure]_Get_node_information_for_non-existing_VM (0.00s) === RUN TestNodeGetVolumeStats W1230 13:11:20.871398 11843 fake_azuredisk_v2.go:57] Using DriverV2 I1230 13:11:20.873851 11843 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME ... skipping 14 lines ... I1230 13:11:20.876600 11843 driver.go:81] Enabling controller service capability: LIST_SNAPSHOTS I1230 13:11:20.876604 11843 driver.go:81] Enabling controller service capability: CLONE_VOLUME I1230 13:11:20.876608 11843 driver.go:81] Enabling controller service capability: EXPAND_VOLUME I1230 13:11:20.876612 11843 driver.go:81] Enabling controller service capability: LIST_VOLUMES I1230 13:11:20.876616 11843 driver.go:81] Enabling controller service capability: LIST_VOLUMES_PUBLISHED_NODES I1230 13:11:20.876621 11843 driver.go:100] Enabling volume access mode: SINGLE_NODE_WRITER W1230 13:11:20.876834 11843 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/azure/scsi1/ failed, error: read /dev/disk/azure/scsi1/ error: bad dir W1230 13:11:20.876863 11843 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/by-id/ failed, error: read /dev/disk/by-id/ error: bad dir E1230 13:11:20.876928 11843 nodeserver_v2.go:157] NodeStageVolume: could not determine if volume vol_1 needs to be resized: Failed readonly device check. Expected 1 or 0, got '16106127360' W1230 13:11:20.876963 11843 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/azure/scsi1/ failed, error: read /dev/disk/azure/scsi1/ error: bad dir W1230 13:11:20.876983 11843 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/by-id/ failed, error: read /dev/disk/by-id/ error: bad dir W1230 13:11:20.877031 11843 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/azure/scsi1/ failed, error: read /dev/disk/azure/scsi1/ error: bad dir W1230 13:11:20.877049 11843 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/by-id/ failed, error: read /dev/disk/by-id/ error: bad dir W1230 13:11:20.877122 11843 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/azure/scsi1/ failed, error: read /dev/disk/azure/scsi1/ error: bad dir W1230 13:11:20.877143 11843 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/by-id/ failed, error: read /dev/disk/by-id/ error: bad dir I1230 13:11:20.877238 11843 mount_linux.go:529] Disk "/dev/sdd" appears to be unformatted, attempting to format as type: "ext4" with options: [-F -m0 /dev/sdd] I1230 13:11:20.877273 11843 mount_linux.go:539] Disk successfully formatted (mkfs): ext4 - /dev/sdd /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk/source_test E1230 13:11:20.877296 11843 nodeserver_v2.go:157] NodeStageVolume: could not determine if volume vol_1 needs to be resized: Failed readonly device check. Expected 1 or 0, got '' W1230 13:11:20.877353 11843 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/azure/scsi1/ failed, error: read /dev/disk/azure/scsi1/ error: bad dir W1230 13:11:20.877376 11843 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/by-id/ failed, error: read /dev/disk/by-id/ error: bad dir W1230 13:11:20.877433 11843 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/azure/scsi1/ failed, error: read /dev/disk/azure/scsi1/ error: bad dir W1230 13:11:20.877455 11843 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/by-id/ failed, error: read /dev/disk/by-id/ error: bad dir E1230 13:11:20.877519 11843 nodeserver_v2.go:157] NodeStageVolume: could not determine if volume vol_1 needs to be resized: Failed readonly device check. Expected 1 or 0, got '16106127360' --- PASS: TestNodeStageVolume (0.00s) === RUN TestNodeUnstageVolume W1230 13:11:20.877691 11843 fake_azuredisk_v2.go:57] Using DriverV2 I1230 13:11:20.880483 11843 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME I1230 13:11:20.880509 11843 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME I1230 13:11:20.880514 11843 driver.go:81] Enabling controller service capability: CREATE_DELETE_SNAPSHOT ... skipping 13 lines ... I1230 13:11:20.883400 11843 driver.go:81] Enabling controller service capability: LIST_SNAPSHOTS I1230 13:11:20.883406 11843 driver.go:81] Enabling controller service capability: CLONE_VOLUME I1230 13:11:20.883416 11843 driver.go:81] Enabling controller service capability: EXPAND_VOLUME I1230 13:11:20.883424 11843 driver.go:81] Enabling controller service capability: LIST_VOLUMES I1230 13:11:20.883429 11843 driver.go:81] Enabling controller service capability: LIST_VOLUMES_PUBLISHED_NODES I1230 13:11:20.883435 11843 driver.go:100] Enabling volume access mode: SINGLE_NODE_WRITER E1230 13:11:20.883624 11843 nodeserver_v2.go:543] mkdir failed on target: /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk/azuredisk.go (mkdir /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk/azuredisk.go: not a directory) --- PASS: TestNodePublishVolume (0.00s) === RUN TestNodeUnpublishVolume W1230 13:11:20.883943 11843 fake_azuredisk_v2.go:57] Using DriverV2 I1230 13:11:20.886582 11843 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME I1230 13:11:20.886609 11843 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME I1230 13:11:20.886614 11843 driver.go:81] Enabling controller service capability: CREATE_DELETE_SNAPSHOT ... skipping 37 lines ... I1230 13:11:20.897719 11843 driver.go:81] Enabling controller service capability: LIST_SNAPSHOTS I1230 13:11:20.897723 11843 driver.go:81] Enabling controller service capability: CLONE_VOLUME I1230 13:11:20.897727 11843 driver.go:81] Enabling controller service capability: EXPAND_VOLUME I1230 13:11:20.897731 11843 driver.go:81] Enabling controller service capability: LIST_VOLUMES I1230 13:11:20.897734 11843 driver.go:81] Enabling controller service capability: LIST_VOLUMES_PUBLISHED_NODES I1230 13:11:20.897739 11843 driver.go:100] Enabling volume access mode: SINGLE_NODE_WRITER E1230 13:11:20.898298 11843 nodeserver_v2.go:543] mkdir failed on target: /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk/test (mkdir /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk/test: not a directory) --- PASS: TestEnsureBlockTargetFile (0.00s) === RUN TestMakeDir --- PASS: TestMakeDir (0.00s) === RUN TestGetDevicePathWithLUN W1230 13:11:20.898557 11843 fake_azuredisk_v2.go:57] Using DriverV2 I1230 13:11:20.901130 11843 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME ... skipping 185 lines ... - ForceAttemptHTTP2: false, // respect custom dialer (default is true) + ForceAttemptHTTP2: true, // always attempt HTTP/2 even though custom dialer is provided MaxIdleConns: 100, // Zero means no limit, the same as default transport MaxIdleConnsPerHost: 100, // Default is 2, ref:https://cs.opensource.google/go/go/+/go1.18.4:src/net/http/transport.go;l=58 IdleConnTimeout: 90 * time.Second, // the same as default transport error make: *** [Makefile:85: verify] Error 1 + EXIT_VALUE=2 + set +o xtrace