Recent runs || View in Spyglass
PR | andyzhangx: [WIP] test |
Result | FAILURE |
Tests | 0 failed / 0 succeeded |
Started | |
Elapsed | 6m34s |
Revision | 03be4358a3827fdd863e547c1bc2cd1a2ab0135e |
Refs |
1685 |
... skipping 3 lines ... + wait 28 go test -v -cover ./pkg/... ./test/utils/credentials ? sigs.k8s.io/azuredisk-csi-driver/pkg/azureconstants [no test files] === RUN TestRescanAllVolumes --- PASS: TestRescanAllVolumes (0.00s) === RUN TestFindDiskByLun W0109 12:33:38.434153 11717 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/azure/scsi1/ failed, error: read /dev/disk/azure/scsi1/ error: bad dir W0109 12:33:38.434316 11717 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/by-id/ failed, error: read /dev/disk/by-id/ error: bad dir --- PASS: TestFindDiskByLun (0.00s) === RUN TestStrFirstLetterToUpper --- PASS: TestStrFirstLetterToUpper (0.00s) === RUN TestNewDriverV1 --- PASS: TestNewDriverV1 (0.00s) === RUN TestCheckDiskCapacity ... skipping 28 lines ... Git Commit: N/A Go Version: go1.19.4 Platform: linux/amd64 Topology Key: topology.disk.csi.azure.com/zone Streaming logs below: W0109 12:33:38.451291 11717 azure_disk_utils.go:230] get kubeconfig() failed with error: open /var/run/secrets/kubernetes.io/serviceaccount/token: no such file or directory I0109 12:33:38.459744 11717 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME I0109 12:33:38.459829 11717 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME I0109 12:33:38.459840 11717 driver.go:81] Enabling controller service capability: CREATE_DELETE_SNAPSHOT I0109 12:33:38.459848 11717 driver.go:81] Enabling controller service capability: CLONE_VOLUME I0109 12:33:38.459885 11717 driver.go:81] Enabling controller service capability: EXPAND_VOLUME I0109 12:33:38.459927 11717 driver.go:81] Enabling controller service capability: SINGLE_NODE_MULTI_WRITER ... skipping 22 lines ... Git Commit: N/A Go Version: go1.19.4 Platform: linux/amd64 Topology Key: topology.disk.csi.azure.com/zone Streaming logs below: W0109 12:33:38.471832 11717 azure_disk_utils.go:230] get kubeconfig() failed with error: open /var/run/secrets/kubernetes.io/serviceaccount/token: no such file or directory I0109 12:33:38.479897 11717 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME I0109 12:33:38.479960 11717 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME I0109 12:33:38.479988 11717 driver.go:81] Enabling controller service capability: CREATE_DELETE_SNAPSHOT I0109 12:33:38.480006 11717 driver.go:81] Enabling controller service capability: CLONE_VOLUME I0109 12:33:38.480038 11717 driver.go:81] Enabling controller service capability: EXPAND_VOLUME I0109 12:33:38.480069 11717 driver.go:81] Enabling controller service capability: SINGLE_NODE_MULTI_WRITER ... skipping 13 lines ... Git Commit: N/A Go Version: go1.19.4 Platform: linux/amd64 Topology Key: topology.disk.csi.azure.com/zone Streaming logs below: W0109 12:33:38.482106 11717 azure_disk_utils.go:230] get kubeconfig() failed with error: open /var/run/secrets/kubernetes.io/serviceaccount/token: no such file or directory E0109 12:33:38.748630 11717 util.go:138] Send.sendRequest: error in parsing response body string "": unexpected end of JSON input, Skip retrying regional host E0109 12:33:38.748851 11717 azure_standard.go:587] as.GetInstanceTypeByNodeName() failed: as.getVirtualMachine() err=Retriable: false, RetryAfter: 0s, HTTPStatusCode: 400, RawError: azure.BearerAuthorizer#WithAuthorization: Failed to refresh the Token for request to https://management.azure.com/subscriptions/12345/resourceGroups/rg1/providers/Microsoft.Compute/virtualMachines/?%24expand=instanceView&api-version=2022-03-01: StatusCode=400 -- Original Error: adal: Refresh request failed. Status Code = '400'. Response body: {"error":"invalid_request","error_description":"AADSTS90002: Tenant '1234' not found. Check to make sure you have the correct tenant ID and are signing into the correct cloud. Check with your subscription administrator, this may happen if there are no active subscriptions for the tenant.\r\nTrace ID: d961600c-72b4-4d72-a244-fb74478fc902\r\nCorrelation ID: d744130f-5dfc-4a42-9b83-128de19fe60a\r\nTimestamp: 2023-01-09 12:33:38Z","error_codes":[90002],"timestamp":"2023-01-09 12:33:38Z","trace_id":"d961600c-72b4-4d72-a244-fb74478fc902","correlation_id":"d744130f-5dfc-4a42-9b83-128de19fe60a","error_uri":"https://login.microsoftonline.com/error?code=90002"} Endpoint https://login.microsoftonline.com/1234/oauth2/token W0109 12:33:38.748889 11717 azuredisk.go:220] Failed to get node info. Error: NewNodeInfo: Failed to get instance type from Azure cloud provider, nodeName: , error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 400, RawError: azure.BearerAuthorizer#WithAuthorization: Failed to refresh the Token for request to https://management.azure.com/subscriptions/12345/resourceGroups/rg1/providers/Microsoft.Compute/virtualMachines/?%24expand=instanceView&api-version=2022-03-01: StatusCode=400 -- Original Error: adal: Refresh request failed. Status Code = '400'. Response body: {"error":"invalid_request","error_description":"AADSTS90002: Tenant '1234' not found. Check to make sure you have the correct tenant ID and are signing into the correct cloud. Check with your subscription administrator, this may happen if there are no active subscriptions for the tenant.\r\nTrace ID: d961600c-72b4-4d72-a244-fb74478fc902\r\nCorrelation ID: d744130f-5dfc-4a42-9b83-128de19fe60a\r\nTimestamp: 2023-01-09 12:33:38Z","error_codes":[90002],"timestamp":"2023-01-09 12:33:38Z","trace_id":"d961600c-72b4-4d72-a244-fb74478fc902","correlation_id":"d744130f-5dfc-4a42-9b83-128de19fe60a","error_uri":"https://login.microsoftonline.com/error?code=90002"} Endpoint https://login.microsoftonline.com/1234/oauth2/token I0109 12:33:38.754892 11717 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME I0109 12:33:38.754920 11717 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME I0109 12:33:38.754927 11717 driver.go:81] Enabling controller service capability: CREATE_DELETE_SNAPSHOT I0109 12:33:38.754934 11717 driver.go:81] Enabling controller service capability: CLONE_VOLUME I0109 12:33:38.754939 11717 driver.go:81] Enabling controller service capability: EXPAND_VOLUME I0109 12:33:38.754945 11717 driver.go:81] Enabling controller service capability: SINGLE_NODE_MULTI_WRITER ... skipping 258 lines ... I0109 12:33:38.960057 11717 driver.go:81] Enabling controller service capability: LIST_SNAPSHOTS I0109 12:33:38.960063 11717 driver.go:81] Enabling controller service capability: CLONE_VOLUME I0109 12:33:38.960069 11717 driver.go:81] Enabling controller service capability: EXPAND_VOLUME I0109 12:33:38.960091 11717 driver.go:81] Enabling controller service capability: LIST_VOLUMES I0109 12:33:38.960103 11717 driver.go:81] Enabling controller service capability: LIST_VOLUMES_PUBLISHED_NODES I0109 12:33:38.960113 11717 driver.go:100] Enabling volume access mode: SINGLE_NODE_WRITER E0109 12:33:38.960337 11717 controllerserver.go:302] validateDiskURI(123) in DeleteVolume failed with error: invalid DiskURI: 123, correct format: [/subscriptions/{sub-id}/resourcegroups/{group-name}/providers/microsoft.compute/disks/{disk-id}] --- PASS: TestDeleteVolume (0.01s) === RUN TestControllerGetVolume I0109 12:33:38.966476 11717 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME I0109 12:33:38.966504 11717 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME I0109 12:33:38.966511 11717 driver.go:81] Enabling controller service capability: CREATE_DELETE_SNAPSHOT I0109 12:33:38.966518 11717 driver.go:81] Enabling controller service capability: LIST_SNAPSHOTS ... skipping 54 lines ... I0109 12:33:38.998502 11717 driver.go:81] Enabling controller service capability: LIST_VOLUMES I0109 12:33:38.998528 11717 driver.go:81] Enabling controller service capability: LIST_VOLUMES_PUBLISHED_NODES I0109 12:33:38.998546 11717 driver.go:100] Enabling volume access mode: SINGLE_NODE_WRITER === RUN TestControllerPublishVolume/diskName_error === RUN TestControllerPublishVolume/NodeID_missing === RUN TestControllerPublishVolume/failed_provisioning_state W0109 12:33:39.000094 11717 controllerserver.go:392] VM(unit-test-node) is in failed state, update VM first === RUN TestControllerPublishVolume/Volume_already_attached_success I0109 12:33:39.004565 11717 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME I0109 12:33:39.004593 11717 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME I0109 12:33:39.004601 11717 driver.go:81] Enabling controller service capability: CREATE_DELETE_SNAPSHOT I0109 12:33:39.004608 11717 driver.go:81] Enabling controller service capability: LIST_SNAPSHOTS I0109 12:33:39.004615 11717 driver.go:81] Enabling controller service capability: CLONE_VOLUME ... skipping 671 lines ... I0109 12:33:39.397290 11717 driver.go:81] Enabling controller service capability: LIST_SNAPSHOTS I0109 12:33:39.397309 11717 driver.go:81] Enabling controller service capability: CLONE_VOLUME I0109 12:33:39.397318 11717 driver.go:81] Enabling controller service capability: EXPAND_VOLUME I0109 12:33:39.397323 11717 driver.go:81] Enabling controller service capability: LIST_VOLUMES I0109 12:33:39.397330 11717 driver.go:81] Enabling controller service capability: LIST_VOLUMES_PUBLISHED_NODES I0109 12:33:39.397338 11717 driver.go:100] Enabling volume access mode: SINGLE_NODE_WRITER E0109 12:33:39.397613 11717 nodeserver.go:571] mkdir failed on target: /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk/azuredisk.go (mkdir /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk/azuredisk.go: not a directory) --- PASS: TestEnsureMountPoint (0.01s) === RUN TestNodeGetInfo === RUN TestNodeGetInfo/[Success]_Get_node_information_for_existing_VM I0109 12:33:39.405158 11717 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME I0109 12:33:39.405198 11717 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME I0109 12:33:39.405208 11717 driver.go:81] Enabling controller service capability: CREATE_DELETE_SNAPSHOT ... skipping 11 lines ... I0109 12:33:39.411574 11717 driver.go:81] Enabling controller service capability: CLONE_VOLUME I0109 12:33:39.411581 11717 driver.go:81] Enabling controller service capability: EXPAND_VOLUME I0109 12:33:39.411587 11717 driver.go:81] Enabling controller service capability: LIST_VOLUMES I0109 12:33:39.411594 11717 driver.go:81] Enabling controller service capability: LIST_VOLUMES_PUBLISHED_NODES I0109 12:33:39.411602 11717 driver.go:100] Enabling volume access mode: SINGLE_NODE_WRITER W0109 12:33:39.411732 11717 azure_wrap.go:77] Unable to find node 4161bc48-9019-11ed-ba30-1ae85b331012: instance not found W0109 12:33:39.411763 11717 nodeserver.go:339] get zone(fakeNodeID) failed with: instance not found, fall back to get zone from node labels --- PASS: TestNodeGetInfo (0.01s) --- PASS: TestNodeGetInfo/[Success]_Get_node_information_for_existing_VM (0.01s) --- PASS: TestNodeGetInfo/[Failure]_Get_node_information_for_non-existing_VM (0.01s) === RUN TestNodeGetVolumeStats I0109 12:33:39.418751 11717 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME I0109 12:33:39.418845 11717 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME ... skipping 12 lines ... I0109 12:33:39.425996 11717 driver.go:81] Enabling controller service capability: LIST_SNAPSHOTS I0109 12:33:39.426001 11717 driver.go:81] Enabling controller service capability: CLONE_VOLUME I0109 12:33:39.426008 11717 driver.go:81] Enabling controller service capability: EXPAND_VOLUME I0109 12:33:39.426014 11717 driver.go:81] Enabling controller service capability: LIST_VOLUMES I0109 12:33:39.426020 11717 driver.go:81] Enabling controller service capability: LIST_VOLUMES_PUBLISHED_NODES I0109 12:33:39.426026 11717 driver.go:100] Enabling volume access mode: SINGLE_NODE_WRITER W0109 12:33:39.426440 11717 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/azure/scsi1/ failed, error: read /dev/disk/azure/scsi1/ error: bad dir W0109 12:33:39.426537 11717 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/by-id/ failed, error: read /dev/disk/by-id/ error: bad dir E0109 12:33:39.426731 11717 nodeserver.go:169] NodeStageVolume: could not determine if volume vol_1 needs to be resized: Failed readonly device check. Expected 1 or 0, got '16106127360' W0109 12:33:39.426855 11717 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/azure/scsi1/ failed, error: read /dev/disk/azure/scsi1/ error: bad dir W0109 12:33:39.426894 11717 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/by-id/ failed, error: read /dev/disk/by-id/ error: bad dir W0109 12:33:39.427055 11717 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/azure/scsi1/ failed, error: read /dev/disk/azure/scsi1/ error: bad dir W0109 12:33:39.427133 11717 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/by-id/ failed, error: read /dev/disk/by-id/ error: bad dir W0109 12:33:39.427373 11717 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/azure/scsi1/ failed, error: read /dev/disk/azure/scsi1/ error: bad dir W0109 12:33:39.427438 11717 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/by-id/ failed, error: read /dev/disk/by-id/ error: bad dir I0109 12:33:39.427601 11717 mount_linux.go:529] Disk "/dev/sdd" appears to be unformatted, attempting to format as type: "ext4" with options: [-F -m0 /dev/sdd] I0109 12:33:39.427683 11717 mount_linux.go:539] Disk successfully formatted (mkfs): ext4 - /dev/sdd /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk/source_test E0109 12:33:39.427752 11717 nodeserver.go:169] NodeStageVolume: could not determine if volume vol_1 needs to be resized: Failed readonly device check. Expected 1 or 0, got '' W0109 12:33:39.427981 11717 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/azure/scsi1/ failed, error: read /dev/disk/azure/scsi1/ error: bad dir W0109 12:33:39.428048 11717 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/by-id/ failed, error: read /dev/disk/by-id/ error: bad dir W0109 12:33:39.428289 11717 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/azure/scsi1/ failed, error: read /dev/disk/azure/scsi1/ error: bad dir W0109 12:33:39.428365 11717 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/by-id/ failed, error: read /dev/disk/by-id/ error: bad dir E0109 12:33:39.428529 11717 nodeserver.go:169] NodeStageVolume: could not determine if volume vol_1 needs to be resized: Failed readonly device check. Expected 1 or 0, got '16106127360' --- PASS: TestNodeStageVolume (0.01s) === RUN TestNodeUnstageVolume I0109 12:33:39.435555 11717 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME I0109 12:33:39.435588 11717 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME I0109 12:33:39.435600 11717 driver.go:81] Enabling controller service capability: CREATE_DELETE_SNAPSHOT I0109 12:33:39.435608 11717 driver.go:81] Enabling controller service capability: LIST_SNAPSHOTS ... skipping 11 lines ... I0109 12:33:39.445750 11717 driver.go:81] Enabling controller service capability: LIST_SNAPSHOTS I0109 12:33:39.445773 11717 driver.go:81] Enabling controller service capability: CLONE_VOLUME I0109 12:33:39.445801 11717 driver.go:81] Enabling controller service capability: EXPAND_VOLUME I0109 12:33:39.445838 11717 driver.go:81] Enabling controller service capability: LIST_VOLUMES I0109 12:33:39.445862 11717 driver.go:81] Enabling controller service capability: LIST_VOLUMES_PUBLISHED_NODES I0109 12:33:39.445901 11717 driver.go:100] Enabling volume access mode: SINGLE_NODE_WRITER E0109 12:33:39.446611 11717 nodeserver.go:571] mkdir failed on target: /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk/azuredisk.go (mkdir /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk/azuredisk.go: not a directory) --- PASS: TestNodePublishVolume (0.01s) === RUN TestNodeUnpublishVolume I0109 12:33:39.455256 11717 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME I0109 12:33:39.455295 11717 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME I0109 12:33:39.455314 11717 driver.go:81] Enabling controller service capability: CREATE_DELETE_SNAPSHOT I0109 12:33:39.455342 11717 driver.go:81] Enabling controller service capability: LIST_SNAPSHOTS ... skipping 33 lines ... I0109 12:33:39.499343 11717 driver.go:81] Enabling controller service capability: LIST_SNAPSHOTS I0109 12:33:39.499440 11717 driver.go:81] Enabling controller service capability: CLONE_VOLUME I0109 12:33:39.499489 11717 driver.go:81] Enabling controller service capability: EXPAND_VOLUME I0109 12:33:39.499547 11717 driver.go:81] Enabling controller service capability: LIST_VOLUMES I0109 12:33:39.499656 11717 driver.go:81] Enabling controller service capability: LIST_VOLUMES_PUBLISHED_NODES I0109 12:33:39.499749 11717 driver.go:100] Enabling volume access mode: SINGLE_NODE_WRITER E0109 12:33:39.501466 11717 nodeserver.go:571] mkdir failed on target: /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk/test (mkdir /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk/test: not a directory) --- PASS: TestEnsureBlockTargetFile (0.01s) === RUN TestMakeDir --- PASS: TestMakeDir (0.00s) === RUN TestGetDevicePathWithLUN I0109 12:33:39.510414 11717 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME I0109 12:33:39.510706 11717 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME ... skipping 44 lines ... --- PASS: TestCheckDiskName (0.00s) === RUN TestGetCachingMode --- PASS: TestGetCachingMode (0.00s) === RUN TestGetKubeConfig --- PASS: TestGetKubeConfig (0.00s) === RUN TestGetCloudProvider W0109 12:33:32.209962 11682 azure_disk_utils.go:189] load azure config from file(/etc/kubernetes/azure.json) failed with open /etc/kubernetes/azure.json: no such file or directory W0109 12:33:32.210442 11682 azure_disk_utils.go:230] get kubeconfig(/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/pkg/azureutils/empty-kube-config) failed with error: invalid configuration: no configuration has been provided, try setting KUBERNETES_MASTER environment variable W0109 12:33:32.210729 11682 azure_disk_utils.go:230] get kubeconfig() failed with error: open /var/run/secrets/kubernetes.io/serviceaccount/token: no such file or directory --- PASS: TestGetCloudProvider (0.01s) === RUN TestGetDiskLUN --- PASS: TestGetDiskLUN (0.00s) === RUN TestGetDiskName --- PASS: TestGetDiskName (0.00s) === RUN TestGetFStype ... skipping 426 lines ... coverage: 78.0% of statements ok sigs.k8s.io/azuredisk-csi-driver/test/utils/credentials 0.054s coverage: 78.0% of statements go test -v -cover -tags azurediskv2 ./pkg/azuredisk --temp-use-driver-v2 === RUN TestRescanAllVolumes --- PASS: TestRescanAllVolumes (0.00s) === RUN TestFindDiskByLun W0109 12:33:55.906061 12068 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/azure/scsi1/ failed, error: read /dev/disk/azure/scsi1/ error: bad dir W0109 12:33:55.906319 12068 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/by-id/ failed, error: read /dev/disk/by-id/ error: bad dir --- PASS: TestFindDiskByLun (0.00s) === RUN TestStrFirstLetterToUpper --- PASS: TestStrFirstLetterToUpper (0.00s) === RUN TestNewDriverV1 --- PASS: TestNewDriverV1 (0.00s) === RUN TestCheckDiskCapacity ... skipping 30 lines ... Git Commit: N/A Go Version: go1.19.4 Platform: linux/amd64 Topology Key: topology.disk.csi.azure.com/zone Streaming logs below: W0109 12:33:55.922336 12068 azure_disk_utils.go:230] get kubeconfig() failed with error: open /var/run/secrets/kubernetes.io/serviceaccount/token: no such file or directory I0109 12:33:55.931489 12068 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME I0109 12:33:55.931743 12068 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME I0109 12:33:55.931815 12068 driver.go:81] Enabling controller service capability: CREATE_DELETE_SNAPSHOT I0109 12:33:55.931844 12068 driver.go:81] Enabling controller service capability: LIST_SNAPSHOTS I0109 12:33:55.931869 12068 driver.go:81] Enabling controller service capability: CLONE_VOLUME I0109 12:33:55.931895 12068 driver.go:81] Enabling controller service capability: EXPAND_VOLUME ... skipping 26 lines ... Git Commit: N/A Go Version: go1.19.4 Platform: linux/amd64 Topology Key: topology.disk.csi.azure.com/zone Streaming logs below: W0109 12:33:55.941204 12068 azure_disk_utils.go:230] get kubeconfig() failed with error: open /var/run/secrets/kubernetes.io/serviceaccount/token: no such file or directory I0109 12:33:55.947667 12068 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME I0109 12:33:55.947763 12068 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME I0109 12:33:55.947806 12068 driver.go:81] Enabling controller service capability: CREATE_DELETE_SNAPSHOT I0109 12:33:55.947826 12068 driver.go:81] Enabling controller service capability: LIST_SNAPSHOTS I0109 12:33:55.947857 12068 driver.go:81] Enabling controller service capability: CLONE_VOLUME I0109 12:33:55.947898 12068 driver.go:81] Enabling controller service capability: EXPAND_VOLUME ... skipping 16 lines ... Git Commit: N/A Go Version: go1.19.4 Platform: linux/amd64 Topology Key: topology.disk.csi.azure.com/zone Streaming logs below: W0109 12:33:55.949770 12068 azure_disk_utils.go:230] get kubeconfig() failed with error: open /var/run/secrets/kubernetes.io/serviceaccount/token: no such file or directory E0109 12:33:56.257572 12068 util.go:138] Send.sendRequest: error in parsing response body string "": unexpected end of JSON input, Skip retrying regional host E0109 12:33:56.257735 12068 azure_standard.go:587] as.GetInstanceTypeByNodeName() failed: as.getVirtualMachine() err=Retriable: false, RetryAfter: 0s, HTTPStatusCode: 400, RawError: azure.BearerAuthorizer#WithAuthorization: Failed to refresh the Token for request to https://management.azure.com/subscriptions/12345/resourceGroups/rg1/providers/Microsoft.Compute/virtualMachines/?%24expand=instanceView&api-version=2022-03-01: StatusCode=400 -- Original Error: adal: Refresh request failed. Status Code = '400'. Response body: {"error":"invalid_request","error_description":"AADSTS90002: Tenant '1234' not found. Check to make sure you have the correct tenant ID and are signing into the correct cloud. Check with your subscription administrator, this may happen if there are no active subscriptions for the tenant.\r\nTrace ID: 63903e7a-1f62-43d7-93f5-c17aca5b9002\r\nCorrelation ID: f575f2b7-f715-4707-b448-2dc3a775f3d8\r\nTimestamp: 2023-01-09 12:33:56Z","error_codes":[90002],"timestamp":"2023-01-09 12:33:56Z","trace_id":"63903e7a-1f62-43d7-93f5-c17aca5b9002","correlation_id":"f575f2b7-f715-4707-b448-2dc3a775f3d8","error_uri":"https://login.microsoftonline.com/error?code=90002"} Endpoint https://login.microsoftonline.com/1234/oauth2/token W0109 12:33:56.257816 12068 azuredisk.go:220] Failed to get node info. Error: NewNodeInfo: Failed to get instance type from Azure cloud provider, nodeName: , error: Retriable: false, RetryAfter: 0s, HTTPStatusCode: 400, RawError: azure.BearerAuthorizer#WithAuthorization: Failed to refresh the Token for request to https://management.azure.com/subscriptions/12345/resourceGroups/rg1/providers/Microsoft.Compute/virtualMachines/?%24expand=instanceView&api-version=2022-03-01: StatusCode=400 -- Original Error: adal: Refresh request failed. Status Code = '400'. Response body: {"error":"invalid_request","error_description":"AADSTS90002: Tenant '1234' not found. Check to make sure you have the correct tenant ID and are signing into the correct cloud. Check with your subscription administrator, this may happen if there are no active subscriptions for the tenant.\r\nTrace ID: 63903e7a-1f62-43d7-93f5-c17aca5b9002\r\nCorrelation ID: f575f2b7-f715-4707-b448-2dc3a775f3d8\r\nTimestamp: 2023-01-09 12:33:56Z","error_codes":[90002],"timestamp":"2023-01-09 12:33:56Z","trace_id":"63903e7a-1f62-43d7-93f5-c17aca5b9002","correlation_id":"f575f2b7-f715-4707-b448-2dc3a775f3d8","error_uri":"https://login.microsoftonline.com/error?code=90002"} Endpoint https://login.microsoftonline.com/1234/oauth2/token I0109 12:33:56.265481 12068 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME I0109 12:33:56.265713 12068 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME I0109 12:33:56.265819 12068 driver.go:81] Enabling controller service capability: CREATE_DELETE_SNAPSHOT I0109 12:33:56.265908 12068 driver.go:81] Enabling controller service capability: CLONE_VOLUME I0109 12:33:56.265961 12068 driver.go:81] Enabling controller service capability: EXPAND_VOLUME I0109 12:33:56.266022 12068 driver.go:81] Enabling controller service capability: SINGLE_NODE_MULTI_WRITER ... skipping 254 lines ... I0109 12:33:56.438953 12068 driver.go:81] Enabling controller service capability: LIST_SNAPSHOTS I0109 12:33:56.438960 12068 driver.go:81] Enabling controller service capability: CLONE_VOLUME I0109 12:33:56.438966 12068 driver.go:81] Enabling controller service capability: EXPAND_VOLUME I0109 12:33:56.438972 12068 driver.go:81] Enabling controller service capability: LIST_VOLUMES I0109 12:33:56.438978 12068 driver.go:81] Enabling controller service capability: LIST_VOLUMES_PUBLISHED_NODES I0109 12:33:56.438986 12068 driver.go:100] Enabling volume access mode: SINGLE_NODE_WRITER E0109 12:33:56.439212 12068 controllerserver_v2.go:256] validateDiskURI(123) in DeleteVolume failed with error: invalid DiskURI: 123, correct format: [/subscriptions/{sub-id}/resourcegroups/{group-name}/providers/microsoft.compute/disks/{disk-id}] --- PASS: TestDeleteVolume (0.01s) === RUN TestControllerGetVolume W0109 12:33:56.439285 12068 fake_azuredisk_v2.go:57] Using DriverV2 I0109 12:33:56.445326 12068 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME I0109 12:33:56.445367 12068 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME I0109 12:33:56.445375 12068 driver.go:81] Enabling controller service capability: CREATE_DELETE_SNAPSHOT ... skipping 60 lines ... I0109 12:33:56.481723 12068 driver.go:81] Enabling controller service capability: LIST_VOLUMES I0109 12:33:56.481728 12068 driver.go:81] Enabling controller service capability: LIST_VOLUMES_PUBLISHED_NODES I0109 12:33:56.481735 12068 driver.go:100] Enabling volume access mode: SINGLE_NODE_WRITER === RUN TestControllerPublishVolume/diskName_error === RUN TestControllerPublishVolume/NodeID_missing === RUN TestControllerPublishVolume/failed_provisioning_state W0109 12:33:56.482275 12068 controllerserver_v2.go:341] VM(unit-test-node) is in failed state, update VM first === RUN TestControllerPublishVolume/Volume_already_attached_success W0109 12:33:56.482405 12068 fake_azuredisk_v2.go:57] Using DriverV2 I0109 12:33:56.493351 12068 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME I0109 12:33:56.493388 12068 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME I0109 12:33:56.493394 12068 driver.go:81] Enabling controller service capability: CREATE_DELETE_SNAPSHOT I0109 12:33:56.493401 12068 driver.go:81] Enabling controller service capability: LIST_SNAPSHOTS ... skipping 731 lines ... I0109 12:33:56.935743 12068 driver.go:81] Enabling controller service capability: LIST_SNAPSHOTS I0109 12:33:56.935749 12068 driver.go:81] Enabling controller service capability: CLONE_VOLUME I0109 12:33:56.935756 12068 driver.go:81] Enabling controller service capability: EXPAND_VOLUME I0109 12:33:56.935762 12068 driver.go:81] Enabling controller service capability: LIST_VOLUMES I0109 12:33:56.935767 12068 driver.go:81] Enabling controller service capability: LIST_VOLUMES_PUBLISHED_NODES I0109 12:33:56.935775 12068 driver.go:100] Enabling volume access mode: SINGLE_NODE_WRITER E0109 12:33:56.935848 12068 nodeserver_v2.go:543] mkdir failed on target: /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk/azuredisk.go (mkdir /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk/azuredisk.go: not a directory) --- PASS: TestEnsureMountPoint (0.01s) === RUN TestNodeGetInfo === RUN TestNodeGetInfo/[Success]_Get_node_information_for_existing_VM W0109 12:33:56.936189 12068 fake_azuredisk_v2.go:57] Using DriverV2 I0109 12:33:56.944537 12068 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME I0109 12:33:56.944645 12068 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME ... skipping 13 lines ... I0109 12:33:56.951860 12068 driver.go:81] Enabling controller service capability: CLONE_VOLUME I0109 12:33:56.951866 12068 driver.go:81] Enabling controller service capability: EXPAND_VOLUME I0109 12:33:56.951871 12068 driver.go:81] Enabling controller service capability: LIST_VOLUMES I0109 12:33:56.951877 12068 driver.go:81] Enabling controller service capability: LIST_VOLUMES_PUBLISHED_NODES I0109 12:33:56.951884 12068 driver.go:100] Enabling volume access mode: SINGLE_NODE_WRITER W0109 12:33:56.951993 12068 azure_wrap.go:77] Unable to find node 4161bc48-9019-11ed-ba30-1ae85b331012: instance not found W0109 12:33:56.952016 12068 nodeserver_v2.go:336] get zone(fakeNodeID) failed with: instance not found, fall back to get zone from node labels --- PASS: TestNodeGetInfo (0.02s) --- PASS: TestNodeGetInfo/[Success]_Get_node_information_for_existing_VM (0.01s) --- PASS: TestNodeGetInfo/[Failure]_Get_node_information_for_non-existing_VM (0.01s) === RUN TestNodeGetVolumeStats W0109 12:33:56.952297 12068 fake_azuredisk_v2.go:57] Using DriverV2 I0109 12:33:56.957779 12068 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME ... skipping 14 lines ... I0109 12:33:56.963985 12068 driver.go:81] Enabling controller service capability: LIST_SNAPSHOTS I0109 12:33:56.963992 12068 driver.go:81] Enabling controller service capability: CLONE_VOLUME I0109 12:33:56.963998 12068 driver.go:81] Enabling controller service capability: EXPAND_VOLUME I0109 12:33:56.964004 12068 driver.go:81] Enabling controller service capability: LIST_VOLUMES I0109 12:33:56.964009 12068 driver.go:81] Enabling controller service capability: LIST_VOLUMES_PUBLISHED_NODES I0109 12:33:56.964017 12068 driver.go:100] Enabling volume access mode: SINGLE_NODE_WRITER W0109 12:33:56.964356 12068 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/azure/scsi1/ failed, error: read /dev/disk/azure/scsi1/ error: bad dir W0109 12:33:56.964390 12068 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/by-id/ failed, error: read /dev/disk/by-id/ error: bad dir E0109 12:33:56.967400 12068 nodeserver_v2.go:157] NodeStageVolume: could not determine if volume vol_1 needs to be resized: Failed readonly device check. Expected 1 or 0, got '16106127360' W0109 12:33:56.967633 12068 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/azure/scsi1/ failed, error: read /dev/disk/azure/scsi1/ error: bad dir W0109 12:33:56.967690 12068 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/by-id/ failed, error: read /dev/disk/by-id/ error: bad dir W0109 12:33:56.967778 12068 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/azure/scsi1/ failed, error: read /dev/disk/azure/scsi1/ error: bad dir W0109 12:33:56.967789 12068 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/by-id/ failed, error: read /dev/disk/by-id/ error: bad dir W0109 12:33:56.967921 12068 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/azure/scsi1/ failed, error: read /dev/disk/azure/scsi1/ error: bad dir W0109 12:33:56.967951 12068 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/by-id/ failed, error: read /dev/disk/by-id/ error: bad dir I0109 12:33:56.968006 12068 mount_linux.go:529] Disk "/dev/sdd" appears to be unformatted, attempting to format as type: "ext4" with options: [-F -m0 /dev/sdd] I0109 12:33:56.968034 12068 mount_linux.go:539] Disk successfully formatted (mkfs): ext4 - /dev/sdd /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk/source_test E0109 12:33:56.968056 12068 nodeserver_v2.go:157] NodeStageVolume: could not determine if volume vol_1 needs to be resized: Failed readonly device check. Expected 1 or 0, got '' W0109 12:33:56.968129 12068 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/azure/scsi1/ failed, error: read /dev/disk/azure/scsi1/ error: bad dir W0109 12:33:56.968147 12068 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/by-id/ failed, error: read /dev/disk/by-id/ error: bad dir W0109 12:33:56.968202 12068 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/azure/scsi1/ failed, error: read /dev/disk/azure/scsi1/ error: bad dir W0109 12:33:56.968219 12068 azure_common_linux.go:188] azureDisk - getDiskLinkByDevName by sdd under /dev/disk/by-id/ failed, error: read /dev/disk/by-id/ error: bad dir E0109 12:33:56.968266 12068 nodeserver_v2.go:157] NodeStageVolume: could not determine if volume vol_1 needs to be resized: Failed readonly device check. Expected 1 or 0, got '16106127360' --- PASS: TestNodeStageVolume (0.01s) === RUN TestNodeUnstageVolume W0109 12:33:56.968476 12068 fake_azuredisk_v2.go:57] Using DriverV2 I0109 12:33:56.974860 12068 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME I0109 12:33:56.974898 12068 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME I0109 12:33:56.974911 12068 driver.go:81] Enabling controller service capability: CREATE_DELETE_SNAPSHOT ... skipping 13 lines ... I0109 12:33:56.981047 12068 driver.go:81] Enabling controller service capability: LIST_SNAPSHOTS I0109 12:33:56.981054 12068 driver.go:81] Enabling controller service capability: CLONE_VOLUME I0109 12:33:56.981061 12068 driver.go:81] Enabling controller service capability: EXPAND_VOLUME I0109 12:33:56.981068 12068 driver.go:81] Enabling controller service capability: LIST_VOLUMES I0109 12:33:56.981078 12068 driver.go:81] Enabling controller service capability: LIST_VOLUMES_PUBLISHED_NODES I0109 12:33:56.981087 12068 driver.go:100] Enabling volume access mode: SINGLE_NODE_WRITER E0109 12:33:56.981298 12068 nodeserver_v2.go:543] mkdir failed on target: /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk/azuredisk.go (mkdir /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk/azuredisk.go: not a directory) --- PASS: TestNodePublishVolume (0.01s) === RUN TestNodeUnpublishVolume W0109 12:33:56.981631 12068 fake_azuredisk_v2.go:57] Using DriverV2 I0109 12:33:56.987534 12068 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME I0109 12:33:56.987573 12068 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME I0109 12:33:56.987582 12068 driver.go:81] Enabling controller service capability: CREATE_DELETE_SNAPSHOT ... skipping 37 lines ... I0109 12:33:57.018851 12068 driver.go:81] Enabling controller service capability: LIST_SNAPSHOTS I0109 12:33:57.018884 12068 driver.go:81] Enabling controller service capability: CLONE_VOLUME I0109 12:33:57.018914 12068 driver.go:81] Enabling controller service capability: EXPAND_VOLUME I0109 12:33:57.018956 12068 driver.go:81] Enabling controller service capability: LIST_VOLUMES I0109 12:33:57.018986 12068 driver.go:81] Enabling controller service capability: LIST_VOLUMES_PUBLISHED_NODES I0109 12:33:57.019026 12068 driver.go:100] Enabling volume access mode: SINGLE_NODE_WRITER E0109 12:33:57.020029 12068 nodeserver_v2.go:543] mkdir failed on target: /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk/test (mkdir /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk/test: not a directory) --- PASS: TestEnsureBlockTargetFile (0.01s) === RUN TestMakeDir --- PASS: TestMakeDir (0.00s) === RUN TestGetDevicePathWithLUN W0109 12:33:57.020384 12068 fake_azuredisk_v2.go:57] Using DriverV2 I0109 12:33:57.027133 12068 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME ... skipping 198 lines ... + Key: key, + Data: data, + CreatedOn: time.Now().UTC(), + }) } error make: *** [Makefile:85: verify] Error 1 + EXIT_VALUE=2 + set +o xtrace