Recent runs || View in Spyglass
PR | andyzhangx: test: support Win2022 test on capz |
Result | FAILURE |
Tests | 1 failed / 19 succeeded |
Started | |
Elapsed | 56m30s |
Revision | 6ef34dea3391800ae98f85f6700d7af3463efd40 |
Refs |
988 |
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=AzureFile\sCSI\sDriver\sEnd\-to\-End\sTests\sDynamic\sProvisioning\sshould\screate\sa\svolume\son\sdemand\swith\smount\soptions\s\[kubernetes\.io\/azure\-file\]\s\[file\.csi\.azure\.com\]\s\[Windows\]$'
/home/prow/go/src/sigs.k8s.io/azurefile-csi-driver/test/e2e/dynamic_provisioning_test.go:104 Unexpected error: <*errors.errorString | 0xc000b8d7f0>: { s: "pod \"azurefile-volume-tester-qzwxk\" failed with status: {Phase:Failed Conditions:[{Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-17 07:12:16 +0000 UTC Reason: Message:} {Type:Ready Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-17 07:12:16 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [volume-tester]} {Type:ContainersReady Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-17 07:12:16 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [volume-tester]} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-17 07:12:16 +0000 UTC Reason: Message:}] Message: Reason: NominatedNodeName: HostIP:10.1.0.7 PodIP:192.168.64.4 PodIPs:[{IP:192.168.64.4}] StartTime:2022-04-17 07:12:16 +0000 UTC InitContainerStatuses:[] ContainerStatuses:[{Name:volume-tester State:{Waiting:&ContainerStateWaiting{Reason:RunContainerError,Message:context deadline exceeded,} Running:nil Terminated:nil} LastTerminationState:{Waiting:nil Running:nil Terminated:&ContainerStateTerminated{ExitCode:0,Signal:0,Reason:,Message:,StartedAt:0001-01-01 00:00:00 +0000 UTC,FinishedAt:0001-01-01 00:00:00 +0000 UTC,ContainerID:containerd://8a1b4e221ce200dfaade518931d7e99a5fc9cae8695661dd48295be3f8c8805a,}} Ready:false RestartCount:0 Image:mcr.microsoft.com/windows/servercore:ltsc2022 ImageID:mcr.microsoft.com/windows/servercore@sha256:378d85bd8e7388a777d25009f8523d1e95a5f544f131eaada83171045d5b2c1e ContainerID:containerd://8a1b4e221ce200dfaade518931d7e99a5fc9cae8695661dd48295be3f8c8805a Started:0xc000885f18}] QOSClass:BestEffort EphemeralContainerStatuses:[]}", } pod "azurefile-volume-tester-qzwxk" failed with status: {Phase:Failed Conditions:[{Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-17 07:12:16 +0000 UTC Reason: Message:} {Type:Ready Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-17 07:12:16 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [volume-tester]} {Type:ContainersReady Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-17 07:12:16 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [volume-tester]} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-17 07:12:16 +0000 UTC Reason: Message:}] Message: Reason: NominatedNodeName: HostIP:10.1.0.7 PodIP:192.168.64.4 PodIPs:[{IP:192.168.64.4}] StartTime:2022-04-17 07:12:16 +0000 UTC InitContainerStatuses:[] ContainerStatuses:[{Name:volume-tester State:{Waiting:&ContainerStateWaiting{Reason:RunContainerError,Message:context deadline exceeded,} Running:nil Terminated:nil} LastTerminationState:{Waiting:nil Running:nil Terminated:&ContainerStateTerminated{ExitCode:0,Signal:0,Reason:,Message:,StartedAt:0001-01-01 00:00:00 +0000 UTC,FinishedAt:0001-01-01 00:00:00 +0000 UTC,ContainerID:containerd://8a1b4e221ce200dfaade518931d7e99a5fc9cae8695661dd48295be3f8c8805a,}} Ready:false RestartCount:0 Image:mcr.microsoft.com/windows/servercore:ltsc2022 ImageID:mcr.microsoft.com/windows/servercore@sha256:378d85bd8e7388a777d25009f8523d1e95a5f544f131eaada83171045d5b2c1e ContainerID:containerd://8a1b4e221ce200dfaade518931d7e99a5fc9cae8695661dd48295be3f8c8805a Started:0xc000885f18}] QOSClass:BestEffort EphemeralContainerStatuses:[]} occurred /home/prow/go/src/sigs.k8s.io/azurefile-csi-driver/test/e2e/testsuites/testsuites.go:690from junit_01.xml
�[1mSTEP�[0m: Creating a kubernetes client Apr 17 07:10:38.730: INFO: >>> kubeConfig: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig �[1mSTEP�[0m: Building a namespace api object, basename azurefile �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace Apr 17 07:10:39.279: INFO: >>> kubeConfig: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig �[1mSTEP�[0m: setting up the StorageClass �[1mSTEP�[0m: creating a StorageClass �[1mSTEP�[0m: setting up the PVC and PV �[1mSTEP�[0m: creating a PVC �[1mSTEP�[0m: waiting for PVC to be in phase "Bound" Apr 17 07:10:39.340: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-wp46c] to have phase Bound Apr 17 07:10:39.367: INFO: PersistentVolumeClaim pvc-wp46c found but phase is Pending instead of Bound. Apr 17 07:10:41.397: INFO: PersistentVolumeClaim pvc-wp46c found but phase is Pending instead of Bound. Apr 17 07:10:43.426: INFO: PersistentVolumeClaim pvc-wp46c found but phase is Pending instead of Bound. Apr 17 07:10:45.455: INFO: PersistentVolumeClaim pvc-wp46c found but phase is Pending instead of Bound. Apr 17 07:10:47.485: INFO: PersistentVolumeClaim pvc-wp46c found but phase is Pending instead of Bound. Apr 17 07:10:49.514: INFO: PersistentVolumeClaim pvc-wp46c found but phase is Pending instead of Bound. Apr 17 07:10:51.546: INFO: PersistentVolumeClaim pvc-wp46c found but phase is Pending instead of Bound. Apr 17 07:10:53.575: INFO: PersistentVolumeClaim pvc-wp46c found but phase is Pending instead of Bound. Apr 17 07:10:55.603: INFO: PersistentVolumeClaim pvc-wp46c found but phase is Pending instead of Bound. Apr 17 07:10:57.633: INFO: PersistentVolumeClaim pvc-wp46c found but phase is Pending instead of Bound. Apr 17 07:10:59.663: INFO: PersistentVolumeClaim pvc-wp46c found but phase is Pending instead of Bound. Apr 17 07:11:01.695: INFO: PersistentVolumeClaim pvc-wp46c found but phase is Pending instead of Bound. Apr 17 07:11:03.724: INFO: PersistentVolumeClaim pvc-wp46c found but phase is Pending instead of Bound. Apr 17 07:11:05.753: INFO: PersistentVolumeClaim pvc-wp46c found but phase is Pending instead of Bound. Apr 17 07:11:07.780: INFO: PersistentVolumeClaim pvc-wp46c found but phase is Pending instead of Bound. Apr 17 07:11:09.809: INFO: PersistentVolumeClaim pvc-wp46c found but phase is Pending instead of Bound. Apr 17 07:11:11.838: INFO: PersistentVolumeClaim pvc-wp46c found but phase is Pending instead of Bound. Apr 17 07:11:13.871: INFO: PersistentVolumeClaim pvc-wp46c found but phase is Pending instead of Bound. Apr 17 07:11:15.900: INFO: PersistentVolumeClaim pvc-wp46c found but phase is Pending instead of Bound. Apr 17 07:11:17.929: INFO: PersistentVolumeClaim pvc-wp46c found but phase is Pending instead of Bound. Apr 17 07:11:19.957: INFO: PersistentVolumeClaim pvc-wp46c found but phase is Pending instead of Bound. Apr 17 07:11:21.986: INFO: PersistentVolumeClaim pvc-wp46c found but phase is Pending instead of Bound. Apr 17 07:11:24.014: INFO: PersistentVolumeClaim pvc-wp46c found but phase is Pending instead of Bound. Apr 17 07:11:26.043: INFO: PersistentVolumeClaim pvc-wp46c found but phase is Pending instead of Bound. Apr 17 07:11:28.072: INFO: PersistentVolumeClaim pvc-wp46c found but phase is Pending instead of Bound. Apr 17 07:11:30.101: INFO: PersistentVolumeClaim pvc-wp46c found but phase is Pending instead of Bound. Apr 17 07:11:32.129: INFO: PersistentVolumeClaim pvc-wp46c found but phase is Pending instead of Bound. Apr 17 07:11:34.157: INFO: PersistentVolumeClaim pvc-wp46c found but phase is Pending instead of Bound. Apr 17 07:11:36.187: INFO: PersistentVolumeClaim pvc-wp46c found but phase is Pending instead of Bound. Apr 17 07:11:38.215: INFO: PersistentVolumeClaim pvc-wp46c found but phase is Pending instead of Bound. Apr 17 07:11:40.245: INFO: PersistentVolumeClaim pvc-wp46c found but phase is Pending instead of Bound. Apr 17 07:11:42.274: INFO: PersistentVolumeClaim pvc-wp46c found but phase is Pending instead of Bound. Apr 17 07:11:44.304: INFO: PersistentVolumeClaim pvc-wp46c found but phase is Pending instead of Bound. Apr 17 07:11:46.332: INFO: PersistentVolumeClaim pvc-wp46c found but phase is Pending instead of Bound. Apr 17 07:11:48.360: INFO: PersistentVolumeClaim pvc-wp46c found but phase is Pending instead of Bound. Apr 17 07:11:50.388: INFO: PersistentVolumeClaim pvc-wp46c found but phase is Pending instead of Bound. Apr 17 07:11:52.417: INFO: PersistentVolumeClaim pvc-wp46c found but phase is Pending instead of Bound. Apr 17 07:11:54.446: INFO: PersistentVolumeClaim pvc-wp46c found but phase is Pending instead of Bound. Apr 17 07:11:56.475: INFO: PersistentVolumeClaim pvc-wp46c found but phase is Pending instead of Bound. Apr 17 07:11:58.503: INFO: PersistentVolumeClaim pvc-wp46c found but phase is Pending instead of Bound. Apr 17 07:12:00.532: INFO: PersistentVolumeClaim pvc-wp46c found but phase is Pending instead of Bound. Apr 17 07:12:02.560: INFO: PersistentVolumeClaim pvc-wp46c found but phase is Pending instead of Bound. Apr 17 07:12:04.589: INFO: PersistentVolumeClaim pvc-wp46c found but phase is Pending instead of Bound. Apr 17 07:12:06.617: INFO: PersistentVolumeClaim pvc-wp46c found but phase is Pending instead of Bound. Apr 17 07:12:08.645: INFO: PersistentVolumeClaim pvc-wp46c found but phase is Pending instead of Bound. Apr 17 07:12:10.673: INFO: PersistentVolumeClaim pvc-wp46c found but phase is Pending instead of Bound. Apr 17 07:12:12.701: INFO: PersistentVolumeClaim pvc-wp46c found but phase is Pending instead of Bound. Apr 17 07:12:14.729: INFO: PersistentVolumeClaim pvc-wp46c found but phase is Pending instead of Bound. Apr 17 07:12:16.759: INFO: PersistentVolumeClaim pvc-wp46c found and phase=Bound (1m37.418994538s) �[1mSTEP�[0m: checking the PVC �[1mSTEP�[0m: validating provisioned PV �[1mSTEP�[0m: checking the PV �[1mSTEP�[0m: deploying the pod �[1mSTEP�[0m: checking that the pods command exits with no error Apr 17 07:12:16.843: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-qzwxk" in namespace "azurefile-2540" to be "Succeeded or Failed" Apr 17 07:12:16.871: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 27.857399ms Apr 17 07:12:18.899: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 2.055719168s Apr 17 07:12:20.928: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 4.084302341s Apr 17 07:12:22.958: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 6.114788908s Apr 17 07:12:24.987: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 8.144057924s Apr 17 07:12:27.015: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 10.172106238s Apr 17 07:12:29.043: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 12.199871942s Apr 17 07:12:31.071: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 14.227757982s Apr 17 07:12:33.099: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 16.255788619s Apr 17 07:12:35.128: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 18.284419647s Apr 17 07:12:37.157: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 20.313505831s Apr 17 07:12:39.186: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 22.343082223s Apr 17 07:12:41.214: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 24.371099748s Apr 17 07:12:43.243: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 26.399980726s Apr 17 07:12:45.272: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 28.4291503s Apr 17 07:12:47.301: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 30.45805834s Apr 17 07:12:49.330: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 32.487075969s Apr 17 07:12:51.360: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 34.516686013s Apr 17 07:12:53.389: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 36.545477092s Apr 17 07:12:55.418: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 38.574283995s Apr 17 07:12:57.446: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 40.602301869s Apr 17 07:12:59.474: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 42.63104402s Apr 17 07:13:01.504: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 44.660251281s Apr 17 07:13:03.533: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 46.689638184s Apr 17 07:13:05.562: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 48.718506607s Apr 17 07:13:07.590: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 50.746887908s Apr 17 07:13:09.619: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 52.775269577s Apr 17 07:13:11.649: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 54.805290147s Apr 17 07:13:13.679: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 56.835290531s Apr 17 07:13:15.709: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 58.865210855s Apr 17 07:13:17.737: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.893892636s Apr 17 07:13:19.768: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.924331435s Apr 17 07:13:21.798: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.954375227s Apr 17 07:13:23.826: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.982984989s Apr 17 07:13:25.855: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m9.012191169s Apr 17 07:13:27.885: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m11.042003755s Apr 17 07:13:29.915: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m13.071926035s Apr 17 07:13:31.945: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m15.101958293s Apr 17 07:13:33.974: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m17.1310039s Apr 17 07:13:36.004: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m19.160954271s Apr 17 07:13:38.036: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m21.192690711s Apr 17 07:13:40.066: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m23.222424822s Apr 17 07:13:42.095: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m25.251606356s Apr 17 07:13:44.124: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m27.280615709s Apr 17 07:13:46.154: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m29.310537872s Apr 17 07:13:48.183: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m31.339632879s Apr 17 07:13:50.212: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m33.368899867s Apr 17 07:13:52.242: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m35.39871898s Apr 17 07:13:54.271: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m37.428002777s Apr 17 07:13:56.301: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m39.457442907s Apr 17 07:13:58.332: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m41.488260273s Apr 17 07:14:00.362: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m43.519165215s Apr 17 07:14:02.392: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m45.548657716s Apr 17 07:14:04.422: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m47.578556901s Apr 17 07:14:06.452: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m49.608572474s Apr 17 07:14:08.482: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m51.639171626s Apr 17 07:14:10.513: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m53.669593941s Apr 17 07:14:12.542: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m55.699158987s Apr 17 07:14:14.573: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m57.729373885s Apr 17 07:14:16.603: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 1m59.759730616s Apr 17 07:14:18.634: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m1.790272447s Apr 17 07:14:20.665: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m3.821316867s Apr 17 07:14:22.695: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m5.851578208s Apr 17 07:14:24.725: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m7.882078396s Apr 17 07:14:26.756: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m9.912253099s Apr 17 07:14:28.785: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m11.941524352s Apr 17 07:14:30.814: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m13.971180273s Apr 17 07:14:32.844: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.000744464s Apr 17 07:14:34.875: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.031745315s Apr 17 07:14:36.905: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.061424004s Apr 17 07:14:38.935: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.091710584s Apr 17 07:14:40.967: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.124152468s Apr 17 07:14:42.999: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.155262318s Apr 17 07:14:45.029: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.185708465s Apr 17 07:14:47.059: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.215244477s Apr 17 07:14:49.088: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.245155721s Apr 17 07:14:51.118: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.274881878s Apr 17 07:14:53.147: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.303964377s Apr 17 07:14:55.177: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.333930788s Apr 17 07:14:57.208: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.364447831s Apr 17 07:14:59.237: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.393275329s Apr 17 07:15:01.267: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.423765064s Apr 17 07:15:03.297: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.45408641s Apr 17 07:15:05.328: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.48435269s Apr 17 07:15:07.358: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.514684944s Apr 17 07:15:09.388: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.544454493s Apr 17 07:15:11.418: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.574810467s Apr 17 07:15:13.448: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.604808482s Apr 17 07:15:15.478: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.634416904s Apr 17 07:15:17.507: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.664020524s Apr 17 07:15:19.537: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.694161575s Apr 17 07:15:21.567: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.724189212s Apr 17 07:15:23.598: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.7548688s Apr 17 07:15:25.627: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.783772081s Apr 17 07:15:27.657: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.813610424s Apr 17 07:15:29.687: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.843394151s Apr 17 07:15:31.718: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.875101064s Apr 17 07:15:33.748: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.904216491s Apr 17 07:15:35.778: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.934447906s Apr 17 07:15:37.808: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.964715831s Apr 17 07:15:39.838: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.995143547s Apr 17 07:15:41.869: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m25.025738748s Apr 17 07:15:43.900: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m27.056241893s Apr 17 07:15:45.930: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m29.086370368s Apr 17 07:15:47.960: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m31.116752244s Apr 17 07:15:49.990: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m33.146200186s Apr 17 07:15:52.020: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m35.176566591s Apr 17 07:15:54.050: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m37.206864734s Apr 17 07:15:56.080: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m39.236356316s Apr 17 07:15:58.109: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m41.266052614s Apr 17 07:16:00.139: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m43.295760842s Apr 17 07:16:02.169: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m45.325509267s Apr 17 07:16:04.199: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m47.355833656s Apr 17 07:16:06.230: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m49.386238349s Apr 17 07:16:08.259: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m51.41616173s Apr 17 07:16:10.290: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m53.446203007s Apr 17 07:16:12.320: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m55.476612741s Apr 17 07:16:14.351: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m57.507604567s Apr 17 07:16:16.380: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 3m59.537139977s Apr 17 07:16:18.410: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m1.56712063s Apr 17 07:16:20.441: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m3.597444922s Apr 17 07:16:22.470: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m5.627103926s Apr 17 07:16:24.501: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m7.657428888s Apr 17 07:16:26.531: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m9.687207754s Apr 17 07:16:28.560: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m11.71689232s Apr 17 07:16:30.590: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m13.747026168s Apr 17 07:16:32.620: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m15.776716217s Apr 17 07:16:34.650: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m17.806477282s Apr 17 07:16:36.681: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m19.837290484s Apr 17 07:16:38.711: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m21.867335045s Apr 17 07:16:40.741: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m23.897252669s Apr 17 07:16:42.770: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m25.926836052s Apr 17 07:16:44.800: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m27.956715492s Apr 17 07:16:46.830: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m29.986936415s Apr 17 07:16:48.861: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.017714875s Apr 17 07:16:50.891: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.047506156s Apr 17 07:16:52.922: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.078204799s Apr 17 07:16:54.952: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.108405137s Apr 17 07:16:56.982: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.138349354s Apr 17 07:16:59.011: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.167336122s Apr 17 07:17:01.042: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.198219628s Apr 17 07:17:03.072: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.228286374s Apr 17 07:17:05.102: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.258617713s Apr 17 07:17:07.131: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.287802218s Apr 17 07:17:09.160: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.31703671s Apr 17 07:17:11.190: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.347193527s Apr 17 07:17:13.220: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.376754515s Apr 17 07:17:15.250: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.406760304s Apr 17 07:17:17.281: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.437906085s Apr 17 07:17:19.311: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 5m2.467200209s Apr 17 07:17:21.341: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 5m4.498003262s Apr 17 07:17:23.371: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 5m6.528101102s Apr 17 07:17:25.401: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 5m8.557971113s Apr 17 07:17:27.432: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 5m10.589147395s Apr 17 07:17:29.464: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 5m12.620209107s Apr 17 07:17:31.494: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 5m14.65059889s Apr 17 07:17:33.523: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 5m16.680087867s Apr 17 07:17:35.553: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 5m18.709584856s Apr 17 07:17:37.583: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 5m20.740114463s Apr 17 07:17:39.613: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 5m22.76987657s Apr 17 07:17:41.643: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 5m24.799770994s Apr 17 07:17:43.672: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 5m26.829165633s Apr 17 07:17:45.702: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 5m28.859130139s Apr 17 07:17:47.735: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 5m30.892128557s Apr 17 07:17:49.764: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 5m32.921075331s Apr 17 07:17:51.794: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 5m34.950869586s Apr 17 07:17:53.824: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 5m36.980806601s Apr 17 07:17:55.855: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 5m39.011668493s Apr 17 07:17:57.885: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 5m41.041218809s Apr 17 07:17:59.914: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 5m43.070836381s Apr 17 07:18:01.944: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 5m45.100301855s Apr 17 07:18:03.973: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 5m47.129573459s Apr 17 07:18:06.003: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 5m49.159536468s Apr 17 07:18:08.032: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 5m51.188738494s Apr 17 07:18:10.062: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 5m53.218820309s Apr 17 07:18:12.092: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 5m55.248197389s Apr 17 07:18:14.121: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 5m57.277672267s Apr 17 07:18:16.150: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 5m59.307117095s Apr 17 07:18:18.180: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 6m1.337158321s Apr 17 07:18:20.210: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 6m3.366739798s Apr 17 07:18:22.241: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 6m5.397809024s Apr 17 07:18:24.272: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 6m7.428607901s Apr 17 07:18:26.302: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 6m9.459001096s Apr 17 07:18:28.332: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 6m11.488371653s Apr 17 07:18:30.362: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 6m13.518897448s Apr 17 07:18:32.394: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 6m15.550537199s Apr 17 07:18:34.423: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 6m17.580063693s Apr 17 07:18:36.454: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 6m19.610458799s Apr 17 07:18:38.483: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 6m21.639616993s Apr 17 07:18:40.515: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 6m23.671311629s Apr 17 07:18:42.543: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 6m25.699892981s Apr 17 07:18:44.573: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 6m27.729715153s Apr 17 07:18:46.602: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 6m29.75919421s Apr 17 07:18:48.632: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 6m31.788437157s Apr 17 07:18:50.661: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 6m33.817940095s Apr 17 07:18:52.691: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 6m35.84778685s Apr 17 07:18:54.721: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 6m37.877765551s Apr 17 07:18:56.751: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 6m39.907322987s Apr 17 07:18:58.781: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 6m41.937235233s Apr 17 07:19:00.811: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 6m43.967521608s Apr 17 07:19:02.840: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 6m45.996626894s Apr 17 07:19:04.870: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 6m48.026708549s Apr 17 07:19:06.900: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 6m50.056216129s Apr 17 07:19:08.934: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 6m52.09093707s Apr 17 07:19:10.964: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 6m54.121139248s Apr 17 07:19:12.995: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 6m56.151196748s Apr 17 07:19:15.025: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 6m58.181572307s Apr 17 07:19:17.055: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 7m0.211791864s Apr 17 07:19:19.084: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 7m2.241062814s Apr 17 07:19:21.114: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 7m4.270242195s Apr 17 07:19:23.143: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 7m6.299911969s Apr 17 07:19:25.174: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 7m8.33021853s Apr 17 07:19:27.203: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 7m10.3601485s Apr 17 07:19:29.233: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Failed", Reason="", readiness=false. Elapsed: 7m12.390102608s Apr 17 07:19:29.234: INFO: deleting Pod "azurefile-2540"/"azurefile-volume-tester-qzwxk" Apr 17 07:19:29.281: INFO: Pod azurefile-volume-tester-qzwxk has the following logs: �[1mSTEP�[0m: Deleting pod azurefile-volume-tester-qzwxk in namespace azurefile-2540 Apr 17 07:19:29.318: INFO: deleting PVC "azurefile-2540"/"pvc-wp46c" Apr 17 07:19:29.318: INFO: Deleting PersistentVolumeClaim "pvc-wp46c" �[1mSTEP�[0m: waiting for claim's PV "pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3" to be deleted Apr 17 07:19:29.404: INFO: Waiting up to 10m0s for PersistentVolume pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3 to get deleted Apr 17 07:19:29.431: INFO: PersistentVolume pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3 found and phase=Released (27.356859ms) Apr 17 07:19:34.460: INFO: PersistentVolume pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3 was removed Apr 17 07:19:34.460: INFO: Waiting up to 5m0s for PersistentVolumeClaim azurefile-2540 to be removed Apr 17 07:19:34.488: INFO: Claim "azurefile-2540" in namespace "pvc-wp46c" doesn't exist in the system Apr 17 07:19:34.488: INFO: deleting StorageClass azurefile-2540-file.csi.azure.com-dynamic-sc-zncck �[1mSTEP�[0m: Collecting events from namespace "azurefile-2540". �[1mSTEP�[0m: Found 13 events. Apr 17 07:19:34.549: INFO: At 2022-04-17 07:10:39 +0000 UTC - event for pvc-wp46c: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "file.csi.azure.com" or manually created by system administrator Apr 17 07:19:34.549: INFO: At 2022-04-17 07:10:39 +0000 UTC - event for pvc-wp46c: {file.csi.azure.com_capz-hw3kwu-md-0-s5b2t_fad5e90c-aa63-4905-987b-f4fd31c3d02e } Provisioning: External provisioner is provisioning volume for claim "azurefile-2540/pvc-wp46c" Apr 17 07:19:34.549: INFO: At 2022-04-17 07:12:15 +0000 UTC - event for pvc-wp46c: {file.csi.azure.com_capz-hw3kwu-md-0-s5b2t_fad5e90c-aa63-4905-987b-f4fd31c3d02e } ProvisioningSucceeded: Successfully provisioned volume pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3 Apr 17 07:19:34.549: INFO: At 2022-04-17 07:12:16 +0000 UTC - event for azurefile-volume-tester-qzwxk: {default-scheduler } Scheduled: Successfully assigned azurefile-2540/azurefile-volume-tester-qzwxk to capz-hw3k-g6lbs Apr 17 07:19:34.549: INFO: At 2022-04-17 07:12:24 +0000 UTC - event for azurefile-volume-tester-qzwxk: {kubelet capz-hw3k-g6lbs} FailedMount: MountVolume.MountDevice failed for volume "pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3" : rpc error: code = Internal desc = volume(capz-hw3kwu#fedf9d94b13a54e409b27ba#pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3#) mount "\\\\fedf9d94b13a54e409b27ba.privatelink.file.core.windows.net\\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3" on "\\var\\lib\\kubelet\\plugins\\kubernetes.io\\csi\\pv\\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3\\globalmount" failed with smb mapping failed with error: rpc error: code = Unknown desc = NewSmbGlobalMapping failed. output: "New-SmbGlobalMapping : Access is denied. \r\nAt line:1 char:190\r\n+ ... ser, $PWord;New-SmbGlobalMapping -RemotePath $Env:smbremotepath -Cred ...\r\n+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~\r\n + CategoryInfo : PermissionDenied: (MSFT_SmbGlobalMapping:ROOT/Microsoft/...mbGlobalMapping) [New-SmbGlob \r\n alMapping], CimException\r\n + FullyQualifiedErrorId : Windows System Error 5,New-SmbGlobalMapping\r\n \r\n", err: exit status 1 Apr 17 07:19:34.549: INFO: At 2022-04-17 07:13:13 +0000 UTC - event for azurefile-volume-tester-qzwxk: {kubelet capz-hw3k-g6lbs} Pulling: Pulling image "mcr.microsoft.com/windows/servercore:ltsc2022" Apr 17 07:19:34.549: INFO: At 2022-04-17 07:17:27 +0000 UTC - event for azurefile-volume-tester-qzwxk: {kubelet capz-hw3k-g6lbs} Pulled: Successfully pulled image "mcr.microsoft.com/windows/servercore:ltsc2022" in 4m13.8411483s Apr 17 07:19:34.549: INFO: At 2022-04-17 07:17:27 +0000 UTC - event for azurefile-volume-tester-qzwxk: {kubelet capz-hw3k-g6lbs} Created: Created container volume-tester Apr 17 07:19:34.549: INFO: At 2022-04-17 07:19:27 +0000 UTC - event for azurefile-volume-tester-qzwxk: {kubelet capz-hw3k-g6lbs} Failed: Error: context deadline exceeded Apr 17 07:19:34.549: INFO: At 2022-04-17 07:19:28 +0000 UTC - event for azurefile-volume-tester-qzwxk: {kubelet capz-hw3k-g6lbs} FailedMount: MountVolume.SetUp failed for volume "kube-api-access-2p9v6" : object "azurefile-2540"/"kube-root-ca.crt" not registered Apr 17 07:19:34.549: INFO: At 2022-04-17 07:19:28 +0000 UTC - event for azurefile-volume-tester-qzwxk: {kubelet capz-hw3k-g6lbs} Pulled: Container image "mcr.microsoft.com/windows/servercore:ltsc2022" already present on machine Apr 17 07:19:34.549: INFO: At 2022-04-17 07:19:32 +0000 UTC - event for azurefile-volume-tester-qzwxk: {kubelet capz-hw3k-g6lbs} Started: Started container volume-tester Apr 17 07:19:34.549: INFO: At 2022-04-17 07:19:33 +0000 UTC - event for azurefile-volume-tester-qzwxk: {kubelet capz-hw3k-g6lbs} Killing: Stopping container volume-tester Apr 17 07:19:34.577: INFO: POD NODE PHASE GRACE CONDITIONS Apr 17 07:19:34.577: INFO: Apr 17 07:19:34.614: INFO: Logging node info for node capz-hw3k-g6lbs Apr 17 07:19:34.644: INFO: Node Info: &Node{ObjectMeta:{capz-hw3k-g6lbs 17901421-60bf-4c55-8ef6-e95b1cbede1b 4123 0 2022-04-17 06:53:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D4s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:eastus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:capz-hw3k-g6lbs kubernetes.io/os:windows node.kubernetes.io/instance-type:Standard_D4s_v3 node.kubernetes.io/windows-build:10.0.20348 topology.kubernetes.io/region:eastus topology.kubernetes.io/zone:0] map[cluster.x-k8s.io/cluster-name:capz-hw3kwu cluster.x-k8s.io/cluster-namespace:default cluster.x-k8s.io/machine:capz-hw3kwu-md-win-547c98c959-blkv2 cluster.x-k8s.io/owner-kind:MachineSet cluster.x-k8s.io/owner-name:capz-hw3kwu-md-win-547c98c959 csi.volume.kubernetes.io/nodeid:{"file.csi.azure.com":"capz-hw3k-g6lbs"} kubeadm.alpha.kubernetes.io/cri-socket:npipe:////./pipe/containerd-containerd node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.1.0.7/16 projectcalico.org/IPv4VXLANTunnelAddr:192.168.64.1 projectcalico.org/VXLANTunnelMACAddr:00:15:5d:5f:93:23 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{Go-http-client Update v1 2022-04-17 06:53:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubeadm.alpha.kubernetes.io/cri-socket":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-04-17 06:53:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}} } {manager Update v1 2022-04-17 06:53:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:cluster.x-k8s.io/cluster-name":{},"f:cluster.x-k8s.io/cluster-namespace":{},"f:cluster.x-k8s.io/machine":{},"f:cluster.x-k8s.io/owner-kind":{},"f:cluster.x-k8s.io/owner-name":{}}}} } {calico-node.exe Update v1 2022-04-17 06:55:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4VXLANTunnelAddr":{},"f:projectcalico.org/VXLANTunnelMACAddr":{}}}} status} {Go-http-client Update v1 2022-04-17 07:10:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/===REDACTED===/resourceGroups/capz-hw3kwu/providers/Microsoft.Compute/virtualMachines/capz-hw3k-g6lbs,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{17179398144 0} {<nil>} 16776756Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{123221307598 0} {<nil>} 123221307598 DecimalSI},memory: {{17074540544 0} {<nil>} 16674356Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-04-17 07:17:30 +0000 UTC,LastTransitionTime:2022-04-17 06:53:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-04-17 07:17:30 +0000 UTC,LastTransitionTime:2022-04-17 06:53:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-04-17 07:17:30 +0000 UTC,LastTransitionTime:2022-04-17 06:53:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-04-17 07:17:30 +0000 UTC,LastTransitionTime:2022-04-17 06:54:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:capz-hw3k-g6lbs,},NodeAddress{Type:InternalIP,Address:10.1.0.7,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:capz-hw3k-g6lbs,SystemUUID:89BC4058-4FC5-4522-821A-9CDAEA73D215,BootID:,KernelVersion:10.0.20348.405,OSImage:Windows Server 2022 Datacenter,ContainerRuntimeVersion:containerd://1.6.1,KubeletVersion:v1.23.5,KubeProxyVersion:v1.23.5,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:378d85bd8e7388a777d25009f8523d1e95a5f544f131eaada83171045d5b2c1e mcr.microsoft.com/windows/servercore:ltsc2022],SizeBytes:2226956779,},ContainerImage{Names:[docker.io/sigwindowstools/calico-install@sha256:141afecd724eb757ee41593cc73f35fb19a2ce13cad73179cf3b1cef81a637d1 docker.io/sigwindowstools/calico-install:v3.22.1-hostprocess],SizeBytes:148096127,},ContainerImage{Names:[capzci.azurecr.io/azurefile-csi@sha256:3740698191fc139702e43013e4921d9be75591b063804a08c01c69b8f8e4ca78 capzci.azurecr.io/azurefile-csi:e2e-a3f61a5e163bc4536ff4e8a3aac2b0f5e7027564],SizeBytes:130280744,},ContainerImage{Names:[docker.io/sigwindowstools/calico-node@sha256:b8e6e2f190e58d6b61b7f2a19b0e2e17a377e5b9d7b9528e9b7953d9f9ab59bb docker.io/sigwindowstools/calico-node:v3.22.1-hostprocess],SizeBytes:128793648,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:dbec3a8166686b09b242176ab5b99e993da4126438bbce68147c3fd654f35662 mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v2.4.0],SizeBytes:125554391,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:c96a6255c42766f6b8bb1a7cda02b0060ab1b20b2e2dafcc64ec09e7646745a6 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.5.0],SizeBytes:124471446,},ContainerImage{Names:[ghcr.io/kubernetes-sigs/sig-windows/csi-proxy@sha256:96b4144986319a747ba599892454be2737aae6005d96b8e13ed481321ac3afba ghcr.io/kubernetes-sigs/sig-windows/csi-proxy:v1.0.2],SizeBytes:123925937,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6],SizeBytes:119397646,},ContainerImage{Names:[docker.io/sigwindowstools/kube-proxy@sha256:0f8a44b795d1824358f24cc56f0024d18a39ae044656686596d8b7fa6d78e1fa docker.io/sigwindowstools/kube-proxy:v1.23.5-calico-hostprocess],SizeBytes:116337721,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Apr 17 07:19:34.644: INFO: Logging kubelet events for node capz-hw3k-g6lbs Apr 17 07:19:34.675: INFO: Logging pods the kubelet thinks is on node capz-hw3k-g6lbs Apr 17 07:19:34.721: INFO: calico-node-windows-r4gth started at 2022-04-17 06:53:28 +0000 UTC (1+2 container statuses recorded) Apr 17 07:19:34.721: INFO: Init container install-cni ready: true, restart count 0 Apr 17 07:19:34.721: INFO: Container calico-node-felix ready: true, restart count 1 Apr 17 07:19:34.721: INFO: Container calico-node-startup ready: true, restart count 0 Apr 17 07:19:34.721: INFO: kube-proxy-windows-llvx2 started at 2022-04-17 06:53:28 +0000 UTC (0+1 container statuses recorded) Apr 17 07:19:34.721: INFO: Container kube-proxy ready: true, restart count 0 Apr 17 07:19:34.721: INFO: csi-proxy-btskb started at 2022-04-17 06:54:40 +0000 UTC (0+1 container statuses recorded) Apr 17 07:19:34.721: INFO: Container csi-proxy ready: true, restart count 0 Apr 17 07:19:34.721: INFO: csi-azurefile-node-win-4dsj5 started at 2022-04-17 07:09:05 +0000 UTC (0+3 container statuses recorded) Apr 17 07:19:34.721: INFO: Container azurefile ready: true, restart count 0 Apr 17 07:19:34.721: INFO: Container liveness-probe ready: true, restart count 0 Apr 17 07:19:34.721: INFO: Container node-driver-registrar ready: true, restart count 0 Apr 17 07:19:34.908: INFO: Latency metrics for node capz-hw3k-g6lbs Apr 17 07:19:34.908: INFO: Logging node info for node capz-hw3k-mmbvt Apr 17 07:19:34.936: INFO: Node Info: &Node{ObjectMeta:{capz-hw3k-mmbvt b75bea1f-5e19-43d2-aa11-a48c0ef6a80d 3797 0 2022-04-17 06:53:38 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D4s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:eastus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:capz-hw3k-mmbvt kubernetes.io/os:windows node.kubernetes.io/instance-type:Standard_D4s_v3 node.kubernetes.io/windows-build:10.0.20348 topology.kubernetes.io/region:eastus topology.kubernetes.io/zone:0] map[cluster.x-k8s.io/cluster-name:capz-hw3kwu cluster.x-k8s.io/cluster-namespace:default cluster.x-k8s.io/machine:capz-hw3kwu-md-win-547c98c959-8vt5x cluster.x-k8s.io/owner-kind:MachineSet cluster.x-k8s.io/owner-name:capz-hw3kwu-md-win-547c98c959 csi.volume.kubernetes.io/nodeid:{"file.csi.azure.com":"capz-hw3k-mmbvt"} kubeadm.alpha.kubernetes.io/cri-socket:npipe:////./pipe/containerd-containerd node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.1.0.4/16 projectcalico.org/IPv4VXLANTunnelAddr:192.168.136.1 projectcalico.org/VXLANTunnelMACAddr:00:15:5d:91:23:e1 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{Go-http-client Update v1 2022-04-17 06:53:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubeadm.alpha.kubernetes.io/cri-socket":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-04-17 06:53:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}} } {manager Update v1 2022-04-17 06:53:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:cluster.x-k8s.io/cluster-name":{},"f:cluster.x-k8s.io/cluster-namespace":{},"f:cluster.x-k8s.io/machine":{},"f:cluster.x-k8s.io/owner-kind":{},"f:cluster.x-k8s.io/owner-name":{}}}} } {calico-node.exe Update v1 2022-04-17 06:55:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4VXLANTunnelAddr":{},"f:projectcalico.org/VXLANTunnelMACAddr":{}}}} status} {Go-http-client Update v1 2022-04-17 07:10:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/===REDACTED===/resourceGroups/capz-hw3kwu/providers/Microsoft.Compute/virtualMachines/capz-hw3k-mmbvt,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{17179398144 0} {<nil>} 16776756Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{123221307598 0} {<nil>} 123221307598 DecimalSI},memory: {{17074540544 0} {<nil>} 16674356Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-04-17 07:15:15 +0000 UTC,LastTransitionTime:2022-04-17 06:53:38 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-04-17 07:15:15 +0000 UTC,LastTransitionTime:2022-04-17 06:53:38 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-04-17 07:15:15 +0000 UTC,LastTransitionTime:2022-04-17 06:53:38 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-04-17 07:15:15 +0000 UTC,LastTransitionTime:2022-04-17 06:54:49 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:capz-hw3k-mmbvt,},NodeAddress{Type:InternalIP,Address:10.1.0.4,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:capz-hw3k-mmbvt,SystemUUID:C4C3AC19-7BCA-46CB-87F5-14E06DA46FFA,BootID:,KernelVersion:10.0.20348.405,OSImage:Windows Server 2022 Datacenter,ContainerRuntimeVersion:containerd://1.6.1,KubeletVersion:v1.23.5,KubeProxyVersion:v1.23.5,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/sigwindowstools/calico-install@sha256:141afecd724eb757ee41593cc73f35fb19a2ce13cad73179cf3b1cef81a637d1 docker.io/sigwindowstools/calico-install:v3.22.1-hostprocess],SizeBytes:148096127,},ContainerImage{Names:[capzci.azurecr.io/azurefile-csi@sha256:3740698191fc139702e43013e4921d9be75591b063804a08c01c69b8f8e4ca78 capzci.azurecr.io/azurefile-csi:e2e-a3f61a5e163bc4536ff4e8a3aac2b0f5e7027564],SizeBytes:130280744,},ContainerImage{Names:[docker.io/sigwindowstools/calico-node@sha256:b8e6e2f190e58d6b61b7f2a19b0e2e17a377e5b9d7b9528e9b7953d9f9ab59bb docker.io/sigwindowstools/calico-node:v3.22.1-hostprocess],SizeBytes:128793648,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:dbec3a8166686b09b242176ab5b99e993da4126438bbce68147c3fd654f35662 mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v2.4.0],SizeBytes:125554391,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:c96a6255c42766f6b8bb1a7cda02b0060ab1b20b2e2dafcc64ec09e7646745a6 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.5.0],SizeBytes:124471446,},ContainerImage{Names:[ghcr.io/kubernetes-sigs/sig-windows/csi-proxy@sha256:96b4144986319a747ba599892454be2737aae6005d96b8e13ed481321ac3afba ghcr.io/kubernetes-sigs/sig-windows/csi-proxy:v1.0.2],SizeBytes:123925937,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6],SizeBytes:119397646,},ContainerImage{Names:[docker.io/sigwindowstools/kube-proxy@sha256:0f8a44b795d1824358f24cc56f0024d18a39ae044656686596d8b7fa6d78e1fa docker.io/sigwindowstools/kube-proxy:v1.23.5-calico-hostprocess],SizeBytes:116337721,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Apr 17 07:19:34.937: INFO: Logging kubelet events for node capz-hw3k-mmbvt Apr 17 07:19:34.967: INFO: Logging pods the kubelet thinks is on node capz-hw3k-mmbvt Apr 17 07:19:35.027: INFO: csi-proxy-h5vbr started at 2022-04-17 06:54:49 +0000 UTC (0+1 container statuses recorded) Apr 17 07:19:35.027: INFO: Container csi-proxy ready: true, restart count 0 Apr 17 07:19:35.027: INFO: csi-azurefile-node-win-qpsbl started at 2022-04-17 07:09:05 +0000 UTC (0+3 container statuses recorded) Apr 17 07:19:35.027: INFO: Container azurefile ready: true, restart count 0 Apr 17 07:19:35.027: INFO: Container liveness-probe ready: true, restart count 0 Apr 17 07:19:35.027: INFO: Container node-driver-registrar ready: true, restart count 0 Apr 17 07:19:35.027: INFO: kube-proxy-windows-w2cdh started at 2022-04-17 06:53:38 +0000 UTC (0+1 container statuses recorded) Apr 17 07:19:35.027: INFO: Container kube-proxy ready: true, restart count 0 Apr 17 07:19:35.027: INFO: calico-node-windows-jxgtg started at 2022-04-17 06:53:38 +0000 UTC (1+2 container statuses recorded) Apr 17 07:19:35.027: INFO: Init container install-cni ready: true, restart count 0 Apr 17 07:19:35.027: INFO: Container calico-node-felix ready: true, restart count 1 Apr 17 07:19:35.027: INFO: Container calico-node-startup ready: true, restart count 0 Apr 17 07:19:35.200: INFO: Latency metrics for node capz-hw3k-mmbvt Apr 17 07:19:35.201: INFO: Logging node info for node capz-hw3kwu-control-plane-lcdn5 Apr 17 07:19:35.231: INFO: Node Info: &Node{ObjectMeta:{capz-hw3kwu-control-plane-lcdn5 edf52a6a-0b64-4ec7-b466-df7831b6f2d7 4151 0 2022-04-17 06:51:06 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eastus failure-domain.beta.kubernetes.io/zone:eastus-2 kubernetes.io/arch:amd64 kubernetes.io/hostname:capz-hw3kwu-control-plane-lcdn5 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node-role.kubernetes.io/master: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:Standard_D2s_v3 topology.kubernetes.io/region:eastus topology.kubernetes.io/zone:eastus-2] map[cluster.x-k8s.io/cluster-name:capz-hw3kwu cluster.x-k8s.io/cluster-namespace:default cluster.x-k8s.io/machine:capz-hw3kwu-control-plane-2f4zq cluster.x-k8s.io/owner-kind:KubeadmControlPlane cluster.x-k8s.io/owner-name:capz-hw3kwu-control-plane kubeadm.alpha.kubernetes.io/cri-socket:/run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.0.4/16 projectcalico.org/IPv4VXLANTunnelAddr:192.168.187.192 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{Go-http-client Update v1 2022-04-17 06:51:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubeadm.alpha.kubernetes.io/cri-socket":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node-role.kubernetes.io/control-plane":{},"f:node-role.kubernetes.io/master":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {manager Update v1 2022-04-17 06:51:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:cluster.x-k8s.io/cluster-name":{},"f:cluster.x-k8s.io/cluster-namespace":{},"f:cluster.x-k8s.io/machine":{},"f:cluster.x-k8s.io/owner-kind":{},"f:cluster.x-k8s.io/owner-name":{}}}} } {kube-controller-manager Update v1 2022-04-17 06:51:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:taints":{}}} } {calico-node Update v1 2022-04-17 06:51:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4VXLANTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {Go-http-client Update v1 2022-04-17 06:51:43 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/===REDACTED===/resourceGroups/capz-hw3kwu/providers/Microsoft.Compute/virtualMachines/capz-hw3kwu-control-plane-lcdn5,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{133018140672 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8340819968 0} {<nil>} 8145332Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{119716326407 0} {<nil>} 119716326407 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8235962368 0} {<nil>} 8042932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-04-17 06:51:38 +0000 UTC,LastTransitionTime:2022-04-17 06:51:38 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-04-17 07:17:42 +0000 UTC,LastTransitionTime:2022-04-17 06:50:50 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-04-17 07:17:42 +0000 UTC,LastTransitionTime:2022-04-17 06:50:50 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-04-17 07:17:42 +0000 UTC,LastTransitionTime:2022-04-17 06:50:50 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-04-17 07:17:42 +0000 UTC,LastTransitionTime:2022-04-17 06:51:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:capz-hw3kwu-control-plane-lcdn5,},NodeAddress{Type:InternalIP,Address:10.0.0.4,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:97cb82e3bec94f378f811a27a6c65146,SystemUUID:b30d53a3-85e1-e74f-b47c-580424c82477,BootID:e4a301ca-a9e3-41a3-a9e4-29c84ba10147,KernelVersion:5.13.0-1017-azure,OSImage:Ubuntu 20.04.4 LTS,ContainerRuntimeVersion:containerd://1.6.1,KubeletVersion:v1.23.5,KubeProxyVersion:v1.23.5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 k8s.gcr.io/etcd:3.5.1-0],SizeBytes:98888614,},ContainerImage{Names:[docker.io/calico/cni@sha256:2219eae79544b098119a06a8bb5608867f9ac00471592a00e2347f3ae4bea687 docker.io/calico/cni:v3.22.1],SizeBytes:80514590,},ContainerImage{Names:[docker.io/calico/node@sha256:1f8ed83e5264b4206cce7e1def11bca0b3ea7d5f4eb9b0ca0dbfc8cb968ca57e docker.io/calico/node:v3.22.1],SizeBytes:69647221,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:e42a0aba3637d123481cca14fd8314a482616593edf58f9594c9382e50498f9b docker.io/calico/kube-controllers:v3.22.1],SizeBytes:54948023,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:c1f625d115fbd9a12eac615653fc81c0edb33b2b5a76d1e09d5daed11fa557c1 k8s.gcr.io/kube-proxy:v1.23.5],SizeBytes:39278412,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:ddf5bf7196eb534271f9e5d403f4da19838d5610bb5ca191001bde5f32b5492e k8s.gcr.io/kube-apiserver:v1.23.5],SizeBytes:32603217,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:cca0fb3532abedcc95c5f64268d54da9ecc56cc4817ff08d0128941cf2b0e1a4 k8s.gcr.io/kube-controller-manager:v1.23.5],SizeBytes:30174093,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:489efb65da9edc40bf0911f3e6371e5bb6b8ad8fde1d55193a6cc84c2ef36626 k8s.gcr.io/kube-scheduler:v1.23.5],SizeBytes:15131395,},ContainerImage{Names:[k8s.gcr.io/coredns/coredns@sha256:5b6ec0d6de9baaf3e92d0f66cd96a25b9edbce8716f5f15dcd1a616b3abd590e k8s.gcr.io/coredns/coredns:v1.8.6],SizeBytes:13585107,},ContainerImage{Names:[docker.io/calico/pod2daemon-flexvol@sha256:35802ba083546a7c5e8b5bf0ee7ffad7f8a468e8c2b3631e7e9647512c94041d docker.io/calico/pod2daemon-flexvol:v3.22.1],SizeBytes:8462620,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Apr 17 07:19:35.231: INFO: Logging kubelet events for node capz-hw3kwu-control-plane-lcdn5 Apr 17 07:19:35.263: INFO: Logging pods the kubelet thinks is on node capz-hw3kwu-control-plane-lcdn5 Apr 17 07:19:35.321: INFO: kube-scheduler-capz-hw3kwu-control-plane-lcdn5 started at 2022-04-17 06:51:13 +0000 UTC (0+1 container statuses recorded) Apr 17 07:19:35.321: INFO: Container kube-scheduler ready: true, restart count 0 Apr 17 07:19:35.321: INFO: kube-proxy-6q72h started at 2022-04-17 06:51:13 +0000 UTC (0+1 container statuses recorded) Apr 17 07:19:35.321: INFO: Container kube-proxy ready: true, restart count 0 Apr 17 07:19:35.321: INFO: coredns-64897985d-lqjjx started at 2022-04-17 06:51:33 +0000 UTC (0+1 container statuses recorded) Apr 17 07:19:35.321: INFO: Container coredns ready: true, restart count 0 Apr 17 07:19:35.321: INFO: calico-kube-controllers-7c664f4648-r4ks9 started at 2022-04-17 06:51:33 +0000 UTC (0+1 container statuses recorded) Apr 17 07:19:35.321: INFO: Container calico-kube-controllers ready: true, restart count 0 Apr 17 07:19:35.321: INFO: etcd-capz-hw3kwu-control-plane-lcdn5 started at 2022-04-17 06:51:13 +0000 UTC (0+1 container statuses recorded) Apr 17 07:19:35.321: INFO: Container etcd ready: true, restart count 0 Apr 17 07:19:35.321: INFO: kube-apiserver-capz-hw3kwu-control-plane-lcdn5 started at 2022-04-17 06:51:13 +0000 UTC (0+1 container statuses recorded) Apr 17 07:19:35.321: INFO: Container kube-apiserver ready: true, restart count 0 Apr 17 07:19:35.321: INFO: kube-controller-manager-capz-hw3kwu-control-plane-lcdn5 started at 2022-04-17 06:51:13 +0000 UTC (0+1 container statuses recorded) Apr 17 07:19:35.321: INFO: Container kube-controller-manager ready: true, restart count 0 Apr 17 07:19:35.321: INFO: calico-node-88n9t started at 2022-04-17 06:51:13 +0000 UTC (3+1 container statuses recorded) Apr 17 07:19:35.321: INFO: Init container upgrade-ipam ready: true, restart count 0 Apr 17 07:19:35.321: INFO: Init container install-cni ready: true, restart count 0 Apr 17 07:19:35.321: INFO: Init container flexvol-driver ready: true, restart count 0 Apr 17 07:19:35.321: INFO: Container calico-node ready: true, restart count 0 Apr 17 07:19:35.321: INFO: coredns-64897985d-48fdf started at 2022-04-17 06:51:33 +0000 UTC (0+1 container statuses recorded) Apr 17 07:19:35.321: INFO: Container coredns ready: true, restart count 0 Apr 17 07:19:35.470: INFO: Latency metrics for node capz-hw3kwu-control-plane-lcdn5 Apr 17 07:19:35.470: INFO: Logging node info for node capz-hw3kwu-md-0-s5b2t Apr 17 07:19:35.499: INFO: Node Info: &Node{ObjectMeta:{capz-hw3kwu-md-0-s5b2t 7cec75ad-1d96-42a9-b45c-da009287b1c8 3736 0 2022-04-17 06:52:14 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D4s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eastus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:capz-hw3kwu-md-0-s5b2t kubernetes.io/os:linux node.kubernetes.io/instance-type:Standard_D4s_v3 topology.kubernetes.io/region:eastus topology.kubernetes.io/zone:0] map[cluster.x-k8s.io/cluster-name:capz-hw3kwu cluster.x-k8s.io/cluster-namespace:default cluster.x-k8s.io/machine:capz-hw3kwu-md-0-6848989f78-q2scv cluster.x-k8s.io/owner-kind:MachineSet cluster.x-k8s.io/owner-name:capz-hw3kwu-md-0-6848989f78 kubeadm.alpha.kubernetes.io/cri-socket:/run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.1.0.5/16 projectcalico.org/IPv4VXLANTunnelAddr:192.168.170.192 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{Go-http-client Update v1 2022-04-17 06:52:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubeadm.alpha.kubernetes.io/cri-socket":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-04-17 06:52:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}} } {manager Update v1 2022-04-17 06:52:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:cluster.x-k8s.io/cluster-name":{},"f:cluster.x-k8s.io/cluster-namespace":{},"f:cluster.x-k8s.io/machine":{},"f:cluster.x-k8s.io/owner-kind":{},"f:cluster.x-k8s.io/owner-name":{}}}} } {calico-node Update v1 2022-04-17 06:52:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4VXLANTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {Go-http-client Update v1 2022-04-17 06:52:45 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/===REDACTED===/resourceGroups/capz-hw3kwu/providers/Microsoft.Compute/virtualMachines/capz-hw3kwu-md-0-s5b2t,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{133018140672 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{16783433728 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{119716326407 0} {<nil>} 119716326407 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{16678576128 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-04-17 06:52:34 +0000 UTC,LastTransitionTime:2022-04-17 06:52:34 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-04-17 07:14:51 +0000 UTC,LastTransitionTime:2022-04-17 06:52:14 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-04-17 07:14:51 +0000 UTC,LastTransitionTime:2022-04-17 06:52:14 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-04-17 07:14:51 +0000 UTC,LastTransitionTime:2022-04-17 06:52:14 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-04-17 07:14:51 +0000 UTC,LastTransitionTime:2022-04-17 06:52:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:capz-hw3kwu-md-0-s5b2t,},NodeAddress{Type:InternalIP,Address:10.1.0.5,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:7e2f085d1c4e442782a9c133ae6c75c6,SystemUUID:c9469493-6ecd-c649-a1c5-55d9d768a5f1,BootID:19ef8d68-7a20-476d-b4b1-d13e1f1d8b8a,KernelVersion:5.13.0-1017-azure,OSImage:Ubuntu 20.04.4 LTS,ContainerRuntimeVersion:containerd://1.6.1,KubeletVersion:v1.23.5,KubeProxyVersion:v1.23.5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 k8s.gcr.io/etcd:3.5.1-0],SizeBytes:98888614,},ContainerImage{Names:[capzci.azurecr.io/azurefile-csi@sha256:3740698191fc139702e43013e4921d9be75591b063804a08c01c69b8f8e4ca78 capzci.azurecr.io/azurefile-csi:e2e-a3f61a5e163bc4536ff4e8a3aac2b0f5e7027564],SizeBytes:95808164,},ContainerImage{Names:[docker.io/calico/cni@sha256:2219eae79544b098119a06a8bb5608867f9ac00471592a00e2347f3ae4bea687 docker.io/calico/cni:v3.22.1],SizeBytes:80514590,},ContainerImage{Names:[docker.io/calico/node@sha256:1f8ed83e5264b4206cce7e1def11bca0b3ea7d5f4eb9b0ca0dbfc8cb968ca57e docker.io/calico/node:v3.22.1],SizeBytes:69647221,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner@sha256:542c9258a1441e4927883ea73425e21f9a14043a649686bf6b51700f34c64f8e mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner:v3.1.0],SizeBytes:59205633,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-resizer@sha256:ab6c2e18a4d943f2bf8688e1779622277a1d14c355c9d4bfc0d761d86c5108b3 mcr.microsoft.com/oss/kubernetes-csi/csi-resizer:v1.4.0],SizeBytes:56924121,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-attacher@sha256:19fbca01394f7ed80151731180cfde0a3367f038beae2a97cda7928034010057 mcr.microsoft.com/oss/kubernetes-csi/csi-attacher:v3.4.0],SizeBytes:56301028,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:c1f625d115fbd9a12eac615653fc81c0edb33b2b5a76d1e09d5daed11fa557c1 k8s.gcr.io/kube-proxy:v1.23.5],SizeBytes:39278412,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:ddf5bf7196eb534271f9e5d403f4da19838d5610bb5ca191001bde5f32b5492e k8s.gcr.io/kube-apiserver:v1.23.5],SizeBytes:32603217,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:cca0fb3532abedcc95c5f64268d54da9ecc56cc4817ff08d0128941cf2b0e1a4 k8s.gcr.io/kube-controller-manager:v1.23.5],SizeBytes:30174093,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter@sha256:a889e925e15f9423f7842f1b769f64cbcf6a20b6956122836fc835cf22d9073f mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter:v5.0.1],SizeBytes:22192414,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:489efb65da9edc40bf0911f3e6371e5bb6b8ad8fde1d55193a6cc84c2ef36626 k8s.gcr.io/kube-scheduler:v1.23.5],SizeBytes:15131395,},ContainerImage{Names:[k8s.gcr.io/coredns/coredns@sha256:5b6ec0d6de9baaf3e92d0f66cd96a25b9edbce8716f5f15dcd1a616b3abd590e k8s.gcr.io/coredns/coredns:v1.8.6],SizeBytes:13585107,},ContainerImage{Names:[docker.io/calico/pod2daemon-flexvol@sha256:35802ba083546a7c5e8b5bf0ee7ffad7f8a468e8c2b3631e7e9647512c94041d docker.io/calico/pod2daemon-flexvol:v3.22.1],SizeBytes:8462620,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:c96a6255c42766f6b8bb1a7cda02b0060ab1b20b2e2dafcc64ec09e7646745a6 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.5.0],SizeBytes:8222208,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Apr 17 07:19:35.500: INFO: Logging kubelet events for node capz-hw3kwu-md-0-s5b2t Apr 17 07:19:35.530: INFO: Logging pods the kubelet thinks is on node capz-hw3kwu-md-0-s5b2t Apr 17 07:19:35.584: INFO: kube-proxy-k8dmz started at 2022-04-17 06:52:15 +0000 UTC (0+1 container statuses recorded) Apr 17 07:19:35.584: INFO: Container kube-proxy ready: true, restart count 0 Apr 17 07:19:35.584: INFO: calico-node-kdwxm started at 2022-04-17 06:52:15 +0000 UTC (3+1 container statuses recorded) Apr 17 07:19:35.584: INFO: Init container upgrade-ipam ready: true, restart count 0 Apr 17 07:19:35.584: INFO: Init container install-cni ready: true, restart count 0 Apr 17 07:19:35.584: INFO: Init container flexvol-driver ready: true, restart count 0 Apr 17 07:19:35.584: INFO: Container calico-node ready: true, restart count 0 Apr 17 07:19:35.584: INFO: csi-azurefile-controller-6dc68fcd56-8rfz5 started at 2022-04-17 07:09:05 +0000 UTC (0+6 container statuses recorded) Apr 17 07:19:35.584: INFO: Container azurefile ready: true, restart count 0 Apr 17 07:19:35.584: INFO: Container csi-attacher ready: true, restart count 0 Apr 17 07:19:35.584: INFO: Container csi-provisioner ready: true, restart count 0 Apr 17 07:19:35.584: INFO: Container csi-resizer ready: true, restart count 0 Apr 17 07:19:35.584: INFO: Container csi-snapshotter ready: true, restart count 0 Apr 17 07:19:35.584: INFO: Container liveness-probe ready: true, restart count 0 Apr 17 07:19:35.718: INFO: Latency metrics for node capz-hw3kwu-md-0-s5b2t Apr 17 07:19:35.718: INFO: Logging node info for node capz-hw3kwu-md-0-z65f8 Apr 17 07:19:35.747: INFO: Node Info: &Node{ObjectMeta:{capz-hw3kwu-md-0-z65f8 5048d97c-ff1d-4ba0-88c8-d11691e17334 3818 0 2022-04-17 06:52:14 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D4s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eastus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:capz-hw3kwu-md-0-z65f8 kubernetes.io/os:linux node.kubernetes.io/instance-type:Standard_D4s_v3 topology.kubernetes.io/region:eastus topology.kubernetes.io/zone:0] map[cluster.x-k8s.io/cluster-name:capz-hw3kwu cluster.x-k8s.io/cluster-namespace:default cluster.x-k8s.io/machine:capz-hw3kwu-md-0-6848989f78-jd4kj cluster.x-k8s.io/owner-kind:MachineSet cluster.x-k8s.io/owner-name:capz-hw3kwu-md-0-6848989f78 kubeadm.alpha.kubernetes.io/cri-socket:/run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.1.0.6/16 projectcalico.org/IPv4VXLANTunnelAddr:192.168.76.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{Go-http-client Update v1 2022-04-17 06:52:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubeadm.alpha.kubernetes.io/cri-socket":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {manager Update v1 2022-04-17 06:52:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:cluster.x-k8s.io/cluster-name":{},"f:cluster.x-k8s.io/cluster-namespace":{},"f:cluster.x-k8s.io/machine":{},"f:cluster.x-k8s.io/owner-kind":{},"f:cluster.x-k8s.io/owner-name":{}}}} } {kube-controller-manager Update v1 2022-04-17 06:52:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}} } {calico-node Update v1 2022-04-17 06:52:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4VXLANTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {Go-http-client Update v1 2022-04-17 06:52:45 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/===REDACTED===/resourceGroups/capz-hw3kwu/providers/Microsoft.Compute/virtualMachines/capz-hw3kwu-md-0-z65f8,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{133018140672 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{16783433728 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{119716326407 0} {<nil>} 119716326407 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{16678576128 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-04-17 06:52:34 +0000 UTC,LastTransitionTime:2022-04-17 06:52:34 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-04-17 07:15:24 +0000 UTC,LastTransitionTime:2022-04-17 06:52:14 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-04-17 07:15:24 +0000 UTC,LastTransitionTime:2022-04-17 06:52:14 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-04-17 07:15:24 +0000 UTC,LastTransitionTime:2022-04-17 06:52:14 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-04-17 07:15:24 +0000 UTC,LastTransitionTime:2022-04-17 06:52:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:capz-hw3kwu-md-0-z65f8,},NodeAddress{Type:InternalIP,Address:10.1.0.6,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:b782c957b05f4abdab39d8a3d9b9f57e,SystemUUID:daae8810-1f0c-2049-9522-bb81df1d16cb,BootID:dc006dbf-f36e-4be3-8ac7-84489e24c2a9,KernelVersion:5.13.0-1017-azure,OSImage:Ubuntu 20.04.4 LTS,ContainerRuntimeVersion:containerd://1.6.1,KubeletVersion:v1.23.5,KubeProxyVersion:v1.23.5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 k8s.gcr.io/etcd:3.5.1-0],SizeBytes:98888614,},ContainerImage{Names:[docker.io/calico/cni@sha256:2219eae79544b098119a06a8bb5608867f9ac00471592a00e2347f3ae4bea687 docker.io/calico/cni:v3.22.1],SizeBytes:80514590,},ContainerImage{Names:[docker.io/calico/node@sha256:1f8ed83e5264b4206cce7e1def11bca0b3ea7d5f4eb9b0ca0dbfc8cb968ca57e docker.io/calico/node:v3.22.1],SizeBytes:69647221,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:c1f625d115fbd9a12eac615653fc81c0edb33b2b5a76d1e09d5daed11fa557c1 k8s.gcr.io/kube-proxy:v1.23.5],SizeBytes:39278412,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:ddf5bf7196eb534271f9e5d403f4da19838d5610bb5ca191001bde5f32b5492e k8s.gcr.io/kube-apiserver:v1.23.5],SizeBytes:32603217,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:cca0fb3532abedcc95c5f64268d54da9ecc56cc4817ff08d0128941cf2b0e1a4 k8s.gcr.io/kube-controller-manager:v1.23.5],SizeBytes:30174093,},ContainerImage{Names:[docker.io/andyzhangx/samba@sha256:1c268eae7ec1eb9fbbbd4f0aab3ee41c7a4c4ecb0313c498cb11cfdcc762ad3e docker.io/andyzhangx/samba:win-fix],SizeBytes:21999042,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:489efb65da9edc40bf0911f3e6371e5bb6b8ad8fde1d55193a6cc84c2ef36626 k8s.gcr.io/kube-scheduler:v1.23.5],SizeBytes:15131395,},ContainerImage{Names:[k8s.gcr.io/coredns/coredns@sha256:5b6ec0d6de9baaf3e92d0f66cd96a25b9edbce8716f5f15dcd1a616b3abd590e k8s.gcr.io/coredns/coredns:v1.8.6],SizeBytes:13585107,},ContainerImage{Names:[docker.io/calico/pod2daemon-flexvol@sha256:35802ba083546a7c5e8b5bf0ee7ffad7f8a468e8c2b3631e7e9647512c94041d docker.io/calico/pod2daemon-flexvol:v3.22.1],SizeBytes:8462620,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Apr 17 07:19:35.747: INFO: Logging kubelet events for node capz-hw3kwu-md-0-z65f8 Apr 17 07:19:35.779: INFO: Logging pods the kubelet thinks is on node capz-hw3kwu-md-0-z65f8 Apr 17 07:19:35.830: INFO: calico-node-cbqj9 started at 2022-04-17 06:52:15 +0000 UTC (3+1 container statuses recorded) Apr 17 07:19:35.830: INFO: Init container upgrade-ipam ready: true, restart count 0 Apr 17 07:19:35.830: INFO: Init container install-cni ready: true, restart count 0 Apr 17 07:19:35.830: INFO: Init container flexvol-driver ready: true, restart count 0 Apr 17 07:19:35.830: INFO: Container calico-node ready: true, restart count 0 Apr 17 07:19:35.830: INFO: kube-proxy-g5xd5 started at 2022-04-17 06:52:15 +0000 UTC (0+1 container statuses recorded) Apr 17 07:19:35.830: INFO: Container kube-proxy ready: true, restart count 0 Apr 17 07:19:35.830: INFO: smb-server-55b87d449c-v7kd9 started at 2022-04-17 07:10:11 +0000 UTC (0+1 container statuses recorded) Apr 17 07:19:35.830: INFO: Container smb-server ready: true, restart count 0 Apr 17 07:19:35.960: INFO: Latency metrics for node capz-hw3kwu-md-0-z65f8 Apr 17 07:19:35.960: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "azurefile-2540" for this suite.
Find azurefile-volume-tester-qzwxk mentions in log files | View test history on testgrid
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create a deployment object, write and read to it, delete the pod and write and read to it again [kubernetes.io/azure-file] [file.csi.azure.com] [Windows]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create a pod with multiple volumes [kubernetes.io/azure-file] [file.csi.azure.com] [Windows]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create a pod with volume mount subpath [file.csi.azure.com] [Windows]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create a statefulset object, write and read to it, delete the pod and write and read to it again [file.csi.azure.com]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create a storage account with tags [file.csi.azure.com] [Windows]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create a volume on demand and mount it as readOnly in a pod [kubernetes.io/azure-file] [file.csi.azure.com] [Windows]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create a volume on demand and resize it [kubernetes.io/azure-file] [file.csi.azure.com] [Windows]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create a volume on demand with mount options (Bring Your Own Key) [file.csi.azure.com] [Windows]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create a volume on demand with useDataPlaneAPI [file.csi.azure.com] [Windows]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create an CSI inline volume [file.csi.azure.com]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create multiple PV objects, bind to PVCs and attach all to different pods on the same node [kubernetes.io/azure-file] [file.csi.azure.com] [Windows]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should delete PV with reclaimPolicy "Delete" [kubernetes.io/azure-file] [file.csi.azure.com] [Windows]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should mount on-prem smb server [file.csi.azure.com]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should retain PV with reclaimPolicy "Retain" [file.csi.azure.com] [Windows]
AzureFile CSI Driver End-to-End Tests Pre-Provisioned should use a pre-provisioned volume and mount it as readOnly in a pod [file.csi.azure.com] [Windows]
AzureFile CSI Driver End-to-End Tests Pre-Provisioned should use a pre-provisioned volume and mount it by multiple pods [file.csi.azure.com] [Windows]
AzureFile CSI Driver End-to-End Tests Pre-Provisioned should use a pre-provisioned volume and retain PV with reclaimPolicy "Retain" [file.csi.azure.com] [Windows]
AzureFile CSI Driver End-to-End Tests Pre-Provisioned should use existing credentials in k8s cluster [file.csi.azure.com] [Windows]
AzureFile CSI Driver End-to-End Tests Pre-Provisioned should use provided credentials [file.csi.azure.com] [Windows]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning [env] should retain PV with reclaimPolicy "Retain" [file.csi.azure.com] [disk]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create a NFS volume on demand on a storage account with private endpoint [file.csi.azure.com] [nfs]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create a NFS volume on demand with mount options [file.csi.azure.com] [nfs]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create a deployment object, write and read to it, delete the pod and write and read to it again [file.csi.azure.com] [disk]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create a pod with multiple NFS volumes [file.csi.azure.com]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create a pod, write and read to it, take a volume snapshot, and validate whether it is ready to use [file.csi.azure.com]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create a vhd disk volume on demand [kubernetes.io/azure-file] [file.csi.azure.com][disk]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create a vhd disk volume on demand and mount it as readOnly in a pod [file.csi.azure.com][disk]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create a volume after driver restart [kubernetes.io/azure-file] [file.csi.azure.com]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create an inline volume by in-tree driver [kubernetes.io/azure-file]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create multiple PV objects, bind to PVCs and attach all to different pods on the same node [file.csi.azure.com][disk]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should delete PV with reclaimPolicy "Delete" [file.csi.azure.com] [disk]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should receive FailedMount event with invalid mount options [file.csi.azure.com] [disk]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should receive FailedMount event with invalid mount options [file.csi.azure.com] [disk]
... skipping 671 lines ... certificate.cert-manager.io "selfsigned-cert" deleted # Create secret for AzureClusterIdentity ./hack/create-identity-secret.sh make[2]: Entering directory '/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure' make[2]: Nothing to be done for 'kubectl'. make[2]: Leaving directory '/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure' Error from server (NotFound): secrets "cluster-identity-secret" not found secret/cluster-identity-secret created secret/cluster-identity-secret labeled # Deploy CAPI curl --retry 3 -sSL https://github.com/kubernetes-sigs/cluster-api/releases/download/v1.1.2/cluster-api-components.yaml | /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/hack/tools/bin/envsubst-v2.0.0-20210730161058-179042472c46 | kubectl apply -f - namespace/capi-system created customresourcedefinition.apiextensions.k8s.io/clusterclasses.cluster.x-k8s.io created ... skipping 180 lines ... 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 11156 100 11156 0 0 122k 0 --:--:-- --:--:-- --:--:-- 122k Downloading https://get.helm.sh/helm-v3.8.2-linux-amd64.tar.gz Verifying checksum... Done. Preparing to install helm into /usr/local/bin helm installed into /usr/local/bin/helm docker pull capzci.azurecr.io/azurefile-csi:e2e-a3f61a5e163bc4536ff4e8a3aac2b0f5e7027564 || make container-all push-manifest Error response from daemon: manifest for capzci.azurecr.io/azurefile-csi:e2e-a3f61a5e163bc4536ff4e8a3aac2b0f5e7027564 not found: manifest unknown: manifest tagged by "e2e-a3f61a5e163bc4536ff4e8a3aac2b0f5e7027564" is not found make[2]: Entering directory '/home/prow/go/src/sigs.k8s.io/azurefile-csi-driver' CGO_ENABLED=0 GOOS=windows go build -a -ldflags "-X sigs.k8s.io/azurefile-csi-driver/pkg/azurefile.driverVersion=e2e-a3f61a5e163bc4536ff4e8a3aac2b0f5e7027564 -X sigs.k8s.io/azurefile-csi-driver/pkg/azurefile.gitCommit=a3f61a5e163bc4536ff4e8a3aac2b0f5e7027564 -X sigs.k8s.io/azurefile-csi-driver/pkg/azurefile.buildDate=2022-04-17T06:54:50Z -s -w -extldflags '-static'" -mod vendor -o _output/amd64/azurefileplugin.exe ./pkg/azurefileplugin docker buildx rm container-builder || true error: no builder "container-builder" found docker buildx create --use --name=container-builder container-builder # enable qemu for arm64 build # https://github.com/docker/buildx/issues/464#issuecomment-741507760 docker run --privileged --rm tonistiigi/binfmt --uninstall qemu-aarch64 Unable to find image 'tonistiigi/binfmt:latest' locally ... skipping 2473 lines ... image: "mcr.microsoft.com/oss/kubernetes-csi/csi-resizer:v1.4.0" args: - "-csi-address=$(ADDRESS)" - "-v=2" - "-leader-election" - "--leader-election-namespace=kube-system" - '-handle-volume-inuse-error=false' - '-timeout=120s' - '-feature-gates=RecoverVolumeExpansionFailure=true' env: - name: ADDRESS value: /csi/csi.sock imagePullPolicy: IfNotPresent ... skipping 148 lines ... Git Commit: N/A Go Version: go1.18.1 Platform: linux/amd64 Streaming logs below: [1mSTEP[0m: Building a namespace api object, basename azurefile W0417 07:10:11.109460 36148 azure.go:78] InitializeCloudFromSecret: failed to get cloud config from secret /: failed to get secret /: resource name may not be empty I0417 07:10:11.111236 36148 driver.go:93] Enabling controller service capability: CREATE_DELETE_VOLUME I0417 07:10:11.111277 36148 driver.go:93] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME I0417 07:10:11.111292 36148 driver.go:93] Enabling controller service capability: CREATE_DELETE_SNAPSHOT I0417 07:10:11.111298 36148 driver.go:93] Enabling controller service capability: EXPAND_VOLUME I0417 07:10:11.111301 36148 driver.go:93] Enabling controller service capability: SINGLE_NODE_MULTI_WRITER I0417 07:10:11.111307 36148 driver.go:112] Enabling volume access mode: SINGLE_NODE_WRITER ... skipping 120 lines ... Apr 17 07:12:14.729: INFO: PersistentVolumeClaim pvc-wp46c found but phase is Pending instead of Bound. Apr 17 07:12:16.759: INFO: PersistentVolumeClaim pvc-wp46c found and phase=Bound (1m37.418994538s) [1mSTEP[0m: checking the PVC [1mSTEP[0m: validating provisioned PV [1mSTEP[0m: checking the PV [1mSTEP[0m: deploying the pod [1mSTEP[0m: checking that the pods command exits with no error Apr 17 07:12:16.843: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-qzwxk" in namespace "azurefile-2540" to be "Succeeded or Failed" Apr 17 07:12:16.871: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 27.857399ms Apr 17 07:12:18.899: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 2.055719168s Apr 17 07:12:20.928: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 4.084302341s Apr 17 07:12:22.958: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 6.114788908s Apr 17 07:12:24.987: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 8.144057924s Apr 17 07:12:27.015: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 10.172106238s ... skipping 201 lines ... Apr 17 07:19:17.055: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 7m0.211791864s Apr 17 07:19:19.084: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 7m2.241062814s Apr 17 07:19:21.114: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 7m4.270242195s Apr 17 07:19:23.143: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 7m6.299911969s Apr 17 07:19:25.174: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 7m8.33021853s Apr 17 07:19:27.203: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Pending", Reason="", readiness=false. Elapsed: 7m10.3601485s Apr 17 07:19:29.233: INFO: Pod "azurefile-volume-tester-qzwxk": Phase="Failed", Reason="", readiness=false. Elapsed: 7m12.390102608s Apr 17 07:19:29.234: INFO: deleting Pod "azurefile-2540"/"azurefile-volume-tester-qzwxk" Apr 17 07:19:29.281: INFO: Pod azurefile-volume-tester-qzwxk has the following logs: [1mSTEP[0m: Deleting pod azurefile-volume-tester-qzwxk in namespace azurefile-2540 Apr 17 07:19:29.318: INFO: deleting PVC "azurefile-2540"/"pvc-wp46c" Apr 17 07:19:29.318: INFO: Deleting PersistentVolumeClaim "pvc-wp46c" [1mSTEP[0m: waiting for claim's PV "pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3" to be deleted ... skipping 6 lines ... [1mSTEP[0m: Collecting events from namespace "azurefile-2540". [1mSTEP[0m: Found 13 events. Apr 17 07:19:34.549: INFO: At 2022-04-17 07:10:39 +0000 UTC - event for pvc-wp46c: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "file.csi.azure.com" or manually created by system administrator Apr 17 07:19:34.549: INFO: At 2022-04-17 07:10:39 +0000 UTC - event for pvc-wp46c: {file.csi.azure.com_capz-hw3kwu-md-0-s5b2t_fad5e90c-aa63-4905-987b-f4fd31c3d02e } Provisioning: External provisioner is provisioning volume for claim "azurefile-2540/pvc-wp46c" Apr 17 07:19:34.549: INFO: At 2022-04-17 07:12:15 +0000 UTC - event for pvc-wp46c: {file.csi.azure.com_capz-hw3kwu-md-0-s5b2t_fad5e90c-aa63-4905-987b-f4fd31c3d02e } ProvisioningSucceeded: Successfully provisioned volume pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3 Apr 17 07:19:34.549: INFO: At 2022-04-17 07:12:16 +0000 UTC - event for azurefile-volume-tester-qzwxk: {default-scheduler } Scheduled: Successfully assigned azurefile-2540/azurefile-volume-tester-qzwxk to capz-hw3k-g6lbs Apr 17 07:19:34.549: INFO: At 2022-04-17 07:12:24 +0000 UTC - event for azurefile-volume-tester-qzwxk: {kubelet capz-hw3k-g6lbs} FailedMount: MountVolume.MountDevice failed for volume "pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3" : rpc error: code = Internal desc = volume(capz-hw3kwu#fedf9d94b13a54e409b27ba#pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3#) mount "\\\\fedf9d94b13a54e409b27ba.privatelink.file.core.windows.net\\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3" on "\\var\\lib\\kubelet\\plugins\\kubernetes.io\\csi\\pv\\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3\\globalmount" failed with smb mapping failed with error: rpc error: code = Unknown desc = NewSmbGlobalMapping failed. output: "New-SmbGlobalMapping : Access is denied. \r\nAt line:1 char:190\r\n+ ... ser, $PWord;New-SmbGlobalMapping -RemotePath $Env:smbremotepath -Cred ...\r\n+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~\r\n + CategoryInfo : PermissionDenied: (MSFT_SmbGlobalMapping:ROOT/Microsoft/...mbGlobalMapping) [New-SmbGlob \r\n alMapping], CimException\r\n + FullyQualifiedErrorId : Windows System Error 5,New-SmbGlobalMapping\r\n \r\n", err: exit status 1 Apr 17 07:19:34.549: INFO: At 2022-04-17 07:13:13 +0000 UTC - event for azurefile-volume-tester-qzwxk: {kubelet capz-hw3k-g6lbs} Pulling: Pulling image "mcr.microsoft.com/windows/servercore:ltsc2022" Apr 17 07:19:34.549: INFO: At 2022-04-17 07:17:27 +0000 UTC - event for azurefile-volume-tester-qzwxk: {kubelet capz-hw3k-g6lbs} Pulled: Successfully pulled image "mcr.microsoft.com/windows/servercore:ltsc2022" in 4m13.8411483s Apr 17 07:19:34.549: INFO: At 2022-04-17 07:17:27 +0000 UTC - event for azurefile-volume-tester-qzwxk: {kubelet capz-hw3k-g6lbs} Created: Created container volume-tester Apr 17 07:19:34.549: INFO: At 2022-04-17 07:19:27 +0000 UTC - event for azurefile-volume-tester-qzwxk: {kubelet capz-hw3k-g6lbs} Failed: Error: context deadline exceeded Apr 17 07:19:34.549: INFO: At 2022-04-17 07:19:28 +0000 UTC - event for azurefile-volume-tester-qzwxk: {kubelet capz-hw3k-g6lbs} FailedMount: MountVolume.SetUp failed for volume "kube-api-access-2p9v6" : object "azurefile-2540"/"kube-root-ca.crt" not registered Apr 17 07:19:34.549: INFO: At 2022-04-17 07:19:28 +0000 UTC - event for azurefile-volume-tester-qzwxk: {kubelet capz-hw3k-g6lbs} Pulled: Container image "mcr.microsoft.com/windows/servercore:ltsc2022" already present on machine Apr 17 07:19:34.549: INFO: At 2022-04-17 07:19:32 +0000 UTC - event for azurefile-volume-tester-qzwxk: {kubelet capz-hw3k-g6lbs} Started: Started container volume-tester Apr 17 07:19:34.549: INFO: At 2022-04-17 07:19:33 +0000 UTC - event for azurefile-volume-tester-qzwxk: {kubelet capz-hw3k-g6lbs} Killing: Stopping container volume-tester Apr 17 07:19:34.577: INFO: POD NODE PHASE GRACE CONDITIONS Apr 17 07:19:34.577: INFO: Apr 17 07:19:34.614: INFO: ... skipping 115 lines ... [91m[1m• Failure [537.294 seconds][0m Dynamic Provisioning [90m/home/prow/go/src/sigs.k8s.io/azurefile-csi-driver/test/e2e/dynamic_provisioning_test.go:42[0m [91m[1mshould create a volume on demand with mount options [kubernetes.io/azure-file] [file.csi.azure.com] [Windows] [It][0m [90m/home/prow/go/src/sigs.k8s.io/azurefile-csi-driver/test/e2e/dynamic_provisioning_test.go:104[0m [91mUnexpected error: <*errors.errorString | 0xc000b8d7f0>: { s: "pod \"azurefile-volume-tester-qzwxk\" failed with status: {Phase:Failed Conditions:[{Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-17 07:12:16 +0000 UTC Reason: Message:} {Type:Ready Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-17 07:12:16 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [volume-tester]} {Type:ContainersReady Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-17 07:12:16 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [volume-tester]} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-17 07:12:16 +0000 UTC Reason: Message:}] Message: Reason: NominatedNodeName: HostIP:10.1.0.7 PodIP:192.168.64.4 PodIPs:[{IP:192.168.64.4}] StartTime:2022-04-17 07:12:16 +0000 UTC InitContainerStatuses:[] ContainerStatuses:[{Name:volume-tester State:{Waiting:&ContainerStateWaiting{Reason:RunContainerError,Message:context deadline exceeded,} Running:nil Terminated:nil} LastTerminationState:{Waiting:nil Running:nil Terminated:&ContainerStateTerminated{ExitCode:0,Signal:0,Reason:,Message:,StartedAt:0001-01-01 00:00:00 +0000 UTC,FinishedAt:0001-01-01 00:00:00 +0000 UTC,ContainerID:containerd://8a1b4e221ce200dfaade518931d7e99a5fc9cae8695661dd48295be3f8c8805a,}} Ready:false RestartCount:0 Image:mcr.microsoft.com/windows/servercore:ltsc2022 ImageID:mcr.microsoft.com/windows/servercore@sha256:378d85bd8e7388a777d25009f8523d1e95a5f544f131eaada83171045d5b2c1e ContainerID:containerd://8a1b4e221ce200dfaade518931d7e99a5fc9cae8695661dd48295be3f8c8805a Started:0xc000885f18}] QOSClass:BestEffort EphemeralContainerStatuses:[]}", } pod "azurefile-volume-tester-qzwxk" failed with status: {Phase:Failed Conditions:[{Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-17 07:12:16 +0000 UTC Reason: Message:} {Type:Ready Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-17 07:12:16 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [volume-tester]} {Type:ContainersReady Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-17 07:12:16 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [volume-tester]} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-17 07:12:16 +0000 UTC Reason: Message:}] Message: Reason: NominatedNodeName: HostIP:10.1.0.7 PodIP:192.168.64.4 PodIPs:[{IP:192.168.64.4}] StartTime:2022-04-17 07:12:16 +0000 UTC InitContainerStatuses:[] ContainerStatuses:[{Name:volume-tester State:{Waiting:&ContainerStateWaiting{Reason:RunContainerError,Message:context deadline exceeded,} Running:nil Terminated:nil} LastTerminationState:{Waiting:nil Running:nil Terminated:&ContainerStateTerminated{ExitCode:0,Signal:0,Reason:,Message:,StartedAt:0001-01-01 00:00:00 +0000 UTC,FinishedAt:0001-01-01 00:00:00 +0000 UTC,ContainerID:containerd://8a1b4e221ce200dfaade518931d7e99a5fc9cae8695661dd48295be3f8c8805a,}} Ready:false RestartCount:0 Image:mcr.microsoft.com/windows/servercore:ltsc2022 ImageID:mcr.microsoft.com/windows/servercore@sha256:378d85bd8e7388a777d25009f8523d1e95a5f544f131eaada83171045d5b2c1e ContainerID:containerd://8a1b4e221ce200dfaade518931d7e99a5fc9cae8695661dd48295be3f8c8805a Started:0xc000885f18}] QOSClass:BestEffort EphemeralContainerStatuses:[]} occurred[0m /home/prow/go/src/sigs.k8s.io/azurefile-csi-driver/test/e2e/testsuites/testsuites.go:690 [90m------------------------------[0m [0mDynamic Provisioning[0m [1mshould create a pod with volume mount subpath [file.csi.azure.com] [Windows][0m ... skipping 31 lines ... Apr 17 07:20:05.245: INFO: PersistentVolumeClaim pvc-8cskp found but phase is Pending instead of Bound. Apr 17 07:20:07.275: INFO: PersistentVolumeClaim pvc-8cskp found and phase=Bound (30.464953265s) [1mSTEP[0m: checking the PVC [1mSTEP[0m: validating provisioned PV [1mSTEP[0m: checking the PV [1mSTEP[0m: deploying the pod [1mSTEP[0m: checking that the pods command exits with no error Apr 17 07:20:07.363: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-gf52f" in namespace "azurefile-4728" to be "Succeeded or Failed" Apr 17 07:20:07.391: INFO: Pod "azurefile-volume-tester-gf52f": Phase="Pending", Reason="", readiness=false. Elapsed: 27.735789ms Apr 17 07:20:09.420: INFO: Pod "azurefile-volume-tester-gf52f": Phase="Pending", Reason="", readiness=false. Elapsed: 2.056434547s Apr 17 07:20:11.450: INFO: Pod "azurefile-volume-tester-gf52f": Phase="Pending", Reason="", readiness=false. Elapsed: 4.086613686s Apr 17 07:20:13.480: INFO: Pod "azurefile-volume-tester-gf52f": Phase="Pending", Reason="", readiness=false. Elapsed: 6.116448865s Apr 17 07:20:15.509: INFO: Pod "azurefile-volume-tester-gf52f": Phase="Pending", Reason="", readiness=false. Elapsed: 8.145551358s Apr 17 07:20:17.539: INFO: Pod "azurefile-volume-tester-gf52f": Phase="Pending", Reason="", readiness=false. Elapsed: 10.175213s Apr 17 07:20:19.569: INFO: Pod "azurefile-volume-tester-gf52f": Phase="Pending", Reason="", readiness=false. Elapsed: 12.205313914s Apr 17 07:20:21.598: INFO: Pod "azurefile-volume-tester-gf52f": Phase="Pending", Reason="", readiness=false. Elapsed: 14.234797521s Apr 17 07:20:23.628: INFO: Pod "azurefile-volume-tester-gf52f": Phase="Running", Reason="", readiness=true. Elapsed: 16.264440794s Apr 17 07:20:25.657: INFO: Pod "azurefile-volume-tester-gf52f": Phase="Running", Reason="", readiness=true. Elapsed: 18.293851252s Apr 17 07:20:27.688: INFO: Pod "azurefile-volume-tester-gf52f": Phase="Running", Reason="", readiness=true. Elapsed: 20.324967286s Apr 17 07:20:29.717: INFO: Pod "azurefile-volume-tester-gf52f": Phase="Succeeded", Reason="", readiness=false. Elapsed: 22.353931568s [1mSTEP[0m: Saw pod success Apr 17 07:20:29.718: INFO: Pod "azurefile-volume-tester-gf52f" satisfied condition "Succeeded or Failed" Apr 17 07:20:29.718: INFO: deleting Pod "azurefile-4728"/"azurefile-volume-tester-gf52f" Apr 17 07:20:29.755: INFO: Pod azurefile-volume-tester-gf52f has the following logs: hello world [1mSTEP[0m: Deleting pod azurefile-volume-tester-gf52f in namespace azurefile-4728 Apr 17 07:20:29.789: INFO: deleting PVC "azurefile-4728"/"pvc-8cskp" Apr 17 07:20:29.789: INFO: Deleting PersistentVolumeClaim "pvc-8cskp" ... skipping 116 lines ... Apr 17 07:21:33.531: INFO: PersistentVolumeClaim pvc-m29dv found but phase is Pending instead of Bound. Apr 17 07:21:35.560: INFO: PersistentVolumeClaim pvc-m29dv found and phase=Bound (20.313260829s) [1mSTEP[0m: checking the PVC [1mSTEP[0m: validating provisioned PV [1mSTEP[0m: checking the PV [1mSTEP[0m: deploying the pod [1mSTEP[0m: checking that the pods command exits with an error Apr 17 07:21:35.645: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-qcnfl" in namespace "azurefile-2790" to be "Error status code" Apr 17 07:21:35.672: INFO: Pod "azurefile-volume-tester-qcnfl": Phase="Pending", Reason="", readiness=false. Elapsed: 27.579633ms Apr 17 07:21:37.702: INFO: Pod "azurefile-volume-tester-qcnfl": Phase="Pending", Reason="", readiness=false. Elapsed: 2.056917708s Apr 17 07:21:39.731: INFO: Pod "azurefile-volume-tester-qcnfl": Phase="Pending", Reason="", readiness=false. Elapsed: 4.086535777s Apr 17 07:21:41.761: INFO: Pod "azurefile-volume-tester-qcnfl": Phase="Pending", Reason="", readiness=false. Elapsed: 6.116609369s Apr 17 07:21:43.790: INFO: Pod "azurefile-volume-tester-qcnfl": Phase="Pending", Reason="", readiness=false. Elapsed: 8.145402571s Apr 17 07:21:45.820: INFO: Pod "azurefile-volume-tester-qcnfl": Phase="Pending", Reason="", readiness=false. Elapsed: 10.175099273s Apr 17 07:21:47.849: INFO: Pod "azurefile-volume-tester-qcnfl": Phase="Running", Reason="", readiness=true. Elapsed: 12.204000169s Apr 17 07:21:49.878: INFO: Pod "azurefile-volume-tester-qcnfl": Phase="Running", Reason="", readiness=true. Elapsed: 14.23359506s Apr 17 07:21:51.908: INFO: Pod "azurefile-volume-tester-qcnfl": Phase="Running", Reason="", readiness=true. Elapsed: 16.262958094s Apr 17 07:21:53.937: INFO: Pod "azurefile-volume-tester-qcnfl": Phase="Failed", Reason="", readiness=false. Elapsed: 18.292151348s [1mSTEP[0m: Saw pod failure Apr 17 07:21:53.937: INFO: Pod "azurefile-volume-tester-qcnfl" satisfied condition "Error status code" [1mSTEP[0m: checking that pod logs contain expected message Apr 17 07:21:53.977: INFO: deleting Pod "azurefile-2790"/"azurefile-volume-tester-qcnfl" Apr 17 07:21:54.012: INFO: Pod azurefile-volume-tester-qcnfl has the following logs: out-file : Access to the path 'C:\mnt\test-1\data' is denied. At line:1 char:1 + echo $null >> C:\mnt\test-1\data + ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ... skipping 201 lines ... Apr 17 07:23:10.554: INFO: PersistentVolumeClaim pvc-q2nhw found but phase is Pending instead of Bound. Apr 17 07:23:12.584: INFO: PersistentVolumeClaim pvc-q2nhw found and phase=Bound (2.065524983s) [1mSTEP[0m: checking the PVC [1mSTEP[0m: validating provisioned PV [1mSTEP[0m: checking the PV [1mSTEP[0m: deploying the pod [1mSTEP[0m: checking that the pods command exits with no error Apr 17 07:23:12.673: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-75wg7" in namespace "azurefile-4538" to be "Succeeded or Failed" Apr 17 07:23:12.701: INFO: Pod "azurefile-volume-tester-75wg7": Phase="Pending", Reason="", readiness=false. Elapsed: 27.265012ms Apr 17 07:23:14.729: INFO: Pod "azurefile-volume-tester-75wg7": Phase="Pending", Reason="", readiness=false. Elapsed: 2.055292273s Apr 17 07:23:16.757: INFO: Pod "azurefile-volume-tester-75wg7": Phase="Pending", Reason="", readiness=false. Elapsed: 4.08368721s Apr 17 07:23:18.786: INFO: Pod "azurefile-volume-tester-75wg7": Phase="Pending", Reason="", readiness=false. Elapsed: 6.112233836s Apr 17 07:23:20.815: INFO: Pod "azurefile-volume-tester-75wg7": Phase="Pending", Reason="", readiness=false. Elapsed: 8.141689752s Apr 17 07:23:22.845: INFO: Pod "azurefile-volume-tester-75wg7": Phase="Pending", Reason="", readiness=false. Elapsed: 10.17168953s Apr 17 07:23:24.874: INFO: Pod "azurefile-volume-tester-75wg7": Phase="Pending", Reason="", readiness=false. Elapsed: 12.200555603s Apr 17 07:23:26.905: INFO: Pod "azurefile-volume-tester-75wg7": Phase="Running", Reason="", readiness=true. Elapsed: 14.232068969s Apr 17 07:23:28.935: INFO: Pod "azurefile-volume-tester-75wg7": Phase="Running", Reason="", readiness=true. Elapsed: 16.261389854s Apr 17 07:23:30.964: INFO: Pod "azurefile-volume-tester-75wg7": Phase="Running", Reason="", readiness=true. Elapsed: 18.290975883s Apr 17 07:23:32.993: INFO: Pod "azurefile-volume-tester-75wg7": Phase="Succeeded", Reason="", readiness=false. Elapsed: 20.319933599s [1mSTEP[0m: Saw pod success Apr 17 07:23:32.993: INFO: Pod "azurefile-volume-tester-75wg7" satisfied condition "Succeeded or Failed" [1mSTEP[0m: resizing the pvc [1mSTEP[0m: sleep 30s waiting for resize complete [1mSTEP[0m: checking the resizing result [1mSTEP[0m: checking the resizing PV result [1mSTEP[0m: checking the resizing azurefile result Apr 17 07:24:03.340: INFO: deleting Pod "azurefile-4538"/"azurefile-volume-tester-75wg7" ... skipping 303 lines ... Apr 17 07:24:24.397: INFO: PersistentVolumeClaim pvc-m2xqh found but phase is Pending instead of Bound. Apr 17 07:24:26.426: INFO: PersistentVolumeClaim pvc-m2xqh found and phase=Bound (2.056703977s) [1mSTEP[0m: checking the PVC [1mSTEP[0m: validating provisioned PV [1mSTEP[0m: checking the PV [1mSTEP[0m: deploying the pod [1mSTEP[0m: checking that the pods command exits with no error Apr 17 07:24:26.511: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-t5922" in namespace "azurefile-7726" to be "Succeeded or Failed" Apr 17 07:24:26.539: INFO: Pod "azurefile-volume-tester-t5922": Phase="Pending", Reason="", readiness=false. Elapsed: 28.155427ms Apr 17 07:24:28.569: INFO: Pod "azurefile-volume-tester-t5922": Phase="Pending", Reason="", readiness=false. Elapsed: 2.057738677s Apr 17 07:24:30.599: INFO: Pod "azurefile-volume-tester-t5922": Phase="Pending", Reason="", readiness=false. Elapsed: 4.088131884s Apr 17 07:24:32.629: INFO: Pod "azurefile-volume-tester-t5922": Phase="Pending", Reason="", readiness=false. Elapsed: 6.117924724s Apr 17 07:24:34.659: INFO: Pod "azurefile-volume-tester-t5922": Phase="Pending", Reason="", readiness=false. Elapsed: 8.147875178s Apr 17 07:24:36.688: INFO: Pod "azurefile-volume-tester-t5922": Phase="Pending", Reason="", readiness=false. Elapsed: 10.17761478s Apr 17 07:24:38.720: INFO: Pod "azurefile-volume-tester-t5922": Phase="Pending", Reason="", readiness=false. Elapsed: 12.208688241s Apr 17 07:24:40.749: INFO: Pod "azurefile-volume-tester-t5922": Phase="Running", Reason="", readiness=true. Elapsed: 14.237827029s Apr 17 07:24:42.780: INFO: Pod "azurefile-volume-tester-t5922": Phase="Running", Reason="", readiness=true. Elapsed: 16.268650062s Apr 17 07:24:44.809: INFO: Pod "azurefile-volume-tester-t5922": Phase="Running", Reason="", readiness=true. Elapsed: 18.298130126s Apr 17 07:24:46.839: INFO: Pod "azurefile-volume-tester-t5922": Phase="Succeeded", Reason="", readiness=false. Elapsed: 20.327826777s [1mSTEP[0m: Saw pod success Apr 17 07:24:46.839: INFO: Pod "azurefile-volume-tester-t5922" satisfied condition "Succeeded or Failed" Apr 17 07:24:46.839: INFO: deleting Pod "azurefile-7726"/"azurefile-volume-tester-t5922" Apr 17 07:24:47.150: INFO: Pod azurefile-volume-tester-t5922 has the following logs: hello world [1mSTEP[0m: Deleting pod azurefile-volume-tester-t5922 in namespace azurefile-7726 Apr 17 07:24:47.185: INFO: deleting PVC "azurefile-7726"/"pvc-m2xqh" Apr 17 07:24:47.185: INFO: Deleting PersistentVolumeClaim "pvc-m2xqh" ... skipping 96 lines ... check the driver pods if restarts ... ====================================================================================== 2022/04/17 07:25:19 Check successfully Apr 17 07:25:19.479: INFO: >>> kubeConfig: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig 2022/04/17 07:25:19 run script: test/utils/get_storage_account_secret_name.sh 2022/04/17 07:25:19 got output: azure-storage-account-f76f2647d622d47d1bc2366-secret , error: <nil> 2022/04/17 07:25:19 got storage account secret name: azure-storage-account-f76f2647d622d47d1bc2366-secret [1mSTEP[0m: setting up the StorageClass [1mSTEP[0m: creating a StorageClass [1mSTEP[0m: setting up the PVC and PV [1mSTEP[0m: creating a PVC [1mSTEP[0m: waiting for PVC to be in phase "Bound" Apr 17 07:25:19.749: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-wff64] to have phase Bound Apr 17 07:25:19.777: INFO: PersistentVolumeClaim pvc-wff64 found but phase is Pending instead of Bound. Apr 17 07:25:21.806: INFO: PersistentVolumeClaim pvc-wff64 found and phase=Bound (2.056592408s) [1mSTEP[0m: checking the PVC [1mSTEP[0m: validating provisioned PV [1mSTEP[0m: checking the PV [1mSTEP[0m: deploying the pod [1mSTEP[0m: checking that the pods command exits with no error Apr 17 07:25:21.891: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-zdqp7" in namespace "azurefile-1387" to be "Succeeded or Failed" Apr 17 07:25:21.918: INFO: Pod "azurefile-volume-tester-zdqp7": Phase="Pending", Reason="", readiness=false. Elapsed: 27.665507ms Apr 17 07:25:23.948: INFO: Pod "azurefile-volume-tester-zdqp7": Phase="Pending", Reason="", readiness=false. Elapsed: 2.05702505s Apr 17 07:25:25.978: INFO: Pod "azurefile-volume-tester-zdqp7": Phase="Pending", Reason="", readiness=false. Elapsed: 4.087433585s Apr 17 07:25:28.007: INFO: Pod "azurefile-volume-tester-zdqp7": Phase="Pending", Reason="", readiness=false. Elapsed: 6.11677687s Apr 17 07:25:30.036: INFO: Pod "azurefile-volume-tester-zdqp7": Phase="Pending", Reason="", readiness=false. Elapsed: 8.145665075s Apr 17 07:25:32.065: INFO: Pod "azurefile-volume-tester-zdqp7": Phase="Running", Reason="", readiness=true. Elapsed: 10.174501762s Apr 17 07:25:34.095: INFO: Pod "azurefile-volume-tester-zdqp7": Phase="Running", Reason="", readiness=true. Elapsed: 12.20459056s Apr 17 07:25:36.124: INFO: Pod "azurefile-volume-tester-zdqp7": Phase="Running", Reason="", readiness=true. Elapsed: 14.233456639s Apr 17 07:25:38.155: INFO: Pod "azurefile-volume-tester-zdqp7": Phase="Running", Reason="", readiness=true. Elapsed: 16.26396048s Apr 17 07:25:40.184: INFO: Pod "azurefile-volume-tester-zdqp7": Phase="Succeeded", Reason="", readiness=false. Elapsed: 18.293514356s [1mSTEP[0m: Saw pod success Apr 17 07:25:40.184: INFO: Pod "azurefile-volume-tester-zdqp7" satisfied condition "Succeeded or Failed" Apr 17 07:25:40.184: INFO: deleting Pod "azurefile-1387"/"azurefile-volume-tester-zdqp7" Apr 17 07:25:40.220: INFO: Pod azurefile-volume-tester-zdqp7 has the following logs: hello world [1mSTEP[0m: Deleting pod azurefile-volume-tester-zdqp7 in namespace azurefile-1387 Apr 17 07:25:40.260: INFO: deleting PVC "azurefile-1387"/"pvc-wff64" Apr 17 07:25:40.260: INFO: Deleting PersistentVolumeClaim "pvc-wff64" ... skipping 44 lines ... Apr 17 07:26:04.374: INFO: PersistentVolumeClaim pvc-kllh7 found but phase is Pending instead of Bound. Apr 17 07:26:06.404: INFO: PersistentVolumeClaim pvc-kllh7 found and phase=Bound (20.318983512s) [1mSTEP[0m: checking the PVC [1mSTEP[0m: validating provisioned PV [1mSTEP[0m: checking the PV [1mSTEP[0m: deploying the pod [1mSTEP[0m: checking that the pods command exits with no error Apr 17 07:26:06.489: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-7vrsw" in namespace "azurefile-4547" to be "Succeeded or Failed" Apr 17 07:26:06.520: INFO: Pod "azurefile-volume-tester-7vrsw": Phase="Pending", Reason="", readiness=false. Elapsed: 30.340832ms Apr 17 07:26:08.548: INFO: Pod "azurefile-volume-tester-7vrsw": Phase="Pending", Reason="", readiness=false. Elapsed: 2.059049183s Apr 17 07:26:10.577: INFO: Pod "azurefile-volume-tester-7vrsw": Phase="Pending", Reason="", readiness=false. Elapsed: 4.08798468s Apr 17 07:26:12.608: INFO: Pod "azurefile-volume-tester-7vrsw": Phase="Pending", Reason="", readiness=false. Elapsed: 6.118313566s Apr 17 07:26:14.637: INFO: Pod "azurefile-volume-tester-7vrsw": Phase="Pending", Reason="", readiness=false. Elapsed: 8.148090035s Apr 17 07:26:16.667: INFO: Pod "azurefile-volume-tester-7vrsw": Phase="Running", Reason="", readiness=true. Elapsed: 10.177969283s Apr 17 07:26:18.697: INFO: Pod "azurefile-volume-tester-7vrsw": Phase="Running", Reason="", readiness=true. Elapsed: 12.207638515s Apr 17 07:26:20.726: INFO: Pod "azurefile-volume-tester-7vrsw": Phase="Running", Reason="", readiness=true. Elapsed: 14.236500697s Apr 17 07:26:22.756: INFO: Pod "azurefile-volume-tester-7vrsw": Phase="Succeeded", Reason="", readiness=false. Elapsed: 16.266389903s [1mSTEP[0m: Saw pod success Apr 17 07:26:22.756: INFO: Pod "azurefile-volume-tester-7vrsw" satisfied condition "Succeeded or Failed" Apr 17 07:26:22.756: INFO: deleting Pod "azurefile-4547"/"azurefile-volume-tester-7vrsw" Apr 17 07:26:22.796: INFO: Pod azurefile-volume-tester-7vrsw has the following logs: hello world [1mSTEP[0m: Deleting pod azurefile-volume-tester-7vrsw in namespace azurefile-4547 Apr 17 07:26:22.839: INFO: deleting PVC "azurefile-4547"/"pvc-kllh7" Apr 17 07:26:22.839: INFO: Deleting PersistentVolumeClaim "pvc-kllh7" ... skipping 75 lines ... check the driver pods if restarts ... ====================================================================================== 2022/04/17 07:27:50 Check successfully Apr 17 07:27:50.746: INFO: >>> kubeConfig: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig 2022/04/17 07:27:50 run script: test/utils/get_storage_account_secret_name.sh 2022/04/17 07:27:50 got output: azure-storage-account-f76f2647d622d47d1bc2366-secret , error: <nil> 2022/04/17 07:27:50 got storage account secret name: azure-storage-account-f76f2647d622d47d1bc2366-secret [1mSTEP[0m: Successfully provisioned AzureFile volume: "capz-hw3kwu#f76f2647d622d47d1bc2366#csi-inline-smb-volume##csi-inline-smb-volume" [1mSTEP[0m: deploying the pod [1mSTEP[0m: checking that the pods command exits with no error Apr 17 07:27:51.860: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-vthsh" in namespace "azurefile-4801" to be "Succeeded or Failed" Apr 17 07:27:51.893: INFO: Pod "azurefile-volume-tester-vthsh": Phase="Pending", Reason="", readiness=false. Elapsed: 33.401362ms Apr 17 07:27:53.923: INFO: Pod "azurefile-volume-tester-vthsh": Phase="Pending", Reason="", readiness=false. Elapsed: 2.062819119s Apr 17 07:27:55.952: INFO: Pod "azurefile-volume-tester-vthsh": Phase="Pending", Reason="", readiness=false. Elapsed: 4.092461599s Apr 17 07:27:57.983: INFO: Pod "azurefile-volume-tester-vthsh": Phase="Pending", Reason="", readiness=false. Elapsed: 6.122622377s Apr 17 07:28:00.012: INFO: Pod "azurefile-volume-tester-vthsh": Phase="Pending", Reason="", readiness=false. Elapsed: 8.152220038s Apr 17 07:28:02.041: INFO: Pod "azurefile-volume-tester-vthsh": Phase="Running", Reason="", readiness=true. Elapsed: 10.181555524s Apr 17 07:28:04.071: INFO: Pod "azurefile-volume-tester-vthsh": Phase="Running", Reason="", readiness=true. Elapsed: 12.210860413s Apr 17 07:28:06.101: INFO: Pod "azurefile-volume-tester-vthsh": Phase="Running", Reason="", readiness=true. Elapsed: 14.241103596s Apr 17 07:28:08.131: INFO: Pod "azurefile-volume-tester-vthsh": Phase="Succeeded", Reason="", readiness=false. Elapsed: 16.270806901s [1mSTEP[0m: Saw pod success Apr 17 07:28:08.131: INFO: Pod "azurefile-volume-tester-vthsh" satisfied condition "Succeeded or Failed" Apr 17 07:28:08.131: INFO: deleting Pod "azurefile-4801"/"azurefile-volume-tester-vthsh" Apr 17 07:28:08.168: INFO: Pod azurefile-volume-tester-vthsh has the following logs: hello world [1mSTEP[0m: Deleting pod azurefile-volume-tester-vthsh in namespace azurefile-4801 Apr 17 07:28:08.206: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [1mSTEP[0m: Destroying namespace "azurefile-4801" for this suite. ... skipping 43 lines ... ====================================================================================== 2022/04/17 07:28:09 Check successfully Apr 17 07:28:09.257: INFO: >>> kubeConfig: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [1mSTEP[0m: creating secret smbcreds in namespace azurefile-1166 2022/04/17 07:28:09 run script: test/utils/get_smb_svc_public_ip.sh 2022/04/17 07:28:09 got output: 52.226.200.247 , error: <nil> 2022/04/17 07:28:09 use server on Windows: 52.226.200.247 [1mSTEP[0m: deploying the pod [1mSTEP[0m: checking that the pods command exits with no error Apr 17 07:28:09.545: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-njmqg" in namespace "azurefile-1166" to be "Succeeded or Failed" Apr 17 07:28:09.580: INFO: Pod "azurefile-volume-tester-njmqg": Phase="Pending", Reason="", readiness=false. Elapsed: 35.403729ms Apr 17 07:28:11.610: INFO: Pod "azurefile-volume-tester-njmqg": Phase="Pending", Reason="", readiness=false. Elapsed: 2.064722682s Apr 17 07:28:13.640: INFO: Pod "azurefile-volume-tester-njmqg": Phase="Pending", Reason="", readiness=false. Elapsed: 4.094959184s Apr 17 07:28:15.670: INFO: Pod "azurefile-volume-tester-njmqg": Phase="Pending", Reason="", readiness=false. Elapsed: 6.125095644s Apr 17 07:28:17.699: INFO: Pod "azurefile-volume-tester-njmqg": Phase="Pending", Reason="", readiness=false. Elapsed: 8.154431251s Apr 17 07:28:19.729: INFO: Pod "azurefile-volume-tester-njmqg": Phase="Pending", Reason="", readiness=false. Elapsed: 10.184030183s Apr 17 07:28:21.759: INFO: Pod "azurefile-volume-tester-njmqg": Phase="Running", Reason="", readiness=true. Elapsed: 12.213508749s Apr 17 07:28:23.788: INFO: Pod "azurefile-volume-tester-njmqg": Phase="Running", Reason="", readiness=true. Elapsed: 14.243223593s Apr 17 07:28:25.818: INFO: Pod "azurefile-volume-tester-njmqg": Phase="Running", Reason="", readiness=true. Elapsed: 16.272581491s Apr 17 07:28:27.849: INFO: Pod "azurefile-volume-tester-njmqg": Phase="Succeeded", Reason="", readiness=false. Elapsed: 18.303909132s [1mSTEP[0m: Saw pod success Apr 17 07:28:27.849: INFO: Pod "azurefile-volume-tester-njmqg" satisfied condition "Succeeded or Failed" Apr 17 07:28:27.849: INFO: deleting Pod "azurefile-1166"/"azurefile-volume-tester-njmqg" Apr 17 07:28:27.886: INFO: Pod azurefile-volume-tester-njmqg has the following logs: hello world [1mSTEP[0m: Deleting pod azurefile-volume-tester-njmqg in namespace azurefile-1166 Apr 17 07:28:27.921: INFO: deleting Secret smbcreds Apr 17 07:28:27.950: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready ... skipping 132 lines ... Apr 17 07:28:31.387: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-zn66r] to have phase Bound Apr 17 07:28:31.414: INFO: PersistentVolumeClaim pvc-zn66r found and phase=Bound (27.09285ms) [1mSTEP[0m: checking the PVC [1mSTEP[0m: validating provisioned PV [1mSTEP[0m: checking the PV [1mSTEP[0m: deploying the pod [1mSTEP[0m: checking that the pods command exits with an error Apr 17 07:28:31.501: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-jdm2g" in namespace "azurefile-5320" to be "Error status code" Apr 17 07:28:31.529: INFO: Pod "azurefile-volume-tester-jdm2g": Phase="Pending", Reason="", readiness=false. Elapsed: 27.934201ms Apr 17 07:28:33.560: INFO: Pod "azurefile-volume-tester-jdm2g": Phase="Pending", Reason="", readiness=false. Elapsed: 2.058751296s Apr 17 07:28:35.589: INFO: Pod "azurefile-volume-tester-jdm2g": Phase="Pending", Reason="", readiness=false. Elapsed: 4.088323671s Apr 17 07:28:37.619: INFO: Pod "azurefile-volume-tester-jdm2g": Phase="Pending", Reason="", readiness=false. Elapsed: 6.117537261s Apr 17 07:28:39.650: INFO: Pod "azurefile-volume-tester-jdm2g": Phase="Pending", Reason="", readiness=false. Elapsed: 8.149239007s Apr 17 07:28:41.681: INFO: Pod "azurefile-volume-tester-jdm2g": Phase="Pending", Reason="", readiness=false. Elapsed: 10.179856051s Apr 17 07:28:43.713: INFO: Pod "azurefile-volume-tester-jdm2g": Phase="Running", Reason="", readiness=true. Elapsed: 12.211861209s Apr 17 07:28:45.742: INFO: Pod "azurefile-volume-tester-jdm2g": Phase="Running", Reason="", readiness=true. Elapsed: 14.240556881s Apr 17 07:28:47.771: INFO: Pod "azurefile-volume-tester-jdm2g": Phase="Running", Reason="", readiness=true. Elapsed: 16.269470998s Apr 17 07:28:49.800: INFO: Pod "azurefile-volume-tester-jdm2g": Phase="Failed", Reason="", readiness=false. Elapsed: 18.299401805s [1mSTEP[0m: Saw pod failure Apr 17 07:28:49.800: INFO: Pod "azurefile-volume-tester-jdm2g" satisfied condition "Error status code" [1mSTEP[0m: checking that pod logs contain expected message Apr 17 07:28:49.842: INFO: deleting Pod "azurefile-5320"/"azurefile-volume-tester-jdm2g" Apr 17 07:28:49.874: INFO: Pod azurefile-volume-tester-jdm2g has the following logs: Out-File : Access to the path 'C:\mnt\test-1\data.txt' is denied. At line:1 char:22 + ... cho 'hello world' | Out-File -FilePath C:\mnt\test-1\data.txt; Get-Co ... + ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ... skipping 55 lines ... Apr 17 07:28:51.418: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-5nkq5] to have phase Bound Apr 17 07:28:51.446: INFO: PersistentVolumeClaim pvc-5nkq5 found and phase=Bound (27.614182ms) [1mSTEP[0m: checking the PVC [1mSTEP[0m: validating provisioned PV [1mSTEP[0m: checking the PV [1mSTEP[0m: deploying the pod [1mSTEP[0m: checking that the pods command exits with no error Apr 17 07:28:51.530: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-8xzk8" in namespace "azurefile-9103" to be "Succeeded or Failed" Apr 17 07:28:51.558: INFO: Pod "azurefile-volume-tester-8xzk8": Phase="Pending", Reason="", readiness=false. Elapsed: 27.944851ms Apr 17 07:28:53.587: INFO: Pod "azurefile-volume-tester-8xzk8": Phase="Pending", Reason="", readiness=false. Elapsed: 2.056762048s Apr 17 07:28:55.617: INFO: Pod "azurefile-volume-tester-8xzk8": Phase="Pending", Reason="", readiness=false. Elapsed: 4.086906187s Apr 17 07:28:57.647: INFO: Pod "azurefile-volume-tester-8xzk8": Phase="Pending", Reason="", readiness=false. Elapsed: 6.116506783s Apr 17 07:28:59.676: INFO: Pod "azurefile-volume-tester-8xzk8": Phase="Pending", Reason="", readiness=false. Elapsed: 8.145959678s Apr 17 07:29:01.706: INFO: Pod "azurefile-volume-tester-8xzk8": Phase="Running", Reason="", readiness=true. Elapsed: 10.176324572s Apr 17 07:29:03.736: INFO: Pod "azurefile-volume-tester-8xzk8": Phase="Running", Reason="", readiness=true. Elapsed: 12.205726788s Apr 17 07:29:05.765: INFO: Pod "azurefile-volume-tester-8xzk8": Phase="Running", Reason="", readiness=true. Elapsed: 14.234881858s Apr 17 07:29:07.795: INFO: Pod "azurefile-volume-tester-8xzk8": Phase="Succeeded", Reason="", readiness=false. Elapsed: 16.264694124s [1mSTEP[0m: Saw pod success Apr 17 07:29:07.795: INFO: Pod "azurefile-volume-tester-8xzk8" satisfied condition "Succeeded or Failed" [1mSTEP[0m: setting up the PV [1mSTEP[0m: creating a PV [1mSTEP[0m: setting up the PVC [1mSTEP[0m: creating a PVC [1mSTEP[0m: waiting for PVC to be in phase "Bound" Apr 17 07:29:07.852: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-rj6wm] to have phase Bound Apr 17 07:29:07.879: INFO: PersistentVolumeClaim pvc-rj6wm found and phase=Bound (27.3581ms) [1mSTEP[0m: checking the PVC [1mSTEP[0m: validating provisioned PV [1mSTEP[0m: checking the PV [1mSTEP[0m: deploying the pod [1mSTEP[0m: checking that the pods command exits with no error Apr 17 07:29:07.966: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-pbj7k" in namespace "azurefile-9103" to be "Succeeded or Failed" Apr 17 07:29:07.994: INFO: Pod "azurefile-volume-tester-pbj7k": Phase="Pending", Reason="", readiness=false. Elapsed: 27.573147ms Apr 17 07:29:10.023: INFO: Pod "azurefile-volume-tester-pbj7k": Phase="Pending", Reason="", readiness=false. Elapsed: 2.057005797s Apr 17 07:29:12.052: INFO: Pod "azurefile-volume-tester-pbj7k": Phase="Pending", Reason="", readiness=false. Elapsed: 4.086228998s Apr 17 07:29:14.081: INFO: Pod "azurefile-volume-tester-pbj7k": Phase="Pending", Reason="", readiness=false. Elapsed: 6.115236003s Apr 17 07:29:16.110: INFO: Pod "azurefile-volume-tester-pbj7k": Phase="Pending", Reason="", readiness=false. Elapsed: 8.144050281s Apr 17 07:29:18.139: INFO: Pod "azurefile-volume-tester-pbj7k": Phase="Running", Reason="", readiness=true. Elapsed: 10.173229527s Apr 17 07:29:20.169: INFO: Pod "azurefile-volume-tester-pbj7k": Phase="Running", Reason="", readiness=true. Elapsed: 12.203272335s Apr 17 07:29:22.199: INFO: Pod "azurefile-volume-tester-pbj7k": Phase="Running", Reason="", readiness=true. Elapsed: 14.232606121s Apr 17 07:29:24.228: INFO: Pod "azurefile-volume-tester-pbj7k": Phase="Succeeded", Reason="", readiness=false. Elapsed: 16.26219305s [1mSTEP[0m: Saw pod success Apr 17 07:29:24.228: INFO: Pod "azurefile-volume-tester-pbj7k" satisfied condition "Succeeded or Failed" [1mSTEP[0m: setting up the PV [1mSTEP[0m: creating a PV [1mSTEP[0m: setting up the PVC [1mSTEP[0m: creating a PVC [1mSTEP[0m: waiting for PVC to be in phase "Bound" Apr 17 07:29:24.289: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-dkdnf] to have phase Bound Apr 17 07:29:24.316: INFO: PersistentVolumeClaim pvc-dkdnf found and phase=Bound (27.29518ms) [1mSTEP[0m: checking the PVC [1mSTEP[0m: validating provisioned PV [1mSTEP[0m: checking the PV [1mSTEP[0m: deploying the pod [1mSTEP[0m: checking that the pods command exits with no error Apr 17 07:29:24.406: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-7khc4" in namespace "azurefile-9103" to be "Succeeded or Failed" Apr 17 07:29:24.434: INFO: Pod "azurefile-volume-tester-7khc4": Phase="Pending", Reason="", readiness=false. Elapsed: 27.774705ms Apr 17 07:29:26.462: INFO: Pod "azurefile-volume-tester-7khc4": Phase="Pending", Reason="", readiness=false. Elapsed: 2.055796962s Apr 17 07:29:28.492: INFO: Pod "azurefile-volume-tester-7khc4": Phase="Pending", Reason="", readiness=false. Elapsed: 4.086013219s Apr 17 07:29:30.521: INFO: Pod "azurefile-volume-tester-7khc4": Phase="Pending", Reason="", readiness=false. Elapsed: 6.11533788s Apr 17 07:29:32.552: INFO: Pod "azurefile-volume-tester-7khc4": Phase="Pending", Reason="", readiness=false. Elapsed: 8.146300183s Apr 17 07:29:34.582: INFO: Pod "azurefile-volume-tester-7khc4": Phase="Running", Reason="", readiness=true. Elapsed: 10.175531126s Apr 17 07:29:36.611: INFO: Pod "azurefile-volume-tester-7khc4": Phase="Running", Reason="", readiness=true. Elapsed: 12.205072897s Apr 17 07:29:38.641: INFO: Pod "azurefile-volume-tester-7khc4": Phase="Running", Reason="", readiness=true. Elapsed: 14.235034749s Apr 17 07:29:40.671: INFO: Pod "azurefile-volume-tester-7khc4": Phase="Succeeded", Reason="", readiness=false. Elapsed: 16.265122933s [1mSTEP[0m: Saw pod success Apr 17 07:29:40.671: INFO: Pod "azurefile-volume-tester-7khc4" satisfied condition "Succeeded or Failed" [1mSTEP[0m: setting up the PV [1mSTEP[0m: creating a PV [1mSTEP[0m: setting up the PVC [1mSTEP[0m: creating a PVC [1mSTEP[0m: waiting for PVC to be in phase "Bound" Apr 17 07:29:40.728: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-lbz5t] to have phase Bound Apr 17 07:29:40.756: INFO: PersistentVolumeClaim pvc-lbz5t found and phase=Bound (27.474432ms) [1mSTEP[0m: checking the PVC [1mSTEP[0m: validating provisioned PV [1mSTEP[0m: checking the PV [1mSTEP[0m: deploying the pod [1mSTEP[0m: checking that the pods command exits with no error Apr 17 07:29:40.841: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-8mstc" in namespace "azurefile-9103" to be "Succeeded or Failed" Apr 17 07:29:40.871: INFO: Pod "azurefile-volume-tester-8mstc": Phase="Pending", Reason="", readiness=false. Elapsed: 30.589494ms Apr 17 07:29:42.901: INFO: Pod "azurefile-volume-tester-8mstc": Phase="Pending", Reason="", readiness=false. Elapsed: 2.060477769s Apr 17 07:29:44.931: INFO: Pod "azurefile-volume-tester-8mstc": Phase="Pending", Reason="", readiness=false. Elapsed: 4.090538267s Apr 17 07:29:46.961: INFO: Pod "azurefile-volume-tester-8mstc": Phase="Pending", Reason="", readiness=false. Elapsed: 6.120879405s Apr 17 07:29:48.990: INFO: Pod "azurefile-volume-tester-8mstc": Phase="Pending", Reason="", readiness=false. Elapsed: 8.149686437s Apr 17 07:29:51.026: INFO: Pod "azurefile-volume-tester-8mstc": Phase="Running", Reason="", readiness=true. Elapsed: 10.185349173s Apr 17 07:29:53.055: INFO: Pod "azurefile-volume-tester-8mstc": Phase="Running", Reason="", readiness=true. Elapsed: 12.214798654s Apr 17 07:29:55.086: INFO: Pod "azurefile-volume-tester-8mstc": Phase="Running", Reason="", readiness=true. Elapsed: 14.245197175s Apr 17 07:29:57.116: INFO: Pod "azurefile-volume-tester-8mstc": Phase="Succeeded", Reason="", readiness=false. Elapsed: 16.275347092s [1mSTEP[0m: Saw pod success Apr 17 07:29:57.116: INFO: Pod "azurefile-volume-tester-8mstc" satisfied condition "Succeeded or Failed" [1mSTEP[0m: setting up the PV [1mSTEP[0m: creating a PV [1mSTEP[0m: setting up the PVC [1mSTEP[0m: creating a PVC [1mSTEP[0m: waiting for PVC to be in phase "Bound" Apr 17 07:29:57.179: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-c79fd] to have phase Bound Apr 17 07:29:57.214: INFO: PersistentVolumeClaim pvc-c79fd found and phase=Bound (35.054227ms) [1mSTEP[0m: checking the PVC [1mSTEP[0m: validating provisioned PV [1mSTEP[0m: checking the PV [1mSTEP[0m: deploying the pod [1mSTEP[0m: checking that the pods command exits with no error Apr 17 07:29:57.302: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-jlmbg" in namespace "azurefile-9103" to be "Succeeded or Failed" Apr 17 07:29:57.329: INFO: Pod "azurefile-volume-tester-jlmbg": Phase="Pending", Reason="", readiness=false. Elapsed: 27.515883ms Apr 17 07:29:59.358: INFO: Pod "azurefile-volume-tester-jlmbg": Phase="Pending", Reason="", readiness=false. Elapsed: 2.055940815s Apr 17 07:30:01.388: INFO: Pod "azurefile-volume-tester-jlmbg": Phase="Pending", Reason="", readiness=false. Elapsed: 4.086109472s Apr 17 07:30:03.417: INFO: Pod "azurefile-volume-tester-jlmbg": Phase="Pending", Reason="", readiness=false. Elapsed: 6.115666321s Apr 17 07:30:05.447: INFO: Pod "azurefile-volume-tester-jlmbg": Phase="Pending", Reason="", readiness=false. Elapsed: 8.145177166s Apr 17 07:30:07.478: INFO: Pod "azurefile-volume-tester-jlmbg": Phase="Running", Reason="", readiness=true. Elapsed: 10.175973293s Apr 17 07:30:09.507: INFO: Pod "azurefile-volume-tester-jlmbg": Phase="Running", Reason="", readiness=true. Elapsed: 12.205414073s Apr 17 07:30:11.536: INFO: Pod "azurefile-volume-tester-jlmbg": Phase="Running", Reason="", readiness=true. Elapsed: 14.234548876s Apr 17 07:30:13.565: INFO: Pod "azurefile-volume-tester-jlmbg": Phase="Succeeded", Reason="", readiness=false. Elapsed: 16.263168903s [1mSTEP[0m: Saw pod success Apr 17 07:30:13.565: INFO: Pod "azurefile-volume-tester-jlmbg" satisfied condition "Succeeded or Failed" [1mSTEP[0m: setting up the PV [1mSTEP[0m: creating a PV [1mSTEP[0m: setting up the PVC [1mSTEP[0m: creating a PVC [1mSTEP[0m: waiting for PVC to be in phase "Bound" Apr 17 07:30:13.623: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-4fkp6] to have phase Bound Apr 17 07:30:13.650: INFO: PersistentVolumeClaim pvc-4fkp6 found and phase=Bound (27.340814ms) [1mSTEP[0m: checking the PVC [1mSTEP[0m: validating provisioned PV [1mSTEP[0m: checking the PV [1mSTEP[0m: deploying the pod [1mSTEP[0m: checking that the pods command exits with no error Apr 17 07:30:13.735: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-8w2xj" in namespace "azurefile-9103" to be "Succeeded or Failed" Apr 17 07:30:13.762: INFO: Pod "azurefile-volume-tester-8w2xj": Phase="Pending", Reason="", readiness=false. Elapsed: 27.330108ms Apr 17 07:30:15.792: INFO: Pod "azurefile-volume-tester-8w2xj": Phase="Pending", Reason="", readiness=false. Elapsed: 2.056526171s Apr 17 07:30:17.822: INFO: Pod "azurefile-volume-tester-8w2xj": Phase="Pending", Reason="", readiness=false. Elapsed: 4.086648321s Apr 17 07:30:19.855: INFO: Pod "azurefile-volume-tester-8w2xj": Phase="Pending", Reason="", readiness=false. Elapsed: 6.120213966s Apr 17 07:30:21.885: INFO: Pod "azurefile-volume-tester-8w2xj": Phase="Pending", Reason="", readiness=false. Elapsed: 8.149824623s Apr 17 07:30:23.915: INFO: Pod "azurefile-volume-tester-8w2xj": Phase="Running", Reason="", readiness=true. Elapsed: 10.179713798s Apr 17 07:30:25.944: INFO: Pod "azurefile-volume-tester-8w2xj": Phase="Running", Reason="", readiness=true. Elapsed: 12.209194175s Apr 17 07:30:27.974: INFO: Pod "azurefile-volume-tester-8w2xj": Phase="Running", Reason="", readiness=true. Elapsed: 14.239012227s Apr 17 07:30:30.004: INFO: Pod "azurefile-volume-tester-8w2xj": Phase="Succeeded", Reason="", readiness=false. Elapsed: 16.269131415s [1mSTEP[0m: Saw pod success Apr 17 07:30:30.004: INFO: Pod "azurefile-volume-tester-8w2xj" satisfied condition "Succeeded or Failed" Apr 17 07:30:30.004: INFO: deleting Pod "azurefile-9103"/"azurefile-volume-tester-8w2xj" Apr 17 07:30:30.055: INFO: Pod azurefile-volume-tester-8w2xj has the following logs: hello world [1mSTEP[0m: Deleting pod azurefile-volume-tester-8w2xj in namespace azurefile-9103 Apr 17 07:30:30.091: INFO: deleting PVC "azurefile-9103"/"pvc-4fkp6" Apr 17 07:30:30.091: INFO: Deleting PersistentVolumeClaim "pvc-4fkp6" ... skipping 143 lines ... Apr 17 07:30:35.071: INFO: PersistentVolumeClaim pvc-tlbbw found but phase is Pending instead of Bound. Apr 17 07:30:37.100: INFO: PersistentVolumeClaim pvc-tlbbw found and phase=Bound (2.056460234s) [1mSTEP[0m: checking the PVC [1mSTEP[0m: validating provisioned PV [1mSTEP[0m: checking the PV [1mSTEP[0m: deploying the pod [1mSTEP[0m: checking that the pods command exits with no error Apr 17 07:30:37.186: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-8rbxv" in namespace "azurefile-8470" to be "Succeeded or Failed" Apr 17 07:30:37.213: INFO: Pod "azurefile-volume-tester-8rbxv": Phase="Pending", Reason="", readiness=false. Elapsed: 27.361293ms Apr 17 07:30:39.242: INFO: Pod "azurefile-volume-tester-8rbxv": Phase="Pending", Reason="", readiness=false. Elapsed: 2.056144705s Apr 17 07:30:41.272: INFO: Pod "azurefile-volume-tester-8rbxv": Phase="Pending", Reason="", readiness=false. Elapsed: 4.08596624s Apr 17 07:30:43.301: INFO: Pod "azurefile-volume-tester-8rbxv": Phase="Pending", Reason="", readiness=false. Elapsed: 6.115330246s Apr 17 07:30:45.332: INFO: Pod "azurefile-volume-tester-8rbxv": Phase="Pending", Reason="", readiness=false. Elapsed: 8.146001271s Apr 17 07:30:47.363: INFO: Pod "azurefile-volume-tester-8rbxv": Phase="Pending", Reason="", readiness=false. Elapsed: 10.177085224s Apr 17 07:30:49.392: INFO: Pod "azurefile-volume-tester-8rbxv": Phase="Running", Reason="", readiness=true. Elapsed: 12.206441117s Apr 17 07:30:51.422: INFO: Pod "azurefile-volume-tester-8rbxv": Phase="Running", Reason="", readiness=true. Elapsed: 14.236586183s Apr 17 07:30:53.453: INFO: Pod "azurefile-volume-tester-8rbxv": Phase="Running", Reason="", readiness=true. Elapsed: 16.267028458s Apr 17 07:30:55.483: INFO: Pod "azurefile-volume-tester-8rbxv": Phase="Succeeded", Reason="", readiness=false. Elapsed: 18.296692612s [1mSTEP[0m: Saw pod success Apr 17 07:30:55.483: INFO: Pod "azurefile-volume-tester-8rbxv" satisfied condition "Succeeded or Failed" Apr 17 07:30:55.483: INFO: deleting Pod "azurefile-8470"/"azurefile-volume-tester-8rbxv" Apr 17 07:30:55.520: INFO: Pod azurefile-volume-tester-8rbxv has the following logs: hello world [1mSTEP[0m: Deleting pod azurefile-volume-tester-8rbxv in namespace azurefile-8470 Apr 17 07:30:55.565: INFO: deleting PVC "azurefile-8470"/"pvc-tlbbw" Apr 17 07:30:55.565: INFO: Deleting PersistentVolumeClaim "pvc-tlbbw" ... skipping 33 lines ... Apr 17 07:30:57.009: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-gvqj9] to have phase Bound Apr 17 07:30:57.037: INFO: PersistentVolumeClaim pvc-gvqj9 found and phase=Bound (27.459954ms) [1mSTEP[0m: checking the PVC [1mSTEP[0m: validating provisioned PV [1mSTEP[0m: checking the PV [1mSTEP[0m: deploying the pod [1mSTEP[0m: checking that the pods command exits with no error Apr 17 07:30:57.122: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-wnmmt" in namespace "azurefile-7029" to be "Succeeded or Failed" Apr 17 07:30:57.150: INFO: Pod "azurefile-volume-tester-wnmmt": Phase="Pending", Reason="", readiness=false. Elapsed: 28.186645ms Apr 17 07:30:59.179: INFO: Pod "azurefile-volume-tester-wnmmt": Phase="Pending", Reason="", readiness=false. Elapsed: 2.057034578s Apr 17 07:31:01.208: INFO: Pod "azurefile-volume-tester-wnmmt": Phase="Pending", Reason="", readiness=false. Elapsed: 4.086355315s Apr 17 07:31:03.239: INFO: Pod "azurefile-volume-tester-wnmmt": Phase="Pending", Reason="", readiness=false. Elapsed: 6.117428463s Apr 17 07:31:05.270: INFO: Pod "azurefile-volume-tester-wnmmt": Phase="Pending", Reason="", readiness=false. Elapsed: 8.148171716s Apr 17 07:31:07.300: INFO: Pod "azurefile-volume-tester-wnmmt": Phase="Pending", Reason="", readiness=false. Elapsed: 10.178514868s Apr 17 07:31:09.329: INFO: Pod "azurefile-volume-tester-wnmmt": Phase="Running", Reason="", readiness=true. Elapsed: 12.207627743s Apr 17 07:31:11.359: INFO: Pod "azurefile-volume-tester-wnmmt": Phase="Running", Reason="", readiness=true. Elapsed: 14.237582664s Apr 17 07:31:13.389: INFO: Pod "azurefile-volume-tester-wnmmt": Phase="Running", Reason="", readiness=true. Elapsed: 16.267340307s Apr 17 07:31:15.419: INFO: Pod "azurefile-volume-tester-wnmmt": Phase="Succeeded", Reason="", readiness=false. Elapsed: 18.297439401s [1mSTEP[0m: Saw pod success Apr 17 07:31:15.419: INFO: Pod "azurefile-volume-tester-wnmmt" satisfied condition "Succeeded or Failed" Apr 17 07:31:15.419: INFO: deleting Pod "azurefile-7029"/"azurefile-volume-tester-wnmmt" Apr 17 07:31:15.459: INFO: Pod azurefile-volume-tester-wnmmt has the following logs: hello world [1mSTEP[0m: Deleting pod azurefile-volume-tester-wnmmt in namespace azurefile-7029 Apr 17 07:31:15.497: INFO: deleting PVC "azurefile-7029"/"pvc-gvqj9" Apr 17 07:31:15.497: INFO: Deleting PersistentVolumeClaim "pvc-gvqj9" ... skipping 86 lines ... Platform: linux/amd64 Streaming logs below: I0417 07:09:21.328918 1 azurefile.go:267] driver userAgent: file.csi.azure.com/e2e-a3f61a5e163bc4536ff4e8a3aac2b0f5e7027564 gc/go1.18.1 (amd64-linux) e2e-test I0417 07:09:21.329274 1 azure.go:71] reading cloud config from secret kube-system/azure-cloud-provider I0417 07:09:21.343652 1 round_trippers.go:553] GET https://10.96.0.1:443/api/v1/namespaces/kube-system/secrets/azure-cloud-provider 404 Not Found in 14 milliseconds W0417 07:09:21.343902 1 azure.go:78] InitializeCloudFromSecret: failed to get cloud config from secret kube-system/azure-cloud-provider: failed to get secret kube-system/azure-cloud-provider: secrets "azure-cloud-provider" not found I0417 07:09:21.343919 1 azure.go:83] could not read cloud config from secret kube-system/azure-cloud-provider I0417 07:09:21.343929 1 azure.go:93] use default AZURE_CREDENTIAL_FILE env var: /etc/kubernetes/azure.json I0417 07:09:21.343969 1 azure.go:101] read cloud config from file: /etc/kubernetes/azure.json successfully I0417 07:09:21.344442 1 azure_auth.go:245] Using AzurePublicCloud environment I0417 07:09:21.344490 1 azure_auth.go:130] azure: using client_id+client_secret to retrieve access token I0417 07:09:21.344554 1 azure_diskclient.go:67] Azure DisksClient using API version: 2021-04-01 ... skipping 2917 lines ... Platform: windows/amd64 Streaming logs below: I0417 07:10:07.671988 7108 azurefile.go:267] driver userAgent: file.csi.azure.com/e2e-a3f61a5e163bc4536ff4e8a3aac2b0f5e7027564 gc/go1.18.1 (amd64-windows) e2e-test I0417 07:10:07.694610 7108 azure.go:71] reading cloud config from secret kube-system/azure-cloud-provider I0417 07:10:07.699443 7108 round_trippers.go:553] GET https://10.96.0.1:443/api/v1/namespaces/kube-system/secrets/azure-cloud-provider in 2 milliseconds W0417 07:10:07.700274 7108 azure.go:78] InitializeCloudFromSecret: failed to get cloud config from secret kube-system/azure-cloud-provider: failed to get secret kube-system/azure-cloud-provider: Get "https://10.96.0.1:443/api/v1/namespaces/kube-system/secrets/azure-cloud-provider": dial tcp 10.96.0.1:443: connectex: An attempt was made to access a socket in a way forbidden by its access permissions. I0417 07:10:07.700994 7108 azure.go:83] could not read cloud config from secret kube-system/azure-cloud-provider I0417 07:10:07.700994 7108 azure.go:93] use default AZURE_CREDENTIAL_FILE env var: C:\k\azure.json I0417 07:10:07.700994 7108 azure.go:101] read cloud config from file: C:\k\azure.json successfully I0417 07:10:07.708701 7108 azure_auth.go:245] Using AzurePublicCloud environment I0417 07:10:07.709361 7108 azure_auth.go:130] azure: using client_id+client_secret to retrieve access token I0417 07:10:07.710478 7108 azure_diskclient.go:67] Azure DisksClient using API version: 2021-04-01 ... skipping 53 lines ... I0417 07:12:17.129290 7108 safe_mounter_windows.go:220] Exists path: \var\lib\kubelet\plugins\kubernetes.io\csi\pv\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3\globalmount I0417 07:12:17.131094 7108 azure_common_windows.go:73] Removing path: \var\lib\kubelet\plugins\kubernetes.io\csi\pv\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3\globalmount I0417 07:12:17.131094 7108 safe_mounter_windows.go:133] Remove directory: \var\lib\kubelet\plugins\kubernetes.io\csi\pv\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3\globalmount I0417 07:12:17.131770 7108 safe_mounter_windows.go:70] SMBMount: remote path: \\fedf9d94b13a54e409b27ba.privatelink.file.core.windows.net\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3 local path: \var\lib\kubelet\plugins\kubernetes.io\csi\pv\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3\globalmount I0417 07:12:17.131770 7108 safe_mounter_windows.go:220] Exists path: \var\lib\kubelet\plugins\kubernetes.io\csi\pv\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3 I0417 07:12:17.132569 7108 safe_mounter_windows.go:97] begin to mount \\fedf9d94b13a54e409b27ba.privatelink.file.core.windows.net\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3 on c:\var\lib\kubelet\plugins\kubernetes.io\csi\pv\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3\globalmount E0417 07:12:24.202654 7108 utils.go:81] GRPC error: rpc error: code = Internal desc = volume(capz-hw3kwu#fedf9d94b13a54e409b27ba#pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3#) mount "\\\\fedf9d94b13a54e409b27ba.privatelink.file.core.windows.net\\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3" on "\\var\\lib\\kubelet\\plugins\\kubernetes.io\\csi\\pv\\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3\\globalmount" failed with smb mapping failed with error: rpc error: code = Unknown desc = NewSmbGlobalMapping failed. output: "New-SmbGlobalMapping : Access is denied. \r\nAt line:1 char:190\r\n+ ... ser, $PWord;New-SmbGlobalMapping -RemotePath $Env:smbremotepath -Cred ...\r\n+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~\r\n + CategoryInfo : PermissionDenied: (MSFT_SmbGlobalMapping:ROOT/Microsoft/...mbGlobalMapping) [New-SmbGlob \r\n alMapping], CimException\r\n + FullyQualifiedErrorId : Windows System Error 5,New-SmbGlobalMapping\r\n \r\n", err: exit status 1 I0417 07:12:24.808094 7108 utils.go:76] GRPC call: /csi.v1.Node/NodeGetCapabilities I0417 07:12:24.808784 7108 utils.go:77] GRPC request: {} I0417 07:12:24.808904 7108 utils.go:83] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":2}}}]} I0417 07:12:24.815964 7108 utils.go:76] GRPC call: /csi.v1.Node/NodeGetCapabilities I0417 07:12:24.815964 7108 utils.go:77] GRPC request: {} I0417 07:12:24.815964 7108 utils.go:83] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":2}}}]} ... skipping 8 lines ... I0417 07:12:24.820779 7108 safe_mounter_windows.go:220] Exists path: \var\lib\kubelet\plugins\kubernetes.io\csi\pv\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3\globalmount I0417 07:12:24.821614 7108 azure_common_windows.go:73] Removing path: \var\lib\kubelet\plugins\kubernetes.io\csi\pv\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3\globalmount I0417 07:12:24.821614 7108 safe_mounter_windows.go:133] Remove directory: \var\lib\kubelet\plugins\kubernetes.io\csi\pv\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3\globalmount I0417 07:12:24.822133 7108 safe_mounter_windows.go:70] SMBMount: remote path: \\fedf9d94b13a54e409b27ba.privatelink.file.core.windows.net\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3 local path: \var\lib\kubelet\plugins\kubernetes.io\csi\pv\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3\globalmount I0417 07:12:24.822164 7108 safe_mounter_windows.go:220] Exists path: \var\lib\kubelet\plugins\kubernetes.io\csi\pv\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3 I0417 07:12:24.822164 7108 safe_mounter_windows.go:97] begin to mount \\fedf9d94b13a54e409b27ba.privatelink.file.core.windows.net\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3 on c:\var\lib\kubelet\plugins\kubernetes.io\csi\pv\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3\globalmount E0417 07:12:27.142834 7108 utils.go:81] GRPC error: rpc error: code = Internal desc = volume(capz-hw3kwu#fedf9d94b13a54e409b27ba#pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3#) mount "\\\\fedf9d94b13a54e409b27ba.privatelink.file.core.windows.net\\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3" on "\\var\\lib\\kubelet\\plugins\\kubernetes.io\\csi\\pv\\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3\\globalmount" failed with smb mapping failed with error: rpc error: code = Unknown desc = NewSmbGlobalMapping failed. output: "New-SmbGlobalMapping : Access is denied. \r\nAt line:1 char:190\r\n+ ... ser, $PWord;New-SmbGlobalMapping -RemotePath $Env:smbremotepath -Cred ...\r\n+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~\r\n + CategoryInfo : PermissionDenied: (MSFT_SmbGlobalMapping:ROOT/Microsoft/...mbGlobalMapping) [New-SmbGlob \r\n alMapping], CimException\r\n + FullyQualifiedErrorId : Windows System Error 5,New-SmbGlobalMapping\r\n \r\n", err: exit status 1 I0417 07:12:28.215372 7108 utils.go:76] GRPC call: /csi.v1.Node/NodeGetCapabilities I0417 07:12:28.215372 7108 utils.go:77] GRPC request: {} I0417 07:12:28.215372 7108 utils.go:83] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":2}}}]} I0417 07:12:28.218176 7108 utils.go:76] GRPC call: /csi.v1.Node/NodeGetCapabilities I0417 07:12:28.218176 7108 utils.go:77] GRPC request: {} I0417 07:12:28.218266 7108 utils.go:83] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":2}}}]} ... skipping 8 lines ... I0417 07:12:28.225599 7108 safe_mounter_windows.go:220] Exists path: \var\lib\kubelet\plugins\kubernetes.io\csi\pv\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3\globalmount I0417 07:12:28.225995 7108 azure_common_windows.go:73] Removing path: \var\lib\kubelet\plugins\kubernetes.io\csi\pv\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3\globalmount I0417 07:12:28.225995 7108 safe_mounter_windows.go:133] Remove directory: \var\lib\kubelet\plugins\kubernetes.io\csi\pv\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3\globalmount I0417 07:12:28.226581 7108 safe_mounter_windows.go:70] SMBMount: remote path: \\fedf9d94b13a54e409b27ba.privatelink.file.core.windows.net\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3 local path: \var\lib\kubelet\plugins\kubernetes.io\csi\pv\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3\globalmount I0417 07:12:28.226581 7108 safe_mounter_windows.go:220] Exists path: \var\lib\kubelet\plugins\kubernetes.io\csi\pv\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3 I0417 07:12:28.227414 7108 safe_mounter_windows.go:97] begin to mount \\fedf9d94b13a54e409b27ba.privatelink.file.core.windows.net\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3 on c:\var\lib\kubelet\plugins\kubernetes.io\csi\pv\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3\globalmount E0417 07:12:30.595328 7108 utils.go:81] GRPC error: rpc error: code = Internal desc = volume(capz-hw3kwu#fedf9d94b13a54e409b27ba#pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3#) mount "\\\\fedf9d94b13a54e409b27ba.privatelink.file.core.windows.net\\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3" on "\\var\\lib\\kubelet\\plugins\\kubernetes.io\\csi\\pv\\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3\\globalmount" failed with smb mapping failed with error: rpc error: code = Unknown desc = NewSmbGlobalMapping failed. output: "New-SmbGlobalMapping : Access is denied. \r\nAt line:1 char:190\r\n+ ... ser, $PWord;New-SmbGlobalMapping -RemotePath $Env:smbremotepath -Cred ...\r\n+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~\r\n + CategoryInfo : PermissionDenied: (MSFT_SmbGlobalMapping:ROOT/Microsoft/...mbGlobalMapping) [New-SmbGlob \r\n alMapping], CimException\r\n + FullyQualifiedErrorId : Windows System Error 5,New-SmbGlobalMapping\r\n \r\n", err: exit status 1 I0417 07:12:32.676275 7108 utils.go:76] GRPC call: /csi.v1.Node/NodeGetCapabilities I0417 07:12:32.676275 7108 utils.go:77] GRPC request: {} I0417 07:12:32.676275 7108 utils.go:83] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":2}}}]} I0417 07:12:32.679236 7108 utils.go:76] GRPC call: /csi.v1.Node/NodeGetCapabilities I0417 07:12:32.679236 7108 utils.go:77] GRPC request: {} I0417 07:12:32.679236 7108 utils.go:83] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":2}}}]} ... skipping 8 lines ... I0417 07:12:32.686022 7108 safe_mounter_windows.go:220] Exists path: \var\lib\kubelet\plugins\kubernetes.io\csi\pv\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3\globalmount I0417 07:12:32.686482 7108 azure_common_windows.go:73] Removing path: \var\lib\kubelet\plugins\kubernetes.io\csi\pv\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3\globalmount I0417 07:12:32.686482 7108 safe_mounter_windows.go:133] Remove directory: \var\lib\kubelet\plugins\kubernetes.io\csi\pv\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3\globalmount I0417 07:12:32.687342 7108 safe_mounter_windows.go:70] SMBMount: remote path: \\fedf9d94b13a54e409b27ba.privatelink.file.core.windows.net\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3 local path: \var\lib\kubelet\plugins\kubernetes.io\csi\pv\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3\globalmount I0417 07:12:32.687342 7108 safe_mounter_windows.go:220] Exists path: \var\lib\kubelet\plugins\kubernetes.io\csi\pv\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3 I0417 07:12:32.687342 7108 safe_mounter_windows.go:97] begin to mount \\fedf9d94b13a54e409b27ba.privatelink.file.core.windows.net\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3 on c:\var\lib\kubelet\plugins\kubernetes.io\csi\pv\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3\globalmount E0417 07:12:35.066020 7108 utils.go:81] GRPC error: rpc error: code = Internal desc = volume(capz-hw3kwu#fedf9d94b13a54e409b27ba#pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3#) mount "\\\\fedf9d94b13a54e409b27ba.privatelink.file.core.windows.net\\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3" on "\\var\\lib\\kubelet\\plugins\\kubernetes.io\\csi\\pv\\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3\\globalmount" failed with smb mapping failed with error: rpc error: code = Unknown desc = NewSmbGlobalMapping failed. output: "New-SmbGlobalMapping : Access is denied. \r\nAt line:1 char:190\r\n+ ... ser, $PWord;New-SmbGlobalMapping -RemotePath $Env:smbremotepath -Cred ...\r\n+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~\r\n + CategoryInfo : PermissionDenied: (MSFT_SmbGlobalMapping:ROOT/Microsoft/...mbGlobalMapping) [New-SmbGlob \r\n alMapping], CimException\r\n + FullyQualifiedErrorId : Windows System Error 5,New-SmbGlobalMapping\r\n \r\n", err: exit status 1 I0417 07:12:35.499607 7108 utils.go:76] GRPC call: /csi.v1.Identity/Probe I0417 07:12:35.499607 7108 utils.go:77] GRPC request: {} I0417 07:12:35.499607 7108 utils.go:83] GRPC response: {"ready":{"value":true}} I0417 07:12:39.094213 7108 utils.go:76] GRPC call: /csi.v1.Node/NodeGetCapabilities I0417 07:12:39.094247 7108 utils.go:77] GRPC request: {} I0417 07:12:39.094247 7108 utils.go:83] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":2}}}]} ... skipping 11 lines ... I0417 07:12:39.103822 7108 safe_mounter_windows.go:220] Exists path: \var\lib\kubelet\plugins\kubernetes.io\csi\pv\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3\globalmount I0417 07:12:39.104545 7108 azure_common_windows.go:73] Removing path: \var\lib\kubelet\plugins\kubernetes.io\csi\pv\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3\globalmount I0417 07:12:39.104545 7108 safe_mounter_windows.go:133] Remove directory: \var\lib\kubelet\plugins\kubernetes.io\csi\pv\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3\globalmount I0417 07:12:39.105511 7108 safe_mounter_windows.go:70] SMBMount: remote path: \\fedf9d94b13a54e409b27ba.privatelink.file.core.windows.net\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3 local path: \var\lib\kubelet\plugins\kubernetes.io\csi\pv\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3\globalmount I0417 07:12:39.105534 7108 safe_mounter_windows.go:220] Exists path: \var\lib\kubelet\plugins\kubernetes.io\csi\pv\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3 I0417 07:12:39.105738 7108 safe_mounter_windows.go:97] begin to mount \\fedf9d94b13a54e409b27ba.privatelink.file.core.windows.net\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3 on c:\var\lib\kubelet\plugins\kubernetes.io\csi\pv\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3\globalmount E0417 07:12:41.373980 7108 utils.go:81] GRPC error: rpc error: code = Internal desc = volume(capz-hw3kwu#fedf9d94b13a54e409b27ba#pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3#) mount "\\\\fedf9d94b13a54e409b27ba.privatelink.file.core.windows.net\\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3" on "\\var\\lib\\kubelet\\plugins\\kubernetes.io\\csi\\pv\\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3\\globalmount" failed with smb mapping failed with error: rpc error: code = Unknown desc = NewSmbGlobalMapping failed. output: "New-SmbGlobalMapping : Access is denied. \r\nAt line:1 char:190\r\n+ ... ser, $PWord;New-SmbGlobalMapping -RemotePath $Env:smbremotepath -Cred ...\r\n+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~\r\n + CategoryInfo : PermissionDenied: (MSFT_SmbGlobalMapping:ROOT/Microsoft/...mbGlobalMapping) [New-SmbGlob \r\n alMapping], CimException\r\n + FullyQualifiedErrorId : Windows System Error 5,New-SmbGlobalMapping\r\n \r\n", err: exit status 1 I0417 07:12:49.432159 7108 utils.go:76] GRPC call: /csi.v1.Node/NodeGetCapabilities I0417 07:12:49.432159 7108 utils.go:77] GRPC request: {} I0417 07:12:49.432159 7108 utils.go:83] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":2}}}]} I0417 07:12:49.434601 7108 utils.go:76] GRPC call: /csi.v1.Node/NodeGetCapabilities I0417 07:12:49.434601 7108 utils.go:77] GRPC request: {} I0417 07:12:49.434601 7108 utils.go:83] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":2}}}]} ... skipping 8 lines ... I0417 07:12:49.439591 7108 safe_mounter_windows.go:220] Exists path: \var\lib\kubelet\plugins\kubernetes.io\csi\pv\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3\globalmount I0417 07:12:49.440074 7108 azure_common_windows.go:73] Removing path: \var\lib\kubelet\plugins\kubernetes.io\csi\pv\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3\globalmount I0417 07:12:49.440101 7108 safe_mounter_windows.go:133] Remove directory: \var\lib\kubelet\plugins\kubernetes.io\csi\pv\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3\globalmount I0417 07:12:49.440354 7108 safe_mounter_windows.go:70] SMBMount: remote path: \\fedf9d94b13a54e409b27ba.privatelink.file.core.windows.net\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3 local path: \var\lib\kubelet\plugins\kubernetes.io\csi\pv\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3\globalmount I0417 07:12:49.440354 7108 safe_mounter_windows.go:220] Exists path: \var\lib\kubelet\plugins\kubernetes.io\csi\pv\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3 I0417 07:12:49.441037 7108 safe_mounter_windows.go:97] begin to mount \\fedf9d94b13a54e409b27ba.privatelink.file.core.windows.net\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3 on c:\var\lib\kubelet\plugins\kubernetes.io\csi\pv\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3\globalmount E0417 07:12:51.688757 7108 utils.go:81] GRPC error: rpc error: code = Internal desc = volume(capz-hw3kwu#fedf9d94b13a54e409b27ba#pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3#) mount "\\\\fedf9d94b13a54e409b27ba.privatelink.file.core.windows.net\\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3" on "\\var\\lib\\kubelet\\plugins\\kubernetes.io\\csi\\pv\\pvc-84516bc7-16ed-4a4a-9797-beaa8c3510b3\\globalmount" failed with smb mapping failed with error: rpc error: code = Unknown desc = NewSmbGlobalMapping failed. output: "New-SmbGlobalMapping : Access is denied. \r\nAt line:1 char:190\r\n+ ... ser, $PWord;New-SmbGlobalMapping -RemotePath $Env:smbremotepath -Cred ...\r\n+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~\r\n + CategoryInfo : PermissionDenied: (MSFT_SmbGlobalMapping:ROOT/Microsoft/...mbGlobalMapping) [New-SmbGlob \r\n alMapping], CimException\r\n + FullyQualifiedErrorId : Windows System Error 5,New-SmbGlobalMapping\r\n \r\n", err: exit status 1 I0417 07:13:05.495161 7108 utils.go:76] GRPC call: /csi.v1.Identity/Probe I0417 07:13:05.495161 7108 utils.go:77] GRPC request: {} I0417 07:13:05.496020 7108 utils.go:83] GRPC response: {"ready":{"value":true}} I0417 07:13:07.779562 7108 utils.go:76] GRPC call: /csi.v1.Node/NodeGetCapabilities I0417 07:13:07.779562 7108 utils.go:77] GRPC request: {} I0417 07:13:07.779562 7108 utils.go:83] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":2}}}]} ... skipping 1188 lines ... I0417 07:27:52.141523 7108 utils.go:76] GRPC call: /csi.v1.Node/NodeGetCapabilities I0417 07:27:52.141523 7108 utils.go:77] GRPC request: {} I0417 07:27:52.141523 7108 utils.go:83] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":2}}}]} I0417 07:27:52.142711 7108 utils.go:76] GRPC call: /csi.v1.Node/NodePublishVolume I0417 07:27:52.142711 7108 utils.go:77] GRPC request: {"target_path":"c:\\var\\lib\\kubelet\\pods\\3be97881-5212-4fe3-b85c-afeb526fc5a5\\volumes\\kubernetes.io~csi\\test-volume-1\\mount","volume_capability":{"AccessType":{"Mount":{}},"access_mode":{"mode":7}},"volume_context":{"csi.storage.k8s.io/ephemeral":"true","csi.storage.k8s.io/pod.name":"azurefile-volume-tester-vthsh","csi.storage.k8s.io/pod.namespace":"azurefile-4801","csi.storage.k8s.io/pod.uid":"3be97881-5212-4fe3-b85c-afeb526fc5a5","csi.storage.k8s.io/serviceAccount.name":"default","mountOptions":"cache=singleclient","secretName":"azure-storage-account-f76f2647d622d47d1bc2366-secret","server":"","shareName":"csi-inline-smb-volume"},"volume_id":"csi-1d0f8ae8da18c5a50a65db3710545ed3eee501241268c97a9a02ef2b26f8fe60"} I0417 07:27:52.142711 7108 nodeserver.go:68] NodePublishVolume: ephemeral volume(csi-1d0f8ae8da18c5a50a65db3710545ed3eee501241268c97a9a02ef2b26f8fe60) mount on c:\var\lib\kubelet\pods\3be97881-5212-4fe3-b85c-afeb526fc5a5\volumes\kubernetes.io~csi\test-volume-1\mount, VolumeContext: map[csi.storage.k8s.io/ephemeral:true csi.storage.k8s.io/pod.name:azurefile-volume-tester-vthsh csi.storage.k8s.io/pod.namespace:azurefile-4801 csi.storage.k8s.io/pod.uid:3be97881-5212-4fe3-b85c-afeb526fc5a5 csi.storage.k8s.io/serviceAccount.name:default getaccountkeyfromsecret:true mountOptions:cache=singleclient secretName:azure-storage-account-f76f2647d622d47d1bc2366-secret secretnamespace:azurefile-4801 server: shareName:csi-inline-smb-volume storageaccount:] W0417 07:27:52.143235 7108 azurefile.go:546] parsing volumeID(csi-1d0f8ae8da18c5a50a65db3710545ed3eee501241268c97a9a02ef2b26f8fe60) return with error: error parsing volume id: "csi-1d0f8ae8da18c5a50a65db3710545ed3eee501241268c97a9a02ef2b26f8fe60", should at least contain two # I0417 07:27:52.153755 7108 round_trippers.go:553] GET https://10.96.0.1:443/api/v1/namespaces/azurefile-4801/secrets/azure-storage-account-f76f2647d622d47d1bc2366-secret 200 OK in 10 milliseconds I0417 07:27:52.153755 7108 nodeserver.go:268] cifsMountPath(c:\var\lib\kubelet\pods\3be97881-5212-4fe3-b85c-afeb526fc5a5\volumes\kubernetes.io~csi\test-volume-1\mount) fstype() volumeID(csi-1d0f8ae8da18c5a50a65db3710545ed3eee501241268c97a9a02ef2b26f8fe60) context(map[csi.storage.k8s.io/ephemeral:true csi.storage.k8s.io/pod.name:azurefile-volume-tester-vthsh csi.storage.k8s.io/pod.namespace:azurefile-4801 csi.storage.k8s.io/pod.uid:3be97881-5212-4fe3-b85c-afeb526fc5a5 csi.storage.k8s.io/serviceAccount.name:default getaccountkeyfromsecret:true mountOptions:cache=singleclient secretName:azure-storage-account-f76f2647d622d47d1bc2366-secret secretnamespace:azurefile-4801 server: shareName:csi-inline-smb-volume storageaccount:]) mountflags([]) mountOptions([AZURE\f76f2647d622d47d1bc2366]) volumeMountGroup() I0417 07:27:52.154408 7108 safe_mounter_windows.go:163] IsLikelyNotMountPoint: c:\var\lib\kubelet\pods\3be97881-5212-4fe3-b85c-afeb526fc5a5\volumes\kubernetes.io~csi\test-volume-1\mount I0417 07:27:52.154408 7108 safe_mounter_windows.go:220] Exists path: c:\var\lib\kubelet\pods\3be97881-5212-4fe3-b85c-afeb526fc5a5\volumes\kubernetes.io~csi\test-volume-1\mount I0417 07:27:52.156614 7108 safe_mounter_windows.go:220] Exists path: c:\var\lib\kubelet\pods\3be97881-5212-4fe3-b85c-afeb526fc5a5\volumes\kubernetes.io~csi\test-volume-1\mount I0417 07:27:52.157157 7108 azure_common_windows.go:73] Removing path: c:\var\lib\kubelet\pods\3be97881-5212-4fe3-b85c-afeb526fc5a5\volumes\kubernetes.io~csi\test-volume-1\mount ... skipping 39 lines ... I0417 07:28:09.770227 7108 utils.go:76] GRPC call: /csi.v1.Node/NodeGetCapabilities I0417 07:28:09.770227 7108 utils.go:77] GRPC request: {} I0417 07:28:09.770227 7108 utils.go:83] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":2}}}]} I0417 07:28:09.771632 7108 utils.go:76] GRPC call: /csi.v1.Node/NodePublishVolume I0417 07:28:09.771632 7108 utils.go:77] GRPC request: {"target_path":"c:\\var\\lib\\kubelet\\pods\\f8a3d253-9f92-4d66-a16d-09e621153490\\volumes\\kubernetes.io~csi\\test-volume-1\\mount","volume_capability":{"AccessType":{"Mount":{}},"access_mode":{"mode":7}},"volume_context":{"csi.storage.k8s.io/ephemeral":"true","csi.storage.k8s.io/pod.name":"azurefile-volume-tester-njmqg","csi.storage.k8s.io/pod.namespace":"azurefile-1166","csi.storage.k8s.io/pod.uid":"f8a3d253-9f92-4d66-a16d-09e621153490","csi.storage.k8s.io/serviceAccount.name":"default","mountOptions":"cache=singleclient","secretName":"smbcreds","server":"52.226.200.247","shareName":"share"},"volume_id":"csi-a24be87ec8f721f8a1dbfe1d4dc43eac149737a922edc3fc382254b8ef90839c"} I0417 07:28:09.771632 7108 nodeserver.go:68] NodePublishVolume: ephemeral volume(csi-a24be87ec8f721f8a1dbfe1d4dc43eac149737a922edc3fc382254b8ef90839c) mount on c:\var\lib\kubelet\pods\f8a3d253-9f92-4d66-a16d-09e621153490\volumes\kubernetes.io~csi\test-volume-1\mount, VolumeContext: map[csi.storage.k8s.io/ephemeral:true csi.storage.k8s.io/pod.name:azurefile-volume-tester-njmqg csi.storage.k8s.io/pod.namespace:azurefile-1166 csi.storage.k8s.io/pod.uid:f8a3d253-9f92-4d66-a16d-09e621153490 csi.storage.k8s.io/serviceAccount.name:default getaccountkeyfromsecret:true mountOptions:cache=singleclient secretName:smbcreds secretnamespace:azurefile-1166 server:52.226.200.247 shareName:share storageaccount:] W0417 07:28:09.771632 7108 azurefile.go:546] parsing volumeID(csi-a24be87ec8f721f8a1dbfe1d4dc43eac149737a922edc3fc382254b8ef90839c) return with error: error parsing volume id: "csi-a24be87ec8f721f8a1dbfe1d4dc43eac149737a922edc3fc382254b8ef90839c", should at least contain two # I0417 07:28:09.775660 7108 round_trippers.go:553] GET https://10.96.0.1:443/api/v1/namespaces/azurefile-1166/secrets/smbcreds 200 OK in 4 milliseconds I0417 07:28:09.775660 7108 nodeserver.go:268] cifsMountPath(c:\var\lib\kubelet\pods\f8a3d253-9f92-4d66-a16d-09e621153490\volumes\kubernetes.io~csi\test-volume-1\mount) fstype() volumeID(csi-a24be87ec8f721f8a1dbfe1d4dc43eac149737a922edc3fc382254b8ef90839c) context(map[csi.storage.k8s.io/ephemeral:true csi.storage.k8s.io/pod.name:azurefile-volume-tester-njmqg csi.storage.k8s.io/pod.namespace:azurefile-1166 csi.storage.k8s.io/pod.uid:f8a3d253-9f92-4d66-a16d-09e621153490 csi.storage.k8s.io/serviceAccount.name:default getaccountkeyfromsecret:true mountOptions:cache=singleclient secretName:smbcreds secretnamespace:azurefile-1166 server:52.226.200.247 shareName:share storageaccount:]) mountflags([]) mountOptions([AZURE\USERNAME]) volumeMountGroup() I0417 07:28:09.775660 7108 safe_mounter_windows.go:163] IsLikelyNotMountPoint: c:\var\lib\kubelet\pods\f8a3d253-9f92-4d66-a16d-09e621153490\volumes\kubernetes.io~csi\test-volume-1\mount I0417 07:28:09.775660 7108 safe_mounter_windows.go:220] Exists path: c:\var\lib\kubelet\pods\f8a3d253-9f92-4d66-a16d-09e621153490\volumes\kubernetes.io~csi\test-volume-1\mount I0417 07:28:09.777060 7108 safe_mounter_windows.go:220] Exists path: c:\var\lib\kubelet\pods\f8a3d253-9f92-4d66-a16d-09e621153490\volumes\kubernetes.io~csi\test-volume-1\mount I0417 07:28:09.777846 7108 azure_common_windows.go:73] Removing path: c:\var\lib\kubelet\pods\f8a3d253-9f92-4d66-a16d-09e621153490\volumes\kubernetes.io~csi\test-volume-1\mount ... skipping 710 lines ... Platform: windows/amd64 Streaming logs below: I0417 07:10:09.346862 6728 azurefile.go:267] driver userAgent: file.csi.azure.com/e2e-a3f61a5e163bc4536ff4e8a3aac2b0f5e7027564 gc/go1.18.1 (amd64-windows) e2e-test I0417 07:10:09.361419 6728 azure.go:71] reading cloud config from secret kube-system/azure-cloud-provider I0417 07:10:09.386263 6728 round_trippers.go:553] GET https://10.96.0.1:443/api/v1/namespaces/kube-system/secrets/azure-cloud-provider 404 Not Found in 16 milliseconds W0417 07:10:09.387685 6728 azure.go:78] InitializeCloudFromSecret: failed to get cloud config from secret kube-system/azure-cloud-provider: failed to get secret kube-system/azure-cloud-provider: secrets "azure-cloud-provider" not found I0417 07:10:09.388237 6728 azure.go:83] could not read cloud config from secret kube-system/azure-cloud-provider I0417 07:10:09.388237 6728 azure.go:93] use default AZURE_CREDENTIAL_FILE env var: C:\k\azure.json I0417 07:10:09.388237 6728 azure.go:101] read cloud config from file: C:\k\azure.json successfully I0417 07:10:09.391220 6728 azure_auth.go:245] Using AzurePublicCloud environment I0417 07:10:09.392426 6728 azure_auth.go:130] azure: using client_id+client_secret to retrieve access token I0417 07:10:09.394415 6728 azure_diskclient.go:67] Azure DisksClient using API version: 2021-04-01 ... skipping 574 lines ... JUnit report was created: /logs/artifacts/junit_01.xml [91m[1mSummarizing 1 Failure:[0m [91m[1m[Fail] [0m[90mDynamic Provisioning [0m[91m[1m[It] should create a volume on demand with mount options [kubernetes.io/azure-file] [file.csi.azure.com] [Windows] [0m [37m/home/prow/go/src/sigs.k8s.io/azurefile-csi-driver/test/e2e/testsuites/testsuites.go:690[0m [1m[91mRan 20 of 34 Specs in 2130.582 seconds[0m [1m[91mFAIL![0m -- [32m[1m19 Passed[0m | [91m[1m1 Failed[0m | [33m[1m0 Pending[0m | [36m[1m14 Skipped[0m [38;5;228mYou're using deprecated Ginkgo functionality:[0m [38;5;228m=============================================[0m [1m[38;5;10mGinkgo 2.0[0m is under active development and will introduce several new features, improvements, and a small handful of breaking changes. A release candidate for 2.0 is now available and 2.0 should GA in Fall 2021. [1mPlease give the RC a try and send us feedback![0m - To learn more, view the migration guide at [38;5;14m[4mhttps://github.com/onsi/ginkgo/blob/ver2/docs/MIGRATING_TO_V2.md[0m ... skipping 5 lines ... [38;5;9m[1mIf this change will be impactful to you please leave a comment on [38;5;14m[4mhttps://github.com/onsi/ginkgo/issues/711[0m[0m [1mLearn more at:[0m [38;5;14m[4mhttps://github.com/onsi/ginkgo/blob/ver2/docs/MIGRATING_TO_V2.md#removed-custom-reporters[0m [38;5;243mTo silence deprecations that can be silenced set the following environment variable:[0m [38;5;243mACK_GINKGO_DEPRECATIONS=1.16.5[0m --- FAIL: TestE2E (2130.59s) FAIL FAIL sigs.k8s.io/azurefile-csi-driver/test/e2e 2130.648s FAIL make: *** [Makefile:85: e2e-test] Error 1 make: Nothing to be done for 'kubectl'. ================ DUMPING LOGS FOR MANAGEMENT CLUSTER ================ Exported logs for cluster "capz" to: /logs/artifacts/management-cluster ================ DUMPING LOGS FOR WORKLOAD CLUSTER (Linux) ========== Deploying log-dump-daemonset ... skipping 98 lines ...