Recent runs || View in Spyglass
PR | andyzhangx: test: support Win2022 test on capz |
Result | FAILURE |
Tests | 1 failed / 19 succeeded |
Started | |
Elapsed | 49m27s |
Revision | 1ecf7e2b24335790fae9e49b3535eab947e6ad78 |
Refs |
988 |
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=AzureFile\sCSI\sDriver\sEnd\-to\-End\sTests\sDynamic\sProvisioning\sshould\screate\sa\svolume\son\sdemand\swith\smount\soptions\s\[kubernetes\.io\/azure\-file\]\s\[file\.csi\.azure\.com\]\s\[Windows\]$'
/home/prow/go/src/sigs.k8s.io/azurefile-csi-driver/test/e2e/dynamic_provisioning_test.go:104 Unexpected error: <*errors.errorString | 0xc000518c30>: { s: "pod \"azurefile-volume-tester-gbrmv\" failed with status: {Phase:Failed Conditions:[{Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-21 04:09:57 +0000 UTC Reason: Message:} {Type:Ready Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-21 04:09:57 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [volume-tester]} {Type:ContainersReady Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-21 04:09:57 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [volume-tester]} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-21 04:09:57 +0000 UTC Reason: Message:}] Message: Reason: NominatedNodeName: HostIP:10.1.0.4 PodIP:192.168.221.196 PodIPs:[{IP:192.168.221.196}] StartTime:2022-04-21 04:09:57 +0000 UTC InitContainerStatuses:[] ContainerStatuses:[{Name:volume-tester State:{Waiting:&ContainerStateWaiting{Reason:RunContainerError,Message:context deadline exceeded,} Running:nil Terminated:nil} LastTerminationState:{Waiting:nil Running:nil Terminated:&ContainerStateTerminated{ExitCode:0,Signal:0,Reason:,Message:,StartedAt:0001-01-01 00:00:00 +0000 UTC,FinishedAt:0001-01-01 00:00:00 +0000 UTC,ContainerID:containerd://f34405ec9383d0af41d58d7872f41f77552f5abf44015d252db39d21336e3014,}} Ready:false RestartCount:0 Image:mcr.microsoft.com/windows/servercore:ltsc2022 ImageID:mcr.microsoft.com/windows/servercore@sha256:378d85bd8e7388a777d25009f8523d1e95a5f544f131eaada83171045d5b2c1e ContainerID:containerd://f34405ec9383d0af41d58d7872f41f77552f5abf44015d252db39d21336e3014 Started:0xc00094f2a8}] QOSClass:BestEffort EphemeralContainerStatuses:[]}", } pod "azurefile-volume-tester-gbrmv" failed with status: {Phase:Failed Conditions:[{Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-21 04:09:57 +0000 UTC Reason: Message:} {Type:Ready Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-21 04:09:57 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [volume-tester]} {Type:ContainersReady Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-21 04:09:57 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [volume-tester]} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-21 04:09:57 +0000 UTC Reason: Message:}] Message: Reason: NominatedNodeName: HostIP:10.1.0.4 PodIP:192.168.221.196 PodIPs:[{IP:192.168.221.196}] StartTime:2022-04-21 04:09:57 +0000 UTC InitContainerStatuses:[] ContainerStatuses:[{Name:volume-tester State:{Waiting:&ContainerStateWaiting{Reason:RunContainerError,Message:context deadline exceeded,} Running:nil Terminated:nil} LastTerminationState:{Waiting:nil Running:nil Terminated:&ContainerStateTerminated{ExitCode:0,Signal:0,Reason:,Message:,StartedAt:0001-01-01 00:00:00 +0000 UTC,FinishedAt:0001-01-01 00:00:00 +0000 UTC,ContainerID:containerd://f34405ec9383d0af41d58d7872f41f77552f5abf44015d252db39d21336e3014,}} Ready:false RestartCount:0 Image:mcr.microsoft.com/windows/servercore:ltsc2022 ImageID:mcr.microsoft.com/windows/servercore@sha256:378d85bd8e7388a777d25009f8523d1e95a5f544f131eaada83171045d5b2c1e ContainerID:containerd://f34405ec9383d0af41d58d7872f41f77552f5abf44015d252db39d21336e3014 Started:0xc00094f2a8}] QOSClass:BestEffort EphemeralContainerStatuses:[]} occurred /home/prow/go/src/sigs.k8s.io/azurefile-csi-driver/test/e2e/testsuites/testsuites.go:691from junit_01.xml
�[1mSTEP�[0m: Creating a kubernetes client Apr 21 04:08:18.913: INFO: >>> kubeConfig: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig �[1mSTEP�[0m: Building a namespace api object, basename azurefile �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace Apr 21 04:08:19.424: INFO: >>> kubeConfig: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig �[1mSTEP�[0m: setting up the StorageClass �[1mSTEP�[0m: creating a StorageClass �[1mSTEP�[0m: setting up the PVC and PV �[1mSTEP�[0m: creating a PVC �[1mSTEP�[0m: waiting for PVC to be in phase "Bound" Apr 21 04:08:19.497: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-cjj7x] to have phase Bound Apr 21 04:08:19.529: INFO: PersistentVolumeClaim pvc-cjj7x found but phase is Pending instead of Bound. Apr 21 04:08:21.561: INFO: PersistentVolumeClaim pvc-cjj7x found but phase is Pending instead of Bound. Apr 21 04:08:23.594: INFO: PersistentVolumeClaim pvc-cjj7x found but phase is Pending instead of Bound. Apr 21 04:08:25.628: INFO: PersistentVolumeClaim pvc-cjj7x found but phase is Pending instead of Bound. Apr 21 04:08:27.662: INFO: PersistentVolumeClaim pvc-cjj7x found but phase is Pending instead of Bound. Apr 21 04:08:29.695: INFO: PersistentVolumeClaim pvc-cjj7x found but phase is Pending instead of Bound. Apr 21 04:08:31.728: INFO: PersistentVolumeClaim pvc-cjj7x found but phase is Pending instead of Bound. Apr 21 04:08:33.762: INFO: PersistentVolumeClaim pvc-cjj7x found but phase is Pending instead of Bound. Apr 21 04:08:35.795: INFO: PersistentVolumeClaim pvc-cjj7x found but phase is Pending instead of Bound. Apr 21 04:08:37.828: INFO: PersistentVolumeClaim pvc-cjj7x found but phase is Pending instead of Bound. Apr 21 04:08:39.861: INFO: PersistentVolumeClaim pvc-cjj7x found but phase is Pending instead of Bound. Apr 21 04:08:41.894: INFO: PersistentVolumeClaim pvc-cjj7x found but phase is Pending instead of Bound. Apr 21 04:08:43.927: INFO: PersistentVolumeClaim pvc-cjj7x found but phase is Pending instead of Bound. Apr 21 04:08:45.960: INFO: PersistentVolumeClaim pvc-cjj7x found but phase is Pending instead of Bound. Apr 21 04:08:47.994: INFO: PersistentVolumeClaim pvc-cjj7x found but phase is Pending instead of Bound. Apr 21 04:08:50.026: INFO: PersistentVolumeClaim pvc-cjj7x found but phase is Pending instead of Bound. Apr 21 04:08:52.061: INFO: PersistentVolumeClaim pvc-cjj7x found but phase is Pending instead of Bound. Apr 21 04:08:54.098: INFO: PersistentVolumeClaim pvc-cjj7x found but phase is Pending instead of Bound. Apr 21 04:08:56.132: INFO: PersistentVolumeClaim pvc-cjj7x found but phase is Pending instead of Bound. Apr 21 04:08:58.165: INFO: PersistentVolumeClaim pvc-cjj7x found but phase is Pending instead of Bound. Apr 21 04:09:00.197: INFO: PersistentVolumeClaim pvc-cjj7x found but phase is Pending instead of Bound. Apr 21 04:09:02.231: INFO: PersistentVolumeClaim pvc-cjj7x found but phase is Pending instead of Bound. Apr 21 04:09:04.263: INFO: PersistentVolumeClaim pvc-cjj7x found but phase is Pending instead of Bound. Apr 21 04:09:06.298: INFO: PersistentVolumeClaim pvc-cjj7x found but phase is Pending instead of Bound. Apr 21 04:09:08.331: INFO: PersistentVolumeClaim pvc-cjj7x found but phase is Pending instead of Bound. Apr 21 04:09:10.366: INFO: PersistentVolumeClaim pvc-cjj7x found but phase is Pending instead of Bound. Apr 21 04:09:12.400: INFO: PersistentVolumeClaim pvc-cjj7x found but phase is Pending instead of Bound. Apr 21 04:09:14.440: INFO: PersistentVolumeClaim pvc-cjj7x found but phase is Pending instead of Bound. Apr 21 04:09:16.474: INFO: PersistentVolumeClaim pvc-cjj7x found but phase is Pending instead of Bound. Apr 21 04:09:18.507: INFO: PersistentVolumeClaim pvc-cjj7x found but phase is Pending instead of Bound. Apr 21 04:09:20.542: INFO: PersistentVolumeClaim pvc-cjj7x found but phase is Pending instead of Bound. Apr 21 04:09:22.576: INFO: PersistentVolumeClaim pvc-cjj7x found but phase is Pending instead of Bound. Apr 21 04:09:24.609: INFO: PersistentVolumeClaim pvc-cjj7x found but phase is Pending instead of Bound. Apr 21 04:09:26.642: INFO: PersistentVolumeClaim pvc-cjj7x found but phase is Pending instead of Bound. Apr 21 04:09:28.675: INFO: PersistentVolumeClaim pvc-cjj7x found but phase is Pending instead of Bound. Apr 21 04:09:30.708: INFO: PersistentVolumeClaim pvc-cjj7x found but phase is Pending instead of Bound. Apr 21 04:09:32.740: INFO: PersistentVolumeClaim pvc-cjj7x found but phase is Pending instead of Bound. Apr 21 04:09:34.773: INFO: PersistentVolumeClaim pvc-cjj7x found but phase is Pending instead of Bound. Apr 21 04:09:36.806: INFO: PersistentVolumeClaim pvc-cjj7x found but phase is Pending instead of Bound. Apr 21 04:09:38.839: INFO: PersistentVolumeClaim pvc-cjj7x found but phase is Pending instead of Bound. Apr 21 04:09:40.872: INFO: PersistentVolumeClaim pvc-cjj7x found but phase is Pending instead of Bound. Apr 21 04:09:42.905: INFO: PersistentVolumeClaim pvc-cjj7x found but phase is Pending instead of Bound. Apr 21 04:09:44.938: INFO: PersistentVolumeClaim pvc-cjj7x found but phase is Pending instead of Bound. Apr 21 04:09:46.971: INFO: PersistentVolumeClaim pvc-cjj7x found but phase is Pending instead of Bound. Apr 21 04:09:49.005: INFO: PersistentVolumeClaim pvc-cjj7x found but phase is Pending instead of Bound. Apr 21 04:09:51.039: INFO: PersistentVolumeClaim pvc-cjj7x found but phase is Pending instead of Bound. Apr 21 04:09:53.073: INFO: PersistentVolumeClaim pvc-cjj7x found but phase is Pending instead of Bound. Apr 21 04:09:55.106: INFO: PersistentVolumeClaim pvc-cjj7x found but phase is Pending instead of Bound. Apr 21 04:09:57.138: INFO: PersistentVolumeClaim pvc-cjj7x found and phase=Bound (1m37.64121106s) �[1mSTEP�[0m: checking the PVC �[1mSTEP�[0m: validating provisioned PV �[1mSTEP�[0m: checking the PV �[1mSTEP�[0m: deploying the pod �[1mSTEP�[0m: checking that the pods command exits with no error Apr 21 04:09:57.236: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-gbrmv" in namespace "azurefile-2540" to be "Succeeded or Failed" Apr 21 04:09:57.268: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 31.633182ms Apr 21 04:09:59.303: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 2.066737733s Apr 21 04:10:01.337: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 4.100714209s Apr 21 04:10:03.370: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 6.133579044s Apr 21 04:10:05.403: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 8.166930793s Apr 21 04:10:07.436: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 10.199943322s Apr 21 04:10:09.470: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 12.234188537s Apr 21 04:10:11.503: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 14.2669072s Apr 21 04:10:13.536: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 16.299332575s Apr 21 04:10:15.568: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 18.331752132s Apr 21 04:10:17.601: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 20.364749847s Apr 21 04:10:19.635: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 22.398606453s Apr 21 04:10:21.668: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 24.431401772s Apr 21 04:10:23.702: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 26.465355686s Apr 21 04:10:25.735: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 28.4989382s Apr 21 04:10:27.771: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 30.535248122s Apr 21 04:10:29.805: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 32.568789977s Apr 21 04:10:31.838: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 34.601994901s Apr 21 04:10:33.873: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 36.636675275s Apr 21 04:10:35.906: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 38.669444169s Apr 21 04:10:37.940: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 40.703771494s Apr 21 04:10:39.975: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 42.738491416s Apr 21 04:10:42.009: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 44.772463876s Apr 21 04:10:44.042: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 46.805332895s Apr 21 04:10:46.075: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 48.839089733s Apr 21 04:10:48.108: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 50.871697019s Apr 21 04:10:50.142: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 52.905712133s Apr 21 04:10:52.175: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 54.938622851s Apr 21 04:10:54.210: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 56.97338003s Apr 21 04:10:56.243: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 59.006765047s Apr 21 04:10:58.277: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m1.041192819s Apr 21 04:11:00.311: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m3.075103614s Apr 21 04:11:02.347: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m5.110932947s Apr 21 04:11:04.382: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m7.14580216s Apr 21 04:11:06.416: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m9.179630059s Apr 21 04:11:08.449: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m11.213245381s Apr 21 04:11:10.483: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m13.247255957s Apr 21 04:11:12.518: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m15.281958536s Apr 21 04:11:14.553: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m17.316469062s Apr 21 04:11:16.587: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m19.351114025s Apr 21 04:11:18.622: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m21.38553189s Apr 21 04:11:20.656: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m23.419845702s Apr 21 04:11:22.690: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m25.454205987s Apr 21 04:11:24.725: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m27.488761094s Apr 21 04:11:26.762: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m29.525653826s Apr 21 04:11:28.797: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m31.560395142s Apr 21 04:11:30.832: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m33.595542748s Apr 21 04:11:32.867: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m35.630378174s Apr 21 04:11:34.901: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m37.665216425s Apr 21 04:11:36.936: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m39.70029045s Apr 21 04:11:38.970: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m41.733823634s Apr 21 04:11:41.005: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m43.768725542s Apr 21 04:11:43.040: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m45.803620283s Apr 21 04:11:45.075: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m47.838824398s Apr 21 04:11:47.110: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m49.873380389s Apr 21 04:11:49.143: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m51.907287774s Apr 21 04:11:51.177: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m53.940796969s Apr 21 04:11:53.211: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m55.975104582s Apr 21 04:11:55.245: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.008883484s Apr 21 04:11:57.279: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.043142209s Apr 21 04:11:59.313: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.077153817s Apr 21 04:12:01.348: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.112003695s Apr 21 04:12:03.386: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.149650553s Apr 21 04:12:05.422: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.185628524s Apr 21 04:12:07.456: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.219348908s Apr 21 04:12:09.491: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.254903477s Apr 21 04:12:11.526: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.290096599s Apr 21 04:12:13.560: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.324091541s Apr 21 04:12:15.595: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.35892742s Apr 21 04:12:17.631: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.394710368s Apr 21 04:12:19.665: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.429044281s Apr 21 04:12:21.700: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.463725682s Apr 21 04:12:23.734: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.497944636s Apr 21 04:12:25.772: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.535816123s Apr 21 04:12:27.806: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.569814123s Apr 21 04:12:29.839: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.603210327s Apr 21 04:12:31.879: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.642329176s Apr 21 04:12:33.914: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.677441095s Apr 21 04:12:35.951: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.715142781s Apr 21 04:12:37.986: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.750133311s Apr 21 04:12:40.022: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.78551726s Apr 21 04:12:42.055: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.819217248s Apr 21 04:12:44.091: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.854786811s Apr 21 04:12:46.135: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.898804195s Apr 21 04:12:48.169: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.932911974s Apr 21 04:12:50.204: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.967342424s Apr 21 04:12:52.237: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m55.000711644s Apr 21 04:12:54.272: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m57.036042863s Apr 21 04:12:56.307: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m59.070656961s Apr 21 04:12:58.341: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m1.105153014s Apr 21 04:13:00.376: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m3.13954818s Apr 21 04:13:02.410: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m5.174060932s Apr 21 04:13:04.444: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m7.208083338s Apr 21 04:13:06.479: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m9.242726992s Apr 21 04:13:08.513: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m11.276559829s Apr 21 04:13:10.547: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m13.310724181s Apr 21 04:13:12.582: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m15.345696861s Apr 21 04:13:14.616: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m17.380248509s Apr 21 04:13:16.650: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m19.41413855s Apr 21 04:13:18.685: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m21.449172365s Apr 21 04:13:20.720: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m23.484088208s Apr 21 04:13:22.755: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m25.519307738s Apr 21 04:13:24.791: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m27.554489637s Apr 21 04:13:26.825: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m29.58849306s Apr 21 04:13:28.859: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m31.622565733s Apr 21 04:13:30.893: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m33.656896189s Apr 21 04:13:32.929: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m35.692694653s Apr 21 04:13:34.963: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m37.72634017s Apr 21 04:13:36.997: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m39.761131118s Apr 21 04:13:39.032: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m41.79570827s Apr 21 04:13:41.068: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m43.831701242s Apr 21 04:13:43.104: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m45.867935695s Apr 21 04:13:45.142: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m47.905660683s Apr 21 04:13:47.177: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m49.940417512s Apr 21 04:13:49.211: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m51.974451732s Apr 21 04:13:51.245: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.008609921s Apr 21 04:13:53.279: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.042347803s Apr 21 04:13:55.313: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.077142271s Apr 21 04:13:57.348: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.112042926s Apr 21 04:13:59.383: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.146352132s Apr 21 04:14:01.416: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.179770102s Apr 21 04:14:03.452: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.215366457s Apr 21 04:14:05.485: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.249075398s Apr 21 04:14:07.520: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.283698634s Apr 21 04:14:09.554: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.317908463s Apr 21 04:14:11.589: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.352795307s Apr 21 04:14:13.624: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.387694912s Apr 21 04:14:15.658: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.422260021s Apr 21 04:14:17.693: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.4570262s Apr 21 04:14:19.728: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.491998509s Apr 21 04:14:21.762: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.525819893s Apr 21 04:14:23.797: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.561038383s Apr 21 04:14:25.831: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.594825353s Apr 21 04:14:27.866: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.629503309s Apr 21 04:14:29.901: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.664574436s Apr 21 04:14:31.935: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.698624662s Apr 21 04:14:33.969: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.733259731s Apr 21 04:14:36.003: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.767053177s Apr 21 04:14:38.038: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.801493651s Apr 21 04:14:40.072: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.836150068s Apr 21 04:14:42.108: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.871436804s Apr 21 04:14:44.141: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.905307922s Apr 21 04:14:46.177: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.940521353s Apr 21 04:14:48.212: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.976311551s Apr 21 04:14:50.250: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m53.013675005s Apr 21 04:14:52.291: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m55.054464903s Apr 21 04:14:54.326: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m57.089331113s Apr 21 04:14:56.361: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m59.125123714s Apr 21 04:14:58.396: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 5m1.160035935s Apr 21 04:15:00.431: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 5m3.195223328s Apr 21 04:15:02.467: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 5m5.230498005s Apr 21 04:15:04.502: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 5m7.265848728s Apr 21 04:15:06.537: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 5m9.30112962s Apr 21 04:15:08.572: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 5m11.33573406s Apr 21 04:15:10.606: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 5m13.370041045s Apr 21 04:15:12.644: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 5m15.408113049s Apr 21 04:15:14.678: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 5m17.442269287s Apr 21 04:15:16.714: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 5m19.477501656s Apr 21 04:15:18.747: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 5m21.510889294s Apr 21 04:15:20.782: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 5m23.545330989s Apr 21 04:15:22.818: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 5m25.581373185s Apr 21 04:15:24.852: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 5m27.61561512s Apr 21 04:15:26.886: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 5m29.649528641s Apr 21 04:15:28.920: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 5m31.683878188s Apr 21 04:15:30.955: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 5m33.718773381s Apr 21 04:15:32.993: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 5m35.757231745s Apr 21 04:15:35.029: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 5m37.792439802s Apr 21 04:15:37.063: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 5m39.827040849s Apr 21 04:15:39.098: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 5m41.861983866s Apr 21 04:15:41.135: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 5m43.898910729s Apr 21 04:15:43.170: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 5m45.933690104s Apr 21 04:15:45.204: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 5m47.967614878s Apr 21 04:15:47.239: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 5m50.002422902s Apr 21 04:15:49.272: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 5m52.036040633s Apr 21 04:15:51.306: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 5m54.07030274s Apr 21 04:15:53.341: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 5m56.104323993s Apr 21 04:15:55.375: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 5m58.138392441s Apr 21 04:15:57.409: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 6m0.173071842s Apr 21 04:15:59.443: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 6m2.206819154s Apr 21 04:16:01.481: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 6m4.245276316s Apr 21 04:16:03.516: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 6m6.280252168s Apr 21 04:16:05.551: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 6m8.314575584s Apr 21 04:16:07.585: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 6m10.349269848s Apr 21 04:16:09.620: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 6m12.383572779s Apr 21 04:16:11.654: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 6m14.417425821s Apr 21 04:16:13.688: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 6m16.451568478s Apr 21 04:16:15.723: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 6m18.486415453s Apr 21 04:16:17.756: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 6m20.520217757s Apr 21 04:16:19.791: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 6m22.555162033s Apr 21 04:16:21.826: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 6m24.589548942s Apr 21 04:16:23.861: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 6m26.624828778s Apr 21 04:16:25.896: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 6m28.659525396s Apr 21 04:16:27.932: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 6m30.695566758s Apr 21 04:16:29.966: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 6m32.730275669s Apr 21 04:16:32.000: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 6m34.763862741s Apr 21 04:16:34.034: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 6m36.797978995s Apr 21 04:16:36.068: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 6m38.832206821s Apr 21 04:16:38.104: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 6m40.867412834s Apr 21 04:16:40.138: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 6m42.902256947s Apr 21 04:16:42.173: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 6m44.937299361s Apr 21 04:16:44.208: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 6m46.971942807s Apr 21 04:16:46.243: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 6m49.006656883s Apr 21 04:16:48.277: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 6m51.040834653s Apr 21 04:16:50.312: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 6m53.076069525s Apr 21 04:16:52.348: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 6m55.111985551s Apr 21 04:16:54.383: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 6m57.14727127s Apr 21 04:16:56.418: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 6m59.181866177s Apr 21 04:16:58.453: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 7m1.216849967s Apr 21 04:17:00.487: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 7m3.250573443s Apr 21 04:17:02.524: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 7m5.287592633s Apr 21 04:17:04.559: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 7m7.322858533s Apr 21 04:17:06.594: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 7m9.358146599s Apr 21 04:17:08.629: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 7m11.393070558s Apr 21 04:17:10.664: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 7m13.427390736s Apr 21 04:17:12.697: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 7m15.461175314s Apr 21 04:17:14.731: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 7m17.494816369s Apr 21 04:17:16.765: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 7m19.528508723s Apr 21 04:17:18.799: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 7m21.563139078s Apr 21 04:17:20.834: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 7m23.597410869s Apr 21 04:17:22.868: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 7m25.631733421s Apr 21 04:17:24.903: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 7m27.666793199s Apr 21 04:17:26.939: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 7m29.702695268s Apr 21 04:17:28.973: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 7m31.737301501s Apr 21 04:17:31.009: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 7m33.77297437s Apr 21 04:17:33.045: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 7m35.808700306s Apr 21 04:17:35.079: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 7m37.842976346s Apr 21 04:17:37.114: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 7m39.877499359s Apr 21 04:17:39.149: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 7m41.912836463s Apr 21 04:17:41.183: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 7m43.947043984s Apr 21 04:17:43.218: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 7m45.981661669s Apr 21 04:17:45.253: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 7m48.017254348s Apr 21 04:17:47.290: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 7m50.053513901s Apr 21 04:17:49.325: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 7m52.089133054s Apr 21 04:17:51.361: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 7m54.124627059s Apr 21 04:17:53.394: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 7m56.158007625s Apr 21 04:17:55.429: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 7m58.192733956s Apr 21 04:17:57.463: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 8m0.226404537s Apr 21 04:17:59.498: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 8m2.261656091s Apr 21 04:18:01.531: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 8m4.295305311s Apr 21 04:18:03.565: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 8m6.328667745s Apr 21 04:18:05.600: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 8m8.36336993s Apr 21 04:18:07.633: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 8m10.39706426s Apr 21 04:18:09.668: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 8m12.431630396s Apr 21 04:18:11.703: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 8m14.466546301s Apr 21 04:18:13.737: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 8m16.500547422s Apr 21 04:18:15.772: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 8m18.53532743s Apr 21 04:18:17.804: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 8m20.568299914s Apr 21 04:18:19.839: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 8m22.602698969s Apr 21 04:18:21.873: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 8m24.636903138s Apr 21 04:18:23.908: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 8m26.67168179s Apr 21 04:18:25.943: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 8m28.70654568s Apr 21 04:18:27.976: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 8m30.740009788s Apr 21 04:18:30.010: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 8m32.774244997s Apr 21 04:18:32.044: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 8m34.807978065s Apr 21 04:18:34.079: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 8m36.842382095s Apr 21 04:18:36.114: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 8m38.877455908s Apr 21 04:18:38.150: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 8m40.913876902s Apr 21 04:18:40.185: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 8m42.948591744s Apr 21 04:18:42.221: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 8m44.985112934s Apr 21 04:18:44.255: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 8m47.019257268s Apr 21 04:18:46.290: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Failed", Reason="", readiness=false. Elapsed: 8m49.054039538s �[1mSTEP�[0m: hit error(pod "azurefile-volume-tester-gbrmv" failed with status: {Phase:Failed Conditions:[{Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-21 04:09:57 +0000 UTC Reason: Message:} {Type:Ready Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-21 04:09:57 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [volume-tester]} {Type:ContainersReady Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-21 04:09:57 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [volume-tester]} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-21 04:09:57 +0000 UTC Reason: Message:}] Message: Reason: NominatedNodeName: HostIP:10.1.0.4 PodIP:192.168.221.196 PodIPs:[{IP:192.168.221.196}] StartTime:2022-04-21 04:09:57 +0000 UTC InitContainerStatuses:[] ContainerStatuses:[{Name:volume-tester State:{Waiting:&ContainerStateWaiting{Reason:RunContainerError,Message:context deadline exceeded,} Running:nil Terminated:nil} LastTerminationState:{Waiting:nil Running:nil Terminated:&ContainerStateTerminated{ExitCode:0,Signal:0,Reason:,Message:,StartedAt:0001-01-01 00:00:00 +0000 UTC,FinishedAt:0001-01-01 00:00:00 +0000 UTC,ContainerID:containerd://f34405ec9383d0af41d58d7872f41f77552f5abf44015d252db39d21336e3014,}} Ready:false RestartCount:0 Image:mcr.microsoft.com/windows/servercore:ltsc2022 ImageID:mcr.microsoft.com/windows/servercore@sha256:378d85bd8e7388a777d25009f8523d1e95a5f544f131eaada83171045d5b2c1e ContainerID:containerd://f34405ec9383d0af41d58d7872f41f77552f5abf44015d252db39d21336e3014 Started:0xc00094ed38}] QOSClass:BestEffort EphemeralContainerStatuses:[]}) in first run, give another try Apr 21 04:18:46.291: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-gbrmv" in namespace "azurefile-2540" to be "Succeeded or Failed" Apr 21 04:18:46.325: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Failed", Reason="", readiness=false. Elapsed: 34.11247ms Apr 21 04:18:46.325: INFO: deleting Pod "azurefile-2540"/"azurefile-volume-tester-gbrmv" Apr 21 04:18:46.380: INFO: Pod azurefile-volume-tester-gbrmv has the following logs: �[1mSTEP�[0m: Deleting pod azurefile-volume-tester-gbrmv in namespace azurefile-2540 Apr 21 04:18:46.421: INFO: deleting PVC "azurefile-2540"/"pvc-cjj7x" Apr 21 04:18:46.421: INFO: Deleting PersistentVolumeClaim "pvc-cjj7x" �[1mSTEP�[0m: waiting for claim's PV "pvc-219b8c3b-f4c9-487c-8501-35d9ce960c97" to be deleted Apr 21 04:18:46.525: INFO: Waiting up to 10m0s for PersistentVolume pvc-219b8c3b-f4c9-487c-8501-35d9ce960c97 to get deleted Apr 21 04:18:46.557: INFO: PersistentVolume pvc-219b8c3b-f4c9-487c-8501-35d9ce960c97 found and phase=Released (31.397454ms) Apr 21 04:18:51.590: INFO: PersistentVolume pvc-219b8c3b-f4c9-487c-8501-35d9ce960c97 was removed Apr 21 04:18:51.590: INFO: Waiting up to 5m0s for PersistentVolumeClaim azurefile-2540 to be removed Apr 21 04:18:51.622: INFO: Claim "azurefile-2540" in namespace "pvc-cjj7x" doesn't exist in the system Apr 21 04:18:51.622: INFO: deleting StorageClass azurefile-2540-file.csi.azure.com-dynamic-sc-zkdsf �[1mSTEP�[0m: Collecting events from namespace "azurefile-2540". �[1mSTEP�[0m: Found 12 events. Apr 21 04:18:51.690: INFO: At 2022-04-21 04:08:19 +0000 UTC - event for pvc-cjj7x: {file.csi.azure.com_capz-wu3n7j-md-0-h5bx4_0a16be51-4249-4c6c-b9e2-1d8032487f87 } Provisioning: External provisioner is provisioning volume for claim "azurefile-2540/pvc-cjj7x" Apr 21 04:18:51.690: INFO: At 2022-04-21 04:08:19 +0000 UTC - event for pvc-cjj7x: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "file.csi.azure.com" or manually created by system administrator Apr 21 04:18:51.690: INFO: At 2022-04-21 04:09:55 +0000 UTC - event for pvc-cjj7x: {file.csi.azure.com_capz-wu3n7j-md-0-h5bx4_0a16be51-4249-4c6c-b9e2-1d8032487f87 } ProvisioningSucceeded: Successfully provisioned volume pvc-219b8c3b-f4c9-487c-8501-35d9ce960c97 Apr 21 04:18:51.690: INFO: At 2022-04-21 04:09:57 +0000 UTC - event for azurefile-volume-tester-gbrmv: {default-scheduler } Scheduled: Successfully assigned azurefile-2540/azurefile-volume-tester-gbrmv to capz-wu3n-6ctgs Apr 21 04:18:51.690: INFO: At 2022-04-21 04:09:57 +0000 UTC - event for azurefile-volume-tester-gbrmv: {kubelet capz-wu3n-6ctgs} FailedMount: MountVolume.MountDevice failed for volume "pvc-219b8c3b-f4c9-487c-8501-35d9ce960c97" : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name file.csi.azure.com not found in the list of registered CSI drivers Apr 21 04:18:51.690: INFO: At 2022-04-21 04:11:13 +0000 UTC - event for azurefile-volume-tester-gbrmv: {kubelet capz-wu3n-6ctgs} Pulling: Pulling image "mcr.microsoft.com/windows/servercore:ltsc2022" Apr 21 04:18:51.690: INFO: At 2022-04-21 04:16:44 +0000 UTC - event for azurefile-volume-tester-gbrmv: {kubelet capz-wu3n-6ctgs} Pulled: Successfully pulled image "mcr.microsoft.com/windows/servercore:ltsc2022" in 5m30.633751s Apr 21 04:18:51.690: INFO: At 2022-04-21 04:16:44 +0000 UTC - event for azurefile-volume-tester-gbrmv: {kubelet capz-wu3n-6ctgs} Created: Created container volume-tester Apr 21 04:18:51.690: INFO: At 2022-04-21 04:18:44 +0000 UTC - event for azurefile-volume-tester-gbrmv: {kubelet capz-wu3n-6ctgs} Pulled: Container image "mcr.microsoft.com/windows/servercore:ltsc2022" already present on machine Apr 21 04:18:51.690: INFO: At 2022-04-21 04:18:44 +0000 UTC - event for azurefile-volume-tester-gbrmv: {kubelet capz-wu3n-6ctgs} Failed: Error: context deadline exceeded Apr 21 04:18:51.690: INFO: At 2022-04-21 04:18:50 +0000 UTC - event for azurefile-volume-tester-gbrmv: {kubelet capz-wu3n-6ctgs} Started: Started container volume-tester Apr 21 04:18:51.690: INFO: At 2022-04-21 04:18:50 +0000 UTC - event for azurefile-volume-tester-gbrmv: {kubelet capz-wu3n-6ctgs} Killing: Stopping container volume-tester Apr 21 04:18:51.722: INFO: POD NODE PHASE GRACE CONDITIONS Apr 21 04:18:51.722: INFO: Apr 21 04:18:51.766: INFO: Logging node info for node capz-wu3n-6ctgs Apr 21 04:18:51.801: INFO: Node Info: &Node{ObjectMeta:{capz-wu3n-6ctgs 417413a7-0755-4990-94f8-199c6f590a24 3222 0 2022-04-21 04:03:16 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D4s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:eastus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:capz-wu3n-6ctgs kubernetes.io/os:windows node.kubernetes.io/instance-type:Standard_D4s_v3 node.kubernetes.io/windows-build:10.0.20348 topology.kubernetes.io/region:eastus topology.kubernetes.io/zone:0] map[cluster.x-k8s.io/cluster-name:capz-wu3n7j cluster.x-k8s.io/cluster-namespace:default cluster.x-k8s.io/machine:capz-wu3n7j-md-win-54486fdc48-t66gc cluster.x-k8s.io/owner-kind:MachineSet cluster.x-k8s.io/owner-name:capz-wu3n7j-md-win-54486fdc48 csi.volume.kubernetes.io/nodeid:{"file.csi.azure.com":"capz-wu3n-6ctgs"} kubeadm.alpha.kubernetes.io/cri-socket:npipe:////./pipe/containerd-containerd node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.1.0.4/16 projectcalico.org/IPv4VXLANTunnelAddr:192.168.221.193 projectcalico.org/VXLANTunnelMACAddr:00:15:5d:be:41:cd volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{Go-http-client Update v1 2022-04-21 04:03:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubeadm.alpha.kubernetes.io/cri-socket":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-04-21 04:03:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}} } {manager Update v1 2022-04-21 04:03:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:cluster.x-k8s.io/cluster-name":{},"f:cluster.x-k8s.io/cluster-namespace":{},"f:cluster.x-k8s.io/machine":{},"f:cluster.x-k8s.io/owner-kind":{},"f:cluster.x-k8s.io/owner-name":{}}}} } {calico-node.exe Update v1 2022-04-21 04:05:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4VXLANTunnelAddr":{},"f:projectcalico.org/VXLANTunnelMACAddr":{}}}} status} {Go-http-client Update v1 2022-04-21 04:10:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/===REDACTED===/resourceGroups/capz-wu3n7j/providers/Microsoft.Compute/virtualMachines/capz-wu3n-6ctgs,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{17179398144 0} {<nil>} 16776756Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{123221307598 0} {<nil>} 123221307598 DecimalSI},memory: {{17074540544 0} {<nil>} 16674356Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-04-21 04:16:52 +0000 UTC,LastTransitionTime:2022-04-21 04:03:16 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-04-21 04:16:52 +0000 UTC,LastTransitionTime:2022-04-21 04:03:16 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-04-21 04:16:52 +0000 UTC,LastTransitionTime:2022-04-21 04:03:16 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-04-21 04:16:52 +0000 UTC,LastTransitionTime:2022-04-21 04:04:17 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:capz-wu3n-6ctgs,},NodeAddress{Type:InternalIP,Address:10.1.0.4,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:capz-wu3n-6ctgs,SystemUUID:928AB8ED-92C3-4F57-9EB1-C2576CD40852,BootID:,KernelVersion:10.0.20348.405,OSImage:Windows Server 2022 Datacenter,ContainerRuntimeVersion:containerd://1.6.1,KubeletVersion:v1.23.5,KubeProxyVersion:v1.23.5,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:378d85bd8e7388a777d25009f8523d1e95a5f544f131eaada83171045d5b2c1e mcr.microsoft.com/windows/servercore:ltsc2022],SizeBytes:2226956779,},ContainerImage{Names:[docker.io/sigwindowstools/calico-install@sha256:141afecd724eb757ee41593cc73f35fb19a2ce13cad73179cf3b1cef81a637d1 docker.io/sigwindowstools/calico-install:v3.22.1-hostprocess],SizeBytes:148096127,},ContainerImage{Names:[capzci.azurecr.io/azurefile-csi@sha256:87270d44009338b1f80be0c541aad33634570cda7af735084b75685fcb72cc1e capzci.azurecr.io/azurefile-csi:e2e-6a13648397110ae4586db2ee2bd9457c1a00fa53],SizeBytes:130300507,},ContainerImage{Names:[docker.io/sigwindowstools/calico-node@sha256:b8e6e2f190e58d6b61b7f2a19b0e2e17a377e5b9d7b9528e9b7953d9f9ab59bb docker.io/sigwindowstools/calico-node:v3.22.1-hostprocess],SizeBytes:128793648,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:dbec3a8166686b09b242176ab5b99e993da4126438bbce68147c3fd654f35662 mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v2.4.0],SizeBytes:125554391,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:c96a6255c42766f6b8bb1a7cda02b0060ab1b20b2e2dafcc64ec09e7646745a6 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.5.0],SizeBytes:124471446,},ContainerImage{Names:[ghcr.io/kubernetes-sigs/sig-windows/csi-proxy@sha256:96b4144986319a747ba599892454be2737aae6005d96b8e13ed481321ac3afba ghcr.io/kubernetes-sigs/sig-windows/csi-proxy:v1.0.2],SizeBytes:123925937,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6],SizeBytes:119397646,},ContainerImage{Names:[docker.io/sigwindowstools/kube-proxy@sha256:0f8a44b795d1824358f24cc56f0024d18a39ae044656686596d8b7fa6d78e1fa docker.io/sigwindowstools/kube-proxy:v1.23.5-calico-hostprocess],SizeBytes:116337721,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Apr 21 04:18:51.802: INFO: Logging kubelet events for node capz-wu3n-6ctgs Apr 21 04:18:51.841: INFO: Logging pods the kubelet thinks is on node capz-wu3n-6ctgs Apr 21 04:18:51.900: INFO: calico-node-windows-mwqh9 started at 2022-04-21 04:03:16 +0000 UTC (1+2 container statuses recorded) Apr 21 04:18:51.900: INFO: Init container install-cni ready: true, restart count 0 Apr 21 04:18:51.900: INFO: Container calico-node-felix ready: true, restart count 1 Apr 21 04:18:51.900: INFO: Container calico-node-startup ready: true, restart count 0 Apr 21 04:18:51.900: INFO: kube-proxy-windows-kp699 started at 2022-04-21 04:03:16 +0000 UTC (0+1 container statuses recorded) Apr 21 04:18:51.900: INFO: Container kube-proxy ready: true, restart count 0 Apr 21 04:18:51.900: INFO: csi-proxy-2pbfm started at 2022-04-21 04:04:17 +0000 UTC (0+1 container statuses recorded) Apr 21 04:18:51.900: INFO: Container csi-proxy ready: true, restart count 0 Apr 21 04:18:51.900: INFO: csi-azurefile-node-win-cfqlb started at 2022-04-21 04:06:31 +0000 UTC (0+3 container statuses recorded) Apr 21 04:18:51.900: INFO: Container azurefile ready: true, restart count 0 Apr 21 04:18:51.900: INFO: Container liveness-probe ready: true, restart count 0 Apr 21 04:18:51.900: INFO: Container node-driver-registrar ready: true, restart count 0 Apr 21 04:18:52.158: INFO: Latency metrics for node capz-wu3n-6ctgs Apr 21 04:18:52.158: INFO: Logging node info for node capz-wu3n-njpbf Apr 21 04:18:52.192: INFO: Node Info: &Node{ObjectMeta:{capz-wu3n-njpbf d06d8506-0d9a-47f1-9a0e-661f44fa881f 3394 0 2022-04-21 04:03:16 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D4s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:eastus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:capz-wu3n-njpbf kubernetes.io/os:windows node.kubernetes.io/instance-type:Standard_D4s_v3 node.kubernetes.io/windows-build:10.0.20348 topology.kubernetes.io/region:eastus topology.kubernetes.io/zone:0] map[cluster.x-k8s.io/cluster-name:capz-wu3n7j cluster.x-k8s.io/cluster-namespace:default cluster.x-k8s.io/machine:capz-wu3n7j-md-win-54486fdc48-s674d cluster.x-k8s.io/owner-kind:MachineSet cluster.x-k8s.io/owner-name:capz-wu3n7j-md-win-54486fdc48 csi.volume.kubernetes.io/nodeid:{"file.csi.azure.com":"capz-wu3n-njpbf"} kubeadm.alpha.kubernetes.io/cri-socket:npipe:////./pipe/containerd-containerd node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.1.0.6/16 projectcalico.org/IPv4VXLANTunnelAddr:192.168.111.193 projectcalico.org/VXLANTunnelMACAddr:00:15:5d:2b:61:50 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{Go-http-client Update v1 2022-04-21 04:03:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubeadm.alpha.kubernetes.io/cri-socket":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-04-21 04:03:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}} } {manager Update v1 2022-04-21 04:03:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:cluster.x-k8s.io/cluster-name":{},"f:cluster.x-k8s.io/cluster-namespace":{},"f:cluster.x-k8s.io/machine":{},"f:cluster.x-k8s.io/owner-kind":{},"f:cluster.x-k8s.io/owner-name":{}}}} } {calico-node.exe Update v1 2022-04-21 04:05:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4VXLANTunnelAddr":{},"f:projectcalico.org/VXLANTunnelMACAddr":{}}}} status} {Go-http-client Update v1 2022-04-21 04:07:48 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/===REDACTED===/resourceGroups/capz-wu3n7j/providers/Microsoft.Compute/virtualMachines/capz-wu3n-njpbf,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{17179398144 0} {<nil>} 16776756Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{123221307598 0} {<nil>} 123221307598 DecimalSI},memory: {{17074540544 0} {<nil>} 16674356Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-04-21 04:18:02 +0000 UTC,LastTransitionTime:2022-04-21 04:03:16 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-04-21 04:18:02 +0000 UTC,LastTransitionTime:2022-04-21 04:03:16 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-04-21 04:18:02 +0000 UTC,LastTransitionTime:2022-04-21 04:03:16 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-04-21 04:18:02 +0000 UTC,LastTransitionTime:2022-04-21 04:04:16 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:capz-wu3n-njpbf,},NodeAddress{Type:InternalIP,Address:10.1.0.6,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:capz-wu3n-njpbf,SystemUUID:E13A2EBC-C166-4A54-9AF7-545ACAADCA7C,BootID:,KernelVersion:10.0.20348.405,OSImage:Windows Server 2022 Datacenter,ContainerRuntimeVersion:containerd://1.6.1,KubeletVersion:v1.23.5,KubeProxyVersion:v1.23.5,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/sigwindowstools/calico-install@sha256:141afecd724eb757ee41593cc73f35fb19a2ce13cad73179cf3b1cef81a637d1 docker.io/sigwindowstools/calico-install:v3.22.1-hostprocess],SizeBytes:148096127,},ContainerImage{Names:[capzci.azurecr.io/azurefile-csi@sha256:87270d44009338b1f80be0c541aad33634570cda7af735084b75685fcb72cc1e capzci.azurecr.io/azurefile-csi:e2e-6a13648397110ae4586db2ee2bd9457c1a00fa53],SizeBytes:130300507,},ContainerImage{Names:[docker.io/sigwindowstools/calico-node@sha256:b8e6e2f190e58d6b61b7f2a19b0e2e17a377e5b9d7b9528e9b7953d9f9ab59bb docker.io/sigwindowstools/calico-node:v3.22.1-hostprocess],SizeBytes:128793648,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:dbec3a8166686b09b242176ab5b99e993da4126438bbce68147c3fd654f35662 mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v2.4.0],SizeBytes:125554391,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:c96a6255c42766f6b8bb1a7cda02b0060ab1b20b2e2dafcc64ec09e7646745a6 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.5.0],SizeBytes:124471446,},ContainerImage{Names:[ghcr.io/kubernetes-sigs/sig-windows/csi-proxy@sha256:96b4144986319a747ba599892454be2737aae6005d96b8e13ed481321ac3afba ghcr.io/kubernetes-sigs/sig-windows/csi-proxy:v1.0.2],SizeBytes:123925937,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6],SizeBytes:119397646,},ContainerImage{Names:[docker.io/sigwindowstools/kube-proxy@sha256:0f8a44b795d1824358f24cc56f0024d18a39ae044656686596d8b7fa6d78e1fa docker.io/sigwindowstools/kube-proxy:v1.23.5-calico-hostprocess],SizeBytes:116337721,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Apr 21 04:18:52.193: INFO: Logging kubelet events for node capz-wu3n-njpbf Apr 21 04:18:52.229: INFO: Logging pods the kubelet thinks is on node capz-wu3n-njpbf Apr 21 04:18:52.300: INFO: kube-proxy-windows-j86v9 started at 2022-04-21 04:03:16 +0000 UTC (0+1 container statuses recorded) Apr 21 04:18:52.300: INFO: Container kube-proxy ready: true, restart count 0 Apr 21 04:18:52.300: INFO: calico-node-windows-77b64 started at 2022-04-21 04:03:16 +0000 UTC (1+2 container statuses recorded) Apr 21 04:18:52.300: INFO: Init container install-cni ready: true, restart count 0 Apr 21 04:18:52.300: INFO: Container calico-node-felix ready: true, restart count 1 Apr 21 04:18:52.300: INFO: Container calico-node-startup ready: true, restart count 0 Apr 21 04:18:52.300: INFO: csi-proxy-vzj4w started at 2022-04-21 04:04:16 +0000 UTC (0+1 container statuses recorded) Apr 21 04:18:52.300: INFO: Container csi-proxy ready: true, restart count 0 Apr 21 04:18:52.300: INFO: csi-azurefile-node-win-nhzkb started at 2022-04-21 04:06:31 +0000 UTC (0+3 container statuses recorded) Apr 21 04:18:52.300: INFO: Container azurefile ready: true, restart count 0 Apr 21 04:18:52.300: INFO: Container liveness-probe ready: true, restart count 0 Apr 21 04:18:52.300: INFO: Container node-driver-registrar ready: true, restart count 0 Apr 21 04:18:52.498: INFO: Latency metrics for node capz-wu3n-njpbf Apr 21 04:18:52.498: INFO: Logging node info for node capz-wu3n7j-control-plane-8x9zb Apr 21 04:18:52.534: INFO: Node Info: &Node{ObjectMeta:{capz-wu3n7j-control-plane-8x9zb 10ec5bc2-3d25-4cf4-997c-9ee89a40e10e 3278 0 2022-04-21 04:00:47 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eastus failure-domain.beta.kubernetes.io/zone:eastus-1 kubernetes.io/arch:amd64 kubernetes.io/hostname:capz-wu3n7j-control-plane-8x9zb kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node-role.kubernetes.io/master: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:Standard_D2s_v3 topology.kubernetes.io/region:eastus topology.kubernetes.io/zone:eastus-1] map[cluster.x-k8s.io/cluster-name:capz-wu3n7j cluster.x-k8s.io/cluster-namespace:default cluster.x-k8s.io/machine:capz-wu3n7j-control-plane-wr7tl cluster.x-k8s.io/owner-kind:KubeadmControlPlane cluster.x-k8s.io/owner-name:capz-wu3n7j-control-plane kubeadm.alpha.kubernetes.io/cri-socket:/run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.0.4/16 projectcalico.org/IPv4VXLANTunnelAddr:192.168.155.192 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{manager Update v1 2022-04-21 04:00:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:cluster.x-k8s.io/cluster-name":{},"f:cluster.x-k8s.io/cluster-namespace":{},"f:cluster.x-k8s.io/machine":{},"f:cluster.x-k8s.io/owner-kind":{},"f:cluster.x-k8s.io/owner-name":{}}}} } {Go-http-client Update v1 2022-04-21 04:00:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubeadm.alpha.kubernetes.io/cri-socket":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node-role.kubernetes.io/control-plane":{},"f:node-role.kubernetes.io/master":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-04-21 04:01:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:taints":{}}} } {calico-node Update v1 2022-04-21 04:01:24 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4VXLANTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {Go-http-client Update v1 2022-04-21 04:01:27 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/===REDACTED===/resourceGroups/capz-wu3n7j/providers/Microsoft.Compute/virtualMachines/capz-wu3n7j-control-plane-8x9zb,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{133018140672 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8340819968 0} {<nil>} 8145332Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{119716326407 0} {<nil>} 119716326407 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8235962368 0} {<nil>} 8042932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-04-21 04:01:24 +0000 UTC,LastTransitionTime:2022-04-21 04:01:24 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-04-21 04:17:15 +0000 UTC,LastTransitionTime:2022-04-21 04:00:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-04-21 04:17:15 +0000 UTC,LastTransitionTime:2022-04-21 04:00:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-04-21 04:17:15 +0000 UTC,LastTransitionTime:2022-04-21 04:00:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-04-21 04:17:15 +0000 UTC,LastTransitionTime:2022-04-21 04:01:17 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:capz-wu3n7j-control-plane-8x9zb,},NodeAddress{Type:InternalIP,Address:10.0.0.4,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:7c64b602c046425bbfbe8f9e3d4115ea,SystemUUID:f5493113-22b8-ba42-a600-453999ab1c72,BootID:9225d48e-d2a4-4112-9fb5-4b309cb9083e,KernelVersion:5.13.0-1017-azure,OSImage:Ubuntu 20.04.4 LTS,ContainerRuntimeVersion:containerd://1.6.1,KubeletVersion:v1.23.5,KubeProxyVersion:v1.23.5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 k8s.gcr.io/etcd:3.5.1-0],SizeBytes:98888614,},ContainerImage{Names:[docker.io/calico/cni@sha256:2219eae79544b098119a06a8bb5608867f9ac00471592a00e2347f3ae4bea687 docker.io/calico/cni:v3.22.1],SizeBytes:80514590,},ContainerImage{Names:[docker.io/calico/node@sha256:1f8ed83e5264b4206cce7e1def11bca0b3ea7d5f4eb9b0ca0dbfc8cb968ca57e docker.io/calico/node:v3.22.1],SizeBytes:69647221,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:e42a0aba3637d123481cca14fd8314a482616593edf58f9594c9382e50498f9b docker.io/calico/kube-controllers:v3.22.1],SizeBytes:54948023,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:c1f625d115fbd9a12eac615653fc81c0edb33b2b5a76d1e09d5daed11fa557c1 k8s.gcr.io/kube-proxy:v1.23.5],SizeBytes:39278412,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:ddf5bf7196eb534271f9e5d403f4da19838d5610bb5ca191001bde5f32b5492e k8s.gcr.io/kube-apiserver:v1.23.5],SizeBytes:32603217,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:cca0fb3532abedcc95c5f64268d54da9ecc56cc4817ff08d0128941cf2b0e1a4 k8s.gcr.io/kube-controller-manager:v1.23.5],SizeBytes:30174093,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:489efb65da9edc40bf0911f3e6371e5bb6b8ad8fde1d55193a6cc84c2ef36626 k8s.gcr.io/kube-scheduler:v1.23.5],SizeBytes:15131395,},ContainerImage{Names:[k8s.gcr.io/coredns/coredns@sha256:5b6ec0d6de9baaf3e92d0f66cd96a25b9edbce8716f5f15dcd1a616b3abd590e k8s.gcr.io/coredns/coredns:v1.8.6],SizeBytes:13585107,},ContainerImage{Names:[docker.io/calico/pod2daemon-flexvol@sha256:35802ba083546a7c5e8b5bf0ee7ffad7f8a468e8c2b3631e7e9647512c94041d docker.io/calico/pod2daemon-flexvol:v3.22.1],SizeBytes:8462620,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Apr 21 04:18:52.534: INFO: Logging kubelet events for node capz-wu3n7j-control-plane-8x9zb Apr 21 04:18:52.570: INFO: Logging pods the kubelet thinks is on node capz-wu3n7j-control-plane-8x9zb Apr 21 04:18:52.640: INFO: kube-proxy-dh24x started at 2022-04-21 04:00:58 +0000 UTC (0+1 container statuses recorded) Apr 21 04:18:52.640: INFO: Container kube-proxy ready: true, restart count 0 Apr 21 04:18:52.640: INFO: coredns-64897985d-pg86r started at 2022-04-21 04:01:17 +0000 UTC (0+1 container statuses recorded) Apr 21 04:18:52.640: INFO: Container coredns ready: true, restart count 0 Apr 21 04:18:52.640: INFO: etcd-capz-wu3n7j-control-plane-8x9zb started at 2022-04-21 04:00:57 +0000 UTC (0+1 container statuses recorded) Apr 21 04:18:52.640: INFO: Container etcd ready: true, restart count 0 Apr 21 04:18:52.640: INFO: kube-scheduler-capz-wu3n7j-control-plane-8x9zb started at 2022-04-21 04:00:58 +0000 UTC (0+1 container statuses recorded) Apr 21 04:18:52.640: INFO: Container kube-scheduler ready: true, restart count 0 Apr 21 04:18:52.640: INFO: calico-node-8gkb5 started at 2022-04-21 04:00:58 +0000 UTC (3+1 container statuses recorded) Apr 21 04:18:52.640: INFO: Init container upgrade-ipam ready: true, restart count 0 Apr 21 04:18:52.640: INFO: Init container install-cni ready: true, restart count 0 Apr 21 04:18:52.640: INFO: Init container flexvol-driver ready: true, restart count 0 Apr 21 04:18:52.640: INFO: Container calico-node ready: true, restart count 0 Apr 21 04:18:52.640: INFO: calico-kube-controllers-7c664f4648-6qtqm started at 2022-04-21 04:01:17 +0000 UTC (0+1 container statuses recorded) Apr 21 04:18:52.640: INFO: Container calico-kube-controllers ready: true, restart count 0 Apr 21 04:18:52.640: INFO: coredns-64897985d-7hbb8 started at 2022-04-21 04:01:17 +0000 UTC (0+1 container statuses recorded) Apr 21 04:18:52.640: INFO: Container coredns ready: true, restart count 0 Apr 21 04:18:52.640: INFO: kube-apiserver-capz-wu3n7j-control-plane-8x9zb started at 2022-04-21 04:00:57 +0000 UTC (0+1 container statuses recorded) Apr 21 04:18:52.640: INFO: Container kube-apiserver ready: true, restart count 0 Apr 21 04:18:52.640: INFO: kube-controller-manager-capz-wu3n7j-control-plane-8x9zb started at 2022-04-21 04:00:57 +0000 UTC (0+1 container statuses recorded) Apr 21 04:18:52.640: INFO: Container kube-controller-manager ready: true, restart count 0 Apr 21 04:18:52.812: INFO: Latency metrics for node capz-wu3n7j-control-plane-8x9zb Apr 21 04:18:52.812: INFO: Logging node info for node capz-wu3n7j-md-0-69ghn Apr 21 04:18:52.846: INFO: Node Info: &Node{ObjectMeta:{capz-wu3n7j-md-0-69ghn 30ea4379-a136-4183-bb3e-c31570c16533 3433 0 2022-04-21 04:01:57 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D4s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eastus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:capz-wu3n7j-md-0-69ghn kubernetes.io/os:linux node.kubernetes.io/instance-type:Standard_D4s_v3 topology.kubernetes.io/region:eastus topology.kubernetes.io/zone:0] map[cluster.x-k8s.io/cluster-name:capz-wu3n7j cluster.x-k8s.io/cluster-namespace:default cluster.x-k8s.io/machine:capz-wu3n7j-md-0-57f85f8b7c-dsk7p cluster.x-k8s.io/owner-kind:MachineSet cluster.x-k8s.io/owner-name:capz-wu3n7j-md-0-57f85f8b7c kubeadm.alpha.kubernetes.io/cri-socket:/run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.1.0.7/16 projectcalico.org/IPv4VXLANTunnelAddr:192.168.246.192 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{Go-http-client Update v1 2022-04-21 04:01:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubeadm.alpha.kubernetes.io/cri-socket":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-04-21 04:02:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}} } {manager Update v1 2022-04-21 04:02:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:cluster.x-k8s.io/cluster-name":{},"f:cluster.x-k8s.io/cluster-namespace":{},"f:cluster.x-k8s.io/machine":{},"f:cluster.x-k8s.io/owner-kind":{},"f:cluster.x-k8s.io/owner-name":{}}}} } {calico-node Update v1 2022-04-21 04:02:20 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4VXLANTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {Go-http-client Update v1 2022-04-21 04:02:28 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/===REDACTED===/resourceGroups/capz-wu3n7j/providers/Microsoft.Compute/virtualMachines/capz-wu3n7j-md-0-69ghn,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{133018140672 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{16783433728 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{119716326407 0} {<nil>} 119716326407 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{16678576128 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-04-21 04:02:20 +0000 UTC,LastTransitionTime:2022-04-21 04:02:20 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-04-21 04:18:17 +0000 UTC,LastTransitionTime:2022-04-21 04:01:57 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-04-21 04:18:17 +0000 UTC,LastTransitionTime:2022-04-21 04:01:57 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-04-21 04:18:17 +0000 UTC,LastTransitionTime:2022-04-21 04:01:57 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-04-21 04:18:17 +0000 UTC,LastTransitionTime:2022-04-21 04:02:17 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:capz-wu3n7j-md-0-69ghn,},NodeAddress{Type:InternalIP,Address:10.1.0.7,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:97a8d5fe8e364c4dadb4ce100184dd54,SystemUUID:93de822e-1774-6245-adf7-d547d3f82478,BootID:8d5389bb-b05b-4d82-bff8-86da7731187e,KernelVersion:5.13.0-1017-azure,OSImage:Ubuntu 20.04.4 LTS,ContainerRuntimeVersion:containerd://1.6.1,KubeletVersion:v1.23.5,KubeProxyVersion:v1.23.5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 k8s.gcr.io/etcd:3.5.1-0],SizeBytes:98888614,},ContainerImage{Names:[docker.io/calico/cni@sha256:2219eae79544b098119a06a8bb5608867f9ac00471592a00e2347f3ae4bea687 docker.io/calico/cni:v3.22.1],SizeBytes:80514590,},ContainerImage{Names:[docker.io/calico/node@sha256:1f8ed83e5264b4206cce7e1def11bca0b3ea7d5f4eb9b0ca0dbfc8cb968ca57e docker.io/calico/node:v3.22.1],SizeBytes:69647221,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:c1f625d115fbd9a12eac615653fc81c0edb33b2b5a76d1e09d5daed11fa557c1 k8s.gcr.io/kube-proxy:v1.23.5],SizeBytes:39278412,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:ddf5bf7196eb534271f9e5d403f4da19838d5610bb5ca191001bde5f32b5492e k8s.gcr.io/kube-apiserver:v1.23.5],SizeBytes:32603217,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:cca0fb3532abedcc95c5f64268d54da9ecc56cc4817ff08d0128941cf2b0e1a4 k8s.gcr.io/kube-controller-manager:v1.23.5],SizeBytes:30174093,},ContainerImage{Names:[docker.io/andyzhangx/samba@sha256:1c268eae7ec1eb9fbbbd4f0aab3ee41c7a4c4ecb0313c498cb11cfdcc762ad3e docker.io/andyzhangx/samba:win-fix],SizeBytes:21999042,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:489efb65da9edc40bf0911f3e6371e5bb6b8ad8fde1d55193a6cc84c2ef36626 k8s.gcr.io/kube-scheduler:v1.23.5],SizeBytes:15131395,},ContainerImage{Names:[k8s.gcr.io/coredns/coredns@sha256:5b6ec0d6de9baaf3e92d0f66cd96a25b9edbce8716f5f15dcd1a616b3abd590e k8s.gcr.io/coredns/coredns:v1.8.6],SizeBytes:13585107,},ContainerImage{Names:[docker.io/calico/pod2daemon-flexvol@sha256:35802ba083546a7c5e8b5bf0ee7ffad7f8a468e8c2b3631e7e9647512c94041d docker.io/calico/pod2daemon-flexvol:v3.22.1],SizeBytes:8462620,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Apr 21 04:18:52.846: INFO: Logging kubelet events for node capz-wu3n7j-md-0-69ghn Apr 21 04:18:52.881: INFO: Logging pods the kubelet thinks is on node capz-wu3n7j-md-0-69ghn Apr 21 04:18:52.937: INFO: kube-proxy-xb8k9 started at 2022-04-21 04:01:58 +0000 UTC (0+1 container statuses recorded) Apr 21 04:18:52.937: INFO: Container kube-proxy ready: true, restart count 0 Apr 21 04:18:52.937: INFO: smb-server-55b87d449c-xsv7m started at 2022-04-21 04:07:51 +0000 UTC (0+1 container statuses recorded) Apr 21 04:18:52.937: INFO: Container smb-server ready: true, restart count 0 Apr 21 04:18:52.937: INFO: calico-node-ncmtk started at 2022-04-21 04:01:58 +0000 UTC (3+1 container statuses recorded) Apr 21 04:18:52.937: INFO: Init container upgrade-ipam ready: true, restart count 0 Apr 21 04:18:52.937: INFO: Init container install-cni ready: true, restart count 0 Apr 21 04:18:52.937: INFO: Init container flexvol-driver ready: true, restart count 0 Apr 21 04:18:52.937: INFO: Container calico-node ready: true, restart count 0 Apr 21 04:18:53.076: INFO: Latency metrics for node capz-wu3n7j-md-0-69ghn Apr 21 04:18:53.076: INFO: Logging node info for node capz-wu3n7j-md-0-h5bx4 Apr 21 04:18:53.109: INFO: Node Info: &Node{ObjectMeta:{capz-wu3n7j-md-0-h5bx4 9bfe7984-dbc5-4fa6-a8c4-b6f5098d6841 3291 0 2022-04-21 04:02:02 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D4s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eastus failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:capz-wu3n7j-md-0-h5bx4 kubernetes.io/os:linux node.kubernetes.io/instance-type:Standard_D4s_v3 topology.kubernetes.io/region:eastus topology.kubernetes.io/zone:0] map[cluster.x-k8s.io/cluster-name:capz-wu3n7j cluster.x-k8s.io/cluster-namespace:default cluster.x-k8s.io/machine:capz-wu3n7j-md-0-57f85f8b7c-zflzb cluster.x-k8s.io/owner-kind:MachineSet cluster.x-k8s.io/owner-name:capz-wu3n7j-md-0-57f85f8b7c kubeadm.alpha.kubernetes.io/cri-socket:/run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.1.0.5/16 projectcalico.org/IPv4VXLANTunnelAddr:192.168.163.192 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{Go-http-client Update v1 2022-04-21 04:02:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubeadm.alpha.kubernetes.io/cri-socket":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {manager Update v1 2022-04-21 04:02:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:cluster.x-k8s.io/cluster-name":{},"f:cluster.x-k8s.io/cluster-namespace":{},"f:cluster.x-k8s.io/machine":{},"f:cluster.x-k8s.io/owner-kind":{},"f:cluster.x-k8s.io/owner-name":{}}}} } {kube-controller-manager Update v1 2022-04-21 04:02:11 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}} } {calico-node Update v1 2022-04-21 04:02:24 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4VXLANTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {Go-http-client Update v1 2022-04-21 04:02:32 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/===REDACTED===/resourceGroups/capz-wu3n7j/providers/Microsoft.Compute/virtualMachines/capz-wu3n7j-md-0-h5bx4,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{133018140672 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{16783433728 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{119716326407 0} {<nil>} 119716326407 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{16678576128 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-04-21 04:02:23 +0000 UTC,LastTransitionTime:2022-04-21 04:02:23 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-04-21 04:17:20 +0000 UTC,LastTransitionTime:2022-04-21 04:02:02 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-04-21 04:17:20 +0000 UTC,LastTransitionTime:2022-04-21 04:02:02 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-04-21 04:17:20 +0000 UTC,LastTransitionTime:2022-04-21 04:02:02 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-04-21 04:17:20 +0000 UTC,LastTransitionTime:2022-04-21 04:02:22 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:capz-wu3n7j-md-0-h5bx4,},NodeAddress{Type:InternalIP,Address:10.1.0.5,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:31925525a5f749959d570f3de02dc291,SystemUUID:309b05ac-7708-b748-90eb-db44cb19aa59,BootID:829f70a7-ded9-41e2-ac8e-a549da6e2564,KernelVersion:5.13.0-1017-azure,OSImage:Ubuntu 20.04.4 LTS,ContainerRuntimeVersion:containerd://1.6.1,KubeletVersion:v1.23.5,KubeProxyVersion:v1.23.5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 k8s.gcr.io/etcd:3.5.1-0],SizeBytes:98888614,},ContainerImage{Names:[capzci.azurecr.io/azurefile-csi@sha256:87270d44009338b1f80be0c541aad33634570cda7af735084b75685fcb72cc1e capzci.azurecr.io/azurefile-csi:e2e-6a13648397110ae4586db2ee2bd9457c1a00fa53],SizeBytes:87076704,},ContainerImage{Names:[docker.io/calico/cni@sha256:2219eae79544b098119a06a8bb5608867f9ac00471592a00e2347f3ae4bea687 docker.io/calico/cni:v3.22.1],SizeBytes:80514590,},ContainerImage{Names:[docker.io/calico/node@sha256:1f8ed83e5264b4206cce7e1def11bca0b3ea7d5f4eb9b0ca0dbfc8cb968ca57e docker.io/calico/node:v3.22.1],SizeBytes:69647221,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner@sha256:542c9258a1441e4927883ea73425e21f9a14043a649686bf6b51700f34c64f8e mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner:v3.1.0],SizeBytes:59205633,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-resizer@sha256:ab6c2e18a4d943f2bf8688e1779622277a1d14c355c9d4bfc0d761d86c5108b3 mcr.microsoft.com/oss/kubernetes-csi/csi-resizer:v1.4.0],SizeBytes:56924121,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-attacher@sha256:19fbca01394f7ed80151731180cfde0a3367f038beae2a97cda7928034010057 mcr.microsoft.com/oss/kubernetes-csi/csi-attacher:v3.4.0],SizeBytes:56301028,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:c1f625d115fbd9a12eac615653fc81c0edb33b2b5a76d1e09d5daed11fa557c1 k8s.gcr.io/kube-proxy:v1.23.5],SizeBytes:39278412,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:ddf5bf7196eb534271f9e5d403f4da19838d5610bb5ca191001bde5f32b5492e k8s.gcr.io/kube-apiserver:v1.23.5],SizeBytes:32603217,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:cca0fb3532abedcc95c5f64268d54da9ecc56cc4817ff08d0128941cf2b0e1a4 k8s.gcr.io/kube-controller-manager:v1.23.5],SizeBytes:30174093,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter@sha256:a889e925e15f9423f7842f1b769f64cbcf6a20b6956122836fc835cf22d9073f mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter:v5.0.1],SizeBytes:22192414,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:489efb65da9edc40bf0911f3e6371e5bb6b8ad8fde1d55193a6cc84c2ef36626 k8s.gcr.io/kube-scheduler:v1.23.5],SizeBytes:15131395,},ContainerImage{Names:[k8s.gcr.io/coredns/coredns@sha256:5b6ec0d6de9baaf3e92d0f66cd96a25b9edbce8716f5f15dcd1a616b3abd590e k8s.gcr.io/coredns/coredns:v1.8.6],SizeBytes:13585107,},ContainerImage{Names:[docker.io/calico/pod2daemon-flexvol@sha256:35802ba083546a7c5e8b5bf0ee7ffad7f8a468e8c2b3631e7e9647512c94041d docker.io/calico/pod2daemon-flexvol:v3.22.1],SizeBytes:8462620,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:c96a6255c42766f6b8bb1a7cda02b0060ab1b20b2e2dafcc64ec09e7646745a6 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.5.0],SizeBytes:8222208,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Apr 21 04:18:53.110: INFO: Logging kubelet events for node capz-wu3n7j-md-0-h5bx4 Apr 21 04:18:53.144: INFO: Logging pods the kubelet thinks is on node capz-wu3n7j-md-0-h5bx4 Apr 21 04:18:53.203: INFO: calico-node-5rt6r started at 2022-04-21 04:02:03 +0000 UTC (3+1 container statuses recorded) Apr 21 04:18:53.203: INFO: Init container upgrade-ipam ready: true, restart count 0 Apr 21 04:18:53.203: INFO: Init container install-cni ready: true, restart count 0 Apr 21 04:18:53.203: INFO: Init container flexvol-driver ready: true, restart count 0 Apr 21 04:18:53.203: INFO: Container calico-node ready: true, restart count 0 Apr 21 04:18:53.203: INFO: csi-azurefile-controller-7d56b46bfb-4tkv6 started at 2022-04-21 04:06:31 +0000 UTC (0+6 container statuses recorded) Apr 21 04:18:53.203: INFO: Container azurefile ready: true, restart count 0 Apr 21 04:18:53.203: INFO: Container csi-attacher ready: true, restart count 0 Apr 21 04:18:53.203: INFO: Container csi-provisioner ready: true, restart count 0 Apr 21 04:18:53.203: INFO: Container csi-resizer ready: true, restart count 0 Apr 21 04:18:53.203: INFO: Container csi-snapshotter ready: true, restart count 0 Apr 21 04:18:53.203: INFO: Container liveness-probe ready: true, restart count 0 Apr 21 04:18:53.203: INFO: kube-proxy-rmjsc started at 2022-04-21 04:02:03 +0000 UTC (0+1 container statuses recorded) Apr 21 04:18:53.203: INFO: Container kube-proxy ready: true, restart count 0 Apr 21 04:18:53.363: INFO: Latency metrics for node capz-wu3n7j-md-0-h5bx4 Apr 21 04:18:53.363: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "azurefile-2540" for this suite.
Find azurefile-volume-tester-gbrmv mentions in log files | View test history on testgrid
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create a deployment object, write and read to it, delete the pod and write and read to it again [kubernetes.io/azure-file] [file.csi.azure.com] [Windows]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create a pod with multiple volumes [kubernetes.io/azure-file] [file.csi.azure.com] [Windows]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create a pod with volume mount subpath [file.csi.azure.com] [Windows]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create a statefulset object, write and read to it, delete the pod and write and read to it again [file.csi.azure.com]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create a storage account with tags [file.csi.azure.com] [Windows]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create a volume on demand and mount it as readOnly in a pod [kubernetes.io/azure-file] [file.csi.azure.com] [Windows]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create a volume on demand and resize it [kubernetes.io/azure-file] [file.csi.azure.com] [Windows]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create a volume on demand with mount options (Bring Your Own Key) [file.csi.azure.com] [Windows]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create a volume on demand with useDataPlaneAPI [file.csi.azure.com] [Windows]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create an CSI inline volume [file.csi.azure.com]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create multiple PV objects, bind to PVCs and attach all to different pods on the same node [kubernetes.io/azure-file] [file.csi.azure.com] [Windows]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should delete PV with reclaimPolicy "Delete" [kubernetes.io/azure-file] [file.csi.azure.com] [Windows]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should mount on-prem smb server [file.csi.azure.com]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should retain PV with reclaimPolicy "Retain" [file.csi.azure.com] [Windows]
AzureFile CSI Driver End-to-End Tests Pre-Provisioned should use a pre-provisioned volume and mount it as readOnly in a pod [file.csi.azure.com] [Windows]
AzureFile CSI Driver End-to-End Tests Pre-Provisioned should use a pre-provisioned volume and mount it by multiple pods [file.csi.azure.com] [Windows]
AzureFile CSI Driver End-to-End Tests Pre-Provisioned should use a pre-provisioned volume and retain PV with reclaimPolicy "Retain" [file.csi.azure.com] [Windows]
AzureFile CSI Driver End-to-End Tests Pre-Provisioned should use existing credentials in k8s cluster [file.csi.azure.com] [Windows]
AzureFile CSI Driver End-to-End Tests Pre-Provisioned should use provided credentials [file.csi.azure.com] [Windows]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning [env] should retain PV with reclaimPolicy "Retain" [file.csi.azure.com] [disk]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create a NFS volume on demand on a storage account with private endpoint [file.csi.azure.com] [nfs]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create a NFS volume on demand with mount options [file.csi.azure.com] [nfs]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create a deployment object, write and read to it, delete the pod and write and read to it again [file.csi.azure.com] [disk]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create a pod with multiple NFS volumes [file.csi.azure.com]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create a pod, write and read to it, take a volume snapshot, and validate whether it is ready to use [file.csi.azure.com]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create a vhd disk volume on demand [kubernetes.io/azure-file] [file.csi.azure.com][disk]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create a vhd disk volume on demand and mount it as readOnly in a pod [file.csi.azure.com][disk]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create a volume after driver restart [kubernetes.io/azure-file] [file.csi.azure.com]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create an inline volume by in-tree driver [kubernetes.io/azure-file]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create multiple PV objects, bind to PVCs and attach all to different pods on the same node [file.csi.azure.com][disk]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should delete PV with reclaimPolicy "Delete" [file.csi.azure.com] [disk]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should receive FailedMount event with invalid mount options [file.csi.azure.com] [disk]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should receive FailedMount event with invalid mount options [file.csi.azure.com] [disk]
... skipping 672 lines ... certificate.cert-manager.io "selfsigned-cert" deleted # Create secret for AzureClusterIdentity ./hack/create-identity-secret.sh make[2]: Entering directory '/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure' make[2]: Nothing to be done for 'kubectl'. make[2]: Leaving directory '/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure' Error from server (NotFound): secrets "cluster-identity-secret" not found secret/cluster-identity-secret created secret/cluster-identity-secret labeled # Deploy CAPI curl --retry 3 -sSL https://github.com/kubernetes-sigs/cluster-api/releases/download/v1.1.2/cluster-api-components.yaml | /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/hack/tools/bin/envsubst-v2.0.0-20210730161058-179042472c46 | kubectl apply -f - namespace/capi-system created customresourcedefinition.apiextensions.k8s.io/clusterclasses.cluster.x-k8s.io created ... skipping 129 lines ... # Wait for the kubeconfig to become available. timeout --foreground 300 bash -c "while ! kubectl get secrets | grep capz-wu3n7j-kubeconfig; do sleep 1; done" capz-wu3n7j-kubeconfig cluster.x-k8s.io/secret 1 1s # Get kubeconfig and store it locally. kubectl get secrets capz-wu3n7j-kubeconfig -o json | jq -r .data.value | base64 --decode > ./kubeconfig timeout --foreground 600 bash -c "while ! kubectl --kubeconfig=./kubeconfig get nodes | grep control-plane; do sleep 1; done" error: the server doesn't have a resource type "nodes" capz-wu3n7j-control-plane-8x9zb NotReady control-plane,master 13s v1.23.5 run "kubectl --kubeconfig=./kubeconfig ..." to work with the new target cluster make[1]: Leaving directory '/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure' Waiting for 1 control plane machine(s), 2 worker machine(s), and 2 windows machine(s) to become Ready node/capz-wu3n-6ctgs condition met node/capz-wu3n-njpbf condition met ... skipping 1026 lines ... image: "mcr.microsoft.com/oss/kubernetes-csi/csi-resizer:v1.4.0" args: - "-csi-address=$(ADDRESS)" - "-v=2" - "-leader-election" - "--leader-election-namespace=kube-system" - '-handle-volume-inuse-error=false' - '-timeout=120s' - '-feature-gates=RecoverVolumeExpansionFailure=true' env: - name: ADDRESS value: /csi/csi.sock imagePullPolicy: IfNotPresent ... skipping 147 lines ... Driver Version: N/A Git Commit: N/A Go Version: go1.18.1 Platform: linux/amd64 Streaming logs below: W0421 04:07:50.995266 36340 azure.go:78] InitializeCloudFromSecret: failed to get cloud config from secret /: failed to get secret /: resource name may not be empty [1mSTEP[0m: Building a namespace api object, basename azurefile I0421 04:07:51.013448 36340 driver.go:93] Enabling controller service capability: CREATE_DELETE_VOLUME I0421 04:07:51.013485 36340 driver.go:93] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME I0421 04:07:51.013491 36340 driver.go:93] Enabling controller service capability: CREATE_DELETE_SNAPSHOT I0421 04:07:51.013495 36340 driver.go:93] Enabling controller service capability: EXPAND_VOLUME I0421 04:07:51.013499 36340 driver.go:93] Enabling controller service capability: SINGLE_NODE_MULTI_WRITER ... skipping 121 lines ... Apr 21 04:09:55.106: INFO: PersistentVolumeClaim pvc-cjj7x found but phase is Pending instead of Bound. Apr 21 04:09:57.138: INFO: PersistentVolumeClaim pvc-cjj7x found and phase=Bound (1m37.64121106s) [1mSTEP[0m: checking the PVC [1mSTEP[0m: validating provisioned PV [1mSTEP[0m: checking the PV [1mSTEP[0m: deploying the pod [1mSTEP[0m: checking that the pods command exits with no error Apr 21 04:09:57.236: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-gbrmv" in namespace "azurefile-2540" to be "Succeeded or Failed" Apr 21 04:09:57.268: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 31.633182ms Apr 21 04:09:59.303: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 2.066737733s Apr 21 04:10:01.337: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 4.100714209s Apr 21 04:10:03.370: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 6.133579044s Apr 21 04:10:05.403: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 8.166930793s Apr 21 04:10:07.436: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 10.199943322s ... skipping 248 lines ... Apr 21 04:18:34.079: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 8m36.842382095s Apr 21 04:18:36.114: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 8m38.877455908s Apr 21 04:18:38.150: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 8m40.913876902s Apr 21 04:18:40.185: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 8m42.948591744s Apr 21 04:18:42.221: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 8m44.985112934s Apr 21 04:18:44.255: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Pending", Reason="", readiness=false. Elapsed: 8m47.019257268s Apr 21 04:18:46.290: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Failed", Reason="", readiness=false. Elapsed: 8m49.054039538s [1mSTEP[0m: hit error(pod "azurefile-volume-tester-gbrmv" failed with status: {Phase:Failed Conditions:[{Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-21 04:09:57 +0000 UTC Reason: Message:} {Type:Ready Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-21 04:09:57 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [volume-tester]} {Type:ContainersReady Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-21 04:09:57 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [volume-tester]} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-21 04:09:57 +0000 UTC Reason: Message:}] Message: Reason: NominatedNodeName: HostIP:10.1.0.4 PodIP:192.168.221.196 PodIPs:[{IP:192.168.221.196}] StartTime:2022-04-21 04:09:57 +0000 UTC InitContainerStatuses:[] ContainerStatuses:[{Name:volume-tester State:{Waiting:&ContainerStateWaiting{Reason:RunContainerError,Message:context deadline exceeded,} Running:nil Terminated:nil} LastTerminationState:{Waiting:nil Running:nil Terminated:&ContainerStateTerminated{ExitCode:0,Signal:0,Reason:,Message:,StartedAt:0001-01-01 00:00:00 +0000 UTC,FinishedAt:0001-01-01 00:00:00 +0000 UTC,ContainerID:containerd://f34405ec9383d0af41d58d7872f41f77552f5abf44015d252db39d21336e3014,}} Ready:false RestartCount:0 Image:mcr.microsoft.com/windows/servercore:ltsc2022 ImageID:mcr.microsoft.com/windows/servercore@sha256:378d85bd8e7388a777d25009f8523d1e95a5f544f131eaada83171045d5b2c1e ContainerID:containerd://f34405ec9383d0af41d58d7872f41f77552f5abf44015d252db39d21336e3014 Started:0xc00094ed38}] QOSClass:BestEffort EphemeralContainerStatuses:[]}) in first run, give another try Apr 21 04:18:46.291: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-gbrmv" in namespace "azurefile-2540" to be "Succeeded or Failed" Apr 21 04:18:46.325: INFO: Pod "azurefile-volume-tester-gbrmv": Phase="Failed", Reason="", readiness=false. Elapsed: 34.11247ms Apr 21 04:18:46.325: INFO: deleting Pod "azurefile-2540"/"azurefile-volume-tester-gbrmv" Apr 21 04:18:46.380: INFO: Pod azurefile-volume-tester-gbrmv has the following logs: [1mSTEP[0m: Deleting pod azurefile-volume-tester-gbrmv in namespace azurefile-2540 Apr 21 04:18:46.421: INFO: deleting PVC "azurefile-2540"/"pvc-cjj7x" Apr 21 04:18:46.421: INFO: Deleting PersistentVolumeClaim "pvc-cjj7x" [1mSTEP[0m: waiting for claim's PV "pvc-219b8c3b-f4c9-487c-8501-35d9ce960c97" to be deleted ... skipping 6 lines ... [1mSTEP[0m: Collecting events from namespace "azurefile-2540". [1mSTEP[0m: Found 12 events. Apr 21 04:18:51.690: INFO: At 2022-04-21 04:08:19 +0000 UTC - event for pvc-cjj7x: {file.csi.azure.com_capz-wu3n7j-md-0-h5bx4_0a16be51-4249-4c6c-b9e2-1d8032487f87 } Provisioning: External provisioner is provisioning volume for claim "azurefile-2540/pvc-cjj7x" Apr 21 04:18:51.690: INFO: At 2022-04-21 04:08:19 +0000 UTC - event for pvc-cjj7x: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "file.csi.azure.com" or manually created by system administrator Apr 21 04:18:51.690: INFO: At 2022-04-21 04:09:55 +0000 UTC - event for pvc-cjj7x: {file.csi.azure.com_capz-wu3n7j-md-0-h5bx4_0a16be51-4249-4c6c-b9e2-1d8032487f87 } ProvisioningSucceeded: Successfully provisioned volume pvc-219b8c3b-f4c9-487c-8501-35d9ce960c97 Apr 21 04:18:51.690: INFO: At 2022-04-21 04:09:57 +0000 UTC - event for azurefile-volume-tester-gbrmv: {default-scheduler } Scheduled: Successfully assigned azurefile-2540/azurefile-volume-tester-gbrmv to capz-wu3n-6ctgs Apr 21 04:18:51.690: INFO: At 2022-04-21 04:09:57 +0000 UTC - event for azurefile-volume-tester-gbrmv: {kubelet capz-wu3n-6ctgs} FailedMount: MountVolume.MountDevice failed for volume "pvc-219b8c3b-f4c9-487c-8501-35d9ce960c97" : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name file.csi.azure.com not found in the list of registered CSI drivers Apr 21 04:18:51.690: INFO: At 2022-04-21 04:11:13 +0000 UTC - event for azurefile-volume-tester-gbrmv: {kubelet capz-wu3n-6ctgs} Pulling: Pulling image "mcr.microsoft.com/windows/servercore:ltsc2022" Apr 21 04:18:51.690: INFO: At 2022-04-21 04:16:44 +0000 UTC - event for azurefile-volume-tester-gbrmv: {kubelet capz-wu3n-6ctgs} Pulled: Successfully pulled image "mcr.microsoft.com/windows/servercore:ltsc2022" in 5m30.633751s Apr 21 04:18:51.690: INFO: At 2022-04-21 04:16:44 +0000 UTC - event for azurefile-volume-tester-gbrmv: {kubelet capz-wu3n-6ctgs} Created: Created container volume-tester Apr 21 04:18:51.690: INFO: At 2022-04-21 04:18:44 +0000 UTC - event for azurefile-volume-tester-gbrmv: {kubelet capz-wu3n-6ctgs} Pulled: Container image "mcr.microsoft.com/windows/servercore:ltsc2022" already present on machine Apr 21 04:18:51.690: INFO: At 2022-04-21 04:18:44 +0000 UTC - event for azurefile-volume-tester-gbrmv: {kubelet capz-wu3n-6ctgs} Failed: Error: context deadline exceeded Apr 21 04:18:51.690: INFO: At 2022-04-21 04:18:50 +0000 UTC - event for azurefile-volume-tester-gbrmv: {kubelet capz-wu3n-6ctgs} Started: Started container volume-tester Apr 21 04:18:51.690: INFO: At 2022-04-21 04:18:50 +0000 UTC - event for azurefile-volume-tester-gbrmv: {kubelet capz-wu3n-6ctgs} Killing: Stopping container volume-tester Apr 21 04:18:51.722: INFO: POD NODE PHASE GRACE CONDITIONS Apr 21 04:18:51.722: INFO: Apr 21 04:18:51.766: INFO: Logging node info for node capz-wu3n-6ctgs ... skipping 114 lines ... [91m[1m• Failure [634.527 seconds][0m Dynamic Provisioning [90m/home/prow/go/src/sigs.k8s.io/azurefile-csi-driver/test/e2e/dynamic_provisioning_test.go:42[0m [91m[1mshould create a volume on demand with mount options [kubernetes.io/azure-file] [file.csi.azure.com] [Windows] [It][0m [90m/home/prow/go/src/sigs.k8s.io/azurefile-csi-driver/test/e2e/dynamic_provisioning_test.go:104[0m [91mUnexpected error: <*errors.errorString | 0xc000518c30>: { s: "pod \"azurefile-volume-tester-gbrmv\" failed with status: {Phase:Failed Conditions:[{Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-21 04:09:57 +0000 UTC Reason: Message:} {Type:Ready Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-21 04:09:57 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [volume-tester]} {Type:ContainersReady Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-21 04:09:57 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [volume-tester]} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-21 04:09:57 +0000 UTC Reason: Message:}] Message: Reason: NominatedNodeName: HostIP:10.1.0.4 PodIP:192.168.221.196 PodIPs:[{IP:192.168.221.196}] StartTime:2022-04-21 04:09:57 +0000 UTC InitContainerStatuses:[] ContainerStatuses:[{Name:volume-tester State:{Waiting:&ContainerStateWaiting{Reason:RunContainerError,Message:context deadline exceeded,} Running:nil Terminated:nil} LastTerminationState:{Waiting:nil Running:nil Terminated:&ContainerStateTerminated{ExitCode:0,Signal:0,Reason:,Message:,StartedAt:0001-01-01 00:00:00 +0000 UTC,FinishedAt:0001-01-01 00:00:00 +0000 UTC,ContainerID:containerd://f34405ec9383d0af41d58d7872f41f77552f5abf44015d252db39d21336e3014,}} Ready:false RestartCount:0 Image:mcr.microsoft.com/windows/servercore:ltsc2022 ImageID:mcr.microsoft.com/windows/servercore@sha256:378d85bd8e7388a777d25009f8523d1e95a5f544f131eaada83171045d5b2c1e ContainerID:containerd://f34405ec9383d0af41d58d7872f41f77552f5abf44015d252db39d21336e3014 Started:0xc00094f2a8}] QOSClass:BestEffort EphemeralContainerStatuses:[]}", } pod "azurefile-volume-tester-gbrmv" failed with status: {Phase:Failed Conditions:[{Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-21 04:09:57 +0000 UTC Reason: Message:} {Type:Ready Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-21 04:09:57 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [volume-tester]} {Type:ContainersReady Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-21 04:09:57 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [volume-tester]} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-21 04:09:57 +0000 UTC Reason: Message:}] Message: Reason: NominatedNodeName: HostIP:10.1.0.4 PodIP:192.168.221.196 PodIPs:[{IP:192.168.221.196}] StartTime:2022-04-21 04:09:57 +0000 UTC InitContainerStatuses:[] ContainerStatuses:[{Name:volume-tester State:{Waiting:&ContainerStateWaiting{Reason:RunContainerError,Message:context deadline exceeded,} Running:nil Terminated:nil} LastTerminationState:{Waiting:nil Running:nil Terminated:&ContainerStateTerminated{ExitCode:0,Signal:0,Reason:,Message:,StartedAt:0001-01-01 00:00:00 +0000 UTC,FinishedAt:0001-01-01 00:00:00 +0000 UTC,ContainerID:containerd://f34405ec9383d0af41d58d7872f41f77552f5abf44015d252db39d21336e3014,}} Ready:false RestartCount:0 Image:mcr.microsoft.com/windows/servercore:ltsc2022 ImageID:mcr.microsoft.com/windows/servercore@sha256:378d85bd8e7388a777d25009f8523d1e95a5f544f131eaada83171045d5b2c1e ContainerID:containerd://f34405ec9383d0af41d58d7872f41f77552f5abf44015d252db39d21336e3014 Started:0xc00094f2a8}] QOSClass:BestEffort EphemeralContainerStatuses:[]} occurred[0m /home/prow/go/src/sigs.k8s.io/azurefile-csi-driver/test/e2e/testsuites/testsuites.go:691 [90m------------------------------[0m [0mDynamic Provisioning[0m [1mshould create a pod with volume mount subpath [file.csi.azure.com] [Windows][0m ... skipping 26 lines ... Apr 21 04:19:12.596: INFO: PersistentVolumeClaim pvc-nj8bq found but phase is Pending instead of Bound. Apr 21 04:19:14.630: INFO: PersistentVolumeClaim pvc-nj8bq found and phase=Bound (20.368058703s) [1mSTEP[0m: checking the PVC [1mSTEP[0m: validating provisioned PV [1mSTEP[0m: checking the PV [1mSTEP[0m: deploying the pod [1mSTEP[0m: checking that the pods command exits with no error Apr 21 04:19:14.729: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-26v4k" in namespace "azurefile-4728" to be "Succeeded or Failed" Apr 21 04:19:14.762: INFO: Pod "azurefile-volume-tester-26v4k": Phase="Pending", Reason="", readiness=false. Elapsed: 33.013778ms Apr 21 04:19:16.795: INFO: Pod "azurefile-volume-tester-26v4k": Phase="Pending", Reason="", readiness=false. Elapsed: 2.066218704s Apr 21 04:19:18.828: INFO: Pod "azurefile-volume-tester-26v4k": Phase="Pending", Reason="", readiness=false. Elapsed: 4.098884262s Apr 21 04:19:20.863: INFO: Pod "azurefile-volume-tester-26v4k": Phase="Pending", Reason="", readiness=false. Elapsed: 6.13380637s Apr 21 04:19:22.897: INFO: Pod "azurefile-volume-tester-26v4k": Phase="Pending", Reason="", readiness=false. Elapsed: 8.168160178s Apr 21 04:19:24.931: INFO: Pod "azurefile-volume-tester-26v4k": Phase="Pending", Reason="", readiness=false. Elapsed: 10.202426431s ... skipping 3 lines ... Apr 21 04:19:33.066: INFO: Pod "azurefile-volume-tester-26v4k": Phase="Running", Reason="", readiness=true. Elapsed: 18.33705021s Apr 21 04:19:35.102: INFO: Pod "azurefile-volume-tester-26v4k": Phase="Running", Reason="", readiness=true. Elapsed: 20.373333328s Apr 21 04:19:37.137: INFO: Pod "azurefile-volume-tester-26v4k": Phase="Running", Reason="", readiness=true. Elapsed: 22.407706071s Apr 21 04:19:39.170: INFO: Pod "azurefile-volume-tester-26v4k": Phase="Running", Reason="", readiness=true. Elapsed: 24.441142663s Apr 21 04:19:41.206: INFO: Pod "azurefile-volume-tester-26v4k": Phase="Succeeded", Reason="", readiness=false. Elapsed: 26.476805778s [1mSTEP[0m: Saw pod success Apr 21 04:19:41.206: INFO: Pod "azurefile-volume-tester-26v4k" satisfied condition "Succeeded or Failed" Apr 21 04:19:41.206: INFO: deleting Pod "azurefile-4728"/"azurefile-volume-tester-26v4k" Apr 21 04:19:41.247: INFO: Pod azurefile-volume-tester-26v4k has the following logs: hello world [1mSTEP[0m: Deleting pod azurefile-volume-tester-26v4k in namespace azurefile-4728 Apr 21 04:19:41.296: INFO: deleting PVC "azurefile-4728"/"pvc-nj8bq" Apr 21 04:19:41.296: INFO: Deleting PersistentVolumeClaim "pvc-nj8bq" ... skipping 117 lines ... Apr 21 04:20:51.395: INFO: PersistentVolumeClaim pvc-d9cln found but phase is Pending instead of Bound. Apr 21 04:20:53.428: INFO: PersistentVolumeClaim pvc-d9cln found and phase=Bound (22.407851056s) [1mSTEP[0m: checking the PVC [1mSTEP[0m: validating provisioned PV [1mSTEP[0m: checking the PV [1mSTEP[0m: deploying the pod [1mSTEP[0m: checking that the pods command exits with an error Apr 21 04:20:53.527: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-2vnhv" in namespace "azurefile-2790" to be "Error status code" Apr 21 04:20:53.584: INFO: Pod "azurefile-volume-tester-2vnhv": Phase="Pending", Reason="", readiness=false. Elapsed: 56.794836ms Apr 21 04:20:55.619: INFO: Pod "azurefile-volume-tester-2vnhv": Phase="Pending", Reason="", readiness=false. Elapsed: 2.09243629s Apr 21 04:20:57.699: INFO: Pod "azurefile-volume-tester-2vnhv": Phase="Pending", Reason="", readiness=false. Elapsed: 4.172539714s Apr 21 04:20:59.734: INFO: Pod "azurefile-volume-tester-2vnhv": Phase="Pending", Reason="", readiness=false. Elapsed: 6.207604107s Apr 21 04:21:01.769: INFO: Pod "azurefile-volume-tester-2vnhv": Phase="Pending", Reason="", readiness=false. Elapsed: 8.242138006s Apr 21 04:21:03.803: INFO: Pod "azurefile-volume-tester-2vnhv": Phase="Pending", Reason="", readiness=false. Elapsed: 10.27596431s Apr 21 04:21:05.837: INFO: Pod "azurefile-volume-tester-2vnhv": Phase="Pending", Reason="", readiness=false. Elapsed: 12.310284156s Apr 21 04:21:07.872: INFO: Pod "azurefile-volume-tester-2vnhv": Phase="Running", Reason="", readiness=true. Elapsed: 14.345015117s Apr 21 04:21:09.906: INFO: Pod "azurefile-volume-tester-2vnhv": Phase="Running", Reason="", readiness=true. Elapsed: 16.379416624s Apr 21 04:21:11.940: INFO: Pod "azurefile-volume-tester-2vnhv": Phase="Running", Reason="", readiness=true. Elapsed: 18.413385538s Apr 21 04:21:13.974: INFO: Pod "azurefile-volume-tester-2vnhv": Phase="Running", Reason="", readiness=true. Elapsed: 20.447599166s Apr 21 04:21:16.011: INFO: Pod "azurefile-volume-tester-2vnhv": Phase="Failed", Reason="", readiness=false. Elapsed: 22.484386661s [1mSTEP[0m: Saw pod failure Apr 21 04:21:16.011: INFO: Pod "azurefile-volume-tester-2vnhv" satisfied condition "Error status code" [1mSTEP[0m: checking that pod logs contain expected message Apr 21 04:21:16.057: INFO: deleting Pod "azurefile-2790"/"azurefile-volume-tester-2vnhv" Apr 21 04:21:16.094: INFO: Pod azurefile-volume-tester-2vnhv has the following logs: out-file : Access to the path 'C:\mnt\test-1\data' is denied. At line:1 char:1 + echo $null >> C:\mnt\test-1\data + ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ... skipping 201 lines ... Apr 21 04:22:37.189: INFO: PersistentVolumeClaim pvc-979hj found but phase is Pending instead of Bound. Apr 21 04:22:39.223: INFO: PersistentVolumeClaim pvc-979hj found and phase=Bound (2.065786494s) [1mSTEP[0m: checking the PVC [1mSTEP[0m: validating provisioned PV [1mSTEP[0m: checking the PV [1mSTEP[0m: deploying the pod [1mSTEP[0m: checking that the pods command exits with no error Apr 21 04:22:39.323: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-fm828" in namespace "azurefile-4538" to be "Succeeded or Failed" Apr 21 04:22:39.359: INFO: Pod "azurefile-volume-tester-fm828": Phase="Pending", Reason="", readiness=false. Elapsed: 35.800817ms Apr 21 04:22:41.396: INFO: Pod "azurefile-volume-tester-fm828": Phase="Pending", Reason="", readiness=false. Elapsed: 2.073356039s Apr 21 04:22:43.430: INFO: Pod "azurefile-volume-tester-fm828": Phase="Pending", Reason="", readiness=false. Elapsed: 4.10672579s Apr 21 04:22:45.463: INFO: Pod "azurefile-volume-tester-fm828": Phase="Pending", Reason="", readiness=false. Elapsed: 6.140553505s Apr 21 04:22:47.499: INFO: Pod "azurefile-volume-tester-fm828": Phase="Pending", Reason="", readiness=false. Elapsed: 8.175850614s Apr 21 04:22:49.533: INFO: Pod "azurefile-volume-tester-fm828": Phase="Pending", Reason="", readiness=false. Elapsed: 10.210022951s Apr 21 04:22:51.567: INFO: Pod "azurefile-volume-tester-fm828": Phase="Pending", Reason="", readiness=false. Elapsed: 12.243625705s Apr 21 04:22:53.602: INFO: Pod "azurefile-volume-tester-fm828": Phase="Running", Reason="", readiness=true. Elapsed: 14.279166276s Apr 21 04:22:55.636: INFO: Pod "azurefile-volume-tester-fm828": Phase="Running", Reason="", readiness=true. Elapsed: 16.313217808s Apr 21 04:22:57.674: INFO: Pod "azurefile-volume-tester-fm828": Phase="Running", Reason="", readiness=true. Elapsed: 18.35118668s Apr 21 04:22:59.707: INFO: Pod "azurefile-volume-tester-fm828": Phase="Succeeded", Reason="", readiness=false. Elapsed: 20.384441185s [1mSTEP[0m: Saw pod success Apr 21 04:22:59.707: INFO: Pod "azurefile-volume-tester-fm828" satisfied condition "Succeeded or Failed" [1mSTEP[0m: resizing the pvc [1mSTEP[0m: sleep 30s waiting for resize complete [1mSTEP[0m: checking the resizing result [1mSTEP[0m: checking the resizing PV result [1mSTEP[0m: checking the resizing azurefile result Apr 21 04:23:30.285: INFO: deleting Pod "azurefile-4538"/"azurefile-volume-tester-fm828" ... skipping 303 lines ... Apr 21 04:23:51.861: INFO: PersistentVolumeClaim pvc-mb6vx found but phase is Pending instead of Bound. Apr 21 04:23:53.899: INFO: PersistentVolumeClaim pvc-mb6vx found and phase=Bound (2.072057718s) [1mSTEP[0m: checking the PVC [1mSTEP[0m: validating provisioned PV [1mSTEP[0m: checking the PV [1mSTEP[0m: deploying the pod [1mSTEP[0m: checking that the pods command exits with no error Apr 21 04:23:53.997: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-kqpc6" in namespace "azurefile-7726" to be "Succeeded or Failed" Apr 21 04:23:54.031: INFO: Pod "azurefile-volume-tester-kqpc6": Phase="Pending", Reason="", readiness=false. Elapsed: 34.097737ms Apr 21 04:23:56.067: INFO: Pod "azurefile-volume-tester-kqpc6": Phase="Pending", Reason="", readiness=false. Elapsed: 2.069485119s Apr 21 04:23:58.101: INFO: Pod "azurefile-volume-tester-kqpc6": Phase="Pending", Reason="", readiness=false. Elapsed: 4.104169485s Apr 21 04:24:00.136: INFO: Pod "azurefile-volume-tester-kqpc6": Phase="Pending", Reason="", readiness=false. Elapsed: 6.138529553s Apr 21 04:24:02.170: INFO: Pod "azurefile-volume-tester-kqpc6": Phase="Pending", Reason="", readiness=false. Elapsed: 8.172388939s Apr 21 04:24:04.204: INFO: Pod "azurefile-volume-tester-kqpc6": Phase="Pending", Reason="", readiness=false. Elapsed: 10.206700268s ... skipping 3 lines ... Apr 21 04:24:12.342: INFO: Pod "azurefile-volume-tester-kqpc6": Phase="Running", Reason="", readiness=true. Elapsed: 18.345219843s Apr 21 04:24:14.377: INFO: Pod "azurefile-volume-tester-kqpc6": Phase="Running", Reason="", readiness=true. Elapsed: 20.379576985s Apr 21 04:24:16.413: INFO: Pod "azurefile-volume-tester-kqpc6": Phase="Running", Reason="", readiness=true. Elapsed: 22.415612273s Apr 21 04:24:18.447: INFO: Pod "azurefile-volume-tester-kqpc6": Phase="Running", Reason="", readiness=true. Elapsed: 24.449404413s Apr 21 04:24:20.480: INFO: Pod "azurefile-volume-tester-kqpc6": Phase="Succeeded", Reason="", readiness=false. Elapsed: 26.483228422s [1mSTEP[0m: Saw pod success Apr 21 04:24:20.481: INFO: Pod "azurefile-volume-tester-kqpc6" satisfied condition "Succeeded or Failed" Apr 21 04:24:20.481: INFO: deleting Pod "azurefile-7726"/"azurefile-volume-tester-kqpc6" Apr 21 04:24:20.555: INFO: Pod azurefile-volume-tester-kqpc6 has the following logs: hello world [1mSTEP[0m: Deleting pod azurefile-volume-tester-kqpc6 in namespace azurefile-7726 Apr 21 04:24:20.601: INFO: deleting PVC "azurefile-7726"/"pvc-mb6vx" Apr 21 04:24:20.601: INFO: Deleting PersistentVolumeClaim "pvc-mb6vx" ... skipping 96 lines ... check the driver pods if restarts ... ====================================================================================== 2022/04/21 04:24:53 Check successfully Apr 21 04:24:53.216: INFO: >>> kubeConfig: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig 2022/04/21 04:24:53 run script: test/utils/get_storage_account_secret_name.sh 2022/04/21 04:24:53 got output: azure-storage-account-fe0adf6af95b24b319cea4d-secret , error: <nil> 2022/04/21 04:24:53 got storage account secret name: azure-storage-account-fe0adf6af95b24b319cea4d-secret [1mSTEP[0m: setting up the StorageClass [1mSTEP[0m: creating a StorageClass [1mSTEP[0m: setting up the PVC and PV [1mSTEP[0m: creating a PVC [1mSTEP[0m: waiting for PVC to be in phase "Bound" Apr 21 04:24:53.519: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-kf4f9] to have phase Bound Apr 21 04:24:53.550: INFO: PersistentVolumeClaim pvc-kf4f9 found but phase is Pending instead of Bound. Apr 21 04:24:55.582: INFO: PersistentVolumeClaim pvc-kf4f9 found and phase=Bound (2.063482733s) [1mSTEP[0m: checking the PVC [1mSTEP[0m: validating provisioned PV [1mSTEP[0m: checking the PV [1mSTEP[0m: deploying the pod [1mSTEP[0m: checking that the pods command exits with no error Apr 21 04:24:55.682: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-6d64q" in namespace "azurefile-1387" to be "Succeeded or Failed" Apr 21 04:24:55.714: INFO: Pod "azurefile-volume-tester-6d64q": Phase="Pending", Reason="", readiness=false. Elapsed: 32.258468ms Apr 21 04:24:57.757: INFO: Pod "azurefile-volume-tester-6d64q": Phase="Pending", Reason="", readiness=false. Elapsed: 2.075040415s Apr 21 04:24:59.791: INFO: Pod "azurefile-volume-tester-6d64q": Phase="Pending", Reason="", readiness=false. Elapsed: 4.1089613s Apr 21 04:25:01.825: INFO: Pod "azurefile-volume-tester-6d64q": Phase="Pending", Reason="", readiness=false. Elapsed: 6.142916784s Apr 21 04:25:03.861: INFO: Pod "azurefile-volume-tester-6d64q": Phase="Pending", Reason="", readiness=false. Elapsed: 8.178977424s Apr 21 04:25:05.897: INFO: Pod "azurefile-volume-tester-6d64q": Phase="Pending", Reason="", readiness=false. Elapsed: 10.214363194s Apr 21 04:25:07.930: INFO: Pod "azurefile-volume-tester-6d64q": Phase="Pending", Reason="", readiness=false. Elapsed: 12.247773822s Apr 21 04:25:09.965: INFO: Pod "azurefile-volume-tester-6d64q": Phase="Running", Reason="", readiness=true. Elapsed: 14.282752682s Apr 21 04:25:11.998: INFO: Pod "azurefile-volume-tester-6d64q": Phase="Running", Reason="", readiness=true. Elapsed: 16.315620917s Apr 21 04:25:14.031: INFO: Pod "azurefile-volume-tester-6d64q": Phase="Running", Reason="", readiness=true. Elapsed: 18.349059766s Apr 21 04:25:16.064: INFO: Pod "azurefile-volume-tester-6d64q": Phase="Succeeded", Reason="", readiness=false. Elapsed: 20.381606696s [1mSTEP[0m: Saw pod success Apr 21 04:25:16.064: INFO: Pod "azurefile-volume-tester-6d64q" satisfied condition "Succeeded or Failed" Apr 21 04:25:16.064: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-6d64q" in namespace "azurefile-1387" to be "Succeeded or Failed" Apr 21 04:25:16.096: INFO: Pod "azurefile-volume-tester-6d64q": Phase="Succeeded", Reason="", readiness=false. Elapsed: 32.262166ms [1mSTEP[0m: Saw pod success Apr 21 04:25:16.096: INFO: Pod "azurefile-volume-tester-6d64q" satisfied condition "Succeeded or Failed" Apr 21 04:25:16.096: INFO: deleting Pod "azurefile-1387"/"azurefile-volume-tester-6d64q" Apr 21 04:25:16.143: INFO: Pod azurefile-volume-tester-6d64q has the following logs: hello world [1mSTEP[0m: Deleting pod azurefile-volume-tester-6d64q in namespace azurefile-1387 Apr 21 04:25:16.189: INFO: deleting PVC "azurefile-1387"/"pvc-kf4f9" Apr 21 04:25:16.189: INFO: Deleting PersistentVolumeClaim "pvc-kf4f9" ... skipping 44 lines ... Apr 21 04:25:40.453: INFO: PersistentVolumeClaim pvc-lbkkp found but phase is Pending instead of Bound. Apr 21 04:25:42.487: INFO: PersistentVolumeClaim pvc-lbkkp found and phase=Bound (20.36997564s) [1mSTEP[0m: checking the PVC [1mSTEP[0m: validating provisioned PV [1mSTEP[0m: checking the PV [1mSTEP[0m: deploying the pod [1mSTEP[0m: checking that the pods command exits with no error Apr 21 04:25:42.585: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-7jlfh" in namespace "azurefile-4547" to be "Succeeded or Failed" Apr 21 04:25:42.625: INFO: Pod "azurefile-volume-tester-7jlfh": Phase="Pending", Reason="", readiness=false. Elapsed: 40.136278ms Apr 21 04:25:44.657: INFO: Pod "azurefile-volume-tester-7jlfh": Phase="Pending", Reason="", readiness=false. Elapsed: 2.072750338s Apr 21 04:25:46.691: INFO: Pod "azurefile-volume-tester-7jlfh": Phase="Pending", Reason="", readiness=false. Elapsed: 4.106757279s Apr 21 04:25:48.724: INFO: Pod "azurefile-volume-tester-7jlfh": Phase="Pending", Reason="", readiness=false. Elapsed: 6.139649964s Apr 21 04:25:50.761: INFO: Pod "azurefile-volume-tester-7jlfh": Phase="Pending", Reason="", readiness=false. Elapsed: 8.175904576s Apr 21 04:25:52.794: INFO: Pod "azurefile-volume-tester-7jlfh": Phase="Pending", Reason="", readiness=false. Elapsed: 10.208975628s Apr 21 04:25:54.827: INFO: Pod "azurefile-volume-tester-7jlfh": Phase="Pending", Reason="", readiness=false. Elapsed: 12.242443863s Apr 21 04:25:56.862: INFO: Pod "azurefile-volume-tester-7jlfh": Phase="Running", Reason="", readiness=true. Elapsed: 14.277558668s Apr 21 04:25:58.895: INFO: Pod "azurefile-volume-tester-7jlfh": Phase="Running", Reason="", readiness=true. Elapsed: 16.310740277s Apr 21 04:26:00.930: INFO: Pod "azurefile-volume-tester-7jlfh": Phase="Running", Reason="", readiness=true. Elapsed: 18.345659666s Apr 21 04:26:02.964: INFO: Pod "azurefile-volume-tester-7jlfh": Phase="Succeeded", Reason="", readiness=false. Elapsed: 20.379182894s [1mSTEP[0m: Saw pod success Apr 21 04:26:02.964: INFO: Pod "azurefile-volume-tester-7jlfh" satisfied condition "Succeeded or Failed" Apr 21 04:26:02.964: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-7jlfh" in namespace "azurefile-4547" to be "Succeeded or Failed" Apr 21 04:26:02.998: INFO: Pod "azurefile-volume-tester-7jlfh": Phase="Succeeded", Reason="", readiness=false. Elapsed: 34.511498ms [1mSTEP[0m: Saw pod success Apr 21 04:26:02.998: INFO: Pod "azurefile-volume-tester-7jlfh" satisfied condition "Succeeded or Failed" Apr 21 04:26:02.998: INFO: deleting Pod "azurefile-4547"/"azurefile-volume-tester-7jlfh" Apr 21 04:26:03.041: INFO: Pod azurefile-volume-tester-7jlfh has the following logs: hello world [1mSTEP[0m: Deleting pod azurefile-volume-tester-7jlfh in namespace azurefile-4547 Apr 21 04:26:03.085: INFO: deleting PVC "azurefile-4547"/"pvc-lbkkp" Apr 21 04:26:03.085: INFO: Deleting PersistentVolumeClaim "pvc-lbkkp" ... skipping 75 lines ... check the driver pods if restarts ... ====================================================================================== 2022/04/21 04:27:28 Check successfully Apr 21 04:27:28.082: INFO: >>> kubeConfig: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig 2022/04/21 04:27:28 run script: test/utils/get_storage_account_secret_name.sh 2022/04/21 04:27:28 got output: azure-storage-account-fe0adf6af95b24b319cea4d-secret , error: <nil> 2022/04/21 04:27:28 got storage account secret name: azure-storage-account-fe0adf6af95b24b319cea4d-secret [1mSTEP[0m: Successfully provisioned AzureFile volume: "capz-wu3n7j#fe0adf6af95b24b319cea4d#csi-inline-smb-volume##csi-inline-smb-volume" [1mSTEP[0m: deploying the pod [1mSTEP[0m: checking that the pods command exits with no error Apr 21 04:27:29.277: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-77g67" in namespace "azurefile-4801" to be "Succeeded or Failed" Apr 21 04:27:29.309: INFO: Pod "azurefile-volume-tester-77g67": Phase="Pending", Reason="", readiness=false. Elapsed: 31.557424ms Apr 21 04:27:31.343: INFO: Pod "azurefile-volume-tester-77g67": Phase="Pending", Reason="", readiness=false. Elapsed: 2.066155731s Apr 21 04:27:33.377: INFO: Pod "azurefile-volume-tester-77g67": Phase="Pending", Reason="", readiness=false. Elapsed: 4.100094562s Apr 21 04:27:35.411: INFO: Pod "azurefile-volume-tester-77g67": Phase="Pending", Reason="", readiness=false. Elapsed: 6.133625349s Apr 21 04:27:37.447: INFO: Pod "azurefile-volume-tester-77g67": Phase="Pending", Reason="", readiness=false. Elapsed: 8.169530153s Apr 21 04:27:39.480: INFO: Pod "azurefile-volume-tester-77g67": Phase="Pending", Reason="", readiness=false. Elapsed: 10.203343952s Apr 21 04:27:41.516: INFO: Pod "azurefile-volume-tester-77g67": Phase="Running", Reason="", readiness=true. Elapsed: 12.238569362s Apr 21 04:27:43.551: INFO: Pod "azurefile-volume-tester-77g67": Phase="Running", Reason="", readiness=true. Elapsed: 14.27363902s Apr 21 04:27:45.584: INFO: Pod "azurefile-volume-tester-77g67": Phase="Running", Reason="", readiness=true. Elapsed: 16.306811113s Apr 21 04:27:47.617: INFO: Pod "azurefile-volume-tester-77g67": Phase="Running", Reason="", readiness=true. Elapsed: 18.339874907s Apr 21 04:27:49.650: INFO: Pod "azurefile-volume-tester-77g67": Phase="Succeeded", Reason="", readiness=false. Elapsed: 20.37299929s [1mSTEP[0m: Saw pod success Apr 21 04:27:49.650: INFO: Pod "azurefile-volume-tester-77g67" satisfied condition "Succeeded or Failed" Apr 21 04:27:49.650: INFO: deleting Pod "azurefile-4801"/"azurefile-volume-tester-77g67" Apr 21 04:27:49.692: INFO: Pod azurefile-volume-tester-77g67 has the following logs: hello world [1mSTEP[0m: Deleting pod azurefile-volume-tester-77g67 in namespace azurefile-4801 Apr 21 04:27:49.732: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [1mSTEP[0m: Destroying namespace "azurefile-4801" for this suite. ... skipping 43 lines ... ====================================================================================== 2022/04/21 04:27:50 Check successfully Apr 21 04:27:50.891: INFO: >>> kubeConfig: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [1mSTEP[0m: creating secret smbcreds in namespace azurefile-1166 2022/04/21 04:27:50 run script: test/utils/get_smb_svc_public_ip.sh 2022/04/21 04:27:51 got output: 52.226.207.196 , error: <nil> 2022/04/21 04:27:51 use server on Windows: 52.226.207.196 [1mSTEP[0m: deploying the pod [1mSTEP[0m: checking that the pods command exits with no error Apr 21 04:27:51.181: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-rjh6m" in namespace "azurefile-1166" to be "Succeeded or Failed" Apr 21 04:27:51.213: INFO: Pod "azurefile-volume-tester-rjh6m": Phase="Pending", Reason="", readiness=false. Elapsed: 31.381225ms Apr 21 04:27:53.247: INFO: Pod "azurefile-volume-tester-rjh6m": Phase="Pending", Reason="", readiness=false. Elapsed: 2.065074407s Apr 21 04:27:55.282: INFO: Pod "azurefile-volume-tester-rjh6m": Phase="Pending", Reason="", readiness=false. Elapsed: 4.100577102s Apr 21 04:27:57.316: INFO: Pod "azurefile-volume-tester-rjh6m": Phase="Pending", Reason="", readiness=false. Elapsed: 6.134681164s Apr 21 04:27:59.350: INFO: Pod "azurefile-volume-tester-rjh6m": Phase="Pending", Reason="", readiness=false. Elapsed: 8.168862474s Apr 21 04:28:01.384: INFO: Pod "azurefile-volume-tester-rjh6m": Phase="Pending", Reason="", readiness=false. Elapsed: 10.202208671s Apr 21 04:28:03.419: INFO: Pod "azurefile-volume-tester-rjh6m": Phase="Pending", Reason="", readiness=false. Elapsed: 12.237339762s Apr 21 04:28:05.453: INFO: Pod "azurefile-volume-tester-rjh6m": Phase="Running", Reason="", readiness=true. Elapsed: 14.27198264s Apr 21 04:28:07.487: INFO: Pod "azurefile-volume-tester-rjh6m": Phase="Running", Reason="", readiness=true. Elapsed: 16.305854306s Apr 21 04:28:09.521: INFO: Pod "azurefile-volume-tester-rjh6m": Phase="Running", Reason="", readiness=true. Elapsed: 18.339760092s Apr 21 04:28:11.557: INFO: Pod "azurefile-volume-tester-rjh6m": Phase="Succeeded", Reason="", readiness=false. Elapsed: 20.375346909s [1mSTEP[0m: Saw pod success Apr 21 04:28:11.557: INFO: Pod "azurefile-volume-tester-rjh6m" satisfied condition "Succeeded or Failed" Apr 21 04:28:11.557: INFO: deleting Pod "azurefile-1166"/"azurefile-volume-tester-rjh6m" Apr 21 04:28:11.599: INFO: Pod azurefile-volume-tester-rjh6m has the following logs: hello world [1mSTEP[0m: Deleting pod azurefile-volume-tester-rjh6m in namespace azurefile-1166 Apr 21 04:28:11.643: INFO: deleting Secret smbcreds Apr 21 04:28:11.676: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready ... skipping 132 lines ... Apr 21 04:28:35.112: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-wxkns] to have phase Bound Apr 21 04:28:35.145: INFO: PersistentVolumeClaim pvc-wxkns found and phase=Bound (32.627416ms) [1mSTEP[0m: checking the PVC [1mSTEP[0m: validating provisioned PV [1mSTEP[0m: checking the PV [1mSTEP[0m: deploying the pod [1mSTEP[0m: checking that the pods command exits with an error Apr 21 04:28:35.244: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-l2rfx" in namespace "azurefile-5320" to be "Error status code" Apr 21 04:28:35.276: INFO: Pod "azurefile-volume-tester-l2rfx": Phase="Pending", Reason="", readiness=false. Elapsed: 31.405826ms Apr 21 04:28:37.311: INFO: Pod "azurefile-volume-tester-l2rfx": Phase="Pending", Reason="", readiness=false. Elapsed: 2.066324146s Apr 21 04:28:39.345: INFO: Pod "azurefile-volume-tester-l2rfx": Phase="Pending", Reason="", readiness=false. Elapsed: 4.100263519s Apr 21 04:28:41.380: INFO: Pod "azurefile-volume-tester-l2rfx": Phase="Pending", Reason="", readiness=false. Elapsed: 6.135773666s Apr 21 04:28:43.414: INFO: Pod "azurefile-volume-tester-l2rfx": Phase="Pending", Reason="", readiness=false. Elapsed: 8.169632051s Apr 21 04:28:45.449: INFO: Pod "azurefile-volume-tester-l2rfx": Phase="Pending", Reason="", readiness=false. Elapsed: 10.204053679s Apr 21 04:28:47.485: INFO: Pod "azurefile-volume-tester-l2rfx": Phase="Pending", Reason="", readiness=false. Elapsed: 12.240229313s Apr 21 04:28:49.519: INFO: Pod "azurefile-volume-tester-l2rfx": Phase="Pending", Reason="", readiness=false. Elapsed: 14.274909744s Apr 21 04:28:51.553: INFO: Pod "azurefile-volume-tester-l2rfx": Phase="Running", Reason="", readiness=true. Elapsed: 16.30810796s Apr 21 04:28:53.588: INFO: Pod "azurefile-volume-tester-l2rfx": Phase="Running", Reason="", readiness=true. Elapsed: 18.343839209s Apr 21 04:28:55.623: INFO: Pod "azurefile-volume-tester-l2rfx": Phase="Running", Reason="", readiness=true. Elapsed: 20.378525086s Apr 21 04:28:57.658: INFO: Pod "azurefile-volume-tester-l2rfx": Phase="Failed", Reason="", readiness=false. Elapsed: 22.413711572s [1mSTEP[0m: Saw pod failure Apr 21 04:28:57.658: INFO: Pod "azurefile-volume-tester-l2rfx" satisfied condition "Error status code" [1mSTEP[0m: checking that pod logs contain expected message Apr 21 04:28:57.712: INFO: deleting Pod "azurefile-5320"/"azurefile-volume-tester-l2rfx" Apr 21 04:28:57.757: INFO: Pod azurefile-volume-tester-l2rfx has the following logs: Out-File : Access to the path 'C:\mnt\test-1\data.txt' is denied. At line:1 char:22 + ... cho 'hello world' | Out-File -FilePath C:\mnt\test-1\data.txt; Get-Co ... + ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ... skipping 55 lines ... Apr 21 04:28:59.517: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-kdbzs] to have phase Bound Apr 21 04:28:59.549: INFO: PersistentVolumeClaim pvc-kdbzs found and phase=Bound (31.631332ms) [1mSTEP[0m: checking the PVC [1mSTEP[0m: validating provisioned PV [1mSTEP[0m: checking the PV [1mSTEP[0m: deploying the pod [1mSTEP[0m: checking that the pods command exits with no error Apr 21 04:28:59.645: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-thtp4" in namespace "azurefile-9103" to be "Succeeded or Failed" Apr 21 04:28:59.676: INFO: Pod "azurefile-volume-tester-thtp4": Phase="Pending", Reason="", readiness=false. Elapsed: 31.220566ms Apr 21 04:29:01.710: INFO: Pod "azurefile-volume-tester-thtp4": Phase="Pending", Reason="", readiness=false. Elapsed: 2.065039725s Apr 21 04:29:03.744: INFO: Pod "azurefile-volume-tester-thtp4": Phase="Pending", Reason="", readiness=false. Elapsed: 4.098994306s Apr 21 04:29:05.778: INFO: Pod "azurefile-volume-tester-thtp4": Phase="Pending", Reason="", readiness=false. Elapsed: 6.132645122s Apr 21 04:29:07.812: INFO: Pod "azurefile-volume-tester-thtp4": Phase="Pending", Reason="", readiness=false. Elapsed: 8.167201883s Apr 21 04:29:09.847: INFO: Pod "azurefile-volume-tester-thtp4": Phase="Pending", Reason="", readiness=false. Elapsed: 10.201538446s Apr 21 04:29:11.881: INFO: Pod "azurefile-volume-tester-thtp4": Phase="Pending", Reason="", readiness=false. Elapsed: 12.23565094s Apr 21 04:29:13.915: INFO: Pod "azurefile-volume-tester-thtp4": Phase="Running", Reason="", readiness=true. Elapsed: 14.270207324s Apr 21 04:29:15.951: INFO: Pod "azurefile-volume-tester-thtp4": Phase="Running", Reason="", readiness=true. Elapsed: 16.305935467s Apr 21 04:29:17.986: INFO: Pod "azurefile-volume-tester-thtp4": Phase="Running", Reason="", readiness=true. Elapsed: 18.340485034s Apr 21 04:29:20.019: INFO: Pod "azurefile-volume-tester-thtp4": Phase="Succeeded", Reason="", readiness=false. Elapsed: 20.374119584s [1mSTEP[0m: Saw pod success Apr 21 04:29:20.019: INFO: Pod "azurefile-volume-tester-thtp4" satisfied condition "Succeeded or Failed" [1mSTEP[0m: setting up the PV [1mSTEP[0m: creating a PV [1mSTEP[0m: setting up the PVC [1mSTEP[0m: creating a PVC [1mSTEP[0m: waiting for PVC to be in phase "Bound" Apr 21 04:29:20.092: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-g7lpv] to have phase Bound Apr 21 04:29:20.127: INFO: PersistentVolumeClaim pvc-g7lpv found and phase=Bound (35.266944ms) [1mSTEP[0m: checking the PVC [1mSTEP[0m: validating provisioned PV [1mSTEP[0m: checking the PV [1mSTEP[0m: deploying the pod [1mSTEP[0m: checking that the pods command exits with no error Apr 21 04:29:20.227: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-tdpwl" in namespace "azurefile-9103" to be "Succeeded or Failed" Apr 21 04:29:20.259: INFO: Pod "azurefile-volume-tester-tdpwl": Phase="Pending", Reason="", readiness=false. Elapsed: 31.746011ms Apr 21 04:29:22.294: INFO: Pod "azurefile-volume-tester-tdpwl": Phase="Pending", Reason="", readiness=false. Elapsed: 2.066703433s Apr 21 04:29:24.329: INFO: Pod "azurefile-volume-tester-tdpwl": Phase="Pending", Reason="", readiness=false. Elapsed: 4.102656642s Apr 21 04:29:26.365: INFO: Pod "azurefile-volume-tester-tdpwl": Phase="Pending", Reason="", readiness=false. Elapsed: 6.138268915s Apr 21 04:29:28.400: INFO: Pod "azurefile-volume-tester-tdpwl": Phase="Pending", Reason="", readiness=false. Elapsed: 8.173250316s Apr 21 04:29:30.434: INFO: Pod "azurefile-volume-tester-tdpwl": Phase="Pending", Reason="", readiness=false. Elapsed: 10.207385732s Apr 21 04:29:32.469: INFO: Pod "azurefile-volume-tester-tdpwl": Phase="Running", Reason="", readiness=true. Elapsed: 12.241995726s Apr 21 04:29:34.504: INFO: Pod "azurefile-volume-tester-tdpwl": Phase="Running", Reason="", readiness=true. Elapsed: 14.276794118s Apr 21 04:29:36.537: INFO: Pod "azurefile-volume-tester-tdpwl": Phase="Running", Reason="", readiness=true. Elapsed: 16.310469849s Apr 21 04:29:38.571: INFO: Pod "azurefile-volume-tester-tdpwl": Phase="Running", Reason="", readiness=true. Elapsed: 18.344454831s Apr 21 04:29:40.605: INFO: Pod "azurefile-volume-tester-tdpwl": Phase="Succeeded", Reason="", readiness=false. Elapsed: 20.378490996s [1mSTEP[0m: Saw pod success Apr 21 04:29:40.605: INFO: Pod "azurefile-volume-tester-tdpwl" satisfied condition "Succeeded or Failed" [1mSTEP[0m: setting up the PV [1mSTEP[0m: creating a PV [1mSTEP[0m: setting up the PVC [1mSTEP[0m: creating a PVC [1mSTEP[0m: waiting for PVC to be in phase "Bound" Apr 21 04:29:40.676: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-qs4cz] to have phase Bound Apr 21 04:29:40.708: INFO: PersistentVolumeClaim pvc-qs4cz found and phase=Bound (31.317972ms) [1mSTEP[0m: checking the PVC [1mSTEP[0m: validating provisioned PV [1mSTEP[0m: checking the PV [1mSTEP[0m: deploying the pod [1mSTEP[0m: checking that the pods command exits with no error Apr 21 04:29:40.814: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-nprwh" in namespace "azurefile-9103" to be "Succeeded or Failed" Apr 21 04:29:40.858: INFO: Pod "azurefile-volume-tester-nprwh": Phase="Pending", Reason="", readiness=false. Elapsed: 43.662283ms Apr 21 04:29:42.891: INFO: Pod "azurefile-volume-tester-nprwh": Phase="Pending", Reason="", readiness=false. Elapsed: 2.076634089s Apr 21 04:29:44.925: INFO: Pod "azurefile-volume-tester-nprwh": Phase="Pending", Reason="", readiness=false. Elapsed: 4.110377327s Apr 21 04:29:46.958: INFO: Pod "azurefile-volume-tester-nprwh": Phase="Pending", Reason="", readiness=false. Elapsed: 6.143927635s Apr 21 04:29:48.992: INFO: Pod "azurefile-volume-tester-nprwh": Phase="Pending", Reason="", readiness=false. Elapsed: 8.177270101s Apr 21 04:29:51.025: INFO: Pod "azurefile-volume-tester-nprwh": Phase="Pending", Reason="", readiness=false. Elapsed: 10.210891438s Apr 21 04:29:53.061: INFO: Pod "azurefile-volume-tester-nprwh": Phase="Running", Reason="", readiness=true. Elapsed: 12.247047532s Apr 21 04:29:55.095: INFO: Pod "azurefile-volume-tester-nprwh": Phase="Running", Reason="", readiness=true. Elapsed: 14.281003842s Apr 21 04:29:57.130: INFO: Pod "azurefile-volume-tester-nprwh": Phase="Running", Reason="", readiness=true. Elapsed: 16.315292658s Apr 21 04:29:59.165: INFO: Pod "azurefile-volume-tester-nprwh": Phase="Running", Reason="", readiness=true. Elapsed: 18.350203208s Apr 21 04:30:01.199: INFO: Pod "azurefile-volume-tester-nprwh": Phase="Succeeded", Reason="", readiness=false. Elapsed: 20.384477851s [1mSTEP[0m: Saw pod success Apr 21 04:30:01.199: INFO: Pod "azurefile-volume-tester-nprwh" satisfied condition "Succeeded or Failed" [1mSTEP[0m: setting up the PV [1mSTEP[0m: creating a PV [1mSTEP[0m: setting up the PVC [1mSTEP[0m: creating a PVC [1mSTEP[0m: waiting for PVC to be in phase "Bound" Apr 21 04:30:01.270: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-bznl5] to have phase Bound Apr 21 04:30:01.301: INFO: PersistentVolumeClaim pvc-bznl5 found and phase=Bound (31.433184ms) [1mSTEP[0m: checking the PVC [1mSTEP[0m: validating provisioned PV [1mSTEP[0m: checking the PV [1mSTEP[0m: deploying the pod [1mSTEP[0m: checking that the pods command exits with no error Apr 21 04:30:01.399: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-d6f5l" in namespace "azurefile-9103" to be "Succeeded or Failed" Apr 21 04:30:01.431: INFO: Pod "azurefile-volume-tester-d6f5l": Phase="Pending", Reason="", readiness=false. Elapsed: 31.78798ms Apr 21 04:30:03.466: INFO: Pod "azurefile-volume-tester-d6f5l": Phase="Pending", Reason="", readiness=false. Elapsed: 2.066990266s Apr 21 04:30:05.501: INFO: Pod "azurefile-volume-tester-d6f5l": Phase="Pending", Reason="", readiness=false. Elapsed: 4.101267112s Apr 21 04:30:07.534: INFO: Pod "azurefile-volume-tester-d6f5l": Phase="Pending", Reason="", readiness=false. Elapsed: 6.13490346s Apr 21 04:30:09.567: INFO: Pod "azurefile-volume-tester-d6f5l": Phase="Pending", Reason="", readiness=false. Elapsed: 8.168057461s Apr 21 04:30:11.601: INFO: Pod "azurefile-volume-tester-d6f5l": Phase="Pending", Reason="", readiness=false. Elapsed: 10.201177057s Apr 21 04:30:13.633: INFO: Pod "azurefile-volume-tester-d6f5l": Phase="Running", Reason="", readiness=true. Elapsed: 12.234125389s Apr 21 04:30:15.667: INFO: Pod "azurefile-volume-tester-d6f5l": Phase="Running", Reason="", readiness=true. Elapsed: 14.267976375s Apr 21 04:30:17.704: INFO: Pod "azurefile-volume-tester-d6f5l": Phase="Running", Reason="", readiness=true. Elapsed: 16.304489395s Apr 21 04:30:19.738: INFO: Pod "azurefile-volume-tester-d6f5l": Phase="Running", Reason="", readiness=true. Elapsed: 18.338441689s Apr 21 04:30:21.775: INFO: Pod "azurefile-volume-tester-d6f5l": Phase="Succeeded", Reason="", readiness=false. Elapsed: 20.37595515s [1mSTEP[0m: Saw pod success Apr 21 04:30:21.775: INFO: Pod "azurefile-volume-tester-d6f5l" satisfied condition "Succeeded or Failed" [1mSTEP[0m: setting up the PV [1mSTEP[0m: creating a PV [1mSTEP[0m: setting up the PVC [1mSTEP[0m: creating a PVC [1mSTEP[0m: waiting for PVC to be in phase "Bound" Apr 21 04:30:21.852: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-s69wc] to have phase Bound Apr 21 04:30:21.895: INFO: PersistentVolumeClaim pvc-s69wc found but phase is Pending instead of Bound. Apr 21 04:30:23.928: INFO: PersistentVolumeClaim pvc-s69wc found and phase=Bound (2.076064405s) [1mSTEP[0m: checking the PVC [1mSTEP[0m: validating provisioned PV [1mSTEP[0m: checking the PV [1mSTEP[0m: deploying the pod [1mSTEP[0m: checking that the pods command exits with no error Apr 21 04:30:24.027: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-sx2mw" in namespace "azurefile-9103" to be "Succeeded or Failed" Apr 21 04:30:24.064: INFO: Pod "azurefile-volume-tester-sx2mw": Phase="Pending", Reason="", readiness=false. Elapsed: 37.007961ms Apr 21 04:30:26.098: INFO: Pod "azurefile-volume-tester-sx2mw": Phase="Pending", Reason="", readiness=false. Elapsed: 2.071382616s Apr 21 04:30:28.132: INFO: Pod "azurefile-volume-tester-sx2mw": Phase="Pending", Reason="", readiness=false. Elapsed: 4.104587051s Apr 21 04:30:30.165: INFO: Pod "azurefile-volume-tester-sx2mw": Phase="Pending", Reason="", readiness=false. Elapsed: 6.13797623s Apr 21 04:30:32.200: INFO: Pod "azurefile-volume-tester-sx2mw": Phase="Pending", Reason="", readiness=false. Elapsed: 8.173359844s Apr 21 04:30:34.235: INFO: Pod "azurefile-volume-tester-sx2mw": Phase="Pending", Reason="", readiness=false. Elapsed: 10.207896322s Apr 21 04:30:36.271: INFO: Pod "azurefile-volume-tester-sx2mw": Phase="Running", Reason="", readiness=true. Elapsed: 12.243811857s Apr 21 04:30:38.305: INFO: Pod "azurefile-volume-tester-sx2mw": Phase="Running", Reason="", readiness=true. Elapsed: 14.27760719s Apr 21 04:30:40.339: INFO: Pod "azurefile-volume-tester-sx2mw": Phase="Running", Reason="", readiness=true. Elapsed: 16.312315099s Apr 21 04:30:42.373: INFO: Pod "azurefile-volume-tester-sx2mw": Phase="Running", Reason="", readiness=true. Elapsed: 18.345996539s Apr 21 04:30:44.407: INFO: Pod "azurefile-volume-tester-sx2mw": Phase="Succeeded", Reason="", readiness=false. Elapsed: 20.380135275s [1mSTEP[0m: Saw pod success Apr 21 04:30:44.407: INFO: Pod "azurefile-volume-tester-sx2mw" satisfied condition "Succeeded or Failed" [1mSTEP[0m: setting up the PV [1mSTEP[0m: creating a PV [1mSTEP[0m: setting up the PVC [1mSTEP[0m: creating a PVC [1mSTEP[0m: waiting for PVC to be in phase "Bound" Apr 21 04:30:44.474: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-djfpg] to have phase Bound Apr 21 04:30:44.506: INFO: PersistentVolumeClaim pvc-djfpg found and phase=Bound (31.653479ms) [1mSTEP[0m: checking the PVC [1mSTEP[0m: validating provisioned PV [1mSTEP[0m: checking the PV [1mSTEP[0m: deploying the pod [1mSTEP[0m: checking that the pods command exits with no error Apr 21 04:30:44.603: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-vbmjl" in namespace "azurefile-9103" to be "Succeeded or Failed" Apr 21 04:30:44.638: INFO: Pod "azurefile-volume-tester-vbmjl": Phase="Pending", Reason="", readiness=false. Elapsed: 34.713539ms Apr 21 04:30:46.670: INFO: Pod "azurefile-volume-tester-vbmjl": Phase="Pending", Reason="", readiness=false. Elapsed: 2.066946539s Apr 21 04:30:48.704: INFO: Pod "azurefile-volume-tester-vbmjl": Phase="Pending", Reason="", readiness=false. Elapsed: 4.101032201s Apr 21 04:30:50.738: INFO: Pod "azurefile-volume-tester-vbmjl": Phase="Pending", Reason="", readiness=false. Elapsed: 6.135198008s Apr 21 04:30:52.772: INFO: Pod "azurefile-volume-tester-vbmjl": Phase="Pending", Reason="", readiness=false. Elapsed: 8.169201279s Apr 21 04:30:54.808: INFO: Pod "azurefile-volume-tester-vbmjl": Phase="Pending", Reason="", readiness=false. Elapsed: 10.20471205s Apr 21 04:30:56.842: INFO: Pod "azurefile-volume-tester-vbmjl": Phase="Running", Reason="", readiness=true. Elapsed: 12.238897629s Apr 21 04:30:58.877: INFO: Pod "azurefile-volume-tester-vbmjl": Phase="Running", Reason="", readiness=true. Elapsed: 14.273931719s Apr 21 04:31:00.911: INFO: Pod "azurefile-volume-tester-vbmjl": Phase="Running", Reason="", readiness=true. Elapsed: 16.30763002s Apr 21 04:31:02.945: INFO: Pod "azurefile-volume-tester-vbmjl": Phase="Running", Reason="", readiness=true. Elapsed: 18.342182612s Apr 21 04:31:04.979: INFO: Pod "azurefile-volume-tester-vbmjl": Phase="Succeeded", Reason="", readiness=false. Elapsed: 20.375796333s [1mSTEP[0m: Saw pod success Apr 21 04:31:04.979: INFO: Pod "azurefile-volume-tester-vbmjl" satisfied condition "Succeeded or Failed" Apr 21 04:31:04.979: INFO: deleting Pod "azurefile-9103"/"azurefile-volume-tester-vbmjl" Apr 21 04:31:05.044: INFO: Pod azurefile-volume-tester-vbmjl has the following logs: hello world [1mSTEP[0m: Deleting pod azurefile-volume-tester-vbmjl in namespace azurefile-9103 Apr 21 04:31:05.085: INFO: deleting PVC "azurefile-9103"/"pvc-djfpg" Apr 21 04:31:05.085: INFO: Deleting PersistentVolumeClaim "pvc-djfpg" ... skipping 143 lines ... Apr 21 04:31:09.978: INFO: PersistentVolumeClaim pvc-zhx6j found but phase is Pending instead of Bound. Apr 21 04:31:12.011: INFO: PersistentVolumeClaim pvc-zhx6j found and phase=Bound (2.065190151s) [1mSTEP[0m: checking the PVC [1mSTEP[0m: validating provisioned PV [1mSTEP[0m: checking the PV [1mSTEP[0m: deploying the pod [1mSTEP[0m: checking that the pods command exits with no error Apr 21 04:31:12.110: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-v6ptr" in namespace "azurefile-8470" to be "Succeeded or Failed" Apr 21 04:31:12.142: INFO: Pod "azurefile-volume-tester-v6ptr": Phase="Pending", Reason="", readiness=false. Elapsed: 32.248046ms Apr 21 04:31:14.175: INFO: Pod "azurefile-volume-tester-v6ptr": Phase="Pending", Reason="", readiness=false. Elapsed: 2.065862158s Apr 21 04:31:16.208: INFO: Pod "azurefile-volume-tester-v6ptr": Phase="Pending", Reason="", readiness=false. Elapsed: 4.098791835s Apr 21 04:31:18.243: INFO: Pod "azurefile-volume-tester-v6ptr": Phase="Pending", Reason="", readiness=false. Elapsed: 6.133073784s Apr 21 04:31:20.277: INFO: Pod "azurefile-volume-tester-v6ptr": Phase="Pending", Reason="", readiness=false. Elapsed: 8.167271035s Apr 21 04:31:22.311: INFO: Pod "azurefile-volume-tester-v6ptr": Phase="Pending", Reason="", readiness=false. Elapsed: 10.201037501s Apr 21 04:31:24.345: INFO: Pod "azurefile-volume-tester-v6ptr": Phase="Pending", Reason="", readiness=false. Elapsed: 12.235483425s Apr 21 04:31:26.379: INFO: Pod "azurefile-volume-tester-v6ptr": Phase="Running", Reason="", readiness=true. Elapsed: 14.269833866s Apr 21 04:31:28.413: INFO: Pod "azurefile-volume-tester-v6ptr": Phase="Running", Reason="", readiness=true. Elapsed: 16.303853386s Apr 21 04:31:30.449: INFO: Pod "azurefile-volume-tester-v6ptr": Phase="Running", Reason="", readiness=true. Elapsed: 18.339029376s Apr 21 04:31:32.483: INFO: Pod "azurefile-volume-tester-v6ptr": Phase="Succeeded", Reason="", readiness=false. Elapsed: 20.373115223s [1mSTEP[0m: Saw pod success Apr 21 04:31:32.483: INFO: Pod "azurefile-volume-tester-v6ptr" satisfied condition "Succeeded or Failed" Apr 21 04:31:32.483: INFO: deleting Pod "azurefile-8470"/"azurefile-volume-tester-v6ptr" Apr 21 04:31:32.526: INFO: Pod azurefile-volume-tester-v6ptr has the following logs: hello world [1mSTEP[0m: Deleting pod azurefile-volume-tester-v6ptr in namespace azurefile-8470 Apr 21 04:31:32.568: INFO: deleting PVC "azurefile-8470"/"pvc-zhx6j" Apr 21 04:31:32.568: INFO: Deleting PersistentVolumeClaim "pvc-zhx6j" ... skipping 33 lines ... Apr 21 04:31:34.159: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-wtpj5] to have phase Bound Apr 21 04:31:34.191: INFO: PersistentVolumeClaim pvc-wtpj5 found and phase=Bound (31.501317ms) [1mSTEP[0m: checking the PVC [1mSTEP[0m: validating provisioned PV [1mSTEP[0m: checking the PV [1mSTEP[0m: deploying the pod [1mSTEP[0m: checking that the pods command exits with no error Apr 21 04:31:34.294: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-8frb6" in namespace "azurefile-7029" to be "Succeeded or Failed" Apr 21 04:31:34.325: INFO: Pod "azurefile-volume-tester-8frb6": Phase="Pending", Reason="", readiness=false. Elapsed: 31.486378ms Apr 21 04:31:36.359: INFO: Pod "azurefile-volume-tester-8frb6": Phase="Pending", Reason="", readiness=false. Elapsed: 2.064689716s Apr 21 04:31:38.392: INFO: Pod "azurefile-volume-tester-8frb6": Phase="Pending", Reason="", readiness=false. Elapsed: 4.097551956s Apr 21 04:31:40.424: INFO: Pod "azurefile-volume-tester-8frb6": Phase="Pending", Reason="", readiness=false. Elapsed: 6.129789084s Apr 21 04:31:42.458: INFO: Pod "azurefile-volume-tester-8frb6": Phase="Pending", Reason="", readiness=false. Elapsed: 8.163660265s Apr 21 04:31:44.492: INFO: Pod "azurefile-volume-tester-8frb6": Phase="Pending", Reason="", readiness=false. Elapsed: 10.197826481s ... skipping 2 lines ... Apr 21 04:31:50.596: INFO: Pod "azurefile-volume-tester-8frb6": Phase="Running", Reason="", readiness=true. Elapsed: 16.301669721s Apr 21 04:31:52.630: INFO: Pod "azurefile-volume-tester-8frb6": Phase="Running", Reason="", readiness=true. Elapsed: 18.335770194s Apr 21 04:31:54.663: INFO: Pod "azurefile-volume-tester-8frb6": Phase="Running", Reason="", readiness=true. Elapsed: 20.368737162s Apr 21 04:31:56.697: INFO: Pod "azurefile-volume-tester-8frb6": Phase="Running", Reason="", readiness=true. Elapsed: 22.402921444s Apr 21 04:31:58.730: INFO: Pod "azurefile-volume-tester-8frb6": Phase="Succeeded", Reason="", readiness=false. Elapsed: 24.436385868s [1mSTEP[0m: Saw pod success Apr 21 04:31:58.730: INFO: Pod "azurefile-volume-tester-8frb6" satisfied condition "Succeeded or Failed" Apr 21 04:31:58.730: INFO: deleting Pod "azurefile-7029"/"azurefile-volume-tester-8frb6" Apr 21 04:31:58.775: INFO: Pod azurefile-volume-tester-8frb6 has the following logs: hello world [1mSTEP[0m: Deleting pod azurefile-volume-tester-8frb6 in namespace azurefile-7029 Apr 21 04:31:58.831: INFO: deleting PVC "azurefile-7029"/"pvc-wtpj5" Apr 21 04:31:58.831: INFO: Deleting PersistentVolumeClaim "pvc-wtpj5" ... skipping 86 lines ... Platform: linux/amd64 Streaming logs below: I0421 04:06:49.285381 1 azurefile.go:267] driver userAgent: file.csi.azure.com/e2e-6a13648397110ae4586db2ee2bd9457c1a00fa53 gc/go1.18.1 (amd64-linux) e2e-test I0421 04:06:49.285780 1 azure.go:71] reading cloud config from secret kube-system/azure-cloud-provider I0421 04:06:49.300117 1 round_trippers.go:553] GET https://10.96.0.1:443/api/v1/namespaces/kube-system/secrets/azure-cloud-provider 404 Not Found in 14 milliseconds W0421 04:06:49.300391 1 azure.go:78] InitializeCloudFromSecret: failed to get cloud config from secret kube-system/azure-cloud-provider: failed to get secret kube-system/azure-cloud-provider: secrets "azure-cloud-provider" not found I0421 04:06:49.300421 1 azure.go:83] could not read cloud config from secret kube-system/azure-cloud-provider I0421 04:06:49.300433 1 azure.go:93] use default AZURE_CREDENTIAL_FILE env var: /etc/kubernetes/azure.json I0421 04:06:49.300473 1 azure.go:101] read cloud config from file: /etc/kubernetes/azure.json successfully I0421 04:06:49.301946 1 azure_auth.go:245] Using AzurePublicCloud environment I0421 04:06:49.302013 1 azure_auth.go:130] azure: using client_id+client_secret to retrieve access token I0421 04:06:49.302110 1 azure_diskclient.go:67] Azure DisksClient using API version: 2021-04-01 ... skipping 2918 lines ... Platform: windows/amd64 Streaming logs below: I0421 04:10:47.805065 6740 azurefile.go:267] driver userAgent: file.csi.azure.com/e2e-6a13648397110ae4586db2ee2bd9457c1a00fa53 gc/go1.18.1 (amd64-windows) e2e-test I0421 04:10:47.820330 6740 azure.go:71] reading cloud config from secret kube-system/azure-cloud-provider I0421 04:10:47.870787 6740 round_trippers.go:553] GET https://10.96.0.1:443/api/v1/namespaces/kube-system/secrets/azure-cloud-provider 404 Not Found in 39 milliseconds W0421 04:10:47.875474 6740 azure.go:78] InitializeCloudFromSecret: failed to get cloud config from secret kube-system/azure-cloud-provider: failed to get secret kube-system/azure-cloud-provider: secrets "azure-cloud-provider" not found I0421 04:10:47.875546 6740 azure.go:83] could not read cloud config from secret kube-system/azure-cloud-provider I0421 04:10:47.875938 6740 azure.go:93] use default AZURE_CREDENTIAL_FILE env var: C:\k\azure.json I0421 04:10:47.876019 6740 azure.go:101] read cloud config from file: C:\k\azure.json successfully I0421 04:10:47.878496 6740 azure_auth.go:245] Using AzurePublicCloud environment I0421 04:10:47.878916 6740 azure_auth.go:130] azure: using client_id+client_secret to retrieve access token I0421 04:10:47.883299 6740 azure_diskclient.go:67] Azure DisksClient using API version: 2021-04-01 ... skipping 1272 lines ... I0421 04:27:29.539856 6740 utils.go:76] GRPC call: /csi.v1.Node/NodeGetCapabilities I0421 04:27:29.539856 6740 utils.go:77] GRPC request: {} I0421 04:27:29.541316 6740 utils.go:83] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":2}}}]} I0421 04:27:29.548207 6740 utils.go:76] GRPC call: /csi.v1.Node/NodePublishVolume I0421 04:27:29.548207 6740 utils.go:77] GRPC request: {"target_path":"c:\\var\\lib\\kubelet\\pods\\ba42c385-94ba-47b6-9e55-63ea92da3659\\volumes\\kubernetes.io~csi\\test-volume-1\\mount","volume_capability":{"AccessType":{"Mount":{}},"access_mode":{"mode":7}},"volume_context":{"csi.storage.k8s.io/ephemeral":"true","csi.storage.k8s.io/pod.name":"azurefile-volume-tester-77g67","csi.storage.k8s.io/pod.namespace":"azurefile-4801","csi.storage.k8s.io/pod.uid":"ba42c385-94ba-47b6-9e55-63ea92da3659","csi.storage.k8s.io/serviceAccount.name":"default","mountOptions":"cache=singleclient","secretName":"azure-storage-account-fe0adf6af95b24b319cea4d-secret","server":"","shareName":"csi-inline-smb-volume"},"volume_id":"csi-bb6a97ac1b167527f2d20bc2b066b990f3207c02bd60f1e22de65f900247d08a"} I0421 04:27:29.548207 6740 nodeserver.go:68] NodePublishVolume: ephemeral volume(csi-bb6a97ac1b167527f2d20bc2b066b990f3207c02bd60f1e22de65f900247d08a) mount on c:\var\lib\kubelet\pods\ba42c385-94ba-47b6-9e55-63ea92da3659\volumes\kubernetes.io~csi\test-volume-1\mount, VolumeContext: map[csi.storage.k8s.io/ephemeral:true csi.storage.k8s.io/pod.name:azurefile-volume-tester-77g67 csi.storage.k8s.io/pod.namespace:azurefile-4801 csi.storage.k8s.io/pod.uid:ba42c385-94ba-47b6-9e55-63ea92da3659 csi.storage.k8s.io/serviceAccount.name:default getaccountkeyfromsecret:true mountOptions:cache=singleclient secretName:azure-storage-account-fe0adf6af95b24b319cea4d-secret secretnamespace:azurefile-4801 server: shareName:csi-inline-smb-volume storageaccount:] W0421 04:27:29.548207 6740 azurefile.go:546] parsing volumeID(csi-bb6a97ac1b167527f2d20bc2b066b990f3207c02bd60f1e22de65f900247d08a) return with error: error parsing volume id: "csi-bb6a97ac1b167527f2d20bc2b066b990f3207c02bd60f1e22de65f900247d08a", should at least contain two # I0421 04:27:29.559195 6740 round_trippers.go:553] GET https://10.96.0.1:443/api/v1/namespaces/azurefile-4801/secrets/azure-storage-account-fe0adf6af95b24b319cea4d-secret 200 OK in 8 milliseconds I0421 04:27:29.562600 6740 nodeserver.go:268] cifsMountPath(c:\var\lib\kubelet\pods\ba42c385-94ba-47b6-9e55-63ea92da3659\volumes\kubernetes.io~csi\test-volume-1\mount) fstype() volumeID(csi-bb6a97ac1b167527f2d20bc2b066b990f3207c02bd60f1e22de65f900247d08a) context(map[csi.storage.k8s.io/ephemeral:true csi.storage.k8s.io/pod.name:azurefile-volume-tester-77g67 csi.storage.k8s.io/pod.namespace:azurefile-4801 csi.storage.k8s.io/pod.uid:ba42c385-94ba-47b6-9e55-63ea92da3659 csi.storage.k8s.io/serviceAccount.name:default getaccountkeyfromsecret:true mountOptions:cache=singleclient secretName:azure-storage-account-fe0adf6af95b24b319cea4d-secret secretnamespace:azurefile-4801 server: shareName:csi-inline-smb-volume storageaccount:]) mountflags([]) mountOptions([AZURE\fe0adf6af95b24b319cea4d]) volumeMountGroup() I0421 04:27:29.562600 6740 safe_mounter_windows.go:163] IsLikelyNotMountPoint: c:\var\lib\kubelet\pods\ba42c385-94ba-47b6-9e55-63ea92da3659\volumes\kubernetes.io~csi\test-volume-1\mount I0421 04:27:29.562600 6740 safe_mounter_windows.go:220] Exists path: c:\var\lib\kubelet\pods\ba42c385-94ba-47b6-9e55-63ea92da3659\volumes\kubernetes.io~csi\test-volume-1\mount I0421 04:27:29.564234 6740 safe_mounter_windows.go:220] Exists path: c:\var\lib\kubelet\pods\ba42c385-94ba-47b6-9e55-63ea92da3659\volumes\kubernetes.io~csi\test-volume-1\mount I0421 04:27:29.564909 6740 azure_common_windows.go:73] Removing path: c:\var\lib\kubelet\pods\ba42c385-94ba-47b6-9e55-63ea92da3659\volumes\kubernetes.io~csi\test-volume-1\mount ... skipping 39 lines ... I0421 04:27:51.295386 6740 utils.go:76] GRPC call: /csi.v1.Node/NodeGetCapabilities I0421 04:27:51.295386 6740 utils.go:77] GRPC request: {} I0421 04:27:51.295386 6740 utils.go:83] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":2}}}]} I0421 04:27:51.298263 6740 utils.go:76] GRPC call: /csi.v1.Node/NodePublishVolume I0421 04:27:51.298303 6740 utils.go:77] GRPC request: {"target_path":"c:\\var\\lib\\kubelet\\pods\\ca8e0740-351c-4819-9e00-d736fc5c97a6\\volumes\\kubernetes.io~csi\\test-volume-1\\mount","volume_capability":{"AccessType":{"Mount":{}},"access_mode":{"mode":7}},"volume_context":{"csi.storage.k8s.io/ephemeral":"true","csi.storage.k8s.io/pod.name":"azurefile-volume-tester-rjh6m","csi.storage.k8s.io/pod.namespace":"azurefile-1166","csi.storage.k8s.io/pod.uid":"ca8e0740-351c-4819-9e00-d736fc5c97a6","csi.storage.k8s.io/serviceAccount.name":"default","mountOptions":"cache=singleclient","secretName":"smbcreds","server":"52.226.207.196","shareName":"share"},"volume_id":"csi-eb5ab26c4036386d8e5303a197634b131d24a26442f3d0d7a0a63d33c9e7eec3"} I0421 04:27:51.298560 6740 nodeserver.go:68] NodePublishVolume: ephemeral volume(csi-eb5ab26c4036386d8e5303a197634b131d24a26442f3d0d7a0a63d33c9e7eec3) mount on c:\var\lib\kubelet\pods\ca8e0740-351c-4819-9e00-d736fc5c97a6\volumes\kubernetes.io~csi\test-volume-1\mount, VolumeContext: map[csi.storage.k8s.io/ephemeral:true csi.storage.k8s.io/pod.name:azurefile-volume-tester-rjh6m csi.storage.k8s.io/pod.namespace:azurefile-1166 csi.storage.k8s.io/pod.uid:ca8e0740-351c-4819-9e00-d736fc5c97a6 csi.storage.k8s.io/serviceAccount.name:default getaccountkeyfromsecret:true mountOptions:cache=singleclient secretName:smbcreds secretnamespace:azurefile-1166 server:52.226.207.196 shareName:share storageaccount:] W0421 04:27:51.298665 6740 azurefile.go:546] parsing volumeID(csi-eb5ab26c4036386d8e5303a197634b131d24a26442f3d0d7a0a63d33c9e7eec3) return with error: error parsing volume id: "csi-eb5ab26c4036386d8e5303a197634b131d24a26442f3d0d7a0a63d33c9e7eec3", should at least contain two # I0421 04:27:51.302261 6740 round_trippers.go:553] GET https://10.96.0.1:443/api/v1/namespaces/azurefile-1166/secrets/smbcreds 200 OK in 3 milliseconds I0421 04:27:51.302868 6740 nodeserver.go:268] cifsMountPath(c:\var\lib\kubelet\pods\ca8e0740-351c-4819-9e00-d736fc5c97a6\volumes\kubernetes.io~csi\test-volume-1\mount) fstype() volumeID(csi-eb5ab26c4036386d8e5303a197634b131d24a26442f3d0d7a0a63d33c9e7eec3) context(map[csi.storage.k8s.io/ephemeral:true csi.storage.k8s.io/pod.name:azurefile-volume-tester-rjh6m csi.storage.k8s.io/pod.namespace:azurefile-1166 csi.storage.k8s.io/pod.uid:ca8e0740-351c-4819-9e00-d736fc5c97a6 csi.storage.k8s.io/serviceAccount.name:default getaccountkeyfromsecret:true mountOptions:cache=singleclient secretName:smbcreds secretnamespace:azurefile-1166 server:52.226.207.196 shareName:share storageaccount:]) mountflags([]) mountOptions([AZURE\USERNAME]) volumeMountGroup() I0421 04:27:51.302939 6740 safe_mounter_windows.go:163] IsLikelyNotMountPoint: c:\var\lib\kubelet\pods\ca8e0740-351c-4819-9e00-d736fc5c97a6\volumes\kubernetes.io~csi\test-volume-1\mount I0421 04:27:51.302967 6740 safe_mounter_windows.go:220] Exists path: c:\var\lib\kubelet\pods\ca8e0740-351c-4819-9e00-d736fc5c97a6\volumes\kubernetes.io~csi\test-volume-1\mount I0421 04:27:51.304472 6740 safe_mounter_windows.go:220] Exists path: c:\var\lib\kubelet\pods\ca8e0740-351c-4819-9e00-d736fc5c97a6\volumes\kubernetes.io~csi\test-volume-1\mount I0421 04:27:51.305084 6740 azure_common_windows.go:73] Removing path: c:\var\lib\kubelet\pods\ca8e0740-351c-4819-9e00-d736fc5c97a6\volumes\kubernetes.io~csi\test-volume-1\mount ... skipping 26 lines ... I0421 04:28:35.557184 6740 utils.go:76] GRPC call: /csi.v1.Node/NodeGetCapabilities I0421 04:28:35.557184 6740 utils.go:77] GRPC request: {} I0421 04:28:35.557184 6740 utils.go:83] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":2}}}]} I0421 04:28:35.558468 6740 utils.go:76] GRPC call: /csi.v1.Node/NodeStageVolume I0421 04:28:35.558468 6740 utils.go:77] GRPC request: {"staging_target_path":"\\var\\lib\\kubelet\\plugins\\kubernetes.io\\csi\\pv\\azurefile-5320-file.csi.azure.com-preprovsioned-pv-9wzg2\\globalmount","volume_capability":{"AccessType":{"Mount":{}},"access_mode":{"mode":7}},"volume_id":"capz-wu3n7j#f62084dbabd054de985d3f4#pre-provisioned-readonly##pre-provisioned-readonly"} I0421 04:28:35.563482 6740 round_trippers.go:553] GET https://10.96.0.1:443/api/v1/namespaces/default/secrets/azure-storage-account-f62084dbabd054de985d3f4-secret 404 Not Found in 2 milliseconds I0421 04:28:35.563651 6740 azurefile.go:616] could not get account(f62084dbabd054de985d3f4) key from secret(azure-storage-account-f62084dbabd054de985d3f4-secret), error: could not get secret(azure-storage-account-f62084dbabd054de985d3f4-secret): secrets "azure-storage-account-f62084dbabd054de985d3f4-secret" not found, use cluster identity to get account key instead (2022-04-21T04:28:35.5702371Z) INFO: REQUEST: POST https://login.microsoftonline.com/097f89a0-9286-43d2-9a1a-08f1d49b1af8/oauth2/token Content-Type: application/x-www-form-urlencoded User-Agent: Go/go1.18.1 (amd64-windows) go-autorest/adal/v1.0.0 (2022-04-21T04:28:35.8858617Z) INFO: RESPONSE: 200 https://login.microsoftonline.com/097f89a0-9286-43d2-9a1a-08f1d49b1af8/oauth2/token Content-Type: application/json; charset=utf-8 P3p: CP="DSP CUR OTPi IND OTRi ONL FIN" ... skipping 134 lines ... I0421 04:29:03.054070 6740 utils.go:77] GRPC request: {} I0421 04:29:03.054139 6740 utils.go:83] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":2}}}]} I0421 04:29:03.055881 6740 utils.go:76] GRPC call: /csi.v1.Node/NodePublishVolume I0421 04:29:03.055881 6740 utils.go:77] GRPC request: {"staging_target_path":"\\var\\lib\\kubelet\\plugins\\kubernetes.io\\csi\\pv\\azurefile-9103-file.csi.azure.com-preprovsioned-pv-8276d\\globalmount","target_path":"c:\\var\\lib\\kubelet\\pods\\7541b52f-f3e6-4447-b828-3495f17a069d\\volumes\\kubernetes.io~csi\\azurefile-9103-file.csi.azure.com-preprovsioned-pv-8276d\\mount","volume_capability":{"AccessType":{"Mount":{}},"access_mode":{"mode":7}},"volume_context":{"csi.storage.k8s.io/ephemeral":"false","csi.storage.k8s.io/pod.name":"azurefile-volume-tester-thtp4","csi.storage.k8s.io/pod.namespace":"azurefile-9103","csi.storage.k8s.io/pod.uid":"7541b52f-f3e6-4447-b828-3495f17a069d","csi.storage.k8s.io/serviceAccount.name":"default"},"volume_id":"capz-wu3n7j#f62084dbabd054de985d3f4#pre-provisioned-multiple-pods##pre-provisioned-multiple-pods1"} I0421 04:29:03.056455 6740 safe_mounter_windows.go:163] IsLikelyNotMountPoint: c:\var\lib\kubelet\pods\7541b52f-f3e6-4447-b828-3495f17a069d\volumes\kubernetes.io~csi\azurefile-9103-file.csi.azure.com-preprovsioned-pv-8276d\mount I0421 04:29:03.056455 6740 safe_mounter_windows.go:220] Exists path: c:\var\lib\kubelet\pods\7541b52f-f3e6-4447-b828-3495f17a069d\volumes\kubernetes.io~csi\azurefile-9103-file.csi.azure.com-preprovsioned-pv-8276d\mount W0421 04:29:03.145062 6740 nodeserver.go:489] ReadDir c:\var\lib\kubelet\pods\7541b52f-f3e6-4447-b828-3495f17a069d\volumes\kubernetes.io~csi\azurefile-9103-file.csi.azure.com-preprovsioned-pv-8276d\mount failed with open c:\var\lib\kubelet\pods\7541b52f-f3e6-4447-b828-3495f17a069d\volumes\kubernetes.io~csi\azurefile-9103-file.csi.azure.com-preprovsioned-pv-8276d\mount: Access is denied., unmount this directory I0421 04:29:03.145787 6740 safe_mounter_windows.go:147] Unmount: c:\var\lib\kubelet\pods\7541b52f-f3e6-4447-b828-3495f17a069d\volumes\kubernetes.io~csi\azurefile-9103-file.csi.azure.com-preprovsioned-pv-8276d\mount I0421 04:29:03.145787 6740 safe_mounter_windows.go:133] Remove directory: c:\var\lib\kubelet\pods\7541b52f-f3e6-4447-b828-3495f17a069d\volumes\kubernetes.io~csi\azurefile-9103-file.csi.azure.com-preprovsioned-pv-8276d\mount E0421 04:29:03.149171 6740 utils.go:81] GRPC error: rpc error: code = Internal desc = Could not mount target "c:\\var\\lib\\kubelet\\pods\\7541b52f-f3e6-4447-b828-3495f17a069d\\volumes\\kubernetes.io~csi\\azurefile-9103-file.csi.azure.com-preprovsioned-pv-8276d\\mount": open c:\var\lib\kubelet\pods\7541b52f-f3e6-4447-b828-3495f17a069d\volumes\kubernetes.io~csi\azurefile-9103-file.csi.azure.com-preprovsioned-pv-8276d\mount: Access is denied. I0421 04:29:16.349332 6740 utils.go:76] GRPC call: /csi.v1.Node/NodeGetCapabilities I0421 04:29:16.349371 6740 utils.go:77] GRPC request: {} I0421 04:29:16.349371 6740 utils.go:83] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":2}}}]} I0421 04:29:16.350495 6740 utils.go:76] GRPC call: /csi.v1.Node/NodeGetVolumeStats I0421 04:29:16.350495 6740 utils.go:77] GRPC request: {"volume_id":"capz-wu3n7j#f62084dbabd054de985d3f4#pre-provisioned-multiple-pods##pre-provisioned-multiple-pods1","volume_path":"c:\\var\\lib\\kubelet\\pods\\7541b52f-f3e6-4447-b828-3495f17a069d\\volumes\\kubernetes.io~csi\\azurefile-9103-file.csi.azure.com-preprovsioned-pv-8276d\\mount"} I0421 04:29:16.351439 6740 utils.go:83] GRPC response: {"usage":[{"available":117435953152,"total":136912564224,"unit":1,"used":19476611072},{"unit":2}]} ... skipping 578 lines ... Platform: windows/amd64 Streaming logs below: I0421 04:07:47.596997 6860 azurefile.go:267] driver userAgent: file.csi.azure.com/e2e-6a13648397110ae4586db2ee2bd9457c1a00fa53 gc/go1.18.1 (amd64-windows) e2e-test I0421 04:07:47.612692 6860 azure.go:71] reading cloud config from secret kube-system/azure-cloud-provider I0421 04:07:47.640073 6860 round_trippers.go:553] GET https://10.96.0.1:443/api/v1/namespaces/kube-system/secrets/azure-cloud-provider 404 Not Found in 22 milliseconds W0421 04:07:47.645643 6860 azure.go:78] InitializeCloudFromSecret: failed to get cloud config from secret kube-system/azure-cloud-provider: failed to get secret kube-system/azure-cloud-provider: secrets "azure-cloud-provider" not found I0421 04:07:47.645643 6860 azure.go:83] could not read cloud config from secret kube-system/azure-cloud-provider I0421 04:07:47.645643 6860 azure.go:93] use default AZURE_CREDENTIAL_FILE env var: C:\k\azure.json I0421 04:07:47.646366 6860 azure.go:101] read cloud config from file: C:\k\azure.json successfully I0421 04:07:47.648285 6860 azure_auth.go:245] Using AzurePublicCloud environment I0421 04:07:47.648886 6860 azure_auth.go:130] azure: using client_id+client_secret to retrieve access token I0421 04:07:47.653150 6860 azure_diskclient.go:67] Azure DisksClient using API version: 2021-04-01 ... skipping 595 lines ... JUnit report was created: /logs/artifacts/junit_01.xml [91m[1mSummarizing 1 Failure:[0m [91m[1m[Fail] [0m[90mDynamic Provisioning [0m[91m[1m[It] should create a volume on demand with mount options [kubernetes.io/azure-file] [file.csi.azure.com] [Windows] [0m [37m/home/prow/go/src/sigs.k8s.io/azurefile-csi-driver/test/e2e/testsuites/testsuites.go:691[0m [1m[91mRan 20 of 34 Specs in 1597.202 seconds[0m [1m[91mFAIL![0m -- [32m[1m19 Passed[0m | [91m[1m1 Failed[0m | [33m[1m0 Pending[0m | [36m[1m14 Skipped[0m [38;5;228mYou're using deprecated Ginkgo functionality:[0m [38;5;228m=============================================[0m [1m[38;5;10mGinkgo 2.0[0m is under active development and will introduce several new features, improvements, and a small handful of breaking changes. A release candidate for 2.0 is now available and 2.0 should GA in Fall 2021. [1mPlease give the RC a try and send us feedback![0m - To learn more, view the migration guide at [38;5;14m[4mhttps://github.com/onsi/ginkgo/blob/ver2/docs/MIGRATING_TO_V2.md[0m ... skipping 5 lines ... [38;5;9m[1mIf this change will be impactful to you please leave a comment on [38;5;14m[4mhttps://github.com/onsi/ginkgo/issues/711[0m[0m [1mLearn more at:[0m [38;5;14m[4mhttps://github.com/onsi/ginkgo/blob/ver2/docs/MIGRATING_TO_V2.md#removed-custom-reporters[0m [38;5;243mTo silence deprecations that can be silenced set the following environment variable:[0m [38;5;243mACK_GINKGO_DEPRECATIONS=1.16.5[0m --- FAIL: TestE2E (1597.21s) FAIL FAIL sigs.k8s.io/azurefile-csi-driver/test/e2e 1597.302s FAIL make: *** [Makefile:85: e2e-test] Error 1 make: Nothing to be done for 'kubectl'. ================ DUMPING LOGS FOR MANAGEMENT CLUSTER ================ Exported logs for cluster "capz" to: /logs/artifacts/management-cluster ================ DUMPING LOGS FOR WORKLOAD CLUSTER (Linux) ========== Deploying log-dump-daemonset ... skipping 81 lines ... daemonset.apps "log-dump-node-windows" deleted ================ REDACTING LOGS ================ All sensitive variables are redacted cluster.cluster.x-k8s.io "capz-wu3n7j" deleted kind delete cluster --name=capz || true Deleting cluster "capz" ... ERROR: failed to delete cluster "capz": failed to delete nodes: command "docker rm -f -v capz-control-plane" failed with error: exit status 1 Command Output: Error response from daemon: Could not kill running container 4a0e877b6678473f5f9e33ccf48ec0e77230350440235f6f7e7d67870ee8e2f2, cannot remove - tried to kill container, but did not receive an exit event kind delete cluster --name=capz-e2e || true Deleting cluster "capz-e2e" ... + EXIT_VALUE=2 + set +o xtrace Cleaning up after docker in docker. ================================================================================ Cleaning up after docker 533e7efca983 Error response from daemon: Could not kill running container 4a0e877b6678473f5f9e33ccf48ec0e77230350440235f6f7e7d67870ee8e2f2, cannot remove - tried to kill container, but did not receive an exit event Stopping Docker: dockerProgram process in pidfile '/var/run/docker-ssd.pid', 1 process(es), refused to die. ================================================================================ Done cleaning up after docker in docker.